: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:11.351442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:11.351447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:11.351451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:11.351454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:11.351457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:11.351460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:11.351463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:11.351466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:11.351470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:11.351473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:11.351476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:11.351479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:11.351482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:11.351485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:11.351488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:11.351491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:11.351495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:11.351498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:11.351501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:11.351504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:11.351508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:11.351511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:11.351514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:11.351517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:11.351520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:11.351553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:11.354063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:11.354489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:11.354501Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:11.354504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:11.354509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:11.354516Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2579 [2:7559602394838664061:11718]
2025-10-10T14:38:11.354532Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:11.354551Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:11.354554Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:11.354559Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:11.354561Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:11.354579Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:11.354588Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:11.354597Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:11.354659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:11.354667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:11.354669Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:11.354673Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:11.354746Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:11.354754Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:11.354766Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:11.354780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:11.354799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:11.354825Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602394838664056:11718]
2025-10-10T14:38:11.354833Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602394838664056:11718]
2025-10-10T14:38:11.354835Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602394838664056:11718]
2025-10-10T14:38:11.354849Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:11.354861Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:11.354868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602395620899004:11675], now have 1 active actors on pipe
2025-10-10T14:38:11.354870Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:11.354872Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:11.354872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602395620898828:2438], now have 1 active actors on pipe
2025-10-10T14:38:11.354881Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:11.354898Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:11.354906Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:11.354934Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602394838664056:11718]
2025-10-10T14:38:11.354949Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:11.354959Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:11.354953Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2579
2025-10-10T14:38:11.354979Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2579
2025-10-10T14:38:11.355041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:11.355051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:11.355087Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3321abb2-741c18b2-9b31e2b7-7a7c9c8d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:11.355099Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:11.355103Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:11.355107Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:11.355120Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:11.355136Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:11.355158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:11.355374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:11.355385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:11.355398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:11.355476Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2580 partition: 0 MaxSeqNo: 40 sessionId: src_id|3321abb2-741c18b2-9b31e2b7-7a7c9c8d_0
2025-10-10T14:38:11.355830Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|260cd8e1-d7fb18ed-3dd274fb-3c43c4bc_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|3321abb2-741c18b2-9b31e2b7-7a7c9c8d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:11.358662Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3321abb2-741c18b2-9b31e2b7-7a7c9c8d_0] Write session: try to update token
2025-10-10T14:38:11.358686Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3321abb2-741c18b2-9b31e2b7-7a7c9c8d_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:11.376325Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:11.376345Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:11.376349Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:11.376352Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:11.376362Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602394838664056:11718]
2025-10-10T14:38:11.376368Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602394838664056:11718]
2025-10-10T14:38:11.376374Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602394838664056:11718]
2025-10-10T14:38:11.376427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:11.376443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:11.376451Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:11.376595Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:11.377384Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2580 sessionId: src_id|3321abb2-741c18b2-9b31e2b7-7a7c9c8d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:11.380148Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:11.381391Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:11.381408Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:11.381414Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:11.413671Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602395620899042:11209]
2025-10-10T14:38:11.413997Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 pipe creation result: OK TabletId: 72075186224037892 Generation: 2579, pipe: [1:7559602395620899042:11209]
2025-10-10T14:38:11.500167Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:11.500701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:11.500718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:11.500764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602395620899042:11209], now have 1 active actors on pipe
2025-10-10T14:38:11.501026Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 78 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602395620899042:11209]
2025-10-10T14:38:11.501064Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:11.501067Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:11.501062Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:11.501131Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2580 reason: error at write: Disconnected sessionId: src_id|3321abb2-741c18b2-9b31e2b7-7a7c9c8d_0
2025-10-10T14:38:11.501393Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2580 sessionId: src_id|3321abb2-741c18b2-9b31e2b7-7a7c9c8d_0 is DEAD
2025-10-10T14:38:11.501740Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:11.502130Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3321abb2-741c18b2-9b31e2b7-7a7c9c8d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:11.502142Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3321abb2-741c18b2-9b31e2b7-7a7c9c8d_0] Write session will restart in 0.005457s
2025-10-10T14:38:11.502168Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3321abb2-741c18b2-9b31e2b7-7a7c9c8d_0] Write session: Do CDS request
2025-10-10T14:38:11.502176Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3321abb2-741c18b2-9b31e2b7-7a7c9c8d_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:11.509821Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3321abb2-741c18b2-9b31e2b7-7a7c9c8d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:11.509929Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:11.509948Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2581
2025-10-10T14:38:11.510637Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2581 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:11.510697Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2581 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:11.510708Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2581 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:11.510713Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:11.511346Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2581 sessionId:  describe result for acl check
2025-10-10T14:38:11.511382Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:11.511384Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:11.511386Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:11.511392Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602395620899086:11691] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:11.512492Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602395620899086:11691] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:11.514600Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602395620899086:11691] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:11.518473Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602395620899086:11691] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:11.518490Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602395620899086:11691] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:11.518494Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602395620899086:11691] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:11.518504Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2581 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:11.523256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:11.525062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:11.525291Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:11.525304Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:11.525316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:11.525408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:11.525453Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602394838664269:11732]
2025-10-10T14:38:11.526121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:11.526505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:11.526561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:11.526911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:11.526980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:11.526987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:11.526988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:11.526989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:11.526990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:11.526992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:11.526993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:11.526994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:11.526996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:11.526997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:11.526998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:11.527000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:11.527001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:11.527008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:11.527023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:11.527028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:11.527033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:11.527037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:11.527042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:11.527046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:11.527050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:11.527054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:11.527060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:11.527065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:11.527069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:11.527074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:11.527083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:11.527092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:11.527100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:11.527106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:11.527111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:11.527117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:11.527122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:11.527135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:11.527140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:11.527146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:11.527156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:11.527161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:11.527167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:11.527177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:11.527182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:11.527188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:11.527193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:11.527198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:11.527203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:11.527208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:11.527213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:11.527218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:11.527224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:11.527229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:11.527240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:11.527247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:11.527322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:11.530879Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2580
2025-10-10T14:38:11.530885Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2580
2025-10-10T14:38:11.530009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:11.530442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:11.530448Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:11.530451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:11.530456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:11.530463Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2580 [2:7559602394838664269:11732]
2025-10-10T14:38:11.530478Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:11.530499Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:11.530503Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:11.530508Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:11.530510Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:11.530528Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:11.530536Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:11.530547Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:11.530615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:11.530618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:11.530620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:11.530623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:11.530701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:11.530704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:11.530720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:11.530734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:11.530770Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:11.530793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602395620899185:11691], now have 1 active actors on pipe
2025-10-10T14:38:11.530797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602395620899061:2438], now have 1 active actors on pipe
2025-10-10T14:38:11.530805Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602394838664264:11732]
2025-10-10T14:38:11.530808Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602394838664264:11732]
2025-10-10T14:38:11.530810Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602394838664264:11732]
2025-10-10T14:38:11.530825Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:11.530841Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:11.530840Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:11.530844Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:11.530846Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:11.530858Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:11.530862Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:11.530894Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602394838664264:11732]
2025-10-10T14:38:11.530903Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:11.530909Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:11.531121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:11.531126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:11.531160Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a78a1f03-c01dfe23-d0f569dd-1099f0b5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:11.531170Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:11.531174Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:11.531177Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:11.531190Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:11.531222Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:11.531238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:11.531454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:11.531461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:11.531485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:11.531686Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2581 partition: 0 MaxSeqNo: 40 sessionId: src_id|a78a1f03-c01dfe23-d0f569dd-1099f0b5_0
2025-10-10T14:38:11.532125Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3321abb2-741c18b2-9b31e2b7-7a7c9c8d_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|a78a1f03-c01dfe23-d0f569dd-1099f0b5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:11.535004Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a78a1f03-c01dfe23-d0f569dd-1099f0b5_0] Write session: try to update token
2025-10-10T14:38:11.535025Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a78a1f03-c01dfe23-d0f569dd-1099f0b5_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:11.542880Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:38:11.542897Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:11.542909Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602394838664264:11732]
2025-10-10T14:38:11.542966Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:38:11.542969Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:38:11.543196Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:38:11.543345Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:11.543490Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:11.543633Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:11.543831Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:38:11.543878Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:38:11.549661Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2581 sessionId: src_id|a78a1f03-c01dfe23-d0f569dd-1099f0b5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:11.552444Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:11.552700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:11.552723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:11.552768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:38:11.552863Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:38:11.562217Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:11.562237Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:11.562241Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:11.562243Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:11.562254Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602394838664264:11732]
2025-10-10T14:38:11.562259Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602394838664264:11732]
2025-10-10T14:38:11.562264Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602394838664264:11732]
2025-10-10T14:38:11.562309Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:11.562318Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:11.562323Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:11.562327Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:11.562328Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:11.562330Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:11.562488Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:11.595996Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602395620899267:11209]
2025-10-10T14:38:11.596437Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 pipe creation result: OK TabletId: 72075186224037892 Generation: 2580, pipe: [1:7559602395620899267:11209]
2025-10-10T14:38:11.680865Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:11.689727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:11.689757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:11.689942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:11.690011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:11.690082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:11.690152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:11.690209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:11.690219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:11.690300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:11.690385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:11.690462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:11.690543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:11.690594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:11.690603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:11.690681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:11.690744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:11.690809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:11.690876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:11.690920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:11.690927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:11.690992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:11.691052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:11.691112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:11.691183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:11.691227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:11.691228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:11.691300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:11.691363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:11.691427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:11.691490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:11.691535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:11.691542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:11.691613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:11.691680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:11.691754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:11.691821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:11.691868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:11.691874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:11.691951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:11.692014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:11.692079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:11.692144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:11.692189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:11.692201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:11.692267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:11.692327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:11.692389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:11.692453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:11.692507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:11.692514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:11.692587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:11.692654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:11.692725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:11.692788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:11.692835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:11.692844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:11.692914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:11.692977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:11.693045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:11.693113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:11.693161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:11.693168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:11.693241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602395620899267:11209], now have 1 active actors on pipe
2025-10-10T14:38:11.693784Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:11.693803Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:11.693841Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2581 reason: error at write: Disconnected sessionId: src_id|a78a1f03-c01dfe23-d0f569dd-1099f0b5_0
2025-10-10T14:38:11.693846Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:11.693911Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 79 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602395620899267:11209]
2025-10-10T14:38:11.694096Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2581 sessionId: src_id|a78a1f03-c01dfe23-d0f569dd-1099f0b5_0 is DEAD
2025-10-10T14:38:11.694284Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a78a1f03-c01dfe23-d0f569dd-1099f0b5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:11.694296Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a78a1f03-c01dfe23-d0f569dd-1099f0b5_0] Write session will restart in 0.006498s
2025-10-10T14:38:11.694325Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a78a1f03-c01dfe23-d0f569dd-1099f0b5_0] Write session: Do CDS request
2025-10-10T14:38:11.694331Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a78a1f03-c01dfe23-d0f569dd-1099f0b5_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:11.694595Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:11.701890Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a78a1f03-c01dfe23-d0f569dd-1099f0b5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:11.701996Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:11.702021Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2582
2025-10-10T14:38:11.702163Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2582 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:11.702210Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2582 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:11.702223Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2582 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:11.702228Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:11.702894Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2582 sessionId:  describe result for acl check
2025-10-10T14:38:11.702932Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:11.702938Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:11.702940Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:11.702946Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602395620899293:11695] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:11.703505Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602395620899293:11695] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:11.706563Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602395620899293:11695] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:11.709666Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602395620899293:11695] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:11.709681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602395620899293:11695] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:11.709685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602395620899293:11695] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:11.709693Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2582 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:11.710884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:11.712754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:11.712973Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:11.712985Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:11.712998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:11.713054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:11.713100Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602394838664440:11736]
2025-10-10T14:38:11.713770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:11.714160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:11.714221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:11.714619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:11.714678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:11.714688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:11.714689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:11.714690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:11.714691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:11.714692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:11.714694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:11.714695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:11.714696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:11.714698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:11.714699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:11.714700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:11.714701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:11.714708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:11.714721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:11.714725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:11.714730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:11.714734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:11.714737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:11.714742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:11.714746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:11.714750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:11.714754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:11.714758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:11.714763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:11.714767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:11.714775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:11.714784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:11.714792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:11.714797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:11.714803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:11.714818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:11.714822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:11.714827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:11.714833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:11.714838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:11.714842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:11.714848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:11.714853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:11.714859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:11.714863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:11.714868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:11.714873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:11.714879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:11.714890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:11.714896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:11.714900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:11.714906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:11.714910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:11.714915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:11.714920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:11.714927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:11.714970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:11.717478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:11.718051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:11.718062Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:11.718064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:11.718067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:11.718074Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2581 [2:7559602394838664440:11736]
2025-10-10T14:38:11.718088Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:11.718109Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:11.718117Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:11.718121Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:11.718124Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:11.718141Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:11.718153Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:11.718161Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:11.718231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:11.718239Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:11.718241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:11.718243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:11.718313Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:11.718321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:11.718333Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:11.718356Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:11.718377Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:11.718402Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602394838664435:11736]
2025-10-10T14:38:11.718409Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602394838664435:11736]
2025-10-10T14:38:11.718412Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602394838664435:11736]
2025-10-10T14:38:11.718421Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:11.718428Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:11.718430Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:11.718432Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:11.718436Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:11.718451Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:11.718455Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:11.718467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602395620899270:2438], now have 1 active actors on pipe
2025-10-10T14:38:11.718470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602395620899456:11695], now have 1 active actors on pipe
2025-10-10T14:38:11.718498Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602394838664435:11736]
2025-10-10T14:38:11.718507Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:11.718530Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:11.718731Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2581
2025-10-10T14:38:11.718777Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2581
2025-10-10T14:38:11.719131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:11.719145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:11.719187Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7f71c3bc-7ba41114-b05da61e-573e0dbd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:11.719202Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:11.719211Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:11.719214Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:11.719226Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:11.719243Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:11.719260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:11.719722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:11.719731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:11.719752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:11.720001Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2582 partition: 0 MaxSeqNo: 40 sessionId: src_id|7f71c3bc-7ba41114-b05da61e-573e0dbd_0
2025-10-10T14:38:11.720426Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a78a1f03-c01dfe23-d0f569dd-1099f0b5_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|7f71c3bc-7ba41114-b05da61e-573e0dbd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:11.723365Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7f71c3bc-7ba41114-b05da61e-573e0dbd_0] Write session: try to update token
2025-10-10T14:38:11.723388Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7f71c3bc-7ba41114-b05da61e-573e0dbd_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:11.743966Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2582 sessionId: src_id|7f71c3bc-7ba41114-b05da61e-573e0dbd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:11.744711Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:11.744731Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:11.744735Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:11.744738Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:11.744748Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602394838664435:11736]
2025-10-10T14:38:11.744753Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602394838664435:11736]
2025-10-10T14:38:11.744758Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602394838664435:11736]
2025-10-10T14:38:11.744811Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:11.744816Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:11.744824Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:11.744824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:11.744827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:11.744829Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:11.744968Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:11.746860Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:11.794130Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602395620899477:11209]
2025-10-10T14:38:11.794583Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 pipe creation result: OK TabletId: 72075186224037892 Generation: 2581, pipe: [1:7559602395620899477:11209]
2025-10-10T14:38:11.868845Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:11.869287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:11.869299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:11.869414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602395620899477:11209], now have 1 active actors on pipe
2025-10-10T14:38:11.869749Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:11.870144Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 80 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602395620899477:11209]
2025-10-10T14:38:11.870185Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:11.870218Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:38:11.870298Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2582 reason: status is not ok: tablet will be restarted right now sessionId: src_id|7f71c3bc-7ba41114-b05da61e-573e0dbd_0
2025-10-10T14:38:11.870503Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2582 sessionId: src_id|7f71c3bc-7ba41114-b05da61e-573e0dbd_0 is DEAD
2025-10-10T14:38:11.870680Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f71c3bc-7ba41114-b05da61e-573e0dbd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:38:11.870691Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f71c3bc-7ba41114-b05da61e-573e0dbd_0] Write session will restart in 0.006232s
2025-10-10T14:38:11.870728Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f71c3bc-7ba41114-b05da61e-573e0dbd_0] Write session: Do CDS request
2025-10-10T14:38:11.870734Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f71c3bc-7ba41114-b05da61e-573e0dbd_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:11.881899Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7f71c3bc-7ba41114-b05da61e-573e0dbd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:11.882005Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:11.882022Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2583
2025-10-10T14:38:11.884020Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2583 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:11.884072Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2583 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:11.884083Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2583 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:11.884087Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:11.884595Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2583 sessionId:  describe result for acl check
2025-10-10T14:38:11.884640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:11.884648Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:11.884650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:11.884657Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602395620899637:11700] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:11.885215Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602395620899637:11700] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:11.887720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:11.888279Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602395620899637:11700] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:11.890387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:11.890624Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:11.890636Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:11.890648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:11.890710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:11.890764Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602394838664611:11738]
2025-10-10T14:38:11.891395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:11.891758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:11.891808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:11.892138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:11.892204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:11.892212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:11.892213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:11.892214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:11.892216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:11.892218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:11.892219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:11.892220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:11.892222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:11.892223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:11.892225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:11.892227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:11.892228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:11.892246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:11.892260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:11.892266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:11.892270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:11.892275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:11.892280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:11.892284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:11.892289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:11.892294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:11.892298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:11.892303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:11.892307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:11.892312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:11.892321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:11.892331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:11.892338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:11.892345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:11.892355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:11.892361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:11.892366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:11.892371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:11.892377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:11.892383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:11.892387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:11.892396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:11.892401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:11.892407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:11.892414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:11.892424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:11.892430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:11.892436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:11.892445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:11.892451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:11.892456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:11.892462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:11.892468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:11.892474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:11.892479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:11.892485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:11.892530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:11.892667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602395620899637:11700] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:11.892684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602395620899637:11700] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:11.892688Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602395620899637:11700] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:11.892698Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2583 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:11.895132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:11.895472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:11.895487Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:11.895491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:11.895495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:11.895501Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2582 [2:7559602394838664611:11738]
2025-10-10T14:38:11.895515Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:11.895535Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:11.895538Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:11.895542Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:11.895544Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:11.895562Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:11.895574Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:11.895585Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:11.895646Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:11.895654Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:11.895656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:11.895659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:11.895729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:11.895737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:11.895750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:11.895768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:11.895788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:11.895810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602395620899676:11700], now have 1 active actors on pipe
2025-10-10T14:38:11.895819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602395620899482:2438], now have 1 active actors on pipe
2025-10-10T14:38:11.895826Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602394838664606:11738]
2025-10-10T14:38:11.895828Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602394838664606:11738]
2025-10-10T14:38:11.895830Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602394838664606:11738]
2025-10-10T14:38:11.895845Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:11.895859Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:11.895861Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:11.895867Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:11.895869Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:11.895881Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:11.895884Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:11.895887Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2582
2025-10-10T14:38:11.895915Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602394838664606:11738]
2025-10-10T14:38:11.895928Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2582
2025-10-10T14:38:11.895942Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:11.895977Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:11.896134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:11.896145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:11.896177Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|99bfa91b-66cf0e79-21f479cf-5970e782_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:11.896189Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:11.896193Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:11.896198Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:11.896210Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:11.896225Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:11.896244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:11.896489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:11.896497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:11.896512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:11.896626Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2583 partition: 0 MaxSeqNo: 40 sessionId: src_id|99bfa91b-66cf0e79-21f479cf-5970e782_0
2025-10-10T14:38:11.897038Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f71c3bc-7ba41114-b05da61e-573e0dbd_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|99bfa91b-66cf0e79-21f479cf-5970e782_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:11.899988Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|99bfa91b-66cf0e79-21f479cf-5970e782_0] Write session: try to update token
2025-10-10T14:38:11.900013Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|99bfa91b-66cf0e79-21f479cf-5970e782_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:11.907837Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:38:11.907855Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:11.907866Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602394838664606:11738]
2025-10-10T14:38:11.907917Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:38:11.907920Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:38:11.908105Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:38:11.908248Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:11.908388Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:11.908528Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:11.908723Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:38:11.908768Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:38:11.915329Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2583 sessionId: src_id|99bfa91b-66cf0e79-21f479cf-5970e782_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:11.917872Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:11.918407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:11.918431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:11.918475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:38:11.918578Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:38:11.936184Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:11.936206Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:11.936211Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:11.936214Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:11.936226Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602394838664606:11738]
2025-10-10T14:38:11.936232Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602394838664606:11738]
2025-10-10T14:38:11.936236Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602394838664606:11738]
2025-10-10T14:38:11.936314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:11.936323Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:11.936326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:11.936325Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:11.936337Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:11.936342Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:11.936489Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:11.973407Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602395620899684:11209]
2025-10-10T14:38:11.973755Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 pipe creation result: OK TabletId: 72075186224037892 Generation: 2582, pipe: [1:7559602395620899684:11209]
2025-10-10T14:38:12.053180Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:12.061503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:12.061527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:12.061711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:12.061778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:12.061848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:12.061922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:12.061967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:12.061976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:12.065187Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:12.065201Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:12.065243Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2583 reason: error at write: Disconnected sessionId: src_id|99bfa91b-66cf0e79-21f479cf-5970e782_0
2025-10-10T14:38:12.062048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:12.065355Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:12.062122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:12.062186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:12.062244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:12.062285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:12.062288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:12.062373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:12.062436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:12.062501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:12.062560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:12.062604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:12.062608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:12.062683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:12.062754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:12.062816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:12.065418Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 81 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602395620899684:11209]
2025-10-10T14:38:12.062882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:12.062926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:12.062929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:12.063005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:12.063066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:12.063136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:12.063198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:12.063243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:12.063246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:12.063313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:12.063375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:12.063436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:12.063501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:12.063543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:12.063546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:12.063615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:12.065470Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2583 sessionId: src_id|99bfa91b-66cf0e79-21f479cf-5970e782_0 is DEAD
2025-10-10T14:38:12.063674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:12.063740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:12.063800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:12.063840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:12.063843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:12.063919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:12.063984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:12.064043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:12.064103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:12.064151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:12.064154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:12.064226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:12.064282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:12.064342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:12.064409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:12.064460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:12.064463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:12.064531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:12.064591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:12.064653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:12.064713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:12.064753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:12.064760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:12.064832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602395620899684:11209], now have 1 active actors on pipe
2025-10-10T14:38:12.065704Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99bfa91b-66cf0e79-21f479cf-5970e782_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:12.065712Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99bfa91b-66cf0e79-21f479cf-5970e782_0] Write session will restart in 0.009730s
2025-10-10T14:38:12.065737Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99bfa91b-66cf0e79-21f479cf-5970e782_0] Write session: Do CDS request
2025-10-10T14:38:12.065743Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99bfa91b-66cf0e79-21f479cf-5970e782_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:12.066216Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:12.076971Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|99bfa91b-66cf0e79-21f479cf-5970e782_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:12.077037Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:12.077054Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2584
2025-10-10T14:38:12.077239Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2584 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:12.077294Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2584 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:12.077306Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2584 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:12.077310Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:12.077873Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2584 sessionId:  describe result for acl check
2025-10-10T14:38:12.077913Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:12.077915Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:12.077917Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:12.077923Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602399915866998:11704] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:12.078490Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602399915866998:11704] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:12.083128Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602399915866998:11704] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:12.086167Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602399915866998:11704] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:12.086182Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602399915866998:11704] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:12.086186Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602399915866998:11704] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:12.086195Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2584 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:12.086650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:12.088322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:12.088545Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:12.088559Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:12.088573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:12.088635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:12.088680Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602399133632082:11740]
2025-10-10T14:38:12.089307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:12.089643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:12.089684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:12.090008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:12.090067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:12.090073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:12.090074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:12.090075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:12.090077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:12.090078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:12.090079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:12.090081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:12.090082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:12.090083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:12.090085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:12.090086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:12.090087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:12.090092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:12.090107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:12.090111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:12.090116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:12.090120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:12.090124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:12.090128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:12.090131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:12.090135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:12.090139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:12.090144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:12.090148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:12.090152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:12.090160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:12.090169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:12.090178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:12.090184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:12.090189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:12.090194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:12.090199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:12.090204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:12.090208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:12.090213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:12.090218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:12.090223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:12.090228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:12.090235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:12.090246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:12.090251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:12.090256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:12.090265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:12.090269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:12.090274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:12.090284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:12.090290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:12.090300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:12.090305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:12.090314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:12.090319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:12.090368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:12.092795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:12.093348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:12.093364Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:12.093366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:12.093370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:12.093376Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2583 [2:7559602399133632082:11740]
2025-10-10T14:38:12.093389Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:12.093408Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:12.093412Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:12.093415Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:12.093418Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:12.093434Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:12.093442Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:12.093451Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:12.093511Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:12.093513Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:12.093515Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:12.093517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:12.093587Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:12.093590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:12.093600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:12.093611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:12.093627Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:12.093656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602399915867173:11704], now have 1 active actors on pipe
2025-10-10T14:38:12.093659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602399915866983:2438], now have 1 active actors on pipe
2025-10-10T14:38:12.093667Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602399133632077:11740]
2025-10-10T14:38:12.093669Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602399133632077:11740]
2025-10-10T14:38:12.093671Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602399133632077:11740]
2025-10-10T14:38:12.093687Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:12.093699Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:12.093702Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:12.093703Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:12.093705Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:12.093718Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:12.093722Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:12.093746Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602399133632077:11740]
2025-10-10T14:38:12.093755Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:12.093776Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:12.093869Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2583
2025-10-10T14:38:12.093908Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2583
2025-10-10T14:38:12.094081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:12.094094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:12.094127Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|28c97c8-d0fdef4e-dc7ba1d8-f5148c6c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:12.094136Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:12.094140Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:12.094143Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:12.094157Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:12.094171Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:12.094186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:12.094410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:12.094417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:12.094434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:12.094594Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2584 partition: 0 MaxSeqNo: 40 sessionId: src_id|28c97c8-d0fdef4e-dc7ba1d8-f5148c6c_0
2025-10-10T14:38:12.095100Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99bfa91b-66cf0e79-21f479cf-5970e782_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|28c97c8-d0fdef4e-dc7ba1d8-f5148c6c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:12.098173Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|28c97c8-d0fdef4e-dc7ba1d8-f5148c6c_0] Write session: try to update token
2025-10-10T14:38:12.098197Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|28c97c8-d0fdef4e-dc7ba1d8-f5148c6c_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:12.120282Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2584 sessionId: src_id|28c97c8-d0fdef4e-dc7ba1d8-f5148c6c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:12.124097Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:12.125253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:12.125283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:12.125310Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:12.125314Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:12.125317Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:12.125320Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:12.125350Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602399133632077:11740]
2025-10-10T14:38:12.125356Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602399133632077:11740]
2025-10-10T14:38:12.125360Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602399133632077:11740]
2025-10-10T14:38:12.125410Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:12.125424Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:12.125426Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:12.125429Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:12.125434Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:12.125437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:12.125578Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:12.165831Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602399915867185:11209]
2025-10-10T14:38:12.166029Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 pipe creation result: OK TabletId: 72075186224037892 Generation: 2583, pipe: [1:7559602399915867185:11209]
2025-10-10T14:38:12.250473Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:12.250878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:38:12.250942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602399915867185:11209], now have 1 active actors on pipe
2025-10-10T14:38:12.251043Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:38:12.251279Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 82 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602399915867185:11209]
2025-10-10T14:38:12.251322Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:12.264957Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:12.264974Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:12.265008Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2584 reason: error at write: Disconnected sessionId: src_id|28c97c8-d0fdef4e-dc7ba1d8-f5148c6c_0
2025-10-10T14:38:12.265167Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2584 sessionId: src_id|28c97c8-d0fdef4e-dc7ba1d8-f5148c6c_0 is DEAD
2025-10-10T14:38:12.265636Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28c97c8-d0fdef4e-dc7ba1d8-f5148c6c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:12.265648Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28c97c8-d0fdef4e-dc7ba1d8-f5148c6c_0] Write session will restart in 0.006405s
2025-10-10T14:38:12.265673Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28c97c8-d0fdef4e-dc7ba1d8-f5148c6c_0] Write session: Do CDS request
2025-10-10T14:38:12.265681Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28c97c8-d0fdef4e-dc7ba1d8-f5148c6c_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:12.272900Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|28c97c8-d0fdef4e-dc7ba1d8-f5148c6c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:12.273287Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:12.273306Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2585
2025-10-10T14:38:12.273491Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2585 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:12.273526Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2585 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:12.273532Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2585 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:12.273536Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:12.274005Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2585 sessionId:  describe result for acl check
2025-10-10T14:38:12.274042Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:12.274044Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:12.274046Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:12.274054Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602399915867290:11708] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:12.274660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602399915867290:11708] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:12.280723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602399915867290:11708] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:12.287986Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602399915867290:11708] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:12.288004Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602399915867290:11708] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:12.288008Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602399915867290:11708] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:12.288017Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2585 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:12.288950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:12.291763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:12.291994Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:12.292000Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:12.292013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:12.292105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:12.292143Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602399133632258:11743]
2025-10-10T14:38:12.292798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:12.293138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:12.293179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:12.293511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:12.293569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:12.293571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:12.293573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:12.293574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:12.293576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:12.293577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:12.293579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:12.293580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:12.293581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:12.293583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:12.293585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:12.293586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:12.293588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:12.293594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:12.293608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:12.293612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:12.293617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:12.293621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:12.293626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:12.293631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:12.293635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:12.293639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:12.293644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:12.293648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:12.293652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:12.293657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:12.293665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:12.293674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:12.293681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:12.293687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:12.293693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:12.293699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:12.293703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:12.293709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:12.293713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:12.293718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:12.293723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:12.293731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:12.293736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:12.293741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:12.293745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:12.293751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:12.293756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:12.293761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:12.293765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:12.293771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:12.293776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:12.293781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:12.293786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:12.293791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:12.293795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:12.293802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:12.293847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:12.296868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:12.297543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:12.297549Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:12.297551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:12.297556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:12.297563Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2584 [2:7559602399133632258:11743]
2025-10-10T14:38:12.297578Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:12.297599Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:12.297604Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:12.297608Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:12.297610Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:12.297630Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:12.297638Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:12.297648Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:12.297715Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:12.297718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:12.297721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:12.297724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:12.297799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:12.297803Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:12.297817Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:12.297830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:12.297849Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:12.297871Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602399133632252:11743]
2025-10-10T14:38:12.297874Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602399133632252:11743]
2025-10-10T14:38:12.297877Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602399133632252:11743]
2025-10-10T14:38:12.297886Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:12.297898Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:12.297901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602399915867378:11708], now have 1 active actors on pipe
2025-10-10T14:38:12.297902Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:12.297905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602399915867188:2438], now have 1 active actors on pipe
2025-10-10T14:38:12.297905Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:12.297913Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:12.297929Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:12.297933Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:12.297964Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602399133632252:11743]
2025-10-10T14:38:12.297974Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:12.298293Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2584
2025-10-10T14:38:12.298323Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2584
2025-10-10T14:38:12.298413Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:12.302036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:12.302059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:12.302110Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d6eb8893-5d3e4fd8-1432645f-193a4f86_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:12.302124Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:12.302131Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:12.302134Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:12.302154Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:12.302174Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:12.302198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:12.305172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:12.305190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:12.305230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:12.305986Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2585 partition: 0 MaxSeqNo: 40 sessionId: src_id|d6eb8893-5d3e4fd8-1432645f-193a4f86_0
2025-10-10T14:38:12.306484Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28c97c8-d0fdef4e-dc7ba1d8-f5148c6c_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|d6eb8893-5d3e4fd8-1432645f-193a4f86_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:12.309212Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6eb8893-5d3e4fd8-1432645f-193a4f86_0] Write session: try to update token
2025-10-10T14:38:12.309233Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6eb8893-5d3e4fd8-1432645f-193a4f86_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:12.324531Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:12.324556Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:12.324560Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:12.324563Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:12.324574Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602399133632252:11743]
2025-10-10T14:38:12.324580Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602399133632252:11743]
2025-10-10T14:38:12.324585Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602399133632252:11743]
2025-10-10T14:38:12.324643Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:12.324652Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:12.324655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:12.324823Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:12.326300Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2585 sessionId: src_id|d6eb8893-5d3e4fd8-1432645f-193a4f86_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:12.329090Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:12.329236Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:12.329253Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:12.329259Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:12.353453Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602399915867392:11209]
2025-10-10T14:38:12.353981Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 pipe creation result: OK TabletId: 72075186224037892 Generation: 2584, pipe: [1:7559602399915867392:11209]
2025-10-10T14:38:12.440226Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:12.440587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:12.440602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:12.440652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602399915867392:11209], now have 1 active actors on pipe
2025-10-10T14:38:12.440916Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:12.440932Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 83 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602399915867392:11209]
2025-10-10T14:38:12.440937Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:12.440956Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:12.441006Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2585 reason: error at write: Disconnected sessionId: src_id|d6eb8893-5d3e4fd8-1432645f-193a4f86_0
2025-10-10T14:38:12.441198Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2585 sessionId: src_id|d6eb8893-5d3e4fd8-1432645f-193a4f86_0 is DEAD
2025-10-10T14:38:12.441378Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6eb8893-5d3e4fd8-1432645f-193a4f86_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:12.441390Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6eb8893-5d3e4fd8-1432645f-193a4f86_0] Write session will restart in 0.008820s
2025-10-10T14:38:12.441417Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6eb8893-5d3e4fd8-1432645f-193a4f86_0] Write session: Do CDS request
2025-10-10T14:38:12.441424Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6eb8893-5d3e4fd8-1432645f-193a4f86_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:12.441397Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:12.451943Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6eb8893-5d3e4fd8-1432645f-193a4f86_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:12.451992Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:12.452019Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2586
2025-10-10T14:38:12.452190Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2586 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:12.452226Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2586 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:12.452236Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2586 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:12.452240Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:12.452725Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2586 sessionId:  describe result for acl check
2025-10-10T14:38:12.452763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:12.452773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:12.452775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:12.452781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602399915867559:11713] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:12.453372Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602399915867559:11713] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:12.455050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:12.455914Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602399915867559:11713] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:12.456651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:12.456842Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:12.456854Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:12.456867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:12.456948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:12.456988Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602399133632444:11746]
2025-10-10T14:38:12.457646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:12.458024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:12.458091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:12.458283Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602399915867559:11713] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:12.458299Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602399915867559:11713] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:12.458303Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602399915867559:11713] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:12.458311Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2586 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:12.458473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:12.458545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:12.458551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:12.458552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:12.458553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:12.458555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:12.458556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:12.458557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:12.458559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:12.458561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:12.458562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:12.458563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:12.458565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:12.458566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:12.458572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:12.458586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:12.458590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:12.458594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:12.458598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:12.458603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:12.458607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:12.458611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:12.458615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:12.458619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:12.458622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:12.458626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:12.458630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:12.458640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:12.458648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:12.458656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:12.458662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:12.458666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:12.458670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:12.458674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:12.458679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:12.458684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:12.458689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:12.458694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:12.458699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:12.458703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:12.458709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:12.458713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:12.458718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:12.458723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:12.458728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:12.458733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:12.458738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:12.458747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:12.458752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:12.458763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:12.458768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:12.458773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:12.458778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:12.458832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:12.461285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:12.461652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:12.461667Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:12.461669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:12.461674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:12.461681Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2585 [2:7559602399133632444:11746]
2025-10-10T14:38:12.461694Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:12.461713Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:12.461716Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:12.461720Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:12.461723Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:12.461741Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:12.461754Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:12.461773Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:12.461847Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:12.461857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:12.461859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:12.461862Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:12.461932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:12.461942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:12.461954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:12.461971Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:12.461993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:12.462018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602399915867601:11713], now have 1 active actors on pipe
2025-10-10T14:38:12.462028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602399915867405:2438], now have 1 active actors on pipe
2025-10-10T14:38:12.462035Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602399133632439:11746]
2025-10-10T14:38:12.462036Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602399133632439:11746]
2025-10-10T14:38:12.462038Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602399133632439:11746]
2025-10-10T14:38:12.462053Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:12.462069Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:12.462070Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:12.462075Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:12.462077Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:12.462085Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:12.462089Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:12.462103Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2585
2025-10-10T14:38:12.462103Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2585
2025-10-10T14:38:12.462122Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602399133632439:11746]
2025-10-10T14:38:12.462131Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:12.462150Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:12.462295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:12.462305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:12.462355Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5e3c01cc-ad488497-3be231cc-c453b53a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:12.462367Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:12.462371Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:12.462374Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:12.462386Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:12.462398Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:12.462413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:12.462875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:12.462904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:12.462936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:12.463054Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2586 partition: 0 MaxSeqNo: 40 sessionId: src_id|5e3c01cc-ad488497-3be231cc-c453b53a_0
2025-10-10T14:38:12.463463Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6eb8893-5d3e4fd8-1432645f-193a4f86_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|5e3c01cc-ad488497-3be231cc-c453b53a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:12.466308Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5e3c01cc-ad488497-3be231cc-c453b53a_0] Write session: try to update token
2025-10-10T14:38:12.466344Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5e3c01cc-ad488497-3be231cc-c453b53a_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:12.481136Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2586 sessionId: src_id|5e3c01cc-ad488497-3be231cc-c453b53a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:12.483566Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:12.483590Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:12.483599Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:12.483601Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:12.483611Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602399133632439:11746]
2025-10-10T14:38:12.483616Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602399133632439:11746]
2025-10-10T14:38:12.483620Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602399133632439:11746]
2025-10-10T14:38:12.483674Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:12.483675Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:12.483682Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:12.483682Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:12.483685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:12.483697Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:12.483843Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:12.484125Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:12.541143Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602399915867624:11209]
2025-10-10T14:38:12.541507Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 pipe creation result: OK TabletId: 72075186224037892 Generation: 2585, pipe: [1:7559602399915867624:11209]
2025-10-10T14:38:12.599615Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:12.600097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:12.600113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:12.600161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602399915867624:11209], now have 1 active actors on pipe
2025-10-10T14:38:12.600405Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:12.600425Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 84 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602399915867624:11209]
2025-10-10T14:38:12.600425Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:12.600430Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:12.600456Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:12.600511Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2586 reason: error at write: Disconnected sessionId: src_id|5e3c01cc-ad488497-3be231cc-c453b53a_0
2025-10-10T14:38:12.600724Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2586 sessionId: src_id|5e3c01cc-ad488497-3be231cc-c453b53a_0 is DEAD
2025-10-10T14:38:12.600881Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e3c01cc-ad488497-3be231cc-c453b53a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:12.600891Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e3c01cc-ad488497-3be231cc-c453b53a_0] Write session will restart in 0.006512s
2025-10-10T14:38:12.600916Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e3c01cc-ad488497-3be231cc-c453b53a_0] Write session: Do CDS request
2025-10-10T14:38:12.600925Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e3c01cc-ad488497-3be231cc-c453b53a_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:12.608937Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5e3c01cc-ad488497-3be231cc-c453b53a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:12.609047Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:12.609063Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2587
2025-10-10T14:38:12.609222Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2587 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:12.609286Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2587 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:12.609299Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2587 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:12.609304Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:12.609841Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2587 sessionId:  describe result for acl check
2025-10-10T14:38:12.609877Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:12.609885Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:12.609887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:12.609894Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602399915867703:11726] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:12.610485Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602399915867703:11726] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:12.613199Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602399915867703:11726] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:12.615905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:12.616019Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602399915867703:11726] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:12.616034Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602399915867703:11726] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:12.616038Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602399915867703:11726] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:12.616047Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2587 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:12.618109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:12.618380Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:12.618391Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:12.618405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:12.618471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:12.618524Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602399133632659:11761]
2025-10-10T14:38:12.619192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:12.619630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:12.619698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:12.620036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:12.620099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:12.620105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:12.620107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:12.620108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:12.620109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:12.620111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:12.620112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:12.620113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:12.620114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:12.620115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:12.620116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:12.620118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:12.620119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:12.620125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:12.620137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:12.620142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:12.620145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:12.620149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:12.620153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:12.620157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:12.620161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:12.620164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:12.620169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:12.620172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:12.620177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:12.620180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:12.620189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:12.620197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:12.620203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:12.620208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:12.620212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:12.620217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:12.620220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:12.620226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:12.620231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:12.620236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:12.620240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:12.620244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:12.620248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:12.620253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:12.620257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:12.620262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:12.620268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:12.620272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:12.620276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:12.620280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:12.620284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:12.620288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:12.620292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:12.620297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:12.620301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:12.620308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:12.620346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:12.623409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:12.623883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:12.623896Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:12.623898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:12.623902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:12.623909Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2586 [2:7559602399133632659:11761]
2025-10-10T14:38:12.623923Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:12.623942Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:12.623946Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:12.623950Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:12.623952Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:12.623972Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:12.623985Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:12.623992Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:12.624053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:12.624062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:12.624064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:12.624067Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:12.624135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:12.624142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:12.624153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:12.624166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:12.624188Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:12.624212Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602399133632653:11761]
2025-10-10T14:38:12.624219Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602399133632653:11761]
2025-10-10T14:38:12.624221Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602399133632653:11761]
2025-10-10T14:38:12.624231Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:12.624240Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:12.624248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602399915867829:11726], now have 1 active actors on pipe
2025-10-10T14:38:12.624248Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:12.624250Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:12.624254Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:12.624270Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:12.624278Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:12.624284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602399915867636:2438], now have 1 active actors on pipe
2025-10-10T14:38:12.624310Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602399133632653:11761]
2025-10-10T14:38:12.624322Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:12.624407Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2586
2025-10-10T14:38:12.624472Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:12.624545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:12.624552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:12.624595Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|20e48032-deea6956-5c355eb-68a9f5e4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:12.624603Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:12.624607Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:12.624610Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:12.624622Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:12.624634Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:12.624649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:12.624877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:12.624886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:12.624880Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2586
2025-10-10T14:38:12.624903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:12.625020Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2587 partition: 0 MaxSeqNo: 40 sessionId: src_id|20e48032-deea6956-5c355eb-68a9f5e4_0
2025-10-10T14:38:12.625462Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e3c01cc-ad488497-3be231cc-c453b53a_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|20e48032-deea6956-5c355eb-68a9f5e4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:12.628310Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|20e48032-deea6956-5c355eb-68a9f5e4_0] Write session: try to update token
2025-10-10T14:38:12.628328Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|20e48032-deea6956-5c355eb-68a9f5e4_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:12.644625Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2587 sessionId: src_id|20e48032-deea6956-5c355eb-68a9f5e4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:12.647506Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:12.647939Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:12.647956Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:12.647960Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:12.647962Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:12.647976Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602399133632653:11761]
2025-10-10T14:38:12.647981Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602399133632653:11761]
2025-10-10T14:38:12.647985Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602399133632653:11761]
2025-10-10T14:38:12.648031Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:12.648040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:12.648053Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:12.648058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:12.648060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:12.648079Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:12.648412Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:12.700519Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602399915867842:11209]
2025-10-10T14:38:12.701360Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 pipe creation result: OK TabletId: 72075186224037892 Generation: 2586, pipe: [1:7559602399915867842:11209]
2025-10-10T14:38:12.766288Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:12.766670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:12.766688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:12.766738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602399915867842:11209], now have 1 active actors on pipe
2025-10-10T14:38:12.767023Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:12.767523Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20e48032-deea6956-5c355eb-68a9f5e4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:12.767535Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20e48032-deea6956-5c355eb-68a9f5e4_0] Write session will restart in 0.008432s
2025-10-10T14:38:12.767044Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:12.767067Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:12.767074Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:12.767569Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20e48032-deea6956-5c355eb-68a9f5e4_0] Write session: Do CDS request
2025-10-10T14:38:12.767131Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2587 reason: error at write: Disconnected sessionId: src_id|20e48032-deea6956-5c355eb-68a9f5e4_0
2025-10-10T14:38:12.767587Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20e48032-deea6956-5c355eb-68a9f5e4_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:12.767131Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 85 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602399915867842:11209]
2025-10-10T14:38:12.767348Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2587 sessionId: src_id|20e48032-deea6956-5c355eb-68a9f5e4_0 is DEAD
2025-10-10T14:38:12.776958Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|20e48032-deea6956-5c355eb-68a9f5e4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:12.777126Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:12.777145Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2588
2025-10-10T14:38:12.777354Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2588 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:12.777398Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2588 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:12.777418Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2588 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:12.777422Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:12.777935Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2588 sessionId:  describe result for acl check
2025-10-10T14:38:12.777975Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:12.777982Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:12.777984Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:12.777991Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602399915867925:11730] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:12.778607Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602399915867925:11730] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:12.781128Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602399915867925:11730] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:12.784905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:12.786604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:12.786525Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602399915867925:11730] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:12.786544Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602399915867925:11730] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:12.786548Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602399915867925:11730] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:12.786840Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:12.786852Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:12.786865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:12.786557Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2588 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:12.786927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:12.786974Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602399133632835:11763]
2025-10-10T14:38:12.787624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:12.787958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:12.788015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:12.788360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:12.788433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:12.788440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:12.788441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:12.788442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:12.788444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:12.788446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:12.788447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:12.788448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:12.788450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:12.788451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:12.788453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:12.788454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:12.788455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:12.788461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:12.788475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:12.788479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:12.788483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:12.788487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:12.788491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:12.788495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:12.788499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:12.788503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:12.788508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:12.788512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:12.788515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:12.788519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:12.788529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:12.788538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:12.788545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:12.788551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:12.788556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:12.788561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:12.788566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:12.788572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:12.788577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:12.788582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:12.788588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:12.788594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:12.788599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:12.788604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:12.788608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:12.788614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:12.788625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:12.788630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:12.788635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:12.788640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:12.788649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:12.788654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:12.788659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:12.788668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:12.788673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:12.788678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:12.788722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:12.791297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:12.791993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:12.792006Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:12.792009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:12.792013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:12.792020Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2587 [2:7559602399133632835:11763]
2025-10-10T14:38:12.792033Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:12.792051Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:12.792055Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:12.792059Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:12.792062Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:12.792090Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:12.792103Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:12.792114Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:12.792181Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:12.792189Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:12.792191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:12.792194Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:12.792265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:12.792273Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:12.792284Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:12.792297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:12.792315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:12.792346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602399915867843:2438], now have 1 active actors on pipe
2025-10-10T14:38:12.792363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602399915868041:11730], now have 1 active actors on pipe
2025-10-10T14:38:12.792375Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602399133632830:11763]
2025-10-10T14:38:12.792376Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602399133632830:11763]
2025-10-10T14:38:12.792378Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602399133632830:11763]
2025-10-10T14:38:12.792387Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:12.792402Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:12.792414Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:12.792418Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:12.792420Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:12.792421Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:12.792425Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:12.792456Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602399133632830:11763]
2025-10-10T14:38:12.792462Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:12.792465Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:12.792411Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2587
2025-10-10T14:38:12.792473Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2587
2025-10-10T14:38:12.792521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:12.792531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:12.792558Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8228f32c-9e19150e-7e97092b-1e2af12a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:12.792564Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:12.792567Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:12.792570Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:12.792579Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:12.792590Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:12.792605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:12.792729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:12.792735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:12.792748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:12.792829Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2588 partition: 0 MaxSeqNo: 40 sessionId: src_id|8228f32c-9e19150e-7e97092b-1e2af12a_0
2025-10-10T14:38:12.793235Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20e48032-deea6956-5c355eb-68a9f5e4_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|8228f32c-9e19150e-7e97092b-1e2af12a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:12.795999Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8228f32c-9e19150e-7e97092b-1e2af12a_0] Write session: try to update token
2025-10-10T14:38:12.796024Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8228f32c-9e19150e-7e97092b-1e2af12a_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:12.812034Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:38:12.812054Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:12.812066Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602399133632830:11763]
2025-10-10T14:38:12.812131Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:38:12.812270Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:38:12.812453Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:38:12.812604Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:12.812747Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:12.812897Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:12.813090Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:38:12.813133Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:38:12.813095Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2588 sessionId: src_id|8228f32c-9e19150e-7e97092b-1e2af12a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:12.815776Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:12.815977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:12.815996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:12.816053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:38:12.818190Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:38:12.824826Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:12.824848Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:12.824851Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:12.824854Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:12.824865Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602399133632830:11763]
2025-10-10T14:38:12.824869Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602399133632830:11763]
2025-10-10T14:38:12.824873Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602399133632830:11763]
2025-10-10T14:38:12.824932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:12.824931Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:12.824941Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:12.824944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:12.824950Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:12.824955Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:12.825086Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:12.867309Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602399915868059:11209]
2025-10-10T14:38:12.867631Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 pipe creation result: OK TabletId: 72075186224037892 Generation: 2587, pipe: [1:7559602399915868059:11209]
2025-10-10T14:38:12.946509Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:12.955569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:12.955603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:12.955804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:12.955878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:12.955957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:12.956029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:12.956359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:12.956376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:12.956453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:12.956531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:12.956608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:12.956991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:12.957048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:12.957057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:12.957134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:12.957207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:12.957282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:12.957412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:12.957462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:12.957470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:12.957549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:12.957625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:12.957698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:12.957773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:12.957824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:12.957832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:12.957906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:12.957976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:12.958057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:12.958130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:12.958186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:12.958194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:12.958266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:12.958356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:12.958425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:12.958501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:12.958548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:12.958557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:12.958629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:12.958697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:12.958771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:12.958842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:12.958895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:12.958903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:12.958980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:12.959048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:12.959120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:12.959194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:12.959246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:12.959253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:12.959326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:12.959398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:12.959476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:12.959549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:12.959601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:12.959608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:12.959683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:12.959755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:12.959827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:12.959901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:12.959951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:12.959959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:12.960033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602399915868059:11209], now have 1 active actors on pipe
2025-10-10T14:38:12.960285Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:12.960301Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:12.960301Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 86 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602399915868059:11209]
2025-10-10T14:38:12.960324Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:12.960353Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2588 reason: error at write: Disconnected sessionId: src_id|8228f32c-9e19150e-7e97092b-1e2af12a_0
2025-10-10T14:38:12.960601Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2588 sessionId: src_id|8228f32c-9e19150e-7e97092b-1e2af12a_0 is DEAD
2025-10-10T14:38:12.960688Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:12.960779Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8228f32c-9e19150e-7e97092b-1e2af12a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:12.960790Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8228f32c-9e19150e-7e97092b-1e2af12a_0] Write session will restart in 0.006148s
2025-10-10T14:38:12.960830Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8228f32c-9e19150e-7e97092b-1e2af12a_0] Write session: Do CDS request
2025-10-10T14:38:12.960837Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8228f32c-9e19150e-7e97092b-1e2af12a_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:12.967911Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8228f32c-9e19150e-7e97092b-1e2af12a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:12.968026Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:12.968045Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2589
2025-10-10T14:38:12.968223Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2589 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:12.968263Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2589 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:12.968271Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2589 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:12.968284Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:12.968764Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2589 sessionId:  describe result for acl check
2025-10-10T14:38:12.968801Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:12.968803Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:12.968805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:12.968812Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602399915868093:11735] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:12.969434Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602399915868093:11735] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:12.972671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602399915868093:11735] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:12.975567Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602399915868093:11735] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:12.975582Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602399915868093:11735] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:12.975586Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602399915868093:11735] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:12.975595Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2589 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:12.976087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:12.977902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:12.978120Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:12.978132Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:12.978144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:12.978197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:12.978242Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602399133633014:11765]
2025-10-10T14:38:12.978902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:12.979319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:12.979386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:12.979853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:12.979931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:12.979939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:12.979941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:12.979942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:12.979943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:12.979945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:12.979946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:12.979948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:12.979950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:12.979951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:12.979952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:12.979953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:12.979954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:12.979961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:12.979974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:12.979979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:12.979983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:12.979987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:12.979992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:12.979996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:12.980000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:12.980004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:12.980009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:12.980013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:12.980017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:12.980021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:12.980029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:12.980038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:12.980045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:12.980051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:12.980056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:12.980062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:12.980066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:12.980072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:12.980086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:12.980092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:12.980096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:12.980102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:12.980106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:12.980112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:12.980116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:12.980122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:12.980132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:12.980138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:12.980142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:12.980152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:12.980156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:12.980163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:12.980167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:12.980172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:12.980177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:12.980182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:12.980230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:12.982839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:12.983291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:12.983302Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:12.983305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:12.983309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:12.983315Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2588 [2:7559602399133633014:11765]
2025-10-10T14:38:12.983329Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:12.983350Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:12.983362Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:12.983366Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:12.983368Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:12.983386Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:12.983394Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:12.983403Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:12.983469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:12.983471Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:12.983474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:12.983477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:12.983544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:12.983548Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:12.983559Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:12.983572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:12.983587Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:12.983611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602399915868255:11735], now have 1 active actors on pipe
2025-10-10T14:38:12.983615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602399915868064:2438], now have 1 active actors on pipe
2025-10-10T14:38:12.983623Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602399133633009:11765]
2025-10-10T14:38:12.983626Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602399133633009:11765]
2025-10-10T14:38:12.983628Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602399133633009:11765]
2025-10-10T14:38:12.983646Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:12.983662Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:12.983666Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:12.983669Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:12.983672Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:12.983679Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:12.983683Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:12.983713Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602399133633009:11765]
2025-10-10T14:38:12.983721Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:12.983703Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2588
2025-10-10T14:38:12.983736Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:12.983705Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2588
2025-10-10T14:38:12.983916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:12.983927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:12.983962Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ce2b80a8-e1eed0fa-cd555b43-e9848af8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:12.983970Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:12.983975Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:12.983977Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:12.983990Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:12.984001Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:12.984017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:12.984205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:12.984217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:12.984260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:12.984377Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2589 partition: 0 MaxSeqNo: 40 sessionId: src_id|ce2b80a8-e1eed0fa-cd555b43-e9848af8_0
2025-10-10T14:38:12.985010Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8228f32c-9e19150e-7e97092b-1e2af12a_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|ce2b80a8-e1eed0fa-cd555b43-e9848af8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:12.987764Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ce2b80a8-e1eed0fa-cd555b43-e9848af8_0] Write session: try to update token
2025-10-10T14:38:12.987785Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ce2b80a8-e1eed0fa-cd555b43-e9848af8_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:12.996333Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:38:12.996354Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:12.996365Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602399133633009:11765]
2025-10-10T14:38:12.996419Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:38:12.996620Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:38:12.996790Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:12.996937Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:12.997088Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:12.997402Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:38:12.997404Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:38:12.997572Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:38:13.006445Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2589 sessionId: src_id|ce2b80a8-e1eed0fa-cd555b43-e9848af8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:13.009432Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:13.009927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:13.009949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:13.009995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:38:13.010092Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:38:13.017860Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:13.017880Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:13.017883Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:13.017884Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:13.017894Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602399133633009:11765]
2025-10-10T14:38:13.017898Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602399133633009:11765]
2025-10-10T14:38:13.017901Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602399133633009:11765]
2025-10-10T14:38:13.017948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:13.017954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:13.017956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:13.017957Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:13.017964Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:13.017968Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:13.018101Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:13.060345Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602404210835565:11209]
2025-10-10T14:38:13.060624Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 pipe creation result: OK TabletId: 72075186224037892 Generation: 2588, pipe: [1:7559602404210835565:11209]
2025-10-10T14:38:13.134633Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:13.143804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:13.143843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:13.144051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:13.144129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:13.144205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:13.144387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:13.144440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:13.144454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:13.144534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:13.144608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:13.144681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:13.144756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:13.144806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:13.144814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:13.144889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:13.144954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:13.145027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:13.145103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:13.148007Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 87 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602404210835565:11209]
2025-10-10T14:38:13.148056Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:13.148071Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:13.148074Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:13.148104Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2589 reason: error at write: Disconnected sessionId: src_id|ce2b80a8-e1eed0fa-cd555b43-e9848af8_0
2025-10-10T14:38:13.148335Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2589 sessionId: src_id|ce2b80a8-e1eed0fa-cd555b43-e9848af8_0 is DEAD
2025-10-10T14:38:13.148459Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce2b80a8-e1eed0fa-cd555b43-e9848af8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:13.148470Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce2b80a8-e1eed0fa-cd555b43-e9848af8_0] Write session will restart in 0.006150s
2025-10-10T14:38:13.148497Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce2b80a8-e1eed0fa-cd555b43-e9848af8_0] Write session: Do CDS request
2025-10-10T14:38:13.148503Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce2b80a8-e1eed0fa-cd555b43-e9848af8_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:13.145152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:13.145165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:13.145240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:13.145303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:13.145393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:13.145456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:13.145498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:13.145501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:13.145574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:13.145643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:13.145712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:13.145777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:13.145823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:13.145826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:13.145902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:13.145966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:13.146033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:13.146102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:13.146155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:13.146158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:13.146236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:13.146304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:13.146392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:13.146461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:13.146507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:13.146509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:13.146589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:13.146658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:13.146729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:13.146800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:13.146848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:13.146851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:13.146933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:13.147004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:13.147073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:13.147143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:13.147189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:13.147192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:13.147272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:13.147341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:13.147410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:13.147479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:13.147533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:13.147537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:13.147620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602404210835565:11209], now have 1 active actors on pipe
2025-10-10T14:38:13.149063Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:13.155929Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ce2b80a8-e1eed0fa-cd555b43-e9848af8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:13.156054Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:13.156074Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2590
2025-10-10T14:38:13.156751Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2590 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:13.156794Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2590 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:13.156804Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2590 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:13.156810Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:13.157406Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2590 sessionId:  describe result for acl check
2025-10-10T14:38:13.157459Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:13.157474Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:13.157477Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:13.157484Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602404210835582:11739] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:13.158145Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602404210835582:11739] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:13.161553Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602404210835582:11739] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:13.166846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602404210835582:11739] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:13.166867Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602404210835582:11739] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:13.166871Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602404210835582:11739] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:13.166881Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2590 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:13.168254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:13.170285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:13.170642Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:13.170657Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:13.170669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:13.170744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:13.170797Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602403428600491:11768]
2025-10-10T14:38:13.171438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:13.171825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:13.171876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:13.172212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:13.172278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:13.172284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:13.172286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:13.172287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:13.172289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:13.172291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:13.172292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:13.172294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:13.172295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:13.172296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:13.172298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:13.172299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:13.172301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:13.172308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:13.172321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:13.172326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:13.172330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:13.172334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:13.172339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:13.172343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:13.172347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:13.172351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:13.172356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:13.172360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:13.172364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:13.172368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:13.172379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:13.172388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:13.172394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:13.172400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:13.172405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:13.172410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:13.172415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:13.172421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:13.172426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:13.172432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:13.172436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:13.172442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:13.172447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:13.172453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:13.172458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:13.172463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:13.172470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:13.172475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:13.172480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:13.172485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:13.172490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:13.172496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:13.172501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:13.172506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:13.172511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:13.172517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:13.172558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:13.175284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:13.175952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:13.175964Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:13.175967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:13.175972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:13.175979Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2589 [2:7559602403428600491:11768]
2025-10-10T14:38:13.176003Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:13.176026Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:13.176035Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:13.176039Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:13.176042Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:13.176060Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:13.176072Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:13.176080Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:13.176155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:13.176162Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:13.176165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:13.176167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:13.176240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:13.176250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:13.176262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:13.176276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:13.176294Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:13.176317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602404210835567:2438], now have 1 active actors on pipe
2025-10-10T14:38:13.176325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602404210835762:11739], now have 1 active actors on pipe
2025-10-10T14:38:13.176333Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602403428600486:11768]
2025-10-10T14:38:13.176340Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602403428600486:11768]
2025-10-10T14:38:13.176343Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602403428600486:11768]
2025-10-10T14:38:13.176359Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:13.176376Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:13.176385Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:13.176352Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2589
2025-10-10T14:38:13.176388Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:13.176389Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:13.176405Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:13.176408Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:13.176414Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2589
2025-10-10T14:38:13.176464Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602403428600486:11768]
2025-10-10T14:38:13.176477Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:13.176483Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:13.176523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:13.176534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:13.176567Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|978c812-b52df501-34dfbfd1-38efada0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:13.176580Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:13.176586Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:13.176588Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:13.176600Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:13.176617Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:13.176632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:13.176798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:13.176807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:13.176825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:13.176936Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2590 partition: 0 MaxSeqNo: 40 sessionId: src_id|978c812-b52df501-34dfbfd1-38efada0_0
2025-10-10T14:38:13.177408Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce2b80a8-e1eed0fa-cd555b43-e9848af8_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|978c812-b52df501-34dfbfd1-38efada0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:13.180331Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|978c812-b52df501-34dfbfd1-38efada0_0] Write session: try to update token
2025-10-10T14:38:13.180359Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|978c812-b52df501-34dfbfd1-38efada0_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:13.188339Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:38:13.188356Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:13.188368Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602403428600486:11768]
2025-10-10T14:38:13.188419Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:38:13.188423Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:38:13.188616Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:38:13.188771Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:13.188922Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:13.189091Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:13.189295Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:38:13.189357Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:38:13.196485Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2590 sessionId: src_id|978c812-b52df501-34dfbfd1-38efada0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:13.199301Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:13.199551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:13.199577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:13.199622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:38:13.199724Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:38:13.206875Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:13.206898Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:13.206901Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:13.206904Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:13.206917Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602403428600486:11768]
2025-10-10T14:38:13.206923Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602403428600486:11768]
2025-10-10T14:38:13.206927Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602403428600486:11768]
2025-10-10T14:38:13.206992Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:13.207001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:13.206998Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:13.207004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:13.207006Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:13.207012Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:13.207152Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:13.248235Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602404210835777:11209]
2025-10-10T14:38:13.248569Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 pipe creation result: OK TabletId: 72075186224037892 Generation: 2589, pipe: [1:7559602404210835777:11209]
2025-10-10T14:38:13.328031Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:13.336911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:13.336949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:13.337132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:13.337200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:13.337267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:13.337357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:13.337408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:13.337421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:13.337495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:13.337561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:13.337631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:13.337699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:13.337749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:13.337759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:13.337833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:13.337901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:13.337970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:13.338036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:13.338084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:13.338093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:13.338165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:13.338235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:13.338304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:13.338384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:13.338432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:13.338440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:13.338511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:13.338581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:13.338645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:13.338709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:13.338756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:13.338763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:13.338830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:13.338891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:13.338959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:13.339024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:13.339071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:13.339081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:13.339146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:13.339214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:13.339283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:13.339358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:13.339405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:13.339413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:13.339481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:13.339542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:13.339612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:13.339679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:13.339721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:13.339730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:13.339799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:13.339889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:13.339963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:13.340029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:13.340076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:13.340084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:13.340150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:13.340214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:13.340280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:13.340343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:13.340388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:13.340398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:13.340467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602404210835777:11209], now have 1 active actors on pipe
2025-10-10T14:38:13.340722Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 88 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602404210835777:11209]
2025-10-10T14:38:13.340729Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:13.340734Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:13.340764Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:13.340770Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2590 reason: error at write: Disconnected sessionId: src_id|978c812-b52df501-34dfbfd1-38efada0_0
2025-10-10T14:38:13.340992Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2590 sessionId: src_id|978c812-b52df501-34dfbfd1-38efada0_0 is DEAD
2025-10-10T14:38:13.341172Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|978c812-b52df501-34dfbfd1-38efada0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:13.341183Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|978c812-b52df501-34dfbfd1-38efada0_0] Write session will restart in 0.007761s
2025-10-10T14:38:13.341207Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|978c812-b52df501-34dfbfd1-38efada0_0] Write session: Do CDS request
2025-10-10T14:38:13.341214Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|978c812-b52df501-34dfbfd1-38efada0_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:13.341919Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:13.353789Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|978c812-b52df501-34dfbfd1-38efada0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:13.353915Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:13.353935Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2591
2025-10-10T14:38:13.354453Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2591 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:13.354509Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2591 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:13.354520Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2591 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:13.354524Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:13.355048Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2591 sessionId:  describe result for acl check
2025-10-10T14:38:13.355089Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:13.355096Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:13.355103Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:13.355110Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602404210835947:11743] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:13.355698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602404210835947:11743] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:13.355869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:13.358059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:13.358366Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:13.358378Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:13.358395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:13.358480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:13.358527Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602403428600682:11771]
2025-10-10T14:38:13.358553Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602404210835947:11743] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:13.359169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:13.359489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:13.359539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:13.359870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:13.359936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:13.359942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:13.359943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:13.359945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:13.359946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:13.359947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:13.359948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:13.359950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:13.359951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:13.359952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:13.359954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:13.359955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:13.359956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:13.359963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:13.359975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:13.359978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:13.359983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:13.359987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:13.359991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:13.359994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:13.359998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:13.360002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:13.360007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:13.360011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:13.360015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:13.360018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:13.360027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:13.360035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:13.360041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:13.360047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:13.360050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:13.360061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:13.360065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:13.360070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:13.360074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:13.360079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:13.360089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:13.360094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:13.360099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:13.360104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:13.360108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:13.360114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:13.360118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:13.360124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:13.360128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:13.360139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:13.360144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:13.360149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:13.360158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:13.360163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:13.360168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:13.360174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:13.360215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:13.361057Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602404210835947:11743] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:13.361074Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602404210835947:11743] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:13.361078Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602404210835947:11743] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:13.361087Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2591 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:13.362697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:13.363057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:13.363066Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:13.363069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:13.363073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:13.363080Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2590 [2:7559602403428600682:11771]
2025-10-10T14:38:13.363094Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:13.363426Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2590
2025-10-10T14:38:13.363435Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2590
2025-10-10T14:38:13.363111Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:13.363123Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:13.363127Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:13.363129Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:13.363146Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:13.363153Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:13.363161Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:13.363220Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:13.363222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:13.363225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:13.363227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:13.363299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:13.363304Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:13.363316Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:13.363329Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:13.363361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:13.363384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602404210835981:11743], now have 1 active actors on pipe
2025-10-10T14:38:13.363388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602404210835779:2438], now have 1 active actors on pipe
2025-10-10T14:38:13.363396Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602403428600677:11771]
2025-10-10T14:38:13.363398Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602403428600677:11771]
2025-10-10T14:38:13.363400Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602403428600677:11771]
2025-10-10T14:38:13.363414Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:13.363429Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:13.363431Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:13.363435Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:13.363437Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:13.363446Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:13.363450Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:13.363476Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602403428600677:11771]
2025-10-10T14:38:13.363479Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:13.363482Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:13.363509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:13.363514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:13.363550Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b1f29e23-c51269f8-823c2fba-50690d91_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:13.363558Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:13.363562Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:13.363565Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:13.363576Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:13.363586Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:13.363604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:13.363816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:13.363842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:13.363869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:13.363967Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2591 partition: 0 MaxSeqNo: 40 sessionId: src_id|b1f29e23-c51269f8-823c2fba-50690d91_0
2025-10-10T14:38:13.364382Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|978c812-b52df501-34dfbfd1-38efada0_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|b1f29e23-c51269f8-823c2fba-50690d91_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:13.367233Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b1f29e23-c51269f8-823c2fba-50690d91_0] Write session: try to update token
2025-10-10T14:38:13.367250Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b1f29e23-c51269f8-823c2fba-50690d91_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:13.383510Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2591 sessionId: src_id|b1f29e23-c51269f8-823c2fba-50690d91_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:13.385286Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:13.385308Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:13.385312Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:13.385315Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:13.385325Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602403428600677:11771]
2025-10-10T14:38:13.385349Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602403428600677:11771]
2025-10-10T14:38:13.385353Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602403428600677:11771]
2025-10-10T14:38:13.385407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:13.385408Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:13.385414Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:13.385421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:13.385423Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:13.385424Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:13.385568Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:13.386256Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:13.440738Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602404210836001:11209]
2025-10-10T14:38:13.441028Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 pipe creation result: OK TabletId: 72075186224037892 Generation: 2590, pipe: [1:7559602404210836001:11209]
2025-10-10T14:38:13.506661Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:13.507424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:13.507444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:13.507507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602404210836001:11209], now have 1 active actors on pipe
2025-10-10T14:38:13.507731Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:13.507748Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:13.507800Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 89 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602404210836001:11209]
2025-10-10T14:38:13.507803Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:13.507806Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:13.507888Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2591 reason: error at write: Disconnected sessionId: src_id|b1f29e23-c51269f8-823c2fba-50690d91_0
2025-10-10T14:38:13.508106Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2591 sessionId: src_id|b1f29e23-c51269f8-823c2fba-50690d91_0 is DEAD
2025-10-10T14:38:13.508309Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1f29e23-c51269f8-823c2fba-50690d91_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:13.508319Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1f29e23-c51269f8-823c2fba-50690d91_0] Write session will restart in 0.005376s
2025-10-10T14:38:13.508361Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1f29e23-c51269f8-823c2fba-50690d91_0] Write session: Do CDS request
2025-10-10T14:38:13.508369Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1f29e23-c51269f8-823c2fba-50690d91_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:13.514920Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b1f29e23-c51269f8-823c2fba-50690d91_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:13.515014Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:13.515032Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2592
2025-10-10T14:38:13.515178Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2592 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:13.515225Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2592 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:13.515238Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2592 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:13.515242Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:13.515785Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2592 sessionId:  describe result for acl check
2025-10-10T14:38:13.515825Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:13.515827Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:13.515829Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:13.515835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602404210836024:11748] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:13.516470Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602404210836024:11748] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:13.519372Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602404210836024:11748] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:13.522853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602404210836024:11748] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:13.522869Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602404210836024:11748] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:13.522872Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602404210836024:11748] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:13.522882Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2592 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:13.523091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:13.524965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:13.525202Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:13.525216Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:13.525230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:13.525307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:13.525373Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602403428600865:11773]
2025-10-10T14:38:13.525996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:13.526343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:13.526407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:13.526763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:13.526835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:13.526842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:13.526843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:13.526844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:13.526845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:13.526846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:13.526847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:13.526849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:13.526850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:13.526851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:13.526852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:13.526853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:13.526855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:13.526861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:13.526875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:13.526880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:13.526884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:13.526888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:13.526892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:13.526896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:13.526901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:13.526905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:13.526910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:13.526914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:13.526918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:13.526923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:13.526931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:13.526941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:13.526948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:13.526954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:13.526959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:13.526965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:13.526970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:13.526976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:13.526982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:13.526987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:13.526991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:13.526997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:13.527003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:13.527009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:13.527013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:13.527019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:13.527024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:13.527029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:13.527033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:13.527038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:13.527043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:13.527055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:13.527059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:13.527065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:13.527069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:13.527080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:13.527127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:13.529870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:13.530223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:13.530236Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:13.530239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:13.530244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:13.530251Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2591 [2:7559602403428600865:11773]
2025-10-10T14:38:13.530267Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:13.530291Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:13.530299Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:13.530303Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:13.530305Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:13.530338Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:13.530347Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:13.530360Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:13.530429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:13.530440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:13.530442Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:13.530445Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:13.530523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:13.530530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:13.530542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:13.530559Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:13.530581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:13.530610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602404210836201:11748], now have 1 active actors on pipe
2025-10-10T14:38:13.530618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602404210836002:2438], now have 1 active actors on pipe
2025-10-10T14:38:13.530626Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602403428600859:11773]
2025-10-10T14:38:13.530629Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602403428600859:11773]
2025-10-10T14:38:13.530631Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602403428600859:11773]
2025-10-10T14:38:13.530645Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:13.530672Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:13.530672Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:13.530677Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:13.530680Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:13.530694Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:13.530697Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:13.530689Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2591
2025-10-10T14:38:13.530717Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2591
2025-10-10T14:38:13.530733Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602403428600859:11773]
2025-10-10T14:38:13.530745Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:13.530776Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:13.530847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:13.530858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:13.530889Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7fbdb91d-602e202a-65345e8d-d4827b1c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:13.530901Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:13.530905Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:13.530908Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:13.530921Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:13.530932Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:13.530958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:13.531205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:13.531219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:13.531246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:13.531351Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2592 partition: 0 MaxSeqNo: 40 sessionId: src_id|7fbdb91d-602e202a-65345e8d-d4827b1c_0
2025-10-10T14:38:13.531761Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1f29e23-c51269f8-823c2fba-50690d91_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|7fbdb91d-602e202a-65345e8d-d4827b1c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:13.534659Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7fbdb91d-602e202a-65345e8d-d4827b1c_0] Write session: try to update token
2025-10-10T14:38:13.534683Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7fbdb91d-602e202a-65345e8d-d4827b1c_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:13.551426Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:13.551446Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:13.551450Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:13.551452Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:13.551463Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602403428600859:11773]
2025-10-10T14:38:13.551468Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602403428600859:11773]
2025-10-10T14:38:13.551472Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602403428600859:11773]
2025-10-10T14:38:13.551522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:13.551530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:13.551533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:13.551676Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:13.552285Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:13.552292Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:13.552297Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:13.550724Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2592 sessionId: src_id|7fbdb91d-602e202a-65345e8d-d4827b1c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:13.553477Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:13.608933Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602404210836226:11209]
2025-10-10T14:38:13.609273Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 pipe creation result: OK TabletId: 72075186224037892 Generation: 2591, pipe: [1:7559602404210836226:11209]
2025-10-10T14:38:13.672415Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:13.673105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:13.673118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:13.673168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602404210836226:11209], now have 1 active actors on pipe
2025-10-10T14:38:13.673642Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 90 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602404210836226:11209]
2025-10-10T14:38:13.673688Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:13.673700Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:13.673765Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2592 reason: error at write: Disconnected sessionId: src_id|7fbdb91d-602e202a-65345e8d-d4827b1c_0
2025-10-10T14:38:13.673945Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:13.673969Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2592 sessionId: src_id|7fbdb91d-602e202a-65345e8d-d4827b1c_0 is DEAD
2025-10-10T14:38:13.674187Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:13.676664Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7fbdb91d-602e202a-65345e8d-d4827b1c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:13.676677Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7fbdb91d-602e202a-65345e8d-d4827b1c_0] Write session will restart in 0.009162s
2025-10-10T14:38:13.676706Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7fbdb91d-602e202a-65345e8d-d4827b1c_0] Write session: Do CDS request
2025-10-10T14:38:13.676716Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7fbdb91d-602e202a-65345e8d-d4827b1c_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:13.687005Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7fbdb91d-602e202a-65345e8d-d4827b1c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:13.689538Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:13.689553Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2593
2025-10-10T14:38:13.689703Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2593 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:13.689735Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2593 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:13.689741Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2593 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:13.689745Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:13.690186Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2593 sessionId:  describe result for acl check
2025-10-10T14:38:13.690227Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:13.690234Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:13.690236Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:13.690242Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602404210836253:11761] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:13.690798Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602404210836253:11761] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:13.693169Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602404210836253:11761] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:13.697058Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602404210836253:11761] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:13.697073Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602404210836253:11761] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:13.697077Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602404210836253:11761] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:13.697087Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2593 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:13.702039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:13.704594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:13.704864Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:13.704892Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:13.704908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:13.704991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:13.705041Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602403428601085:11788]
2025-10-10T14:38:13.705703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:13.706138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:13.706223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:13.706628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:13.706717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:13.706725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:13.706727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:13.706728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:13.706729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:13.706731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:13.706732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:13.706734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:13.706735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:13.706736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:13.706737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:13.706738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:13.706740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:13.706746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:13.706760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:13.706764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:13.706768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:13.706773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:13.706777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:13.706781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:13.706785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:13.706789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:13.706793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:13.706797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:13.706802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:13.706806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:13.706828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:13.706838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:13.706845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:13.706851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:13.706855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:13.706861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:13.706866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:13.706871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:13.706877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:13.706882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:13.706887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:13.706892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:13.706896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:13.706903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:13.706908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:13.706913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:13.706919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:13.706933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:13.706938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:13.706946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:13.706951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:13.706957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:13.706962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:13.706968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:13.706973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:13.706978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:13.707032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:13.709690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:13.710815Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2592
2025-10-10T14:38:13.710849Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2592
2025-10-10T14:38:13.710379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:13.710393Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:13.710395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:13.710400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:13.710406Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2592 [2:7559602403428601085:11788]
2025-10-10T14:38:13.710421Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:13.710439Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:13.710443Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:13.710446Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:13.710449Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:13.710469Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:13.710476Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:13.710485Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:13.710551Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:13.710553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:13.710555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:13.710558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:13.710629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:13.710632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:13.710643Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:13.710655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:13.710672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:13.710695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602404210836382:11761], now have 1 active actors on pipe
2025-10-10T14:38:13.710698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602404210836238:2438], now have 1 active actors on pipe
2025-10-10T14:38:13.710708Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602403428601080:11788]
2025-10-10T14:38:13.710710Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602403428601080:11788]
2025-10-10T14:38:13.710712Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602403428601080:11788]
2025-10-10T14:38:13.710728Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:13.710742Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:13.710745Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:13.710745Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:13.710748Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:13.710761Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:13.710765Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:13.710798Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602403428601080:11788]
2025-10-10T14:38:13.710805Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:13.710811Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:13.712185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:13.712196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:13.712244Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c89f52a5-32549633-3be32207-5d49cac5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:13.712255Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:13.712260Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:13.712263Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:13.712290Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:13.712305Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:13.712327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:13.716295Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2593 partition: 0 MaxSeqNo: 40 sessionId: src_id|c89f52a5-32549633-3be32207-5d49cac5_0
2025-10-10T14:38:13.716739Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7fbdb91d-602e202a-65345e8d-d4827b1c_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|c89f52a5-32549633-3be32207-5d49cac5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:13.714827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:13.714842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:13.714882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:13.719555Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c89f52a5-32549633-3be32207-5d49cac5_0] Write session: try to update token
2025-10-10T14:38:13.719576Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c89f52a5-32549633-3be32207-5d49cac5_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:13.736842Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:13.736862Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:13.736866Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:13.736868Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:13.736879Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602403428601080:11788]
2025-10-10T14:38:13.736884Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602403428601080:11788]
2025-10-10T14:38:13.736888Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602403428601080:11788]
2025-10-10T14:38:13.736945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:13.736953Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:13.736955Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:13.737105Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:13.739555Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:13.739579Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:13.739585Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:13.748405Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2593 sessionId: src_id|c89f52a5-32549633-3be32207-5d49cac5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:13.750975Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:13.773568Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602404210836453:11209]
2025-10-10T14:38:13.774134Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 pipe creation result: OK TabletId: 72075186224037892 Generation: 2592, pipe: [1:7559602404210836453:11209]
2025-10-10T14:38:13.862657Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:13.862954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:13.862969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:13.862992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602404210836453:11209], now have 1 active actors on pipe
2025-10-10T14:38:13.863824Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c89f52a5-32549633-3be32207-5d49cac5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:13.863848Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c89f52a5-32549633-3be32207-5d49cac5_0] Write session will restart in 0.008862s
2025-10-10T14:38:13.863873Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c89f52a5-32549633-3be32207-5d49cac5_0] Write session: Do CDS request
2025-10-10T14:38:13.863879Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c89f52a5-32549633-3be32207-5d49cac5_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:13.863490Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:13.863331Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 91 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602404210836453:11209]
2025-10-10T14:38:13.863380Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:13.863383Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:13.863458Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2593 reason: error at write: Disconnected sessionId: src_id|c89f52a5-32549633-3be32207-5d49cac5_0
2025-10-10T14:38:13.863674Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:13.863681Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2593 sessionId: src_id|c89f52a5-32549633-3be32207-5d49cac5_0 is DEAD
2025-10-10T14:38:13.873924Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c89f52a5-32549633-3be32207-5d49cac5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:13.877686Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:13.877704Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2594
2025-10-10T14:38:13.881541Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2594 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:13.881600Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2594 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:13.881606Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2594 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:13.881610Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:13.885769Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2594 sessionId:  describe result for acl check
2025-10-10T14:38:13.885819Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:13.885821Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:13.885823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:13.885831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602404210836633:11766] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:13.886434Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602404210836633:11766] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:13.887287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:13.888812Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602404210836633:11766] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:13.889600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:13.889824Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:13.889836Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:13.889850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:13.889919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:13.889976Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602403428601268:11790]
2025-10-10T14:38:13.890604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:13.890965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:13.891014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:13.891385Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602404210836633:11766] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:13.891375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:13.891398Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602404210836633:11766] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:13.891402Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602404210836633:11766] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:13.891411Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2594 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:13.891467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:13.891475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:13.891476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:13.891477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:13.891478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:13.891479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:13.891480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:13.891481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:13.891483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:13.891484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:13.891485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:13.891486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:13.891487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:13.891494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:13.891507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:13.891511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:13.891515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:13.891518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:13.891522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:13.891526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:13.891530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:13.891534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:13.891538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:13.891542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:13.891545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:13.891549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:13.891557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:13.891565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:13.891572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:13.891578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:13.891582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:13.891587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:13.891592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:13.891605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:13.891610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:13.891615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:13.891619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:13.891624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:13.891630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:13.891635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:13.891640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:13.891645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:13.891649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:13.891654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:13.891658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:13.891664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:13.891668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:13.891674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:13.891679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:13.891685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:13.891689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:13.891695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:13.891735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:13.894244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:13.894862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:13.894880Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:13.894883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:13.894887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:13.894893Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2593 [2:7559602403428601268:11790]
2025-10-10T14:38:13.894906Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:13.894924Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:13.894934Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:13.894938Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:13.894940Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:13.894958Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:13.894969Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:13.894977Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:13.895036Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:13.895044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:13.895048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:13.895051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:13.895120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:13.895128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:13.895139Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:13.895150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:13.895165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:13.895192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602404210836667:11766], now have 1 active actors on pipe
2025-10-10T14:38:13.895200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602404210836464:2438], now have 1 active actors on pipe
2025-10-10T14:38:13.895208Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602403428601263:11790]
2025-10-10T14:38:13.895215Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602403428601263:11790]
2025-10-10T14:38:13.895218Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602403428601263:11790]
2025-10-10T14:38:13.895235Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:13.895252Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:13.895272Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:13.895280Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:13.895298Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2593
2025-10-10T14:38:13.895305Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602403428601263:11790]
2025-10-10T14:38:13.895318Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:13.895325Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2593
2025-10-10T14:38:13.895377Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:13.895385Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:13.895387Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:13.895393Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:13.895462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:13.895472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:13.895505Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2a260637-a90a5ee4-57204236-3c7fff32_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:13.895518Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:13.895522Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:13.895524Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:13.895536Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:13.895547Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:13.895562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:13.895763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:13.895776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:13.895800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:13.895902Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2594 partition: 0 MaxSeqNo: 40 sessionId: src_id|2a260637-a90a5ee4-57204236-3c7fff32_0
2025-10-10T14:38:13.896300Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c89f52a5-32549633-3be32207-5d49cac5_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|2a260637-a90a5ee4-57204236-3c7fff32_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:13.898945Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2a260637-a90a5ee4-57204236-3c7fff32_0] Write session: try to update token
2025-10-10T14:38:13.898962Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2a260637-a90a5ee4-57204236-3c7fff32_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:13.922351Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:38:13.922368Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:13.922379Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602403428601263:11790]
2025-10-10T14:38:13.922426Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:38:13.922438Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:38:13.922677Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:38:13.922861Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:13.923013Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:13.923167Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:13.923433Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:38:13.923498Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:38:13.924217Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2594 sessionId: src_id|2a260637-a90a5ee4-57204236-3c7fff32_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:13.926840Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:13.928291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:13.928312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:13.928370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:38:13.928468Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:38:13.932506Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:13.932528Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:13.932531Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:13.932533Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:13.932543Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602403428601263:11790]
2025-10-10T14:38:13.932547Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602403428601263:11790]
2025-10-10T14:38:13.932551Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602403428601263:11790]
2025-10-10T14:38:13.932598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:13.932607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:13.932610Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:13.932610Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:13.932617Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:13.932621Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:13.932746Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:13.963458Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602404210836676:11209]
2025-10-10T14:38:13.963933Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 pipe creation result: OK TabletId: 72075186224037892 Generation: 2593, pipe: [1:7559602404210836676:11209]
2025-10-10T14:38:14.052276Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:14.061051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:14.061086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:14.061283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:14.061597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:14.061668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:14.061736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:14.061779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:14.061789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:14.061868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:14.061932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:14.061990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:14.062369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:14.062410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:14.062413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:14.062485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:14.062548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:14.062617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:14.062676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:14.062719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:14.062722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:14.062793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:14.062859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:14.062925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:14.062987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:14.063027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:14.063029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:14.063104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:14.063168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:14.063235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:14.063301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:14.063351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:14.063354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:14.063433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:14.063499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:14.063558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:14.063623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:14.063668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:14.063671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:14.063747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:14.063813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:14.063881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:14.063948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:14.063990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:14.063994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:14.064065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:14.064128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:14.064196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:14.064260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:14.064298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:14.064301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:14.064376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:14.064442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:14.064505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:14.064567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:14.064610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:14.064613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:14.064688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:14.064758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:14.064818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:14.064884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:14.064929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:14.064931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:14.065010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602404210836676:11209], now have 1 active actors on pipe
2025-10-10T14:38:14.066335Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:38:14.066393Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2594 reason: status is not ok: tablet will be restarted right now sessionId: src_id|2a260637-a90a5ee4-57204236-3c7fff32_0
2025-10-10T14:38:14.066624Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2594 sessionId: src_id|2a260637-a90a5ee4-57204236-3c7fff32_0 is DEAD
2025-10-10T14:38:14.066773Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 92 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602404210836676:11209]
2025-10-10T14:38:14.066793Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:14.065868Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:14.067232Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a260637-a90a5ee4-57204236-3c7fff32_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:38:14.067241Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a260637-a90a5ee4-57204236-3c7fff32_0] Write session will restart in 0.006934s
2025-10-10T14:38:14.067266Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a260637-a90a5ee4-57204236-3c7fff32_0] Write session: Do CDS request
2025-10-10T14:38:14.067272Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a260637-a90a5ee4-57204236-3c7fff32_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:14.075942Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2a260637-a90a5ee4-57204236-3c7fff32_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:14.077503Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:14.077523Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2595
2025-10-10T14:38:14.077698Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2595 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:14.077741Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2595 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:14.077763Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2595 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:14.077772Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:14.078274Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2595 sessionId:  describe result for acl check
2025-10-10T14:38:14.078341Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:14.078348Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:14.078350Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:14.078357Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602408505803991:11770] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:14.078960Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602408505803991:11770] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:14.084384Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602408505803991:11770] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:14.087698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602408505803991:11770] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:14.087717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602408505803991:11770] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:14.087721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602408505803991:11770] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:14.087730Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2595 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:14.088325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:14.090396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:14.090640Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:14.090651Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:14.090664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:14.090725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:14.090773Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602407723568749:11792]
2025-10-10T14:38:14.091440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:14.091806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:14.091855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:14.092207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:14.092268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:14.092274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:14.092275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:14.092277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:14.092278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:14.092279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:14.092280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:14.092282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:14.092283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:14.092285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:14.092286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:14.092288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:14.092289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:14.092296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:14.092310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:14.092314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:14.092319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:14.092324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:14.092329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:14.092333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:14.092338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:14.092342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:14.092349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:14.092353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:14.092358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:14.092363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:14.092372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:14.092386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:14.092393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:14.092399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:14.092404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:14.092414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:14.092420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:14.092426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:14.092435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:14.092442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:14.092448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:14.092453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:14.092458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:14.092464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:14.092470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:14.092479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:14.092485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:14.092494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:14.092499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:14.092506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:14.092515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:14.092522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:14.092527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:14.092537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:14.092545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:14.092551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:14.092595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:14.095302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:14.096065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:14.096080Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:14.096082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:14.096086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:14.096093Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2594 [2:7559602407723568749:11792]
2025-10-10T14:38:14.096107Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:14.096128Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:14.096132Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:14.096137Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:14.096139Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:14.096159Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:14.096167Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:14.096176Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:14.096240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:14.096250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:14.096252Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:14.096255Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:14.096327Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:14.096336Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:14.096347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:14.096362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:14.096381Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:14.096406Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602407723568744:11792]
2025-10-10T14:38:14.096413Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602407723568744:11792]
2025-10-10T14:38:14.096415Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602407723568744:11792]
2025-10-10T14:38:14.096428Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:14.096442Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:14.096445Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:14.096447Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:14.096452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602408505804176:11770], now have 1 active actors on pipe
2025-10-10T14:38:14.096458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602408505803975:2438], now have 1 active actors on pipe
2025-10-10T14:38:14.096467Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:14.096483Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:14.096486Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:14.096517Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602407723568744:11792]
2025-10-10T14:38:14.096524Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:14.096529Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:14.096516Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2594
2025-10-10T14:38:14.096517Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2594
2025-10-10T14:38:14.096690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:14.096705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:14.096744Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|64bd8397-67ff798b-ce161969-fdf8611a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:14.096757Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:14.096762Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:14.096765Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:14.096777Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:14.096793Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:14.096813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:14.097017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:14.097030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:14.097054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:14.097191Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2595 partition: 0 MaxSeqNo: 40 sessionId: src_id|64bd8397-67ff798b-ce161969-fdf8611a_0
2025-10-10T14:38:14.097623Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a260637-a90a5ee4-57204236-3c7fff32_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|64bd8397-67ff798b-ce161969-fdf8611a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:14.100450Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|64bd8397-67ff798b-ce161969-fdf8611a_0] Write session: try to update token
2025-10-10T14:38:14.100473Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|64bd8397-67ff798b-ce161969-fdf8611a_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:14.113578Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:38:14.113596Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:14.113606Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602407723568744:11792]
2025-10-10T14:38:14.113654Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:38:14.113658Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:38:14.113835Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:38:14.113993Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:14.114149Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:14.114327Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:14.114527Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:38:14.114578Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:38:14.117592Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2595 sessionId: src_id|64bd8397-67ff798b-ce161969-fdf8611a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:14.120447Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:14.120809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:14.120835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:14.120883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:38:14.120980Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:38:14.135405Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:14.135425Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:14.135428Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:14.135431Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:14.135443Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602407723568744:11792]
2025-10-10T14:38:14.135447Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602407723568744:11792]
2025-10-10T14:38:14.135451Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602407723568744:11792]
2025-10-10T14:38:14.135498Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:14.135501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:14.135506Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:14.135509Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:14.135510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:14.135512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:14.135647Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:14.166237Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602408505804188:11209]
2025-10-10T14:38:14.166578Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 pipe creation result: OK TabletId: 72075186224037892 Generation: 2594, pipe: [1:7559602408505804188:11209]
2025-10-10T14:38:14.253999Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:14.262048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:14.262077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:14.262267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:14.262348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:14.262417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:14.262492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:14.262546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:14.262556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:14.262632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:14.262699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:14.262765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:14.262836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:14.262891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:14.262899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:14.262972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:14.263034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:14.263102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:14.263173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:14.263215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:14.263218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:14.263289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:14.263354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:14.263412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:14.263479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:14.263523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:14.263526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:14.263596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:14.263655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:14.263715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:14.263777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:14.263816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:14.263819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:14.263897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:14.263952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:14.264013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:14.264075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:14.264188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:14.264191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:14.264264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:14.264323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:14.264396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:14.264457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:14.264498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:14.264500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:14.264576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:14.264636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:14.264694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:14.264758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:14.264798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:14.264801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:14.264869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:14.264928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:14.264992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:14.265055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:14.265097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:14.265100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:14.265174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:14.265235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:14.265300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:14.265570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:14.265619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:14.265622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:14.265691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602408505804188:11209], now have 1 active actors on pipe
2025-10-10T14:38:14.265995Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:14.266012Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:14.266047Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2595 reason: error at write: Disconnected sessionId: src_id|64bd8397-67ff798b-ce161969-fdf8611a_0
2025-10-10T14:38:14.266085Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:14.266147Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 93 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602408505804188:11209]
2025-10-10T14:38:14.266475Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64bd8397-67ff798b-ce161969-fdf8611a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:14.266485Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64bd8397-67ff798b-ce161969-fdf8611a_0] Write session will restart in 0.005544s
2025-10-10T14:38:14.266513Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64bd8397-67ff798b-ce161969-fdf8611a_0] Write session: Do CDS request
2025-10-10T14:38:14.266520Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64bd8397-67ff798b-ce161969-fdf8611a_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:14.266309Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2595 sessionId: src_id|64bd8397-67ff798b-ce161969-fdf8611a_0 is DEAD
2025-10-10T14:38:14.266828Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:14.272997Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|64bd8397-67ff798b-ce161969-fdf8611a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:14.273030Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:14.273059Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2596
2025-10-10T14:38:14.273270Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2596 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:14.273310Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2596 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:14.273323Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2596 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:14.273328Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:14.273938Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2596 sessionId:  describe result for acl check
2025-10-10T14:38:14.273977Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:14.273984Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:14.273986Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:14.273992Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602408505804198:11774] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:14.274612Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602408505804198:11774] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:14.277758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602408505804198:11774] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:14.283337Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602408505804198:11774] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:14.283356Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602408505804198:11774] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:14.283360Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602408505804198:11774] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:14.283370Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2596 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:14.295811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:14.297511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:14.297747Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:14.297753Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:14.297765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:14.297827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:14.297871Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602407723568937:11795]
2025-10-10T14:38:14.298524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:14.298878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:14.298953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:14.299312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:14.299375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:14.299382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:14.299384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:14.299385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:14.299386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:14.299388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:14.299389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:14.299390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:14.299391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:14.299393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:14.299394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:14.299395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:14.299397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:14.299403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:14.299417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:14.299421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:14.299425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:14.299429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:14.299432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:14.299436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:14.299439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:14.299443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:14.299447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:14.299451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:14.299456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:14.299460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:14.299468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:14.299477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:14.299484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:14.299490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:14.299495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:14.299501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:14.299505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:14.299510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:14.299515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:14.299520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:14.299523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:14.299528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:14.299533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:14.299538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:14.299544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:14.299550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:14.299555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:14.299561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:14.299566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:14.299571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:14.299578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:14.299588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:14.299593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:14.299597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:14.299602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:14.299612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:14.299654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:14.302390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:14.302951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:14.302967Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:14.302970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:14.302975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:14.302982Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2595 [2:7559602407723568937:11795]
2025-10-10T14:38:14.302996Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:14.303016Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:14.303026Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:14.303031Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:14.303033Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:14.303052Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:14.303062Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:14.303075Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:14.303145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:14.303151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:14.303154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:14.303158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:14.303238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:14.303245Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:14.303258Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:14.303274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:14.303294Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:14.303321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602408505804235:11774], now have 1 active actors on pipe
2025-10-10T14:38:14.303330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602408505804191:2438], now have 1 active actors on pipe
2025-10-10T14:38:14.303339Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602407723568932:11795]
2025-10-10T14:38:14.303342Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602407723568932:11795]
2025-10-10T14:38:14.303344Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602407723568932:11795]
2025-10-10T14:38:14.303360Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:14.303377Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:14.303395Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:14.303399Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:14.303433Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602407723568932:11795]
2025-10-10T14:38:14.303441Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:14.303485Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:14.303497Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:14.303500Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:14.303507Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:14.303807Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2595
2025-10-10T14:38:14.303847Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2595
2025-10-10T14:38:14.303878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:14.303890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:14.303927Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bed5b726-8e208b30-ea33f45c-110217ef_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:14.303950Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:14.303959Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:14.303962Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:14.303977Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:14.303996Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:14.304017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:14.307666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:14.307685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:14.307731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:14.309719Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2596 partition: 0 MaxSeqNo: 40 sessionId: src_id|bed5b726-8e208b30-ea33f45c-110217ef_0
2025-10-10T14:38:14.310750Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64bd8397-67ff798b-ce161969-fdf8611a_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|bed5b726-8e208b30-ea33f45c-110217ef_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:14.313450Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bed5b726-8e208b30-ea33f45c-110217ef_0] Write session: try to update token
2025-10-10T14:38:14.313473Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bed5b726-8e208b30-ea33f45c-110217ef_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:14.325750Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:14.325769Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:14.325773Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:14.325775Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:14.325786Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602407723568932:11795]
2025-10-10T14:38:14.325791Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602407723568932:11795]
2025-10-10T14:38:14.325796Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602407723568932:11795]
2025-10-10T14:38:14.325849Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:14.325847Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:14.325854Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:14.325856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:14.325859Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:14.325859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:14.326003Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:14.330065Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2596 sessionId: src_id|bed5b726-8e208b30-ea33f45c-110217ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:14.332859Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:14.366433Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602408505804406:11209]
2025-10-10T14:38:14.366764Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 pipe creation result: OK TabletId: 72075186224037892 Generation: 2595, pipe: [1:7559602408505804406:11209]
2025-10-10T14:38:14.444987Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:14.445568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:14.445583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:14.445630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602408505804406:11209], now have 1 active actors on pipe
2025-10-10T14:38:14.445895Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:14.445907Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:14.445923Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:14.446004Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2596 reason: error at write: Disconnected sessionId: src_id|bed5b726-8e208b30-ea33f45c-110217ef_0
2025-10-10T14:38:14.446210Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2596 sessionId: src_id|bed5b726-8e208b30-ea33f45c-110217ef_0 is DEAD
2025-10-10T14:38:14.446383Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 94 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602408505804406:11209]
2025-10-10T14:38:14.446398Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:14.449436Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bed5b726-8e208b30-ea33f45c-110217ef_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:14.449449Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bed5b726-8e208b30-ea33f45c-110217ef_0] Write session will restart in 0.009340s
2025-10-10T14:38:14.449476Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bed5b726-8e208b30-ea33f45c-110217ef_0] Write session: Do CDS request
2025-10-10T14:38:14.449485Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bed5b726-8e208b30-ea33f45c-110217ef_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:14.459950Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bed5b726-8e208b30-ea33f45c-110217ef_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:14.460030Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:14.460048Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2597
2025-10-10T14:38:14.460170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:14.460246Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2597 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:14.460293Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2597 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:14.460304Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2597 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:14.460308Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:14.460897Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2597 sessionId:  describe result for acl check
2025-10-10T14:38:14.460935Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:14.460942Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:14.460944Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:14.460951Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602408505804594:11779] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:14.461568Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602408505804594:11779] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:14.462347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:14.462567Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:14.462579Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:14.462591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:14.462642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:14.462685Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602407723569134:11798]
2025-10-10T14:38:14.463335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:14.463651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:14.463703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:14.463829Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602408505804594:11779] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:14.464044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:14.464104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:14.464112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:14.464113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:14.464115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:14.464116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:14.464118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:14.464120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:14.464121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:14.464122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:14.464124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:14.464125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:14.464127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:14.464128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:14.464135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:14.464149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:14.464154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:14.464159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:14.464163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:14.464168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:14.464173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:14.464178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:14.464182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:14.464187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:14.464192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:14.464197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:14.464202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:14.464209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:14.464218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:14.464226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:14.464232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:14.464238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:14.464245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:14.464250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:14.464255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:14.464261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:14.464269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:14.464279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:14.464285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:14.464296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:14.464301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:14.464306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:14.464311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:14.464317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:14.464322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:14.464326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:14.464332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:14.464342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:14.464347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:14.464353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:14.464363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:14.464369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:14.464379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:14.464426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:14.467077Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602408505804594:11779] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:14.467092Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602408505804594:11779] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:14.467096Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602408505804594:11779] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:14.467105Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2597 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:14.466970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:14.467306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:14.467312Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:14.467315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:14.467319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:14.467324Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2596 [2:7559602407723569134:11798]
2025-10-10T14:38:14.467341Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:14.467359Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:14.467362Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:14.467366Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:14.467368Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:14.467386Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:14.467394Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:14.467403Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:14.467459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:14.467461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:14.467462Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:14.467465Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:14.467619Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:14.467633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:14.467636Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2596
2025-10-10T14:38:14.467643Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:14.467655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:14.467676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:14.467680Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2596
2025-10-10T14:38:14.467700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602408505804422:2438], now have 1 active actors on pipe
2025-10-10T14:38:14.467711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602408505804627:11779], now have 1 active actors on pipe
2025-10-10T14:38:14.467726Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602407723569129:11798]
2025-10-10T14:38:14.467728Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602407723569129:11798]
2025-10-10T14:38:14.467730Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602407723569129:11798]
2025-10-10T14:38:14.467740Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:14.467750Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:14.467754Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:14.467759Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:14.467762Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:14.467772Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:14.467776Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:14.467792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:14.467802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:14.467838Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602407723569129:11798]
2025-10-10T14:38:14.467850Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:14.467861Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:14.467869Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d926e79d-daf989f9-48159c24-3c191980_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:14.467876Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:14.467880Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:14.467883Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:14.467895Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:14.467906Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:14.467942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:14.468262Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2597 partition: 0 MaxSeqNo: 40 sessionId: src_id|d926e79d-daf989f9-48159c24-3c191980_0
2025-10-10T14:38:14.468085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:14.468095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:14.468110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:14.468663Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bed5b726-8e208b30-ea33f45c-110217ef_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|d926e79d-daf989f9-48159c24-3c191980_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:14.471380Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d926e79d-daf989f9-48159c24-3c191980_0] Write session: try to update token
2025-10-10T14:38:14.471398Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d926e79d-daf989f9-48159c24-3c191980_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:14.485811Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2597 sessionId: src_id|d926e79d-daf989f9-48159c24-3c191980_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:14.487487Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:14.487508Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:14.487511Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:14.487513Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:14.487522Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602407723569129:11798]
2025-10-10T14:38:14.487526Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602407723569129:11798]
2025-10-10T14:38:14.487528Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602407723569129:11798]
2025-10-10T14:38:14.487570Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:14.487575Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:14.487576Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:14.487580Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:14.487582Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:14.487584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:14.487727Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:14.488520Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:14.546646Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602408505804636:11209]
2025-10-10T14:38:14.546966Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 pipe creation result: OK TabletId: 72075186224037892 Generation: 2596, pipe: [1:7559602408505804636:11209]
2025-10-10T14:38:14.604393Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:14.604647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:14.604663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:14.604707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602408505804636:11209], now have 1 active actors on pipe
2025-10-10T14:38:14.605061Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:14.605099Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:38:14.605127Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 95 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602408505804636:11209]
2025-10-10T14:38:14.605188Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2597 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d926e79d-daf989f9-48159c24-3c191980_0
2025-10-10T14:38:14.605418Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2597 sessionId: src_id|d926e79d-daf989f9-48159c24-3c191980_0 is DEAD
2025-10-10T14:38:14.605008Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:14.605850Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d926e79d-daf989f9-48159c24-3c191980_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:38:14.605859Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d926e79d-daf989f9-48159c24-3c191980_0] Write session will restart in 0.005513s
2025-10-10T14:38:14.605878Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d926e79d-daf989f9-48159c24-3c191980_0] Write session: Do CDS request
2025-10-10T14:38:14.605883Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d926e79d-daf989f9-48159c24-3c191980_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:14.613776Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d926e79d-daf989f9-48159c24-3c191980_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:14.613883Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:14.613898Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2598
2025-10-10T14:38:14.614062Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2598 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:14.614110Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2598 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:14.614123Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2598 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:14.614130Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:14.614593Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2598 sessionId:  describe result for acl check
2025-10-10T14:38:14.614630Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:14.614638Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:14.614642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:14.614648Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602408505804655:11783] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:14.615240Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602408505804655:11783] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:14.622918Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602408505804655:11783] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:14.627560Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602408505804655:11783] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:14.627577Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602408505804655:11783] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:14.627582Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602408505804655:11783] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:14.627591Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2598 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:14.635629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:14.645774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:14.646059Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:14.646074Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:14.646089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:14.646164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:14.646213Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602407723569336:11800]
2025-10-10T14:38:14.646867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:14.647264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:14.647330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:14.647689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:14.647759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:14.647764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:14.647766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:14.647768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:14.647769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:14.647771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:14.647772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:14.647773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:14.647775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:14.647776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:14.647777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:14.647779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:14.647780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:14.647787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:14.647800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:14.647805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:14.647810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:14.647814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:14.647819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:14.647823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:14.647827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:14.647831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:14.647835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:14.647838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:14.647842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:14.647846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:14.647854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:14.647864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:14.647871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:14.647877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:14.647882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:14.647892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:14.647898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:14.647910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:14.647915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:14.647921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:14.647926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:14.647932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:14.647943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:14.647948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:14.647956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:14.647963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:14.647968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:14.647976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:14.647985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:14.647991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:14.648000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:14.648005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:14.648010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:14.648016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:14.648021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:14.648028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:14.648072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:14.650877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:14.651524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:14.651537Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:14.651540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:14.651544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:14.651552Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2597 [2:7559602407723569336:11800]
2025-10-10T14:38:14.651564Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:14.651585Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:14.651593Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:14.651596Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:14.651600Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:14.651619Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:14.651631Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:14.651950Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2597
2025-10-10T14:38:14.651640Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:14.651710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:14.651713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:14.652014Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2597
2025-10-10T14:38:14.651716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:14.651719Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:14.651791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:14.651794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:14.651806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:14.651816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:14.651832Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:14.651856Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602407723569331:11800]
2025-10-10T14:38:14.651858Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602407723569331:11800]
2025-10-10T14:38:14.651860Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602407723569331:11800]
2025-10-10T14:38:14.651871Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:14.651881Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:14.651885Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:14.651888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602408505804640:2438], now have 1 active actors on pipe
2025-10-10T14:38:14.651891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602408505804812:11783], now have 1 active actors on pipe
2025-10-10T14:38:14.651896Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:14.651899Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:14.651911Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:14.651915Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:14.651947Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602407723569331:11800]
2025-10-10T14:38:14.651957Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:14.652006Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:14.652223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:14.652235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:14.652266Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4c62dd7c-91c61dcf-7d8cd2f9-49afa0df_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:14.652280Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:14.652284Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:14.652286Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:14.652298Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:14.652314Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:14.652333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:14.657629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:14.657646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:14.657687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:14.657903Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2598 partition: 0 MaxSeqNo: 40 sessionId: src_id|4c62dd7c-91c61dcf-7d8cd2f9-49afa0df_0
2025-10-10T14:38:14.658340Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d926e79d-daf989f9-48159c24-3c191980_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|4c62dd7c-91c61dcf-7d8cd2f9-49afa0df_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:14.666675Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4c62dd7c-91c61dcf-7d8cd2f9-49afa0df_0] Write session: try to update token
2025-10-10T14:38:14.666698Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4c62dd7c-91c61dcf-7d8cd2f9-49afa0df_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:14.678644Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:14.678664Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:14.678668Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:14.678670Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:14.678680Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602407723569331:11800]
2025-10-10T14:38:14.678684Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602407723569331:11800]
2025-10-10T14:38:14.678689Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602407723569331:11800]
2025-10-10T14:38:14.678749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:14.678757Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:14.678757Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:14.678759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:14.678764Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:14.678768Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:14.678910Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:14.685843Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2598 sessionId: src_id|4c62dd7c-91c61dcf-7d8cd2f9-49afa0df_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:14.689384Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:14.704834Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602408505804882:11209]
2025-10-10T14:38:14.705164Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 pipe creation result: OK TabletId: 72075186224037892 Generation: 2597, pipe: [1:7559602408505804882:11209]
2025-10-10T14:38:14.799614Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:14.800119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:14.800136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:14.800160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602408505804882:11209], now have 1 active actors on pipe
2025-10-10T14:38:14.800390Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:14.800438Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:14.800476Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 96 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602408505804882:11209]
2025-10-10T14:38:14.800497Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:38:14.801305Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2598 reason: status is not ok: tablet will be restarted right now sessionId: src_id|4c62dd7c-91c61dcf-7d8cd2f9-49afa0df_0
2025-10-10T14:38:14.801512Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2598 sessionId: src_id|4c62dd7c-91c61dcf-7d8cd2f9-49afa0df_0 is DEAD
2025-10-10T14:38:14.801671Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4c62dd7c-91c61dcf-7d8cd2f9-49afa0df_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:38:14.801684Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4c62dd7c-91c61dcf-7d8cd2f9-49afa0df_0] Write session will restart in 0.009857s
2025-10-10T14:38:14.801710Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4c62dd7c-91c61dcf-7d8cd2f9-49afa0df_0] Write session: Do CDS request
2025-10-10T14:38:14.801716Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4c62dd7c-91c61dcf-7d8cd2f9-49afa0df_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:14.812884Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4c62dd7c-91c61dcf-7d8cd2f9-49afa0df_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:14.812990Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:14.813005Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2599
2025-10-10T14:38:14.813149Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2599 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:14.813188Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2599 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:14.813194Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2599 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:14.813198Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:14.813802Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2599 sessionId:  describe result for acl check
2025-10-10T14:38:14.813838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:14.813840Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:14.813842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:14.813849Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602408505804926:11797] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:14.814439Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602408505804926:11797] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:14.817299Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602408505804926:11797] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:14.820708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602408505804926:11797] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:14.820724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602408505804926:11797] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:14.820728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602408505804926:11797] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:14.820737Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2599 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:14.821585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:14.823322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:14.823564Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:14.823576Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:14.823589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:14.823657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:14.823757Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602407723569549:11815]
2025-10-10T14:38:14.824383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:14.824722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:14.824776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:14.825098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:14.825169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:14.825175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:14.825177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:14.825178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:14.825179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:14.825180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:14.825182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:14.825183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:14.825184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:14.825185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:14.825187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:14.825188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:14.825189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:14.825196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:14.825210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:14.825214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:14.825219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:14.825223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:14.825227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:14.825231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:14.825235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:14.825239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:14.825243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:14.825247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:14.825251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:14.825256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:14.825263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:14.825273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:14.825279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:14.825285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:14.825289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:14.825295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:14.825299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:14.825305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:14.825309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:14.825314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:14.825318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:14.825324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:14.825342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:14.825348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:14.825353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:14.825362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:14.825366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:14.825371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:14.825375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:14.825380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:14.825386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:14.825391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:14.825395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:14.825404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:14.825408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:14.825413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:14.825456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:14.827919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:14.828488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:14.828501Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:14.828503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:14.828507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:14.828513Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2598 [2:7559602407723569549:11815]
2025-10-10T14:38:14.828526Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:14.828543Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:14.828556Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:14.828560Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:14.828562Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:14.828580Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:14.828589Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:14.828597Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:14.828668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:14.828675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:14.828678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:14.828681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:14.828752Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:14.828759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:14.828770Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:14.828783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:14.828806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:14.828832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602408505804889:2438], now have 1 active actors on pipe
2025-10-10T14:38:14.828844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602408505805093:11797], now have 1 active actors on pipe
2025-10-10T14:38:14.828853Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602407723569544:11815]
2025-10-10T14:38:14.828855Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602407723569544:11815]
2025-10-10T14:38:14.828857Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602407723569544:11815]
2025-10-10T14:38:14.828870Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:14.828884Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:14.828884Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:14.828887Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:14.828889Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:14.828901Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:14.828904Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:14.828896Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2598
2025-10-10T14:38:14.828924Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2598
2025-10-10T14:38:14.828931Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602407723569544:11815]
2025-10-10T14:38:14.828941Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:14.828942Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:14.828959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:14.828969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:14.829026Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9a879514-676e5093-8f59a08d-e28e95b0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:14.829038Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:14.829043Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:14.829045Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:14.829056Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:14.829067Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:14.829095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:14.829213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:14.829222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:14.829237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:14.829323Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2599 partition: 0 MaxSeqNo: 40 sessionId: src_id|9a879514-676e5093-8f59a08d-e28e95b0_0
2025-10-10T14:38:14.829762Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4c62dd7c-91c61dcf-7d8cd2f9-49afa0df_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|9a879514-676e5093-8f59a08d-e28e95b0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:14.832654Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9a879514-676e5093-8f59a08d-e28e95b0_0] Write session: try to update token
2025-10-10T14:38:14.832674Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9a879514-676e5093-8f59a08d-e28e95b0_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:14.848340Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2599 sessionId: src_id|9a879514-676e5093-8f59a08d-e28e95b0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:14.852162Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:14.852184Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:14.852187Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:14.852189Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:14.852199Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602407723569544:11815]
2025-10-10T14:38:14.852204Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602407723569544:11815]
2025-10-10T14:38:14.852208Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602407723569544:11815]
2025-10-10T14:38:14.852258Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:14.852267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:14.852269Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:14.852414Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:14.853114Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:14.853276Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:14.853293Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:14.853297Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:14.900425Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602408505805110:11209]
2025-10-10T14:38:14.900696Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 pipe creation result: OK TabletId: 72075186224037892 Generation: 2598, pipe: [1:7559602408505805110:11209]
2025-10-10T14:38:14.966786Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:14.967224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:14.967242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:14.967290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602408505805110:11209], now have 1 active actors on pipe
2025-10-10T14:38:14.967537Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:14.967540Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:14.967577Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 97 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602408505805110:11209]
2025-10-10T14:38:14.967737Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:38:14.967830Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2599 reason: status is not ok: tablet will be restarted right now sessionId: src_id|9a879514-676e5093-8f59a08d-e28e95b0_0
2025-10-10T14:38:14.968041Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2599 sessionId: src_id|9a879514-676e5093-8f59a08d-e28e95b0_0 is DEAD
2025-10-10T14:38:14.968181Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a879514-676e5093-8f59a08d-e28e95b0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:38:14.968195Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a879514-676e5093-8f59a08d-e28e95b0_0] Write session will restart in 0.009429s
2025-10-10T14:38:14.968216Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a879514-676e5093-8f59a08d-e28e95b0_0] Write session: Do CDS request
2025-10-10T14:38:14.968221Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a879514-676e5093-8f59a08d-e28e95b0_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:14.978951Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9a879514-676e5093-8f59a08d-e28e95b0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:14.979015Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:14.979034Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2600
2025-10-10T14:38:14.979186Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2600 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:14.979223Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2600 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:14.979234Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2600 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:14.979238Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:14.979889Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2600 sessionId:  describe result for acl check
2025-10-10T14:38:14.979929Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:14.979936Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:14.979938Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:14.979944Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602408505805243:11801] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:14.980539Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602408505805243:11801] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:14.982996Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602408505805243:11801] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:14.983119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:14.985221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:14.985449Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:14.985463Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:14.985476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:14.985540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:14.985574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602408505805243:11801] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:14.985582Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602407723569737:11817]
2025-10-10T14:38:14.985590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602408505805243:11801] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:14.985593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602408505805243:11801] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:14.985602Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2600 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:14.986216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:14.986589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:14.986641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:14.986993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:14.987066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:14.987074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:14.987075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:14.987076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:14.987077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:14.987079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:14.987080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:14.987081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:14.987083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:14.987084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:14.987086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:14.987087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:14.987089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:14.987095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:14.987110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:14.987114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:14.987119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:14.987124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:14.987128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:14.987133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:14.987137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:14.987141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:14.987146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:14.987151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:14.987155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:14.987159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:14.987167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:14.987177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:14.987190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:14.987197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:14.987202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:14.987208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:14.987215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:14.987226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:14.987231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:14.987241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:14.987246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:14.987256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:14.987262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:14.987273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:14.987277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:14.987284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:14.987294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:14.987300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:14.987309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:14.987314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:14.987320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:14.987330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:14.987335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:14.987346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:14.987351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:14.987362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:14.987411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:14.989965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:14.990609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:14.990629Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:14.990631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:14.990636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:14.990642Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2599 [2:7559602407723569737:11817]
2025-10-10T14:38:14.990656Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:14.990679Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:14.990689Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:14.990694Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:14.990696Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:14.990715Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:14.990722Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:14.990735Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:14.990803Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:14.990814Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:14.990816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:14.990818Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:14.990890Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:14.990899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:14.990913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:14.990926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:14.990942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:14.990971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602408505805318:11801], now have 1 active actors on pipe
2025-10-10T14:38:14.990979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602408505805114:2438], now have 1 active actors on pipe
2025-10-10T14:38:14.990988Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602407723569732:11817]
2025-10-10T14:38:14.990997Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602407723569732:11817]
2025-10-10T14:38:14.990999Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602407723569732:11817]
2025-10-10T14:38:14.991016Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:14.991061Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2599
2025-10-10T14:38:14.991074Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2599
2025-10-10T14:38:14.991033Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:14.991048Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:14.991053Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:14.991054Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:14.991055Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:14.991059Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:14.991085Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602407723569732:11817]
2025-10-10T14:38:14.991089Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:14.991106Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:14.991121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:14.991126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:14.991164Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dbc6f489-1420e37d-2d7193d5-34d7d05e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:14.991174Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:14.991179Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:14.991182Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:14.991195Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:14.991206Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:14.991221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:14.991391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:14.991401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:14.991419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:14.991490Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2600 partition: 0 MaxSeqNo: 40 sessionId: src_id|dbc6f489-1420e37d-2d7193d5-34d7d05e_0
2025-10-10T14:38:14.991959Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a879514-676e5093-8f59a08d-e28e95b0_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|dbc6f489-1420e37d-2d7193d5-34d7d05e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:14.994665Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dbc6f489-1420e37d-2d7193d5-34d7d05e_0] Write session: try to update token
2025-10-10T14:38:14.994683Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dbc6f489-1420e37d-2d7193d5-34d7d05e_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:15.009297Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2600 sessionId: src_id|dbc6f489-1420e37d-2d7193d5-34d7d05e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:15.010876Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:15.010901Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:15.010904Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:15.010906Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:15.010917Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602407723569732:11817]
2025-10-10T14:38:15.010923Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602407723569732:11817]
2025-10-10T14:38:15.010926Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602407723569732:11817]
2025-10-10T14:38:15.010983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:15.010985Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:15.010993Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:15.010997Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:15.010998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:15.011000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:15.011148Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:15.012099Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:15.067891Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602412800772626:11209]
2025-10-10T14:38:15.068276Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 pipe creation result: OK TabletId: 72075186224037892 Generation: 2599, pipe: [1:7559602412800772626:11209]
2025-10-10T14:38:15.135400Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:15.135841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:15.135857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:15.135909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602412800772626:11209], now have 1 active actors on pipe
2025-10-10T14:38:15.136643Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:15.136669Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:15.136686Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:15.136800Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2600 reason: error at write: Disconnected sessionId: src_id|dbc6f489-1420e37d-2d7193d5-34d7d05e_0
2025-10-10T14:38:15.136887Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 98 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602412800772626:11209]
2025-10-10T14:38:15.137020Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2600 sessionId: src_id|dbc6f489-1420e37d-2d7193d5-34d7d05e_0 is DEAD
2025-10-10T14:38:15.137043Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:15.137196Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dbc6f489-1420e37d-2d7193d5-34d7d05e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:15.137208Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dbc6f489-1420e37d-2d7193d5-34d7d05e_0] Write session will restart in 0.005432s
2025-10-10T14:38:15.137234Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dbc6f489-1420e37d-2d7193d5-34d7d05e_0] Write session: Do CDS request
2025-10-10T14:38:15.137241Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dbc6f489-1420e37d-2d7193d5-34d7d05e_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:15.143957Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dbc6f489-1420e37d-2d7193d5-34d7d05e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:15.144047Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:15.144065Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2601
2025-10-10T14:38:15.144225Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2601 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:15.144281Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2601 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:15.144292Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2601 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:15.144296Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:15.144793Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2601 sessionId:  describe result for acl check
2025-10-10T14:38:15.144834Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:15.144840Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:15.144856Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:15.144867Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602412800772648:11805] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:15.145508Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602412800772648:11805] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:15.151232Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602412800772648:11805] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:15.154857Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602412800772648:11805] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:15.154878Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602412800772648:11805] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:15.154881Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602412800772648:11805] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:15.154892Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2601 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:15.155854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:15.159247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:15.159512Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:15.159527Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:15.159540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:15.159600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:15.159665Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602412018537226:11820]
2025-10-10T14:38:15.160332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:15.160665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:15.160720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:15.161060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:15.161151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:15.161159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:15.161160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:15.161162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:15.161164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:15.161165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:15.161167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:15.161169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:15.161170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:15.161172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:15.161173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:15.161175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:15.161176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:15.161183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:15.161198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:15.161203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:15.161207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:15.161212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:15.161217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:15.161222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:15.161226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:15.161231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:15.161235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:15.161239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:15.161244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:15.161249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:15.161259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:15.161268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:15.161278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:15.161285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:15.161294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:15.161300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:15.161304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:15.161311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:15.161316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:15.161322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:15.161328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:15.161353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:15.161360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:15.161366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:15.161376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:15.161382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:15.161387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:15.161398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:15.161403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:15.161409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:15.161420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:15.161426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:15.161436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:15.161443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:15.161452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:15.161458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:15.161511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:15.164071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:15.164609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:15.164623Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:15.164627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:15.164631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:15.164639Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2600 [2:7559602412018537226:11820]
2025-10-10T14:38:15.164653Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:15.164673Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:15.164681Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:15.164685Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:15.164688Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:15.164708Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:15.164722Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:15.164731Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:15.164806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:15.164814Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:15.164816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:15.164819Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:15.164889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:15.164896Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:15.164907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:15.164920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:15.164942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:15.164970Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602412018537221:11820]
2025-10-10T14:38:15.164977Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602412018537221:11820]
2025-10-10T14:38:15.164979Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602412018537221:11820]
2025-10-10T14:38:15.164988Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:15.164997Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:15.165001Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:15.165003Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:15.165005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602412800772838:11805], now have 1 active actors on pipe
2025-10-10T14:38:15.165009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602412800772631:2438], now have 1 active actors on pipe
2025-10-10T14:38:15.165018Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:15.165035Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:15.165038Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:15.165065Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602412018537221:11820]
2025-10-10T14:38:15.165080Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:15.165100Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:15.165172Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2600
2025-10-10T14:38:15.165213Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2600
2025-10-10T14:38:15.165263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:15.165274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:15.165311Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|24b30ef8-9a05505-41767c3b-71cca8e1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:15.165341Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:15.165346Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:15.165348Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:15.165360Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:15.165372Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:15.165392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:15.165579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:15.165592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:15.165625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:15.165730Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2601 partition: 0 MaxSeqNo: 40 sessionId: src_id|24b30ef8-9a05505-41767c3b-71cca8e1_0
2025-10-10T14:38:15.166127Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dbc6f489-1420e37d-2d7193d5-34d7d05e_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|24b30ef8-9a05505-41767c3b-71cca8e1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:15.170260Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|24b30ef8-9a05505-41767c3b-71cca8e1_0] Write session: try to update token
2025-10-10T14:38:15.170304Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|24b30ef8-9a05505-41767c3b-71cca8e1_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:15.179693Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:38:15.179722Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:15.179734Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602412018537221:11820]
2025-10-10T14:38:15.179797Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:38:15.179802Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:38:15.180182Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:38:15.180336Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:15.180490Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:15.180640Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:15.180849Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:38:15.180902Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:38:15.189609Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2601 sessionId: src_id|24b30ef8-9a05505-41767c3b-71cca8e1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:15.192381Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:15.192658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:15.192685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:15.192732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:38:15.192817Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:38:15.197029Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:15.197049Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:15.197053Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:15.197055Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:15.197067Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602412018537221:11820]
2025-10-10T14:38:15.197072Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602412018537221:11820]
2025-10-10T14:38:15.197076Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602412018537221:11820]
2025-10-10T14:38:15.197125Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:15.197129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:15.197137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:15.197140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:15.197157Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:15.197161Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:15.197281Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:15.236855Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602412800772851:11209]
2025-10-10T14:38:15.237173Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 pipe creation result: OK TabletId: 72075186224037892 Generation: 2600, pipe: [1:7559602412800772851:11209]
2025-10-10T14:38:15.315037Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:15.324026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:15.324059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:15.324260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:15.324338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:15.324410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:15.324480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:15.324533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:15.324542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:15.324622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:15.324770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:15.324837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:15.324910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:15.325052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:15.325061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:15.325176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:15.325248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:15.325319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:15.325578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:15.325627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:15.325636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:15.325713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:15.325789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:15.325858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:15.325930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:15.325985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:15.325993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:15.326065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:15.326128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:15.328399Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:15.328417Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:15.328421Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:15.328455Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2601 reason: error at write: Disconnected sessionId: src_id|24b30ef8-9a05505-41767c3b-71cca8e1_0
2025-10-10T14:38:15.328471Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 99 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602412800772851:11209]
2025-10-10T14:38:15.328486Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1661: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 closed with error: reason# too much attempts to restart pipe
2025-10-10T14:38:15.328586Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 is DEAD
2025-10-10T14:38:15.328685Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2601 sessionId: src_id|24b30ef8-9a05505-41767c3b-71cca8e1_0 is DEAD
2025-10-10T14:38:15.328747Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559602335491343500:11204] disconnected; active server actors: 1
2025-10-10T14:38:15.328755Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559602335491343500:11204] client user disconnected session shared/user_1_26_8283312721166257727_v1
2025-10-10T14:38:15.328812Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24b30ef8-9a05505-41767c3b-71cca8e1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:15.328825Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24b30ef8-9a05505-41767c3b-71cca8e1_0] Write session will restart in 0.006170s
2025-10-10T14:38:15.328851Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24b30ef8-9a05505-41767c3b-71cca8e1_0] Write session: Do CDS request
2025-10-10T14:38:15.328857Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24b30ef8-9a05505-41767c3b-71cca8e1_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:15.328940Z :ERROR: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] Got error. Status: UNAVAILABLE. Description: <main>: Error: too much attempts to restart pipe, code: 500027 
2025-10-10T14:38:15.329081Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-10T14:38:15.329087Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-10T14:38:15.329094Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] Reconnecting session to cluster  in 0.009369s
2025-10-10T14:38:15.326198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:15.326266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:15.326412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:15.326417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:15.326496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:15.326558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:15.326627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:15.326693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:15.326734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:15.326737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:15.326814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:15.326876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:15.326947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:15.327057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:15.327103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:15.327106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:15.327178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:15.327234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:15.327300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:15.327367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:15.327473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:15.327476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:15.327545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:15.327600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:15.327664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:15.327728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:15.327780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:15.327783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:15.327854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:15.327912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:15.327975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:15.328037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:15.328124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:15.328127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:15.328201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602412800772851:11209], now have 1 active actors on pipe
2025-10-10T14:38:15.329572Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:15.340867Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] Successfully connected. Initializing session
2025-10-10T14:38:15.340887Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|24b30ef8-9a05505-41767c3b-71cca8e1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:15.341030Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:15.341048Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2602
2025-10-10T14:38:15.341576Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2602 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:15.341620Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2602 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:15.341627Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2602 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:15.341631Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:15.341681Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-10T14:38:15.341683Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 27
2025-10-10T14:38:15.341827Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 27 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-10T14:38:15.341876Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 read init: from# ipv6:[::1]:37328, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-10T14:38:15.341964Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 auth for : user
2025-10-10T14:38:15.343523Z :INFO: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] Got InitResponse. ReadSessionId: shared/user_1_27_4594285658103637580_v1
2025-10-10T14:38:15.342453Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2602 sessionId:  describe result for acl check
2025-10-10T14:38:15.342496Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:15.342498Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:15.342500Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:15.342506Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602412800772957:11809] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:15.343054Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 Handle describe topics response
2025-10-10T14:38:15.343077Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 auth is DEAD
2025-10-10T14:38:15.343096Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602412800772957:11809] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:15.343126Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 auth ok: topics# 1, initDone# 0
2025-10-10T14:38:15.343413Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 register session: topic# rt3.dc1--test-topic
2025-10-10T14:38:15.344395Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559602412800772971:11810] connected; active server actors: 1
2025-10-10T14:38:15.344406Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7559602412800772971:11810] session shared/user_1_27_4594285658103637580_v1
2025-10-10T14:38:15.344416Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-10-10T14:38:15.344427Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-10-10T14:38:15.344434Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_27_4594285658103637580_v1" (Sender=[1:7559602412800772945:11810], Pipe=[1:7559602412800772971:11810], Partitions=[], ActiveFamilyCount=0)
2025-10-10T14:38:15.344439Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-10T14:38:15.344449Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-10-10T14:38:15.344459Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_27_4594285658103637580_v1" (Sender=[1:7559602412800772945:11810], Pipe=[1:7559602412800772971:11810], Partitions=[], ActiveFamilyCount=0)
2025-10-10T14:38:15.344469Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_27_4594285658103637580_v1" sender [1:7559602412800772945:11810] lock partition 0 for ReadingSession "shared/user_1_27_4594285658103637580_v1" (Sender=[1:7559602412800772945:11810], Pipe=[1:7559602412800772971:11810], Partitions=[], ActiveFamilyCount=1) generation 1 step 27
2025-10-10T14:38:15.344477Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-10-10T14:38:15.344482Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000030s
2025-10-10T14:38:15.344717Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 27 Session: "shared/user_1_27_4594285658103637580_v1" ClientId: "user" PipeClient { RawX1: 7559602412800772971 RawX2: 4503603922349602 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-10T14:38:15.344741Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-10T14:38:15.348053Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602412800772957:11809] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:15.350693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:15.350700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602412800772957:11809] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:15.350717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602412800772957:11809] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:15.350721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602412800772957:11809] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:15.350731Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2602 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:15.353111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:15.353363Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:15.353377Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:15.353392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:15.353461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:15.353508Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602412018537430:11822]
2025-10-10T14:38:15.354019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:15.354372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:15.354435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:15.354809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:15.354877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:15.354885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:15.354886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:15.354887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:15.354888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:15.354889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:15.354890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:15.354892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:15.354893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:15.354894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:15.354895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:15.354896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:15.354897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:15.354904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:15.354918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:15.354923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:15.354927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:15.354930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:15.354934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:15.354938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:15.354941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:15.354945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:15.354950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:15.354953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:15.354957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:15.354961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:15.354971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:15.354983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:15.354989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:15.354995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:15.354999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:15.355005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:15.355010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:15.355029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:15.355040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:15.355045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:15.355050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:15.355054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:15.355059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:15.355069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:15.355074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:15.355079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:15.355089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:15.355096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:15.355105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:15.355110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:15.355115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:15.355121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:15.355129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:15.355135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:15.355140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:15.355150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:15.355191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:15.357807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:15.358267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:15.358288Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:15.358291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:15.358295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:15.358301Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2601 [2:7559602412018537430:11822]
2025-10-10T14:38:15.358315Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:15.358337Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:15.358344Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:15.358347Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:15.358348Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:15.358363Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:15.358372Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:15.358379Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:15.358430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:15.358435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:15.358437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:15.358439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:15.358508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:15.358516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:15.358527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:15.358537Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:15.358556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:15.358581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602412800772994:11816], now have 1 active actors on pipe
2025-10-10T14:38:15.358589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602412800773068:11809], now have 1 active actors on pipe
2025-10-10T14:38:15.358592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602412800772854:2438], now have 1 active actors on pipe
2025-10-10T14:38:15.358600Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602412018537424:11822]
2025-10-10T14:38:15.358607Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602412018537424:11822]
2025-10-10T14:38:15.358609Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602412018537424:11822]
2025-10-10T14:38:15.358622Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:15.358632Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:15.358640Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:15.358641Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:15.358642Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:15.358657Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:15.358665Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:15.358696Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602412018537424:11822]
2025-10-10T14:38:15.358707Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:15.358712Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:15.358835Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 2601, pipe: [1:7559602412800772994:11816]
2025-10-10T14:38:15.358865Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2601
2025-10-10T14:38:15.358887Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2601
2025-10-10T14:38:15.358982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:15.358993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:15.359004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_27_4594285658103637580_v1 on pipe: [1:7559602412800772994:11816]
2025-10-10T14:38:15.359028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:15.359035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:15.359042Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_27_4594285658103637580_v1:1 with generation 2601
2025-10-10T14:38:15.359050Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:15.359060Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:15.359062Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:15.359082Z node 2 :PERSQUEUE DEBUG: partition.cpp:3747: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_27_4594285658103637580_v1
2025-10-10T14:38:15.359090Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:15.359136Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5c24659b-d7caa3b3-88067111-f2e0822f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:15.359148Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:38:15.359154Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:38:15.363622Z node 2 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:38:15.363665Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:38:15.363676Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:15.363685Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:15.363688Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:15.363703Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:15.363735Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:15.363750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-10T14:38:15.363766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-10T14:38:15.363789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:15.363953Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 40 WriteTimestampMS: 1760106661000 SizeLag: 17206678 WriteTimestampEstimateMS: 1760107095357 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-10T14:38:15.363982Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 40 readOffset 0 committedOffset 0
2025-10-10T14:38:15.364051Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 sending to client partition status
2025-10-10T14:38:15.364373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:15.364388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:15.364413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:15.364597Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2602 partition: 0 MaxSeqNo: 40 sessionId: src_id|5c24659b-d7caa3b3-88067111-f2e0822f_0
2025-10-10T14:38:15.365758Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24b30ef8-9a05505-41767c3b-71cca8e1_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|5c24659b-d7caa3b3-88067111-f2e0822f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:15.368601Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5c24659b-d7caa3b3-88067111-f2e0822f_0] Write session: try to update token
2025-10-10T14:38:15.368622Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5c24659b-d7caa3b3-88067111-f2e0822f_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:15.378401Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:15.378422Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:15.378426Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:15.378428Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:15.378438Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602412018537424:11822]
2025-10-10T14:38:15.378443Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602412018537424:11822]
2025-10-10T14:38:15.378447Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602412018537424:11822]
2025-10-10T14:38:15.378501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:15.378516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:15.378523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:15.378709Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:15.380342Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:15.380359Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:15.380364Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:15.388923Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2602 sessionId: src_id|5c24659b-d7caa3b3-88067111-f2e0822f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:15.391575Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:15.497125Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:15.497943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:15.497962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:15.498252Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 0 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602412800772994:11816]
2025-10-10T14:38:15.498431Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:15.498439Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:15.498503Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2602 reason: error at write: Disconnected sessionId: src_id|5c24659b-d7caa3b3-88067111-f2e0822f_0
2025-10-10T14:38:15.498719Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2602 sessionId: src_id|5c24659b-d7caa3b3-88067111-f2e0822f_0 is DEAD
2025-10-10T14:38:15.498899Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c24659b-d7caa3b3-88067111-f2e0822f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:15.498912Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c24659b-d7caa3b3-88067111-f2e0822f_0] Write session will restart in 0.007318s
2025-10-10T14:38:15.498890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_27_4594285658103637580_v1
2025-10-10T14:38:15.498914Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:15.498940Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c24659b-d7caa3b3-88067111-f2e0822f_0] Write session: Do CDS request
2025-10-10T14:38:15.498946Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c24659b-d7caa3b3-88067111-f2e0822f_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:15.498938Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_27_4594285658103637580_v1
2025-10-10T14:38:15.498919Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:15.508174Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5c24659b-d7caa3b3-88067111-f2e0822f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:15.508538Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:15.508574Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2603
2025-10-10T14:38:15.508856Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2603 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:15.508906Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2603 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:15.508919Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2603 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:15.508924Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:15.510087Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2603 sessionId:  describe result for acl check
2025-10-10T14:38:15.510146Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:15.510151Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:15.510153Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:15.510160Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602412800773180:11818] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:15.510823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602412800773180:11818] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:15.514605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602412800773180:11818] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:15.517644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602412800773180:11818] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:15.517661Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602412800773180:11818] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:15.517665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602412800773180:11818] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:15.517674Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2603 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:15.518689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:15.519364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:15.519588Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:15.519602Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:15.519615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:15.519674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:15.519724Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602412018537624:11825]
2025-10-10T14:38:15.520299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:15.521077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:15.521131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:15.521506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:15.521597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:15.521603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:15.521605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:15.521606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:15.521607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:15.521608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:15.521609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:15.521610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:15.521611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:15.521612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:15.521614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:15.521615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:15.521616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:15.521621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:15.521634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:15.521638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:15.521642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:15.521646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:15.521649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:15.521653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:15.521656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:15.521660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:15.521664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:15.521667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:15.521671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:15.521674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:15.521684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:15.521692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:15.521699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:15.521704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:15.521708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:15.521713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:15.521722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:15.521727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:15.521731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:15.521741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:15.521747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:15.521769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:15.521773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:15.521778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:15.521786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:15.521790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:15.521794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:15.521798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:15.521806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:15.521811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:15.521815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:15.521820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:15.521824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:15.521830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:15.521835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:15.521840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:15.521885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:15.525140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:15.526568Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2602
2025-10-10T14:38:15.526570Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2602
2025-10-10T14:38:15.527040Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2603 partition: 0 MaxSeqNo: 40 sessionId: src_id|f37982de-545d1abc-7c2bd52b-37f92d47_0
2025-10-10T14:38:15.529675Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c24659b-d7caa3b3-88067111-f2e0822f_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|f37982de-545d1abc-7c2bd52b-37f92d47_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:15.532425Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f37982de-545d1abc-7c2bd52b-37f92d47_0] Write session: try to update token
2025-10-10T14:38:15.532440Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f37982de-545d1abc-7c2bd52b-37f92d47_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:15.526126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:15.526140Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:15.526142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:15.526146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:15.526153Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2602 [2:7559602412018537624:11825]
2025-10-10T14:38:15.526166Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:15.526186Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:15.526190Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:15.526194Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:15.526196Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:15.526213Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:15.526222Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:15.526230Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:15.526314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:15.526318Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:15.526319Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:15.526322Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:15.526410Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:15.526413Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:15.526427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:15.526440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:15.526461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:15.526484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602412800773304:11818], now have 1 active actors on pipe
2025-10-10T14:38:15.526488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602412800773095:2438], now have 1 active actors on pipe
2025-10-10T14:38:15.526496Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602412018537618:11825]
2025-10-10T14:38:15.526498Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602412018537618:11825]
2025-10-10T14:38:15.526500Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602412018537618:11825]
2025-10-10T14:38:15.526517Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:15.526534Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:15.526535Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:15.526537Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:15.526539Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:15.526552Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:15.526556Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:15.526584Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602412018537618:11825]
2025-10-10T14:38:15.526595Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:15.526603Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:15.526638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:15.526644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:15.526675Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f37982de-545d1abc-7c2bd52b-37f92d47_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:15.526683Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:15.526691Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:15.526693Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:15.526706Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:15.526718Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:15.526741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:15.526895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:15.526901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:15.526927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:15.538459Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:38:15.538482Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:15.538494Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602412018537618:11825]
2025-10-10T14:38:15.538548Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:38:15.538548Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:38:15.539144Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:38:15.539485Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:15.539665Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:15.539853Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:15.540330Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:38:15.540383Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:38:15.549897Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2603 sessionId: src_id|f37982de-545d1abc-7c2bd52b-37f92d47_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:15.552691Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:15.552912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:15.552940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:15.552992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:38:15.553096Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:38:15.556893Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:15.556915Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:15.556918Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:15.556920Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:15.556933Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602412018537618:11825]
2025-10-10T14:38:15.556937Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602412018537618:11825]
2025-10-10T14:38:15.556942Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602412018537618:11825]
2025-10-10T14:38:15.556990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:15.556990Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:15.556997Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:15.556998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:15.557000Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:15.557001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:15.557186Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:15.598673Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602412800773317:11816]
2025-10-10T14:38:15.601564Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 pipe creation result: OK TabletId: 72075186224037892 Generation: 2602, pipe: [1:7559602412800773317:11816]
2025-10-10T14:38:15.673703Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:15.681398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:15.681425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:15.681592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:15.681647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:15.681710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:15.681771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:15.681819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:15.681825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:15.681899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:15.681963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:15.682030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:15.682094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:15.682604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:15.682610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:15.682687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:15.682745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:15.682841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:15.682912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:15.682958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:15.682962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:15.683035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:15.683096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:15.683165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:15.683228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:15.683275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:15.683279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:15.683392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:15.683457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:15.683559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:15.683660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:15.683700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:15.683703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:15.683780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:15.683841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:15.683907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:15.683975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:15.684037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:15.684040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:15.684111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:15.684175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:15.684247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:15.684313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:15.684369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:15.684375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:15.684446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:15.684509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:15.684619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:15.684688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:15.684749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:15.684752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:15.684821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:15.684882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:15.684942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:15.685003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:15.685064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:15.685067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:15.685254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:15.685313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:15.685400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:15.685590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:15.686421Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 1 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602412800773317:11816]
2025-10-10T14:38:15.686458Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:15.686462Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:15.686492Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2603 reason: error at write: Disconnected sessionId: src_id|f37982de-545d1abc-7c2bd52b-37f92d47_0
2025-10-10T14:38:15.686698Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2603 sessionId: src_id|f37982de-545d1abc-7c2bd52b-37f92d47_0 is DEAD
2025-10-10T14:38:15.685667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:15.685678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:15.685739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602412800773317:11816], now have 1 active actors on pipe
2025-10-10T14:38:15.686467Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:15.687025Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:15.687254Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f37982de-545d1abc-7c2bd52b-37f92d47_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:15.687266Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f37982de-545d1abc-7c2bd52b-37f92d47_0] Write session will restart in 0.007911s
2025-10-10T14:38:15.687291Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f37982de-545d1abc-7c2bd52b-37f92d47_0] Write session: Do CDS request
2025-10-10T14:38:15.687305Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f37982de-545d1abc-7c2bd52b-37f92d47_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:15.701878Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f37982de-545d1abc-7c2bd52b-37f92d47_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:15.702004Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:15.702021Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2604
2025-10-10T14:38:15.702135Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2604 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:15.702179Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2604 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:15.702191Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2604 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:15.702195Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:15.702642Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2604 sessionId:  describe result for acl check
2025-10-10T14:38:15.702681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:15.702688Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:15.702690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:15.702696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602412800773477:11828] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:15.703260Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602412800773477:11828] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:15.706463Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602412800773477:11828] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:15.707350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:15.709588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:15.709827Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:15.709839Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:15.709852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:15.709904Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602412800773477:11828] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:15.709921Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602412800773477:11828] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:15.709925Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602412800773477:11828] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:15.709934Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2604 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:15.709912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:15.709973Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602412018537829:11833]
2025-10-10T14:38:15.710612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:15.710936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:15.710986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:15.711335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:15.711427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:15.711435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:15.711436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:15.711437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:15.711438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:15.711440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:15.711441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:15.711443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:15.711444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:15.711446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:15.711447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:15.711448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:15.711450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:15.711456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:15.711468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:15.711472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:15.711476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:15.711480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:15.711485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:15.711490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:15.711494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:15.711498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:15.711504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:15.711508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:15.711512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:15.711517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:15.711526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:15.711535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:15.711542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:15.711548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:15.711553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:15.711559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:15.711564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:15.711570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:15.711574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:15.711584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:15.711594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:15.711600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:15.711610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:15.711616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:15.711620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:15.711626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:15.711631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:15.711642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:15.711646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:15.711656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:15.711660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:15.711665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:15.711669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:15.711679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:15.711684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:15.711689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:15.711730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:15.714282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:15.714635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:15.714653Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:15.714656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:15.714660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:15.714666Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2603 [2:7559602412018537829:11833]
2025-10-10T14:38:15.714679Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:15.714699Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:15.714708Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:15.714712Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:15.714715Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:15.714733Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:15.714745Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:15.714754Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:15.714819Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:15.714827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:15.714830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:15.714833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:15.714919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:15.714929Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:15.714943Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:15.714956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:15.714976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:15.715000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602412800773543:11828], now have 1 active actors on pipe
2025-10-10T14:38:15.715004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602412800773333:2438], now have 1 active actors on pipe
2025-10-10T14:38:15.715012Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602412018537824:11833]
2025-10-10T14:38:15.715015Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602412018537824:11833]
2025-10-10T14:38:15.715019Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602412018537824:11833]
2025-10-10T14:38:15.715033Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:15.715049Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:15.715068Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:15.715071Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:15.715071Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:15.715075Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:15.715078Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:15.715096Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602412018537824:11833]
2025-10-10T14:38:15.715100Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:15.715122Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:15.715202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:15.715211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:15.715053Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2603
2025-10-10T14:38:15.715086Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2603
2025-10-10T14:38:15.715265Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8e2fa93b-86a22e78-612f052b-f1decf9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:15.715284Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:15.715289Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:15.715304Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:15.715317Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:15.715330Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:15.715353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:15.715532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:15.715543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:15.715559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:15.715669Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2604 partition: 0 MaxSeqNo: 40 sessionId: src_id|8e2fa93b-86a22e78-612f052b-f1decf9_0
2025-10-10T14:38:15.716098Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f37982de-545d1abc-7c2bd52b-37f92d47_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|8e2fa93b-86a22e78-612f052b-f1decf9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:15.718864Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8e2fa93b-86a22e78-612f052b-f1decf9_0] Write session: try to update token
2025-10-10T14:38:15.718888Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8e2fa93b-86a22e78-612f052b-f1decf9_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:15.734909Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:15.734931Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:15.734934Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:15.734936Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:15.734945Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602412018537824:11833]
2025-10-10T14:38:15.734950Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602412018537824:11833]
2025-10-10T14:38:15.734954Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602412018537824:11833]
2025-10-10T14:38:15.734993Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:15.735000Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:15.735004Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:15.735006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:15.735013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:15.735016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:15.735154Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:15.742716Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2604 sessionId: src_id|8e2fa93b-86a22e78-612f052b-f1decf9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:15.745706Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:15.786685Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602412800773570:11816]
2025-10-10T14:38:15.786943Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 pipe creation result: OK TabletId: 72075186224037892 Generation: 2603, pipe: [1:7559602412800773570:11816]
2025-10-10T14:38:15.857787Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:15.858759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:15.858780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:15.858806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602412800773570:11816], now have 1 active actors on pipe
2025-10-10T14:38:15.859104Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:15.859119Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:15.859570Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e2fa93b-86a22e78-612f052b-f1decf9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:15.859595Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e2fa93b-86a22e78-612f052b-f1decf9_0] Write session will restart in 0.008336s
2025-10-10T14:38:15.859190Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2604 reason: error at write: Disconnected sessionId: src_id|8e2fa93b-86a22e78-612f052b-f1decf9_0
2025-10-10T14:38:15.859625Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e2fa93b-86a22e78-612f052b-f1decf9_0] Write session: Do CDS request
2025-10-10T14:38:15.859398Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2604 sessionId: src_id|8e2fa93b-86a22e78-612f052b-f1decf9_0 is DEAD
2025-10-10T14:38:15.859632Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e2fa93b-86a22e78-612f052b-f1decf9_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:15.859497Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 2 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602412800773570:11816]
2025-10-10T14:38:15.859112Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:15.859529Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:15.868915Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8e2fa93b-86a22e78-612f052b-f1decf9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:15.868977Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:15.868992Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2605
2025-10-10T14:38:15.869148Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2605 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:15.869203Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2605 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:15.869214Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2605 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:15.869219Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:15.869761Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2605 sessionId:  describe result for acl check
2025-10-10T14:38:15.869802Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:15.869809Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:15.869811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:15.869818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602412800773697:11836] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:15.870430Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602412800773697:11836] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:15.872799Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602412800773697:11836] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:15.873554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:15.875475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:15.875684Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:15.875696Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:15.875711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:15.875783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:15.875827Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602412018538047:11842]
2025-10-10T14:38:15.876102Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602412800773697:11836] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:15.876118Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602412800773697:11836] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:15.876122Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602412800773697:11836] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:15.876130Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2605 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:15.876455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:15.876787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:15.876844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:15.877159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:15.877223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:15.877230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:15.877232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:15.877233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:15.877234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:15.877236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:15.877237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:15.877238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:15.877240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:15.877241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:15.877242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:15.877243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:15.877245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:15.877251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:15.877263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:15.877267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:15.877271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:15.877275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:15.877279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:15.877284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:15.877288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:15.877292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:15.877296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:15.877300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:15.877304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:15.877308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:15.877315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:15.877324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:15.877346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:15.877351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:15.877357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:15.877362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:15.877367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:15.877372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:15.877377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:15.877382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:15.877387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:15.877392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:15.877397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:15.877402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:15.877408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:15.877413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:15.877418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:15.877423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:15.877432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:15.877438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:15.877454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:15.877464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:15.877468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:15.877473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:15.877482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:15.877487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:15.877526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:15.880181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:15.880496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:15.880508Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:15.880511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:15.880515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:15.880521Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2604 [2:7559602412018538047:11842]
2025-10-10T14:38:15.880533Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:15.880549Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:15.880557Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:15.880561Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:15.880563Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:15.880578Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:15.880590Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:15.880596Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:15.880656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:15.880664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:15.880666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:15.880669Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:15.880897Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2604
2025-10-10T14:38:15.880905Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2604
2025-10-10T14:38:15.880925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:15.880936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:15.880948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:15.880961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:15.880981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:15.881004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602412800773578:2438], now have 1 active actors on pipe
2025-10-10T14:38:15.881008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602412800773790:11836], now have 1 active actors on pipe
2025-10-10T14:38:15.881027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:15.881032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:15.881050Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602412018538042:11842]
2025-10-10T14:38:15.881052Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602412018538042:11842]
2025-10-10T14:38:15.881055Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602412018538042:11842]
2025-10-10T14:38:15.881069Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:15.881082Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:15.881084Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:15.881087Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:15.881089Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:15.881101Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:15.881105Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:15.881129Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a450293a-b25dcf06-662469fe-f1f199fe_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:15.881136Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:15.881140Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:15.881142Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:15.881153Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:15.881164Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:15.881187Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602412018538042:11842]
2025-10-10T14:38:15.881196Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:15.881200Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:15.881208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:15.881431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:15.881434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:15.881452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:15.881530Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2605 partition: 0 MaxSeqNo: 40 sessionId: src_id|a450293a-b25dcf06-662469fe-f1f199fe_0
2025-10-10T14:38:15.882004Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e2fa93b-86a22e78-612f052b-f1decf9_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|a450293a-b25dcf06-662469fe-f1f199fe_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:15.884852Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a450293a-b25dcf06-662469fe-f1f199fe_0] Write session: try to update token
2025-10-10T14:38:15.884873Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a450293a-b25dcf06-662469fe-f1f199fe_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:15.900018Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:38:15.900055Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:15.900070Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602412018538042:11842]
2025-10-10T14:38:15.900123Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:38:15.900133Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:38:15.900325Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:38:15.900489Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:15.900657Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:15.900825Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:15.901046Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:38:15.901097Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:38:15.905586Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2605 sessionId: src_id|a450293a-b25dcf06-662469fe-f1f199fe_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:15.908298Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:15.908877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:15.908904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:15.908945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:38:15.909079Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:38:15.918218Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:15.918240Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:15.918243Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:15.918245Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:15.918257Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602412018538042:11842]
2025-10-10T14:38:15.918273Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602412018538042:11842]
2025-10-10T14:38:15.918279Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602412018538042:11842]
2025-10-10T14:38:15.918337Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:15.918355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:15.918360Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:15.918362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:15.918368Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:15.918373Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:15.918603Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:15.959738Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602412800773801:11816]
2025-10-10T14:38:15.960063Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 pipe creation result: OK TabletId: 72075186224037892 Generation: 2604, pipe: [1:7559602412800773801:11816]
2025-10-10T14:38:16.035370Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:16.043966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:16.043993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:16.044183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:16.044256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:16.044324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:16.044392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:16.044441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:16.044451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:16.044524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:16.044652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:16.044776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:16.044848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:16.044893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:16.044902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:16.044972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:16.045045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:16.045211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:16.045283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:16.045349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:16.045360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:16.047923Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:16.047941Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 3 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602412800773801:11816]
2025-10-10T14:38:16.047975Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:16.047977Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:16.048013Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2605 reason: error at write: Disconnected sessionId: src_id|a450293a-b25dcf06-662469fe-f1f199fe_0
2025-10-10T14:38:16.048216Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2605 sessionId: src_id|a450293a-b25dcf06-662469fe-f1f199fe_0 is DEAD
2025-10-10T14:38:16.048335Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a450293a-b25dcf06-662469fe-f1f199fe_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:16.048357Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a450293a-b25dcf06-662469fe-f1f199fe_0] Write session will restart in 0.008633s
2025-10-10T14:38:16.048385Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a450293a-b25dcf06-662469fe-f1f199fe_0] Write session: Do CDS request
2025-10-10T14:38:16.048390Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a450293a-b25dcf06-662469fe-f1f199fe_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:16.045437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:16.045504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:16.045597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:16.045693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:16.045736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:16.045739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:16.045806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:16.045864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:16.045926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:16.045983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:16.046024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:16.046032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:16.046104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:16.046162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:16.046275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:16.046338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:16.046378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:16.046381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:16.046447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:16.046505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:16.046573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:16.046636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:16.046675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:16.046678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:16.046747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:16.046805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:16.046865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:16.046921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:16.046962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:16.046965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:16.047034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:16.047090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:16.047173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:16.047236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:16.047277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:16.047279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:16.047348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:16.047406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:16.047467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:16.047525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:16.047587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:16.047590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:16.047661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602412800773801:11816], now have 1 active actors on pipe
2025-10-10T14:38:16.048841Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:16.057902Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a450293a-b25dcf06-662469fe-f1f199fe_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:16.058010Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:16.058028Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2606
2025-10-10T14:38:16.058179Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2606 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:16.058222Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2606 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:16.058234Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2606 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:16.058239Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:16.058738Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2606 sessionId:  describe result for acl check
2025-10-10T14:38:16.058779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:16.058787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:16.058789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:16.058796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602417095741182:11840] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:16.059373Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602417095741182:11840] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:16.062382Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602417095741182:11840] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:16.064350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:16.066459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:16.066712Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:16.066732Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:16.066749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:16.066811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:16.066832Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602417095741182:11840] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:16.066855Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602416313505537:11844]
2025-10-10T14:38:16.066852Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602417095741182:11840] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:16.066856Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602417095741182:11840] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:16.066873Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2606 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:16.067448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:16.067752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:16.067796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:16.068126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:16.068187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:16.068189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:16.068190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:16.068191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:16.068192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:16.068193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:16.068195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:16.068196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:16.068197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:16.068198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:16.068200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:16.068201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:16.068202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:16.068209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:16.068222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:16.068226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:16.068230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:16.068234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:16.068237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:16.068241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:16.068244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:16.068248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:16.068253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:16.068257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:16.068262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:16.068266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:16.068273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:16.068282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:16.068289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:16.068295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:16.068300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:16.068305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:16.068309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:16.068314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:16.068319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:16.068325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:16.068330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:16.068335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:16.068340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:16.068345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:16.068350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:16.068355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:16.068359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:16.068365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:16.068371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:16.068377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:16.068382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:16.068388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:16.068400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:16.068406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:16.068410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:16.068420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:16.068460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:16.070885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:16.071332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:16.071350Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:16.071353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:16.071357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:16.071363Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2605 [2:7559602416313505537:11844]
2025-10-10T14:38:16.071377Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:16.071406Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:16.071415Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:16.071419Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:16.071422Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:16.071439Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:16.071452Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:16.071461Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:16.071522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:16.071530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:16.071531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:16.071534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:16.071609Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:16.071616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:16.071628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:16.071638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:16.071657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:16.071678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602417095741100:2438], now have 1 active actors on pipe
2025-10-10T14:38:16.071691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602417095741313:11840], now have 1 active actors on pipe
2025-10-10T14:38:16.071699Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602416313505532:11844]
2025-10-10T14:38:16.071708Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602416313505532:11844]
2025-10-10T14:38:16.071711Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602416313505532:11844]
2025-10-10T14:38:16.071724Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:16.071738Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:16.071749Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:16.071752Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:16.071755Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:16.071763Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:16.071765Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:16.071781Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602416313505532:11844]
2025-10-10T14:38:16.071784Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:16.071786Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:16.071743Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2605
2025-10-10T14:38:16.071749Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2605
2025-10-10T14:38:16.071813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:16.071825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:16.071865Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d91a815-ae9f4326-a8de9b74-ab26078c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:16.071879Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:16.071885Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:16.071888Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:16.071899Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:16.071910Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:16.071933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:16.072077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:16.072085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:16.072103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:16.073527Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2606 partition: 0 MaxSeqNo: 40 sessionId: src_id|d91a815-ae9f4326-a8de9b74-ab26078c_0
2025-10-10T14:38:16.073941Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a450293a-b25dcf06-662469fe-f1f199fe_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|d91a815-ae9f4326-a8de9b74-ab26078c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:16.076869Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d91a815-ae9f4326-a8de9b74-ab26078c_0] Write session: try to update token
2025-10-10T14:38:16.076890Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d91a815-ae9f4326-a8de9b74-ab26078c_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:16.091211Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:16.091237Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:16.091240Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:16.091243Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:16.091253Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602416313505532:11844]
2025-10-10T14:38:16.091258Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602416313505532:11844]
2025-10-10T14:38:16.091263Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602416313505532:11844]
2025-10-10T14:38:16.091307Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:16.091311Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:16.091319Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:16.091322Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:16.091329Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:16.091333Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:16.091880Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:16.092119Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2606 sessionId: src_id|d91a815-ae9f4326-a8de9b74-ab26078c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:16.095171Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:16.148175Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602417095741325:11816]
2025-10-10T14:38:16.148556Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 pipe creation result: OK TabletId: 72075186224037892 Generation: 2605, pipe: [1:7559602417095741325:11816]
2025-10-10T14:38:16.214374Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:16.214808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:16.214827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:16.214875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602417095741325:11816], now have 1 active actors on pipe
2025-10-10T14:38:16.215122Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:16.215127Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 4 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602417095741325:11816]
2025-10-10T14:38:16.215138Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:16.215148Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:16.215221Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2606 reason: error at write: Disconnected sessionId: src_id|d91a815-ae9f4326-a8de9b74-ab26078c_0
2025-10-10T14:38:16.215442Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2606 sessionId: src_id|d91a815-ae9f4326-a8de9b74-ab26078c_0 is DEAD
2025-10-10T14:38:16.215659Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d91a815-ae9f4326-a8de9b74-ab26078c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:16.215679Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d91a815-ae9f4326-a8de9b74-ab26078c_0] Write session will restart in 0.007685s
2025-10-10T14:38:16.215130Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:16.215736Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d91a815-ae9f4326-a8de9b74-ab26078c_0] Write session: Do CDS request
2025-10-10T14:38:16.215750Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d91a815-ae9f4326-a8de9b74-ab26078c_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:16.225050Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d91a815-ae9f4326-a8de9b74-ab26078c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:16.225044Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:16.225072Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2607
2025-10-10T14:38:16.225322Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2607 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:16.225383Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2607 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:16.225389Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2607 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:16.225394Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:16.225957Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2607 sessionId:  describe result for acl check
2025-10-10T14:38:16.226002Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:16.226004Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:16.226007Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:16.226014Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602417095741431:11844] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:16.226638Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602417095741431:11844] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:16.229383Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602417095741431:11844] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:16.230883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:16.232801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:16.233020Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:16.233001Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602417095741431:11844] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:16.233033Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:16.233017Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602417095741431:11844] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:16.233046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:16.233021Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602417095741431:11844] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:16.233030Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2607 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:16.233106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:16.233159Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602416313505734:11847]
2025-10-10T14:38:16.233801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:16.234133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:16.234193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:16.234555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:16.234621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:16.234627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:16.234628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:16.234629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:16.234631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:16.234632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:16.234633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:16.234634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:16.234635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:16.234637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:16.234638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:16.234639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:16.234641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:16.234647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:16.234660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:16.234665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:16.234669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:16.234673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:16.234677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:16.234682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:16.234686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:16.234690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:16.234695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:16.234699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:16.234703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:16.234707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:16.234715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:16.234725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:16.234732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:16.234738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:16.234743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:16.234749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:16.234753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:16.234759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:16.234763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:16.234768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:16.234773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:16.234779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:16.234784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:16.234792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:16.234798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:16.234805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:16.234809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:16.234814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:16.234824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:16.234829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:16.234834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:16.234840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:16.234844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:16.234854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:16.234859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:16.234864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:16.234905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:16.240014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:16.240346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:16.240361Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:16.240364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:16.240369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:16.240375Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2606 [2:7559602416313505734:11847]
2025-10-10T14:38:16.240391Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:16.240411Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:16.240420Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:16.240423Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:16.240426Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:16.240447Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:16.240459Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:16.240466Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:16.240535Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:16.240548Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:16.240550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:16.240553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:16.240640Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:16.240651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:16.240663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:16.240674Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:16.240696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:16.240725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602417095741541:11844], now have 1 active actors on pipe
2025-10-10T14:38:16.240733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602417095741326:2438], now have 1 active actors on pipe
2025-10-10T14:38:16.240742Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602416313505729:11847]
2025-10-10T14:38:16.240749Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602416313505729:11847]
2025-10-10T14:38:16.240752Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602416313505729:11847]
2025-10-10T14:38:16.240766Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:16.240785Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:16.240785Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:16.240788Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:16.240791Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:16.240807Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:16.240810Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:16.240827Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2606
2025-10-10T14:38:16.240840Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2606
2025-10-10T14:38:16.240849Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602416313505729:11847]
2025-10-10T14:38:16.240859Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:16.240869Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:16.240898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:16.240904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:16.240946Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6b7add9b-e9e81add-bee7927d-a776ebb7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:16.240962Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:16.240966Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:16.240969Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:16.240981Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:16.240992Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:16.241007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:16.241154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:16.241163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:16.241180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:16.241284Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2607 partition: 0 MaxSeqNo: 40 sessionId: src_id|6b7add9b-e9e81add-bee7927d-a776ebb7_0
2025-10-10T14:38:16.241729Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d91a815-ae9f4326-a8de9b74-ab26078c_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|6b7add9b-e9e81add-bee7927d-a776ebb7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:16.244924Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6b7add9b-e9e81add-bee7927d-a776ebb7_0] Write session: try to update token
2025-10-10T14:38:16.244943Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6b7add9b-e9e81add-bee7927d-a776ebb7_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:16.259577Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2607 sessionId: src_id|6b7add9b-e9e81add-bee7927d-a776ebb7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:16.262400Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:16.261239Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:16.261263Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:16.261266Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:16.261268Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:16.261280Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602416313505729:11847]
2025-10-10T14:38:16.261285Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602416313505729:11847]
2025-10-10T14:38:16.261289Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602416313505729:11847]
2025-10-10T14:38:16.261351Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:16.261359Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:16.261362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:16.261363Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:16.261370Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:16.261373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:16.261523Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:16.315109Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602417095741553:11816]
2025-10-10T14:38:16.315408Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 pipe creation result: OK TabletId: 72075186224037892 Generation: 2606, pipe: [1:7559602417095741553:11816]
2025-10-10T14:38:16.377421Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:16.378060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:16.378076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:16.378125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602417095741553:11816], now have 1 active actors on pipe
2025-10-10T14:38:16.378353Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:16.378426Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:16.378431Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 5 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602417095741553:11816]
2025-10-10T14:38:16.378442Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:16.378454Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:16.378525Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2607 reason: error at write: Disconnected sessionId: src_id|6b7add9b-e9e81add-bee7927d-a776ebb7_0
2025-10-10T14:38:16.378718Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2607 sessionId: src_id|6b7add9b-e9e81add-bee7927d-a776ebb7_0 is DEAD
2025-10-10T14:38:16.378900Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b7add9b-e9e81add-bee7927d-a776ebb7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:16.378912Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b7add9b-e9e81add-bee7927d-a776ebb7_0] Write session will restart in 0.008160s
2025-10-10T14:38:16.378948Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b7add9b-e9e81add-bee7927d-a776ebb7_0] Write session: Do CDS request
2025-10-10T14:38:16.378954Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b7add9b-e9e81add-bee7927d-a776ebb7_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:16.387915Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6b7add9b-e9e81add-bee7927d-a776ebb7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:16.388024Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:16.388042Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2608
2025-10-10T14:38:16.388202Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2608 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:16.388250Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2608 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:16.388262Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2608 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:16.388266Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:16.388745Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2608 sessionId:  describe result for acl check
2025-10-10T14:38:16.388783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:16.388785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:16.388789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:16.388795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602417095741627:11850] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:16.389430Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602417095741627:11850] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:16.392797Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602417095741627:11850] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:16.395295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:16.397753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:16.398040Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:16.398053Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:16.398066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:16.398141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:16.398184Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602416313505943:11850]
2025-10-10T14:38:16.398863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:16.399204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:16.399252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:16.399598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:16.399671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:16.399676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:16.399677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:16.399678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:16.399680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:16.399681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:16.399683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:16.399685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:16.399686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:16.399688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:16.399689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:16.399691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:16.399692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:16.399699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:16.399713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:16.399717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:16.399721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:16.399726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:16.399730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:16.399735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:16.399739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:16.399743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:16.399748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:16.399752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:16.399757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:16.399761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:16.399770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:16.399785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:16.399795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:16.399807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:16.399815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:16.399821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:16.399826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:16.399832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:16.399838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:16.399843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:16.399853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:16.399860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:16.399869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:16.399876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:16.399884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:16.399891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:16.399900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:16.399907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:16.399916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:16.399922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:16.399930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:16.399939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:16.399944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:16.399954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:16.399960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:16.399969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:16.400013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:16.401784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602417095741627:11850] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:16.401805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602417095741627:11850] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:16.401809Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602417095741627:11850] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:16.401819Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2608 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:16.402645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:16.402975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:16.402987Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:16.402990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:16.403007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:16.403017Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2607 [2:7559602416313505943:11850]
2025-10-10T14:38:16.403034Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:16.403057Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:16.403075Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:16.403082Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:16.403085Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:16.403102Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:16.403117Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:16.403125Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:16.403194Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:16.403201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:16.403204Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:16.403207Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:16.403276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:16.403283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:16.403294Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:16.403309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:16.403332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:16.403358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602417095741557:2438], now have 1 active actors on pipe
2025-10-10T14:38:16.403367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602417095741775:11850], now have 1 active actors on pipe
2025-10-10T14:38:16.403375Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602416313505938:11850]
2025-10-10T14:38:16.403377Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602416313505938:11850]
2025-10-10T14:38:16.403379Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602416313505938:11850]
2025-10-10T14:38:16.403393Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:16.403408Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:16.403424Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:16.403427Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:16.403432Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:16.403432Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:16.403435Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:16.403389Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2607
2025-10-10T14:38:16.403418Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2607
2025-10-10T14:38:16.403478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:16.403487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:16.403503Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602416313505938:11850]
2025-10-10T14:38:16.403515Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:16.403527Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:16.403552Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6c2ce857-5658c33b-364c57c0-e89a3fd4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:16.403564Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:16.403568Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:16.403576Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:16.403587Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:16.403603Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:16.403630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:16.403780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:16.403791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:16.403808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:16.403874Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2608 partition: 0 MaxSeqNo: 40 sessionId: src_id|6c2ce857-5658c33b-364c57c0-e89a3fd4_0
2025-10-10T14:38:16.404298Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b7add9b-e9e81add-bee7927d-a776ebb7_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|6c2ce857-5658c33b-364c57c0-e89a3fd4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:16.407168Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6c2ce857-5658c33b-364c57c0-e89a3fd4_0] Write session: try to update token
2025-10-10T14:38:16.407190Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6c2ce857-5658c33b-364c57c0-e89a3fd4_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:16.423888Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:16.423907Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:16.423910Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:16.423912Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:16.423922Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602416313505938:11850]
2025-10-10T14:38:16.423928Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602416313505938:11850]
2025-10-10T14:38:16.423933Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602416313505938:11850]
2025-10-10T14:38:16.423986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:16.423991Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:16.423993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:16.423996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:16.423999Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:16.424003Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:16.424145Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:16.424453Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2608 sessionId: src_id|6c2ce857-5658c33b-364c57c0-e89a3fd4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:16.427430Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:16.478462Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602417095741795:11816]
2025-10-10T14:38:16.478948Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 pipe creation result: OK TabletId: 72075186224037892 Generation: 2607, pipe: [1:7559602417095741795:11816]
2025-10-10T14:38:16.541826Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:16.542528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:16.542546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:16.542594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602417095741795:11816], now have 1 active actors on pipe
2025-10-10T14:38:16.542898Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:16.542906Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 6 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602417095741795:11816]
2025-10-10T14:38:16.542933Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:16.542935Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:16.543016Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2608 reason: error at write: Disconnected sessionId: src_id|6c2ce857-5658c33b-364c57c0-e89a3fd4_0
2025-10-10T14:38:16.543209Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2608 sessionId: src_id|6c2ce857-5658c33b-364c57c0-e89a3fd4_0 is DEAD
2025-10-10T14:38:16.543336Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c2ce857-5658c33b-364c57c0-e89a3fd4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:16.543347Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c2ce857-5658c33b-364c57c0-e89a3fd4_0] Write session will restart in 0.007672s
2025-10-10T14:38:16.543390Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c2ce857-5658c33b-364c57c0-e89a3fd4_0] Write session: Do CDS request
2025-10-10T14:38:16.543398Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c2ce857-5658c33b-364c57c0-e89a3fd4_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:16.543872Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:16.551901Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6c2ce857-5658c33b-364c57c0-e89a3fd4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:16.552039Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:16.552054Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2609
2025-10-10T14:38:16.552198Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2609 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:16.552231Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2609 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:16.552237Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2609 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:16.552241Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:16.552923Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2609 sessionId:  describe result for acl check
2025-10-10T14:38:16.552962Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:16.552965Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:16.552966Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:16.552974Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602417095741866:11855] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:16.553610Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602417095741866:11855] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:16.556314Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602417095741866:11855] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:16.559313Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602417095741866:11855] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:16.559332Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602417095741866:11855] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:16.559337Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602417095741866:11855] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:16.559349Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2609 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:16.559321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:16.561627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:16.561898Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:16.561912Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:16.561926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:16.561995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:16.562044Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602416313506141:11852]
2025-10-10T14:38:16.562670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:16.562998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:16.563044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:16.563379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:16.563445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:16.563453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:16.563455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:16.563456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:16.563457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:16.563458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:16.563459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:16.563460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:16.563461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:16.563462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:16.563464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:16.563465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:16.563466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:16.563473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:16.563486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:16.563489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:16.563493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:16.563497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:16.563500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:16.563504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:16.563508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:16.563511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:16.563515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:16.563518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:16.563521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:16.563525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:16.563534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:16.563545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:16.563551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:16.563554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:16.563557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:16.563561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:16.563564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:16.563568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:16.563572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:16.563575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:16.563578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:16.563581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:16.563584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:16.563587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:16.563590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:16.563593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:16.563597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:16.563600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:16.563603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:16.563606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:16.563609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:16.563612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:16.563615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:16.563620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:16.563624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:16.563629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:16.563670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:16.566167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:16.566584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:16.566596Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:16.566597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:16.566601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:16.566606Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2608 [2:7559602416313506141:11852]
2025-10-10T14:38:16.566617Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:16.566631Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:16.566633Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:16.566635Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:16.566637Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:16.566650Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:16.566656Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:16.566663Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:16.566718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:16.566724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:16.566726Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:16.566728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:16.566789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:16.566797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:16.566804Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:16.566811Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:16.566821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:16.566839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602417095742010:11855], now have 1 active actors on pipe
2025-10-10T14:38:16.566843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602417095741796:2438], now have 1 active actors on pipe
2025-10-10T14:38:16.566850Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602416313506135:11852]
2025-10-10T14:38:16.566854Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602416313506135:11852]
2025-10-10T14:38:16.566855Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602416313506135:11852]
2025-10-10T14:38:16.566869Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:16.566882Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:16.566883Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:16.566887Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:16.566889Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:16.566899Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:16.566902Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:16.566927Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602416313506135:11852]
2025-10-10T14:38:16.566936Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:16.566947Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:16.566918Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2608
2025-10-10T14:38:16.566973Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2608
2025-10-10T14:38:16.566963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:16.566973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:16.567281Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7b49b873-f9c3b39d-d86fc3f8-9b016ea3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:16.567297Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:16.567302Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:16.567305Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:16.567316Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:16.567329Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:16.567359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:16.567540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:16.567552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:16.567570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:16.567667Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2609 partition: 0 MaxSeqNo: 40 sessionId: src_id|7b49b873-f9c3b39d-d86fc3f8-9b016ea3_0
2025-10-10T14:38:16.568051Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c2ce857-5658c33b-364c57c0-e89a3fd4_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|7b49b873-f9c3b39d-d86fc3f8-9b016ea3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:16.570914Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7b49b873-f9c3b39d-d86fc3f8-9b016ea3_0] Write session: try to update token
2025-10-10T14:38:16.570931Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7b49b873-f9c3b39d-d86fc3f8-9b016ea3_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:16.586620Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:16.586647Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:16.586651Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:16.586653Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:16.586665Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602416313506135:11852]
2025-10-10T14:38:16.586670Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602416313506135:11852]
2025-10-10T14:38:16.586674Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602416313506135:11852]
2025-10-10T14:38:16.586725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:16.586733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:16.586736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:16.586737Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:16.586744Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:16.586750Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:16.586879Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:16.588227Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2609 sessionId: src_id|7b49b873-f9c3b39d-d86fc3f8-9b016ea3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:16.590971Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:16.643288Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602417095742024:11816]
2025-10-10T14:38:16.643608Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 pipe creation result: OK TabletId: 72075186224037892 Generation: 2608, pipe: [1:7559602417095742024:11816]
2025-10-10T14:38:16.706349Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:16.706655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:16.706672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:16.706720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602417095742024:11816], now have 1 active actors on pipe
2025-10-10T14:38:16.706965Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:16.706966Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:16.707009Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 7 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602417095742024:11816]
2025-10-10T14:38:16.707023Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:16.707026Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:16.707118Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2609 reason: error at write: Disconnected sessionId: src_id|7b49b873-f9c3b39d-d86fc3f8-9b016ea3_0
2025-10-10T14:38:16.707347Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2609 sessionId: src_id|7b49b873-f9c3b39d-d86fc3f8-9b016ea3_0 is DEAD
2025-10-10T14:38:16.707514Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b49b873-f9c3b39d-d86fc3f8-9b016ea3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:16.707525Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b49b873-f9c3b39d-d86fc3f8-9b016ea3_0] Write session will restart in 0.005166s
2025-10-10T14:38:16.707563Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b49b873-f9c3b39d-d86fc3f8-9b016ea3_0] Write session: Do CDS request
2025-10-10T14:38:16.707572Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b49b873-f9c3b39d-d86fc3f8-9b016ea3_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:16.713912Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7b49b873-f9c3b39d-d86fc3f8-9b016ea3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:16.714012Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:16.714040Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2610
2025-10-10T14:38:16.714176Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2610 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:16.714213Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2610 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:16.714224Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2610 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:16.714228Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:16.714725Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2610 sessionId:  describe result for acl check
2025-10-10T14:38:16.714765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:16.714773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:16.714774Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:16.714781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602417095742041:11859] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:16.715395Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602417095742041:11859] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:16.717960Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602417095742041:11859] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:16.721453Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602417095742041:11859] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:16.721468Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602417095742041:11859] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:16.721472Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602417095742041:11859] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:16.721482Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2610 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:16.724204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:16.726391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:16.726636Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:16.726648Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:16.726662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:16.726728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:16.726780Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602416313506339:11854]
2025-10-10T14:38:16.727483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:16.727849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:16.727928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:16.728383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:16.728483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:16.728494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:16.728496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:16.728497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:16.728498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:16.728499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:16.728501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:16.728503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:16.728504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:16.728505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:16.728507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:16.728508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:16.728509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:16.728516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:16.728530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:16.728534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:16.728537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:16.728542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:16.728546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:16.728550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:16.728554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:16.728559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:16.728563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:16.728568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:16.728572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:16.728576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:16.728588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:16.728597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:16.728604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:16.728610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:16.728615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:16.728627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:16.728632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:16.728643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:16.728648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:16.728658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:16.728663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:16.728669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:16.728673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:16.728679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:16.728683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:16.728691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:16.728696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:16.728706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:16.728710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:16.728716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:16.728726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:16.728731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:16.728736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:16.728743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:16.728748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:16.728753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:16.728793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:16.731495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:16.731859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:16.731874Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:16.731877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:16.731881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:16.731888Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2609 [2:7559602416313506339:11854]
2025-10-10T14:38:16.731911Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:16.731929Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:16.731937Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:16.731940Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:16.731944Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:16.731961Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:16.731970Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:16.731980Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:16.732061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:16.732070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:16.732072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:16.732075Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:16.732420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:16.732428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:16.732441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:16.732452Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:16.732471Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:16.732499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602417095742239:11859], now have 1 active actors on pipe
2025-10-10T14:38:16.732507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602417095742025:2438], now have 1 active actors on pipe
2025-10-10T14:38:16.732516Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602416313506334:11854]
2025-10-10T14:38:16.732522Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602416313506334:11854]
2025-10-10T14:38:16.732524Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602416313506334:11854]
2025-10-10T14:38:16.732540Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:16.732559Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:16.732561Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:16.732564Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:16.732567Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:16.732581Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:16.732584Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:16.732573Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2609
2025-10-10T14:38:16.732616Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2609
2025-10-10T14:38:16.732613Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602416313506334:11854]
2025-10-10T14:38:16.732627Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:16.732637Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:16.732644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:16.732649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:16.732695Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ec3ed0b1-1a075234-32e50765-d93b5e9a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:16.732713Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:16.732717Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:16.732720Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:16.732732Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:16.732743Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:16.732765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:16.732919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:16.732949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:16.732974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:16.733067Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2610 partition: 0 MaxSeqNo: 40 sessionId: src_id|ec3ed0b1-1a075234-32e50765-d93b5e9a_0
2025-10-10T14:38:16.733568Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b49b873-f9c3b39d-d86fc3f8-9b016ea3_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|ec3ed0b1-1a075234-32e50765-d93b5e9a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:16.736674Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ec3ed0b1-1a075234-32e50765-d93b5e9a_0] Write session: try to update token
2025-10-10T14:38:16.736695Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ec3ed0b1-1a075234-32e50765-d93b5e9a_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:16.754399Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2610 sessionId: src_id|ec3ed0b1-1a075234-32e50765-d93b5e9a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:16.756776Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:16.756798Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:16.756802Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:16.756804Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:16.756815Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602416313506334:11854]
2025-10-10T14:38:16.756819Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602416313506334:11854]
2025-10-10T14:38:16.756822Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602416313506334:11854]
2025-10-10T14:38:16.756866Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:16.756874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:16.756877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:16.756876Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:16.756883Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:16.756897Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:16.757016Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:16.757561Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:16.807072Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602417095742283:11816]
2025-10-10T14:38:16.807388Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 pipe creation result: OK TabletId: 72075186224037892 Generation: 2609, pipe: [1:7559602417095742283:11816]
2025-10-10T14:38:16.872843Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:16.873469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:16.873489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:16.873540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602417095742283:11816], now have 1 active actors on pipe
2025-10-10T14:38:16.873787Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 8 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602417095742283:11816]
2025-10-10T14:38:16.873795Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:16.873799Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:16.873819Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:16.873878Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2610 reason: error at write: Disconnected sessionId: src_id|ec3ed0b1-1a075234-32e50765-d93b5e9a_0
2025-10-10T14:38:16.874077Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2610 sessionId: src_id|ec3ed0b1-1a075234-32e50765-d93b5e9a_0 is DEAD
2025-10-10T14:38:16.873777Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:16.874234Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec3ed0b1-1a075234-32e50765-d93b5e9a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:16.874258Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec3ed0b1-1a075234-32e50765-d93b5e9a_0] Write session will restart in 0.006965s
2025-10-10T14:38:16.874285Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec3ed0b1-1a075234-32e50765-d93b5e9a_0] Write session: Do CDS request
2025-10-10T14:38:16.874291Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec3ed0b1-1a075234-32e50765-d93b5e9a_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:16.882917Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ec3ed0b1-1a075234-32e50765-d93b5e9a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:16.883043Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:16.883061Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2611
2025-10-10T14:38:16.883198Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2611 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:16.883244Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2611 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:16.883257Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2611 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:16.883260Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:16.883733Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2611 sessionId:  describe result for acl check
2025-10-10T14:38:16.883779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:16.883786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:16.883788Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:16.883795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602417095742368:11873] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:16.884445Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602417095742368:11873] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:16.887120Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602417095742368:11873] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:16.889444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:16.889699Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602417095742368:11873] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:16.889712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602417095742368:11873] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:16.889716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602417095742368:11873] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:16.889724Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2611 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:16.891236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:16.891461Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:16.891472Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:16.891485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:16.891539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:16.891605Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602416313506577:11869]
2025-10-10T14:38:16.892221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:16.892531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:16.892575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:16.892910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:16.892969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:16.892973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:16.892974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:16.892975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:16.892976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:16.892978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:16.892979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:16.892980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:16.892981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:16.892983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:16.892984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:16.892985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:16.892998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:16.893004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:16.893018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:16.893022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:16.893026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:16.893030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:16.893035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:16.893039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:16.893043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:16.893047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:16.893051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:16.893055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:16.893061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:16.893065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:16.893073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:16.893086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:16.893098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:16.893104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:16.893113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:16.893119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:16.893124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:16.893130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:16.893135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:16.893140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:16.893144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:16.893149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:16.893154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:16.893164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:16.893169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:16.893174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:16.893179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:16.893184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:16.893193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:16.893198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:16.893203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:16.893208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:16.893215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:16.893220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:16.893225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:16.893230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:16.893269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:16.895638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:16.896055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:16.896068Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:16.896071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:16.896075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:16.896081Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2610 [2:7559602416313506577:11869]
2025-10-10T14:38:16.896093Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:16.896116Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:16.896123Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:16.896127Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:16.896129Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:16.896147Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:16.896159Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:16.896169Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:16.896239Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:16.896246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:16.896248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:16.896250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:16.896317Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:16.896325Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:16.896336Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:16.896352Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:16.896373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:16.896398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602417095742287:2438], now have 1 active actors on pipe
2025-10-10T14:38:16.896406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602417095742506:11873], now have 1 active actors on pipe
2025-10-10T14:38:16.896413Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602416313506571:11869]
2025-10-10T14:38:16.896419Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602416313506571:11869]
2025-10-10T14:38:16.896421Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602416313506571:11869]
2025-10-10T14:38:16.896435Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:16.896451Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:16.896453Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:16.896461Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:16.896463Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:16.896469Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:16.896473Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:16.896447Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2610
2025-10-10T14:38:16.896448Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2610
2025-10-10T14:38:16.896498Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602416313506571:11869]
2025-10-10T14:38:16.896511Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:16.896516Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:16.896535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:16.896541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:16.896836Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|72403ed0-a7a9f73c-c4b86bd7-69e8612a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:16.896851Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:16.896854Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:16.896857Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:16.896867Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:16.896879Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:16.896908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:16.897056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:16.897065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:16.897081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:16.897176Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2611 partition: 0 MaxSeqNo: 40 sessionId: src_id|72403ed0-a7a9f73c-c4b86bd7-69e8612a_0
2025-10-10T14:38:16.897569Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec3ed0b1-1a075234-32e50765-d93b5e9a_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|72403ed0-a7a9f73c-c4b86bd7-69e8612a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:16.900502Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|72403ed0-a7a9f73c-c4b86bd7-69e8612a_0] Write session: try to update token
2025-10-10T14:38:16.900520Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|72403ed0-a7a9f73c-c4b86bd7-69e8612a_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:16.915857Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2611 sessionId: src_id|72403ed0-a7a9f73c-c4b86bd7-69e8612a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:16.917774Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:16.917793Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:16.917796Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:16.917798Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:16.917809Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602416313506571:11869]
2025-10-10T14:38:16.917813Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602416313506571:11869]
2025-10-10T14:38:16.917817Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602416313506571:11869]
2025-10-10T14:38:16.917868Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:16.917883Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:16.917886Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:16.917888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:16.917893Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:16.917898Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:16.918038Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:16.918357Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:16.974054Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602417095742518:11816]
2025-10-10T14:38:16.974402Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 pipe creation result: OK TabletId: 72075186224037892 Generation: 2610, pipe: [1:7559602417095742518:11816]
2025-10-10T14:38:17.036138Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:17.036597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:17.036612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:17.036660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602417095742518:11816], now have 1 active actors on pipe
2025-10-10T14:38:17.036913Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:17.036909Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:17.036940Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:17.036945Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:17.036976Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 9 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602417095742518:11816]
2025-10-10T14:38:17.037023Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2611 reason: error at write: Disconnected sessionId: src_id|72403ed0-a7a9f73c-c4b86bd7-69e8612a_0
2025-10-10T14:38:17.037237Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2611 sessionId: src_id|72403ed0-a7a9f73c-c4b86bd7-69e8612a_0 is DEAD
2025-10-10T14:38:17.037419Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72403ed0-a7a9f73c-c4b86bd7-69e8612a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:17.037432Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72403ed0-a7a9f73c-c4b86bd7-69e8612a_0] Write session will restart in 0.005708s
2025-10-10T14:38:17.037456Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72403ed0-a7a9f73c-c4b86bd7-69e8612a_0] Write session: Do CDS request
2025-10-10T14:38:17.037466Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72403ed0-a7a9f73c-c4b86bd7-69e8612a_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:17.044929Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|72403ed0-a7a9f73c-c4b86bd7-69e8612a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:17.045018Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:17.045036Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2612
2025-10-10T14:38:17.045159Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2612 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:17.045206Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2612 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:17.045217Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2612 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:17.045221Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:17.045668Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2612 sessionId:  describe result for acl check
2025-10-10T14:38:17.045711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:17.045721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:17.045726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:17.045732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602421390709848:11877] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:17.046325Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602421390709848:11877] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:17.048791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602421390709848:11877] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:17.052564Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602421390709848:11877] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:17.052582Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602421390709848:11877] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:17.052586Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602421390709848:11877] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:17.052596Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2612 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:17.054872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:17.057130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:17.057365Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:17.057372Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:17.057386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:17.057466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:17.057518Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602420608474074:11871]
2025-10-10T14:38:17.058135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:17.058496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:17.058549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:17.058878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:17.058961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:17.058969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:17.058970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:17.058971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:17.058972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:17.058974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:17.058975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:17.058976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:17.058977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:17.058979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:17.058980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:17.058981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:17.058982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:17.058989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:17.059004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:17.059007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:17.059011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:17.059015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:17.059019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:17.059023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:17.059026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:17.059030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:17.059035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:17.059038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:17.059042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:17.059047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:17.059055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:17.059065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:17.059072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:17.059078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:17.059083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:17.059089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:17.059094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:17.059107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:17.059112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:17.059122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:17.059126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:17.059132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:17.059141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:17.059146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:17.059150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:17.059161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:17.059166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:17.059176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:17.059180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:17.059186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:17.059195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:17.059200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:17.059209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:17.059215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:17.059219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:17.059225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:17.059267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:17.061962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:17.062616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:17.062632Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:17.062635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:17.062639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:17.062647Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2611 [2:7559602420608474074:11871]
2025-10-10T14:38:17.062663Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:17.062684Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:17.062688Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:17.062692Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:17.062694Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:17.062712Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:17.062721Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:17.062730Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:17.062803Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:17.062805Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:17.062807Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:17.062810Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:17.062892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:17.062895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:17.062908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:17.062919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:17.062935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:17.062960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602421390709815:2438], now have 1 active actors on pipe
2025-10-10T14:38:17.062964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602421390710028:11877], now have 1 active actors on pipe
2025-10-10T14:38:17.062973Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602420608474069:11871]
2025-10-10T14:38:17.062975Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602420608474069:11871]
2025-10-10T14:38:17.062977Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602420608474069:11871]
2025-10-10T14:38:17.062992Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:17.063010Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:17.063026Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:17.063027Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:17.063029Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:17.063032Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:17.063035Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:17.063064Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602420608474069:11871]
2025-10-10T14:38:17.063072Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:17.063077Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:17.063187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:17.063198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:17.063236Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|78981115-83c519c1-1108cb41-f3e9b8ad_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:17.063246Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:17.063251Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:17.063254Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:17.063267Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:17.063290Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:17.063307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:17.063078Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2611
2025-10-10T14:38:17.063086Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2611
2025-10-10T14:38:17.063812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:17.063828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:17.063863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:17.064089Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2612 partition: 0 MaxSeqNo: 40 sessionId: src_id|78981115-83c519c1-1108cb41-f3e9b8ad_0
2025-10-10T14:38:17.064543Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72403ed0-a7a9f73c-c4b86bd7-69e8612a_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|78981115-83c519c1-1108cb41-f3e9b8ad_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:17.067429Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|78981115-83c519c1-1108cb41-f3e9b8ad_0] Write session: try to update token
2025-10-10T14:38:17.067453Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|78981115-83c519c1-1108cb41-f3e9b8ad_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:17.083576Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:17.083600Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:17.083603Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:17.083606Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:17.083616Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602420608474069:11871]
2025-10-10T14:38:17.083621Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602420608474069:11871]
2025-10-10T14:38:17.083626Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602420608474069:11871]
2025-10-10T14:38:17.083678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:17.083682Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:17.083689Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:17.083692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:17.083692Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:17.083695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:17.083849Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:17.084527Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2612 sessionId: src_id|78981115-83c519c1-1108cb41-f3e9b8ad_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:17.087327Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:17.137305Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602421390710046:11816]
2025-10-10T14:38:17.137677Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 pipe creation result: OK TabletId: 72075186224037892 Generation: 2611, pipe: [1:7559602421390710046:11816]
2025-10-10T14:38:17.205295Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:17.205638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:17.205657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:17.205707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602421390710046:11816], now have 1 active actors on pipe
2025-10-10T14:38:17.206032Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:17.206171Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:17.206231Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:17.206234Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:17.206324Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2612 reason: error at write: Disconnected sessionId: src_id|78981115-83c519c1-1108cb41-f3e9b8ad_0
2025-10-10T14:38:17.206532Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2612 sessionId: src_id|78981115-83c519c1-1108cb41-f3e9b8ad_0 is DEAD
2025-10-10T14:38:17.206746Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 10 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602421390710046:11816]
2025-10-10T14:38:17.207024Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78981115-83c519c1-1108cb41-f3e9b8ad_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:17.207035Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78981115-83c519c1-1108cb41-f3e9b8ad_0] Write session will restart in 0.006949s
2025-10-10T14:38:17.207061Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78981115-83c519c1-1108cb41-f3e9b8ad_0] Write session: Do CDS request
2025-10-10T14:38:17.207067Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78981115-83c519c1-1108cb41-f3e9b8ad_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:17.217453Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|78981115-83c519c1-1108cb41-f3e9b8ad_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:17.217571Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:17.217589Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2613
2025-10-10T14:38:17.217759Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2613 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:17.217809Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2613 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:17.217832Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2613 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:17.217838Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:17.218638Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2613 sessionId:  describe result for acl check
2025-10-10T14:38:17.218679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:17.218689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:17.218691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:17.218698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602421390710115:11881] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:17.219298Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602421390710115:11881] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:17.223674Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602421390710115:11881] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:17.227340Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602421390710115:11881] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:17.227358Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602421390710115:11881] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:17.227361Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602421390710115:11881] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:17.227374Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2613 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:17.227631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:17.230022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:17.230302Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:17.230309Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:17.230324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:17.230385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:17.230426Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602420608474278:11874]
2025-10-10T14:38:17.231098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:17.231492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:17.231550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:17.231910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:17.231973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:17.231979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:17.231981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:17.231982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:17.231983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:17.231985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:17.231986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:17.231987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:17.231989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:17.231990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:17.231991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:17.231993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:17.231994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:17.232000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:17.232014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:17.232018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:17.232022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:17.232026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:17.232031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:17.232035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:17.232039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:17.232043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:17.232048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:17.232052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:17.232056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:17.232059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:17.232068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:17.232077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:17.232084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:17.232089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:17.232094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:17.232099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:17.232104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:17.232109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:17.232114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:17.232118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:17.232123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:17.232128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:17.232133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:17.232138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:17.232143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:17.232148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:17.232153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:17.232158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:17.232164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:17.232169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:17.232173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:17.232188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:17.232192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:17.232197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:17.232201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:17.232207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:17.232246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:17.235042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:17.235419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:17.235437Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:17.235440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:17.235444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:17.235450Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2612 [2:7559602420608474278:11874]
2025-10-10T14:38:17.235464Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:17.235483Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:17.235487Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:17.235491Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:17.235493Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:17.235511Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:17.235520Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:17.235528Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:17.235590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:17.235602Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:17.235604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:17.235607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:17.235678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:17.235688Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:17.235702Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:17.235716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:17.235735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:17.235758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602421390710266:11881], now have 1 active actors on pipe
2025-10-10T14:38:17.235768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602421390710047:2438], now have 1 active actors on pipe
2025-10-10T14:38:17.235777Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602420608474272:11874]
2025-10-10T14:38:17.235784Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602420608474272:11874]
2025-10-10T14:38:17.235787Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602420608474272:11874]
2025-10-10T14:38:17.235803Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:17.235824Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:17.235837Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:17.235847Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:17.235849Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:17.235851Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:17.235852Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:17.235835Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2612
2025-10-10T14:38:17.235881Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602420608474272:11874]
2025-10-10T14:38:17.235835Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2612
2025-10-10T14:38:17.235891Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:17.235892Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:17.235921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:17.235933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:17.235974Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|42f34d33-796a5033-a697a3db-56104565_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:17.235987Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:17.235992Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:17.235995Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:17.236006Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:17.236023Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:17.236051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:17.236248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:17.236262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:17.236285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:17.236421Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2613 partition: 0 MaxSeqNo: 40 sessionId: src_id|42f34d33-796a5033-a697a3db-56104565_0
2025-10-10T14:38:17.236851Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78981115-83c519c1-1108cb41-f3e9b8ad_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|42f34d33-796a5033-a697a3db-56104565_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:17.239526Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|42f34d33-796a5033-a697a3db-56104565_0] Write session: try to update token
2025-10-10T14:38:17.239545Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|42f34d33-796a5033-a697a3db-56104565_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:17.254530Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2613 sessionId: src_id|42f34d33-796a5033-a697a3db-56104565_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:17.257244Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:17.258422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:17.258449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:17.258474Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:17.258477Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:17.258481Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:17.258483Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:17.258492Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602420608474272:11874]
2025-10-10T14:38:17.258499Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602420608474272:11874]
2025-10-10T14:38:17.258502Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602420608474272:11874]
2025-10-10T14:38:17.258546Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:17.258556Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:17.258560Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:17.258567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:17.258574Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:17.258582Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:17.258723Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:17.306838Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602421390710280:11816]
2025-10-10T14:38:17.307150Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 pipe creation result: OK TabletId: 72075186224037892 Generation: 2612, pipe: [1:7559602421390710280:11816]
2025-10-10T14:38:17.376760Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:17.377228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:38:17.377299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602421390710280:11816], now have 1 active actors on pipe
2025-10-10T14:38:17.377422Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:38:17.377494Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 11 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602421390710280:11816]
2025-10-10T14:38:17.377532Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:17.377535Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:17.377539Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:17.377632Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2613 reason: error at write: Disconnected sessionId: src_id|42f34d33-796a5033-a697a3db-56104565_0
2025-10-10T14:38:17.377944Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|42f34d33-796a5033-a697a3db-56104565_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:17.377973Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|42f34d33-796a5033-a697a3db-56104565_0] Write session will restart in 0.009052s
2025-10-10T14:38:17.378002Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|42f34d33-796a5033-a697a3db-56104565_0] Write session: Do CDS request
2025-10-10T14:38:17.378008Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|42f34d33-796a5033-a697a3db-56104565_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:17.377814Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2613 sessionId: src_id|42f34d33-796a5033-a697a3db-56104565_0 is DEAD
2025-10-10T14:38:17.390566Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|42f34d33-796a5033-a697a3db-56104565_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:17.390593Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:17.390609Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2614
2025-10-10T14:38:17.390783Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2614 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:17.390823Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2614 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:17.390833Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2614 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:17.390837Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:17.391475Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2614 sessionId:  describe result for acl check
2025-10-10T14:38:17.391516Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:17.391518Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:17.391520Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:17.391530Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602421390710392:11885] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:17.392127Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602421390710392:11885] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:17.395168Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602421390710392:11885] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:17.396227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:17.398745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:17.399033Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:17.399050Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:17.399065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:17.399150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:17.399201Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602420608474492:11877]
2025-10-10T14:38:17.399089Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602421390710392:11885] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:17.399106Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602421390710392:11885] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:17.399110Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602421390710392:11885] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:17.399119Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2614 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:17.399852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:17.400224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:17.400299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:17.400687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:17.400761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:17.400780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:17.400781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:17.400782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:17.400784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:17.400785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:17.400786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:17.400788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:17.400790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:17.400791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:17.400793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:17.400794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:17.400796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:17.400803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:17.400817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:17.400821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:17.400825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:17.400828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:17.400832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:17.400835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:17.400839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:17.400843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:17.400847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:17.400851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:17.400856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:17.400860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:17.400868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:17.400877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:17.400884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:17.400890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:17.400894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:17.400900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:17.400905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:17.400910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:17.400916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:17.400921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:17.400926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:17.400931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:17.400936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:17.400942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:17.400955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:17.400961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:17.400966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:17.400972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:17.400976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:17.400981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:17.400987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:17.400992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:17.400997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:17.401002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:17.401008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:17.401013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:17.401056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:17.403800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:17.404244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:17.404260Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:17.404263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:17.404267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:17.404274Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2613 [2:7559602420608474492:11877]
2025-10-10T14:38:17.404291Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:17.404333Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:17.404336Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:17.404340Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:17.404343Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:17.404361Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:17.404375Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:17.404383Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:17.404446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:17.404454Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:17.404456Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:17.404459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:17.404533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:17.404542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:17.404553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:17.404567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:17.404590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:17.404618Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602420608474487:11877]
2025-10-10T14:38:17.404625Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602420608474487:11877]
2025-10-10T14:38:17.404628Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602420608474487:11877]
2025-10-10T14:38:17.404637Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:17.404648Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:17.404653Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:17.404655Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:17.404655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602421390710281:2438], now have 1 active actors on pipe
2025-10-10T14:38:17.404662Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:17.404678Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:17.404688Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:17.404695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602421390710503:11885], now have 1 active actors on pipe
2025-10-10T14:38:17.404726Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602420608474487:11877]
2025-10-10T14:38:17.404738Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:17.404750Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:17.404755Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2613
2025-10-10T14:38:17.404774Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2613
2025-10-10T14:38:17.405027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:17.405038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:17.405072Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ac98d930-b9db626c-12439b64-14e5bc54_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:17.405089Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:17.405098Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:17.405101Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:17.405114Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:17.405130Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:17.405149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:17.405314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:17.405322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:17.405353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:17.405440Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2614 partition: 0 MaxSeqNo: 40 sessionId: src_id|ac98d930-b9db626c-12439b64-14e5bc54_0
2025-10-10T14:38:17.405869Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|42f34d33-796a5033-a697a3db-56104565_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|ac98d930-b9db626c-12439b64-14e5bc54_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:17.408572Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ac98d930-b9db626c-12439b64-14e5bc54_0] Write session: try to update token
2025-10-10T14:38:17.408591Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ac98d930-b9db626c-12439b64-14e5bc54_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:17.423610Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2614 sessionId: src_id|ac98d930-b9db626c-12439b64-14e5bc54_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:17.424910Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:17.424934Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:17.424938Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:17.424940Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:17.424951Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602420608474487:11877]
2025-10-10T14:38:17.424956Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602420608474487:11877]
2025-10-10T14:38:17.424961Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602420608474487:11877]
2025-10-10T14:38:17.425018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:17.425021Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:17.425029Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:17.425032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:17.425033Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:17.425035Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:17.425222Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:17.426677Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:17.477364Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602421390710527:11816]
2025-10-10T14:38:17.477707Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 pipe creation result: OK TabletId: 72075186224037892 Generation: 2613, pipe: [1:7559602421390710527:11816]
2025-10-10T14:38:17.542659Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:17.543074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:17.543088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:17.543134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602421390710527:11816], now have 1 active actors on pipe
2025-10-10T14:38:17.543327Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:17.543362Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:17.543428Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 12 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602421390710527:11816]
2025-10-10T14:38:17.543466Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:38:17.543574Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2614 reason: status is not ok: tablet will be restarted right now sessionId: src_id|ac98d930-b9db626c-12439b64-14e5bc54_0
2025-10-10T14:38:17.543945Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac98d930-b9db626c-12439b64-14e5bc54_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:38:17.543955Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac98d930-b9db626c-12439b64-14e5bc54_0] Write session will restart in 0.007982s
2025-10-10T14:38:17.543982Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac98d930-b9db626c-12439b64-14e5bc54_0] Write session: Do CDS request
2025-10-10T14:38:17.543988Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac98d930-b9db626c-12439b64-14e5bc54_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:17.543787Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2614 sessionId: src_id|ac98d930-b9db626c-12439b64-14e5bc54_0 is DEAD
2025-10-10T14:38:17.554735Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ac98d930-b9db626c-12439b64-14e5bc54_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:17.555157Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:17.555176Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2615
2025-10-10T14:38:17.555419Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2615 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:17.555463Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2615 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:17.555475Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2615 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:17.555480Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:17.555963Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2615 sessionId:  describe result for acl check
2025-10-10T14:38:17.556002Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:17.556004Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:17.556005Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:17.556012Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602421390710595:11890] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:17.556596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602421390710595:11890] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:17.559815Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602421390710595:11890] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:17.566185Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602421390710595:11890] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:17.566206Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602421390710595:11890] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:17.566210Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602421390710595:11890] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:17.566222Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2615 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:17.566167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:17.568446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:17.568927Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:17.568934Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:17.568949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:17.569017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:17.569060Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602420608474697:11879]
2025-10-10T14:38:17.569759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:17.570078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:17.570125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:17.570492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:17.570553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:17.570560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:17.570561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:17.570563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:17.570564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:17.570566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:17.570567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:17.570569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:17.570571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:17.570572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:17.570574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:17.570576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:17.570577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:17.570585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:17.570599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:17.570604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:17.570609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:17.570613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:17.570618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:17.570623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:17.570628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:17.570632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:17.570638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:17.570643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:17.570647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:17.570652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:17.570660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:17.570670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:17.570677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:17.570686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:17.570691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:17.570697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:17.570702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:17.570715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:17.570738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:17.570749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:17.570754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:17.570765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:17.570770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:17.570777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:17.570782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:17.570788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:17.570793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:17.570799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:17.570804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:17.570815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:17.570821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:17.570832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:17.570837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:17.570843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:17.570848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:17.570854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:17.570897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:17.573882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:17.574612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:17.574627Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:17.574629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:17.574633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:17.574640Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2614 [2:7559602420608474697:11879]
2025-10-10T14:38:17.574655Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:17.574674Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:17.574678Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:17.574682Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:17.574685Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:17.574703Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:17.574718Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:17.574726Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:17.574794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:17.574796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:17.574799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:17.574801Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:17.574873Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:17.574882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:17.574896Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:17.574913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:17.574935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:17.574964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602421390710528:2438], now have 1 active actors on pipe
2025-10-10T14:38:17.574971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602421390710748:11890], now have 1 active actors on pipe
2025-10-10T14:38:17.574980Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602420608474691:11879]
2025-10-10T14:38:17.574981Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602420608474691:11879]
2025-10-10T14:38:17.574983Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602420608474691:11879]
2025-10-10T14:38:17.574997Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:17.575012Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:17.575020Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:17.575025Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:17.575027Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:17.575013Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2614
2025-10-10T14:38:17.575034Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2614
2025-10-10T14:38:17.575044Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:17.575052Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:17.575100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:17.575110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:17.575125Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602420608474691:11879]
2025-10-10T14:38:17.575136Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:17.575147Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:17.575173Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cc12b097-f4b6262d-a18a8ef6-e2e8eacb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:17.575186Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:17.575195Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:17.575198Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:17.575210Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:17.575225Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:17.575248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:17.575448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:17.575458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:17.575476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:17.575567Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2615 partition: 0 MaxSeqNo: 40 sessionId: src_id|cc12b097-f4b6262d-a18a8ef6-e2e8eacb_0
2025-10-10T14:38:17.576011Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac98d930-b9db626c-12439b64-14e5bc54_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|cc12b097-f4b6262d-a18a8ef6-e2e8eacb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:17.578851Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cc12b097-f4b6262d-a18a8ef6-e2e8eacb_0] Write session: try to update token
2025-10-10T14:38:17.578871Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cc12b097-f4b6262d-a18a8ef6-e2e8eacb_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:17.595457Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2615 sessionId: src_id|cc12b097-f4b6262d-a18a8ef6-e2e8eacb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:17.598098Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:17.598123Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:17.598127Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:17.598131Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:17.598142Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602420608474691:11879]
2025-10-10T14:38:17.598147Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602420608474691:11879]
2025-10-10T14:38:17.598156Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602420608474691:11879]
2025-10-10T14:38:17.598213Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:17.598224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:17.598225Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:17.598242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:17.598243Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:17.598248Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:17.598700Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:17.598414Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:17.643715Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602421390710762:11816]
2025-10-10T14:38:17.644034Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 pipe creation result: OK TabletId: 72075186224037892 Generation: 2614, pipe: [1:7559602421390710762:11816]
2025-10-10T14:38:17.721409Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:17.721723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:17.721741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:17.721790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602421390710762:11816], now have 1 active actors on pipe
2025-10-10T14:38:17.722047Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:17.722113Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 13 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602421390710762:11816]
2025-10-10T14:38:17.722137Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:17.722160Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:38:17.722251Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2615 reason: status is not ok: tablet will be restarted right now sessionId: src_id|cc12b097-f4b6262d-a18a8ef6-e2e8eacb_0
2025-10-10T14:38:17.722465Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2615 sessionId: src_id|cc12b097-f4b6262d-a18a8ef6-e2e8eacb_0 is DEAD
2025-10-10T14:38:17.722629Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc12b097-f4b6262d-a18a8ef6-e2e8eacb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:38:17.722643Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc12b097-f4b6262d-a18a8ef6-e2e8eacb_0] Write session will restart in 0.007744s
2025-10-10T14:38:17.722685Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc12b097-f4b6262d-a18a8ef6-e2e8eacb_0] Write session: Do CDS request
2025-10-10T14:38:17.722692Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc12b097-f4b6262d-a18a8ef6-e2e8eacb_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:17.731969Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cc12b097-f4b6262d-a18a8ef6-e2e8eacb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:17.732042Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:17.732075Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2616
2025-10-10T14:38:17.732254Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2616 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:17.732302Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2616 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:17.732312Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2616 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:17.732316Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:17.732826Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2616 sessionId:  describe result for acl check
2025-10-10T14:38:17.732863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:17.732870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:17.732872Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:17.732879Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602421390710797:11894] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:17.733474Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602421390710797:11894] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:17.735900Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602421390710797:11894] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:17.739343Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602421390710797:11894] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:17.739361Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602421390710797:11894] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:17.739365Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602421390710797:11894] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:17.739374Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2616 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:17.750390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:17.752683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:17.752944Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:17.752949Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:17.752964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:17.753024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:17.753067Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602420608474902:11881]
2025-10-10T14:38:17.753739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:17.754170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:17.754418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:17.754823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:17.754907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:17.754914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:17.754915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:17.754917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:17.754918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:17.754919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:17.754920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:17.754921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:17.754922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:17.754924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:17.754925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:17.754927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:17.754929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:17.754936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:17.754950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:17.754954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:17.754959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:17.754963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:17.754968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:17.754973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:17.754976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:17.754981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:17.754987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:17.754991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:17.754996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:17.754999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:17.755009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:17.755019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:17.755026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:17.755032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:17.755036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:17.755043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:17.755048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:17.755054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:17.755060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:17.755066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:17.755071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:17.755078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:17.755089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:17.755095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:17.755101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:17.755106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:17.755113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:17.755119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:17.755124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:17.755130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:17.755136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:17.755142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:17.755147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:17.755152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:17.755158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:17.755164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:17.755215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:17.758005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:17.758584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:17.758604Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:17.758607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:17.758612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:17.758619Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2615 [2:7559602420608474902:11881]
2025-10-10T14:38:17.758634Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:17.758658Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:17.758667Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:17.758671Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:17.758674Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:17.758694Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:17.758702Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:17.758712Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:17.758788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:17.758799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:17.758801Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:17.758804Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:17.758879Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:17.758888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:17.758900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:17.758911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:17.758926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:17.758951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602421390710849:11894], now have 1 active actors on pipe
2025-10-10T14:38:17.758955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602421390710763:2438], now have 1 active actors on pipe
2025-10-10T14:38:17.758964Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602420608474897:11881]
2025-10-10T14:38:17.758967Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602420608474897:11881]
2025-10-10T14:38:17.758969Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602420608474897:11881]
2025-10-10T14:38:17.758983Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:17.758999Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:17.759005Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:17.759008Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:17.759011Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:17.759015Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:17.759018Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:17.759054Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602420608474897:11881]
2025-10-10T14:38:17.759068Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:17.759040Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2615
2025-10-10T14:38:17.759075Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2615
2025-10-10T14:38:17.759088Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:17.759310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:17.759326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:17.759365Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d1359247-f2c8925d-e090bb8b-845ca068_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:17.759381Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:17.759386Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:17.759389Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:17.759402Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:17.759417Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:17.759446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:17.759745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:17.759763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:17.759783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:17.759914Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2616 partition: 0 MaxSeqNo: 40 sessionId: src_id|d1359247-f2c8925d-e090bb8b-845ca068_0
2025-10-10T14:38:17.760343Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc12b097-f4b6262d-a18a8ef6-e2e8eacb_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|d1359247-f2c8925d-e090bb8b-845ca068_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:17.763461Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d1359247-f2c8925d-e090bb8b-845ca068_0] Write session: try to update token
2025-10-10T14:38:17.763484Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d1359247-f2c8925d-e090bb8b-845ca068_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:17.782473Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:17.782492Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:17.782496Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:17.782499Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:17.782513Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602420608474897:11881]
2025-10-10T14:38:17.782519Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602420608474897:11881]
2025-10-10T14:38:17.782531Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602420608474897:11881]
2025-10-10T14:38:17.782591Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:17.782599Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:17.782602Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:17.782611Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:17.782618Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:17.782636Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:17.782862Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2616 sessionId: src_id|d1359247-f2c8925d-e090bb8b-845ca068_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:17.782791Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:17.785650Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:17.822529Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602421390711019:11816]
2025-10-10T14:38:17.822977Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 pipe creation result: OK TabletId: 72075186224037892 Generation: 2615, pipe: [1:7559602421390711019:11816]
2025-10-10T14:38:17.900010Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:17.900455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:17.900468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:17.900518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602421390711019:11816], now have 1 active actors on pipe
2025-10-10T14:38:17.900844Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:17.900798Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:17.900798Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 14 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602421390711019:11816]
2025-10-10T14:38:17.900815Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:17.900835Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:17.900884Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2616 reason: error at write: Disconnected sessionId: src_id|d1359247-f2c8925d-e090bb8b-845ca068_0
2025-10-10T14:38:17.901095Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2616 sessionId: src_id|d1359247-f2c8925d-e090bb8b-845ca068_0 is DEAD
2025-10-10T14:38:17.901252Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1359247-f2c8925d-e090bb8b-845ca068_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:17.901265Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1359247-f2c8925d-e090bb8b-845ca068_0] Write session will restart in 0.007121s
2025-10-10T14:38:17.901293Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1359247-f2c8925d-e090bb8b-845ca068_0] Write session: Do CDS request
2025-10-10T14:38:17.901303Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1359247-f2c8925d-e090bb8b-845ca068_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:17.909897Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d1359247-f2c8925d-e090bb8b-845ca068_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:17.909969Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:17.909988Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2617
2025-10-10T14:38:17.910192Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2617 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:17.910240Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2617 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:17.910252Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2617 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:17.910257Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:17.910716Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2617 sessionId:  describe result for acl check
2025-10-10T14:38:17.910757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:17.910759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:17.910761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:17.910768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602421390711103:11908] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:17.911430Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602421390711103:11908] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:17.913972Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602421390711103:11908] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:17.916962Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602421390711103:11908] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:17.916982Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602421390711103:11908] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:17.916986Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602421390711103:11908] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:17.916995Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2617 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:17.918919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:17.920670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:17.920921Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:17.920932Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:17.920945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:17.921017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:17.921067Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602420608475146:11896]
2025-10-10T14:38:17.921721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:17.922045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:17.922091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:17.922402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:17.922459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:17.922465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:17.922466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:17.922467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:17.922471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:17.922472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:17.922473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:17.922474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:17.922475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:17.922476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:17.922477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:17.922478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:17.922479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:17.922485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:17.922499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:17.922503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:17.922507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:17.922510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:17.922514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:17.922518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:17.922521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:17.922524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:17.922528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:17.922531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:17.922535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:17.922538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:17.922546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:17.922554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:17.922560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:17.922565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:17.922569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:17.922574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:17.922579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:17.922584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:17.922589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:17.922595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:17.922599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:17.922603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:17.922608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:17.922625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:17.922630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:17.922634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:17.922644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:17.922648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:17.922652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:17.922656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:17.922660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:17.922667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:17.922672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:17.922681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:17.922685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:17.922689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:17.922723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:17.925237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:17.925684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:17.925699Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:17.925701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:17.925706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:17.925713Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2616 [2:7559602420608475146:11896]
2025-10-10T14:38:17.925740Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:17.925766Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:17.925769Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:17.925772Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:17.925775Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:17.925793Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:17.925804Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:17.925816Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:17.925881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:17.925888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:17.925890Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:17.925893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:17.925972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:17.925981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:17.925992Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:17.926003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:17.926020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:17.926043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602421390711034:2438], now have 1 active actors on pipe
2025-10-10T14:38:17.926053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602421390711255:11908], now have 1 active actors on pipe
2025-10-10T14:38:17.926061Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602420608475141:11896]
2025-10-10T14:38:17.926063Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602420608475141:11896]
2025-10-10T14:38:17.926066Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602420608475141:11896]
2025-10-10T14:38:17.926080Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:17.926098Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:17.926099Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:17.926104Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:17.926106Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:17.926118Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:17.926122Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:17.926154Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602420608475141:11896]
2025-10-10T14:38:17.926113Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2616
2025-10-10T14:38:17.926162Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:17.926150Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2616
2025-10-10T14:38:17.926164Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:17.926196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:17.926206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:17.926258Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a1c87227-5b9f1712-1ba51360-5ccb54f7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:17.926270Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:17.926439Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:17.926449Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:17.926475Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:17.926492Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:17.926520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:17.926685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:17.926693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:17.926708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:17.926806Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2617 partition: 0 MaxSeqNo: 40 sessionId: src_id|a1c87227-5b9f1712-1ba51360-5ccb54f7_0
2025-10-10T14:38:17.927261Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1359247-f2c8925d-e090bb8b-845ca068_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|a1c87227-5b9f1712-1ba51360-5ccb54f7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:17.930692Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a1c87227-5b9f1712-1ba51360-5ccb54f7_0] Write session: try to update token
2025-10-10T14:38:17.930719Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a1c87227-5b9f1712-1ba51360-5ccb54f7_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:17.946702Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2617 sessionId: src_id|a1c87227-5b9f1712-1ba51360-5ccb54f7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:17.946894Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:17.946916Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:17.946919Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:17.946921Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:17.946931Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602420608475141:11896]
2025-10-10T14:38:17.946936Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602420608475141:11896]
2025-10-10T14:38:17.946940Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602420608475141:11896]
2025-10-10T14:38:17.946990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:17.946995Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:17.947001Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:17.947002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:17.947005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:17.947005Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:17.947161Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:17.949683Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:18.001060Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602425685678566:11816]
2025-10-10T14:38:18.001343Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 pipe creation result: OK TabletId: 72075186224037892 Generation: 2616, pipe: [1:7559602425685678566:11816]
2025-10-10T14:38:18.066581Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:18.066980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:18.067003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:18.067067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602425685678566:11816], now have 1 active actors on pipe
2025-10-10T14:38:18.067330Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:18.067772Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1c87227-5b9f1712-1ba51360-5ccb54f7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:18.067783Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1c87227-5b9f1712-1ba51360-5ccb54f7_0] Write session will restart in 0.005929s
2025-10-10T14:38:18.067286Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 15 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602425685678566:11816]
2025-10-10T14:38:18.067811Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1c87227-5b9f1712-1ba51360-5ccb54f7_0] Write session: Do CDS request
2025-10-10T14:38:18.067292Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:18.067817Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1c87227-5b9f1712-1ba51360-5ccb54f7_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:18.067322Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:18.067325Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:18.067385Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2617 reason: error at write: Disconnected sessionId: src_id|a1c87227-5b9f1712-1ba51360-5ccb54f7_0
2025-10-10T14:38:18.067588Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2617 sessionId: src_id|a1c87227-5b9f1712-1ba51360-5ccb54f7_0 is DEAD
2025-10-10T14:38:18.074929Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a1c87227-5b9f1712-1ba51360-5ccb54f7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:18.075009Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:18.075027Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2618
2025-10-10T14:38:18.075175Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2618 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:18.075213Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2618 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:18.075224Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2618 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:18.075228Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:18.075777Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2618 sessionId:  describe result for acl check
2025-10-10T14:38:18.075814Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:18.075820Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:18.075822Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:18.075828Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602425685678600:11912] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:18.076391Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602425685678600:11912] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:18.079677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602425685678600:11912] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:18.082735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602425685678600:11912] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:18.082751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602425685678600:11912] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:18.082755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602425685678600:11912] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:18.082764Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2618 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:18.086247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:18.086821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:18.087166Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:18.087180Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:18.087193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:18.087252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:18.087293Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602424903442649:11898]
2025-10-10T14:38:18.087955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:18.088285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:18.088331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:18.088665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:18.088727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:18.088733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:18.088735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:18.088736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:18.088737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:18.088739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:18.088740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:18.088742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:18.088743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:18.088745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:18.088746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:18.088748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:18.088749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:18.088755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:18.088770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:18.088775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:18.088780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:18.088783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:18.088788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:18.088792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:18.088796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:18.088800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:18.088805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:18.088808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:18.088812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:18.088816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:18.088825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:18.088833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:18.088840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:18.088845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:18.088851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:18.088856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:18.088861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:18.088866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:18.088871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:18.088877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:18.088882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:18.088888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:18.088893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:18.088904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:18.088909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:18.088921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:18.088925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:18.088930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:18.088934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:18.088940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:18.088950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:18.088955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:18.088964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:18.088970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:18.088980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:18.088986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:18.089036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:18.091704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:18.092224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:18.092239Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:18.092241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:18.092246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:18.092253Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2617 [2:7559602424903442649:11898]
2025-10-10T14:38:18.092268Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:18.092286Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:18.092295Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:18.092298Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:18.092301Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:18.092320Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:18.092332Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:18.092340Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:18.092430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:18.092436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:18.092437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:18.092440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:18.092515Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:18.092523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:18.092537Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:18.092547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:18.092567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:18.092594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602425685678567:2438], now have 1 active actors on pipe
2025-10-10T14:38:18.092604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602425685678789:11912], now have 1 active actors on pipe
2025-10-10T14:38:18.092613Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602424903442644:11898]
2025-10-10T14:38:18.092620Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602424903442644:11898]
2025-10-10T14:38:18.092622Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602424903442644:11898]
2025-10-10T14:38:18.092636Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:18.092656Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:18.092673Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:18.092680Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:18.092692Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:18.092702Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:18.092705Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:18.092711Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602424903442644:11898]
2025-10-10T14:38:18.092714Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:18.092694Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2617
2025-10-10T14:38:18.092720Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2617
2025-10-10T14:38:18.092737Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:18.092752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:18.092758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:18.092802Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|170b73ca-f9ec5ac6-a808d5c6-da3bf7fd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:18.092816Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:18.092820Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:18.092827Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:18.092839Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:18.092854Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:18.092873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:18.093010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:18.093022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:18.093037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:18.093110Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2618 partition: 0 MaxSeqNo: 40 sessionId: src_id|170b73ca-f9ec5ac6-a808d5c6-da3bf7fd_0
2025-10-10T14:38:18.093521Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1c87227-5b9f1712-1ba51360-5ccb54f7_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|170b73ca-f9ec5ac6-a808d5c6-da3bf7fd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:18.096462Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|170b73ca-f9ec5ac6-a808d5c6-da3bf7fd_0] Write session: try to update token
2025-10-10T14:38:18.096482Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|170b73ca-f9ec5ac6-a808d5c6-da3bf7fd_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:18.112591Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2618 sessionId: src_id|170b73ca-f9ec5ac6-a808d5c6-da3bf7fd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:18.112763Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:18.112786Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:18.112790Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:18.112792Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:18.112802Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602424903442644:11898]
2025-10-10T14:38:18.112808Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602424903442644:11898]
2025-10-10T14:38:18.112813Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602424903442644:11898]
2025-10-10T14:38:18.112867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:18.112873Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:18.112877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:18.112879Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:18.112881Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:18.112885Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:18.113034Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:18.116015Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:18.167501Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602425685678804:11816]
2025-10-10T14:38:18.167849Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 pipe creation result: OK TabletId: 72075186224037892 Generation: 2617, pipe: [1:7559602425685678804:11816]
2025-10-10T14:38:18.235511Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:18.235994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:18.236015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:18.236069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602425685678804:11816], now have 1 active actors on pipe
2025-10-10T14:38:18.236316Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:18.236433Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:18.236445Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 16 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602425685678804:11816]
2025-10-10T14:38:18.236471Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:38:18.236571Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2618 reason: status is not ok: tablet will be restarted right now sessionId: src_id|170b73ca-f9ec5ac6-a808d5c6-da3bf7fd_0
2025-10-10T14:38:18.236772Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2618 sessionId: src_id|170b73ca-f9ec5ac6-a808d5c6-da3bf7fd_0 is DEAD
2025-10-10T14:38:18.236958Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|170b73ca-f9ec5ac6-a808d5c6-da3bf7fd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:38:18.236968Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|170b73ca-f9ec5ac6-a808d5c6-da3bf7fd_0] Write session will restart in 0.006527s
2025-10-10T14:38:18.236994Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|170b73ca-f9ec5ac6-a808d5c6-da3bf7fd_0] Write session: Do CDS request
2025-10-10T14:38:18.237002Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|170b73ca-f9ec5ac6-a808d5c6-da3bf7fd_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:18.244923Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|170b73ca-f9ec5ac6-a808d5c6-da3bf7fd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:18.245001Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:18.245019Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2619
2025-10-10T14:38:18.245175Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2619 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:18.245216Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2619 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:18.245227Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2619 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:18.245231Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:18.245808Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2619 sessionId:  describe result for acl check
2025-10-10T14:38:18.245852Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:18.245856Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:18.245858Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:18.245865Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602425685678821:11916] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:18.246489Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602425685678821:11916] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:18.249358Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602425685678821:11916] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:18.252263Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602425685678821:11916] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:18.252277Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602425685678821:11916] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:18.252281Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602425685678821:11916] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:18.252296Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2619 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:18.255087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:18.257062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:18.257280Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:18.257294Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:18.257307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:18.257395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:18.257442Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602424903442859:11901]
2025-10-10T14:38:18.258085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:18.258428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:18.258475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:18.258799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:18.258863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:18.258870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:18.258871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:18.258872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:18.258874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:18.258875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:18.258876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:18.258877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:18.258878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:18.258880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:18.258882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:18.258883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:18.258884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:18.258891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:18.258904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:18.258909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:18.258913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:18.258918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:18.258922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:18.258926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:18.258930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:18.258935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:18.258940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:18.258944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:18.258948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:18.258952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:18.258962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:18.258976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:18.258987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:18.258992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:18.259002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:18.259008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:18.259013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:18.259023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:18.259029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:18.259038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:18.259043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:18.259048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:18.259053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:18.259058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:18.259067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:18.259072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:18.259077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:18.259081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:18.259091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:18.259096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:18.259105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:18.259109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:18.259113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:18.259118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:18.259123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:18.259128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:18.259170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:18.261522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:18.262002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:18.262014Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:18.262016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:18.262018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:18.262023Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2618 [2:7559602424903442859:11901]
2025-10-10T14:38:18.262032Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:18.262046Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:18.262048Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:18.262051Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:18.262052Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:18.262067Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:18.262073Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:18.262080Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:18.262136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:18.262145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:18.262146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:18.262148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:18.262383Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2618
2025-10-10T14:38:18.262387Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2618
2025-10-10T14:38:18.262410Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:18.262422Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:18.262435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:18.262448Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:18.262467Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:18.262496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602425685678805:2438], now have 1 active actors on pipe
2025-10-10T14:38:18.262504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602425685679010:11916], now have 1 active actors on pipe
2025-10-10T14:38:18.262522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:18.262527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:18.262551Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602424903442854:11901]
2025-10-10T14:38:18.262557Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602424903442854:11901]
2025-10-10T14:38:18.262558Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602424903442854:11901]
2025-10-10T14:38:18.262570Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:18.262586Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:18.262598Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:18.262601Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:18.262605Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:18.262607Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:18.262609Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:18.262626Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|489712d9-f9dc8ee2-7cfd5edd-394dda53_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:18.262633Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:18.262637Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:18.262639Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:18.262650Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:18.262661Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:18.262711Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602424903442854:11901]
2025-10-10T14:38:18.262722Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:18.262731Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:18.262733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:18.262882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:18.262893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:18.262911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:18.263028Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2619 partition: 0 MaxSeqNo: 40 sessionId: src_id|489712d9-f9dc8ee2-7cfd5edd-394dda53_0
2025-10-10T14:38:18.263488Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|170b73ca-f9ec5ac6-a808d5c6-da3bf7fd_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|489712d9-f9dc8ee2-7cfd5edd-394dda53_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:18.266483Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|489712d9-f9dc8ee2-7cfd5edd-394dda53_0] Write session: try to update token
2025-10-10T14:38:18.266504Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|489712d9-f9dc8ee2-7cfd5edd-394dda53_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:18.284715Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:38:18.284736Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:18.284747Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602424903442854:11901]
2025-10-10T14:38:18.284794Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:38:18.284800Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:38:18.285264Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:38:18.282063Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2619 sessionId: src_id|489712d9-f9dc8ee2-7cfd5edd-394dda53_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:18.285249Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:18.285434Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:18.285587Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:18.285728Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:18.285919Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:38:18.285974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:18.286000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:18.286025Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:38:18.286067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:38:18.286165Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:38:18.296615Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:18.296640Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:18.296643Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:18.296645Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:18.296657Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602424903442854:11901]
2025-10-10T14:38:18.296661Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602424903442854:11901]
2025-10-10T14:38:18.296665Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602424903442854:11901]
2025-10-10T14:38:18.296712Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:18.296720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:18.296718Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:18.296722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:18.296726Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:18.296729Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:18.296862Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:18.336455Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602425685679044:11816]
2025-10-10T14:38:18.337585Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 pipe creation result: OK TabletId: 72075186224037892 Generation: 2618, pipe: [1:7559602425685679044:11816]
2025-10-10T14:38:18.413010Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:18.421750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:18.421782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:18.421976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:18.422037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:18.422102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:18.422163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:18.422236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:18.422245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:18.422318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:18.422380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:18.422444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:18.422516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:18.422557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:18.422560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:18.422642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:18.422710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:18.422775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:18.422843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:18.422886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:18.422889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:18.423007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:18.423077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:18.423143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:18.423212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:18.423259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:18.423263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:18.423347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:18.423411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:18.423485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:18.423553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:18.423600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:18.423603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:18.423684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:18.423749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:18.423817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:18.423889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:18.424017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:18.424020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:18.424092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:18.424155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:18.424217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:18.424284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:18.424327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:18.424330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:18.424409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:18.424473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:18.424537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:18.424601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:18.424646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:18.424650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:18.424723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:18.424782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:18.424845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:18.424953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:18.425002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:18.425006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:18.425075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:18.425133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:18.425196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:18.425259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:18.425299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:18.425303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:18.426075Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:18.426161Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 17 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602425685679044:11816]
2025-10-10T14:38:18.426194Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:18.426204Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:18.426251Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2619 reason: error at write: Disconnected sessionId: src_id|489712d9-f9dc8ee2-7cfd5edd-394dda53_0
2025-10-10T14:38:18.426469Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2619 sessionId: src_id|489712d9-f9dc8ee2-7cfd5edd-394dda53_0 is DEAD
2025-10-10T14:38:18.426642Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|489712d9-f9dc8ee2-7cfd5edd-394dda53_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:18.426654Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|489712d9-f9dc8ee2-7cfd5edd-394dda53_0] Write session will restart in 0.008860s
2025-10-10T14:38:18.426681Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|489712d9-f9dc8ee2-7cfd5edd-394dda53_0] Write session: Do CDS request
2025-10-10T14:38:18.426688Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|489712d9-f9dc8ee2-7cfd5edd-394dda53_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:18.425790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602425685679044:11816], now have 1 active actors on pipe
2025-10-10T14:38:18.427118Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:18.437421Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|489712d9-f9dc8ee2-7cfd5edd-394dda53_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:18.437589Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:18.437612Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2620
2025-10-10T14:38:18.437759Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2620 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:18.437803Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2620 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:18.437818Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2620 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:18.437822Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:18.438211Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2620 sessionId:  describe result for acl check
2025-10-10T14:38:18.438255Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:18.438256Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:18.438261Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:18.438266Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602425685679094:11921] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:18.438827Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602425685679094:11921] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:18.443445Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602425685679094:11921] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:18.447819Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602425685679094:11921] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:18.447845Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602425685679094:11921] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:18.447849Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602425685679094:11921] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:18.447858Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2620 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:18.449430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:18.451665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:18.451896Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:18.451911Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:18.451923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:18.451977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:18.452020Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602424903443081:11904]
2025-10-10T14:38:18.452637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:18.452958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:18.453005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:18.453358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:18.453427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:18.453431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:18.453432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:18.453433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:18.453434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:18.453435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:18.453436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:18.453437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:18.453439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:18.453440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:18.453441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:18.453442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:18.453443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:18.453449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:18.453461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:18.453465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:18.453469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:18.453472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:18.453476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:18.453479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:18.453482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:18.453486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:18.453489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:18.453493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:18.453496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:18.453500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:18.453508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:18.453516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:18.453522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:18.453527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:18.453531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:18.453536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:18.453542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:18.453547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:18.453551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:18.453556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:18.453559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:18.453564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:18.453568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:18.453574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:18.453577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:18.453582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:18.453586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:18.453591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:18.453596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:18.453601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:18.453605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:18.453610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:18.453614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:18.453619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:18.453623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:18.453628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:18.453665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:18.456302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:18.456942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:18.456957Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:18.456959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:18.456964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:18.456970Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2619 [2:7559602424903443081:11904]
2025-10-10T14:38:18.456983Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:18.457002Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:18.457005Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:18.457009Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:18.457012Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:18.457030Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:18.457045Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:18.457053Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:18.457115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:18.457123Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:18.457125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:18.457127Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:18.457194Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:18.457197Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:18.457207Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:18.457216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:18.457231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:18.457253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602425685679281:11921], now have 1 active actors on pipe
2025-10-10T14:38:18.457257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602425685679046:2438], now have 1 active actors on pipe
2025-10-10T14:38:18.457265Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602424903443075:11904]
2025-10-10T14:38:18.457268Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602424903443075:11904]
2025-10-10T14:38:18.457270Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602424903443075:11904]
2025-10-10T14:38:18.457286Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:18.457300Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:18.457301Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:18.457305Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:18.457307Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:18.457317Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:18.457456Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2619
2025-10-10T14:38:18.457493Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2619
2025-10-10T14:38:18.457321Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:18.457371Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602424903443075:11904]
2025-10-10T14:38:18.457380Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:18.457387Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:18.457658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:18.457672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:18.457708Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4c66751a-2ef89a80-30f3e89a-1cd27560_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:18.457722Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:18.457727Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:18.457729Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:18.457744Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:18.457762Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:18.457784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:18.458121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:18.458131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:18.458148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:18.458290Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2620 partition: 0 MaxSeqNo: 40 sessionId: src_id|4c66751a-2ef89a80-30f3e89a-1cd27560_0
2025-10-10T14:38:18.458986Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|489712d9-f9dc8ee2-7cfd5edd-394dda53_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|4c66751a-2ef89a80-30f3e89a-1cd27560_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:18.461793Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4c66751a-2ef89a80-30f3e89a-1cd27560_0] Write session: try to update token
2025-10-10T14:38:18.461815Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4c66751a-2ef89a80-30f3e89a-1cd27560_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:18.471571Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:38:18.471593Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:18.471606Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602424903443075:11904]
2025-10-10T14:38:18.471660Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:38:18.471678Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:38:18.471850Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:38:18.472006Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:18.472152Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:18.472331Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:18.472548Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:38:18.472601Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:38:18.488112Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2620 sessionId: src_id|4c66751a-2ef89a80-30f3e89a-1cd27560_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:18.490981Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:18.491192Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:18.491214Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:18.491217Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:18.491219Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:18.491229Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602424903443075:11904]
2025-10-10T14:38:18.491234Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602424903443075:11904]
2025-10-10T14:38:18.491241Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602424903443075:11904]
2025-10-10T14:38:18.491279Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:18.491286Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:18.491299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:18.491303Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:18.491309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:18.491332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:18.491339Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:18.491342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:18.491477Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:18.525452Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602425685679297:11816]
2025-10-10T14:38:18.525841Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 pipe creation result: OK TabletId: 72075186224037892 Generation: 2619, pipe: [1:7559602425685679297:11816]
2025-10-10T14:38:18.615909Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:18.616365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602425685679297:11816], now have 1 active actors on pipe
2025-10-10T14:38:18.616664Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:18.617237Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 18 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602425685679297:11816]
2025-10-10T14:38:18.617271Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:18.617321Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:38:18.617412Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2620 reason: status is not ok: tablet will be restarted right now sessionId: src_id|4c66751a-2ef89a80-30f3e89a-1cd27560_0
2025-10-10T14:38:18.617621Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2620 sessionId: src_id|4c66751a-2ef89a80-30f3e89a-1cd27560_0 is DEAD
2025-10-10T14:38:18.617795Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4c66751a-2ef89a80-30f3e89a-1cd27560_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:38:18.617818Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4c66751a-2ef89a80-30f3e89a-1cd27560_0] Write session will restart in 0.009742s
2025-10-10T14:38:18.617844Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4c66751a-2ef89a80-30f3e89a-1cd27560_0] Write session: Do CDS request
2025-10-10T14:38:18.617851Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4c66751a-2ef89a80-30f3e89a-1cd27560_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:18.628917Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4c66751a-2ef89a80-30f3e89a-1cd27560_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:18.629002Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:18.629024Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2621
2025-10-10T14:38:18.629172Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2621 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:18.629213Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2621 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:18.629220Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2621 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:18.629224Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:18.629757Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2621 sessionId:  describe result for acl check
2025-10-10T14:38:18.629802Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:18.629811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:18.629814Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:18.629821Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602425685679411:11925] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:18.630451Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602425685679411:11925] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:18.633769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602425685679411:11925] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:18.635443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:18.637439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:18.637688Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:18.637705Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:18.637720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:18.637753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602425685679411:11925] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:18.637773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602425685679411:11925] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:18.637789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602425685679411:11925] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:18.637803Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2621 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:18.637788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:18.637836Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602424903443291:11906]
2025-10-10T14:38:18.638519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:18.638866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:18.638916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:18.639203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:18.639284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:18.639295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:18.639296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:18.639297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:18.639298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:18.639300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:18.639301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:18.639303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:18.639304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:18.639305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:18.639306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:18.639307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:18.639308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:18.639315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:18.639330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:18.639335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:18.639340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:18.639344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:18.639349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:18.639354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:18.639358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:18.639362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:18.639367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:18.639372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:18.639377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:18.639381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:18.639390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:18.639404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:18.639411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:18.639416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:18.639424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:18.639429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:18.639433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:18.639442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:18.639447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:18.639455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:18.639459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:18.639464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:18.639469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:18.639475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:18.639479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:18.639485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:18.639496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:18.639502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:18.639508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:18.639518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:18.639522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:18.639528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:18.639538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:18.639543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:18.639548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:18.639553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:18.639595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:18.642241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:18.642580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:18.642596Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:18.642598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:18.642602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:18.642611Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2620 [2:7559602424903443291:11906]
2025-10-10T14:38:18.642625Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:18.642644Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:18.642652Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:18.642655Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:18.642658Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:18.642675Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:18.642684Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:18.642698Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:18.642761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:18.642770Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:18.642772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:18.642775Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:18.643112Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2620
2025-10-10T14:38:18.643154Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2620
2025-10-10T14:38:18.643174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:18.643184Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:18.643196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:18.643208Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:18.643231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:18.643261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602425685679526:11925], now have 1 active actors on pipe
2025-10-10T14:38:18.643268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602425685679299:2438], now have 1 active actors on pipe
2025-10-10T14:38:18.643284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:18.643295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:18.643320Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602424903443286:11906]
2025-10-10T14:38:18.643327Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602424903443286:11906]
2025-10-10T14:38:18.643329Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602424903443286:11906]
2025-10-10T14:38:18.643346Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:18.643365Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:18.643365Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:18.643371Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:18.643373Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:18.643385Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:18.643389Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:18.643408Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a9631c51-3d9bdd14-45b25ab4-f8041a6c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:18.643421Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:18.643429Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:18.643432Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:18.643444Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:18.643460Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:18.643496Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602424903443286:11906]
2025-10-10T14:38:18.643508Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:18.643515Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:18.643524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:18.643957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:18.643971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:18.643994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:18.644212Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2621 partition: 0 MaxSeqNo: 40 sessionId: src_id|a9631c51-3d9bdd14-45b25ab4-f8041a6c_0
2025-10-10T14:38:18.644638Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4c66751a-2ef89a80-30f3e89a-1cd27560_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|a9631c51-3d9bdd14-45b25ab4-f8041a6c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:18.647532Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a9631c51-3d9bdd14-45b25ab4-f8041a6c_0] Write session: try to update token
2025-10-10T14:38:18.647550Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a9631c51-3d9bdd14-45b25ab4-f8041a6c_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:18.658103Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:38:18.658138Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:18.658151Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602424903443286:11906]
2025-10-10T14:38:18.658228Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:38:18.658430Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:38:18.658619Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:18.658861Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:18.659029Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:18.659282Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:38:18.659329Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:38:18.659537Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:38:18.673069Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2621 sessionId: src_id|a9631c51-3d9bdd14-45b25ab4-f8041a6c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:18.676342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:18.676389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:18.676440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:38:18.676047Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:18.676579Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:38:18.689123Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:18.689149Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:18.689153Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:18.689155Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:18.689166Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602424903443286:11906]
2025-10-10T14:38:18.689170Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602424903443286:11906]
2025-10-10T14:38:18.689175Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602424903443286:11906]
2025-10-10T14:38:18.689226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:18.689233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:18.689235Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:18.689237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:18.689242Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:18.689247Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:18.689395Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:18.717395Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602425685679539:11816]
2025-10-10T14:38:18.717699Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 pipe creation result: OK TabletId: 72075186224037892 Generation: 2620, pipe: [1:7559602425685679539:11816]
2025-10-10T14:38:18.821189Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:18.829945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:18.829981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:18.830168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:18.830243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:18.830313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:18.830381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:18.830515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:18.830526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:18.830624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:18.830687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:18.830753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:18.830823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:18.830869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:18.830876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:18.830954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:18.831018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:18.831093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:18.831165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:18.831209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:18.831217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:18.831292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:18.831358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:18.831427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:18.831491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:18.831540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:18.831543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:18.831615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:18.831687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:18.831752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:18.831817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:18.831868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:18.831876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:18.831943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:18.832006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:18.832072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:18.832137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:18.832184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:18.832198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:18.832266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:18.832325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:18.832436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:18.832500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:18.832543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:18.832546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:18.832614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:18.832674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:18.832731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:18.832792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:18.832837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:18.832840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:18.832903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:18.832963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:18.833020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:18.833078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:18.833119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:18.833122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:18.833188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:18.833245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:18.833312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:18.833496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:18.833549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:18.833557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:18.833633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602425685679539:11816], now have 1 active actors on pipe
2025-10-10T14:38:18.837624Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:18.838377Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:38:18.838455Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2621 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a9631c51-3d9bdd14-45b25ab4-f8041a6c_0
2025-10-10T14:38:18.838667Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2621 sessionId: src_id|a9631c51-3d9bdd14-45b25ab4-f8041a6c_0 is DEAD
2025-10-10T14:38:18.838735Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 19 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602425685679539:11816]
2025-10-10T14:38:18.838760Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:18.838837Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9631c51-3d9bdd14-45b25ab4-f8041a6c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:38:18.838846Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9631c51-3d9bdd14-45b25ab4-f8041a6c_0] Write session will restart in 0.009665s
2025-10-10T14:38:18.838872Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9631c51-3d9bdd14-45b25ab4-f8041a6c_0] Write session: Do CDS request
2025-10-10T14:38:18.838879Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9631c51-3d9bdd14-45b25ab4-f8041a6c_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:18.849924Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a9631c51-3d9bdd14-45b25ab4-f8041a6c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:18.853474Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:18.853504Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2622
2025-10-10T14:38:18.857462Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2622 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:18.857522Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2622 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:18.857534Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2622 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:18.857540Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:18.857990Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2622 sessionId:  describe result for acl check
2025-10-10T14:38:18.858029Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:18.858036Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:18.858038Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:18.858044Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602425685679760:11936] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:18.858639Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602425685679760:11936] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:18.859542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:18.861773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602425685679760:11936] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:18.861788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:18.862134Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:18.862152Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:18.862168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:18.862262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:18.862309Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602424903443515:11910]
2025-10-10T14:38:18.862934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:18.863288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:18.863363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:18.863742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:18.863804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:18.863810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:18.863811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:18.863812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:18.863814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:18.863815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:18.863816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:18.863817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:18.863818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:18.863819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:18.863821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:18.863821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:18.863823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:18.863830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:18.863842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:18.863846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:18.863850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:18.863854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:18.863859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:18.863863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:18.863867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:18.863871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:18.863875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:18.863879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:18.863884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:18.863888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:18.863895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:18.863904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:18.863920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:18.863926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:18.863930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:18.863936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:18.863941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:18.863946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:18.863951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:18.863957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:18.863973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:18.863985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:18.863989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:18.863995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:18.864000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:18.864005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:18.864010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:18.864015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:18.864020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:18.864025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:18.864030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:18.864035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:18.864039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:18.864045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:18.864050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:18.864055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:18.864097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:18.870584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:18.870184Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602425685679760:11936] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:18.870225Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602425685679760:11936] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:18.870229Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602425685679760:11936] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:18.870239Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2622 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:18.871350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:18.871366Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:18.871368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:18.871373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:18.871381Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2621 [2:7559602424903443515:11910]
2025-10-10T14:38:18.871396Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:18.871428Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:18.871433Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:18.871436Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:18.871441Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:18.871460Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:18.871474Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:18.871487Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:18.871552Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:18.871562Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:18.871564Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:18.871567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:18.871641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:18.871650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:18.871664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:18.871676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:18.871708Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:18.871738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602425685679795:11936], now have 1 active actors on pipe
2025-10-10T14:38:18.871750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602425685679547:2438], now have 1 active actors on pipe
2025-10-10T14:38:18.871757Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602424903443510:11910]
2025-10-10T14:38:18.871759Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602424903443510:11910]
2025-10-10T14:38:18.871761Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602424903443510:11910]
2025-10-10T14:38:18.871774Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:18.871787Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:18.871790Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:18.871791Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:18.871797Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:18.871814Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:18.871817Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:18.871871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:18.871882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:18.871897Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602424903443510:11910]
2025-10-10T14:38:18.871910Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:18.871915Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:18.871950Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|72b1d76e-cb0a9b96-1ffca88e-bf6e6a4f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:18.871963Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:18.871968Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:18.871971Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:18.871982Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:18.871993Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:18.872024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:18.871793Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2621
2025-10-10T14:38:18.871828Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2621
2025-10-10T14:38:18.872224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:18.872232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:18.872248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:18.872370Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2622 partition: 0 MaxSeqNo: 40 sessionId: src_id|72b1d76e-cb0a9b96-1ffca88e-bf6e6a4f_0
2025-10-10T14:38:18.872775Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9631c51-3d9bdd14-45b25ab4-f8041a6c_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|72b1d76e-cb0a9b96-1ffca88e-bf6e6a4f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:18.875652Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|72b1d76e-cb0a9b96-1ffca88e-bf6e6a4f_0] Write session: try to update token
2025-10-10T14:38:18.875670Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|72b1d76e-cb0a9b96-1ffca88e-bf6e6a4f_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:18.894443Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:18.894471Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:18.894474Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:18.894476Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:18.894485Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602424903443510:11910]
2025-10-10T14:38:18.894490Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602424903443510:11910]
2025-10-10T14:38:18.894493Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602424903443510:11910]
2025-10-10T14:38:18.894545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:18.894554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:18.894558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:18.894568Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:18.894582Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:18.894599Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:18.894704Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:18.898854Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2622 sessionId: src_id|72b1d76e-cb0a9b96-1ffca88e-bf6e6a4f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:18.901519Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:18.938602Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602425685679814:11816]
2025-10-10T14:38:18.939008Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 pipe creation result: OK TabletId: 72075186224037892 Generation: 2621, pipe: [1:7559602425685679814:11816]
2025-10-10T14:38:19.012409Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:19.012944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:19.012959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:19.012999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602425685679814:11816], now have 1 active actors on pipe
2025-10-10T14:38:19.013222Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:19.013263Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:19.013288Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 20 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602425685679814:11816]
2025-10-10T14:38:19.013855Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:38:19.013933Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2622 reason: status is not ok: tablet will be restarted right now sessionId: src_id|72b1d76e-cb0a9b96-1ffca88e-bf6e6a4f_0
2025-10-10T14:38:19.014123Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2622 sessionId: src_id|72b1d76e-cb0a9b96-1ffca88e-bf6e6a4f_0 is DEAD
2025-10-10T14:38:19.014271Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72b1d76e-cb0a9b96-1ffca88e-bf6e6a4f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:38:19.014279Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72b1d76e-cb0a9b96-1ffca88e-bf6e6a4f_0] Write session will restart in 0.007955s
2025-10-10T14:38:19.014313Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72b1d76e-cb0a9b96-1ffca88e-bf6e6a4f_0] Write session: Do CDS request
2025-10-10T14:38:19.014319Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72b1d76e-cb0a9b96-1ffca88e-bf6e6a4f_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:19.023987Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|72b1d76e-cb0a9b96-1ffca88e-bf6e6a4f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:19.024059Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:19.024092Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2623
2025-10-10T14:38:19.024214Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2623 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:19.024251Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2623 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:19.024262Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2623 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:19.024266Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:19.024832Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2623 sessionId:  describe result for acl check
2025-10-10T14:38:19.024875Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:19.024881Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:19.024883Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:19.024890Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602429980647176:11943] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:19.025524Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602429980647176:11943] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:19.028481Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602429980647176:11943] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:19.031487Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602429980647176:11943] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:19.031502Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602429980647176:11943] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:19.031506Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602429980647176:11943] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:19.031515Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2623 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:19.033142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:19.035165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:19.035367Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:19.035378Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:19.035390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:19.035445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:19.035483Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602429198411049:11923]
2025-10-10T14:38:19.036110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:19.036395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:19.036467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:19.036812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:19.036877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:19.036884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:19.036885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:19.036886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:19.036888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:19.036889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:19.036890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:19.036892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:19.036893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:19.036894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:19.036895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:19.036896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:19.036897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:19.036904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:19.036918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:19.036923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:19.036928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:19.036932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:19.036937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:19.036941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:19.036946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:19.036950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:19.036954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:19.036959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:19.036963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:19.036967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:19.036975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:19.036985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:19.036992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:19.036998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:19.037003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:19.037009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:19.037013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:19.037019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:19.037025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:19.037030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:19.037037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:19.037043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:19.037049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:19.037055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:19.037060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:19.037065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:19.037071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:19.037077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:19.037081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:19.037087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:19.037092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:19.037097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:19.037102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:19.037108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:19.037113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:19.037119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:19.037159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:19.039570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:19.040019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:19.040030Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:19.040032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:19.040037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:19.040043Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2622 [2:7559602429198411049:11923]
2025-10-10T14:38:19.040055Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:19.040073Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:19.040080Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:19.040084Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:19.040087Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:19.040108Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:19.040119Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:19.040132Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:19.040189Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:19.040197Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:19.040199Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:19.040202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:19.040274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:19.040286Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:19.040298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:19.040312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:19.040331Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:19.040352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602429980647340:11943], now have 1 active actors on pipe
2025-10-10T14:38:19.040360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602429980647112:2438], now have 1 active actors on pipe
2025-10-10T14:38:19.040368Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602429198411044:11923]
2025-10-10T14:38:19.040371Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602429198411044:11923]
2025-10-10T14:38:19.040374Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602429198411044:11923]
2025-10-10T14:38:19.040390Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:19.040403Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:19.040407Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:19.040411Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:19.040413Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:19.040424Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:19.040428Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:19.040396Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2622
2025-10-10T14:38:19.040461Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602429198411044:11923]
2025-10-10T14:38:19.040470Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:19.040482Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:19.040514Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2622
2025-10-10T14:38:19.040580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:19.040591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:19.040621Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|402a9257-3fb1d13b-19a89759-2ba0a00e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:19.040634Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:19.040642Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:19.040645Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:19.040656Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:19.040671Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:19.040688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:19.040857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:19.040865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:19.040878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:19.040959Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2623 partition: 0 MaxSeqNo: 40 sessionId: src_id|402a9257-3fb1d13b-19a89759-2ba0a00e_0
2025-10-10T14:38:19.041366Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72b1d76e-cb0a9b96-1ffca88e-bf6e6a4f_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|402a9257-3fb1d13b-19a89759-2ba0a00e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:19.044260Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|402a9257-3fb1d13b-19a89759-2ba0a00e_0] Write session: try to update token
2025-10-10T14:38:19.044281Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|402a9257-3fb1d13b-19a89759-2ba0a00e_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:19.059359Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2623 sessionId: src_id|402a9257-3fb1d13b-19a89759-2ba0a00e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:19.061457Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:19.061477Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:19.061480Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:19.061482Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:19.061492Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602429198411044:11923]
2025-10-10T14:38:19.061497Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602429198411044:11923]
2025-10-10T14:38:19.061501Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602429198411044:11923]
2025-10-10T14:38:19.061558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:19.061566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:19.061569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:19.061723Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:19.062056Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:19.062246Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:19.062260Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:19.062264Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:19.117405Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602429980647354:11816]
2025-10-10T14:38:19.117779Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 pipe creation result: OK TabletId: 72075186224037892 Generation: 2622, pipe: [1:7559602429980647354:11816]
2025-10-10T14:38:19.184098Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:19.184818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:19.184837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:19.184890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602429980647354:11816], now have 1 active actors on pipe
2025-10-10T14:38:19.185210Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:19.185437Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:38:19.185536Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2623 reason: status is not ok: tablet will be restarted right now sessionId: src_id|402a9257-3fb1d13b-19a89759-2ba0a00e_0
2025-10-10T14:38:19.185765Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2623 sessionId: src_id|402a9257-3fb1d13b-19a89759-2ba0a00e_0 is DEAD
2025-10-10T14:38:19.185948Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:19.185976Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|402a9257-3fb1d13b-19a89759-2ba0a00e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:38:19.185987Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|402a9257-3fb1d13b-19a89759-2ba0a00e_0] Write session will restart in 0.005463s
2025-10-10T14:38:19.186015Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|402a9257-3fb1d13b-19a89759-2ba0a00e_0] Write session: Do CDS request
2025-10-10T14:38:19.186004Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 21 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602429980647354:11816]
2025-10-10T14:38:19.186022Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|402a9257-3fb1d13b-19a89759-2ba0a00e_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:19.192926Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|402a9257-3fb1d13b-19a89759-2ba0a00e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:19.193037Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:19.193057Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2624
2025-10-10T14:38:19.193216Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2624 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:19.193284Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2624 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:19.193298Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2624 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:19.193304Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:19.193793Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2624 sessionId:  describe result for acl check
2025-10-10T14:38:19.193829Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:19.193835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:19.193837Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:19.193843Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602429980647384:11947] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:19.194430Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602429980647384:11947] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:19.197806Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602429980647384:11947] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:19.201450Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602429980647384:11947] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:19.201466Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602429980647384:11947] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:19.201479Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602429980647384:11947] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:19.201488Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2624 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:19.204306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:19.206888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:19.207191Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:19.207205Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:19.207221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:19.207294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:19.207358Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602429198411264:11926]
2025-10-10T14:38:19.208016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:19.208415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:19.208470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:19.208828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:19.208899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:19.208906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:19.208908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:19.208909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:19.208911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:19.208912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:19.208913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:19.208915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:19.208916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:19.208917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:19.208919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:19.208921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:19.208922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:19.208928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:19.208942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:19.208947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:19.208951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:19.208955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:19.208959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:19.208964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:19.208968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:19.208972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:19.208977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:19.208982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:19.208986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:19.208990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:19.208998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:19.209008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:19.209014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:19.209021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:19.209026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:19.209032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:19.209037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:19.209042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:19.209047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:19.209053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:19.209058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:19.209063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:19.209068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:19.209074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:19.209080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:19.209087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:19.209091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:19.209097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:19.209102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:19.209107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:19.209112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:19.209117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:19.209122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:19.209127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:19.209131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:19.209136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:19.209178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:19.211927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:19.212622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:19.212639Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:19.212642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:19.212647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:19.212654Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2623 [2:7559602429198411264:11926]
2025-10-10T14:38:19.212670Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:19.212695Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:19.212704Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:19.212708Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:19.212711Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:19.212730Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:19.212742Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:19.212756Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:19.212826Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:19.212834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:19.212837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:19.212840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:19.212912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:19.212923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:19.212937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:19.212950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:19.212969Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:19.212997Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602429198411259:11926]
2025-10-10T14:38:19.213005Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602429198411259:11926]
2025-10-10T14:38:19.213007Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602429198411259:11926]
2025-10-10T14:38:19.213021Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:19.213034Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:19.213040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602429980647356:2438], now have 1 active actors on pipe
2025-10-10T14:38:19.213044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602429980647575:11947], now have 1 active actors on pipe
2025-10-10T14:38:19.213053Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:19.213060Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:19.213064Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:19.213071Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:19.213075Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:19.213110Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602429198411259:11926]
2025-10-10T14:38:19.213072Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2623
2025-10-10T14:38:19.213126Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:19.213144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:19.213108Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2623
2025-10-10T14:38:19.213149Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:19.213150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:19.213206Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a64c49de-26d6c913-c78c2621-17ebb408_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:19.213220Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:19.213224Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:19.213226Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:19.213239Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:19.213255Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:19.213278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:19.213512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:19.213526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:19.213563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:19.213682Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2624 partition: 0 MaxSeqNo: 40 sessionId: src_id|a64c49de-26d6c913-c78c2621-17ebb408_0
2025-10-10T14:38:19.214128Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|402a9257-3fb1d13b-19a89759-2ba0a00e_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|a64c49de-26d6c913-c78c2621-17ebb408_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:19.217060Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a64c49de-26d6c913-c78c2621-17ebb408_0] Write session: try to update token
2025-10-10T14:38:19.217085Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a64c49de-26d6c913-c78c2621-17ebb408_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:19.233265Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:19.233287Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:19.233291Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:19.233293Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:19.233305Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602429198411259:11926]
2025-10-10T14:38:19.233310Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602429198411259:11926]
2025-10-10T14:38:19.233315Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602429198411259:11926]
2025-10-10T14:38:19.233371Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:19.233375Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:19.233379Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:19.233383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:19.233391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:19.233393Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:19.233536Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:19.234525Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2624 sessionId: src_id|a64c49de-26d6c913-c78c2621-17ebb408_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:19.237215Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:19.286265Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602429980647599:11816]
2025-10-10T14:38:19.287157Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 pipe creation result: OK TabletId: 72075186224037892 Generation: 2623, pipe: [1:7559602429980647599:11816]
2025-10-10T14:38:19.352761Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:19.353057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:19.353076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:19.353123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602429980647599:11816], now have 1 active actors on pipe
2025-10-10T14:38:19.353381Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:19.353426Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:19.353492Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 22 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602429980647599:11816]
2025-10-10T14:38:19.353662Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:38:19.353745Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2624 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a64c49de-26d6c913-c78c2621-17ebb408_0
2025-10-10T14:38:19.353945Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2624 sessionId: src_id|a64c49de-26d6c913-c78c2621-17ebb408_0 is DEAD
2025-10-10T14:38:19.354101Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a64c49de-26d6c913-c78c2621-17ebb408_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:38:19.354108Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a64c49de-26d6c913-c78c2621-17ebb408_0] Write session will restart in 0.005866s
2025-10-10T14:38:19.354133Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a64c49de-26d6c913-c78c2621-17ebb408_0] Write session: Do CDS request
2025-10-10T14:38:19.354139Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a64c49de-26d6c913-c78c2621-17ebb408_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:19.360912Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a64c49de-26d6c913-c78c2621-17ebb408_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:19.361010Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:19.361028Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2625
2025-10-10T14:38:19.361162Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2625 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:19.361205Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2625 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:19.361216Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2625 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:19.361220Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:19.361721Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2625 sessionId:  describe result for acl check
2025-10-10T14:38:19.361760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:19.361769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:19.361771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:19.361778Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602429980647646:11951] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:19.362359Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602429980647646:11951] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:19.365230Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602429980647646:11951] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:19.368585Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602429980647646:11951] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:19.368599Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602429980647646:11951] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:19.368603Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602429980647646:11951] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:19.368612Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2625 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:19.369913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:19.372330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:19.372592Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:19.372610Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:19.372622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:19.372680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:19.372732Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602429198411491:11928]
2025-10-10T14:38:19.373425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:19.373814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:19.373885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:19.374255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:19.374328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:19.374349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:19.374355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:19.374356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:19.374358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:19.374360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:19.374361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:19.374363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:19.374365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:19.374366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:19.374368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:19.374369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:19.374371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:19.374377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:19.374390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:19.374395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:19.374399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:19.374403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:19.374408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:19.374412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:19.374416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:19.374421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:19.374426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:19.374430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:19.374439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:19.374443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:19.374457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:19.374472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:19.374483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:19.374490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:19.374495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:19.374501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:19.374510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:19.374517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:19.374527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:19.374533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:19.374542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:19.374548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:19.374556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:19.374562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:19.374567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:19.374574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:19.374580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:19.374591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:19.374597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:19.374607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:19.374612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:19.374622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:19.374627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:19.374633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:19.374642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:19.374648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:19.374697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:19.377229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:19.377659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:19.377674Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:19.377677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:19.377682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:19.377689Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2624 [2:7559602429198411491:11928]
2025-10-10T14:38:19.377704Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:19.377722Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:19.377730Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:19.377734Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:19.377737Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:19.377755Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:19.377767Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:19.377780Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:19.377846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:19.377853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:19.377855Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:19.377858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:19.377938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:19.377945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:19.377958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:19.377977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:19.378001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:19.378028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602429980647831:11951], now have 1 active actors on pipe
2025-10-10T14:38:19.378036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602429980647601:2438], now have 1 active actors on pipe
2025-10-10T14:38:19.378045Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602429198411486:11928]
2025-10-10T14:38:19.378051Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602429198411486:11928]
2025-10-10T14:38:19.378053Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602429198411486:11928]
2025-10-10T14:38:19.378062Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:19.378080Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:19.378051Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2624
2025-10-10T14:38:19.378056Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2624
2025-10-10T14:38:19.378089Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:19.378098Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:19.378102Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:19.378103Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:19.378106Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:19.378139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:19.378149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:19.378167Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602429198411486:11928]
2025-10-10T14:38:19.378182Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:19.378206Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:19.378228Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e123c62d-c4cc5411-260de9c4-a39acdeb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:19.378245Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:19.378249Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:19.378251Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:19.378262Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:19.378273Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:19.378295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:19.378423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:19.378435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:19.378467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:19.378551Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2625 partition: 0 MaxSeqNo: 40 sessionId: src_id|e123c62d-c4cc5411-260de9c4-a39acdeb_0
2025-10-10T14:38:19.378934Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a64c49de-26d6c913-c78c2621-17ebb408_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|e123c62d-c4cc5411-260de9c4-a39acdeb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:19.381702Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e123c62d-c4cc5411-260de9c4-a39acdeb_0] Write session: try to update token
2025-10-10T14:38:19.381720Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e123c62d-c4cc5411-260de9c4-a39acdeb_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:19.395563Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2625 sessionId: src_id|e123c62d-c4cc5411-260de9c4-a39acdeb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:19.397855Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:19.397876Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:19.397880Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:19.397882Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:19.397893Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602429198411486:11928]
2025-10-10T14:38:19.397898Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602429198411486:11928]
2025-10-10T14:38:19.397902Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602429198411486:11928]
2025-10-10T14:38:19.397953Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:19.397961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:19.397963Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:19.397969Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:19.397974Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:19.397979Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:19.398106Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:19.398502Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:19.453650Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602429980647857:11816]
2025-10-10T14:38:19.453912Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 pipe creation result: OK TabletId: 72075186224037892 Generation: 2624, pipe: [1:7559602429980647857:11816]
2025-10-10T14:38:19.513990Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:19.514607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:19.514627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:19.514673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602429980647857:11816], now have 1 active actors on pipe
2025-10-10T14:38:19.514884Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:19.514901Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 23 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602429980647857:11816]
2025-10-10T14:38:19.515043Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:19.515054Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:19.515058Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:19.515119Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2625 reason: error at write: Disconnected sessionId: src_id|e123c62d-c4cc5411-260de9c4-a39acdeb_0
2025-10-10T14:38:19.515319Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2625 sessionId: src_id|e123c62d-c4cc5411-260de9c4-a39acdeb_0 is DEAD
2025-10-10T14:38:19.515495Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e123c62d-c4cc5411-260de9c4-a39acdeb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:19.515506Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e123c62d-c4cc5411-260de9c4-a39acdeb_0] Write session will restart in 0.008869s
2025-10-10T14:38:19.515534Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e123c62d-c4cc5411-260de9c4-a39acdeb_0] Write session: Do CDS request
2025-10-10T14:38:19.515544Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e123c62d-c4cc5411-260de9c4-a39acdeb_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:19.526168Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e123c62d-c4cc5411-260de9c4-a39acdeb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:19.526291Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:19.526312Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2626
2025-10-10T14:38:19.526463Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2626 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:19.526510Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2626 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:19.526522Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2626 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:19.526528Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:19.527083Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2626 sessionId:  describe result for acl check
2025-10-10T14:38:19.527123Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:19.527130Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:19.527132Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:19.527139Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602429980648018:11956] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:19.527728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602429980648018:11956] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:19.529936Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602429980648018:11956] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:19.530266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:19.532322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:19.532505Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602429980648018:11956] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:19.532533Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602429980648018:11956] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:19.532536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602429980648018:11956] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:19.532528Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:19.532540Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:19.532554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:19.532545Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2626 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:19.532607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:19.532649Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602429198411705:11931]
2025-10-10T14:38:19.533272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:19.533586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:19.533628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:19.533950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:19.534007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:19.534013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:19.534015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:19.534016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:19.534017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:19.534019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:19.534020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:19.534021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:19.534022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:19.534023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:19.534025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:19.534026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:19.534027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:19.534033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:19.534046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:19.534051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:19.534055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:19.534060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:19.534064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:19.534068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:19.534072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:19.534076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:19.534081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:19.534086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:19.534090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:19.534093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:19.534112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:19.534125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:19.534137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:19.534143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:19.534152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:19.534158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:19.534167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:19.534173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:19.534182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:19.534188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:19.534205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:19.534215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:19.534222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:19.534227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:19.534236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:19.534242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:19.534250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:19.534256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:19.534261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:19.534274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:19.534279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:19.534284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:19.534289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:19.534294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:19.534299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:19.534304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:19.534345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:19.536791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:19.537452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:19.537469Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:19.537471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:19.537475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:19.537482Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2625 [2:7559602429198411705:11931]
2025-10-10T14:38:19.537496Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:19.537515Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:19.537519Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:19.537522Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:19.537525Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:19.537543Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:19.537551Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:19.537565Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:19.537629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:19.537636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:19.537639Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:19.537641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:19.537709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:19.537717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:19.537730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:19.537749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:19.537770Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:19.537797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602429980648092:11956], now have 1 active actors on pipe
2025-10-10T14:38:19.537806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602429980647859:2438], now have 1 active actors on pipe
2025-10-10T14:38:19.537814Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602429198411700:11931]
2025-10-10T14:38:19.537821Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602429198411700:11931]
2025-10-10T14:38:19.537824Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602429198411700:11931]
2025-10-10T14:38:19.537837Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:19.537852Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:19.537857Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:19.537862Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:19.537865Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:19.537875Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:19.537844Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2625
2025-10-10T14:38:19.537863Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2625
2025-10-10T14:38:19.537879Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:19.537926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:19.537934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:19.537949Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602429198411700:11931]
2025-10-10T14:38:19.537961Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:19.537979Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:19.537999Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e2423ee6-8390a1a2-fad65b50-f2ecc507_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:19.538012Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:19.538020Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:19.538023Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:19.538035Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:19.538050Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:19.538081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:19.538289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:19.538304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:19.538330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:19.538429Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2626 partition: 0 MaxSeqNo: 40 sessionId: src_id|e2423ee6-8390a1a2-fad65b50-f2ecc507_0
2025-10-10T14:38:19.538837Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e123c62d-c4cc5411-260de9c4-a39acdeb_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|e2423ee6-8390a1a2-fad65b50-f2ecc507_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:19.541511Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e2423ee6-8390a1a2-fad65b50-f2ecc507_0] Write session: try to update token
2025-10-10T14:38:19.541529Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e2423ee6-8390a1a2-fad65b50-f2ecc507_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:19.556055Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2626 sessionId: src_id|e2423ee6-8390a1a2-fad65b50-f2ecc507_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:19.557920Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:19.557946Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:19.557950Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:19.557952Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:19.557964Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602429198411700:11931]
2025-10-10T14:38:19.557969Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602429198411700:11931]
2025-10-10T14:38:19.557974Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602429198411700:11931]
2025-10-10T14:38:19.558029Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:19.558038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:19.558037Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:19.558040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:19.558045Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:19.558050Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:19.558187Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:19.558823Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:19.614928Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602429980648103:11816]
2025-10-10T14:38:19.615133Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 pipe creation result: OK TabletId: 72075186224037892 Generation: 2625, pipe: [1:7559602429980648103:11816]
2025-10-10T14:38:19.678769Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:19.679291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:19.679308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:19.679359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602429980648103:11816], now have 1 active actors on pipe
2025-10-10T14:38:19.679617Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:19.679627Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:19.679632Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:19.679637Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:19.679693Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 24 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602429980648103:11816]
2025-10-10T14:38:19.679730Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2626 reason: error at write: Disconnected sessionId: src_id|e2423ee6-8390a1a2-fad65b50-f2ecc507_0
2025-10-10T14:38:19.679965Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2626 sessionId: src_id|e2423ee6-8390a1a2-fad65b50-f2ecc507_0 is DEAD
2025-10-10T14:38:19.680132Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2423ee6-8390a1a2-fad65b50-f2ecc507_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:19.680159Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2423ee6-8390a1a2-fad65b50-f2ecc507_0] Write session will restart in 0.008824s
2025-10-10T14:38:19.680188Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2423ee6-8390a1a2-fad65b50-f2ecc507_0] Write session: Do CDS request
2025-10-10T14:38:19.680197Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2423ee6-8390a1a2-fad65b50-f2ecc507_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:19.689864Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e2423ee6-8390a1a2-fad65b50-f2ecc507_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:19.690000Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:19.690017Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2627
2025-10-10T14:38:19.690129Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2627 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:19.690174Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2627 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:19.690185Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2627 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:19.690200Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:19.690932Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2627 sessionId:  describe result for acl check
2025-10-10T14:38:19.690973Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:19.690980Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:19.690982Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:19.690989Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602429980648188:11960] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:19.691577Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602429980648188:11960] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:19.694451Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602429980648188:11960] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:19.697507Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602429980648188:11960] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:19.697524Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602429980648188:11960] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:19.697528Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602429980648188:11960] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:19.697537Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2627 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:19.697939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:19.700160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:19.700471Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:19.700485Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:19.700504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:19.700554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:19.700588Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602429198411922:11933]
2025-10-10T14:38:19.701219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:19.701597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:19.701653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:19.701995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:19.702063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:19.702069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:19.702070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:19.702071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:19.702073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:19.702074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:19.702076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:19.702077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:19.702079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:19.702080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:19.702081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:19.702083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:19.702084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:19.702090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:19.702104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:19.702108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:19.702113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:19.702117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:19.702122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:19.702126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:19.702130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:19.702134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:19.702139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:19.702144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:19.702149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:19.702154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:19.702162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:19.702172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:19.702179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:19.702184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:19.702205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:19.702210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:19.702215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:19.702220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:19.702226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:19.702232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:19.702242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:19.702249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:19.702254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:19.702263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:19.702268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:19.702272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:19.702277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:19.702283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:19.702288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:19.702294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:19.702299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:19.702306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:19.702314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:19.702320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:19.702329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:19.702334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:19.702381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:19.704819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:19.705438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:19.705455Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:19.705458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:19.705463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:19.705469Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2626 [2:7559602429198411922:11933]
2025-10-10T14:38:19.705482Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:19.705502Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:19.705505Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:19.705508Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:19.705511Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:19.705529Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:19.705537Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:19.705546Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:19.705613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:19.705624Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:19.705626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:19.705629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:19.705702Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:19.705711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:19.705724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:19.705742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:19.705764Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:19.705795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602429980648339:11960], now have 1 active actors on pipe
2025-10-10T14:38:19.705798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602429980648106:2438], now have 1 active actors on pipe
2025-10-10T14:38:19.705809Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602429198411917:11933]
2025-10-10T14:38:19.705816Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602429198411917:11933]
2025-10-10T14:38:19.705818Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602429198411917:11933]
2025-10-10T14:38:19.705832Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:19.705854Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:19.705859Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:19.705862Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:19.705864Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:19.705879Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:19.705884Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:19.705913Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602429198411917:11933]
2025-10-10T14:38:19.705925Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:19.705932Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:19.705946Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2626
2025-10-10T14:38:19.705997Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2626
2025-10-10T14:38:19.706054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:19.706065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:19.706099Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8e624867-8283d5b1-69807a0b-72635707_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:19.706113Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:19.706117Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:19.706120Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:19.706132Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:19.706143Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:19.706166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:19.706341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:19.706350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:19.706365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:19.706475Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2627 partition: 0 MaxSeqNo: 40 sessionId: src_id|8e624867-8283d5b1-69807a0b-72635707_0
2025-10-10T14:38:19.706850Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2423ee6-8390a1a2-fad65b50-f2ecc507_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|8e624867-8283d5b1-69807a0b-72635707_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:19.709648Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8e624867-8283d5b1-69807a0b-72635707_0] Write session: try to update token
2025-10-10T14:38:19.709669Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8e624867-8283d5b1-69807a0b-72635707_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:19.718142Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:38:19.718160Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:19.718171Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602429198411917:11933]
2025-10-10T14:38:19.718243Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:38:19.718259Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:38:19.718442Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:38:19.718611Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:19.718788Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:19.718929Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:19.719124Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:38:19.719175Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:38:19.725992Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2627 sessionId: src_id|8e624867-8283d5b1-69807a0b-72635707_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:19.728852Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:19.729075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:19.729102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:19.729141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:38:19.729254Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:38:19.737030Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:19.737059Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:19.737064Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:19.737066Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:19.737080Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602429198411917:11933]
2025-10-10T14:38:19.737085Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602429198411917:11933]
2025-10-10T14:38:19.737090Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602429198411917:11933]
2025-10-10T14:38:19.737145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:19.737155Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:19.737162Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:19.737164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:19.737167Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:19.737167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:19.737370Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:19.779791Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602429980648353:11816]
2025-10-10T14:38:19.780146Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 pipe creation result: OK TabletId: 72075186224037892 Generation: 2626, pipe: [1:7559602429980648353:11816]
2025-10-10T14:38:19.854963Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:19.863548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:19.863578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:19.863762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:19.863831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:19.863906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:19.863971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:19.864294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:19.864307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:19.864377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:19.864437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:19.864502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:19.864568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:19.864617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:19.864628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:19.864700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:19.864766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:19.864831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:19.864897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:19.864940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:19.864950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:19.865021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:19.865091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:19.865156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:19.865224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:19.865270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:19.865277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:19.865363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:19.865430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:19.865492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:19.865560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:19.865604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:19.865610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:19.865680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:19.865747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:19.865818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:19.865890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:19.865958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:19.865967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:19.866036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:19.866099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:19.866172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:19.866259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:19.866306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:19.866313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:19.866389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:19.866458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:19.866526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:19.866599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:19.866648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:19.866660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:19.866729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:19.866797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:19.866869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:19.866933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:19.866980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:19.866988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:19.867057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:19.867121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:19.867185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:19.867249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:19.867296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:19.867305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:19.867374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602429980648353:11816], now have 1 active actors on pipe
2025-10-10T14:38:19.867698Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 25 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602429980648353:11816]
2025-10-10T14:38:19.867714Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:19.867719Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:19.867735Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:19.867764Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2627 reason: error at write: Disconnected sessionId: src_id|8e624867-8283d5b1-69807a0b-72635707_0
2025-10-10T14:38:19.868009Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2627 sessionId: src_id|8e624867-8283d5b1-69807a0b-72635707_0 is DEAD
2025-10-10T14:38:19.868177Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e624867-8283d5b1-69807a0b-72635707_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:19.868188Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e624867-8283d5b1-69807a0b-72635707_0] Write session will restart in 0.006606s
2025-10-10T14:38:19.868216Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e624867-8283d5b1-69807a0b-72635707_0] Write session: Do CDS request
2025-10-10T14:38:19.868223Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e624867-8283d5b1-69807a0b-72635707_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:19.868301Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:19.875986Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8e624867-8283d5b1-69807a0b-72635707_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:19.876055Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:19.876084Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2628
2025-10-10T14:38:19.876272Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2628 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:19.876312Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2628 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:19.876324Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2628 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:19.876328Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:19.876907Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2628 sessionId:  describe result for acl check
2025-10-10T14:38:19.876948Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:19.876955Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:19.876957Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:19.876965Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602429980648397:11965] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:19.877585Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602429980648397:11965] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:19.880995Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602429980648397:11965] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:19.885654Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602429980648397:11965] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:19.885668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602429980648397:11965] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:19.885672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602429980648397:11965] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:19.885681Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2628 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:19.889587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:19.891793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:19.892167Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:19.892185Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:19.892201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:19.892273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:19.892322Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602429198412139:11935]
2025-10-10T14:38:19.892979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:19.893814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:19.893874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:19.894295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:19.894358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:19.894365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:19.894367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:19.894368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:19.894370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:19.894371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:19.894373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:19.894374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:19.894375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:19.894377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:19.894378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:19.894380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:19.894381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:19.894388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:19.894402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:19.894406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:19.894411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:19.894416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:19.894421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:19.894426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:19.894430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:19.894434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:19.894439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:19.894443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:19.894448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:19.894452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:19.894460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:19.894469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:19.894477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:19.894483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:19.894490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:19.894496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:19.894508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:19.894514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:19.894524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:19.894530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:19.894541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:19.894547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:19.894554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:19.894560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:19.894565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:19.894571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:19.894576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:19.894586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:19.894591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:19.894602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:19.894607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:19.894613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:19.894622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:19.894640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:19.894648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:19.894654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:19.894705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:19.897478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:19.898064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:19.898081Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:19.898083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:19.898087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:19.898093Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2627 [2:7559602429198412139:11935]
2025-10-10T14:38:19.898106Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:19.898129Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:19.898140Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:19.898144Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:19.898146Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:19.898163Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:19.898177Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:19.898217Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:19.898283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:19.898293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:19.898295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:19.898298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:19.898363Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:19.898371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:19.898384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:19.898401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:19.898423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:19.898450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602429980648553:11965], now have 1 active actors on pipe
2025-10-10T14:38:19.898458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602429980648364:2438], now have 1 active actors on pipe
2025-10-10T14:38:19.898467Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602429198412134:11935]
2025-10-10T14:38:19.898469Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602429198412134:11935]
2025-10-10T14:38:19.898471Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602429198412134:11935]
2025-10-10T14:38:19.898487Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:19.898503Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:19.898521Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:19.898530Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:19.898554Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602429198412134:11935]
2025-10-10T14:38:19.898563Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:19.898617Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:19.898628Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:19.898630Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:19.898638Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:19.898801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:19.898819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:19.898864Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d5ee0563-e56e5713-3e9cf3c7-49d77d01_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:19.898879Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:19.898889Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:19.898892Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:19.898905Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:19.898933Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:19.898949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:19.898578Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2627
2025-10-10T14:38:19.898620Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2627
2025-10-10T14:38:19.901677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:19.901691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:19.901722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:19.901871Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2628 partition: 0 MaxSeqNo: 40 sessionId: src_id|d5ee0563-e56e5713-3e9cf3c7-49d77d01_0
2025-10-10T14:38:19.902291Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e624867-8283d5b1-69807a0b-72635707_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|d5ee0563-e56e5713-3e9cf3c7-49d77d01_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:19.905049Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5ee0563-e56e5713-3e9cf3c7-49d77d01_0] Write session: try to update token
2025-10-10T14:38:19.905065Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5ee0563-e56e5713-3e9cf3c7-49d77d01_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:19.922973Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:19.923002Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:19.923005Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:19.923007Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:19.923017Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602429198412134:11935]
2025-10-10T14:38:19.923021Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602429198412134:11935]
2025-10-10T14:38:19.923025Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602429198412134:11935]
2025-10-10T14:38:19.923087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:19.923092Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:19.923096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:19.923099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:19.923100Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:19.923107Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:19.923258Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:19.927313Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2628 sessionId: src_id|d5ee0563-e56e5713-3e9cf3c7-49d77d01_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:19.930395Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:19.967698Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602429980648633:11816]
2025-10-10T14:38:19.968308Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 pipe creation result: OK TabletId: 72075186224037892 Generation: 2627, pipe: [1:7559602429980648633:11816]
2025-10-10T14:38:20.044946Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:20.045510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:20.045529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:20.045577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602429980648633:11816], now have 1 active actors on pipe
2025-10-10T14:38:20.045816Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:20.046153Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 26 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602429980648633:11816]
2025-10-10T14:38:20.046197Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:20.046233Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:38:20.046328Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2628 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d5ee0563-e56e5713-3e9cf3c7-49d77d01_0
2025-10-10T14:38:20.046513Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2628 sessionId: src_id|d5ee0563-e56e5713-3e9cf3c7-49d77d01_0 is DEAD
2025-10-10T14:38:20.048127Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d5ee0563-e56e5713-3e9cf3c7-49d77d01_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:38:20.048137Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d5ee0563-e56e5713-3e9cf3c7-49d77d01_0] Write session will restart in 0.009181s
2025-10-10T14:38:20.048158Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d5ee0563-e56e5713-3e9cf3c7-49d77d01_0] Write session: Do CDS request
2025-10-10T14:38:20.048163Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d5ee0563-e56e5713-3e9cf3c7-49d77d01_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:20.058901Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5ee0563-e56e5713-3e9cf3c7-49d77d01_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:20.058971Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:20.058987Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2629
2025-10-10T14:38:20.059141Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2629 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:20.059182Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2629 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:20.059192Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2629 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:20.059197Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:20.059702Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2629 sessionId:  describe result for acl check
2025-10-10T14:38:20.059743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:20.059751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:20.059754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:20.059760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602434275615964:11978] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:20.060365Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602434275615964:11978] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:20.063293Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602434275615964:11978] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:20.069957Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602434275615964:11978] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:20.069977Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602434275615964:11978] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:20.069982Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602434275615964:11978] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:20.069991Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2629 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:20.069983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:20.072349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:20.072542Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:20.072551Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:20.072560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:20.072615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:20.072649Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602433493379690:11950]
2025-10-10T14:38:20.073050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:20.073348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:20.073391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:20.073606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:20.073657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:20.073665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:20.073667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:20.073668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:20.073669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:20.073671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:20.073672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:20.073673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:20.073674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:20.073676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:20.073677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:20.073678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:20.073679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:20.073685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:20.073704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:20.073707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:20.073709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:20.073712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:20.073714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:20.073716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:20.073719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:20.073721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:20.073724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:20.073726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:20.073728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:20.073731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:20.073737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:20.073749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:20.073754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:20.073757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:20.073760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:20.073763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:20.073766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:20.073769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:20.073772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:20.073775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:20.073777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:20.073780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:20.073785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:20.073788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:20.073790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:20.073794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:20.073799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:20.073802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:20.073805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:20.073808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:20.073810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:20.073813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:20.073816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:20.073819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:20.073822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:20.073825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:20.073859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:20.076397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:20.077101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:20.077114Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:20.077117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:20.077121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:20.077142Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2628 [2:7559602433493379690:11950]
2025-10-10T14:38:20.077156Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:20.077180Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:20.077183Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:20.077187Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:20.077189Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:20.077207Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:20.077214Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:20.077224Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:20.077288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:20.077294Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:20.077296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:20.077299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:20.077384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:20.077391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:20.077403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:20.077419Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:20.077440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:20.077466Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602433493379684:11950]
2025-10-10T14:38:20.077474Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602433493379684:11950]
2025-10-10T14:38:20.077476Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602433493379684:11950]
2025-10-10T14:38:20.077491Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:20.077506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602434275616168:11978], now have 1 active actors on pipe
2025-10-10T14:38:20.077509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602434275615932:2438], now have 1 active actors on pipe
2025-10-10T14:38:20.077515Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:20.077518Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:20.077519Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:20.077521Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:20.077533Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:20.077537Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:20.077561Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2628
2025-10-10T14:38:20.077562Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2628
2025-10-10T14:38:20.077568Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602433493379684:11950]
2025-10-10T14:38:20.077584Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:20.077601Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:20.077640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:20.077646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:20.077682Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f3b421cf-821a9e71-9e7c5920-ecd0fd44_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:20.077690Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:20.077695Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:20.077697Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:20.077709Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:20.077722Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:20.077740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:20.077934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:20.077945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:20.077963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:20.078051Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2629 partition: 0 MaxSeqNo: 40 sessionId: src_id|f3b421cf-821a9e71-9e7c5920-ecd0fd44_0
2025-10-10T14:38:20.078576Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d5ee0563-e56e5713-3e9cf3c7-49d77d01_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|f3b421cf-821a9e71-9e7c5920-ecd0fd44_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:20.081284Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f3b421cf-821a9e71-9e7c5920-ecd0fd44_0] Write session: try to update token
2025-10-10T14:38:20.081307Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f3b421cf-821a9e71-9e7c5920-ecd0fd44_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:20.096054Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2629 sessionId: src_id|f3b421cf-821a9e71-9e7c5920-ecd0fd44_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:20.097639Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:38:20.097661Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:20.097672Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602433493379684:11950]
2025-10-10T14:38:20.097727Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:38:20.097726Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:38:20.097938Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:38:20.098088Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:20.098247Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:20.098396Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:20.098600Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:38:20.098660Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:38:20.098838Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:20.099055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:20.099074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:20.099106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:38:20.099225Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:38:20.107745Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:20.107766Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:20.107770Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:20.107772Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:20.107782Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602433493379684:11950]
2025-10-10T14:38:20.107787Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602433493379684:11950]
2025-10-10T14:38:20.107792Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602433493379684:11950]
2025-10-10T14:38:20.107837Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:20.107838Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:20.107843Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:20.107847Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:20.107848Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:20.107850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:20.107982Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:20.146384Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602434275616181:11816]
2025-10-10T14:38:20.146702Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 pipe creation result: OK TabletId: 72075186224037892 Generation: 2628, pipe: [1:7559602434275616181:11816]
2025-10-10T14:38:20.227013Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:20.235962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:20.235990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:20.236185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:20.236256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:20.236331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:20.236404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:20.236450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:20.236458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:20.236537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:20.236602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:20.236667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:20.236738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:20.236779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:20.236782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:20.236859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:20.236920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:20.236988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:20.237051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:20.237522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:20.237531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:20.237603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:20.237674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:20.237745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:20.237817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:20.240409Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:20.240426Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:20.240478Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2629 reason: error at write: Disconnected sessionId: src_id|f3b421cf-821a9e71-9e7c5920-ecd0fd44_0
2025-10-10T14:38:20.237867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:20.237877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:20.237944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:20.238006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:20.238069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:20.238135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:20.238194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:20.238198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:20.238278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:20.240743Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2629 sessionId: src_id|f3b421cf-821a9e71-9e7c5920-ecd0fd44_0 is DEAD
2025-10-10T14:38:20.238344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:20.238410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:20.238474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:20.238525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:20.238532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:20.238609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:20.238672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:20.238737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:20.238808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:20.238853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:20.238856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:20.238934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:20.239000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:20.239072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:20.239141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:20.239257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:20.239260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:20.239330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:20.239389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:20.239449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:20.239510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:20.240837Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3b421cf-821a9e71-9e7c5920-ecd0fd44_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:20.240855Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3b421cf-821a9e71-9e7c5920-ecd0fd44_0] Write session will restart in 0.009824s
2025-10-10T14:38:20.239552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:20.239555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:20.240887Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3b421cf-821a9e71-9e7c5920-ecd0fd44_0] Write session: Do CDS request
2025-10-10T14:38:20.239631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:20.239688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:20.240893Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3b421cf-821a9e71-9e7c5920-ecd0fd44_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:20.239756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:20.239826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:20.239890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:20.239894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:20.239972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602434275616181:11816], now have 1 active actors on pipe
2025-10-10T14:38:20.240869Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:20.240981Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 27 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602434275616181:11816]
2025-10-10T14:38:20.241145Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:20.251989Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f3b421cf-821a9e71-9e7c5920-ecd0fd44_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:20.252126Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:20.252153Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2630
2025-10-10T14:38:20.252325Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2630 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:20.252376Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2630 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:20.252387Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2630 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:20.252392Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:20.253017Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2630 sessionId:  describe result for acl check
2025-10-10T14:38:20.253049Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:20.253054Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:20.253056Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:20.253061Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602434275616265:11982] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:20.253683Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602434275616265:11982] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:20.260941Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602434275616265:11982] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:20.262326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:20.263898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:20.264130Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:20.264142Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:20.264156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:20.264213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:20.264264Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602433493379909:11953]
2025-10-10T14:38:20.264941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:20.265351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:20.265417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:20.265824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:20.265895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:20.265902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:20.265903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:20.265905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:20.265907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:20.265908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:20.265910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:20.265911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:20.265912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:20.265914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:20.265916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:20.265917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:20.265919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:20.265926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:20.265939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:20.265943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:20.265948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:20.265952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:20.265957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:20.265962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:20.265966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:20.265971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:20.265976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:20.265980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:20.265985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:20.265989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:20.265998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:20.265980Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602434275616265:11982] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:20.266012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:20.266000Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602434275616265:11982] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:20.266005Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602434275616265:11982] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:20.266015Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2630 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:20.266024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:20.266031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:20.266036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:20.266043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:20.266047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:20.266054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:20.266059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:20.266065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:20.266069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:20.266075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:20.266079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:20.266093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:20.266097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:20.266103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:20.266108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:20.266115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:20.266120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:20.266131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:20.266139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:20.266155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:20.266165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:20.266170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:20.266174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:20.266189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:20.266235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:20.268660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:20.269200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:20.269218Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:20.269221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:20.269224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:20.269231Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2629 [2:7559602433493379909:11953]
2025-10-10T14:38:20.269245Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:20.269263Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:20.269273Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:20.269277Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:20.269280Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:20.269299Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:20.269308Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:20.269316Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:20.269400Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:20.269409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:20.269411Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:20.269414Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:20.269486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:20.269497Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:20.269510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:20.269525Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:20.269544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:20.269573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602434275616422:11982], now have 1 active actors on pipe
2025-10-10T14:38:20.269578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602434275616183:2438], now have 1 active actors on pipe
2025-10-10T14:38:20.269586Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602433493379904:11953]
2025-10-10T14:38:20.269588Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602433493379904:11953]
2025-10-10T14:38:20.269591Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602433493379904:11953]
2025-10-10T14:38:20.269607Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:20.269630Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:20.269633Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:20.269635Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:20.269637Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:20.269654Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:20.269657Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:20.269685Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602433493379904:11953]
2025-10-10T14:38:20.269692Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:20.269679Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2629
2025-10-10T14:38:20.269679Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2629
2025-10-10T14:38:20.269746Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:20.269861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:20.269875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:20.269910Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a790c168-5141c5dc-78a8f568-1c9d13d2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:20.269924Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:20.269935Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:20.269938Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:20.269950Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:20.269972Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:20.269993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:20.270171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:20.270190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:20.270206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:20.270357Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2630 partition: 0 MaxSeqNo: 40 sessionId: src_id|a790c168-5141c5dc-78a8f568-1c9d13d2_0
2025-10-10T14:38:20.273667Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3b421cf-821a9e71-9e7c5920-ecd0fd44_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|a790c168-5141c5dc-78a8f568-1c9d13d2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:20.276457Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a790c168-5141c5dc-78a8f568-1c9d13d2_0] Write session: try to update token
2025-10-10T14:38:20.276481Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a790c168-5141c5dc-78a8f568-1c9d13d2_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:20.281854Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:38:20.281877Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:20.281890Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602433493379904:11953]
2025-10-10T14:38:20.281944Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:38:20.281950Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:38:20.282126Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:38:20.282294Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:20.282438Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:20.282568Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:20.282751Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:38:20.282786Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:38:20.297127Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2630 sessionId: src_id|a790c168-5141c5dc-78a8f568-1c9d13d2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:20.299951Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:20.301797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:20.301827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:20.301853Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:20.301857Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:20.301862Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:20.301864Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:20.301874Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602433493379904:11953]
2025-10-10T14:38:20.301878Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602433493379904:11953]
2025-10-10T14:38:20.301883Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602433493379904:11953]
2025-10-10T14:38:20.301933Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:20.301948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:20.301953Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:20.301957Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:20.301957Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:20.301960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:20.302103Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:20.340984Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602434275616432:11816]
2025-10-10T14:38:20.342544Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 pipe creation result: OK TabletId: 72075186224037892 Generation: 2629, pipe: [1:7559602434275616432:11816]
2025-10-10T14:38:20.423530Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:20.424202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:38:20.424249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602434275616432:11816], now have 1 active actors on pipe
2025-10-10T14:38:20.424415Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:38:20.424924Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 28 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602434275616432:11816]
2025-10-10T14:38:20.424941Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:20.437065Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:20.438008Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:20.438050Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2630 reason: error at write: Disconnected sessionId: src_id|a790c168-5141c5dc-78a8f568-1c9d13d2_0
2025-10-10T14:38:20.438257Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2630 sessionId: src_id|a790c168-5141c5dc-78a8f568-1c9d13d2_0 is DEAD
2025-10-10T14:38:20.441431Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a790c168-5141c5dc-78a8f568-1c9d13d2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:20.441446Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a790c168-5141c5dc-78a8f568-1c9d13d2_0] Write session will restart in 0.006364s
2025-10-10T14:38:20.441473Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a790c168-5141c5dc-78a8f568-1c9d13d2_0] Write session: Do CDS request
2025-10-10T14:38:20.441479Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a790c168-5141c5dc-78a8f568-1c9d13d2_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:20.448915Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a790c168-5141c5dc-78a8f568-1c9d13d2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:20.448991Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:20.449009Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2631
2025-10-10T14:38:20.449154Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2631 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:20.449214Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2631 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:20.449228Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2631 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:20.449237Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:20.449676Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2631 sessionId:  describe result for acl check
2025-10-10T14:38:20.449710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:20.449712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:20.449715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:20.449721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602434275616516:11987] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:20.450448Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602434275616516:11987] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:20.455561Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602434275616516:11987] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:20.459363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:20.459132Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602434275616516:11987] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:20.459150Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602434275616516:11987] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:20.459154Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602434275616516:11987] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:20.459163Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2631 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:20.461865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:20.462123Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:20.462134Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:20.462147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:20.462221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:20.462270Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602433493380141:11956]
2025-10-10T14:38:20.462910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:20.463295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:20.463354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:20.463712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:20.463778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:20.463786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:20.463787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:20.463789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:20.463790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:20.463791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:20.463792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:20.463794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:20.463795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:20.463796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:20.463798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:20.463799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:20.463800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:20.463806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:20.463821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:20.463825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:20.463830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:20.463834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:20.463838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:20.463843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:20.463847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:20.463851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:20.463855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:20.463859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:20.463863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:20.463867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:20.463875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:20.463884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:20.463891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:20.463897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:20.463901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:20.463906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:20.463911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:20.463917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:20.463923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:20.463929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:20.463933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:20.463939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:20.463944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:20.463953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:20.463963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:20.463968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:20.463973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:20.463983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:20.463987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:20.463998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:20.464003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:20.464008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:20.464018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:20.464023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:20.464033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:20.464038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:20.464076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:20.466929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:20.467636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:20.467653Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:20.467656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:20.467660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:20.467667Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2630 [2:7559602433493380141:11956]
2025-10-10T14:38:20.467682Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:20.467715Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:20.467724Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:20.467728Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:20.467731Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:20.467751Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:20.467759Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:20.467768Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:20.467833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:20.467842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:20.467844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:20.467847Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:20.467932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:20.467943Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:20.467956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:20.467970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:20.467994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:20.468025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602434275616682:11987], now have 1 active actors on pipe
2025-10-10T14:38:20.468028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602434275616434:2438], now have 1 active actors on pipe
2025-10-10T14:38:20.468036Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602433493380135:11956]
2025-10-10T14:38:20.468038Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602433493380135:11956]
2025-10-10T14:38:20.468041Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602433493380135:11956]
2025-10-10T14:38:20.468057Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:20.468072Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:20.468051Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2630
2025-10-10T14:38:20.468081Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2630
2025-10-10T14:38:20.468076Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:20.468087Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:20.468089Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:20.468090Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:20.468094Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:20.468141Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602433493380135:11956]
2025-10-10T14:38:20.468151Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:20.468165Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:20.468283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:20.468296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:20.468326Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|864dbb22-800e732e-930648da-f7bef513_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:20.468340Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:20.468347Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:20.468350Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:20.468362Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:20.468378Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:20.468398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:20.468603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:20.468618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:20.468640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:20.468778Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2631 partition: 0 MaxSeqNo: 40 sessionId: src_id|864dbb22-800e732e-930648da-f7bef513_0
2025-10-10T14:38:20.469197Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a790c168-5141c5dc-78a8f568-1c9d13d2_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|864dbb22-800e732e-930648da-f7bef513_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:20.472498Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|864dbb22-800e732e-930648da-f7bef513_0] Write session: try to update token
2025-10-10T14:38:20.472524Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|864dbb22-800e732e-930648da-f7bef513_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:20.480458Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:38:20.480488Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:20.480500Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602433493380135:11956]
2025-10-10T14:38:20.480559Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:38:20.480562Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:38:20.480810Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:38:20.481002Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:20.481193Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:20.481397Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:20.481659Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:38:20.481722Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:38:20.491803Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2631 sessionId: src_id|864dbb22-800e732e-930648da-f7bef513_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:20.494577Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:20.494793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:20.494819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:20.494863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:38:20.494948Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:38:20.503199Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:20.503219Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:20.503222Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:20.503224Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:20.503236Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602433493380135:11956]
2025-10-10T14:38:20.503240Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602433493380135:11956]
2025-10-10T14:38:20.503243Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602433493380135:11956]
2025-10-10T14:38:20.503296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:20.503305Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:20.503310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:20.503311Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:20.503312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:20.503316Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:20.503451Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:20.524760Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602434275616696:11816]
2025-10-10T14:38:20.525125Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 pipe creation result: OK TabletId: 72075186224037892 Generation: 2630, pipe: [1:7559602434275616696:11816]
2025-10-10T14:38:20.622272Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:20.630921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:20.630958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:20.631149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:20.631217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:20.631285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:20.631359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:20.632015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:20.632032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:20.632104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:20.632170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:20.632236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:20.632304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:20.632350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:20.632357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:20.632439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:20.632521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:20.632595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:20.632660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:20.632707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:20.632715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:20.632788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:20.632856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:20.632924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:20.632993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:20.633040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:20.633048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:20.633115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:20.633181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:20.633261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:20.635265Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 29 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602434275616696:11816]
2025-10-10T14:38:20.635294Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:20.635308Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:20.635312Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:20.635346Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2631 reason: error at write: Disconnected sessionId: src_id|864dbb22-800e732e-930648da-f7bef513_0
2025-10-10T14:38:20.635581Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2631 sessionId: src_id|864dbb22-800e732e-930648da-f7bef513_0 is DEAD
2025-10-10T14:38:20.635971Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|864dbb22-800e732e-930648da-f7bef513_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:20.635983Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|864dbb22-800e732e-930648da-f7bef513_0] Write session will restart in 0.006557s
2025-10-10T14:38:20.636007Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|864dbb22-800e732e-930648da-f7bef513_0] Write session: Do CDS request
2025-10-10T14:38:20.636015Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|864dbb22-800e732e-930648da-f7bef513_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:20.633327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:20.633459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:20.633463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:20.633530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:20.633589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:20.633666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:20.633729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:20.633773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:20.633776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:20.633846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:20.633904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:20.633967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:20.634026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:20.634067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:20.634070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:20.634140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:20.634216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:20.634278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:20.634338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:20.634384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:20.634387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:20.634461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:20.634517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:20.634575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:20.634633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:20.634675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:20.634678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:20.634745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:20.634804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:20.634865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:20.634937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:20.634980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:20.634982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:20.635055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602434275616696:11816], now have 1 active actors on pipe
2025-10-10T14:38:20.635774Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:20.644022Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|864dbb22-800e732e-930648da-f7bef513_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:20.644092Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:20.644111Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2632
2025-10-10T14:38:20.644288Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2632 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:20.644335Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2632 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:20.644344Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2632 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:20.644349Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:20.644852Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2632 sessionId:  describe result for acl check
2025-10-10T14:38:20.644889Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:20.644903Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:20.644905Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:20.644912Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602434275616732:11991] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:20.645528Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602434275616732:11991] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:20.648313Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602434275616732:11991] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:20.653067Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602434275616732:11991] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:20.653087Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602434275616732:11991] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:20.653093Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602434275616732:11991] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:20.653106Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2632 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:20.656101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:20.658863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:20.659148Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:20.659161Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:20.659173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:20.659230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:20.659274Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602433493380362:11958]
2025-10-10T14:38:20.659831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:20.660180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:20.660227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:20.660552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:20.660617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:20.660623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:20.660625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:20.660626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:20.660627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:20.660629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:20.660630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:20.660632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:20.660633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:20.660635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:20.660636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:20.660637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:20.660639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:20.660646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:20.660658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:20.660662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:20.660666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:20.660670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:20.660674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:20.660679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:20.660682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:20.660686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:20.660691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:20.660695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:20.660699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:20.660703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:20.660712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:20.660720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:20.660726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:20.660732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:20.660736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:20.660741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:20.660746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:20.660752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:20.660757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:20.660763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:20.660767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:20.660773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:20.660778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:20.660784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:20.660793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:20.660798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:20.660803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:20.660813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:20.660818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:20.660823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:20.660833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:20.660838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:20.660843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:20.660848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:20.660857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:20.660862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:20.660902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:20.663640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:20.664369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:20.664386Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:20.664388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:20.664393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:20.664400Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2631 [2:7559602433493380362:11958]
2025-10-10T14:38:20.664416Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:20.664437Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:20.664445Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:20.664449Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:20.664452Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:20.664473Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:20.664486Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:20.664494Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:20.664568Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:20.664579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:20.664581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:20.664584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:20.664664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:20.664674Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:20.664687Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:20.664700Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:20.664718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:20.664745Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602433493380357:11958]
2025-10-10T14:38:20.664756Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602433493380357:11958]
2025-10-10T14:38:20.664758Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602433493380357:11958]
2025-10-10T14:38:20.664775Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:20.664791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602434275616914:11991], now have 1 active actors on pipe
2025-10-10T14:38:20.664800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602434275616698:2438], now have 1 active actors on pipe
2025-10-10T14:38:20.664810Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:20.664830Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:20.664839Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:20.664848Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:20.664855Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:20.664874Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:20.664880Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602433493380357:11958]
2025-10-10T14:38:20.664883Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:20.664884Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:20.664851Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2631
2025-10-10T14:38:20.664857Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2631
2025-10-10T14:38:20.664915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:20.664926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:20.664965Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a2a70d58-7c527bd1-c0fa5349-b10bda43_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:20.664978Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:20.664983Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:20.664990Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:20.665002Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:20.665014Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:20.665042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:20.665181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:20.665188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:20.665203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:20.665291Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2632 partition: 0 MaxSeqNo: 40 sessionId: src_id|a2a70d58-7c527bd1-c0fa5349-b10bda43_0
2025-10-10T14:38:20.665742Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|864dbb22-800e732e-930648da-f7bef513_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|a2a70d58-7c527bd1-c0fa5349-b10bda43_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:20.668672Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a2a70d58-7c527bd1-c0fa5349-b10bda43_0] Write session: try to update token
2025-10-10T14:38:20.668697Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a2a70d58-7c527bd1-c0fa5349-b10bda43_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:20.685490Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:20.685515Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:20.685519Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:20.685521Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:20.685533Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602433493380357:11958]
2025-10-10T14:38:20.685538Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602433493380357:11958]
2025-10-10T14:38:20.685543Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602433493380357:11958]
2025-10-10T14:38:20.685598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:20.685601Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:20.685609Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:20.685611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:20.685613Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:20.685614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:20.685775Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:20.688956Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2632 sessionId: src_id|a2a70d58-7c527bd1-c0fa5349-b10bda43_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:20.692086Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:20.735685Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602434275616949:11816]
2025-10-10T14:38:20.736005Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 pipe creation result: OK TabletId: 72075186224037892 Generation: 2631, pipe: [1:7559602434275616949:11816]
2025-10-10T14:38:20.804274Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:20.804694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:20.804802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:20.804846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602434275616949:11816], now have 1 active actors on pipe
2025-10-10T14:38:20.805213Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 30 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602434275616949:11816]
2025-10-10T14:38:20.805257Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:20.805260Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:20.805322Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2632 reason: error at write: Disconnected sessionId: src_id|a2a70d58-7c527bd1-c0fa5349-b10bda43_0
2025-10-10T14:38:20.805531Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2632 sessionId: src_id|a2a70d58-7c527bd1-c0fa5349-b10bda43_0 is DEAD
2025-10-10T14:38:20.805694Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2a70d58-7c527bd1-c0fa5349-b10bda43_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:20.805705Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2a70d58-7c527bd1-c0fa5349-b10bda43_0] Write session will restart in 0.009944s
2025-10-10T14:38:20.805710Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:20.805745Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2a70d58-7c527bd1-c0fa5349-b10bda43_0] Write session: Do CDS request
2025-10-10T14:38:20.805752Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2a70d58-7c527bd1-c0fa5349-b10bda43_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:20.809507Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:20.816942Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a2a70d58-7c527bd1-c0fa5349-b10bda43_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:20.817037Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:20.817052Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2633
2025-10-10T14:38:20.817255Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2633 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:20.817291Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2633 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:20.817297Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2633 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:20.817302Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:20.817792Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2633 sessionId:  describe result for acl check
2025-10-10T14:38:20.817829Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:20.817831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:20.817832Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:20.817839Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602434275617028:11996] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:20.818403Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602434275617028:11996] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:20.823372Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602434275617028:11996] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:20.828585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:20.829231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:20.826511Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602434275617028:11996] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:20.826529Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602434275617028:11996] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:20.826532Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602434275617028:11996] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:20.826541Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2633 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:20.829431Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:20.829446Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:20.829458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:20.829518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:20.829557Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602433493380583:11960]
2025-10-10T14:38:20.830200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:20.830562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:20.830610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:20.830923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:20.830998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:20.831007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:20.831009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:20.831010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:20.831011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:20.831012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:20.831014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:20.831015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:20.831017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:20.831018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:20.831019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:20.831021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:20.831022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:20.831028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:20.831042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:20.831046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:20.831051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:20.831055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:20.831060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:20.831064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:20.831068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:20.831072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:20.831077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:20.831082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:20.831086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:20.831090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:20.831100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:20.831108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:20.831115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:20.831121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:20.831132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:20.831137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:20.831147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:20.831152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:20.831157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:20.831168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:20.831172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:20.831184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:20.831188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:20.831194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:20.831199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:20.831204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:20.831208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:20.831220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:20.831225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:20.831230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:20.831239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:20.831245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:20.831254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:20.831259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:20.831268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:20.831274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:20.831321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:20.833811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:20.834487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:20.834499Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:20.834501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:20.834505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:20.834511Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2632 [2:7559602433493380583:11960]
2025-10-10T14:38:20.834524Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:20.834542Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:20.834545Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:20.834549Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:20.834553Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:20.834572Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:20.834579Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:20.834601Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:20.834661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:20.834668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:20.834670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:20.834673Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:20.834742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:20.834751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:20.834764Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:20.834776Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:20.834793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:20.834820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602434275617196:11996], now have 1 active actors on pipe
2025-10-10T14:38:20.834824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602434275616955:2438], now have 1 active actors on pipe
2025-10-10T14:38:20.834831Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602433493380578:11960]
2025-10-10T14:38:20.834833Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602433493380578:11960]
2025-10-10T14:38:20.834835Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602433493380578:11960]
2025-10-10T14:38:20.834848Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:20.834862Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:20.834863Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:20.834868Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:20.834871Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:20.834876Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:20.834879Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:20.834905Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2632
2025-10-10T14:38:20.834905Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602433493380578:11960]
2025-10-10T14:38:20.834917Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2632
2025-10-10T14:38:20.834918Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:20.834932Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:20.834949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:20.834954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:20.834988Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2ed53364-a3334fa1-653cef0c-877557d5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:20.835003Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:20.835007Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:20.835010Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:20.835022Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:20.835033Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:20.835055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:20.835338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:20.835351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:20.835374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:20.835467Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2633 partition: 0 MaxSeqNo: 40 sessionId: src_id|2ed53364-a3334fa1-653cef0c-877557d5_0
2025-10-10T14:38:20.835865Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2a70d58-7c527bd1-c0fa5349-b10bda43_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|2ed53364-a3334fa1-653cef0c-877557d5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:20.838766Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2ed53364-a3334fa1-653cef0c-877557d5_0] Write session: try to update token
2025-10-10T14:38:20.838787Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2ed53364-a3334fa1-653cef0c-877557d5_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:20.849221Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:38:20.849243Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:20.849254Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602433493380578:11960]
2025-10-10T14:38:20.849302Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:38:20.849502Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:38:20.849638Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:20.849768Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:20.849898Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:20.850286Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:38:20.850327Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:38:20.850592Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:38:20.857631Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2633 sessionId: src_id|2ed53364-a3334fa1-653cef0c-877557d5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:20.860417Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:20.860676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:20.860701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:20.860743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:38:20.860932Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:38:20.871633Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:20.871660Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:20.871664Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:20.871667Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:20.871679Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602433493380578:11960]
2025-10-10T14:38:20.871683Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602433493380578:11960]
2025-10-10T14:38:20.871688Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602433493380578:11960]
2025-10-10T14:38:20.871739Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:20.871747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:20.871750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:20.871756Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:20.871768Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:20.871773Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:20.871889Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:20.905686Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602434275617211:11816]
2025-10-10T14:38:20.906034Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 pipe creation result: OK TabletId: 72075186224037892 Generation: 2632, pipe: [1:7559602434275617211:11816]
2025-10-10T14:38:20.993666Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:21.001736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:21.001765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:21.001926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:21.001978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:21.002032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:21.002086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:21.002132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:21.002137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:21.002240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:21.002302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:21.002375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:21.002453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:21.002493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:21.002496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:21.002576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:21.002641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:21.002704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:21.002772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:21.002813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:21.002816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:21.002890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:21.002952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:21.003010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:21.003064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:21.003099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:21.003101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:21.003163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:21.003221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:21.003279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:21.003334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:21.003389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:21.003391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:21.003459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:21.003508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:21.003561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:21.003614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:21.003651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:21.003653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:21.003720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:21.003776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:21.003834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:21.003897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:21.003940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:21.003946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:21.004017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:21.004067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:21.004118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:21.004170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:21.004217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:21.004220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:21.004286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:21.004336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:21.004390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:21.004447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:21.004493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:21.004495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:21.004564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:21.004620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:21.004673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:21.004729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:21.004791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:21.004793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:21.004865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602434275617211:11816], now have 1 active actors on pipe
2025-10-10T14:38:21.005969Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ed53364-a3334fa1-653cef0c-877557d5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:21.005989Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ed53364-a3334fa1-653cef0c-877557d5_0] Write session will restart in 0.008697s
2025-10-10T14:38:21.005519Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:21.005573Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:21.006016Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ed53364-a3334fa1-653cef0c-877557d5_0] Write session: Do CDS request
2025-10-10T14:38:21.005576Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:21.006022Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ed53364-a3334fa1-653cef0c-877557d5_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:21.005608Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2633 reason: error at write: Disconnected sessionId: src_id|2ed53364-a3334fa1-653cef0c-877557d5_0
2025-10-10T14:38:21.005988Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2633 sessionId: src_id|2ed53364-a3334fa1-653cef0c-877557d5_0 is DEAD
2025-10-10T14:38:21.006181Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 31 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602434275617211:11816]
2025-10-10T14:38:21.006565Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:21.017812Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2ed53364-a3334fa1-653cef0c-877557d5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:21.018204Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:21.018224Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2634
2025-10-10T14:38:21.018337Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2634 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:21.018366Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2634 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:21.018370Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2634 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:21.018375Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:21.019378Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2634 sessionId:  describe result for acl check
2025-10-10T14:38:21.019419Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:21.019421Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:21.019423Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:21.019429Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602438570584541:12006] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:21.020024Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602438570584541:12006] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:21.024498Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602438570584541:12006] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:21.028300Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602438570584541:12006] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:21.028316Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602438570584541:12006] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:21.028320Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602438570584541:12006] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:21.028328Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2634 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:21.032208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:21.034441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:21.034665Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:21.034680Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:21.034693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:21.034754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:21.034800Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602437788348140:11968]
2025-10-10T14:38:21.035436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:21.035771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:21.035821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:21.036152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:21.036220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:21.036232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:21.036234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:21.036235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:21.036236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:21.036237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:21.036239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:21.036240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:21.036241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:21.036243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:21.036244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:21.036245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:21.036246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:21.036252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:21.036267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:21.036272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:21.036276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:21.036281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:21.036285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:21.036288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:21.036292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:21.036296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:21.036301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:21.036305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:21.036309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:21.036313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:21.036322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:21.036331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:21.036337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:21.036343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:21.036348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:21.036354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:21.036359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:21.036364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:21.036369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:21.036375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:21.036379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:21.036385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:21.036390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:21.036396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:21.036401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:21.036406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:21.036411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:21.036417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:21.036422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:21.036428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:21.036438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:21.036444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:21.036455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:21.036461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:21.036473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:21.036478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:21.036520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:21.039027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:21.039665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:21.039684Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:21.039687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:21.039691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:21.039697Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2633 [2:7559602437788348140:11968]
2025-10-10T14:38:21.039710Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:21.039727Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:21.039730Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:21.039734Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:21.039737Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:21.039755Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:21.039762Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:21.039770Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:21.039827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:21.039835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:21.039837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:21.039840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:21.039913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:21.039922Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:21.039934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:21.039945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:21.039963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:21.039988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602438570584525:2438], now have 1 active actors on pipe
2025-10-10T14:38:21.039996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602438570584712:12006], now have 1 active actors on pipe
2025-10-10T14:38:21.040005Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602437788348135:11968]
2025-10-10T14:38:21.040008Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602437788348135:11968]
2025-10-10T14:38:21.040010Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602437788348135:11968]
2025-10-10T14:38:21.040024Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:21.040017Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2633
2025-10-10T14:38:21.040017Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2633
2025-10-10T14:38:21.040041Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:21.040046Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:21.040064Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:21.040066Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:21.040066Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:21.040070Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:21.040108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:21.040116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:21.040131Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602437788348135:11968]
2025-10-10T14:38:21.040144Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:21.040154Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:21.040180Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4695c31f-862e93c5-13c755e0-fe3d10d2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:21.040188Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:21.040193Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:21.040196Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:21.040208Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:21.040219Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:21.040239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:21.040445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:21.040459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:21.040482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:21.040565Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2634 partition: 0 MaxSeqNo: 40 sessionId: src_id|4695c31f-862e93c5-13c755e0-fe3d10d2_0
2025-10-10T14:38:21.040962Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ed53364-a3334fa1-653cef0c-877557d5_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|4695c31f-862e93c5-13c755e0-fe3d10d2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:21.043864Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4695c31f-862e93c5-13c755e0-fe3d10d2_0] Write session: try to update token
2025-10-10T14:38:21.043882Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4695c31f-862e93c5-13c755e0-fe3d10d2_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:21.058280Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2634 sessionId: src_id|4695c31f-862e93c5-13c755e0-fe3d10d2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:21.059664Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:21.059691Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:21.059694Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:21.059696Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:21.059706Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602437788348135:11968]
2025-10-10T14:38:21.059712Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602437788348135:11968]
2025-10-10T14:38:21.059717Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602437788348135:11968]
2025-10-10T14:38:21.059768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:21.059780Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:21.059787Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:21.059791Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:21.059792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:21.059794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:21.059941Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:21.061011Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:21.105889Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602438570584785:11816]
2025-10-10T14:38:21.106282Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 pipe creation result: OK TabletId: 72075186224037892 Generation: 2633, pipe: [1:7559602438570584785:11816]
2025-10-10T14:38:21.181573Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:21.182239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:21.182252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:21.182304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602438570584785:11816], now have 1 active actors on pipe
2025-10-10T14:38:21.182578Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:21.182609Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 32 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602438570584785:11816]
2025-10-10T14:38:21.182616Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:21.182669Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:38:21.182765Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2634 reason: status is not ok: tablet will be restarted right now sessionId: src_id|4695c31f-862e93c5-13c755e0-fe3d10d2_0
2025-10-10T14:38:21.182973Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2634 sessionId: src_id|4695c31f-862e93c5-13c755e0-fe3d10d2_0 is DEAD
2025-10-10T14:38:21.183154Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4695c31f-862e93c5-13c755e0-fe3d10d2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:38:21.183167Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4695c31f-862e93c5-13c755e0-fe3d10d2_0] Write session will restart in 0.008411s
2025-10-10T14:38:21.183194Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4695c31f-862e93c5-13c755e0-fe3d10d2_0] Write session: Do CDS request
2025-10-10T14:38:21.183201Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4695c31f-862e93c5-13c755e0-fe3d10d2_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:21.192912Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4695c31f-862e93c5-13c755e0-fe3d10d2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:21.193483Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:21.193499Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2635
2025-10-10T14:38:21.193654Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2635 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:21.193696Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2635 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:21.193701Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2635 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:21.193706Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:21.194253Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2635 sessionId:  describe result for acl check
2025-10-10T14:38:21.194287Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:21.194290Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:21.194292Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:21.194299Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602438570584888:12013] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:21.194906Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602438570584888:12013] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:21.198014Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602438570584888:12013] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:21.200354Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602438570584888:12013] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:21.200368Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602438570584888:12013] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:21.200370Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602438570584888:12013] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:21.200377Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2635 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:21.201460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:21.203644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:21.203893Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:21.203903Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:21.203913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:21.203957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:21.203993Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602437788348366:11978]
2025-10-10T14:38:21.204573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:21.204883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:21.204944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:21.205279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:21.205356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:21.205364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:21.205365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:21.205366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:21.205367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:21.205368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:21.205369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:21.205371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:21.205372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:21.205373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:21.205375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:21.205376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:21.205377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:21.205387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:21.205400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:21.205405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:21.205409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:21.205413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:21.205417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:21.205422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:21.205426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:21.205430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:21.205436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:21.205440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:21.205444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:21.205447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:21.205455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:21.205463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:21.205470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:21.205476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:21.205480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:21.205486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:21.205491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:21.205496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:21.205502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:21.205507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:21.205511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:21.205516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:21.205521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:21.205526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:21.205531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:21.205536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:21.205547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:21.205552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:21.205558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:21.205566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:21.205572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:21.205577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:21.205585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:21.205591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:21.205596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:21.205605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:21.205649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:21.208233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:21.208685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:21.208690Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:21.208694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:21.208698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:21.208705Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2634 [2:7559602437788348366:11978]
2025-10-10T14:38:21.208719Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:21.208737Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:21.208741Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:21.208745Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:21.208748Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:21.208766Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:21.208774Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:21.208784Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:21.208851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:21.208853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:21.208855Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:21.208858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:21.208934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:21.208937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:21.208950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:21.208961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:21.208980Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:21.209001Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602437788348361:11978]
2025-10-10T14:38:21.209004Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602437788348361:11978]
2025-10-10T14:38:21.209222Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2634
2025-10-10T14:38:21.209006Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602437788348361:11978]
2025-10-10T14:38:21.209023Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:21.209038Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:21.209055Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:21.209059Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:21.209090Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602437788348361:11978]
2025-10-10T14:38:21.209093Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:21.209114Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:21.209118Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:21.209120Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:21.209123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602438570584788:2438], now have 1 active actors on pipe
2025-10-10T14:38:21.209127Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:21.209312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602438570585031:12013], now have 1 active actors on pipe
2025-10-10T14:38:21.209379Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2634
2025-10-10T14:38:21.209446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:21.209457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:21.209490Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cff15af3-eab7f022-9e3495d-67d67b27_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:21.209514Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:21.209518Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:21.209521Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:21.209536Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:21.209553Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:21.209574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:21.209738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:21.209746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:21.209777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:21.209867Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2635 partition: 0 MaxSeqNo: 40 sessionId: src_id|cff15af3-eab7f022-9e3495d-67d67b27_0
2025-10-10T14:38:21.210987Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4695c31f-862e93c5-13c755e0-fe3d10d2_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|cff15af3-eab7f022-9e3495d-67d67b27_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:21.213873Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cff15af3-eab7f022-9e3495d-67d67b27_0] Write session: try to update token
2025-10-10T14:38:21.213894Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cff15af3-eab7f022-9e3495d-67d67b27_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:21.229352Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2635 sessionId: src_id|cff15af3-eab7f022-9e3495d-67d67b27_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:21.230587Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:21.230605Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:21.230610Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:21.230613Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:21.230622Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602437788348361:11978]
2025-10-10T14:38:21.230628Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602437788348361:11978]
2025-10-10T14:38:21.230633Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602437788348361:11978]
2025-10-10T14:38:21.230687Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:21.230696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:21.230705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:21.230847Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:21.230896Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:21.230913Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:21.230918Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:21.232247Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:21.285409Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602438570585045:11816]
2025-10-10T14:38:21.285944Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 pipe creation result: OK TabletId: 72075186224037892 Generation: 2634, pipe: [1:7559602438570585045:11816]
2025-10-10T14:38:21.355153Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:21.355578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:21.355598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:21.355643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602438570585045:11816], now have 1 active actors on pipe
2025-10-10T14:38:21.355956Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 33 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602438570585045:11816]
2025-10-10T14:38:21.355985Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:21.356022Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:38:21.356117Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2635 reason: status is not ok: tablet will be restarted right now sessionId: src_id|cff15af3-eab7f022-9e3495d-67d67b27_0
2025-10-10T14:38:21.356258Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2635 sessionId: src_id|cff15af3-eab7f022-9e3495d-67d67b27_0 is DEAD
2025-10-10T14:38:21.355960Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:21.356459Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cff15af3-eab7f022-9e3495d-67d67b27_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:38:21.356471Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cff15af3-eab7f022-9e3495d-67d67b27_0] Write session will restart in 0.008131s
2025-10-10T14:38:21.356498Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cff15af3-eab7f022-9e3495d-67d67b27_0] Write session: Do CDS request
2025-10-10T14:38:21.356504Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cff15af3-eab7f022-9e3495d-67d67b27_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:21.366291Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cff15af3-eab7f022-9e3495d-67d67b27_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:21.366853Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:21.366877Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2636
2025-10-10T14:38:21.367130Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2636 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:21.367163Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2636 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:21.367169Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2636 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:21.367173Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:21.367586Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2636 sessionId:  describe result for acl check
2025-10-10T14:38:21.367613Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:21.367614Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:21.367616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:21.367621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602438570585084:12019] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:21.368190Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602438570585084:12019] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:21.372140Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602438570585084:12019] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:21.376895Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602438570585084:12019] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:21.376921Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602438570585084:12019] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:21.376925Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602438570585084:12019] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:21.376936Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2636 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:21.386866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:21.389486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:21.389729Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:21.389734Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:21.389747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:21.389801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:21.389871Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602437788348603:11980]
2025-10-10T14:38:21.390529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:21.390914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:21.390962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:21.391277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:21.391348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:21.391349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:21.391351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:21.391351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:21.391352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:21.391353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:21.391355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:21.391356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:21.391357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:21.391359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:21.391360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:21.391361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:21.391362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:21.391369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:21.391385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:21.391388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:21.391393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:21.391397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:21.391401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:21.391405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:21.391408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:21.391411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:21.391415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:21.391418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:21.391422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:21.391425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:21.391434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:21.391443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:21.391450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:21.391455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:21.391459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:21.391465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:21.391469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:21.391474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:21.391480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:21.391485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:21.391489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:21.391494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:21.391499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:21.391503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:21.391508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:21.391514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:21.391519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:21.391524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:21.391528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:21.391534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:21.391538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:21.391544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:21.391551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:21.391556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:21.391562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:21.391567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:21.391611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:21.394711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:21.395049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:21.395054Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:21.395057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:21.395062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:21.395069Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2635 [2:7559602437788348603:11980]
2025-10-10T14:38:21.395085Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:21.395104Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:21.395107Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:21.395111Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:21.395114Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:21.395133Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:21.395141Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:21.395149Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:21.395217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:21.395219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:21.395222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:21.395224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:21.395296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:21.395299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:21.395310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:21.395321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:21.395337Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:21.395358Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602437788348598:11980]
2025-10-10T14:38:21.395363Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602437788348598:11980]
2025-10-10T14:38:21.395365Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602437788348598:11980]
2025-10-10T14:38:21.395385Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:21.395402Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:21.395418Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:21.395421Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:21.395428Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:21.395432Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:21.395434Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:21.395453Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602437788348598:11980]
2025-10-10T14:38:21.395456Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:21.395519Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:21.395688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602438570585049:2438], now have 1 active actors on pipe
2025-10-10T14:38:21.395696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602438570585214:12019], now have 1 active actors on pipe
2025-10-10T14:38:21.395946Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2635
2025-10-10T14:38:21.395995Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2635
2025-10-10T14:38:21.396315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:21.396327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:21.396361Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c917cca9-b070b9cd-1ca70d27-b0a73d07_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:21.396371Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:21.396376Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:21.396378Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:21.396392Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:21.396406Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:21.396421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:21.399812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:21.399829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:21.399864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:21.400099Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2636 partition: 0 MaxSeqNo: 40 sessionId: src_id|c917cca9-b070b9cd-1ca70d27-b0a73d07_0
2025-10-10T14:38:21.400619Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cff15af3-eab7f022-9e3495d-67d67b27_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|c917cca9-b070b9cd-1ca70d27-b0a73d07_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:21.403537Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c917cca9-b070b9cd-1ca70d27-b0a73d07_0] Write session: try to update token
2025-10-10T14:38:21.403562Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c917cca9-b070b9cd-1ca70d27-b0a73d07_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:21.419589Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:38:21.419606Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:21.419617Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602437788348598:11980]
2025-10-10T14:38:21.419662Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:38:21.419674Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:38:21.419867Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:38:21.420014Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:21.420156Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:21.420295Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:21.420547Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:38:21.420585Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:38:21.431151Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2636 sessionId: src_id|c917cca9-b070b9cd-1ca70d27-b0a73d07_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:21.434114Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:21.435549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:21.435573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:21.435620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:38:21.437273Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:38:21.444570Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:21.444593Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:21.444597Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:21.444599Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:21.444611Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602437788348598:11980]
2025-10-10T14:38:21.444616Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602437788348598:11980]
2025-10-10T14:38:21.444621Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602437788348598:11980]
2025-10-10T14:38:21.444673Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:21.444685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:21.444685Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:21.444688Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:21.444693Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:21.444698Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:21.444841Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:21.456097Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602438570585317:11816]
2025-10-10T14:38:21.457538Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 pipe creation result: OK TabletId: 72075186224037892 Generation: 2635, pipe: [1:7559602438570585317:11816]
2025-10-10T14:38:21.567999Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:21.568495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602438570585317:11816], now have 1 active actors on pipe
2025-10-10T14:38:21.576922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:21.576957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:21.577154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:21.577225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:21.577292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:21.577376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:21.577424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:21.577435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:21.577510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:21.577578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:21.577645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:21.577715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:21.580522Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 34 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602438570585317:11816]
2025-10-10T14:38:21.580532Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:21.580565Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:21.580568Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:21.580609Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2636 reason: error at write: Disconnected sessionId: src_id|c917cca9-b070b9cd-1ca70d27-b0a73d07_0
2025-10-10T14:38:21.580964Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c917cca9-b070b9cd-1ca70d27-b0a73d07_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:21.580973Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c917cca9-b070b9cd-1ca70d27-b0a73d07_0] Write session will restart in 0.009351s
2025-10-10T14:38:21.580997Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c917cca9-b070b9cd-1ca70d27-b0a73d07_0] Write session: Do CDS request
2025-10-10T14:38:21.581002Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c917cca9-b070b9cd-1ca70d27-b0a73d07_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:21.580837Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2636 sessionId: src_id|c917cca9-b070b9cd-1ca70d27-b0a73d07_0 is DEAD
2025-10-10T14:38:21.577763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:21.577776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:21.577842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:21.577899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:21.577960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:21.578025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:21.578065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:21.578068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:21.578137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:21.578207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:21.578268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:21.578328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:21.578370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:21.578373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:21.578442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:21.578500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:21.578560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:21.578621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:21.578690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:21.578694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:21.578766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:21.578826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:21.578885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:21.578946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:21.578988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:21.578992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:21.579084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:21.579142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:21.579207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:21.579268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:21.579328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:21.579331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:21.579403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:21.579458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:21.579516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:21.579576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:21.579617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:21.579620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:21.579688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:21.579745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:21.579804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:21.579863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:21.579904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:21.579907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:21.579974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:21.580029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:21.580088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:21.580146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:21.580187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:21.580191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:21.581853Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:21.591941Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c917cca9-b070b9cd-1ca70d27-b0a73d07_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:21.592024Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:21.592041Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2637
2025-10-10T14:38:21.593825Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2637 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:21.593878Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2637 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:21.593884Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2637 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:21.593889Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:21.594686Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2637 sessionId:  describe result for acl check
2025-10-10T14:38:21.594723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:21.594725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:21.594727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:21.594733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602438570585373:12024] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:21.595312Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602438570585373:12024] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:21.598139Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602438570585373:12024] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:21.602644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602438570585373:12024] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:21.602663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602438570585373:12024] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:21.602667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602438570585373:12024] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:21.602676Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2637 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:21.606660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:21.609133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:21.609396Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:21.609407Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:21.609419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:21.609495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:21.609539Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602437788348829:11983]
2025-10-10T14:38:21.610203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:21.610531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:21.610585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:21.610948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:21.611021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:21.611030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:21.611032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:21.611033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:21.611034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:21.611035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:21.611036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:21.611037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:21.611038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:21.611039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:21.611041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:21.611042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:21.611043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:21.611049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:21.611063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:21.611067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:21.611071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:21.611075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:21.611080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:21.611084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:21.611088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:21.611092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:21.611096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:21.611100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:21.611104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:21.611108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:21.611118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:21.611127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:21.611134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:21.611140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:21.611145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:21.611150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:21.611155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:21.611160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:21.611166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:21.611171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:21.611176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:21.611181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:21.611186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:21.611191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:21.611196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:21.611201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:21.611208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:21.611214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:21.611219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:21.611224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:21.611229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:21.611234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:21.611239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:21.611244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:21.611256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:21.611262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:21.611305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:21.614018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:21.614624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:21.614636Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:21.614638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:21.614641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:21.614646Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2636 [2:7559602437788348829:11983]
2025-10-10T14:38:21.614657Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:21.614673Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:21.614675Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:21.614678Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:21.614680Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:21.614697Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:21.614705Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:21.614713Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:21.614781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:21.614789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:21.614792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:21.614794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:21.614866Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:21.614876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:21.614889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:21.614900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:21.614915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:21.614939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602438570585321:2438], now have 1 active actors on pipe
2025-10-10T14:38:21.614942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602438570585523:12024], now have 1 active actors on pipe
2025-10-10T14:38:21.614951Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602437788348824:11983]
2025-10-10T14:38:21.614954Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602437788348824:11983]
2025-10-10T14:38:21.614955Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602437788348824:11983]
2025-10-10T14:38:21.614969Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:21.614985Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:21.614989Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:21.614994Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:21.614997Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:21.615004Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:21.615007Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:21.615034Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602437788348824:11983]
2025-10-10T14:38:21.615043Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:21.615048Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:21.615189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:21.615201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:21.615233Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|250c6b08-b95824a9-acc5293c-264642ff_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:21.615247Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:21.615256Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:21.615258Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:21.615271Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:21.615286Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:21.615305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:21.615478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:21.615488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:21.615506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:21.616099Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c917cca9-b070b9cd-1ca70d27-b0a73d07_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|250c6b08-b95824a9-acc5293c-264642ff_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:21.614986Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2636
2025-10-10T14:38:21.615002Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2636
2025-10-10T14:38:21.615681Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2637 partition: 0 MaxSeqNo: 40 sessionId: src_id|250c6b08-b95824a9-acc5293c-264642ff_0
2025-10-10T14:38:21.619084Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|250c6b08-b95824a9-acc5293c-264642ff_0] Write session: try to update token
2025-10-10T14:38:21.619105Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|250c6b08-b95824a9-acc5293c-264642ff_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:21.629201Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:38:21.629223Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:21.629239Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602437788348824:11983]
2025-10-10T14:38:21.629297Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:38:21.629309Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:38:21.629594Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:38:21.629760Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:21.629916Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:21.630064Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:21.630295Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:38:21.630350Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:38:21.634983Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2637 sessionId: src_id|250c6b08-b95824a9-acc5293c-264642ff_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:21.637772Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:21.638021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:21.638041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:21.638084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:38:21.638217Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:38:21.648618Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:21.648642Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:21.648645Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:21.648647Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:21.648660Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602437788348824:11983]
2025-10-10T14:38:21.648665Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602437788348824:11983]
2025-10-10T14:38:21.648670Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602437788348824:11983]
2025-10-10T14:38:21.648726Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:21.648733Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:21.648740Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:21.648741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:21.648744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:21.648745Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:21.648882Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:21.680872Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602438570585576:11816]
2025-10-10T14:38:21.681730Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 pipe creation result: OK TabletId: 72075186224037892 Generation: 2636, pipe: [1:7559602438570585576:11816]
2025-10-10T14:38:21.772420Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:21.782077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:21.782106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:21.782308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:21.782381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:21.782457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:21.782535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:21.783050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:21.783071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:21.783149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:21.783217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:21.783287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:21.783365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:21.783411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:21.783422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:21.783502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:21.783573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:21.783639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:21.783714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:21.783764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:21.783772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:21.783854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:21.783935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:21.784005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:21.784074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:21.784121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:21.784129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:21.784200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:21.784272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:21.784347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:21.784422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:21.784473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:21.784481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:21.784554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:21.784621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:21.784692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:21.784763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:21.784810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:21.784817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:21.784886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:21.784952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:21.785068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:21.785138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:21.785184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:21.785190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:21.785258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:21.785325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:21.785409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:21.785471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:21.786995Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|250c6b08-b95824a9-acc5293c-264642ff_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:21.787009Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|250c6b08-b95824a9-acc5293c-264642ff_0] Write session will restart in 0.009405s
2025-10-10T14:38:21.787036Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|250c6b08-b95824a9-acc5293c-264642ff_0] Write session: Do CDS request
2025-10-10T14:38:21.786470Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:21.786531Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 35 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602438570585576:11816]
2025-10-10T14:38:21.786567Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:21.786569Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:21.786608Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2637 reason: error at write: Disconnected sessionId: src_id|250c6b08-b95824a9-acc5293c-264642ff_0
2025-10-10T14:38:21.786823Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2637 sessionId: src_id|250c6b08-b95824a9-acc5293c-264642ff_0 is DEAD
2025-10-10T14:38:21.787050Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|250c6b08-b95824a9-acc5293c-264642ff_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:21.785521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:21.785532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:21.785605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:21.785664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:21.785726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:21.785788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:21.785831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:21.785834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:21.785899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:21.785957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:21.786019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:21.786089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:21.786130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:21.786133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:21.786218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602438570585576:11816], now have 1 active actors on pipe
2025-10-10T14:38:21.786720Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:21.797858Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|250c6b08-b95824a9-acc5293c-264642ff_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:21.797978Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:21.798008Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2638
2025-10-10T14:38:21.798163Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2638 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:21.798213Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2638 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:21.798228Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2638 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:21.798231Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:21.799183Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2638 sessionId:  describe result for acl check
2025-10-10T14:38:21.799234Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:21.799242Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:21.799245Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:21.799252Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602438570585664:12029] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:21.799916Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602438570585664:12029] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:21.807360Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602438570585664:12029] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:21.811177Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602438570585664:12029] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:21.811195Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602438570585664:12029] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:21.811199Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602438570585664:12029] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:21.811209Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2638 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:21.814982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:21.817918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:21.818170Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:21.818183Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:21.818199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:21.818267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:21.818320Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602437788349057:11985]
2025-10-10T14:38:21.818980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:21.819334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:21.819387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:21.819717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:21.819794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:21.819802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:21.819803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:21.819805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:21.819806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:21.819808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:21.819809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:21.819811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:21.819812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:21.819813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:21.819815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:21.819816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:21.819817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:21.819824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:21.819838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:21.819842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:21.819847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:21.819851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:21.819856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:21.819861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:21.819865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:21.819869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:21.819874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:21.819878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:21.819883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:21.819888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:21.819899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:21.819909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:21.819915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:21.819921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:21.819926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:21.819931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:21.819935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:21.819941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:21.819946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:21.819952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:21.819957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:21.819964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:21.819969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:21.819975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:21.819979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:21.819985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:21.819990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:21.819996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:21.820002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:21.820018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:21.820023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:21.820028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:21.820033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:21.820039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:21.820044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:21.820050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:21.820093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:21.822821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:21.823382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:21.823396Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:21.823399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:21.823403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:21.823411Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2637 [2:7559602437788349057:11985]
2025-10-10T14:38:21.823426Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:21.823446Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:21.823450Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:21.823454Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:21.823456Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:21.823476Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:21.823489Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:21.823498Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:21.823563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:21.823570Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:21.823573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:21.823575Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:21.823651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:21.823659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:21.823673Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:21.823687Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:21.823706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:21.823728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602438570585792:12029], now have 1 active actors on pipe
2025-10-10T14:38:21.823737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602438570585581:2438], now have 1 active actors on pipe
2025-10-10T14:38:21.823745Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602437788349052:11985]
2025-10-10T14:38:21.823749Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602437788349052:11985]
2025-10-10T14:38:21.823751Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602437788349052:11985]
2025-10-10T14:38:21.823764Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:21.823840Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2637
2025-10-10T14:38:21.823904Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2637
2025-10-10T14:38:21.823779Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:21.823783Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:21.823798Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:21.823801Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:21.823802Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:21.823805Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:21.823834Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602437788349052:11985]
2025-10-10T14:38:21.823846Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:21.823860Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:21.823963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:21.823971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:21.824005Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6818abea-1640e422-b0bd9b9e-11244dfc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:21.824014Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:21.824019Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:21.824021Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:21.824034Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:21.824048Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:21.824064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:21.824346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:21.824356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:21.824377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:21.825541Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2638 partition: 0 MaxSeqNo: 40 sessionId: src_id|6818abea-1640e422-b0bd9b9e-11244dfc_0
2025-10-10T14:38:21.826058Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|250c6b08-b95824a9-acc5293c-264642ff_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|6818abea-1640e422-b0bd9b9e-11244dfc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:21.829100Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6818abea-1640e422-b0bd9b9e-11244dfc_0] Write session: try to update token
2025-10-10T14:38:21.829120Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6818abea-1640e422-b0bd9b9e-11244dfc_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:21.844690Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:21.844709Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:21.844713Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:21.844716Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:21.844727Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602437788349052:11985]
2025-10-10T14:38:21.844732Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602437788349052:11985]
2025-10-10T14:38:21.844739Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602437788349052:11985]
2025-10-10T14:38:21.844784Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:21.844790Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:21.844794Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:21.844799Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:21.844800Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:21.844802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:21.844962Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:21.846333Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2638 sessionId: src_id|6818abea-1640e422-b0bd9b9e-11244dfc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:21.849173Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:21.886677Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602438570585846:11816]
2025-10-10T14:38:21.887018Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 pipe creation result: OK TabletId: 72075186224037892 Generation: 2637, pipe: [1:7559602438570585846:11816]
2025-10-10T14:38:21.965656Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:21.966131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:21.966142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:21.966211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602438570585846:11816], now have 1 active actors on pipe
2025-10-10T14:38:21.966530Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:21.966916Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:21.966932Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:21.967000Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2638 reason: error at write: Disconnected sessionId: src_id|6818abea-1640e422-b0bd9b9e-11244dfc_0
2025-10-10T14:38:21.967202Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2638 sessionId: src_id|6818abea-1640e422-b0bd9b9e-11244dfc_0 is DEAD
2025-10-10T14:38:21.967348Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 36 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602438570585846:11816]
2025-10-10T14:38:21.967363Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:21.968934Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6818abea-1640e422-b0bd9b9e-11244dfc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:21.968949Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6818abea-1640e422-b0bd9b9e-11244dfc_0] Write session will restart in 0.005171s
2025-10-10T14:38:21.968977Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6818abea-1640e422-b0bd9b9e-11244dfc_0] Write session: Do CDS request
2025-10-10T14:38:21.968987Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6818abea-1640e422-b0bd9b9e-11244dfc_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:21.981253Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6818abea-1640e422-b0bd9b9e-11244dfc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:21.981674Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:21.981695Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2639
2025-10-10T14:38:21.981843Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2639 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:21.981882Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2639 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:21.981896Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2639 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:21.981905Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:21.985759Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2639 sessionId:  describe result for acl check
2025-10-10T14:38:21.985807Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:21.985809Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:21.985811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:21.985817Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602438570585939:12033] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:21.986416Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602438570585939:12033] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:21.996541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:21.999375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:21.999633Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:21.999644Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:21.999657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:21.999713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:21.999759Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602437788349283:11987]
2025-10-10T14:38:22.000402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:22.000725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:22.000763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:22.001081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:22.001137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:22.001143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:22.001145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:22.001146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:22.001147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:22.001149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:22.001150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:22.001151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:22.001153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:22.001154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:22.001155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:22.001156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:22.001158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:22.001163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:22.001177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:22.001181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:22.001185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:22.001189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:22.001193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:22.001197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:22.001201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:22.001205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:22.001210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:22.001214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:22.001218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:22.001222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:22.001230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:22.001239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:22.001245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:22.001251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:22.001256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:22.001261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:22.001266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:22.001272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:22.001277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:22.001282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:22.001286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:22.001292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:22.001297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:22.001302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:22.001307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:22.001312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:22.001318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:22.001323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:22.001327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:22.001348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:22.001358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:22.001364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:22.001369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:22.001374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:22.001380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:22.001390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:22.001434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:22.004381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:22.005181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:22.005193Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:22.005196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:22.005200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:22.005206Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2638 [2:7559602437788349283:11987]
2025-10-10T14:38:22.005219Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:22.005237Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:22.005240Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:22.005243Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:22.005246Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:22.005262Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:22.005273Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:22.005281Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:22.005363Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:22.005365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:22.005367Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:22.005369Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:22.005438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:22.005441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:22.005453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:22.005466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:22.005489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:22.005512Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602437788349277:11987]
2025-10-10T14:38:22.005519Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602437788349277:11987]
2025-10-10T14:38:22.005521Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602437788349277:11987]
2025-10-10T14:38:22.005536Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:22.005550Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:22.005568Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:22.005571Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:22.005596Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602437788349277:11987]
2025-10-10T14:38:22.005599Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:22.005704Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:22.005706Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:22.005708Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:22.005714Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:22.005982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602438570585850:2438], now have 1 active actors on pipe
2025-10-10T14:38:22.007510Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2638
2025-10-10T14:38:22.008604Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602438570585939:12033] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:22.026385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602442865553396:12033], now have 1 active actors on pipe
2025-10-10T14:38:22.026526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:22.026537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:22.026575Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a4cd044a-ccc81f41-9feb5c71-284493f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:22.026597Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:22.026604Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:22.026607Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:22.026623Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:22.026650Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:22.026679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:22.028844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:22.028864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:22.028886Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:22.028889Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:22.028893Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:22.028895Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:22.028905Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602437788349277:11987]
2025-10-10T14:38:22.028909Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602437788349277:11987]
2025-10-10T14:38:22.028913Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602437788349277:11987]
2025-10-10T14:38:22.028960Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:22.028966Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:22.028967Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:22.028971Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:22.028973Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:22.028976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:22.029110Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:22.025978Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602438570585939:12033] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:22.026000Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602438570585939:12033] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:22.026005Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602438570585939:12033] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:22.026014Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2639 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:22.026466Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2638
2025-10-10T14:38:22.066380Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602442865553413:11816]
2025-10-10T14:38:22.066712Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 pipe creation result: OK TabletId: 72075186224037892 Generation: 2638, pipe: [1:7559602442865553413:11816]
2025-10-10T14:38:22.156879Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:22.157194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:22.157455Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2639 partition: 0 MaxSeqNo: 40 sessionId: src_id|a4cd044a-ccc81f41-9feb5c71-284493f_0
2025-10-10T14:38:22.157625Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 37 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602442865553413:11816]
2025-10-10T14:38:22.157656Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:22.157713Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:22.157722Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:22.157750Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2639 reason: pipe to partition's 0 tablet is dead #2 sessionId: src_id|a4cd044a-ccc81f41-9feb5c71-284493f_0
2025-10-10T14:38:22.157267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602442865553413:11816], now have 1 active actors on pipe
2025-10-10T14:38:22.157868Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2639 sessionId: src_id|a4cd044a-ccc81f41-9feb5c71-284493f_0 is DEAD
2025-10-10T14:38:22.157952Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6818abea-1640e422-b0bd9b9e-11244dfc_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|a4cd044a-ccc81f41-9feb5c71-284493f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:22.160647Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a4cd044a-ccc81f41-9feb5c71-284493f_0] Write session: try to update token
2025-10-10T14:38:22.160665Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a4cd044a-ccc81f41-9feb5c71-284493f_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:22.164003Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4cd044a-ccc81f41-9feb5c71-284493f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: pipe to partition's 0 tablet is dead #2, code: 500027 
2025-10-10T14:38:22.164014Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4cd044a-ccc81f41-9feb5c71-284493f_0] Write session will restart in 0.009423s
2025-10-10T14:38:22.164038Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4cd044a-ccc81f41-9feb5c71-284493f_0] Write session: Do CDS request
2025-10-10T14:38:22.164044Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4cd044a-ccc81f41-9feb5c71-284493f_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:22.175055Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a4cd044a-ccc81f41-9feb5c71-284493f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:22.175143Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:22.175164Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2640
2025-10-10T14:38:22.175295Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2640 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:22.175333Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2640 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:22.175344Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2640 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:22.175349Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:22.175932Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2640 sessionId:  describe result for acl check
2025-10-10T14:38:22.176004Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:22.176013Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:22.176016Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:22.176023Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602442865553626:12046] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:22.176696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602442865553626:12046] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:22.179378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:22.179803Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602442865553626:12046] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:22.181564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:22.181806Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:22.181816Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:22.181828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:22.181886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:22.181932Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602442083316848:12003]
2025-10-10T14:38:22.182594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:22.182923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:22.182930Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602442865553626:12046] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:22.182945Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602442865553626:12046] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:22.182949Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602442865553626:12046] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:22.182967Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2640 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:22.182974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:22.183474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:22.183549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:22.183556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:22.183557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:22.183559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:22.183560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:22.183562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:22.183563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:22.183565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:22.183566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:22.183567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:22.183569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:22.183570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:22.183572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:22.183579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:22.183594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:22.183599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:22.183603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:22.183608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:22.183613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:22.183617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:22.183621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:22.183626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:22.183631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:22.183635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:22.183640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:22.183644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:22.183654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:22.183664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:22.183672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:22.183678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:22.183683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:22.183689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:22.183693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:22.183700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:22.183706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:22.183711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:22.183716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:22.183722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:22.183727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:22.183734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:22.183739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:22.183745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:22.183751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:22.183761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:22.183766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:22.183772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:22.183781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:22.183787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:22.183797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:22.183803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:22.183808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:22.183815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:22.183875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:22.186481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:22.187324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:22.187343Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:22.187346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:22.187350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:22.187357Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2639 [2:7559602442083316848:12003]
2025-10-10T14:38:22.187371Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:22.187394Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:22.187405Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:22.187408Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:22.187411Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:22.187431Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:22.187444Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:22.187457Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:22.187536Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:22.187543Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:22.187545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:22.187548Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:22.187632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:22.187643Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:22.187657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:22.187669Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:22.187692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:22.187723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602442865553673:12046], now have 1 active actors on pipe
2025-10-10T14:38:22.187731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602442865553428:2438], now have 1 active actors on pipe
2025-10-10T14:38:22.187741Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602442083316843:12003]
2025-10-10T14:38:22.187748Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602442083316843:12003]
2025-10-10T14:38:22.187750Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602442083316843:12003]
2025-10-10T14:38:22.187766Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:22.187787Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:22.187795Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:22.187804Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:22.187805Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:22.187808Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:22.187815Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:22.187852Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602442083316843:12003]
2025-10-10T14:38:22.187865Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:22.187872Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:22.187871Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2639
2025-10-10T14:38:22.187873Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2639
2025-10-10T14:38:22.188040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:22.188067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:22.188116Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9a4a5e-a4c83841-4128e2be-613398d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:22.188130Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:22.188135Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:22.188138Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:22.188151Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:22.188182Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:22.188205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:22.188466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:22.188475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:22.188494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:22.188603Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2640 partition: 0 MaxSeqNo: 40 sessionId: src_id|9a4a5e-a4c83841-4128e2be-613398d_0
2025-10-10T14:38:22.188990Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4cd044a-ccc81f41-9feb5c71-284493f_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|9a4a5e-a4c83841-4128e2be-613398d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:22.191858Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9a4a5e-a4c83841-4128e2be-613398d_0] Write session: try to update token
2025-10-10T14:38:22.191878Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9a4a5e-a4c83841-4128e2be-613398d_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:22.208140Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:22.208155Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:22.208159Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:22.208160Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:22.208172Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602442083316843:12003]
2025-10-10T14:38:22.208176Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602442083316843:12003]
2025-10-10T14:38:22.208181Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602442083316843:12003]
2025-10-10T14:38:22.208237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:22.208244Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:22.208251Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:22.208252Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:22.208254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:22.208262Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2640 sessionId: src_id|9a4a5e-a4c83841-4128e2be-613398d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:22.208256Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:22.208395Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:22.211100Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:22.257921Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602442865553685:11816]
2025-10-10T14:38:22.258259Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 pipe creation result: OK TabletId: 72075186224037892 Generation: 2639, pipe: [1:7559602442865553685:11816]
2025-10-10T14:38:22.321882Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:22.322363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:22.322383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:22.322430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602442865553685:11816], now have 1 active actors on pipe
2025-10-10T14:38:22.325616Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:22.326166Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a4a5e-a4c83841-4128e2be-613398d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:22.325646Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:22.325678Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:22.325739Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 38 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602442865553685:11816]
2025-10-10T14:38:22.325751Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2640 reason: error at write: Disconnected sessionId: src_id|9a4a5e-a4c83841-4128e2be-613398d_0
2025-10-10T14:38:22.325769Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:22.325969Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2640 sessionId: src_id|9a4a5e-a4c83841-4128e2be-613398d_0 is DEAD
2025-10-10T14:38:22.326179Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a4a5e-a4c83841-4128e2be-613398d_0] Write session will restart in 0.005229s
2025-10-10T14:38:22.326279Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a4a5e-a4c83841-4128e2be-613398d_0] Write session: Do CDS request
2025-10-10T14:38:22.326287Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a4a5e-a4c83841-4128e2be-613398d_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:22.332981Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9a4a5e-a4c83841-4128e2be-613398d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:22.333037Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:22.333054Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2641
2025-10-10T14:38:22.333238Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2641 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:22.333295Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2641 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:22.333306Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2641 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:22.333310Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:22.333783Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2641 sessionId:  describe result for acl check
2025-10-10T14:38:22.333821Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:22.333828Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:22.333830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:22.333838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602442865553701:12050] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:22.334459Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602442865553701:12050] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:22.337285Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602442865553701:12050] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:22.341015Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602442865553701:12050] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:22.341046Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602442865553701:12050] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:22.341049Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602442865553701:12050] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:22.341059Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2641 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:22.345374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:22.348044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:22.348284Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:22.348295Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:22.348309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:22.348373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:22.348421Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602442083317079:12005]
2025-10-10T14:38:22.349080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:22.349446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:22.349516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:22.349912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:22.349977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:22.349982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:22.349983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:22.349984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:22.349986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:22.349987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:22.349988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:22.349989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:22.349990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:22.349991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:22.349992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:22.349993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:22.349994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:22.350002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:22.350016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:22.350020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:22.350024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:22.350043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:22.350048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:22.350052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:22.350056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:22.350060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:22.350064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:22.350068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:22.350072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:22.350076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:22.350088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:22.350096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:22.350103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:22.350109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:22.350115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:22.350124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:22.350129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:22.350135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:22.350152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:22.350161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:22.350174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:22.350184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:22.350189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:22.350194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:22.350203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:22.350208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:22.350214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:22.350224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:22.350229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:22.350234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:22.350239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:22.350244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:22.350253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:22.350258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:22.350263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:22.350273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:22.350308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:22.352732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:22.353404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:22.353415Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:22.353417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:22.353421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:22.353428Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2640 [2:7559602442083317079:12005]
2025-10-10T14:38:22.353441Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:22.353459Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:22.353462Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:22.353466Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:22.353469Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:22.353487Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:22.353500Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:22.353509Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:22.353573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:22.353580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:22.353582Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:22.353585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:22.353654Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:22.353663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:22.353675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:22.353692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:22.353713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:22.353740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602442865553882:12050], now have 1 active actors on pipe
2025-10-10T14:38:22.353748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602442865553686:2438], now have 1 active actors on pipe
2025-10-10T14:38:22.353756Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602442083317074:12005]
2025-10-10T14:38:22.353764Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602442083317074:12005]
2025-10-10T14:38:22.353766Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602442083317074:12005]
2025-10-10T14:38:22.353782Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:22.353800Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:22.353804Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:22.353807Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:22.353810Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:22.353822Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:22.353798Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2640
2025-10-10T14:38:22.353812Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2640
2025-10-10T14:38:22.353830Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:22.353857Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602442083317074:12005]
2025-10-10T14:38:22.353861Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:22.353862Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:22.353882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:22.353888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:22.353941Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fd86914c-bd765910-40471595-ef257d39_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:22.353955Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:22.353959Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:22.353962Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:22.353974Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:22.353990Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:22.354023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:22.354246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:22.354260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:22.354283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:22.354433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2641 partition: 0 MaxSeqNo: 40 sessionId: src_id|fd86914c-bd765910-40471595-ef257d39_0
2025-10-10T14:38:22.354863Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a4a5e-a4c83841-4128e2be-613398d_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|fd86914c-bd765910-40471595-ef257d39_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:22.357841Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fd86914c-bd765910-40471595-ef257d39_0] Write session: try to update token
2025-10-10T14:38:22.357863Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fd86914c-bd765910-40471595-ef257d39_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:22.373895Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:22.373918Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:22.373922Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:22.373924Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:22.373935Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602442083317074:12005]
2025-10-10T14:38:22.373941Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602442083317074:12005]
2025-10-10T14:38:22.373945Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602442083317074:12005]
2025-10-10T14:38:22.373997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:22.374007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:22.374016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:22.374069Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:22.374083Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:22.374087Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:22.374177Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:22.375115Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2641 sessionId: src_id|fd86914c-bd765910-40471595-ef257d39_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:22.377754Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:22.426057Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602442865553946:11816]
2025-10-10T14:38:22.426445Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 pipe creation result: OK TabletId: 72075186224037892 Generation: 2640, pipe: [1:7559602442865553946:11816]
2025-10-10T14:38:22.493078Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:22.493543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:22.493557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:22.493602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602442865553946:11816], now have 1 active actors on pipe
2025-10-10T14:38:22.493833Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:22.493849Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:22.493853Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:22.493879Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:22.493909Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 39 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602442865553946:11816]
2025-10-10T14:38:22.493912Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2641 reason: error at write: Disconnected sessionId: src_id|fd86914c-bd765910-40471595-ef257d39_0
2025-10-10T14:38:22.494299Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd86914c-bd765910-40471595-ef257d39_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:22.494310Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd86914c-bd765910-40471595-ef257d39_0] Write session will restart in 0.005298s
2025-10-10T14:38:22.494336Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd86914c-bd765910-40471595-ef257d39_0] Write session: Do CDS request
2025-10-10T14:38:22.494342Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd86914c-bd765910-40471595-ef257d39_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:22.494116Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2641 sessionId: src_id|fd86914c-bd765910-40471595-ef257d39_0 is DEAD
2025-10-10T14:38:22.500965Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fd86914c-bd765910-40471595-ef257d39_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:22.501082Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:22.501099Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2642
2025-10-10T14:38:22.501313Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2642 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:22.501366Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2642 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:22.501378Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2642 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:22.501382Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:22.501843Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2642 sessionId:  describe result for acl check
2025-10-10T14:38:22.501875Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:22.501882Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:22.501884Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:22.501891Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602442865553980:12055] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:22.502499Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602442865553980:12055] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:22.506148Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602442865553980:12055] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:22.510339Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602442865553980:12055] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:22.510359Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602442865553980:12055] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:22.510363Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602442865553980:12055] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:22.510373Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2642 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:22.513656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:22.516048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:22.516271Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:22.516282Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:22.516294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:22.516357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:22.516401Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602442083317322:12008]
2025-10-10T14:38:22.517041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:22.517382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:22.517428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:22.517761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:22.517824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:22.517830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:22.517831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:22.517832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:22.517834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:22.517835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:22.517836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:22.517837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:22.517838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:22.517840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:22.517841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:22.517843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:22.517844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:22.517850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:22.517864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:22.517868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:22.517872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:22.517876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:22.517880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:22.517885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:22.517889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:22.517893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:22.517897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:22.517900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:22.517903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:22.517907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:22.517914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:22.517923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:22.517930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:22.517936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:22.517941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:22.517947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:22.517952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:22.517957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:22.517962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:22.517967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:22.517972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:22.517976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:22.517981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:22.517986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:22.517990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:22.517996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:22.518009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:22.518014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:22.518024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:22.518029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:22.518038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:22.518043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:22.518047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:22.518052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:22.518063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:22.518069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:22.518110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:22.520664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:22.521496Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2641
2025-10-10T14:38:22.521536Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2641
2025-10-10T14:38:22.521112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:22.521126Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:22.521129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:22.521133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:22.521139Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2641 [2:7559602442083317322:12008]
2025-10-10T14:38:22.521152Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:22.521173Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:22.521176Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:22.521179Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:22.521181Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:22.521199Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:22.521207Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:22.521215Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:22.521280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:22.521282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:22.521285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:22.521287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:22.521687Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:22.521691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:22.521703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:22.521714Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:22.521732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:22.521758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602442865553959:2438], now have 1 active actors on pipe
2025-10-10T14:38:22.521762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602442865554173:12055], now have 1 active actors on pipe
2025-10-10T14:38:22.521778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:22.521783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:22.521807Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602442083317317:12008]
2025-10-10T14:38:22.521809Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602442083317317:12008]
2025-10-10T14:38:22.521813Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602442083317317:12008]
2025-10-10T14:38:22.521830Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:22.521846Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:22.521847Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:22.521849Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:22.521851Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:22.521863Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:22.521866Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:22.521888Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8e262a32-3a2dec76-7599de65-ad276f52_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:22.521896Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:22.521901Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:22.521903Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:22.521915Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:22.521926Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:22.521957Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602442083317317:12008]
2025-10-10T14:38:22.521967Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:22.521972Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:22.521979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:22.522130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:22.522145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:22.522165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:22.522423Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2642 partition: 0 MaxSeqNo: 40 sessionId: src_id|8e262a32-3a2dec76-7599de65-ad276f52_0
2025-10-10T14:38:22.522878Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd86914c-bd765910-40471595-ef257d39_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|8e262a32-3a2dec76-7599de65-ad276f52_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:22.525634Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8e262a32-3a2dec76-7599de65-ad276f52_0] Write session: try to update token
2025-10-10T14:38:22.525653Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8e262a32-3a2dec76-7599de65-ad276f52_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:22.540394Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2642 sessionId: src_id|8e262a32-3a2dec76-7599de65-ad276f52_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:22.541918Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:38:22.541937Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:22.541949Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602442083317317:12008]
2025-10-10T14:38:22.542015Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:38:22.542220Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:38:22.542238Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:38:22.542377Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:22.542519Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:22.542668Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:22.542887Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:38:22.542937Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:38:22.543371Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:22.543622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:22.543637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:22.543672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:38:22.543751Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:38:22.554129Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:22.554157Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:22.554162Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:22.554164Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:22.554176Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602442083317317:12008]
2025-10-10T14:38:22.554181Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602442083317317:12008]
2025-10-10T14:38:22.554185Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602442083317317:12008]
2025-10-10T14:38:22.554235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:22.554243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:22.554243Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:22.554245Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:22.554249Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:22.554254Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:22.554379Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:22.594266Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602442865554221:11816]
2025-10-10T14:38:22.594582Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 pipe creation result: OK TabletId: 72075186224037892 Generation: 2641, pipe: [1:7559602442865554221:11816]
2025-10-10T14:38:22.670821Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:22.678845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:22.678876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:22.679076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:22.679138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:22.679201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:22.679263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:22.679827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:22.679834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:22.679912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:22.679970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:22.680030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:22.680098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:22.680146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:22.680150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:22.680219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:22.680277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:22.680340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:22.680405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:22.680449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:22.680452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:22.680525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:22.680588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:22.680650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:22.680713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:22.680756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:22.680759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:22.680827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:22.680884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:22.680947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:22.681011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:22.681055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:22.681058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:22.681135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:22.681196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:22.681256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:22.681315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:22.681604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:22.681614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:22.681689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:22.681751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:22.681813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:22.681873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:22.681914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:22.681919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:22.681990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:22.682048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:22.682103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:22.682180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:22.682239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:22.682242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:22.682309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:22.682374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:22.682441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:22.682503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:22.682550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:22.682560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:22.682630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:22.682693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:22.682759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:22.682828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:22.682876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:22.682883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:22.682953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602442865554221:11816], now have 1 active actors on pipe
2025-10-10T14:38:22.683362Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 40 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602442865554221:11816]
2025-10-10T14:38:22.683403Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:22.683456Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:22.683463Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:22.683496Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2642 reason: error at write: Disconnected sessionId: src_id|8e262a32-3a2dec76-7599de65-ad276f52_0
2025-10-10T14:38:22.683754Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2642 sessionId: src_id|8e262a32-3a2dec76-7599de65-ad276f52_0 is DEAD
2025-10-10T14:38:22.683880Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e262a32-3a2dec76-7599de65-ad276f52_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:22.683891Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e262a32-3a2dec76-7599de65-ad276f52_0] Write session will restart in 0.006462s
2025-10-10T14:38:22.683918Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e262a32-3a2dec76-7599de65-ad276f52_0] Write session: Do CDS request
2025-10-10T14:38:22.683923Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e262a32-3a2dec76-7599de65-ad276f52_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:22.683701Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:22.692017Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8e262a32-3a2dec76-7599de65-ad276f52_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:22.692361Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:22.692378Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2643
2025-10-10T14:38:22.692527Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2643 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:22.692562Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2643 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:22.692568Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2643 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:22.692571Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:22.692975Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2643 sessionId:  describe result for acl check
2025-10-10T14:38:22.693002Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:22.693004Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:22.693008Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:22.693017Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602442865554236:12059] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:22.693582Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602442865554236:12059] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:22.696673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602442865554236:12059] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:22.702065Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602442865554236:12059] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:22.702083Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602442865554236:12059] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:22.702087Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602442865554236:12059] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:22.702095Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2643 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:22.714682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:22.717111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:22.717395Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:22.717407Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:22.717421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:22.717478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:22.717528Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602442083317555:12010]
2025-10-10T14:38:22.718186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:22.718547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:22.718592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:22.718915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:22.718982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:22.718988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:22.718989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:22.718990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:22.718991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:22.718992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:22.718994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:22.718995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:22.718996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:22.718997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:22.718999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:22.719000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:22.719001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:22.719007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:22.719021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:22.719025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:22.719029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:22.719038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:22.719042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:22.719046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:22.719050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:22.719054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:22.719059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:22.719063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:22.719067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:22.719070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:22.719079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:22.719088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:22.719094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:22.719100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:22.719105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:22.719111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:22.719116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:22.719121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:22.719126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:22.719131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:22.719136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:22.719141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:22.719146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:22.719151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:22.719158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:22.719162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:22.719167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:22.719172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:22.719176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:22.719182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:22.719187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:22.719192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:22.719196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:22.719201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:22.719206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:22.719211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:22.719252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:22.721584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:22.722189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:22.722200Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:22.722203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:22.722207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:22.722213Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2642 [2:7559602442083317555:12010]
2025-10-10T14:38:22.722224Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:22.722241Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:22.722246Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:22.722249Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:22.722250Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:22.722263Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:22.722272Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:22.722278Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:22.722340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:22.722347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:22.722350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:22.722352Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:22.722416Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:22.722424Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:22.722436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:22.722453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:22.722475Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:22.722494Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602442083317550:12010]
2025-10-10T14:38:22.722499Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602442083317550:12010]
2025-10-10T14:38:22.722500Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602442083317550:12010]
2025-10-10T14:38:22.722507Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:22.722519Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:22.722526Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:22.722529Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:22.722533Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:22.722534Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:22.722539Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:22.722549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602442865554291:12059], now have 1 active actors on pipe
2025-10-10T14:38:22.722557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602442865554223:2438], now have 1 active actors on pipe
2025-10-10T14:38:22.722578Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602442083317550:12010]
2025-10-10T14:38:22.722592Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:22.722611Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:22.722623Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2642
2025-10-10T14:38:22.722667Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2642
2025-10-10T14:38:22.722953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:22.722967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:22.723003Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|93e7eca1-8a8ded1d-aeccec3e-3b9ecb27_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:22.723017Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:22.723025Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:22.723028Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:22.723045Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:22.723061Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:22.723081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:22.723306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:22.723314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:22.723330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:22.723438Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2643 partition: 0 MaxSeqNo: 40 sessionId: src_id|93e7eca1-8a8ded1d-aeccec3e-3b9ecb27_0
2025-10-10T14:38:22.723843Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e262a32-3a2dec76-7599de65-ad276f52_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|93e7eca1-8a8ded1d-aeccec3e-3b9ecb27_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:22.726844Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|93e7eca1-8a8ded1d-aeccec3e-3b9ecb27_0] Write session: try to update token
2025-10-10T14:38:22.726874Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|93e7eca1-8a8ded1d-aeccec3e-3b9ecb27_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:22.742952Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:22.742975Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:22.742979Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:22.742981Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:22.742993Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602442083317550:12010]
2025-10-10T14:38:22.742997Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602442083317550:12010]
2025-10-10T14:38:22.743002Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602442083317550:12010]
2025-10-10T14:38:22.743057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:22.743065Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:22.743068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:22.743219Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:22.745821Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:22.745838Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:22.745843Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:22.757476Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2643 sessionId: src_id|93e7eca1-8a8ded1d-aeccec3e-3b9ecb27_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:22.760177Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:22.783853Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602442865554485:11816]
2025-10-10T14:38:22.784213Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 pipe creation result: OK TabletId: 72075186224037892 Generation: 2642, pipe: [1:7559602442865554485:11816]
2025-10-10T14:38:22.869667Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:22.870114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:22.870144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:22.870171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602442865554485:11816], now have 1 active actors on pipe
2025-10-10T14:38:22.870379Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 41 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602442865554485:11816]
2025-10-10T14:38:22.870416Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:22.870404Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:22.870419Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:22.870496Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2643 reason: error at write: Disconnected sessionId: src_id|93e7eca1-8a8ded1d-aeccec3e-3b9ecb27_0
2025-10-10T14:38:22.870687Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:22.870718Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2643 sessionId: src_id|93e7eca1-8a8ded1d-aeccec3e-3b9ecb27_0 is DEAD
2025-10-10T14:38:22.873466Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|93e7eca1-8a8ded1d-aeccec3e-3b9ecb27_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:22.873479Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|93e7eca1-8a8ded1d-aeccec3e-3b9ecb27_0] Write session will restart in 0.005234s
2025-10-10T14:38:22.873515Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|93e7eca1-8a8ded1d-aeccec3e-3b9ecb27_0] Write session: Do CDS request
2025-10-10T14:38:22.873523Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|93e7eca1-8a8ded1d-aeccec3e-3b9ecb27_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:22.880257Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|93e7eca1-8a8ded1d-aeccec3e-3b9ecb27_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:22.880324Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:22.880343Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2644
2025-10-10T14:38:22.880482Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2644 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:22.880518Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2644 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:22.880529Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2644 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:22.880533Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:22.881042Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2644 sessionId:  describe result for acl check
2025-10-10T14:38:22.881082Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:22.881099Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:22.881101Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:22.881107Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602442865554565:12064] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:22.881690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602442865554565:12064] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:22.884745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602442865554565:12064] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:22.888301Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602442865554565:12064] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:22.888317Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602442865554565:12064] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:22.888321Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602442865554565:12064] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:22.888330Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2644 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:22.891075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:22.893465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:22.893726Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:22.893738Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:22.893752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:22.893812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:22.893871Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602442083317788:12012]
2025-10-10T14:38:22.894547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:22.894950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:22.895011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:22.895344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:22.895425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:22.895426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:22.895428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:22.895429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:22.895431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:22.895432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:22.895434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:22.895435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:22.895437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:22.895438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:22.895440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:22.895441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:22.895442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:22.895451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:22.895466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:22.895471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:22.895476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:22.895481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:22.895485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:22.895488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:22.895491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:22.895495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:22.895499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:22.895503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:22.895508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:22.895512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:22.895522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:22.895532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:22.895539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:22.895544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:22.895548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:22.895553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:22.895557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:22.895562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:22.895567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:22.895572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:22.895577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:22.895582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:22.895586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:22.895591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:22.895596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:22.895601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:22.895607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:22.895613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:22.895620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:22.895625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:22.895631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:22.895637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:22.895641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:22.895647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:22.895652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:22.895657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:22.895704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:22.898342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:22.899313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:22.899326Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:22.899329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:22.899333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:22.899340Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2643 [2:7559602442083317788:12012]
2025-10-10T14:38:22.899355Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:22.899373Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:22.899377Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:22.899380Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:22.899383Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:22.899402Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:22.899410Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:22.899418Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:22.899485Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:22.899487Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:22.899489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:22.899491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:22.899571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:22.899579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:22.899592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:22.899606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:22.899789Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2643
2025-10-10T14:38:22.899957Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2643
2025-10-10T14:38:22.900721Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2644 partition: 0 MaxSeqNo: 40 sessionId: src_id|fa4926d3-b72f2108-b5aba317-945cbe8c_0
2025-10-10T14:38:22.901135Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|93e7eca1-8a8ded1d-aeccec3e-3b9ecb27_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|fa4926d3-b72f2108-b5aba317-945cbe8c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:22.899629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:22.899656Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602442083317783:12012]
2025-10-10T14:38:22.899658Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602442083317783:12012]
2025-10-10T14:38:22.899662Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602442083317783:12012]
2025-10-10T14:38:22.899676Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:22.899692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602442865554496:2438], now have 1 active actors on pipe
2025-10-10T14:38:22.899696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602442865554731:12064], now have 1 active actors on pipe
2025-10-10T14:38:22.899704Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:22.899715Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:22.899719Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:22.899719Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:22.899721Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:22.899723Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:22.899760Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602442083317783:12012]
2025-10-10T14:38:22.899767Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:22.899780Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:22.900039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:22.900045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:22.900086Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fa4926d3-b72f2108-b5aba317-945cbe8c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:22.900095Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:22.900099Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:22.900102Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:22.900113Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:22.900126Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:22.900142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:22.900466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:22.900475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:22.900511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:22.904406Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fa4926d3-b72f2108-b5aba317-945cbe8c_0] Write session: try to update token
2025-10-10T14:38:22.904426Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fa4926d3-b72f2108-b5aba317-945cbe8c_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:22.919755Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:22.919775Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:22.919779Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:22.919782Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:22.919794Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602442083317783:12012]
2025-10-10T14:38:22.919799Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602442083317783:12012]
2025-10-10T14:38:22.919804Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602442083317783:12012]
2025-10-10T14:38:22.919860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:22.919868Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:22.919871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:22.920022Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:22.921439Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:22.921459Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:22.921464Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:22.927994Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2644 sessionId: src_id|fa4926d3-b72f2108-b5aba317-945cbe8c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:22.930932Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:22.970582Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602442865554758:11816]
2025-10-10T14:38:22.970846Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 pipe creation result: OK TabletId: 72075186224037892 Generation: 2643, pipe: [1:7559602442865554758:11816]
2025-10-10T14:38:23.042349Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:23.042668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:23.042687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:23.042740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602442865554758:11816], now have 1 active actors on pipe
2025-10-10T14:38:23.042981Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:23.042999Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 42 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602442865554758:11816]
2025-10-10T14:38:23.043010Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:23.043034Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:38:23.043122Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2644 reason: status is not ok: tablet will be restarted right now sessionId: src_id|fa4926d3-b72f2108-b5aba317-945cbe8c_0
2025-10-10T14:38:23.043345Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2644 sessionId: src_id|fa4926d3-b72f2108-b5aba317-945cbe8c_0 is DEAD
2025-10-10T14:38:23.043498Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa4926d3-b72f2108-b5aba317-945cbe8c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:38:23.043511Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa4926d3-b72f2108-b5aba317-945cbe8c_0] Write session will restart in 0.008278s
2025-10-10T14:38:23.043547Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa4926d3-b72f2108-b5aba317-945cbe8c_0] Write session: Do CDS request
2025-10-10T14:38:23.043554Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa4926d3-b72f2108-b5aba317-945cbe8c_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:23.052887Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fa4926d3-b72f2108-b5aba317-945cbe8c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:23.052980Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:23.052995Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2645
2025-10-10T14:38:23.053149Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2645 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:23.053190Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2645 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:23.053201Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2645 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:23.053205Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:23.053669Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2645 sessionId:  describe result for acl check
2025-10-10T14:38:23.053709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:23.053715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:23.053719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:23.053726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602447160522152:12068] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:23.054226Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602447160522152:12068] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:23.057184Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602447160522152:12068] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:23.060262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:23.060338Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602447160522152:12068] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:23.060354Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602447160522152:12068] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:23.060358Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602447160522152:12068] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:23.060367Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2645 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:23.062619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:23.062841Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:23.062852Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:23.062873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:23.062924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:23.062961Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602446378285318:12014]
2025-10-10T14:38:23.063895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:23.064219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:23.064266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:23.064610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:23.064665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:23.064671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:23.064672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:23.064673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:23.064674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:23.064675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:23.064675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:23.064676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:23.064677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:23.064678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:23.064679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:23.064680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:23.064680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:23.064685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:23.064694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:23.064697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:23.064699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:23.064701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:23.064703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:23.064705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:23.064708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:23.064710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:23.064712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:23.064714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:23.064716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:23.064718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:23.064724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:23.064730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:23.064735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:23.064738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:23.064744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:23.064749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:23.064754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:23.064760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:23.064765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:23.064769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:23.064772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:23.064775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:23.064782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:23.064785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:23.064788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:23.064791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:23.064794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:23.064799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:23.064801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:23.064805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:23.064807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:23.064811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:23.064813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:23.064816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:23.064819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:23.064822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:23.064844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:23.067325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:23.067934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:23.067949Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:23.067952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:23.067957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:23.067963Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2644 [2:7559602446378285318:12014]
2025-10-10T14:38:23.067977Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:23.067995Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:23.067999Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:23.068003Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:23.068005Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:23.068023Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:23.068037Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:23.068045Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:23.068112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:23.068121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:23.068123Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:23.068126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:23.068199Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:23.068209Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:23.068222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:23.068239Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:23.068263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:23.068291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602447160522056:2438], now have 1 active actors on pipe
2025-10-10T14:38:23.068299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602447160522309:12068], now have 1 active actors on pipe
2025-10-10T14:38:23.068307Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602446378285312:12014]
2025-10-10T14:38:23.068310Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602446378285312:12014]
2025-10-10T14:38:23.068312Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602446378285312:12014]
2025-10-10T14:38:23.068325Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:23.068345Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:23.068348Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:23.068352Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:23.068354Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:23.068366Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:23.068369Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:23.068360Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2644
2025-10-10T14:38:23.068396Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602446378285312:12014]
2025-10-10T14:38:23.068405Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:23.068374Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2644
2025-10-10T14:38:23.068407Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:23.068422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:23.068431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:23.068485Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a9ce49bf-64e8755b-f51ea9c9-e60472a4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:23.068498Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:23.068507Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:23.068510Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:23.068522Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:23.068537Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:23.068561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:23.068718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:23.068727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:23.068743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:23.068835Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2645 partition: 0 MaxSeqNo: 40 sessionId: src_id|a9ce49bf-64e8755b-f51ea9c9-e60472a4_0
2025-10-10T14:38:23.069232Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa4926d3-b72f2108-b5aba317-945cbe8c_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|a9ce49bf-64e8755b-f51ea9c9-e60472a4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:23.071968Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a9ce49bf-64e8755b-f51ea9c9-e60472a4_0] Write session: try to update token
2025-10-10T14:38:23.071985Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a9ce49bf-64e8755b-f51ea9c9-e60472a4_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:23.086247Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2645 sessionId: src_id|a9ce49bf-64e8755b-f51ea9c9-e60472a4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:23.088125Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:23.088140Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:23.088143Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:23.088146Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:23.088156Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602446378285312:12014]
2025-10-10T14:38:23.088163Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602446378285312:12014]
2025-10-10T14:38:23.088167Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602446378285312:12014]
2025-10-10T14:38:23.088218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:23.088216Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:23.088225Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:23.088226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:23.088229Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:23.088229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:23.088373Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:23.089039Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:23.143114Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602447160522343:11816]
2025-10-10T14:38:23.143431Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 pipe creation result: OK TabletId: 72075186224037892 Generation: 2644, pipe: [1:7559602447160522343:11816]
2025-10-10T14:38:23.205036Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:23.205670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:23.205685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:23.205731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602447160522343:11816], now have 1 active actors on pipe
2025-10-10T14:38:23.205973Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:23.207052Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9ce49bf-64e8755b-f51ea9c9-e60472a4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:38:23.207065Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9ce49bf-64e8755b-f51ea9c9-e60472a4_0] Write session will restart in 0.006645s
2025-10-10T14:38:23.207090Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9ce49bf-64e8755b-f51ea9c9-e60472a4_0] Write session: Do CDS request
2025-10-10T14:38:23.207096Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9ce49bf-64e8755b-f51ea9c9-e60472a4_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:23.206545Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:23.206614Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 43 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602447160522343:11816]
2025-10-10T14:38:23.206638Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:38:23.206719Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2645 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a9ce49bf-64e8755b-f51ea9c9-e60472a4_0
2025-10-10T14:38:23.206919Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2645 sessionId: src_id|a9ce49bf-64e8755b-f51ea9c9-e60472a4_0 is DEAD
2025-10-10T14:38:23.214966Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a9ce49bf-64e8755b-f51ea9c9-e60472a4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:23.215061Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:23.215083Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2646
2025-10-10T14:38:23.215240Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2646 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:23.215295Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2646 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:23.215306Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2646 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:23.215310Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:23.215763Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2646 sessionId:  describe result for acl check
2025-10-10T14:38:23.215802Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:23.215806Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:23.215808Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:23.215814Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602447160522361:12081] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:23.216380Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602447160522361:12081] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:23.218937Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602447160522361:12081] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:23.222028Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602447160522361:12081] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:23.222044Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602447160522361:12081] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:23.222048Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602447160522361:12081] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:23.222057Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2646 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:23.230550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:23.233219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:23.233722Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:23.233736Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:23.233762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:23.233844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:23.233890Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602446378285593:12030]
2025-10-10T14:38:23.234559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:23.234893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:23.234945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:23.235287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:23.235347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:23.235352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:23.235353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:23.235353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:23.235354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:23.235355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:23.235356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:23.235356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:23.235358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:23.235359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:23.235360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:23.235361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:23.235363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:23.235368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:23.235381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:23.235385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:23.235388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:23.235391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:23.235396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:23.235400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:23.235404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:23.235407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:23.235409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:23.235411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:23.235413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:23.235415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:23.235423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:23.235429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:23.235433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:23.235437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:23.235440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:23.235443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:23.235446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:23.235450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:23.235452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:23.235455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:23.235459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:23.235463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:23.235468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:23.235473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:23.235478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:23.235483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:23.235489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:23.235494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:23.235498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:23.235504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:23.235508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:23.235511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:23.235514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:23.235517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:23.235520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:23.235523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:23.235546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:23.238406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:23.239036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:23.239050Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:23.239053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:23.239058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:23.239065Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2645 [2:7559602446378285593:12030]
2025-10-10T14:38:23.239079Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:23.239112Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:23.239121Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:23.239126Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:23.239128Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:23.239148Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:23.239156Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:23.239170Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:23.239251Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:23.239257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:23.239260Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:23.239263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:23.239343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:23.239352Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:23.239364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:23.239382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:23.239406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:23.239439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602447160522346:2438], now have 1 active actors on pipe
2025-10-10T14:38:23.239447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602447160522434:12081], now have 1 active actors on pipe
2025-10-10T14:38:23.239455Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602446378285588:12030]
2025-10-10T14:38:23.239457Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602446378285588:12030]
2025-10-10T14:38:23.239460Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602446378285588:12030]
2025-10-10T14:38:23.239474Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:23.239490Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:23.239489Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:23.239493Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:23.239495Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:23.239511Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:23.239515Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:23.239544Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602446378285588:12030]
2025-10-10T14:38:23.239556Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:23.239566Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:23.239566Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2645
2025-10-10T14:38:23.239642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:23.239656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:23.239690Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e7616810-43acbb1b-af4a829-abdcb00b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:23.239714Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:23.239719Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:23.239722Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:23.239736Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:23.239749Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:23.239770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:23.239836Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2645
2025-10-10T14:38:23.239891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:23.239898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:23.239915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:23.240023Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2646 partition: 0 MaxSeqNo: 40 sessionId: src_id|e7616810-43acbb1b-af4a829-abdcb00b_0
2025-10-10T14:38:23.240418Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9ce49bf-64e8755b-f51ea9c9-e60472a4_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|e7616810-43acbb1b-af4a829-abdcb00b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:23.243253Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e7616810-43acbb1b-af4a829-abdcb00b_0] Write session: try to update token
2025-10-10T14:38:23.243277Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e7616810-43acbb1b-af4a829-abdcb00b_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:23.257867Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:38:23.257890Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:23.257903Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602446378285588:12030]
2025-10-10T14:38:23.257960Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:38:23.257970Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:38:23.258157Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:38:23.258304Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:23.258447Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:23.258596Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:23.258789Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:38:23.258838Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:38:23.262991Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2646 sessionId: src_id|e7616810-43acbb1b-af4a829-abdcb00b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:23.265890Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:23.266100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:23.266134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:23.266198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:38:23.266347Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:38:23.270299Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:23.270314Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:23.270318Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:23.270320Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:23.270331Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602446378285588:12030]
2025-10-10T14:38:23.270335Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602446378285588:12030]
2025-10-10T14:38:23.270339Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602446378285588:12030]
2025-10-10T14:38:23.270394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:23.270397Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:23.270404Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:23.270409Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:23.270410Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:23.270412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:23.270549Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:23.305910Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602447160522610:11816]
2025-10-10T14:38:23.306254Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 pipe creation result: OK TabletId: 72075186224037892 Generation: 2645, pipe: [1:7559602447160522610:11816]
2025-10-10T14:38:23.386571Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:23.394997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:23.395030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:23.395233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:23.395305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:23.395376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:23.395439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:23.395498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:23.395511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:23.395584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:23.395652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:23.395719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:23.395786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:23.395838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:23.395846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:23.395919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:23.395985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:23.396057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:23.396126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:23.396469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:23.396480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:23.396551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:23.396830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:23.396888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:23.396950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:23.396996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:23.397004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:23.397080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:23.397146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:23.397216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:23.397291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:23.397359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:23.397369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:23.397438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:23.397508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:23.397574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:23.397648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:23.397698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:23.397705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:23.397779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:23.397842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:23.397915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:23.397988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:23.398033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:23.398036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:23.398102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:23.398181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:23.398250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:23.398322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:23.398442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:23.398446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:23.398524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:23.398598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:23.398670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:23.398739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:23.398785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:23.398793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:23.398864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:23.398933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:23.398997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:23.399056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:23.399103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:23.399110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:23.399185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602447160522610:11816], now have 1 active actors on pipe
2025-10-10T14:38:23.399462Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 44 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602447160522610:11816]
2025-10-10T14:38:23.399506Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:23.399505Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:23.399508Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:23.399542Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2646 reason: error at write: Disconnected sessionId: src_id|e7616810-43acbb1b-af4a829-abdcb00b_0
2025-10-10T14:38:23.399753Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2646 sessionId: src_id|e7616810-43acbb1b-af4a829-abdcb00b_0 is DEAD
2025-10-10T14:38:23.399811Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:23.401422Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7616810-43acbb1b-af4a829-abdcb00b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:23.401435Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7616810-43acbb1b-af4a829-abdcb00b_0] Write session will restart in 0.008926s
2025-10-10T14:38:23.401462Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7616810-43acbb1b-af4a829-abdcb00b_0] Write session: Do CDS request
2025-10-10T14:38:23.401469Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7616810-43acbb1b-af4a829-abdcb00b_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:23.413963Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e7616810-43acbb1b-af4a829-abdcb00b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:23.414061Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:23.414081Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2647
2025-10-10T14:38:23.414308Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2647 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:23.414353Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2647 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:23.414364Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2647 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:23.414370Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:23.414899Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2647 sessionId:  describe result for acl check
2025-10-10T14:38:23.414939Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:23.414945Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:23.414947Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:23.414954Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602447160522791:12085] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:23.415528Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602447160522791:12085] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:23.418428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:23.418459Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602447160522791:12085] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:23.420907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:23.421136Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:23.421147Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:23.421159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:23.421212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:23.421257Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602446378285840:12033]
2025-10-10T14:38:23.421279Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602447160522791:12085] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:23.421296Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602447160522791:12085] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:23.421299Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602447160522791:12085] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:23.421308Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2647 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:23.421943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:23.422238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:23.422284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:23.422642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:23.422703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:23.422709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:23.422711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:23.422713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:23.422714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:23.422716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:23.422717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:23.422718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:23.422719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:23.422721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:23.422722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:23.422723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:23.422725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:23.422731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:23.422745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:23.422750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:23.422754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:23.422759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:23.422764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:23.422768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:23.422772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:23.422776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:23.422781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:23.422785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:23.422789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:23.422793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:23.422802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:23.422811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:23.422818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:23.422824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:23.422829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:23.422834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:23.422844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:23.422850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:23.422855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:23.422861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:23.422865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:23.422871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:23.422876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:23.422882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:23.422887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:23.422893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:23.422898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:23.422904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:23.422910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:23.422916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:23.422921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:23.422927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:23.422939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:23.422945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:23.422950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:23.422956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:23.422998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:23.425531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:23.426106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:23.426130Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:23.426133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:23.426138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:23.426144Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2646 [2:7559602446378285840:12033]
2025-10-10T14:38:23.426158Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:23.426178Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:23.426186Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:23.426190Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:23.426193Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:23.426212Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:23.426225Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:23.426238Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:23.426306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:23.426312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:23.426315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:23.426318Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:23.426398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:23.426404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:23.426418Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:23.426434Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:23.426452Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:23.426479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602447160522867:12085], now have 1 active actors on pipe
2025-10-10T14:38:23.426486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602447160522613:2438], now have 1 active actors on pipe
2025-10-10T14:38:23.426495Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602446378285835:12033]
2025-10-10T14:38:23.426501Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602446378285835:12033]
2025-10-10T14:38:23.426503Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602446378285835:12033]
2025-10-10T14:38:23.426518Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:23.426531Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:23.426535Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:23.426537Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:23.426537Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:23.426555Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:23.426562Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:23.426592Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602446378285835:12033]
2025-10-10T14:38:23.426604Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:23.426589Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2646
2025-10-10T14:38:23.426601Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2646
2025-10-10T14:38:23.426631Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:23.426711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:23.426722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:23.426754Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|98e3b41c-7234956d-1527dae7-7f74b883_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:23.426766Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:23.426771Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:23.426778Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:23.426790Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:23.426803Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:23.426823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:23.426997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:23.427011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:23.427036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:23.427139Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2647 partition: 0 MaxSeqNo: 40 sessionId: src_id|98e3b41c-7234956d-1527dae7-7f74b883_0
2025-10-10T14:38:23.427617Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7616810-43acbb1b-af4a829-abdcb00b_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|98e3b41c-7234956d-1527dae7-7f74b883_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:23.430559Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|98e3b41c-7234956d-1527dae7-7f74b883_0] Write session: try to update token
2025-10-10T14:38:23.430585Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|98e3b41c-7234956d-1527dae7-7f74b883_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:23.438587Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:38:23.438610Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:23.438624Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602446378285835:12033]
2025-10-10T14:38:23.438673Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:38:23.438678Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:38:23.438858Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:38:23.439009Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:23.439160Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:23.439309Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:23.439512Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:38:23.439559Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:38:23.455145Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2647 sessionId: src_id|98e3b41c-7234956d-1527dae7-7f74b883_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:23.457242Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:23.457264Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:23.457269Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:23.457271Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:23.457282Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602446378285835:12033]
2025-10-10T14:38:23.457286Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602446378285835:12033]
2025-10-10T14:38:23.457294Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602446378285835:12033]
2025-10-10T14:38:23.457359Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:23.457366Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:23.457370Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:23.457384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:23.457390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:23.457393Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:23.457546Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:23.458194Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:23.499478Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602447160522890:11816]
2025-10-10T14:38:23.499847Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 pipe creation result: OK TabletId: 72075186224037892 Generation: 2646, pipe: [1:7559602447160522890:11816]
2025-10-10T14:38:23.576435Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:23.576962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:23.576980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:23.577008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602447160522890:11816], now have 1 active actors on pipe
2025-10-10T14:38:23.577231Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:23.577243Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:23.577260Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:23.577733Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98e3b41c-7234956d-1527dae7-7f74b883_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:23.577748Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98e3b41c-7234956d-1527dae7-7f74b883_0] Write session will restart in 0.006210s
2025-10-10T14:38:23.577790Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98e3b41c-7234956d-1527dae7-7f74b883_0] Write session: Do CDS request
2025-10-10T14:38:23.577798Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98e3b41c-7234956d-1527dae7-7f74b883_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:23.577352Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2647 reason: error at write: Disconnected sessionId: src_id|98e3b41c-7234956d-1527dae7-7f74b883_0
2025-10-10T14:38:23.577584Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2647 sessionId: src_id|98e3b41c-7234956d-1527dae7-7f74b883_0 is DEAD
2025-10-10T14:38:23.577718Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:23.577759Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 45 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602447160522890:11816]
2025-10-10T14:38:23.584960Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|98e3b41c-7234956d-1527dae7-7f74b883_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:23.585105Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:23.585127Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2648
2025-10-10T14:38:23.585280Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2648 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:23.585347Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2648 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:23.585359Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2648 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:23.585362Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:23.585840Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2648 sessionId:  describe result for acl check
2025-10-10T14:38:23.585888Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:23.585895Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:23.585897Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:23.585904Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602447160522908:12090] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:23.586537Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602447160522908:12090] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:23.590613Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602447160522908:12090] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:23.595262Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602447160522908:12090] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:23.595276Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602447160522908:12090] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:23.595280Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602447160522908:12090] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:23.595288Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2648 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:23.602280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:23.608563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:23.608886Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:23.608892Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:23.608910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:23.608992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:23.609045Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602446378286078:12035]
2025-10-10T14:38:23.609667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:23.610198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:23.610263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:23.610612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:23.610684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:23.610688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:23.610689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:23.610691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:23.610692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:23.610693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:23.610695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:23.610696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:23.610698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:23.610699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:23.610700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:23.610701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:23.610702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:23.610709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:23.610724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:23.610728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:23.610732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:23.610737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:23.610741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:23.610746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:23.610750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:23.610754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:23.610759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:23.610764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:23.610769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:23.610773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:23.610782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:23.610791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:23.610798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:23.610811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:23.610821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:23.610826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:23.610833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:23.610839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:23.610848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:23.610854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:23.610858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:23.610864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:23.610869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:23.610875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:23.610880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:23.610887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:23.610892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:23.610902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:23.610907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:23.610913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:23.610918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:23.610924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:23.610928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:23.610934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:23.610940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:23.610951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:23.610998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:23.614440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:23.615291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:23.615309Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:23.615312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:23.615315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:23.615323Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2647 [2:7559602446378286078:12035]
2025-10-10T14:38:23.615337Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:23.615356Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:23.615360Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:23.615365Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:23.615367Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:23.615385Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:23.615399Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:23.615408Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:23.615477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:23.615487Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:23.615489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:23.615492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:23.615570Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:23.615579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:23.615592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:23.615602Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:23.615617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:23.615644Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602446378286073:12035]
2025-10-10T14:38:23.615655Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602446378286073:12035]
2025-10-10T14:38:23.615659Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602446378286073:12035]
2025-10-10T14:38:23.615677Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:23.615697Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:23.615718Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:23.615727Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:23.615767Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602446378286073:12035]
2025-10-10T14:38:23.615781Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:23.615797Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:23.615800Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:23.615802Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:23.615808Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:23.615895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602447160523039:12090], now have 1 active actors on pipe
2025-10-10T14:38:23.615905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602447160522892:2438], now have 1 active actors on pipe
2025-10-10T14:38:23.615987Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2647
2025-10-10T14:38:23.616065Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2647
2025-10-10T14:38:23.616176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:23.616191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:23.616223Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b3ffe9ea-c7c1ba46-bc4c5b20-d11c4dae_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:23.616241Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:23.616246Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:23.616248Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:23.616262Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:23.616275Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:23.616290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:23.616480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:23.616494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:23.616514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:23.616611Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2648 partition: 0 MaxSeqNo: 40 sessionId: src_id|b3ffe9ea-c7c1ba46-bc4c5b20-d11c4dae_0
2025-10-10T14:38:23.617033Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98e3b41c-7234956d-1527dae7-7f74b883_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|b3ffe9ea-c7c1ba46-bc4c5b20-d11c4dae_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:23.619878Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b3ffe9ea-c7c1ba46-bc4c5b20-d11c4dae_0] Write session: try to update token
2025-10-10T14:38:23.619900Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b3ffe9ea-c7c1ba46-bc4c5b20-d11c4dae_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:23.628172Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:38:23.628190Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:23.628201Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602446378286073:12035]
2025-10-10T14:38:23.628256Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:38:23.628262Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:38:23.628433Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:38:23.628577Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:23.628715Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:23.628851Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:23.629061Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:38:23.629106Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:38:23.637868Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2648 sessionId: src_id|b3ffe9ea-c7c1ba46-bc4c5b20-d11c4dae_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:23.640719Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:23.640956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:23.640977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:23.641027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:38:23.641114Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:38:23.648429Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:23.648453Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:23.648457Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:23.648460Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:23.648474Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602446378286073:12035]
2025-10-10T14:38:23.648479Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602446378286073:12035]
2025-10-10T14:38:23.648483Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602446378286073:12035]
2025-10-10T14:38:23.648538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:23.648546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:23.648549Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:23.648565Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:23.648572Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:23.648577Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:23.648693Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:23.678176Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602447160523159:11816]
2025-10-10T14:38:23.678517Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 pipe creation result: OK TabletId: 72075186224037892 Generation: 2647, pipe: [1:7559602447160523159:11816]
2025-10-10T14:38:23.769270Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:23.778622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:23.778648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:23.778846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:23.778918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:23.778989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:23.779058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:23.779107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:23.779112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:23.779188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:23.779252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:23.779325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:23.779393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:23.779434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:23.779438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:23.779518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:23.779586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:23.779657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:23.779721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:23.780158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:23.780163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:23.780242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:23.780315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:23.780383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:23.780448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:23.780495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:23.780498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:23.780571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:23.780637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:23.780702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:23.780766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:23.780810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:23.780814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:23.780886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:23.780944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:23.781008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:23.781070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:23.781118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:23.781123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:23.781193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:23.781251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:23.781317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:23.781613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:23.781666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:23.781670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:23.781740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:23.781808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:23.781887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:23.781958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:23.782010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:23.782018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:23.782094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:23.782169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:23.782239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:23.782305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:23.782355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:23.782365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:23.782438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:23.782502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:23.782569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:23.782637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:23.782686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:23.782694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:23.782762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602447160523159:11816], now have 1 active actors on pipe
2025-10-10T14:38:23.782984Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:23.782999Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 46 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602447160523159:11816]
2025-10-10T14:38:23.783032Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:23.783034Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:23.783071Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2648 reason: error at write: Disconnected sessionId: src_id|b3ffe9ea-c7c1ba46-bc4c5b20-d11c4dae_0
2025-10-10T14:38:23.783502Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:23.783534Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3ffe9ea-c7c1ba46-bc4c5b20-d11c4dae_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:23.783546Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3ffe9ea-c7c1ba46-bc4c5b20-d11c4dae_0] Write session will restart in 0.007946s
2025-10-10T14:38:23.783571Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3ffe9ea-c7c1ba46-bc4c5b20-d11c4dae_0] Write session: Do CDS request
2025-10-10T14:38:23.783577Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3ffe9ea-c7c1ba46-bc4c5b20-d11c4dae_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:23.783819Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2648 sessionId: src_id|b3ffe9ea-c7c1ba46-bc4c5b20-d11c4dae_0 is DEAD
2025-10-10T14:38:23.793003Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b3ffe9ea-c7c1ba46-bc4c5b20-d11c4dae_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:23.793916Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:23.793936Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2649
2025-10-10T14:38:23.794153Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2649 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:23.794195Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2649 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:23.794209Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2649 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:23.794213Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:23.794685Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2649 sessionId:  describe result for acl check
2025-10-10T14:38:23.794722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:23.794734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:23.794736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:23.794744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602447160523199:12095] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:23.795325Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602447160523199:12095] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:23.798780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602447160523199:12095] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:23.802096Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602447160523199:12095] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:23.802128Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602447160523199:12095] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:23.802132Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602447160523199:12095] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:23.802141Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2649 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:23.807936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:23.810707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:23.811191Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:23.811210Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:23.811226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:23.811316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:23.811370Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602446378286316:12037]
2025-10-10T14:38:23.812010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:23.812369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:23.812428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:23.812766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:23.812840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:23.812846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:23.812848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:23.812849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:23.812851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:23.812853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:23.812854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:23.812856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:23.812857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:23.812858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:23.812860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:23.812861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:23.812863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:23.812870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:23.812885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:23.812889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:23.812893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:23.812896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:23.812900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:23.812904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:23.812908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:23.812912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:23.812918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:23.812923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:23.812927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:23.812931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:23.812939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:23.812951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:23.812958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:23.812971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:23.812976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:23.812986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:23.812991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:23.813015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:23.813027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:23.813033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:23.813042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:23.813048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:23.813053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:23.813063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:23.813067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:23.813073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:23.813080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:23.813090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:23.813096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:23.813106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:23.813111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:23.813121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:23.813126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:23.813136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:23.813141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:23.813152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:23.813200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:23.815745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:23.816347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:23.816364Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:23.816367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:23.816371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:23.816378Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2648 [2:7559602446378286316:12037]
2025-10-10T14:38:23.816393Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:23.816411Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:23.816420Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:23.816424Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:23.816426Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:23.816444Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:23.816456Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:23.816471Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:23.816539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:23.816548Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:23.816550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:23.816553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:23.816627Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:23.816635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:23.816647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:23.816664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:23.816679Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:23.816704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602447160523164:2438], now have 1 active actors on pipe
2025-10-10T14:38:23.816709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602447160523318:12095], now have 1 active actors on pipe
2025-10-10T14:38:23.816717Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602446378286311:12037]
2025-10-10T14:38:23.816725Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602446378286311:12037]
2025-10-10T14:38:23.816727Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602446378286311:12037]
2025-10-10T14:38:23.816741Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:23.816762Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:23.816763Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:23.816766Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:23.816768Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:23.816780Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:23.816783Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:23.816774Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2648
2025-10-10T14:38:23.816810Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602446378286311:12037]
2025-10-10T14:38:23.816825Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:23.816843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:23.816843Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:23.816854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:23.816889Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2648
2025-10-10T14:38:23.816912Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|305200da-15b22510-3915c146-2ed3d2e8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:23.816927Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:23.816932Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:23.816936Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:23.816949Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:23.816967Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:23.816991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:23.817164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:23.817175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:23.817193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:23.817264Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2649 partition: 0 MaxSeqNo: 40 sessionId: src_id|305200da-15b22510-3915c146-2ed3d2e8_0
2025-10-10T14:38:23.817669Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3ffe9ea-c7c1ba46-bc4c5b20-d11c4dae_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|305200da-15b22510-3915c146-2ed3d2e8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:23.820340Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|305200da-15b22510-3915c146-2ed3d2e8_0] Write session: try to update token
2025-10-10T14:38:23.820363Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|305200da-15b22510-3915c146-2ed3d2e8_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:23.835690Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2649 sessionId: src_id|305200da-15b22510-3915c146-2ed3d2e8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:23.837553Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:23.837578Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:23.837582Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:23.837584Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:23.837598Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602446378286311:12037]
2025-10-10T14:38:23.837603Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602446378286311:12037]
2025-10-10T14:38:23.837607Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602446378286311:12037]
2025-10-10T14:38:23.837658Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:23.837668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:23.837673Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:23.837677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:23.837677Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:23.837681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:23.837856Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:23.838705Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:23.882971Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602447160523440:11816]
2025-10-10T14:38:23.883285Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 pipe creation result: OK TabletId: 72075186224037892 Generation: 2648, pipe: [1:7559602447160523440:11816]
2025-10-10T14:38:23.960684Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:23.961171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:23.961188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:23.961237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602447160523440:11816], now have 1 active actors on pipe
2025-10-10T14:38:23.961640Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:23.961653Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 47 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602447160523440:11816]
2025-10-10T14:38:23.961658Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:23.961663Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:23.961701Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:23.961739Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2649 reason: error at write: Disconnected sessionId: src_id|305200da-15b22510-3915c146-2ed3d2e8_0
2025-10-10T14:38:23.961981Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2649 sessionId: src_id|305200da-15b22510-3915c146-2ed3d2e8_0 is DEAD
2025-10-10T14:38:23.962182Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|305200da-15b22510-3915c146-2ed3d2e8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:23.962194Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|305200da-15b22510-3915c146-2ed3d2e8_0] Write session will restart in 0.005335s
2025-10-10T14:38:23.962220Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|305200da-15b22510-3915c146-2ed3d2e8_0] Write session: Do CDS request
2025-10-10T14:38:23.962230Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|305200da-15b22510-3915c146-2ed3d2e8_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:23.968974Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|305200da-15b22510-3915c146-2ed3d2e8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:23.969081Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:23.969100Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2650
2025-10-10T14:38:23.969265Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2650 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:23.969307Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2650 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:23.969319Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2650 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:23.969323Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:23.969843Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2650 sessionId:  describe result for acl check
2025-10-10T14:38:23.969885Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:23.969904Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:23.969911Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:23.969919Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602447160523461:12099] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:23.970582Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602447160523461:12099] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:23.974304Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602447160523461:12099] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:23.977796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602447160523461:12099] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:23.977821Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602447160523461:12099] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:23.977825Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602447160523461:12099] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:23.977833Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2650 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:23.982934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:23.985657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:23.985961Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:23.985975Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:23.985988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:23.986070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:23.986134Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602446378286556:12039]
2025-10-10T14:38:23.986660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:23.987019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:23.987075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:23.987450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:23.987538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:23.987545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:23.987546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:23.987547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:23.987548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:23.987549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:23.987550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:23.987552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:23.987553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:23.987554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:23.987556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:23.987557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:23.987558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:23.987565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:23.987578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:23.987582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:23.987586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:23.987589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:23.987593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:23.987597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:23.987600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:23.987604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:23.987608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:23.987612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:23.987615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:23.987618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:23.987627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:23.987636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:23.987642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:23.987648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:23.987652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:23.987657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:23.987661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:23.987665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:23.987670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:23.987675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:23.987680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:23.987685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:23.987689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:23.987694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:23.987698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:23.987703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:23.987708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:23.987712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:23.987716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:23.987721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:23.987725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:23.987730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:23.987737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:23.987742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:23.987746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:23.987751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:23.987786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:23.990718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:23.991041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:23.991056Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:23.991062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:23.991067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:23.991077Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2649 [2:7559602446378286556:12039]
2025-10-10T14:38:23.991091Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:23.991109Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:23.991119Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:23.991123Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:23.991126Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:23.991146Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:23.991155Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:23.991164Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:23.991234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:23.991246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:23.991249Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:23.991252Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:23.991336Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:23.991345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:23.991358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:23.991370Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:23.991389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:23.991413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602447160523639:12099], now have 1 active actors on pipe
2025-10-10T14:38:23.991417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602447160523444:2438], now have 1 active actors on pipe
2025-10-10T14:38:23.991426Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602446378286551:12039]
2025-10-10T14:38:23.991428Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602446378286551:12039]
2025-10-10T14:38:23.991431Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602446378286551:12039]
2025-10-10T14:38:23.991445Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:23.991461Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:23.991480Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:23.991483Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:23.991520Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2649
2025-10-10T14:38:23.991520Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2649
2025-10-10T14:38:23.991513Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602446378286551:12039]
2025-10-10T14:38:23.991522Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:23.991579Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:23.991582Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:23.991584Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:23.991592Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:23.991779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:23.991785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:23.991818Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b542f061-60519561-48df9ff1-523400f4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:23.991837Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:23.991841Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:23.991849Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:23.991862Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:23.991878Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:23.991898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:23.992118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:23.992142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:23.992171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:23.992299Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2650 partition: 0 MaxSeqNo: 40 sessionId: src_id|b542f061-60519561-48df9ff1-523400f4_0
2025-10-10T14:38:23.992754Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|305200da-15b22510-3915c146-2ed3d2e8_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|b542f061-60519561-48df9ff1-523400f4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:23.995481Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b542f061-60519561-48df9ff1-523400f4_0] Write session: try to update token
2025-10-10T14:38:23.995502Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b542f061-60519561-48df9ff1-523400f4_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:24.015610Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:24.015637Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:24.015641Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:24.015644Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:24.015655Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602446378286551:12039]
2025-10-10T14:38:24.015660Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602446378286551:12039]
2025-10-10T14:38:24.015665Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602446378286551:12039]
2025-10-10T14:38:24.015718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:24.015719Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:24.015725Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:24.015727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:24.015730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:24.015730Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:24.015865Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:24.016145Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2650 sessionId: src_id|b542f061-60519561-48df9ff1-523400f4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:24.019231Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:24.061676Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602451455491006:11816]
2025-10-10T14:38:24.062053Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 pipe creation result: OK TabletId: 72075186224037892 Generation: 2649, pipe: [1:7559602451455491006:11816]
2025-10-10T14:38:24.140472Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:24.141190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:24.141218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:24.141271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602451455491006:11816], now have 1 active actors on pipe
2025-10-10T14:38:24.141549Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:24.141611Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:24.141624Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 48 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602451455491006:11816]
2025-10-10T14:38:24.141626Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:24.141646Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:24.141692Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2650 reason: error at write: Disconnected sessionId: src_id|b542f061-60519561-48df9ff1-523400f4_0
2025-10-10T14:38:24.141909Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2650 sessionId: src_id|b542f061-60519561-48df9ff1-523400f4_0 is DEAD
2025-10-10T14:38:24.142067Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b542f061-60519561-48df9ff1-523400f4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:24.142080Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b542f061-60519561-48df9ff1-523400f4_0] Write session will restart in 0.006429s
2025-10-10T14:38:24.142113Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b542f061-60519561-48df9ff1-523400f4_0] Write session: Do CDS request
2025-10-10T14:38:24.142122Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b542f061-60519561-48df9ff1-523400f4_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:24.149914Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b542f061-60519561-48df9ff1-523400f4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:24.149992Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:24.150010Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2651
2025-10-10T14:38:24.150162Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2651 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:24.150201Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2651 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:24.150215Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2651 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:24.150219Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:24.150718Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2651 sessionId:  describe result for acl check
2025-10-10T14:38:24.150757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:24.150759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:24.150761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:24.150767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602451455491027:12105] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:24.151256Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602451455491027:12105] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:24.155662Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602451455491027:12105] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:24.158241Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602451455491027:12105] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:24.158261Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602451455491027:12105] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:24.158264Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602451455491027:12105] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:24.158274Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2651 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:24.176192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:24.178747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:24.179014Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:24.179028Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:24.179042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:24.179111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:24.179159Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602450673254107:12041]
2025-10-10T14:38:24.179850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:24.180219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:24.180294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:24.180666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:24.180721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:24.180726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:24.180726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:24.180727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:24.180728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:24.180729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:24.180730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:24.180730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:24.180731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:24.180732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:24.180733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:24.180733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:24.180734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:24.180739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:24.180747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:24.180750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:24.180752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:24.180755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:24.180757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:24.180760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:24.180762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:24.180765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:24.180768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:24.180770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:24.180773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:24.180775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:24.180781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:24.180786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:24.180791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:24.180795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:24.180798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:24.180801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:24.180804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:24.180807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:24.180811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:24.180815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:24.180817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:24.180821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:24.180824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:24.180827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:24.180829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:24.180833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:24.180836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:24.180840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:24.180843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:24.180846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:24.180849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:24.180852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:24.180854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:24.180857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:24.180860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:24.180864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:24.180907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:24.183514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:24.184122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:24.184138Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:24.184141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:24.184145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:24.184151Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2650 [2:7559602450673254107:12041]
2025-10-10T14:38:24.184163Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:24.184181Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:24.184190Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:24.184194Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:24.184196Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:24.184215Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:24.184223Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:24.184231Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:24.184292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:24.184299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:24.184302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:24.184304Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:24.184373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:24.184396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:24.184408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:24.184419Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:24.184436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:24.184459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602451455491008:2438], now have 1 active actors on pipe
2025-10-10T14:38:24.184462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602451455491103:12105], now have 1 active actors on pipe
2025-10-10T14:38:24.184470Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602450673254102:12041]
2025-10-10T14:38:24.184472Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602450673254102:12041]
2025-10-10T14:38:24.184474Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602450673254102:12041]
2025-10-10T14:38:24.184487Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:24.184501Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:24.184501Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:24.184504Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:24.184506Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:24.184516Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:24.184519Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:24.184546Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602450673254102:12041]
2025-10-10T14:38:24.184553Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:24.184560Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:24.184859Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2650
2025-10-10T14:38:24.184906Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2650
2025-10-10T14:38:24.185043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:24.185057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:24.185087Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ded4c74c-dc40b025-61d38a7a-b1b6d69f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:24.185103Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:24.185107Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:24.185110Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:24.185122Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:24.185136Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:24.185151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:24.185284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:24.185292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:24.185305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:24.185394Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2651 partition: 0 MaxSeqNo: 40 sessionId: src_id|ded4c74c-dc40b025-61d38a7a-b1b6d69f_0
2025-10-10T14:38:24.185823Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b542f061-60519561-48df9ff1-523400f4_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|ded4c74c-dc40b025-61d38a7a-b1b6d69f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:24.188560Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ded4c74c-dc40b025-61d38a7a-b1b6d69f_0] Write session: try to update token
2025-10-10T14:38:24.188579Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ded4c74c-dc40b025-61d38a7a-b1b6d69f_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:24.202913Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2651 sessionId: src_id|ded4c74c-dc40b025-61d38a7a-b1b6d69f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:24.205763Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:24.206223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:24.206250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:24.206277Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:38:24.206280Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:24.206289Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602450673254102:12041]
2025-10-10T14:38:24.206327Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:38:24.206352Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:38:24.206553Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:38:24.206705Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:24.206846Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:24.206992Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:24.207188Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:38:24.207231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:38:24.207255Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:38:24.207351Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:38:24.218167Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:24.218188Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:24.218191Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:24.218193Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:24.218203Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602450673254102:12041]
2025-10-10T14:38:24.218206Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602450673254102:12041]
2025-10-10T14:38:24.218209Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602450673254102:12041]
2025-10-10T14:38:24.218259Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:24.218262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:24.218269Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:24.218272Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:24.218275Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:24.218280Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:24.218403Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:24.241879Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602451455491302:11816]
2025-10-10T14:38:24.242165Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 pipe creation result: OK TabletId: 72075186224037892 Generation: 2650, pipe: [1:7559602451455491302:11816]
2025-10-10T14:38:24.335318Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:24.344304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:24.344343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:24.344515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:24.344575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:24.344642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:24.344708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:24.344759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:24.344769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:24.344843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:24.344910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:24.344976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:24.345036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:24.345076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:24.345082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:24.345151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:24.345214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:24.345275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:24.345385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:24.345449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:24.345462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:24.345560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:24.345649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:24.345733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:24.345816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:24.345872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:24.345880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:24.345958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:24.346045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:24.346142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:24.346222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:24.346278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:24.346290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:24.346372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:24.346460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:24.346566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:24.346644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:24.346696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:24.346706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:24.346785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:24.346860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:24.346938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:24.347018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:24.347075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:24.347083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:24.347153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:24.347221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:24.347280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:24.347345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:24.347387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:24.347393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:24.347452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:24.347506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:24.347569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:24.347626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:24.347668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:24.347673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:24.347733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:24.347790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:24.347848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:24.347905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:24.347945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:24.347950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:24.348003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602451455491302:11816], now have 1 active actors on pipe
2025-10-10T14:38:24.348198Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:24.348243Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:24.348247Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:24.348269Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 49 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602451455491302:11816]
2025-10-10T14:38:24.348281Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2651 reason: error at write: Disconnected sessionId: src_id|ded4c74c-dc40b025-61d38a7a-b1b6d69f_0
2025-10-10T14:38:24.348521Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2651 sessionId: src_id|ded4c74c-dc40b025-61d38a7a-b1b6d69f_0 is DEAD
2025-10-10T14:38:24.348692Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ded4c74c-dc40b025-61d38a7a-b1b6d69f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:24.348700Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ded4c74c-dc40b025-61d38a7a-b1b6d69f_0] Write session will restart in 0.005750s
2025-10-10T14:38:24.348725Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ded4c74c-dc40b025-61d38a7a-b1b6d69f_0] Write session: Do CDS request
2025-10-10T14:38:24.348731Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ded4c74c-dc40b025-61d38a7a-b1b6d69f_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:24.349357Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:24.355986Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ded4c74c-dc40b025-61d38a7a-b1b6d69f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:24.356102Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:24.356120Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2652
2025-10-10T14:38:24.356289Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2652 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:24.356323Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2652 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:24.356334Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2652 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:24.356339Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:24.356787Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2652 sessionId:  describe result for acl check
2025-10-10T14:38:24.356822Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:24.356830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:24.356832Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:24.356839Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602451455491324:12116] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:24.357947Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602451455491324:12116] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:24.361270Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602451455491324:12116] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:24.367467Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602451455491324:12116] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:24.367485Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602451455491324:12116] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:24.367488Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602451455491324:12116] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:24.367500Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2652 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:24.368812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:24.371319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:24.371741Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:24.371756Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:24.371771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:24.371845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:24.371892Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602450673254384:12057]
2025-10-10T14:38:24.372558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:24.372891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:24.372943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:24.373289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:24.373364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:24.373371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:24.373372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:24.373373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:24.373375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:24.373377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:24.373379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:24.373380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:24.373382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:24.373383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:24.373384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:24.373386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:24.373387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:24.373394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:24.373408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:24.373413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:24.373417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:24.373421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:24.373425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:24.373429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:24.373434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:24.373438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:24.373443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:24.373447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:24.373451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:24.373455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:24.373463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:24.373471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:24.373478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:24.373485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:24.373489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:24.373495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:24.373499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:24.373504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:24.373509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:24.373514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:24.373519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:24.373524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:24.373529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:24.373542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:24.373546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:24.373552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:24.373563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:24.373568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:24.373577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:24.373583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:24.373591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:24.373596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:24.373601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:24.373610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:24.373616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:24.373625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:24.373666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:24.376122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:24.376729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:24.376750Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:24.376752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:24.376757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:24.376763Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2651 [2:7559602450673254384:12057]
2025-10-10T14:38:24.376776Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:24.376794Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:24.376802Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:24.376807Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:24.376809Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:24.376827Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:24.376840Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:24.376848Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:24.376907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:24.376913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:24.376915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:24.376918Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:24.376989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:24.377000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:24.377013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:24.377026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:24.377044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:24.377066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602451455491304:2438], now have 1 active actors on pipe
2025-10-10T14:38:24.377075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602451455491560:12116], now have 1 active actors on pipe
2025-10-10T14:38:24.377084Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602450673254367:12057]
2025-10-10T14:38:24.377091Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602450673254367:12057]
2025-10-10T14:38:24.377094Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602450673254367:12057]
2025-10-10T14:38:24.377110Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:24.377130Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:24.377135Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:24.377138Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:24.377141Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:24.377148Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:24.377151Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:24.377175Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602450673254367:12057]
2025-10-10T14:38:24.377187Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:24.377192Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:24.377122Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2651
2025-10-10T14:38:24.377164Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2651
2025-10-10T14:38:24.377365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:24.377381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:24.377412Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c2032258-87f7ef8f-b4a2fc93-fd83749c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:24.377421Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:24.377429Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:24.377432Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:24.377445Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:24.377458Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:24.377472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:24.377723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:24.377736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:24.377761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:24.377889Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2652 partition: 0 MaxSeqNo: 40 sessionId: src_id|c2032258-87f7ef8f-b4a2fc93-fd83749c_0
2025-10-10T14:38:24.378339Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ded4c74c-dc40b025-61d38a7a-b1b6d69f_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|c2032258-87f7ef8f-b4a2fc93-fd83749c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:24.381138Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c2032258-87f7ef8f-b4a2fc93-fd83749c_0] Write session: try to update token
2025-10-10T14:38:24.381156Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c2032258-87f7ef8f-b4a2fc93-fd83749c_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:24.389151Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:38:24.389170Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:24.389181Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602450673254367:12057]
2025-10-10T14:38:24.389236Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:38:24.389239Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:38:24.389458Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:38:24.389605Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:24.389756Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:24.389905Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:24.390142Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:38:24.390183Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:38:24.396549Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2652 sessionId: src_id|c2032258-87f7ef8f-b4a2fc93-fd83749c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:24.399317Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:24.399700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:24.399730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:24.399791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:38:24.399901Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:38:24.407915Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:24.407935Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:24.407938Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:24.407941Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:24.407953Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602450673254367:12057]
2025-10-10T14:38:24.407957Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602450673254367:12057]
2025-10-10T14:38:24.407961Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602450673254367:12057]
2025-10-10T14:38:24.408014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:24.408028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:24.408029Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:24.408031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:24.408037Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:24.408043Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:24.408189Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:24.448176Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602451455491575:11816]
2025-10-10T14:38:24.448511Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 pipe creation result: OK TabletId: 72075186224037892 Generation: 2651, pipe: [1:7559602451455491575:11816]
2025-10-10T14:38:24.525560Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:24.535083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:24.535116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:24.535303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:24.535378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:24.535458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:24.535529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:24.535588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:24.535594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:24.535672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:24.535731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:24.535791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:24.535855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:24.535899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:24.535903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:24.535972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:24.536033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:24.536093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:24.536169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:24.536217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:24.536220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:24.536289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:24.536354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:24.536415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:24.536475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:24.536519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:24.536523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:24.536590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:24.536654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:24.536716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:24.536780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:24.536827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:24.536831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:24.536898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:24.536957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:24.537020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:24.537083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:24.537131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:24.537134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:24.537204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:24.537261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:24.537319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:24.537588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:24.537637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:24.537645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:24.537712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:24.537776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:24.537835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:24.537893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:24.537933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:24.537937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:24.538007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:24.538066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:24.538176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:24.538239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:24.538282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:24.538285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:24.538353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:24.538413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:24.538475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:24.538535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:24.538579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:24.538582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:24.538658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602451455491575:11816], now have 1 active actors on pipe
2025-10-10T14:38:24.540308Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:24.540329Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:24.540373Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2652 reason: error at write: Disconnected sessionId: src_id|c2032258-87f7ef8f-b4a2fc93-fd83749c_0
2025-10-10T14:38:24.540386Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:24.540760Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c2032258-87f7ef8f-b4a2fc93-fd83749c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:24.540780Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c2032258-87f7ef8f-b4a2fc93-fd83749c_0] Write session will restart in 0.007316s
2025-10-10T14:38:24.540806Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c2032258-87f7ef8f-b4a2fc93-fd83749c_0] Write session: Do CDS request
2025-10-10T14:38:24.540812Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c2032258-87f7ef8f-b4a2fc93-fd83749c_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:24.540624Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2652 sessionId: src_id|c2032258-87f7ef8f-b4a2fc93-fd83749c_0 is DEAD
2025-10-10T14:38:24.540805Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 50 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602451455491575:11816]
2025-10-10T14:38:24.540821Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:24.553986Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c2032258-87f7ef8f-b4a2fc93-fd83749c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:24.557552Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:24.557571Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2653
2025-10-10T14:38:24.557825Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2653 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:24.557862Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2653 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:24.557869Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2653 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:24.557874Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:24.558334Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2653 sessionId:  describe result for acl check
2025-10-10T14:38:24.558366Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:24.558369Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:24.558371Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:24.558380Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602451455491680:12121] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:24.559113Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602451455491680:12121] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:24.582341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:24.580235Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602451455491680:12121] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:24.583390Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602451455491680:12121] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:24.583407Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602451455491680:12121] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:24.583412Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602451455491680:12121] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:24.583422Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2653 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:24.585681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:24.585932Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:24.585938Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:24.585950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:24.586009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:24.586052Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602450673254626:12060]
2025-10-10T14:38:24.586741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:24.587211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:24.587318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:24.587676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:24.587741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:24.587742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:24.587743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:24.587744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:24.587745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:24.587747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:24.587748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:24.587750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:24.587751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:24.587753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:24.587754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:24.587755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:24.587756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:24.587764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:24.587778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:24.587782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:24.587787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:24.587792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:24.587795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:24.587800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:24.587804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:24.587808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:24.587813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:24.587816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:24.587820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:24.587824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:24.587842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:24.587852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:24.587859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:24.587865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:24.587871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:24.587876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:24.587881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:24.587886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:24.587891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:24.587898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:24.587903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:24.587909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:24.587914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:24.587920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:24.587925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:24.587931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:24.587936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:24.587941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:24.587946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:24.587952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:24.587957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:24.587962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:24.587967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:24.587972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:24.587976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:24.587981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:24.588022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:24.594800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:24.595180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:24.595187Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:24.595190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:24.595195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:24.595203Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2652 [2:7559602450673254626:12060]
2025-10-10T14:38:24.595218Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:24.595242Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:24.595245Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:24.595249Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:24.595252Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:24.595272Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:24.595283Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:24.595291Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:24.595361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:24.595363Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:24.595365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:24.595368Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:24.595462Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:24.595465Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:24.595476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:24.595487Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:24.595504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:24.595526Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602450673254619:12060]
2025-10-10T14:38:24.595528Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602450673254619:12060]
2025-10-10T14:38:24.595531Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602450673254619:12060]
2025-10-10T14:38:24.595541Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:24.595553Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:24.595556Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:24.595556Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:24.595572Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:24.595572Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:24.595574Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:24.595586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602451455491862:12121], now have 1 active actors on pipe
2025-10-10T14:38:24.595589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602451455491595:2438], now have 1 active actors on pipe
2025-10-10T14:38:24.595629Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602450673254619:12060]
2025-10-10T14:38:24.595639Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:24.595662Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:24.596166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:24.596179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:24.596216Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f3ef4841-41435d93-ed4257f5-58ee6d6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:24.596226Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:24.596230Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:24.596233Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:24.596245Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:24.596258Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:24.596276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:24.596511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:24.596533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:24.596556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:24.597129Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c2032258-87f7ef8f-b4a2fc93-fd83749c_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|f3ef4841-41435d93-ed4257f5-58ee6d6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:24.596034Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2652
2025-10-10T14:38:24.596068Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2652
2025-10-10T14:38:24.596654Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2653 partition: 0 MaxSeqNo: 40 sessionId: src_id|f3ef4841-41435d93-ed4257f5-58ee6d6_0
2025-10-10T14:38:24.600151Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f3ef4841-41435d93-ed4257f5-58ee6d6_0] Write session: try to update token
2025-10-10T14:38:24.600175Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f3ef4841-41435d93-ed4257f5-58ee6d6_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:24.623787Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2653 sessionId: src_id|f3ef4841-41435d93-ed4257f5-58ee6d6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:24.625051Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:38:24.625070Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:24.625083Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602450673254619:12060]
2025-10-10T14:38:24.625130Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:38:24.625137Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:38:24.625354Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:38:24.625502Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:24.625645Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:24.625785Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:24.625989Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:38:24.626027Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:38:24.626787Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:24.627601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:24.627624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:24.627660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:38:24.627762Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:38:24.640211Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602451455491874:11816]
2025-10-10T14:38:24.647488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602451455491874:11816], now have 1 active actors on pipe
2025-10-10T14:38:24.648121Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 pipe creation result: OK TabletId: 72075186224037892 Generation: 2652, pipe: [1:7559602451455491874:11816]
2025-10-10T14:38:24.668690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:24.668732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:24.668939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:24.669011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:24.669098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:24.669173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:24.669227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:24.669233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:24.669315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:24.669448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:24.669524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:24.669602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:24.669654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:24.669662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:24.669740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:24.669813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:24.669885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:24.669958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:24.670009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:24.670017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:24.670090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:24.670177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:24.670249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:24.670319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:24.670368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:24.670377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:24.670448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:24.670515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:24.670582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:24.670649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:24.670708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:24.670717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:24.670789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:24.670857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:24.670926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:24.671003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:24.671051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:24.671059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:24.671132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:24.671200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:24.671273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:24.671343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:24.671402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:24.671415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:24.671488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:24.671545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:24.671606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:24.671669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:24.671786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:24.671790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:24.671862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:24.671923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:24.671985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:24.672046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:24.672088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:24.672092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:24.672167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:24.672224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:24.672283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:24.672346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:24.672391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:24.672394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:24.672478Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:24.672482Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:24.672486Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:24.672489Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:24.672499Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602450673254619:12060]
2025-10-10T14:38:24.672502Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602450673254619:12060]
2025-10-10T14:38:24.672507Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602450673254619:12060]
2025-10-10T14:38:24.672570Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:38:24.672579Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:24.672589Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:24.672593Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:24.672643Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:24.672672Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:24.672675Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-10T14:38:24.672711Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 41 partNo 0
2025-10-10T14:38:24.672725Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 41 partNo 1
2025-10-10T14:38:24.672729Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 41 partNo 2
2025-10-10T14:38:24.672733Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 41 partNo 3
2025-10-10T14:38:24.672736Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 41 partNo 4
2025-10-10T14:38:24.673168Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 41 partNo 4 FormedBlobsCount 0 NewHead: Offset 40 PartNo 0 PackedSize 2253230 count 1 nextOffset 41 batches 5
2025-10-10T14:38:24.673189Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 42 partNo 0
2025-10-10T14:38:24.673198Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 42 partNo 1
2025-10-10T14:38:24.673202Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 42 partNo 2
2025-10-10T14:38:24.673205Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 42 partNo 3
2025-10-10T14:38:24.673209Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 42 partNo 4
2025-10-10T14:38:24.673969Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 42 partNo 4 FormedBlobsCount 0 NewHead: Offset 40 PartNo 0 PackedSize 4506428 count 2 nextOffset 42 batches 9
2025-10-10T14:38:24.674004Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 43 partNo 0
2025-10-10T14:38:24.674018Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 43 partNo 1
2025-10-10T14:38:24.674021Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 43 partNo 2
2025-10-10T14:38:24.674026Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 43 partNo 3
2025-10-10T14:38:24.674029Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 43 partNo 4
2025-10-10T14:38:24.674812Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 43 partNo 4 FormedBlobsCount 0 NewHead: Offset 40 PartNo 0 PackedSize 6759626 count 3 nextOffset 43 batches 13
2025-10-10T14:38:24.674841Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 44 partNo 0
2025-10-10T14:38:24.674849Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 44 partNo 1
2025-10-10T14:38:24.674852Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 44 partNo 2
2025-10-10T14:38:24.674856Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 44 partNo 3
2025-10-10T14:38:24.677290Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 44 partNo 3 result is x0000000000_00000000000000000040_00000_0000000003_00015? size 8295638
2025-10-10T14:38:24.677319Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 44 partNo 4
2025-10-10T14:38:24.677358Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000040_00000_0000000003_00015? new key d0000000000_00000000000000000040_00000_0000000003_00015? size 8295638 WTime 1760107104677
2025-10-10T14:38:24.678012Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 44 partNo 4 FormedBlobsCount 1 NewHead: Offset 43 PartNo 3 PackedSize 717145 count 1 nextOffset 44 batches 2
2025-10-10T14:38:24.678039Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 45 partNo 0
2025-10-10T14:38:24.678053Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 45 partNo 1
2025-10-10T14:38:24.678060Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 45 partNo 2
2025-10-10T14:38:24.678063Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 45 partNo 3
2025-10-10T14:38:24.678066Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 45 partNo 4
2025-10-10T14:38:24.678621Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 45 partNo 4 FormedBlobsCount 0 NewHead: Offset 43 PartNo 3 PackedSize 2970343 count 2 nextOffset 45 batches 6
2025-10-10T14:38:24.678649Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 0
2025-10-10T14:38:24.678655Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 1
2025-10-10T14:38:24.678658Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 2
2025-10-10T14:38:24.678661Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 3
2025-10-10T14:38:24.678664Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 4
2025-10-10T14:38:24.679126Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 46 partNo 4 FormedBlobsCount 0 NewHead: Offset 43 PartNo 3 PackedSize 5223541 count 3 nextOffset 46 batches 10
2025-10-10T14:38:24.679146Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 0
2025-10-10T14:38:24.679154Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 1
2025-10-10T14:38:24.679166Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 2
2025-10-10T14:38:24.679170Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 3
2025-10-10T14:38:24.679173Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 4
2025-10-10T14:38:24.679895Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 47 partNo 4 FormedBlobsCount 0 NewHead: Offset 43 PartNo 3 PackedSize 7476739 count 4 nextOffset 47 batches 14
2025-10-10T14:38:24.679917Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 0
2025-10-10T14:38:24.679923Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 1
2025-10-10T14:38:24.681075Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 48 partNo 1 result is x0000000000_00000000000000000043_00003_0000000004_00014? size 7988760
2025-10-10T14:38:24.681097Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 2
2025-10-10T14:38:24.681104Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 3
2025-10-10T14:38:24.681107Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 4
2025-10-10T14:38:24.681116Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000043_00003_0000000004_00014? new key d0000000000_00000000000000000043_00003_0000000004_00014? size 7988760 WTime 1760107104681
2025-10-10T14:38:24.681418Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 48 partNo 4 FormedBlobsCount 1 NewHead: Offset 47 PartNo 1 PackedSize 1741199 count 1 nextOffset 48 batches 4
2025-10-10T14:38:24.681433Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 49 partNo 0
2025-10-10T14:38:24.681442Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 49 partNo 1
2025-10-10T14:38:24.681452Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 49 partNo 2
2025-10-10T14:38:24.681456Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 49 partNo 3
2025-10-10T14:38:24.681459Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 49 partNo 4
2025-10-10T14:38:24.681923Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 49 partNo 4 FormedBlobsCount 0 NewHead: Offset 47 PartNo 1 PackedSize 3994397 count 2 nextOffset 49 batches 8
2025-10-10T14:38:24.681946Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 50 partNo 0
2025-10-10T14:38:24.681954Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 50 partNo 1
2025-10-10T14:38:24.681959Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 50 partNo 2
2025-10-10T14:38:24.681962Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 50 partNo 3
2025-10-10T14:38:24.681966Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 50 partNo 4
2025-10-10T14:38:24.682591Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 50 partNo 4 FormedBlobsCount 0 NewHead: Offset 47 PartNo 1 PackedSize 6247595 count 3 nextOffset 50 batches 12
2025-10-10T14:38:24.682611Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:24.682695Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 47,3 HeadOffset 40 endOffset 40 curOffset 50 d0000000000_00000000000000000047_00001_0000000003_00011? size 6247585 WTime 1760107104682
2025-10-10T14:38:24.686353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:24.686372Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:24.686375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:24.686533Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:24.804947Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:24.805509Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:38:24.805544Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 40 partNo 0 count 3 size 8295638
2025-10-10T14:38:24.805557Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 43 partNo 3 count 4 size 7988760
2025-10-10T14:38:24.805570Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 47 partNo 1 count 3 size 6247585
2025-10-10T14:38:24.805816Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:24.805969Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:24.805979Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:24.805986Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:24.806039Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 51 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602451455491874:11816]
2025-10-10T14:38:24.806364Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2653 reason: error at write: Disconnected sessionId: src_id|f3ef4841-41435d93-ed4257f5-58ee6d6_0
2025-10-10T14:38:24.806745Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3ef4841-41435d93-ed4257f5-58ee6d6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:24.806768Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3ef4841-41435d93-ed4257f5-58ee6d6_0] Write session will restart in 0.006113s
2025-10-10T14:38:24.806795Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3ef4841-41435d93-ed4257f5-58ee6d6_0] Write session: Do CDS request
2025-10-10T14:38:24.806804Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3ef4841-41435d93-ed4257f5-58ee6d6_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:24.806588Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2653 sessionId: src_id|f3ef4841-41435d93-ed4257f5-58ee6d6_0 is DEAD
2025-10-10T14:38:24.816797Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f3ef4841-41435d93-ed4257f5-58ee6d6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:24.816850Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:24.816869Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2654
2025-10-10T14:38:24.817057Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2654 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:24.817111Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2654 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:24.817123Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2654 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:24.817127Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:24.817692Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2654 sessionId:  describe result for acl check
2025-10-10T14:38:24.817734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:24.817741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:24.817743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:24.817750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602451455491918:12126] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:24.818329Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602451455491918:12126] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:24.822267Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602451455491918:12126] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:24.826578Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602451455491918:12126] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:24.826595Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602451455491918:12126] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:24.826599Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602451455491918:12126] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:24.826609Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2654 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:24.829221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:24.831792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:24.832041Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:24.832052Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:24.832070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:24.832139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:24.832184Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602450673254869:12062]
2025-10-10T14:38:24.832842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:24.833175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:24.833219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:24.833554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:24.833615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:24.833622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:24.833624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:24.833625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:24.833627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:24.833628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:24.833629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:24.833630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:24.833632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:24.833633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:24.833634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:24.833635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:24.833637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:24.833643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:24.833657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:24.833661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:24.833665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:24.833670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:24.833674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:24.833678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:24.833682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:24.833686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:24.833690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:24.833694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:24.833698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:24.833702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:24.833711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:24.833719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:24.833726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:24.833732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:24.833736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:24.833741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:24.833746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:24.833751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:24.833756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:24.833761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:24.833766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:24.833772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:24.833776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:24.833782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:24.833786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:24.833791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:24.833796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:24.833802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:24.833806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:24.833812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:24.833825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:24.833836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:24.833841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:24.833851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:24.833855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:24.833860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:24.833906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:24.836459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:24.837067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:24.837079Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:24.837081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:24.837086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:24.837093Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2653 [2:7559602450673254869:12062]
2025-10-10T14:38:24.837106Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:24.837123Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:24.837126Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:24.837129Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:24.837132Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:24.837149Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:24.837157Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:24.837171Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:24.837248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:24.837256Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:24.837257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:24.837260Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:24.837350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:24.837359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:24.837371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:24.837386Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:24.837404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:24.837431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602451455492130:12126], now have 1 active actors on pipe
2025-10-10T14:38:24.837439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602451455491885:2438], now have 1 active actors on pipe
2025-10-10T14:38:24.837448Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602450673254864:12062]
2025-10-10T14:38:24.837450Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602450673254864:12062]
2025-10-10T14:38:24.837453Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602450673254864:12062]
2025-10-10T14:38:24.837469Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:24.837486Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:24.837488Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:24.837495Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:24.837498Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:24.837503Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:24.837471Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2653
2025-10-10T14:38:24.837507Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:24.837483Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2653
2025-10-10T14:38:24.837551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:24.837564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:24.837583Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602450673254864:12062]
2025-10-10T14:38:24.837593Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:24.837611Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:24.837624Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|eb89f663-6c0e12be-cf2d0c8f-cf8cde92_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:24.837632Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:24.837641Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:24.837644Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:24.837656Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:24.837672Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:24.837704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:24.837969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:24.837978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:24.838002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:24.838113Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2654 partition: 0 MaxSeqNo: 40 sessionId: src_id|eb89f663-6c0e12be-cf2d0c8f-cf8cde92_0
2025-10-10T14:38:24.838546Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3ef4841-41435d93-ed4257f5-58ee6d6_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|eb89f663-6c0e12be-cf2d0c8f-cf8cde92_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:24.841278Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eb89f663-6c0e12be-cf2d0c8f-cf8cde92_0] Write session: try to update token
2025-10-10T14:38:24.841300Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eb89f663-6c0e12be-cf2d0c8f-cf8cde92_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:24.856025Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2654 sessionId: src_id|eb89f663-6c0e12be-cf2d0c8f-cf8cde92_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:24.857586Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:24.857607Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:24.857611Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:24.857613Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:24.857623Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602450673254864:12062]
2025-10-10T14:38:24.857628Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602450673254864:12062]
2025-10-10T14:38:24.857632Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602450673254864:12062]
2025-10-10T14:38:24.857679Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:24.857682Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:24.857690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:24.857692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:24.857695Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:24.857699Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:24.857832Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:24.858678Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:24.905950Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602451455492161:11816]
2025-10-10T14:38:24.906334Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 pipe creation result: OK TabletId: 72075186224037892 Generation: 2653, pipe: [1:7559602451455492161:11816]
2025-10-10T14:38:24.972996Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:24.973921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:24.973937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:24.973989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602451455492161:11816], now have 1 active actors on pipe
2025-10-10T14:38:24.974299Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:24.977418Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:24.977501Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 52 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602451455492161:11816]
2025-10-10T14:38:24.977528Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:38:24.977616Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2654 reason: status is not ok: tablet will be restarted right now sessionId: src_id|eb89f663-6c0e12be-cf2d0c8f-cf8cde92_0
2025-10-10T14:38:24.977834Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2654 sessionId: src_id|eb89f663-6c0e12be-cf2d0c8f-cf8cde92_0 is DEAD
2025-10-10T14:38:24.981433Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb89f663-6c0e12be-cf2d0c8f-cf8cde92_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:38:24.981449Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb89f663-6c0e12be-cf2d0c8f-cf8cde92_0] Write session will restart in 0.005601s
2025-10-10T14:38:24.981477Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb89f663-6c0e12be-cf2d0c8f-cf8cde92_0] Write session: Do CDS request
2025-10-10T14:38:24.981483Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb89f663-6c0e12be-cf2d0c8f-cf8cde92_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:24.989890Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eb89f663-6c0e12be-cf2d0c8f-cf8cde92_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:24.993417Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:24.993436Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2655
2025-10-10T14:38:24.993646Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2655 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:24.993681Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2655 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:24.993687Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2655 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:24.993690Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:24.994117Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2655 sessionId:  describe result for acl check
2025-10-10T14:38:24.994149Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:24.994151Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:24.994153Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:24.994160Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602451455492369:12130] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:24.994767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602451455492369:12130] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:24.997404Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602451455492369:12130] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:25.003392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:25.006027Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602451455492369:12130] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:25.006047Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602451455492369:12130] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:25.006052Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602451455492369:12130] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:25.006063Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2655 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:25.011986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:25.012196Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:25.012204Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:25.012215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:25.012260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:25.012294Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602454968222408:12064]
2025-10-10T14:38:25.012775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:25.013186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:25.013225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:25.013524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:25.013591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:25.013598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:25.013599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:25.013601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:25.013602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:25.013603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:25.013605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:25.013606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:25.013608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:25.013609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:25.013611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:25.013612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:25.013614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:25.013620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:25.013634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:25.013639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:25.013644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:25.013649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:25.013653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:25.013657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:25.013662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:25.013666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:25.013671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:25.013675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:25.013679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:25.013684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:25.013693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:25.013703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:25.013716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:25.013722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:25.013727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:25.013732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:25.013737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:25.013743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:25.013748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:25.013753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:25.013758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:25.013764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:25.013769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:25.013772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:25.013775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:25.013779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:25.013782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:25.013785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:25.013788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:25.013792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:25.013794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:25.013797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:25.013800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:25.013804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:25.013807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:25.013811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:25.013834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:25.026426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:25.026764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:25.026781Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:25.026784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:25.026789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:25.026796Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2654 [2:7559602454968222408:12064]
2025-10-10T14:38:25.026813Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:25.026837Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:25.026841Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:25.026846Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:25.026849Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:25.026872Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:25.026881Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:25.026892Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:25.026968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:25.026971Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:25.026976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:25.026979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:25.027097Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:25.027101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:25.027115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:25.027128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:25.027147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:25.027182Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602454968222402:12064]
2025-10-10T14:38:25.027185Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602454968222402:12064]
2025-10-10T14:38:25.027188Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602454968222402:12064]
2025-10-10T14:38:25.027206Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:25.027224Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:25.027240Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:25.027244Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:25.027262Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:25.027266Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:25.027269Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:25.027292Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602454968222402:12064]
2025-10-10T14:38:25.027296Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:25.027374Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:25.027590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602451455492167:2438], now have 1 active actors on pipe
2025-10-10T14:38:25.027594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602455750459717:12130], now have 1 active actors on pipe
2025-10-10T14:38:25.029762Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2654
2025-10-10T14:38:25.029810Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2654
2025-10-10T14:38:25.030018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:25.030034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:25.030072Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e6e23d26-37563def-cb88c90c-bd10b978_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:25.030103Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:25.030115Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:25.030118Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:25.030134Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:25.030157Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:25.030183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:25.033399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:25.033423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:25.033470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:25.033691Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2655 partition: 0 MaxSeqNo: 40 sessionId: src_id|e6e23d26-37563def-cb88c90c-bd10b978_0
2025-10-10T14:38:25.037460Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb89f663-6c0e12be-cf2d0c8f-cf8cde92_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|e6e23d26-37563def-cb88c90c-bd10b978_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:25.040263Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6e23d26-37563def-cb88c90c-bd10b978_0] Write session: try to update token
2025-10-10T14:38:25.040287Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6e23d26-37563def-cb88c90c-bd10b978_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:25.058911Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:25.058933Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:25.058937Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:25.058939Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:25.058949Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602454968222402:12064]
2025-10-10T14:38:25.058955Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602454968222402:12064]
2025-10-10T14:38:25.058959Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602454968222402:12064]
2025-10-10T14:38:25.059011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:25.059019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:25.059022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:25.059158Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:25.061394Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:25.061413Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:25.061419Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:25.063114Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2655 sessionId: src_id|e6e23d26-37563def-cb88c90c-bd10b978_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:25.065867Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:25.077430Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602455750459730:11816]
2025-10-10T14:38:25.081787Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 pipe creation result: OK TabletId: 72075186224037892 Generation: 2654, pipe: [1:7559602455750459730:11816]
2025-10-10T14:38:25.179679Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:25.180128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:25.180150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:25.180202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602455750459730:11816], now have 1 active actors on pipe
2025-10-10T14:38:25.180487Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:25.181209Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6e23d26-37563def-cb88c90c-bd10b978_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:38:25.181227Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6e23d26-37563def-cb88c90c-bd10b978_0] Write session will restart in 0.009522s
2025-10-10T14:38:25.181252Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6e23d26-37563def-cb88c90c-bd10b978_0] Write session: Do CDS request
2025-10-10T14:38:25.181259Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6e23d26-37563def-cb88c90c-bd10b978_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:25.180683Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 53 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602455750459730:11816]
2025-10-10T14:38:25.180721Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:38:25.180741Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:25.180817Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2655 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e6e23d26-37563def-cb88c90c-bd10b978_0
2025-10-10T14:38:25.181040Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2655 sessionId: src_id|e6e23d26-37563def-cb88c90c-bd10b978_0 is DEAD
2025-10-10T14:38:25.191920Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6e23d26-37563def-cb88c90c-bd10b978_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:25.192445Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:25.192463Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2656
2025-10-10T14:38:25.192614Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2656 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:25.192650Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2656 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:25.192663Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2656 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:25.192667Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:25.193108Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2656 sessionId:  describe result for acl check
2025-10-10T14:38:25.193146Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:25.193152Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:25.193154Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:25.193161Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602455750459827:12134] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:25.193770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602455750459827:12134] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:25.198306Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602455750459827:12134] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:25.201970Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602455750459827:12134] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:25.201985Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602455750459827:12134] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:25.201989Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602455750459827:12134] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:25.201998Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2656 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:25.203426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:25.206616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:25.206882Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:25.206889Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:25.206904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:25.206979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:25.207023Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602454968222654:12067]
2025-10-10T14:38:25.207674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:25.208074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:25.208144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:25.208505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:25.208565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:25.208566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:25.208567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:25.208567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:25.208568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:25.208569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:25.208570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:25.208571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:25.208572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:25.208573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:25.208573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:25.208574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:25.208575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:25.208580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:25.208588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:25.208591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:25.208594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:25.208596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:25.208598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:25.208601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:25.208603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:25.208605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:25.208608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:25.208610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:25.208612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:25.208614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:25.208620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:25.208627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:25.208632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:25.208635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:25.208641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:25.208644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:25.208647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:25.208650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:25.208653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:25.208656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:25.208659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:25.208662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:25.208667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:25.208670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:25.208673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:25.208676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:25.208679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:25.208682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:25.208685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:25.208689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:25.208692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:25.208695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:25.208698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:25.208701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:25.208706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:25.208709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:25.208744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:25.221173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:25.221705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:25.221710Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:25.221715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:25.221719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:25.221726Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2655 [2:7559602454968222654:12067]
2025-10-10T14:38:25.221740Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:25.221759Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:25.221763Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:25.221766Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:25.221770Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:25.221789Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:25.221799Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:25.221806Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:25.221863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:25.221865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:25.221867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:25.221869Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:25.221942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:25.221944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:25.221955Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:25.221966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:25.221982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:25.222002Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602454968222649:12067]
2025-10-10T14:38:25.222005Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602454968222649:12067]
2025-10-10T14:38:25.222006Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602454968222649:12067]
2025-10-10T14:38:25.222025Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:25.222039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602455750459732:2438], now have 1 active actors on pipe
2025-10-10T14:38:25.222042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602455750459992:12134], now have 1 active actors on pipe
2025-10-10T14:38:25.222050Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:25.222064Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:25.222067Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:25.222119Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602454968222649:12067]
2025-10-10T14:38:25.222121Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:25.222472Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:25.222480Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:25.222482Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:25.222489Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:25.223187Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2655
2025-10-10T14:38:25.223229Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2655
2025-10-10T14:38:25.224154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:25.224168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:25.224207Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c3ee54a6-caa88ad0-40f1089e-deb682ae_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:25.224218Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:25.224223Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:25.224226Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:25.224239Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:25.224258Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:25.224281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:25.225744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:25.225754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:25.225791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:25.226028Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2656 partition: 0 MaxSeqNo: 40 sessionId: src_id|c3ee54a6-caa88ad0-40f1089e-deb682ae_0
2025-10-10T14:38:25.226466Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6e23d26-37563def-cb88c90c-bd10b978_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|c3ee54a6-caa88ad0-40f1089e-deb682ae_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:25.229111Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c3ee54a6-caa88ad0-40f1089e-deb682ae_0] Write session: try to update token
2025-10-10T14:38:25.229127Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c3ee54a6-caa88ad0-40f1089e-deb682ae_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:25.236389Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:38:25.236410Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:25.236424Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602454968222649:12067]
2025-10-10T14:38:25.236492Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:38:25.236805Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:38:25.237026Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:25.237242Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:25.237290Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:38:25.237453Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:25.237872Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:38:25.237926Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:38:25.245542Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2656 sessionId: src_id|c3ee54a6-caa88ad0-40f1089e-deb682ae_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:25.248194Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:25.248540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:25.248564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:25.248608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:38:25.248725Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:38:25.254379Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:25.254401Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:25.254405Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:25.254406Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:25.254417Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602454968222649:12067]
2025-10-10T14:38:25.254421Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602454968222649:12067]
2025-10-10T14:38:25.254425Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602454968222649:12067]
2025-10-10T14:38:25.254463Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:25.254473Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:25.254475Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:25.254481Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:25.254484Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:25.254487Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:25.254627Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:25.280756Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602455750460031:11816]
2025-10-10T14:38:25.281153Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 pipe creation result: OK TabletId: 72075186224037892 Generation: 2655, pipe: [1:7559602455750460031:11816]
2025-10-10T14:38:25.372832Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:25.381749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:25.381778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:25.381971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:25.382046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:25.382129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:25.382196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:25.382806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:25.382815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:25.382896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:25.382963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:25.383032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:25.383110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:25.383155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:25.383158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:25.383252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:25.383328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:25.383400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:25.383474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:25.383525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:25.383528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:25.383605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:25.383675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:25.383746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:25.383820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:25.383867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:25.383869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:25.383945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:25.384010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:25.384074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:25.384145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:25.384190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:25.384193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:25.384272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:25.384339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:25.384415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:25.384481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:25.384528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:25.384531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:25.384616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:25.384682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:25.384749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:25.385035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:25.385093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:25.385101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:25.385183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:25.385261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:25.385348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:25.385422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:25.385481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:25.385489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:25.385568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:25.385640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:25.385717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:25.385799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:25.385853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:25.385861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:25.385946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:25.386019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:25.386102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:25.386179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:25.386235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:25.386243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:25.386320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602455750460031:11816], now have 1 active actors on pipe
2025-10-10T14:38:25.386677Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 54 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602455750460031:11816]
2025-10-10T14:38:25.386719Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:25.386769Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:25.386777Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:25.386810Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2656 reason: error at write: Disconnected sessionId: src_id|c3ee54a6-caa88ad0-40f1089e-deb682ae_0
2025-10-10T14:38:25.387036Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:25.387052Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2656 sessionId: src_id|c3ee54a6-caa88ad0-40f1089e-deb682ae_0 is DEAD
2025-10-10T14:38:25.389454Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3ee54a6-caa88ad0-40f1089e-deb682ae_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:25.389469Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3ee54a6-caa88ad0-40f1089e-deb682ae_0] Write session will restart in 0.007474s
2025-10-10T14:38:25.389497Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3ee54a6-caa88ad0-40f1089e-deb682ae_0] Write session: Do CDS request
2025-10-10T14:38:25.389503Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3ee54a6-caa88ad0-40f1089e-deb682ae_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:25.397982Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c3ee54a6-caa88ad0-40f1089e-deb682ae_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:25.398070Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:25.398112Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2657
2025-10-10T14:38:25.398264Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2657 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:25.398303Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2657 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:25.398309Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2657 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:25.398315Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:25.399043Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2657 sessionId:  describe result for acl check
2025-10-10T14:38:25.399086Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:25.399088Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:25.399091Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:25.399097Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602455750460097:12147] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:25.399733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602455750460097:12147] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:25.403743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602455750460097:12147] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:25.408084Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602455750460097:12147] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:25.408103Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602455750460097:12147] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:25.408107Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602455750460097:12147] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:25.408118Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2657 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:25.413672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:25.416840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:25.417254Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:25.417265Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:25.417280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:25.417370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:25.417421Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602454968222951:12083]
2025-10-10T14:38:25.418038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:25.418477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:25.418540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:25.418945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:25.419028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:25.419038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:25.419040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:25.419041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:25.419043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:25.419044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:25.419046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:25.419048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:25.419049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:25.419050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:25.419052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:25.419053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:25.419054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:25.419062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:25.419077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:25.419082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:25.419087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:25.419091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:25.419096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:25.419100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:25.419105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:25.419109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:25.419115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:25.419119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:25.419123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:25.419127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:25.419136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:25.419146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:25.419153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:25.419160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:25.419168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:25.419180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:25.419186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:25.419192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:25.419203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:25.419209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:25.419219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:25.419225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:25.419230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:25.419235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:25.419240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:25.419246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:25.419255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:25.419265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:25.419271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:25.419277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:25.419286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:25.419292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:25.419297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:25.419303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:25.419312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:25.419317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:25.419360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:25.422953Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2656
2025-10-10T14:38:25.422960Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2656
2025-10-10T14:38:25.422150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:25.422485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:25.422490Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:25.422493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:25.422497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:25.422504Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2656 [2:7559602454968222951:12083]
2025-10-10T14:38:25.422539Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:25.422557Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:25.422561Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:25.422565Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:25.422568Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:25.422587Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:25.422595Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:25.422603Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:25.422680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:25.422682Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:25.422684Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:25.422688Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:25.422774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:25.422778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:25.422793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:25.422805Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:25.422824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:25.422848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602455750460228:12147], now have 1 active actors on pipe
2025-10-10T14:38:25.422852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602455750460034:2438], now have 1 active actors on pipe
2025-10-10T14:38:25.422859Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602454968222946:12083]
2025-10-10T14:38:25.422862Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602454968222946:12083]
2025-10-10T14:38:25.422864Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602454968222946:12083]
2025-10-10T14:38:25.422879Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:25.422896Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:25.422901Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:25.422905Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:25.422908Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:25.422912Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:25.422916Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:25.422948Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602454968222946:12083]
2025-10-10T14:38:25.422957Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:25.422977Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:25.423005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:25.423010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:25.423046Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bbbd12c5-efafe71e-f856048-6efcace7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:25.423055Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:25.423059Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:25.423062Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:25.423075Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:25.423087Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:25.423103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:25.423265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:25.423272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:25.423297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:25.423411Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2657 partition: 0 MaxSeqNo: 40 sessionId: src_id|bbbd12c5-efafe71e-f856048-6efcace7_0
2025-10-10T14:38:25.423832Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3ee54a6-caa88ad0-40f1089e-deb682ae_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|bbbd12c5-efafe71e-f856048-6efcace7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:25.426841Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bbbd12c5-efafe71e-f856048-6efcace7_0] Write session: try to update token
2025-10-10T14:38:25.426861Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bbbd12c5-efafe71e-f856048-6efcace7_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:25.438447Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:38:25.438470Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:25.438482Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602454968222946:12083]
2025-10-10T14:38:25.438537Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:38:25.438678Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:38:25.438721Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:38:25.438879Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:25.439469Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:25.439634Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:25.439845Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:38:25.439898Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:38:25.444769Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2657 sessionId: src_id|bbbd12c5-efafe71e-f856048-6efcace7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:25.447643Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:25.449657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:25.449686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:25.449744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:38:25.451320Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:38:25.464109Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:25.464134Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:25.464139Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:25.464141Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:25.464154Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602454968222946:12083]
2025-10-10T14:38:25.464159Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602454968222946:12083]
2025-10-10T14:38:25.464163Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602454968222946:12083]
2025-10-10T14:38:25.464219Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:25.464226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:25.464228Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:25.464233Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:25.464237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:25.464239Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:25.464402Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:25.487062Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602455750460321:11816]
2025-10-10T14:38:25.487460Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 pipe creation result: OK TabletId: 72075186224037892 Generation: 2656, pipe: [1:7559602455750460321:11816]
2025-10-10T14:38:25.585972Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:25.594897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:25.594933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:25.595128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:25.595191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:25.595259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:25.595324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:25.595366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:25.595371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:25.595449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:25.595510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:25.595573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:25.595639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:25.595685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:25.595688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:25.595769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:25.595831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:25.595897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:25.595964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:25.596004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:25.596007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:25.596085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:25.596155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:25.596218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:25.596283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:25.596327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:25.596330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:25.596404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:25.596467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:25.596533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:25.596598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:25.596645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:25.596649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:25.596732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:25.596794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:25.596858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:25.596921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:25.596966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:25.596969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:25.597044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:25.597109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:25.597177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:25.597253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:25.597297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:25.597300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:25.597628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:25.597708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:25.597780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:25.597861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:25.597912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:25.597920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:25.597992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:25.598062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:25.598148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:25.598219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:25.598296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:25.598306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:25.598377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:25.598453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:25.598522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:25.598595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:25.598647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:25.598654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:25.598723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602455750460321:11816], now have 1 active actors on pipe
2025-10-10T14:38:25.600071Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:25.600092Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:25.600116Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:25.600126Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2657 reason: error at write: Disconnected sessionId: src_id|bbbd12c5-efafe71e-f856048-6efcace7_0
2025-10-10T14:38:25.600164Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 55 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602455750460321:11816]
2025-10-10T14:38:25.600197Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:25.600351Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2657 sessionId: src_id|bbbd12c5-efafe71e-f856048-6efcace7_0 is DEAD
2025-10-10T14:38:25.600488Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bbbd12c5-efafe71e-f856048-6efcace7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:25.600496Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bbbd12c5-efafe71e-f856048-6efcace7_0] Write session will restart in 0.009328s
2025-10-10T14:38:25.600522Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bbbd12c5-efafe71e-f856048-6efcace7_0] Write session: Do CDS request
2025-10-10T14:38:25.600529Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bbbd12c5-efafe71e-f856048-6efcace7_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:25.610936Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bbbd12c5-efafe71e-f856048-6efcace7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:25.613513Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:25.613531Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2658
2025-10-10T14:38:25.613728Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2658 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:25.613779Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2658 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:25.613800Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2658 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:25.613808Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:25.614319Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2658 sessionId:  describe result for acl check
2025-10-10T14:38:25.614358Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:25.614366Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:25.614368Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:25.614374Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602455750460378:12152] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:25.614940Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602455750460378:12152] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:25.617860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602455750460378:12152] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:25.622042Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602455750460378:12152] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:25.622058Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602455750460378:12152] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:25.622061Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602455750460378:12152] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:25.622070Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2658 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:25.627512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:25.630155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:25.630435Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:25.630447Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:25.630462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:25.630532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:25.630583Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602454968223199:12085]
2025-10-10T14:38:25.631259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:25.631705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:25.631782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:25.632437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:25.632528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:25.632535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:25.632536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:25.632537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:25.632538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:25.632540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:25.632541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:25.632543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:25.632544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:25.632545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:25.632547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:25.632548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:25.632550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:25.632557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:25.632571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:25.632576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:25.632580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:25.632584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:25.632588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:25.632592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:25.632596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:25.632600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:25.632605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:25.632609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:25.632613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:25.632618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:25.632629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:25.632642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:25.632648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:25.632654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:25.632661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:25.632666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:25.632676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:25.632681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:25.632691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:25.632701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:25.632706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:25.632716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:25.632723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:25.632731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:25.632739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:25.632745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:25.632754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:25.632760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:25.632768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:25.632774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:25.632783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:25.632789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:25.632796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:25.632801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:25.632819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:25.632825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:25.632871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:25.635596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:25.635951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:25.635966Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:25.635970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:25.635974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:25.635999Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2657 [2:7559602454968223199:12085]
2025-10-10T14:38:25.636012Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:25.636037Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:25.636040Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:25.636044Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:25.636047Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:25.636064Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:25.636079Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:25.636088Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:25.636155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:25.636167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:25.636170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:25.636172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:25.636245Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:25.636252Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:25.636265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:25.636275Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:25.636290Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:25.636321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602455750460324:2438], now have 1 active actors on pipe
2025-10-10T14:38:25.636325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602455750460502:12152], now have 1 active actors on pipe
2025-10-10T14:38:25.636334Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602454968223194:12085]
2025-10-10T14:38:25.636343Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602454968223194:12085]
2025-10-10T14:38:25.636345Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602454968223194:12085]
2025-10-10T14:38:25.636359Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:25.636380Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:25.636408Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:25.636416Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:25.636451Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602454968223194:12085]
2025-10-10T14:38:25.636459Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:25.636424Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2657
2025-10-10T14:38:25.636431Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2657
2025-10-10T14:38:25.636504Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:25.636517Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:25.636520Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:25.636528Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:25.636652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:25.636670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:25.636705Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|63592c0d-85eb88fc-138ff11-cac99971_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:25.636719Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:25.636725Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:25.636727Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:25.636745Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:25.636764Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:25.636782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:25.637040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:25.637053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:25.637076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:25.637179Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2658 partition: 0 MaxSeqNo: 40 sessionId: src_id|63592c0d-85eb88fc-138ff11-cac99971_0
2025-10-10T14:38:25.637628Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bbbd12c5-efafe71e-f856048-6efcace7_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|63592c0d-85eb88fc-138ff11-cac99971_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:25.640483Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|63592c0d-85eb88fc-138ff11-cac99971_0] Write session: try to update token
2025-10-10T14:38:25.640508Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|63592c0d-85eb88fc-138ff11-cac99971_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:25.656978Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:25.656998Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:25.657002Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:25.657004Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:25.657016Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602454968223194:12085]
2025-10-10T14:38:25.657020Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602454968223194:12085]
2025-10-10T14:38:25.657025Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602454968223194:12085]
2025-10-10T14:38:25.657077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:25.657077Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:25.657085Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:25.657088Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:25.657090Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:25.657091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:25.657241Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:25.658278Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2658 sessionId: src_id|63592c0d-85eb88fc-138ff11-cac99971_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:25.660977Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:25.700572Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602455750460600:11816]
2025-10-10T14:38:25.700905Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 pipe creation result: OK TabletId: 72075186224037892 Generation: 2657, pipe: [1:7559602455750460600:11816]
2025-10-10T14:38:25.773236Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:25.773843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:25.773865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:25.773915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602455750460600:11816], now have 1 active actors on pipe
2025-10-10T14:38:25.774151Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:25.774164Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 56 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602455750460600:11816]
2025-10-10T14:38:25.774208Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:25.774211Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:25.774279Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2658 reason: error at write: Disconnected sessionId: src_id|63592c0d-85eb88fc-138ff11-cac99971_0
2025-10-10T14:38:25.774328Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:25.774521Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2658 sessionId: src_id|63592c0d-85eb88fc-138ff11-cac99971_0 is DEAD
2025-10-10T14:38:25.774712Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63592c0d-85eb88fc-138ff11-cac99971_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:25.774725Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63592c0d-85eb88fc-138ff11-cac99971_0] Write session will restart in 0.009275s
2025-10-10T14:38:25.774760Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63592c0d-85eb88fc-138ff11-cac99971_0] Write session: Do CDS request
2025-10-10T14:38:25.774769Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63592c0d-85eb88fc-138ff11-cac99971_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:25.784998Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|63592c0d-85eb88fc-138ff11-cac99971_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:25.785077Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:25.785097Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2659
2025-10-10T14:38:25.785233Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2659 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:25.785276Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2659 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:25.785288Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2659 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:25.785292Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:25.785746Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2659 sessionId:  describe result for acl check
2025-10-10T14:38:25.785789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:25.785793Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:25.785795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:25.785802Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602455750460683:12156] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:25.786415Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602455750460683:12156] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:25.789068Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602455750460683:12156] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:25.793551Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602455750460683:12156] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:25.793571Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602455750460683:12156] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:25.793575Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602455750460683:12156] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:25.793586Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2659 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:25.797933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:25.800019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:25.800250Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:25.800265Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:25.800278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:25.800342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:25.800391Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602454968223447:12087]
2025-10-10T14:38:25.801026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:25.801390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:25.801447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:25.801781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:25.801856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:25.801863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:25.801865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:25.801866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:25.801868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:25.801869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:25.801871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:25.801872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:25.801873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:25.801874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:25.801876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:25.801877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:25.801878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:25.801885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:25.801899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:25.801904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:25.801909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:25.801914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:25.801919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:25.801924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:25.801928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:25.801933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:25.801939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:25.801943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:25.801948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:25.801952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:25.801963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:25.801971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:25.801979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:25.801984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:25.801989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:25.801995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:25.802000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:25.802007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:25.802012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:25.802019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:25.802024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:25.802031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:25.802046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:25.802052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:25.802057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:25.802063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:25.802068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:25.802093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:25.802098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:25.802104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:25.802109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:25.802114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:25.802119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:25.802124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:25.802132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:25.802142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:25.802183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:25.804796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:25.805128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:25.805145Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:25.805147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:25.805152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:25.805160Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2658 [2:7559602454968223447:12087]
2025-10-10T14:38:25.805175Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:25.805198Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:25.805207Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:25.805211Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:25.805213Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:25.805234Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:25.805246Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:25.805256Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:25.805326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:25.805356Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:25.805360Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:25.805363Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:25.805440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:25.805449Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:25.805463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:25.805482Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:25.805505Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:25.805535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602455750460604:2438], now have 1 active actors on pipe
2025-10-10T14:38:25.805543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602455750460860:12156], now have 1 active actors on pipe
2025-10-10T14:38:25.805551Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602454968223442:12087]
2025-10-10T14:38:25.805554Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602454968223442:12087]
2025-10-10T14:38:25.805559Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602454968223442:12087]
2025-10-10T14:38:25.805576Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:25.805596Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:25.805602Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:25.805606Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:25.805608Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:25.805616Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:25.805620Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:25.805594Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2658
2025-10-10T14:38:25.805648Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602454968223442:12087]
2025-10-10T14:38:25.805660Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:25.805664Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2658
2025-10-10T14:38:25.805678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:25.805681Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:25.805688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:25.805745Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|588d9956-223d07a-f39cacd0-a5124879_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:25.805759Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:25.805763Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:25.805766Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:25.805779Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:25.805797Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:25.805820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:25.805979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:25.805988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:25.806005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:25.806101Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2659 partition: 0 MaxSeqNo: 40 sessionId: src_id|588d9956-223d07a-f39cacd0-a5124879_0
2025-10-10T14:38:25.806537Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63592c0d-85eb88fc-138ff11-cac99971_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|588d9956-223d07a-f39cacd0-a5124879_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:25.809599Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|588d9956-223d07a-f39cacd0-a5124879_0] Write session: try to update token
2025-10-10T14:38:25.809620Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|588d9956-223d07a-f39cacd0-a5124879_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:25.824633Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2659 sessionId: src_id|588d9956-223d07a-f39cacd0-a5124879_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:25.827637Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:25.829498Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:25.829517Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:25.829521Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:25.829523Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:25.829533Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602454968223442:12087]
2025-10-10T14:38:25.829538Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602454968223442:12087]
2025-10-10T14:38:25.829542Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602454968223442:12087]
2025-10-10T14:38:25.829593Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:25.829602Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:25.829605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:25.829619Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:25.829633Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:25.829637Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:25.829745Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:25.874329Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602455750460890:11816]
2025-10-10T14:38:25.877621Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 pipe creation result: OK TabletId: 72075186224037892 Generation: 2658, pipe: [1:7559602455750460890:11816]
2025-10-10T14:38:25.948263Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:25.949048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:25.949067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:25.949116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602455750460890:11816], now have 1 active actors on pipe
2025-10-10T14:38:25.949358Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:25.949840Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:25.949918Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:38:25.949998Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2659 reason: status is not ok: tablet will be restarted right now sessionId: src_id|588d9956-223d07a-f39cacd0-a5124879_0
2025-10-10T14:38:25.950215Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2659 sessionId: src_id|588d9956-223d07a-f39cacd0-a5124879_0 is DEAD
2025-10-10T14:38:25.950292Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 57 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602455750460890:11816]
2025-10-10T14:38:25.950949Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|588d9956-223d07a-f39cacd0-a5124879_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:38:25.950972Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|588d9956-223d07a-f39cacd0-a5124879_0] Write session will restart in 0.007673s
2025-10-10T14:38:25.951000Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|588d9956-223d07a-f39cacd0-a5124879_0] Write session: Do CDS request
2025-10-10T14:38:25.951007Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|588d9956-223d07a-f39cacd0-a5124879_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:25.960376Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|588d9956-223d07a-f39cacd0-a5124879_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:25.960469Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:25.960488Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2660
2025-10-10T14:38:25.965636Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2660 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:25.965694Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2660 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:25.965700Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2660 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:25.965706Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:25.966399Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2660 sessionId:  describe result for acl check
2025-10-10T14:38:25.966447Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:25.966449Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:25.966451Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:25.966458Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602455750460995:12161] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:25.967058Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602455750460995:12161] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:25.971634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602455750460995:12161] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:25.975400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:25.978773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:25.979027Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:25.979039Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:25.979052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:25.979125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:25.979180Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602454968223695:12089]
2025-10-10T14:38:25.979204Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602455750460995:12161] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:25.979233Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602455750460995:12161] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:25.979237Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602455750460995:12161] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:25.979248Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2660 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:25.979826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:25.980217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:25.980290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:25.980763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:25.980826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:25.980827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:25.980829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:25.980830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:25.980832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:25.980834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:25.980835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:25.980836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:25.980837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:25.980838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:25.980840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:25.980841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:25.980842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:25.980850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:25.980863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:25.980868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:25.980873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:25.980878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:25.980882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:25.980886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:25.980890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:25.980895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:25.980900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:25.980905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:25.980910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:25.980914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:25.980922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:25.980932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:25.980939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:25.980946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:25.980951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:25.980957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:25.980962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:25.980969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:25.980974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:25.980981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:25.980986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:25.980992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:25.980997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:25.981003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:25.981008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:25.981013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:25.981017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:25.981023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:25.981029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:25.981035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:25.981041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:25.981047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:25.981052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:25.981057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:25.981064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:25.981070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:25.981116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:25.983692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:25.984024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:25.984038Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:25.984041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:25.984045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:25.984053Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2659 [2:7559602454968223695:12089]
2025-10-10T14:38:25.984068Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:25.984088Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:25.984097Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:25.984101Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:25.984104Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:25.984123Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:25.984137Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:25.984151Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:25.984217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:25.984225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:25.984227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:25.984230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:25.984306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:25.984315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:25.984327Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:25.984345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:25.984365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:25.984393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602455750460893:2438], now have 1 active actors on pipe
2025-10-10T14:38:25.984402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602455750461158:12161], now have 1 active actors on pipe
2025-10-10T14:38:25.984410Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602454968223690:12089]
2025-10-10T14:38:25.984418Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602454968223690:12089]
2025-10-10T14:38:25.984420Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602454968223690:12089]
2025-10-10T14:38:25.984434Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:25.984445Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2659
2025-10-10T14:38:25.984448Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:25.984452Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:25.984456Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:25.984458Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:25.984469Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:25.984473Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:25.984505Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602454968223690:12089]
2025-10-10T14:38:25.984508Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:25.984528Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:25.984571Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2659
2025-10-10T14:38:25.984766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:25.984780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:25.984816Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|83115399-4c774bb9-ae2cde56-7d907fdb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:25.984832Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:25.984837Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:25.984840Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:25.984855Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:25.984869Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:25.984889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:25.985076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:25.985086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:25.985102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:25.985207Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2660 partition: 0 MaxSeqNo: 40 sessionId: src_id|83115399-4c774bb9-ae2cde56-7d907fdb_0
2025-10-10T14:38:25.985741Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|588d9956-223d07a-f39cacd0-a5124879_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|83115399-4c774bb9-ae2cde56-7d907fdb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:25.988569Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|83115399-4c774bb9-ae2cde56-7d907fdb_0] Write session: try to update token
2025-10-10T14:38:25.988589Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|83115399-4c774bb9-ae2cde56-7d907fdb_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:26.006083Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:26.006101Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:26.006105Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:26.006107Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:26.006118Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602454968223690:12089]
2025-10-10T14:38:26.006123Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602454968223690:12089]
2025-10-10T14:38:26.006131Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602454968223690:12089]
2025-10-10T14:38:26.006185Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:26.006199Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:26.006202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:26.006355Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:26.007018Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2660 sessionId: src_id|83115399-4c774bb9-ae2cde56-7d907fdb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:26.009443Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:26.009461Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:26.009466Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:26.011934Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:26.050296Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602460045428467:11816]
2025-10-10T14:38:26.050801Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 pipe creation result: OK TabletId: 72075186224037892 Generation: 2659, pipe: [1:7559602460045428467:11816]
2025-10-10T14:38:26.123687Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:26.124374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:26.124390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:26.124438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602460045428467:11816], now have 1 active actors on pipe
2025-10-10T14:38:26.124732Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:26.124762Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:26.124831Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2660 reason: error at write: Disconnected sessionId: src_id|83115399-4c774bb9-ae2cde56-7d907fdb_0
2025-10-10T14:38:26.124718Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:26.125072Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2660 sessionId: src_id|83115399-4c774bb9-ae2cde56-7d907fdb_0 is DEAD
2025-10-10T14:38:26.125138Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 58 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602460045428467:11816]
2025-10-10T14:38:26.125166Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:26.125807Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83115399-4c774bb9-ae2cde56-7d907fdb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:26.125823Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83115399-4c774bb9-ae2cde56-7d907fdb_0] Write session will restart in 0.005291s
2025-10-10T14:38:26.125851Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83115399-4c774bb9-ae2cde56-7d907fdb_0] Write session: Do CDS request
2025-10-10T14:38:26.125858Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83115399-4c774bb9-ae2cde56-7d907fdb_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:26.133054Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|83115399-4c774bb9-ae2cde56-7d907fdb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:26.133135Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:26.133153Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2661
2025-10-10T14:38:26.133452Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2661 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:26.133510Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2661 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:26.133522Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2661 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:26.133530Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:26.134097Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2661 sessionId:  describe result for acl check
2025-10-10T14:38:26.134155Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:26.134162Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:26.134164Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:26.134171Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602460045428484:12165] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:26.134804Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602460045428484:12165] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:26.137970Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602460045428484:12165] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:26.141877Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602460045428484:12165] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:26.141898Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602460045428484:12165] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:26.141903Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602460045428484:12165] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:26.141913Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2661 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:26.150456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:26.153514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:26.153940Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:26.153955Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:26.153972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:26.154039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:26.154101Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602459263191245:12091]
2025-10-10T14:38:26.154761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:26.155233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:26.155327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:26.155752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:26.155850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:26.155863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:26.155865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:26.155866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:26.155869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:26.155870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:26.155871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:26.155873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:26.155875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:26.155876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:26.155878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:26.155880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:26.155882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:26.155890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:26.155906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:26.155910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:26.155915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:26.155920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:26.155924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:26.155929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:26.155933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:26.155938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:26.155943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:26.155947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:26.155952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:26.155956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:26.155966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:26.155975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:26.155982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:26.155988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:26.155994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:26.155999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:26.156004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:26.156009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:26.156017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:26.156022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:26.156026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:26.156031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:26.156036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:26.156041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:26.156045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:26.156050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:26.156054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:26.156061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:26.156075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:26.156081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:26.156091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:26.156097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:26.156107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:26.156113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:26.156119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:26.156124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:26.156168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:26.159100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:26.159425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:26.159437Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:26.159440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:26.159444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:26.159451Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2660 [2:7559602459263191245:12091]
2025-10-10T14:38:26.159467Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:26.159489Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:26.159498Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:26.159502Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:26.159505Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:26.159522Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:26.159535Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:26.159544Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:26.159613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:26.159622Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:26.159624Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:26.159627Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:26.159701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:26.159709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:26.159722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:26.159732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:26.159751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:26.159777Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602459263191239:12091]
2025-10-10T14:38:26.159784Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602459263191239:12091]
2025-10-10T14:38:26.159787Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602459263191239:12091]
2025-10-10T14:38:26.159796Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:26.159814Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:26.159803Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:26.159818Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:26.159821Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:26.159833Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:26.159836Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:26.159848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602460045428635:12165], now have 1 active actors on pipe
2025-10-10T14:38:26.159856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602460045428469:2438], now have 1 active actors on pipe
2025-10-10T14:38:26.159881Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602459263191239:12091]
2025-10-10T14:38:26.159891Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:26.159897Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:26.160320Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2660
2025-10-10T14:38:26.160361Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2660
2025-10-10T14:38:26.160771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:26.160789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:26.160832Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8b7a27a1-a053dba6-8b4dd8a7-fc6e7c19_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:26.160852Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:26.160858Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:26.160860Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:26.160876Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:26.160892Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:26.160910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:26.161134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:26.161145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:26.161166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:26.161289Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2661 partition: 0 MaxSeqNo: 40 sessionId: src_id|8b7a27a1-a053dba6-8b4dd8a7-fc6e7c19_0
2025-10-10T14:38:26.161817Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83115399-4c774bb9-ae2cde56-7d907fdb_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|8b7a27a1-a053dba6-8b4dd8a7-fc6e7c19_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:26.164930Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8b7a27a1-a053dba6-8b4dd8a7-fc6e7c19_0] Write session: try to update token
2025-10-10T14:38:26.164952Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8b7a27a1-a053dba6-8b4dd8a7-fc6e7c19_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:26.181799Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:26.181821Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:26.181825Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:26.181827Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:26.181837Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602459263191239:12091]
2025-10-10T14:38:26.181845Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602459263191239:12091]
2025-10-10T14:38:26.181848Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602459263191239:12091]
2025-10-10T14:38:26.181905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:26.181919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:26.181922Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:26.182108Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:26.184402Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:26.184421Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:26.184427Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:26.185062Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2661 sessionId: src_id|8b7a27a1-a053dba6-8b4dd8a7-fc6e7c19_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:26.188156Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:26.225394Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602460045428749:11816]
2025-10-10T14:38:26.225830Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 pipe creation result: OK TabletId: 72075186224037892 Generation: 2660, pipe: [1:7559602460045428749:11816]
2025-10-10T14:38:26.301573Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:26.301980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:26.301996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:26.302044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602460045428749:11816], now have 1 active actors on pipe
2025-10-10T14:38:26.302273Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:26.302322Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:26.302339Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:26.302411Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2661 reason: error at write: Disconnected sessionId: src_id|8b7a27a1-a053dba6-8b4dd8a7-fc6e7c19_0
2025-10-10T14:38:26.302607Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2661 sessionId: src_id|8b7a27a1-a053dba6-8b4dd8a7-fc6e7c19_0 is DEAD
2025-10-10T14:38:26.302772Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b7a27a1-a053dba6-8b4dd8a7-fc6e7c19_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:26.302784Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b7a27a1-a053dba6-8b4dd8a7-fc6e7c19_0] Write session will restart in 0.008052s
2025-10-10T14:38:26.302810Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b7a27a1-a053dba6-8b4dd8a7-fc6e7c19_0] Write session: Do CDS request
2025-10-10T14:38:26.302780Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 59 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602460045428749:11816]
2025-10-10T14:38:26.302817Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b7a27a1-a053dba6-8b4dd8a7-fc6e7c19_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:26.302808Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:26.318259Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8b7a27a1-a053dba6-8b4dd8a7-fc6e7c19_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:26.318607Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:26.318625Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2662
2025-10-10T14:38:26.318749Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2662 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:26.318785Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2662 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:26.318790Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2662 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:26.318795Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:26.319251Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2662 sessionId:  describe result for acl check
2025-10-10T14:38:26.319294Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:26.319302Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:26.319303Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:26.319310Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602460045428937:12175] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:26.319864Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602460045428937:12175] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:26.322875Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602460045428937:12175] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:26.323874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:26.326950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:26.327216Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602460045428937:12175] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:26.327231Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602460045428937:12175] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:26.327234Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602460045428937:12175] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:26.327243Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2662 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:26.327370Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:26.327386Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:26.327402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:26.327488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:26.327549Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602459263191529:12100]
2025-10-10T14:38:26.328172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:26.328455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:26.328519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:26.328865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:26.328931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:26.328938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:26.328939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:26.328940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:26.328941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:26.328942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:26.328943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:26.328944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:26.328945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:26.328946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:26.328947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:26.328948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:26.328949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:26.328955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:26.328966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:26.328971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:26.328975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:26.328979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:26.328983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:26.328987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:26.328991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:26.328995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:26.328999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:26.329002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:26.329006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:26.329009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:26.329019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:26.329027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:26.329034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:26.329040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:26.329045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:26.329050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:26.329054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:26.329059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:26.329063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:26.329068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:26.329072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:26.329078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:26.329084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:26.329089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:26.329093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:26.329106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:26.329110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:26.329121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:26.329125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:26.329131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:26.329141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:26.329146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:26.329150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:26.329161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:26.329165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:26.329176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:26.329220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:26.331814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:26.332339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:26.332355Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:26.332358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:26.332362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:26.332369Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2661 [2:7559602459263191529:12100]
2025-10-10T14:38:26.332382Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:26.332400Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:26.332408Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:26.332411Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:26.332414Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:26.332430Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:26.332440Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:26.332448Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:26.332508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:26.332516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:26.332517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:26.332520Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:26.332590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:26.332598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:26.332609Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:26.332620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:26.332636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:26.332660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602460045429042:12175], now have 1 active actors on pipe
2025-10-10T14:38:26.332669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602460045428763:2438], now have 1 active actors on pipe
2025-10-10T14:38:26.332677Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602459263191509:12100]
2025-10-10T14:38:26.332679Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602459263191509:12100]
2025-10-10T14:38:26.332682Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602459263191509:12100]
2025-10-10T14:38:26.332697Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:26.332711Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:26.332715Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:26.332715Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:26.332717Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:26.332734Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:26.332737Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:26.332761Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602459263191509:12100]
2025-10-10T14:38:26.332773Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:26.332780Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:26.332770Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2661
2025-10-10T14:38:26.332786Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2661
2025-10-10T14:38:26.332947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:26.332958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:26.332994Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|99493e1e-19f0860c-b87b9a55-5f51cb3e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:26.333024Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:26.333028Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:26.333031Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:26.333044Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:26.333057Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:26.333072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:26.333249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:26.333257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:26.333274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:26.333372Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2662 partition: 0 MaxSeqNo: 40 sessionId: src_id|99493e1e-19f0860c-b87b9a55-5f51cb3e_0
2025-10-10T14:38:26.333794Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b7a27a1-a053dba6-8b4dd8a7-fc6e7c19_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|99493e1e-19f0860c-b87b9a55-5f51cb3e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:26.336721Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|99493e1e-19f0860c-b87b9a55-5f51cb3e_0] Write session: try to update token
2025-10-10T14:38:26.336738Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|99493e1e-19f0860c-b87b9a55-5f51cb3e_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:26.350398Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:38:26.350420Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:26.350433Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602459263191509:12100]
2025-10-10T14:38:26.350492Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:38:26.350492Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:38:26.350687Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:38:26.350852Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:26.351005Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:26.351176Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:26.351394Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:38:26.351440Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:38:26.353406Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2662 sessionId: src_id|99493e1e-19f0860c-b87b9a55-5f51cb3e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:26.356217Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:26.356595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:26.356620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:26.356663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:38:26.356815Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:38:26.364018Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:26.364033Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:26.364036Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:26.364037Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:26.364046Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602459263191509:12100]
2025-10-10T14:38:26.364050Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602459263191509:12100]
2025-10-10T14:38:26.364053Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602459263191509:12100]
2025-10-10T14:38:26.364104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:26.364107Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:26.364111Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:26.364113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:26.364114Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:26.364115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:26.364264Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:26.403317Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602460045429057:11816]
2025-10-10T14:38:26.403794Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 pipe creation result: OK TabletId: 72075186224037892 Generation: 2661, pipe: [1:7559602460045429057:11816]
2025-10-10T14:38:26.480434Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:26.489471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:26.489506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:26.489717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:26.489802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:26.489881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:26.489962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:26.490022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:26.490033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:26.490139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:26.490219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:26.490298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:26.490373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:26.490427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:26.490436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:26.490519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:26.490591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:26.490665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:26.490747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:26.490796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:26.490803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:26.490885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:26.490962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:26.491037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:26.491114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:26.491168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:26.491176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:26.491257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:26.491330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:26.491407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:26.491481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:26.491535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:26.491547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:26.491625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:26.491696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:26.491763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:26.491832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:26.491880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:26.491886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:26.491964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:26.492039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:26.492105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:26.492184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:26.492237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:26.492249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:26.492323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:26.492398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:26.492474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:26.492547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:26.492667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:26.492673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:26.492746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:26.492817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:26.492891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:26.492960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:26.493007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:26.493015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:26.493088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:26.493155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:26.493228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:26.493298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:26.493366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:26.493376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:26.493506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602460045429057:11816], now have 1 active actors on pipe
2025-10-10T14:38:26.493945Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:26.494007Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:26.494011Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:26.494045Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2662 reason: error at write: Disconnected sessionId: src_id|99493e1e-19f0860c-b87b9a55-5f51cb3e_0
2025-10-10T14:38:26.494260Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2662 sessionId: src_id|99493e1e-19f0860c-b87b9a55-5f51cb3e_0 is DEAD
2025-10-10T14:38:26.494807Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99493e1e-19f0860c-b87b9a55-5f51cb3e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:26.494820Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99493e1e-19f0860c-b87b9a55-5f51cb3e_0] Write session will restart in 0.008181s
2025-10-10T14:38:26.494847Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99493e1e-19f0860c-b87b9a55-5f51cb3e_0] Write session: Do CDS request
2025-10-10T14:38:26.494854Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99493e1e-19f0860c-b87b9a55-5f51cb3e_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:26.494871Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 60 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602460045429057:11816]
2025-10-10T14:38:26.494885Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:26.503946Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|99493e1e-19f0860c-b87b9a55-5f51cb3e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:26.506711Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:26.506727Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2663
2025-10-10T14:38:26.506924Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2663 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:26.506951Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2663 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:26.506958Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2663 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:26.506963Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:26.509686Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2663 sessionId:  describe result for acl check
2025-10-10T14:38:26.509730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:26.509732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:26.509733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:26.509739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602460045429080:12184] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:26.510192Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602460045429080:12184] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:26.522267Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602460045429080:12184] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:26.532945Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602460045429080:12184] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:26.532962Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602460045429080:12184] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:26.532965Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602460045429080:12184] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:26.532973Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2663 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:26.552038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:26.555363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:26.555631Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:26.555643Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:26.555655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:26.555712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:26.555759Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602459263191798:12110]
2025-10-10T14:38:26.556418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:26.556759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:26.556805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:26.557149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:26.557210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:26.557217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:26.557218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:26.557219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:26.557220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:26.557221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:26.557223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:26.557225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:26.557226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:26.557228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:26.557229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:26.557230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:26.557231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:26.557238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:26.557251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:26.557255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:26.557260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:26.557263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:26.557268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:26.557272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:26.557276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:26.557280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:26.557285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:26.557289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:26.557293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:26.557297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:26.557306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:26.557315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:26.557321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:26.557346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:26.557351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:26.557358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:26.557367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:26.557372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:26.557376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:26.557381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:26.557386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:26.557392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:26.557398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:26.557408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:26.557413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:26.557418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:26.557427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:26.557431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:26.557435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:26.557440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:26.557448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:26.557455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:26.557458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:26.557463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:26.557466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:26.557471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:26.557505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:26.560190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:26.560744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:26.560757Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:26.560760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:26.560765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:26.560772Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2662 [2:7559602459263191798:12110]
2025-10-10T14:38:26.560786Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:26.560807Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:26.560815Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:26.560819Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:26.560822Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:26.560840Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:26.560853Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:26.560861Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:26.560929Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:26.560936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:26.560938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:26.560941Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:26.561010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:26.561018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:26.561030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:26.561040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:26.561055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:26.561078Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602459263191793:12110]
2025-10-10T14:38:26.561081Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602459263191793:12110]
2025-10-10T14:38:26.561084Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602459263191793:12110]
2025-10-10T14:38:26.561093Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:26.561107Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:26.561121Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:26.561123Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:26.561124Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:26.561126Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:26.561126Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:26.561156Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602459263191793:12110]
2025-10-10T14:38:26.561159Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:26.561162Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:26.561248Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2662
2025-10-10T14:38:26.561170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602460045429133:12184], now have 1 active actors on pipe
2025-10-10T14:38:26.561172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602460045429071:2438], now have 1 active actors on pipe
2025-10-10T14:38:26.561287Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2662
2025-10-10T14:38:26.561390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:26.561402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:26.561435Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e4ed9036-a7b105a1-2df69ca1-57f382fd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:26.561443Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:26.561448Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:26.561450Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:26.561464Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:26.561477Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:26.561493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:26.561728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:26.561742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:26.561757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:26.564373Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2663 partition: 0 MaxSeqNo: 40 sessionId: src_id|e4ed9036-a7b105a1-2df69ca1-57f382fd_0
2025-10-10T14:38:26.564773Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99493e1e-19f0860c-b87b9a55-5f51cb3e_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|e4ed9036-a7b105a1-2df69ca1-57f382fd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:26.567573Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e4ed9036-a7b105a1-2df69ca1-57f382fd_0] Write session: try to update token
2025-10-10T14:38:26.567594Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e4ed9036-a7b105a1-2df69ca1-57f382fd_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:26.582011Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:26.582036Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:26.582039Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:26.582041Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:26.582052Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602459263191793:12110]
2025-10-10T14:38:26.582056Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602459263191793:12110]
2025-10-10T14:38:26.582074Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602459263191793:12110]
2025-10-10T14:38:26.582122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:26.582129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:26.582131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:26.582266Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:26.585525Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:26.585543Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:26.585548Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:26.588424Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2663 sessionId: src_id|e4ed9036-a7b105a1-2df69ca1-57f382fd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:26.591828Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:26.595019Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602460045429353:11816]
2025-10-10T14:38:26.595259Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 pipe creation result: OK TabletId: 72075186224037892 Generation: 2662, pipe: [1:7559602460045429353:11816]
2025-10-10T14:38:26.699787Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:26.700427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:26.700448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:26.700474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602460045429353:11816], now have 1 active actors on pipe
2025-10-10T14:38:26.700707Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:26.700778Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 61 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602460045429353:11816]
2025-10-10T14:38:26.700819Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:26.700821Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:26.700884Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2663 reason: error at write: Disconnected sessionId: src_id|e4ed9036-a7b105a1-2df69ca1-57f382fd_0
2025-10-10T14:38:26.701102Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2663 sessionId: src_id|e4ed9036-a7b105a1-2df69ca1-57f382fd_0 is DEAD
2025-10-10T14:38:26.701162Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:26.702499Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4ed9036-a7b105a1-2df69ca1-57f382fd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:26.702511Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4ed9036-a7b105a1-2df69ca1-57f382fd_0] Write session will restart in 0.007920s
2025-10-10T14:38:26.702537Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4ed9036-a7b105a1-2df69ca1-57f382fd_0] Write session: Do CDS request
2025-10-10T14:38:26.702547Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4ed9036-a7b105a1-2df69ca1-57f382fd_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:26.711940Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e4ed9036-a7b105a1-2df69ca1-57f382fd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:26.712017Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:26.712037Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2664
2025-10-10T14:38:26.712190Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2664 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:26.712235Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2664 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:26.712247Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2664 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:26.712254Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:26.712705Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2664 sessionId:  describe result for acl check
2025-10-10T14:38:26.712747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:26.712749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:26.712750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:26.712758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602460045429413:12188] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:26.713368Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602460045429413:12188] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:26.716990Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602460045429413:12188] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:26.720540Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602460045429413:12188] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:26.720559Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602460045429413:12188] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:26.720563Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602460045429413:12188] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:26.720572Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2664 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:26.723779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:26.727114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:26.727380Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:26.727394Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:26.727408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:26.727474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:26.727529Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602459263192051:12112]
2025-10-10T14:38:26.728189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:26.728548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:26.728596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:26.728956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:26.729020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:26.729026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:26.729027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:26.729029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:26.729030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:26.729032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:26.729033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:26.729035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:26.729036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:26.729037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:26.729039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:26.729041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:26.729042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:26.729049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:26.729063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:26.729067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:26.729071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:26.729076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:26.729080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:26.729084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:26.729088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:26.729092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:26.729097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:26.729102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:26.729106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:26.729110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:26.729121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:26.729130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:26.729136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:26.729142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:26.729147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:26.729152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:26.729156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:26.729160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:26.729165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:26.729169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:26.729177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:26.729183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:26.729188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:26.729194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:26.729199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:26.729204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:26.729210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:26.729221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:26.729225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:26.729231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:26.729241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:26.729246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:26.729250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:26.729256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:26.729262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:26.729267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:26.729310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:26.732026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:26.732987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:26.733002Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:26.733004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:26.733008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:26.733016Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2663 [2:7559602459263192051:12112]
2025-10-10T14:38:26.733032Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:26.733063Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:26.733072Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:26.733076Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:26.733078Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:26.733099Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:26.733115Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:26.733124Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:26.733200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:26.733202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:26.733205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:26.733207Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:26.733281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:26.733283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:26.733299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:26.733309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:26.733327Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:26.733398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602460045429610:12188], now have 1 active actors on pipe
2025-10-10T14:38:26.733402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602460045429355:2438], now have 1 active actors on pipe
2025-10-10T14:38:26.733410Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602459263192046:12112]
2025-10-10T14:38:26.733412Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602459263192046:12112]
2025-10-10T14:38:26.733415Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602459263192046:12112]
2025-10-10T14:38:26.733434Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:26.733450Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:26.733455Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:26.733458Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:26.733460Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:26.733469Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:26.733473Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:26.733515Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602459263192046:12112]
2025-10-10T14:38:26.733529Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:26.733552Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:26.733683Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2663
2025-10-10T14:38:26.733721Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2663
2025-10-10T14:38:26.733942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:26.733959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:26.734002Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f39a18e5-9fd43dad-e1f63f0b-9f17596b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:26.734019Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:26.734024Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:26.734027Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:26.734041Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:26.734087Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:26.734131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:26.734333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:26.734346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:26.734368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:26.734471Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2664 partition: 0 MaxSeqNo: 40 sessionId: src_id|f39a18e5-9fd43dad-e1f63f0b-9f17596b_0
2025-10-10T14:38:26.734909Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4ed9036-a7b105a1-2df69ca1-57f382fd_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|f39a18e5-9fd43dad-e1f63f0b-9f17596b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:26.738035Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f39a18e5-9fd43dad-e1f63f0b-9f17596b_0] Write session: try to update token
2025-10-10T14:38:26.738072Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f39a18e5-9fd43dad-e1f63f0b-9f17596b_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:26.751094Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:38:26.751115Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:26.751127Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602459263192046:12112]
2025-10-10T14:38:26.751182Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:38:26.751187Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:38:26.751383Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:38:26.751546Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:26.751722Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:26.751880Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:26.752093Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:38:26.752143Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:38:26.753775Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2664 sessionId: src_id|f39a18e5-9fd43dad-e1f63f0b-9f17596b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:26.756677Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:26.756922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:26.756947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:26.756990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:38:26.757096Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:38:26.769785Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:26.769804Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:26.769808Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:26.769809Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:26.769821Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602459263192046:12112]
2025-10-10T14:38:26.769827Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602459263192046:12112]
2025-10-10T14:38:26.769830Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602459263192046:12112]
2025-10-10T14:38:26.769880Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:26.769882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:26.769887Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:26.769891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:26.769891Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:26.769893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:26.770033Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:26.800861Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602460045429640:11816]
2025-10-10T14:38:26.801247Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 pipe creation result: OK TabletId: 72075186224037892 Generation: 2663, pipe: [1:7559602460045429640:11816]
2025-10-10T14:38:26.887062Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:26.895150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:26.895182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:26.895363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:26.895430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:26.895498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:26.895566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:26.895860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:26.895871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:26.895940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:26.896013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:26.896083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:26.896162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:26.896205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:26.896213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:26.896284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:26.896345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:26.896410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:26.896471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:26.896514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:26.896519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:26.896585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:26.896652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:26.896715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:26.896773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:26.896814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:26.896819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:26.896882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:26.896944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:26.897015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:26.897079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:26.897131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:26.897140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:26.897212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:26.897274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:26.897359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:26.897428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:26.897470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:26.897481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:26.897548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:26.897606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:26.897676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:26.897741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:26.897789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:26.897796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:26.897869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:26.897928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:26.897992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:26.898071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:26.898112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:26.898120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:26.898190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:26.898249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:26.898312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:26.898381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:26.898422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:26.898428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:26.898490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:26.898551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:26.898621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:26.898688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:26.898738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:26.898746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:26.898825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602460045429640:11816], now have 1 active actors on pipe
2025-10-10T14:38:26.899104Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:26.899142Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 62 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602460045429640:11816]
2025-10-10T14:38:26.899184Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:26.899188Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:26.899238Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2664 reason: error at write: Disconnected sessionId: src_id|f39a18e5-9fd43dad-e1f63f0b-9f17596b_0
2025-10-10T14:38:26.899453Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2664 sessionId: src_id|f39a18e5-9fd43dad-e1f63f0b-9f17596b_0 is DEAD
2025-10-10T14:38:26.899546Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:26.899658Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f39a18e5-9fd43dad-e1f63f0b-9f17596b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:26.899670Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f39a18e5-9fd43dad-e1f63f0b-9f17596b_0] Write session will restart in 0.008801s
2025-10-10T14:38:26.899696Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f39a18e5-9fd43dad-e1f63f0b-9f17596b_0] Write session: Do CDS request
2025-10-10T14:38:26.899703Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f39a18e5-9fd43dad-e1f63f0b-9f17596b_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:26.910465Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f39a18e5-9fd43dad-e1f63f0b-9f17596b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:26.910502Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:26.910523Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2665
2025-10-10T14:38:26.910726Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2665 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:26.910765Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2665 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:26.910777Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2665 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:26.910782Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:26.911358Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2665 sessionId:  describe result for acl check
2025-10-10T14:38:26.911393Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:26.911401Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:26.911402Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:26.911409Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602460045429727:12193] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:26.912006Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602460045429727:12193] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:26.916420Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602460045429727:12193] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:26.920430Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602460045429727:12193] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:26.920448Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602460045429727:12193] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:26.920452Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602460045429727:12193] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:26.920460Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2665 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:26.921437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:26.924292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:26.924525Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:26.924539Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:26.924551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:26.924610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:26.924659Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602459263192305:12114]
2025-10-10T14:38:26.925357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:26.925868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:26.925918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:26.926257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:26.926317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:26.926319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:26.926320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:26.926321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:26.926323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:26.926324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:26.926325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:26.926327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:26.926328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:26.926329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:26.926331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:26.926332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:26.926333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:26.926340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:26.926353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:26.926358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:26.926362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:26.926367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:26.926371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:26.926375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:26.926379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:26.926383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:26.926388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:26.926392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:26.926397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:26.926401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:26.926411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:26.926420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:26.926427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:26.926433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:26.926439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:26.926444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:26.926448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:26.926455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:26.926461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:26.926467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:26.926471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:26.926477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:26.926483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:26.926489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:26.926494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:26.926500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:26.926505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:26.926511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:26.926516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:26.926523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:26.926528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:26.926533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:26.926538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:26.926544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:26.926549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:26.926555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:26.926598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:26.929445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:26.929808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:26.929813Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:26.929817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:26.929821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:26.929829Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2664 [2:7559602459263192305:12114]
2025-10-10T14:38:26.929844Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:26.929863Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:26.929867Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:26.929871Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:26.929874Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:26.929892Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:26.929900Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:26.929909Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:26.929981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:26.929984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:26.929986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:26.929989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:26.930079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:26.930082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:26.930094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:26.930104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:26.930120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:26.930144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602460045429919:12193], now have 1 active actors on pipe
2025-10-10T14:38:26.930154Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602459263192300:12114]
2025-10-10T14:38:26.930157Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602459263192300:12114]
2025-10-10T14:38:26.930159Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602459263192300:12114]
2025-10-10T14:38:26.930170Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:26.930187Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:26.930187Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:26.930190Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:26.930192Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:26.930203Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:26.930206Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:26.930241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602460045429649:2438], now have 1 active actors on pipe
2025-10-10T14:38:26.930244Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602459263192300:12114]
2025-10-10T14:38:26.930255Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:26.930455Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2664
2025-10-10T14:38:26.930503Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2664
2025-10-10T14:38:26.930505Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:26.930881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:26.930892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:26.930928Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b2452d17-534e7ac3-c3ae7844-4d8027e9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:26.930939Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:26.930944Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:26.930946Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:26.931115Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:26.931130Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:26.931151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:26.934032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:26.934044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:26.934087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:26.934406Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2665 partition: 0 MaxSeqNo: 40 sessionId: src_id|b2452d17-534e7ac3-c3ae7844-4d8027e9_0
2025-10-10T14:38:26.934800Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f39a18e5-9fd43dad-e1f63f0b-9f17596b_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|b2452d17-534e7ac3-c3ae7844-4d8027e9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:26.937402Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b2452d17-534e7ac3-c3ae7844-4d8027e9_0] Write session: try to update token
2025-10-10T14:38:26.937419Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b2452d17-534e7ac3-c3ae7844-4d8027e9_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:26.954526Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:26.954548Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:26.954551Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:26.954554Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:26.954565Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602459263192300:12114]
2025-10-10T14:38:26.954570Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602459263192300:12114]
2025-10-10T14:38:26.954575Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602459263192300:12114]
2025-10-10T14:38:26.954630Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:26.954642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:26.954644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:26.954678Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:26.954690Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:26.954697Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:26.954807Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:26.956467Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2665 sessionId: src_id|b2452d17-534e7ac3-c3ae7844-4d8027e9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:26.959336Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:26.999493Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602460045429932:11816]
2025-10-10T14:38:26.999879Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 pipe creation result: OK TabletId: 72075186224037892 Generation: 2664, pipe: [1:7559602460045429932:11816]
2025-10-10T14:38:27.079732Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:27.080390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:27.080409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:27.080457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602460045429932:11816], now have 1 active actors on pipe
2025-10-10T14:38:27.082497Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2452d17-534e7ac3-c3ae7844-4d8027e9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:27.082512Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2452d17-534e7ac3-c3ae7844-4d8027e9_0] Write session will restart in 0.009816s
2025-10-10T14:38:27.082538Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2452d17-534e7ac3-c3ae7844-4d8027e9_0] Write session: Do CDS request
2025-10-10T14:38:27.082545Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2452d17-534e7ac3-c3ae7844-4d8027e9_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:27.081732Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:27.081633Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:27.081707Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:27.081710Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:27.081789Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2665 reason: error at write: Disconnected sessionId: src_id|b2452d17-534e7ac3-c3ae7844-4d8027e9_0
2025-10-10T14:38:27.081998Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2665 sessionId: src_id|b2452d17-534e7ac3-c3ae7844-4d8027e9_0 is DEAD
2025-10-10T14:38:27.082258Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 63 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602460045429932:11816]
2025-10-10T14:38:27.093971Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b2452d17-534e7ac3-c3ae7844-4d8027e9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:27.097706Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:27.097726Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2666
2025-10-10T14:38:27.097960Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2666 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:27.098002Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2666 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:27.098014Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2666 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:27.098019Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:27.098554Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2666 sessionId:  describe result for acl check
2025-10-10T14:38:27.098608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:27.098610Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:27.098611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:27.098619Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602464340397340:12197] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:27.099182Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602464340397340:12197] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:27.103530Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602464340397340:12197] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:27.109523Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602464340397340:12197] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:27.109544Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602464340397340:12197] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:27.109557Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602464340397340:12197] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:27.109567Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2666 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:27.110135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:27.112977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:27.113248Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:27.113255Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:27.113268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:27.113351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:27.113396Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602463558159857:12116]
2025-10-10T14:38:27.114039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:27.114496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:27.114566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:27.115017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:27.115133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:27.115150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:27.115151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:27.115153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:27.115155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:27.115156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:27.115157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:27.115159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:27.115161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:27.115162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:27.115164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:27.115165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:27.115167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:27.115176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:27.115190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:27.115195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:27.115199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:27.115204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:27.115209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:27.115213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:27.115217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:27.115222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:27.115226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:27.115231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:27.115236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:27.115240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:27.115252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:27.115262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:27.115273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:27.115280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:27.115295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:27.115301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:27.115312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:27.115319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:27.115330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:27.115337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:27.115348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:27.115355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:27.115361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:27.115367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:27.115373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:27.115379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:27.115385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:27.115405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:27.115410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:27.115417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:27.115422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:27.115426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:27.115431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:27.115437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:27.115443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:27.115449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:27.115495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:27.118249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:27.118938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:27.118954Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:27.118957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:27.118960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:27.118968Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2665 [2:7559602463558159857:12116]
2025-10-10T14:38:27.118981Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:27.119000Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:27.119004Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:27.119008Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:27.119010Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:27.119028Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:27.119041Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:27.119049Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:27.119114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:27.119121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:27.119124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:27.119127Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:27.119216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:27.119226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:27.119240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:27.119252Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:27.119269Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:27.119292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602464340397231:2438], now have 1 active actors on pipe
2025-10-10T14:38:27.119301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602464340397503:12197], now have 1 active actors on pipe
2025-10-10T14:38:27.119308Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602463558159852:12116]
2025-10-10T14:38:27.119310Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602463558159852:12116]
2025-10-10T14:38:27.119313Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602463558159852:12116]
2025-10-10T14:38:27.119326Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:27.119341Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:27.119357Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:27.119358Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:27.119347Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2665
2025-10-10T14:38:27.119362Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:27.119368Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:27.119370Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:27.119388Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602463558159852:12116]
2025-10-10T14:38:27.119392Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:27.119393Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:27.119410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:27.119415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:27.119436Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2665
2025-10-10T14:38:27.119472Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|39d0b107-d85b3341-efd2dfa-e7efa504_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:27.119486Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:27.119490Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:27.119498Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:27.119510Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:27.119526Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:27.119553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:27.119733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:27.119744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:27.119760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:27.119849Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2666 partition: 0 MaxSeqNo: 40 sessionId: src_id|39d0b107-d85b3341-efd2dfa-e7efa504_0
2025-10-10T14:38:27.120278Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2452d17-534e7ac3-c3ae7844-4d8027e9_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|39d0b107-d85b3341-efd2dfa-e7efa504_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:27.123091Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|39d0b107-d85b3341-efd2dfa-e7efa504_0] Write session: try to update token
2025-10-10T14:38:27.123114Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|39d0b107-d85b3341-efd2dfa-e7efa504_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:27.137987Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2666 sessionId: src_id|39d0b107-d85b3341-efd2dfa-e7efa504_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:27.139699Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:27.139722Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:27.139726Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:27.139728Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:27.139738Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602463558159852:12116]
2025-10-10T14:38:27.139742Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602463558159852:12116]
2025-10-10T14:38:27.139746Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602463558159852:12116]
2025-10-10T14:38:27.139805Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:27.139823Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:27.139831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:27.139936Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:27.139958Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:27.139986Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:27.139987Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:27.140960Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:27.181751Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602464340397515:11816]
2025-10-10T14:38:27.182227Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 pipe creation result: OK TabletId: 72075186224037892 Generation: 2665, pipe: [1:7559602464340397515:11816]
2025-10-10T14:38:27.221428Z :ERROR: [/Root] OnFederationDiscovery: Got error. Status: CLIENT_DEADLINE_EXCEEDED. Description: [ { <main>: Error: GRpc error: (4): Deadline Exceeded } { <main>: Error: Grpc error response on endpoint localhost:7170 } ]
2025-10-10T14:38:27.261379Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:27.261946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:27.261966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:27.262013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602464340397515:11816], now have 1 active actors on pipe
2025-10-10T14:38:27.262265Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:27.262280Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:27.262326Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 64 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602464340397515:11816]
2025-10-10T14:38:27.262340Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:27.262352Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:27.262429Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2666 reason: error at write: Disconnected sessionId: src_id|39d0b107-d85b3341-efd2dfa-e7efa504_0
2025-10-10T14:38:27.262629Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2666 sessionId: src_id|39d0b107-d85b3341-efd2dfa-e7efa504_0 is DEAD
2025-10-10T14:38:27.262806Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39d0b107-d85b3341-efd2dfa-e7efa504_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:27.262822Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39d0b107-d85b3341-efd2dfa-e7efa504_0] Write session will restart in 0.006016s
2025-10-10T14:38:27.262851Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39d0b107-d85b3341-efd2dfa-e7efa504_0] Write session: Do CDS request
2025-10-10T14:38:27.262857Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39d0b107-d85b3341-efd2dfa-e7efa504_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:27.269903Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|39d0b107-d85b3341-efd2dfa-e7efa504_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:27.269972Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:27.269990Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2667
2025-10-10T14:38:27.270201Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2667 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:27.270250Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2667 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:27.270261Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2667 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:27.270266Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:27.270769Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2667 sessionId:  describe result for acl check
2025-10-10T14:38:27.270815Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:27.270836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:27.270838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:27.270845Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602464340397531:12201] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:27.271466Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602464340397531:12201] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:27.274740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602464340397531:12201] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:27.280573Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602464340397531:12201] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:27.280595Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602464340397531:12201] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:27.280600Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602464340397531:12201] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:27.280610Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2667 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:27.294211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:27.300006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:27.300297Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:27.300308Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:27.300322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:27.300395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:27.300459Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602463558160115:12119]
2025-10-10T14:38:27.301085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:27.301516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:27.301575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:27.301960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:27.302033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:27.302034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:27.302036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:27.302037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:27.302039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:27.302040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:27.302042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:27.302043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:27.302059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:27.302061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:27.302062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:27.302064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:27.302065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:27.302073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:27.302088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:27.302093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:27.302098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:27.302102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:27.302107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:27.302111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:27.302115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:27.302119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:27.302123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:27.302127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:27.302131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:27.302134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:27.302145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:27.302154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:27.302160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:27.302166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:27.302170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:27.302175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:27.302179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:27.302184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:27.302189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:27.302195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:27.302200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:27.302204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:27.302209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:27.302214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:27.302239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:27.302248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:27.302252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:27.302257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:27.302261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:27.302270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:27.302275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:27.302291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:27.302302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:27.302307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:27.302311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:27.302317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:27.302357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:27.305216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:27.306236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:27.306258Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:27.306261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:27.306266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:27.306275Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2666 [2:7559602463558160115:12119]
2025-10-10T14:38:27.306296Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:27.306319Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:27.306344Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:27.306355Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:27.306357Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:27.306379Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:27.306394Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:27.306410Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:27.306498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:27.306508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:27.306511Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:27.306514Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:27.306600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:27.306608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:27.306626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:27.306638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:27.306656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:27.306842Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2666
2025-10-10T14:38:27.306885Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2666
2025-10-10T14:38:27.306683Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602463558160110:12119]
2025-10-10T14:38:27.306693Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602463558160110:12119]
2025-10-10T14:38:27.306696Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602463558160110:12119]
2025-10-10T14:38:27.306710Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:27.306720Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:27.306723Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:27.306725Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:27.306726Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:27.306744Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:27.306748Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:27.306761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602464340397651:12201], now have 1 active actors on pipe
2025-10-10T14:38:27.306766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602464340397517:2438], now have 1 active actors on pipe
2025-10-10T14:38:27.307085Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602463558160110:12119]
2025-10-10T14:38:27.307107Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:27.307117Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:27.307154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:27.307165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:27.307217Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3e67007f-9dd80124-fb17e207-eddd7cb4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:27.307236Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:27.307241Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:27.307245Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:27.307260Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:27.307282Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:27.307317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:27.307469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:27.307492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:27.307516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:27.307661Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2667 partition: 0 MaxSeqNo: 40 sessionId: src_id|3e67007f-9dd80124-fb17e207-eddd7cb4_0
2025-10-10T14:38:27.308175Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39d0b107-d85b3341-efd2dfa-e7efa504_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|3e67007f-9dd80124-fb17e207-eddd7cb4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:27.311281Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3e67007f-9dd80124-fb17e207-eddd7cb4_0] Write session: try to update token
2025-10-10T14:38:27.311309Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3e67007f-9dd80124-fb17e207-eddd7cb4_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:27.327698Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:27.327722Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:27.327725Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:27.327726Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:27.327736Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602463558160110:12119]
2025-10-10T14:38:27.327740Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602463558160110:12119]
2025-10-10T14:38:27.327745Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602463558160110:12119]
2025-10-10T14:38:27.327793Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:27.327800Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:27.327808Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:27.327809Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:27.327811Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:27.327813Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:27.327958Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:27.327591Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2667 sessionId: src_id|3e67007f-9dd80124-fb17e207-eddd7cb4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:27.330413Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:27.362567Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602464340397816:11816]
2025-10-10T14:38:27.365736Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 pipe creation result: OK TabletId: 72075186224037892 Generation: 2666, pipe: [1:7559602464340397816:11816]
2025-10-10T14:38:27.447100Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:27.447399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:27.447420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:27.447469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602464340397816:11816], now have 1 active actors on pipe
2025-10-10T14:38:27.447798Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:27.448318Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e67007f-9dd80124-fb17e207-eddd7cb4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:27.448337Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e67007f-9dd80124-fb17e207-eddd7cb4_0] Write session will restart in 0.006692s
2025-10-10T14:38:27.447842Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:27.447859Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:27.447927Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2667 reason: error at write: Disconnected sessionId: src_id|3e67007f-9dd80124-fb17e207-eddd7cb4_0
2025-10-10T14:38:27.448120Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2667 sessionId: src_id|3e67007f-9dd80124-fb17e207-eddd7cb4_0 is DEAD
2025-10-10T14:38:27.448373Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e67007f-9dd80124-fb17e207-eddd7cb4_0] Write session: Do CDS request
2025-10-10T14:38:27.448247Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:27.448381Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e67007f-9dd80124-fb17e207-eddd7cb4_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:27.448291Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 65 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602464340397816:11816]
2025-10-10T14:38:27.456311Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3e67007f-9dd80124-fb17e207-eddd7cb4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:27.456422Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:27.456441Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2668
2025-10-10T14:38:27.456571Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2668 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:27.456622Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2668 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:27.456633Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2668 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:27.456638Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:27.457196Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2668 sessionId:  describe result for acl check
2025-10-10T14:38:27.457235Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:27.457241Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:27.457243Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:27.457249Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602464340397845:12214] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:27.457791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602464340397845:12214] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:27.461099Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602464340397845:12214] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:27.465270Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602464340397845:12214] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:27.465291Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602464340397845:12214] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:27.465295Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602464340397845:12214] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:27.465304Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2668 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:27.476883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:27.479592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:27.479787Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:27.479796Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:27.479805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:27.479846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:27.479877Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602463558160422:12135]
2025-10-10T14:38:27.480298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:27.480637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:27.480670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:27.480889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:27.480934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:27.480935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:27.480937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:27.480937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:27.480938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:27.480939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:27.480940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:27.480941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:27.480942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:27.480943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:27.480944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:27.480944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:27.480945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:27.480949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:27.480959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:27.480961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:27.480964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:27.480967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:27.480969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:27.480972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:27.480974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:27.480977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:27.480980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:27.480983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:27.480985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:27.480988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:27.480994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:27.481000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:27.481004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:27.481008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:27.481011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:27.481014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:27.481016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:27.481020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:27.481022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:27.481026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:27.481028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:27.481032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:27.481035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:27.481038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:27.481041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:27.481045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:27.481047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:27.481051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:27.481053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:27.481058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:27.481061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:27.481064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:27.481067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:27.481070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:27.481072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:27.481076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:27.481101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:27.484059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:27.484678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:27.484683Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:27.484685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:27.484688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:27.484695Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2667 [2:7559602463558160422:12135]
2025-10-10T14:38:27.484710Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:27.484731Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:27.484735Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:27.484739Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:27.484741Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:27.484755Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:27.484762Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:27.484770Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:27.484820Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:27.484821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:27.484823Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:27.484825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:27.484898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:27.484901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:27.484912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:27.484922Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:27.484938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:27.484961Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602463558160417:12135]
2025-10-10T14:38:27.484964Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602463558160417:12135]
2025-10-10T14:38:27.484967Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602463558160417:12135]
2025-10-10T14:38:27.484975Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:27.484982Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:27.484984Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:27.484986Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:27.484992Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:27.485007Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:27.485011Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:27.485023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602464340397982:12214], now have 1 active actors on pipe
2025-10-10T14:38:27.485026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602464340397830:2438], now have 1 active actors on pipe
2025-10-10T14:38:27.485050Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602463558160417:12135]
2025-10-10T14:38:27.485058Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:27.485167Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2667
2025-10-10T14:38:27.485201Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2667
2025-10-10T14:38:27.485192Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:27.485347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:27.485359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:27.485395Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ce13c534-53d30a95-963ebf94-80f286b7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:27.485403Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:27.485408Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:27.485410Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:27.485424Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:27.485436Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:27.485452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:27.485932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:27.485941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:27.485959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:27.486095Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2668 partition: 0 MaxSeqNo: 40 sessionId: src_id|ce13c534-53d30a95-963ebf94-80f286b7_0
2025-10-10T14:38:27.486519Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e67007f-9dd80124-fb17e207-eddd7cb4_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|ce13c534-53d30a95-963ebf94-80f286b7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:27.489458Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ce13c534-53d30a95-963ebf94-80f286b7_0] Write session: try to update token
2025-10-10T14:38:27.489480Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ce13c534-53d30a95-963ebf94-80f286b7_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:27.506174Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2668 sessionId: src_id|ce13c534-53d30a95-963ebf94-80f286b7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:27.508758Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:27.509007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:27.509032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:27.509075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:38:27.509165Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:38:27.511885Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:27.511905Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:27.511908Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:27.511910Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:27.511920Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602463558160417:12135]
2025-10-10T14:38:27.511924Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602463558160417:12135]
2025-10-10T14:38:27.511928Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602463558160417:12135]
2025-10-10T14:38:27.511979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:27.511986Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:27.511989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:27.511992Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:27.511997Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:27.512001Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:27.512132Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:27.547968Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602464340398129:11816]
2025-10-10T14:38:27.548569Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 pipe creation result: OK TabletId: 72075186224037892 Generation: 2667, pipe: [1:7559602464340398129:11816]
2025-10-10T14:38:27.628851Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:27.638197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:27.638235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:27.638434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:27.638504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:27.638571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:27.638641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:27.638694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:27.638706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:27.638779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:27.638841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:27.638906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:27.638978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:27.639032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:27.639040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:27.639117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:27.639191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:27.639258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:27.639328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:27.639380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:27.639388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:27.639463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:27.639536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:27.639610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:27.639688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:27.639735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:27.639742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:27.639826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:27.639898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:27.639968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:27.640039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:27.640088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:27.640102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:27.640178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:27.640249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:27.640323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:27.640399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:27.640454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:27.640461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:27.640534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:27.640601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:27.640672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:27.640740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:27.640795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:27.640800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:27.640868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:27.640932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:27.640994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:27.641060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:27.641105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:27.641111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:27.641177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:27.641246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:27.641305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:27.641395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:27.641442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:27.641449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:27.641519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:27.641579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:27.642102Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 66 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602464340398129:11816]
2025-10-10T14:38:27.642148Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:27.642151Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:27.642186Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2668 reason: error at write: Disconnected sessionId: src_id|ce13c534-53d30a95-963ebf94-80f286b7_0
2025-10-10T14:38:27.642415Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2668 sessionId: src_id|ce13c534-53d30a95-963ebf94-80f286b7_0 is DEAD
2025-10-10T14:38:27.642575Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:27.642627Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce13c534-53d30a95-963ebf94-80f286b7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:27.642636Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce13c534-53d30a95-963ebf94-80f286b7_0] Write session will restart in 0.005072s
2025-10-10T14:38:27.642665Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce13c534-53d30a95-963ebf94-80f286b7_0] Write session: Do CDS request
2025-10-10T14:38:27.642671Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce13c534-53d30a95-963ebf94-80f286b7_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:27.641646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:27.641716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:27.641758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:27.641761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:27.641840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602464340398129:11816], now have 1 active actors on pipe
2025-10-10T14:38:27.643134Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:27.648959Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ce13c534-53d30a95-963ebf94-80f286b7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:27.649038Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:27.649056Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2669
2025-10-10T14:38:27.649207Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2669 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:27.649248Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2669 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:27.649259Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2669 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:27.649263Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:27.649787Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2669 sessionId:  describe result for acl check
2025-10-10T14:38:27.649825Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:27.649834Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:27.649836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:27.649843Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602464340398138:12219] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:27.650430Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602464340398138:12219] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:27.653609Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602464340398138:12219] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:27.656723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602464340398138:12219] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:27.656738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602464340398138:12219] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:27.656742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602464340398138:12219] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:27.656751Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2669 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:27.673958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:27.677160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:27.677489Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:27.677500Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:27.677513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:27.677586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:27.677640Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602463558160681:12137]
2025-10-10T14:38:27.678289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:27.678639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:27.678691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:27.679035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:27.679126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:27.679133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:27.679135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:27.679136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:27.679137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:27.679139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:27.679140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:27.679141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:27.679142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:27.679143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:27.679145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:27.679146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:27.679148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:27.679154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:27.679167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:27.679171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:27.679175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:27.679179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:27.679183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:27.679187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:27.679191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:27.679195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:27.679199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:27.679203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:27.679206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:27.679211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:27.679220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:27.679229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:27.679236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:27.679241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:27.679246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:27.679252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:27.679256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:27.679263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:27.679270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:27.679275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:27.679279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:27.679284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:27.679291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:27.679296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:27.679300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:27.679305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:27.679310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:27.679317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:27.679321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:27.679326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:27.679332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:27.679337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:27.679341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:27.679346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:27.679350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:27.679357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:27.679394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:27.681908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:27.682353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:27.682367Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:27.682369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:27.682373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:27.682381Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2668 [2:7559602463558160681:12137]
2025-10-10T14:38:27.682395Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:27.682418Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:27.682426Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:27.682430Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:27.682432Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:27.682452Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:27.682464Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:27.682473Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:27.682546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:27.682554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:27.682557Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:27.682559Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:27.682628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:27.682636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:27.682646Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:27.682659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:27.682687Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:27.682710Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602463558160676:12137]
2025-10-10T14:38:27.682712Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602463558160676:12137]
2025-10-10T14:38:27.682717Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602463558160676:12137]
2025-10-10T14:38:27.682729Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:27.682746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602464340398131:2438], now have 1 active actors on pipe
2025-10-10T14:38:27.682756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602464340398176:12219], now have 1 active actors on pipe
2025-10-10T14:38:27.682764Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:27.682785Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:27.682792Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:27.682816Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602463558160676:12137]
2025-10-10T14:38:27.682822Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:27.682811Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2668
2025-10-10T14:38:27.682811Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2668
2025-10-10T14:38:27.682859Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:27.682867Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:27.682869Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:27.682874Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:27.682966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:27.682983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:27.683026Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2ae97165-ea3d1ed4-160a70cf-829ad59_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:27.683041Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:27.683050Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:27.683052Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:27.683064Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:27.683086Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:27.683103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:27.683252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:27.683259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:27.683273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:27.683356Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2669 partition: 0 MaxSeqNo: 40 sessionId: src_id|2ae97165-ea3d1ed4-160a70cf-829ad59_0
2025-10-10T14:38:27.685484Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce13c534-53d30a95-963ebf94-80f286b7_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|2ae97165-ea3d1ed4-160a70cf-829ad59_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:27.688334Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2ae97165-ea3d1ed4-160a70cf-829ad59_0] Write session: try to update token
2025-10-10T14:38:27.688357Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2ae97165-ea3d1ed4-160a70cf-829ad59_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:27.703759Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:27.703785Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:27.703788Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:27.703791Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:27.703801Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602463558160676:12137]
2025-10-10T14:38:27.703806Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602463558160676:12137]
2025-10-10T14:38:27.703810Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602463558160676:12137]
2025-10-10T14:38:27.703863Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:27.703867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:27.703874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:27.703877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:27.703878Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:27.703883Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:27.704016Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:27.707333Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2669 sessionId: src_id|2ae97165-ea3d1ed4-160a70cf-829ad59_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:27.710167Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:27.742410Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602464340398419:11816]
2025-10-10T14:38:27.742715Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 pipe creation result: OK TabletId: 72075186224037892 Generation: 2668, pipe: [1:7559602464340398419:11816]
2025-10-10T14:38:27.830559Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:27.831043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:27.831066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:27.831121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602464340398419:11816], now have 1 active actors on pipe
2025-10-10T14:38:27.831387Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:27.831333Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:27.831368Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 67 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602464340398419:11816]
2025-10-10T14:38:27.831392Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:27.831398Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:27.831679Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2669 reason: error at write: Disconnected sessionId: src_id|2ae97165-ea3d1ed4-160a70cf-829ad59_0
2025-10-10T14:38:27.831888Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2669 sessionId: src_id|2ae97165-ea3d1ed4-160a70cf-829ad59_0 is DEAD
2025-10-10T14:38:27.833521Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ae97165-ea3d1ed4-160a70cf-829ad59_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:27.833534Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ae97165-ea3d1ed4-160a70cf-829ad59_0] Write session will restart in 0.008980s
2025-10-10T14:38:27.833558Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ae97165-ea3d1ed4-160a70cf-829ad59_0] Write session: Do CDS request
2025-10-10T14:38:27.833568Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ae97165-ea3d1ed4-160a70cf-829ad59_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:27.843935Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2ae97165-ea3d1ed4-160a70cf-829ad59_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:27.843992Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:27.844021Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2670
2025-10-10T14:38:27.844148Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2670 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:27.844181Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2670 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:27.844188Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2670 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:27.844192Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:27.844755Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2670 sessionId:  describe result for acl check
2025-10-10T14:38:27.844805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:27.844811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:27.844813Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:27.844823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602464340398517:12224] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:27.845435Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602464340398517:12224] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:27.848812Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602464340398517:12224] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:27.852675Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602464340398517:12224] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:27.852692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602464340398517:12224] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:27.852695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602464340398517:12224] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:27.852704Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2670 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:27.855076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:27.857684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:27.857908Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:27.857920Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:27.857931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:27.857981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:27.858028Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602463558160940:12139]
2025-10-10T14:38:27.858713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:27.859059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:27.859121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:27.859483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:27.859540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:27.859547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:27.859549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:27.859550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:27.859551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:27.859553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:27.859554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:27.859555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:27.859557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:27.859559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:27.859560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:27.859561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:27.859562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:27.859567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:27.859581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:27.859586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:27.859591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:27.859595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:27.859600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:27.859604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:27.859608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:27.859612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:27.859617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:27.859621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:27.859625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:27.859628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:27.859637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:27.859646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:27.859653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:27.859658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:27.859664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:27.859670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:27.859675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:27.859681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:27.859686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:27.859701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:27.859706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:27.859712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:27.859717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:27.859723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:27.859728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:27.859733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:27.859738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:27.859744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:27.859751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:27.859757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:27.859762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:27.859767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:27.859778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:27.859784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:27.859790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:27.859800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:27.859857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:27.862419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:27.863170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:27.863183Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:27.863185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:27.863189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:27.863195Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2669 [2:7559602463558160940:12139]
2025-10-10T14:38:27.863207Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:27.863226Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:27.863235Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:27.863238Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:27.863241Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:27.863258Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:27.863271Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:27.863279Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:27.863342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:27.863350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:27.863352Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:27.863355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:27.863421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:27.863428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:27.863441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:27.863457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:27.863476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:27.863502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602464340398699:12224], now have 1 active actors on pipe
2025-10-10T14:38:27.863510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602464340398428:2438], now have 1 active actors on pipe
2025-10-10T14:38:27.863519Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602463558160935:12139]
2025-10-10T14:38:27.863521Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602463558160935:12139]
2025-10-10T14:38:27.863523Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602463558160935:12139]
2025-10-10T14:38:27.863537Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:27.863550Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:27.863551Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:27.863559Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:27.863561Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:27.863566Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:27.863569Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:27.863592Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602463558160935:12139]
2025-10-10T14:38:27.863576Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2669
2025-10-10T14:38:27.863601Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:27.863581Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2669
2025-10-10T14:38:27.863606Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:27.863624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:27.863629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:27.863673Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|acb82e9d-a0533540-b4625664-1751285f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:27.863687Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:27.863697Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:27.863699Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:27.863711Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:27.863722Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:27.863748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:27.863887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:27.863894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:27.863909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:27.864000Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2670 partition: 0 MaxSeqNo: 40 sessionId: src_id|acb82e9d-a0533540-b4625664-1751285f_0
2025-10-10T14:38:27.864427Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ae97165-ea3d1ed4-160a70cf-829ad59_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|acb82e9d-a0533540-b4625664-1751285f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:27.867272Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|acb82e9d-a0533540-b4625664-1751285f_0] Write session: try to update token
2025-10-10T14:38:27.867290Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|acb82e9d-a0533540-b4625664-1751285f_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:27.883220Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2670 sessionId: src_id|acb82e9d-a0533540-b4625664-1751285f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:27.886017Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:27.886968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:27.886998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:27.887022Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:27.887025Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:27.887029Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:27.887032Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:27.887040Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602463558160935:12139]
2025-10-10T14:38:27.887045Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602463558160935:12139]
2025-10-10T14:38:27.887049Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602463558160935:12139]
2025-10-10T14:38:27.887098Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:27.887113Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:27.887122Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:27.887124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:27.887132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:27.887135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:27.887262Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:27.931393Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602464340398720:11816]
2025-10-10T14:38:27.931895Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 pipe creation result: OK TabletId: 72075186224037892 Generation: 2669, pipe: [1:7559602464340398720:11816]
2025-10-10T14:38:28.013997Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:28.014493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:38:28.014554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602464340398720:11816], now have 1 active actors on pipe
2025-10-10T14:38:28.014765Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:38:28.014877Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:28.014881Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:28.014976Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2670 reason: error at write: Disconnected sessionId: src_id|acb82e9d-a0533540-b4625664-1751285f_0
2025-10-10T14:38:28.015129Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2670 sessionId: src_id|acb82e9d-a0533540-b4625664-1751285f_0 is DEAD
2025-10-10T14:38:28.015182Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:28.015224Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 68 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602464340398720:11816]
2025-10-10T14:38:28.021623Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|acb82e9d-a0533540-b4625664-1751285f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:28.021641Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|acb82e9d-a0533540-b4625664-1751285f_0] Write session will restart in 0.006267s
2025-10-10T14:38:28.021670Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|acb82e9d-a0533540-b4625664-1751285f_0] Write session: Do CDS request
2025-10-10T14:38:28.021677Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|acb82e9d-a0533540-b4625664-1751285f_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:28.028915Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|acb82e9d-a0533540-b4625664-1751285f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:28.029488Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:28.029509Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2671
2025-10-10T14:38:28.033463Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2671 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:28.033525Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2671 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:28.033532Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2671 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:28.033540Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:28.034307Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2671 sessionId:  describe result for acl check
2025-10-10T14:38:28.034350Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:28.034357Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:28.034359Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:28.034367Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602468635366034:12228] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:28.035033Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602468635366034:12228] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:28.041689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602468635366034:12228] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:28.047389Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602468635366034:12228] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:28.047406Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602468635366034:12228] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:28.047410Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602468635366034:12228] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:28.047420Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2671 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:28.054316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:28.057154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:28.057446Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:28.057459Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:28.057475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:28.057547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:28.057590Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602467853128496:12141]
2025-10-10T14:38:28.058257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:28.058630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:28.058706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:28.059086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:28.059165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:28.059172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:28.059174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:28.059175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:28.059176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:28.059178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:28.059179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:28.059181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:28.059182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:28.059184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:28.059185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:28.059187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:28.059188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:28.059195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:28.059210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:28.059214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:28.059219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:28.059223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:28.059228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:28.059233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:28.059237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:28.059241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:28.059247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:28.059251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:28.059255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:28.059260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:28.059268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:28.059277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:28.059285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:28.059291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:28.059303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:28.059309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:28.059314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:28.059320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:28.059324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:28.059334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:28.059339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:28.059345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:28.059355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:28.059361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:28.059365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:28.059378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:28.059383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:28.059390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:28.059399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:28.059406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:28.059415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:28.059421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:28.059431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:28.059437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:28.059443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:28.059454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:28.059501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:28.062196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:28.062547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:28.062562Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:28.062564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:28.062568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:28.062575Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2670 [2:7559602467853128496:12141]
2025-10-10T14:38:28.062591Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:28.062610Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:28.062618Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:28.062621Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:28.062623Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:28.062642Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:28.062649Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:28.062658Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:28.062714Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:28.062722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:28.062725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:28.062727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:28.062966Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2670
2025-10-10T14:38:28.062967Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2670
2025-10-10T14:38:28.063164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:28.063174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:28.063187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:28.063202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:28.063228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:28.063256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602468635366173:12228], now have 1 active actors on pipe
2025-10-10T14:38:28.063260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602468635366018:2438], now have 1 active actors on pipe
2025-10-10T14:38:28.063280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:28.063285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:28.063304Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602467853128491:12141]
2025-10-10T14:38:28.063313Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602467853128491:12141]
2025-10-10T14:38:28.063315Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602467853128491:12141]
2025-10-10T14:38:28.063333Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:28.063351Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:28.063354Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:28.063363Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:28.063366Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:28.063373Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:28.063377Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:28.063399Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|adb3c3b0-7e3acab-13369d28-a98175f8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:28.063411Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:28.063417Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:28.063424Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:28.063436Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:28.063453Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:28.063488Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602467853128491:12141]
2025-10-10T14:38:28.063497Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:28.063503Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:28.063509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:28.063704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:28.063716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:28.063753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:28.063861Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2671 partition: 0 MaxSeqNo: 40 sessionId: src_id|adb3c3b0-7e3acab-13369d28-a98175f8_0
2025-10-10T14:38:28.064284Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|acb82e9d-a0533540-b4625664-1751285f_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|adb3c3b0-7e3acab-13369d28-a98175f8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:28.067203Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|adb3c3b0-7e3acab-13369d28-a98175f8_0] Write session: try to update token
2025-10-10T14:38:28.067222Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|adb3c3b0-7e3acab-13369d28-a98175f8_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:28.081771Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:38:28.081793Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:28.081807Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602467853128491:12141]
2025-10-10T14:38:28.081869Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:38:28.081879Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:38:28.082083Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:38:28.082232Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:28.082370Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:28.082513Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:28.082707Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:38:28.083021Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:38:28.083399Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2671 sessionId: src_id|adb3c3b0-7e3acab-13369d28-a98175f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:28.086318Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:28.086624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:28.086648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:28.086700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:38:28.087254Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:38:28.115173Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602468635366308:11816]
2025-10-10T14:38:28.115459Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 pipe creation result: OK TabletId: 72075186224037892 Generation: 2670, pipe: [1:7559602468635366308:11816]
2025-10-10T14:38:28.124524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:28.124667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:28.124871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:28.124930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:28.124994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:28.125061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:28.125103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:28.125109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:28.125180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:28.125239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:28.125301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:28.125385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:28.125427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:28.125431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:28.125506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:28.125571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:28.125636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:28.125699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:28.125742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:28.125745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:28.125819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:28.125886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:28.125948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:28.126014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:28.126071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:28.126074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:28.126144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:28.126202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:28.126260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:28.126324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:28.126365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:28.126368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:28.126439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:28.126501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:28.126557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:28.126616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:28.126660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:28.126664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:28.126731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:28.126789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:28.126851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:28.126918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:28.126959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:28.126963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:28.127030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:28.127084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:28.127145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:28.127209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:28.127251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:28.127254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:28.127322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:28.127382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:28.127445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:28.127505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:28.127550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:28.127553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:28.127621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:28.127682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:28.127741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:28.127800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:28.127839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:28.127843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:28.127922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602468635366308:11816], now have 1 active actors on pipe
2025-10-10T14:38:28.127936Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:28.127939Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:28.127943Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:28.127945Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:28.127956Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602467853128491:12141]
2025-10-10T14:38:28.127963Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602467853128491:12141]
2025-10-10T14:38:28.127967Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602467853128491:12141]
2025-10-10T14:38:28.128026Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:38:28.128025Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:28.128046Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:28.128050Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:28.128101Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:28.128125Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:28.128127Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-10T14:38:28.128165Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 41 partNo 0
2025-10-10T14:38:28.128178Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 41 partNo 1
2025-10-10T14:38:28.128181Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 41 partNo 2
2025-10-10T14:38:28.128185Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 41 partNo 3
2025-10-10T14:38:28.128188Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 41 partNo 4
2025-10-10T14:38:28.128593Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 41 partNo 4 FormedBlobsCount 0 NewHead: Offset 40 PartNo 0 PackedSize 2253230 count 1 nextOffset 41 batches 5
2025-10-10T14:38:28.128610Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 42 partNo 0
2025-10-10T14:38:28.128616Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 42 partNo 1
2025-10-10T14:38:28.128619Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 42 partNo 2
2025-10-10T14:38:28.128623Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 42 partNo 3
2025-10-10T14:38:28.128627Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 42 partNo 4
2025-10-10T14:38:28.129703Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 42 partNo 4 FormedBlobsCount 0 NewHead: Offset 40 PartNo 0 PackedSize 4506428 count 2 nextOffset 42 batches 9
2025-10-10T14:38:28.129720Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 43 partNo 0
2025-10-10T14:38:28.129729Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 43 partNo 1
2025-10-10T14:38:28.129733Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 43 partNo 2
2025-10-10T14:38:28.129737Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 43 partNo 3
2025-10-10T14:38:28.129740Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 43 partNo 4
2025-10-10T14:38:28.130544Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 43 partNo 4 FormedBlobsCount 0 NewHead: Offset 40 PartNo 0 PackedSize 6759626 count 3 nextOffset 43 batches 13
2025-10-10T14:38:28.130573Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 44 partNo 0
2025-10-10T14:38:28.130580Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 44 partNo 1
2025-10-10T14:38:28.130584Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 44 partNo 2
2025-10-10T14:38:28.130587Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 44 partNo 3
2025-10-10T14:38:28.131723Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 44 partNo 3 result is x0000000000_00000000000000000040_00000_0000000003_00015? size 8295638
2025-10-10T14:38:28.131744Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 44 partNo 4
2025-10-10T14:38:28.131763Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000040_00000_0000000003_00015? new key d0000000000_00000000000000000040_00000_0000000003_00015? size 8295638 WTime 1760107108131
2025-10-10T14:38:28.131872Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 44 partNo 4 FormedBlobsCount 1 NewHead: Offset 43 PartNo 3 PackedSize 717145 count 1 nextOffset 44 batches 2
2025-10-10T14:38:28.131886Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 45 partNo 0
2025-10-10T14:38:28.131891Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 45 partNo 1
2025-10-10T14:38:28.131897Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 45 partNo 2
2025-10-10T14:38:28.131902Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 45 partNo 3
2025-10-10T14:38:28.131905Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 45 partNo 4
2025-10-10T14:38:28.132579Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 45 partNo 4 FormedBlobsCount 0 NewHead: Offset 43 PartNo 3 PackedSize 2970343 count 2 nextOffset 45 batches 6
2025-10-10T14:38:28.132602Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 0
2025-10-10T14:38:28.132607Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 1
2025-10-10T14:38:28.132611Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 2
2025-10-10T14:38:28.132614Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 3
2025-10-10T14:38:28.132618Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 4
2025-10-10T14:38:28.133200Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 46 partNo 4 FormedBlobsCount 0 NewHead: Offset 43 PartNo 3 PackedSize 5223541 count 3 nextOffset 46 batches 10
2025-10-10T14:38:28.133226Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 0
2025-10-10T14:38:28.133239Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 1
2025-10-10T14:38:28.133242Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 2
2025-10-10T14:38:28.133245Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 3
2025-10-10T14:38:28.133248Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 4
2025-10-10T14:38:28.133807Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 47 partNo 4 FormedBlobsCount 0 NewHead: Offset 43 PartNo 3 PackedSize 7476739 count 4 nextOffset 47 batches 14
2025-10-10T14:38:28.133832Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 0
2025-10-10T14:38:28.133838Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 1
2025-10-10T14:38:28.134977Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 48 partNo 1 result is x0000000000_00000000000000000043_00003_0000000004_00014? size 7988760
2025-10-10T14:38:28.134997Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 2
2025-10-10T14:38:28.135004Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 3
2025-10-10T14:38:28.135008Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 4
2025-10-10T14:38:28.135021Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000043_00003_0000000004_00014? new key d0000000000_00000000000000000043_00003_0000000004_00014? size 7988760 WTime 1760107108134
2025-10-10T14:38:28.135360Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 48 partNo 4 FormedBlobsCount 1 NewHead: Offset 47 PartNo 1 PackedSize 1741199 count 1 nextOffset 48 batches 4
2025-10-10T14:38:28.135384Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 49 partNo 0
2025-10-10T14:38:28.135393Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 49 partNo 1
2025-10-10T14:38:28.135397Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 49 partNo 2
2025-10-10T14:38:28.135401Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 49 partNo 3
2025-10-10T14:38:28.135405Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 49 partNo 4
2025-10-10T14:38:28.135891Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 49 partNo 4 FormedBlobsCount 0 NewHead: Offset 47 PartNo 1 PackedSize 3994397 count 2 nextOffset 49 batches 8
2025-10-10T14:38:28.135914Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 50 partNo 0
2025-10-10T14:38:28.135919Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 50 partNo 1
2025-10-10T14:38:28.135923Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 50 partNo 2
2025-10-10T14:38:28.135927Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 50 partNo 3
2025-10-10T14:38:28.135931Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 50 partNo 4
2025-10-10T14:38:28.136378Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 50 partNo 4 FormedBlobsCount 0 NewHead: Offset 47 PartNo 1 PackedSize 6247595 count 3 nextOffset 50 batches 12
2025-10-10T14:38:28.136415Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:28.136531Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 47,3 HeadOffset 40 endOffset 40 curOffset 50 d0000000000_00000000000000000047_00001_0000000003_00011? size 6247585 WTime 1760107108136
2025-10-10T14:38:28.137235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:28.137254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:28.137256Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:28.137410Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:28.256077Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:28.256362Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:38:28.256395Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 40 partNo 0 count 3 size 8295638
2025-10-10T14:38:28.256403Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 43 partNo 3 count 4 size 7988760
2025-10-10T14:38:28.256409Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 47 partNo 1 count 3 size 6247585
2025-10-10T14:38:28.256635Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:28.256660Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 69 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602468635366308:11816]
2025-10-10T14:38:28.256712Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:38:28.256770Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2671 reason: status is not ok: tablet will be restarted right now sessionId: src_id|adb3c3b0-7e3acab-13369d28-a98175f8_0
2025-10-10T14:38:28.257079Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2671 sessionId: src_id|adb3c3b0-7e3acab-13369d28-a98175f8_0 is DEAD
2025-10-10T14:38:28.257162Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|adb3c3b0-7e3acab-13369d28-a98175f8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:38:28.257172Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|adb3c3b0-7e3acab-13369d28-a98175f8_0] Write session will restart in 0.006517s
2025-10-10T14:38:28.257207Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|adb3c3b0-7e3acab-13369d28-a98175f8_0] Write session: Do CDS request
2025-10-10T14:38:28.257217Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|adb3c3b0-7e3acab-13369d28-a98175f8_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:28.257285Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:28.264960Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|adb3c3b0-7e3acab-13369d28-a98175f8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:28.265027Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:28.265044Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2672
2025-10-10T14:38:28.265180Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2672 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:28.265216Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2672 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:28.265222Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2672 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:28.265227Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:28.265729Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2672 sessionId:  describe result for acl check
2025-10-10T14:38:28.265785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:28.265792Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:28.265794Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:28.265800Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602468635366350:12232] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:28.266404Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602468635366350:12232] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:28.269623Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602468635366350:12232] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:28.274416Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602468635366350:12232] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:28.274432Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602468635366350:12232] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:28.274436Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602468635366350:12232] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:28.274444Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2672 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:28.276798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:28.279243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:28.279510Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:28.279524Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:28.279537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:28.279595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:28.279652Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602467853128760:12144]
2025-10-10T14:38:28.280301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:28.280638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:28.280685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:28.281032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:28.281101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:28.281107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:28.281109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:28.281110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:28.281111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:28.281113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:28.281114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:28.281115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:28.281116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:28.281117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:28.281119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:28.281120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:28.281122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:28.281128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:28.281142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:28.281146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:28.281149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:28.281153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:28.281157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:28.281162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:28.281166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:28.281171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:28.281175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:28.281179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:28.281183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:28.281187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:28.281196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:28.281208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:28.281215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:28.281221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:28.281226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:28.281231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:28.281235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:28.281241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:28.281246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:28.281251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:28.281255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:28.281261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:28.281266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:28.281277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:28.281281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:28.281287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:28.281294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:28.281300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:28.281310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:28.281316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:28.281325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:28.281406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:28.281416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:28.281423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:28.281431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:28.281437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:28.281476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:28.284232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:28.284577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:28.284589Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:28.284592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:28.284597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:28.284603Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2671 [2:7559602467853128760:12144]
2025-10-10T14:38:28.284618Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:28.284638Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:28.284646Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:28.284650Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:28.284652Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:28.284672Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:28.284685Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:28.284694Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:28.284761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:28.284769Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:28.284772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:28.284775Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:28.284850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:28.284861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:28.284875Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:28.284888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:28.284908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:28.284936Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602467853128755:12144]
2025-10-10T14:38:28.284944Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602467853128755:12144]
2025-10-10T14:38:28.284947Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602467853128755:12144]
2025-10-10T14:38:28.284966Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:28.284983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602468635366574:12232], now have 1 active actors on pipe
2025-10-10T14:38:28.284991Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:28.284993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602468635366311:2438], now have 1 active actors on pipe
2025-10-10T14:38:28.285002Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:28.285013Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:28.285020Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:28.285024Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:28.285024Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:28.285057Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602467853128755:12144]
2025-10-10T14:38:28.285066Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:28.285094Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:28.285099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:28.285104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:28.285142Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ca8f807e-42cab274-4433c02b-f2b62f72_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:28.285150Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:28.285155Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:28.285158Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:28.285170Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:28.285181Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:28.285197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:28.285054Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2671
2025-10-10T14:38:28.285053Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2671
2025-10-10T14:38:28.287347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:28.287363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:28.287396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:28.287540Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2672 partition: 0 MaxSeqNo: 40 sessionId: src_id|ca8f807e-42cab274-4433c02b-f2b62f72_0
2025-10-10T14:38:28.287953Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|adb3c3b0-7e3acab-13369d28-a98175f8_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|ca8f807e-42cab274-4433c02b-f2b62f72_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:28.290802Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ca8f807e-42cab274-4433c02b-f2b62f72_0] Write session: try to update token
2025-10-10T14:38:28.290822Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ca8f807e-42cab274-4433c02b-f2b62f72_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:28.306070Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2672 sessionId: src_id|ca8f807e-42cab274-4433c02b-f2b62f72_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:28.306232Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:28.306254Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:28.306258Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:28.306260Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:28.306271Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602467853128755:12144]
2025-10-10T14:38:28.306276Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602467853128755:12144]
2025-10-10T14:38:28.306281Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602467853128755:12144]
2025-10-10T14:38:28.306337Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:28.306344Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:28.306352Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:28.306353Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:28.306355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:28.306358Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:28.306532Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:28.309066Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:28.356829Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602468635366601:11816]
2025-10-10T14:38:28.357139Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 pipe creation result: OK TabletId: 72075186224037892 Generation: 2671, pipe: [1:7559602468635366601:11816]
2025-10-10T14:38:28.425246Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:28.425898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:28.425918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:28.425965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602468635366601:11816], now have 1 active actors on pipe
2025-10-10T14:38:28.427118Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:28.427170Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 70 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602468635366601:11816]
2025-10-10T14:38:28.427191Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:28.427198Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:28.426823Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:28.428200Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2672 reason: error at write: Disconnected sessionId: src_id|ca8f807e-42cab274-4433c02b-f2b62f72_0
2025-10-10T14:38:28.428415Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2672 sessionId: src_id|ca8f807e-42cab274-4433c02b-f2b62f72_0 is DEAD
2025-10-10T14:38:28.428779Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca8f807e-42cab274-4433c02b-f2b62f72_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:28.428789Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca8f807e-42cab274-4433c02b-f2b62f72_0] Write session will restart in 0.007630s
2025-10-10T14:38:28.428816Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca8f807e-42cab274-4433c02b-f2b62f72_0] Write session: Do CDS request
2025-10-10T14:38:28.428824Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca8f807e-42cab274-4433c02b-f2b62f72_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:28.438267Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ca8f807e-42cab274-4433c02b-f2b62f72_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:28.438626Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:28.438645Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2673
2025-10-10T14:38:28.438756Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2673 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:28.438792Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2673 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:28.438802Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2673 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:28.438806Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:28.440837Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2673 sessionId:  describe result for acl check
2025-10-10T14:38:28.440878Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:28.440884Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:28.440886Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:28.440891Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602468635366644:12245] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:28.441296Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602468635366644:12245] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:28.443974Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602468635366644:12245] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:28.447683Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602468635366644:12245] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:28.447699Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602468635366644:12245] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:28.447704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602468635366644:12245] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:28.447713Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2673 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:28.462496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:28.468215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:28.468491Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:28.468504Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:28.468517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:28.468578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:28.468625Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602467853129072:12153]
2025-10-10T14:38:28.469296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:28.469803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:28.469886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:28.470279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:28.470363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:28.470372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:28.470373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:28.470374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:28.470376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:28.470377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:28.470379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:28.470380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:28.470382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:28.470383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:28.470384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:28.470386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:28.470387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:28.470394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:28.470421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:28.470425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:28.470430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:28.470433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:28.470439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:28.470443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:28.470448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:28.470451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:28.470455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:28.470459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:28.470463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:28.470466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:28.470476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:28.470485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:28.470499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:28.470504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:28.470509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:28.470514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:28.470518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:28.470523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:28.470528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:28.470534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:28.470538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:28.470549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:28.470553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:28.470558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:28.470562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:28.470567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:28.470572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:28.470577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:28.470581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:28.470586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:28.470591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:28.470596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:28.470601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:28.470605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:28.470610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:28.470615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:28.470655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:28.473474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:28.474091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:28.474108Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:28.474110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:28.474114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:28.474121Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2672 [2:7559602467853129072:12153]
2025-10-10T14:38:28.474135Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:28.474154Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:28.474157Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:28.474161Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:28.474163Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:28.474181Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:28.474189Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:28.474198Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:28.474258Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:28.474266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:28.474269Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:28.474271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:28.474344Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:28.474352Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:28.474363Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:28.474373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:28.474388Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:28.474409Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602467853129067:12153]
2025-10-10T14:38:28.474411Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602467853129067:12153]
2025-10-10T14:38:28.474413Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602467853129067:12153]
2025-10-10T14:38:28.474426Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:28.474441Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:28.474457Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:28.474460Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:28.474490Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602467853129067:12153]
2025-10-10T14:38:28.474493Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:28.474607Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:28.474609Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:28.474611Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:28.474617Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:28.474961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602468635366724:12245], now have 1 active actors on pipe
2025-10-10T14:38:28.474971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602468635366616:2438], now have 1 active actors on pipe
2025-10-10T14:38:28.474981Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2672
2025-10-10T14:38:28.475020Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2672
2025-10-10T14:38:28.475282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:28.475304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:28.475339Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|af305c34-d903d207-5b8a053f-aa776b61_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:28.475353Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:28.475357Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:28.475359Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:28.475372Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:28.475386Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:28.475407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:28.475685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:28.475695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:28.475715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:28.475834Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2673 partition: 0 MaxSeqNo: 40 sessionId: src_id|af305c34-d903d207-5b8a053f-aa776b61_0
2025-10-10T14:38:28.476252Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca8f807e-42cab274-4433c02b-f2b62f72_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|af305c34-d903d207-5b8a053f-aa776b61_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:28.479188Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|af305c34-d903d207-5b8a053f-aa776b61_0] Write session: try to update token
2025-10-10T14:38:28.479206Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|af305c34-d903d207-5b8a053f-aa776b61_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:28.494328Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2673 sessionId: src_id|af305c34-d903d207-5b8a053f-aa776b61_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:28.497185Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:28.498369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:28.498395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:28.498419Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:28.498424Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:28.498427Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:28.498429Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:28.498438Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602467853129067:12153]
2025-10-10T14:38:28.498441Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602467853129067:12153]
2025-10-10T14:38:28.498447Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602467853129067:12153]
2025-10-10T14:38:28.498504Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:28.498509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:28.498516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:28.498518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:28.498520Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:28.498524Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:28.498661Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:28.527319Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602468635366931:11816]
2025-10-10T14:38:28.527696Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 pipe creation result: OK TabletId: 72075186224037892 Generation: 2672, pipe: [1:7559602468635366931:11816]
2025-10-10T14:38:28.627092Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:38:28.627226Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:28.627238Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:28.627332Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2673 reason: error at write: Disconnected sessionId: src_id|af305c34-d903d207-5b8a053f-aa776b61_0
2025-10-10T14:38:28.627484Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2673 sessionId: src_id|af305c34-d903d207-5b8a053f-aa776b61_0 is DEAD
2025-10-10T14:38:28.627648Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af305c34-d903d207-5b8a053f-aa776b61_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:28.627662Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af305c34-d903d207-5b8a053f-aa776b61_0] Write session will restart in 0.005439s
2025-10-10T14:38:28.626257Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:28.626928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:38:28.626987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602468635366931:11816], now have 1 active actors on pipe
2025-10-10T14:38:28.627690Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af305c34-d903d207-5b8a053f-aa776b61_0] Write session: Do CDS request
2025-10-10T14:38:28.627697Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af305c34-d903d207-5b8a053f-aa776b61_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:28.627816Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:28.627889Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 71 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602468635366931:11816]
2025-10-10T14:38:28.635012Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|af305c34-d903d207-5b8a053f-aa776b61_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:28.635063Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:28.635086Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2674
2025-10-10T14:38:28.635877Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2674 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:28.635915Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2674 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:28.635921Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2674 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:28.635935Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:28.636665Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2674 sessionId:  describe result for acl check
2025-10-10T14:38:28.636699Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:28.636701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:28.636703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:28.636710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602468635366963:12250] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:28.637301Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602468635366963:12250] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:28.642333Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602468635366963:12250] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:28.649043Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602468635366963:12250] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:28.649082Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602468635366963:12250] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:28.649086Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602468635366963:12250] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:28.649096Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2674 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:28.659018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:28.661799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:28.662033Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:28.662038Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:28.662050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:28.662101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:28.662140Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602467853129335:12162]
2025-10-10T14:38:28.662763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:28.663079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:28.663120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:28.663427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:28.663472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:28.663473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:28.663474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:28.663475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:28.663476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:28.663477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:28.663478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:28.663479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:28.663480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:28.663481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:28.663482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:28.663483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:28.663484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:28.663490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:28.663502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:28.663506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:28.663509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:28.663513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:28.663518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:28.663521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:28.663525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:28.663528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:28.663532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:28.663536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:28.663539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:28.663543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:28.663550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:28.663558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:28.663565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:28.663570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:28.663574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:28.663579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:28.663596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:28.663601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:28.663606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:28.663610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:28.663614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:28.663619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:28.663623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:28.663627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:28.663631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:28.663636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:28.663640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:28.663644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:28.663648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:28.663653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:28.663657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:28.663662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:28.663667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:28.663672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:28.663680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:28.663684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:28.663720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:28.666401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:28.666840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:28.666851Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:28.666854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:28.666858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:28.666865Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2673 [2:7559602467853129335:12162]
2025-10-10T14:38:28.666877Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:28.666895Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:28.666903Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:28.666907Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:28.666910Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:28.666926Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:28.666936Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:28.666943Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:28.667006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:28.667013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:28.667015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:28.667018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:28.667089Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:28.667097Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:28.667108Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:28.667118Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:28.667139Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:28.667160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602468635367088:12250], now have 1 active actors on pipe
2025-10-10T14:38:28.667168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602468635366934:2438], now have 1 active actors on pipe
2025-10-10T14:38:28.667175Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602467853129330:12162]
2025-10-10T14:38:28.667177Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602467853129330:12162]
2025-10-10T14:38:28.667179Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602467853129330:12162]
2025-10-10T14:38:28.667192Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:28.667207Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:28.667209Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:28.667224Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:28.667228Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:28.667228Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:28.667231Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:28.667251Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602467853129330:12162]
2025-10-10T14:38:28.667258Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:28.667230Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2673
2025-10-10T14:38:28.667234Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2673
2025-10-10T14:38:28.667283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:28.667284Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:28.667293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:28.667332Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b30e502f-65d61d5c-6fbf36f-ed60701_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:28.667344Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:28.667348Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:28.667351Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:28.667363Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:28.667378Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:28.667404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:28.667547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:28.667552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:28.667565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:28.667663Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2674 partition: 0 MaxSeqNo: 40 sessionId: src_id|b30e502f-65d61d5c-6fbf36f-ed60701_0
2025-10-10T14:38:28.668081Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af305c34-d903d207-5b8a053f-aa776b61_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|b30e502f-65d61d5c-6fbf36f-ed60701_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:28.670868Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b30e502f-65d61d5c-6fbf36f-ed60701_0] Write session: try to update token
2025-10-10T14:38:28.670887Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b30e502f-65d61d5c-6fbf36f-ed60701_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:28.687190Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:28.687214Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:28.687218Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:28.687220Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:28.687231Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602467853129330:12162]
2025-10-10T14:38:28.687236Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602467853129330:12162]
2025-10-10T14:38:28.687240Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602467853129330:12162]
2025-10-10T14:38:28.687292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:28.687295Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:28.687303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:28.687306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:28.687320Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:28.687325Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:28.687451Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:28.690570Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2674 sessionId: src_id|b30e502f-65d61d5c-6fbf36f-ed60701_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:28.693278Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:28.728029Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602468635367227:11816]
2025-10-10T14:38:28.728340Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 pipe creation result: OK TabletId: 72075186224037892 Generation: 2673, pipe: [1:7559602468635367227:11816]
2025-10-10T14:38:28.801405Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:28.801932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:28.801949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:28.801996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602468635367227:11816], now have 1 active actors on pipe
2025-10-10T14:38:28.802301Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 72 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602468635367227:11816]
2025-10-10T14:38:28.802336Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:28.802339Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:28.802410Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2674 reason: error at write: Disconnected sessionId: src_id|b30e502f-65d61d5c-6fbf36f-ed60701_0
2025-10-10T14:38:28.802454Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:28.802610Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2674 sessionId: src_id|b30e502f-65d61d5c-6fbf36f-ed60701_0 is DEAD
2025-10-10T14:38:28.802258Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:28.802781Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b30e502f-65d61d5c-6fbf36f-ed60701_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:28.802790Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b30e502f-65d61d5c-6fbf36f-ed60701_0] Write session will restart in 0.006324s
2025-10-10T14:38:28.802816Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b30e502f-65d61d5c-6fbf36f-ed60701_0] Write session: Do CDS request
2025-10-10T14:38:28.802826Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b30e502f-65d61d5c-6fbf36f-ed60701_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:28.810893Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b30e502f-65d61d5c-6fbf36f-ed60701_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:28.810980Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:28.810999Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2675
2025-10-10T14:38:28.811130Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2675 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:28.811174Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2675 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:28.811185Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2675 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:28.811189Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:28.811624Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2675 sessionId:  describe result for acl check
2025-10-10T14:38:28.811660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:28.811665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:28.811667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:28.811674Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602468635367269:12255] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:28.812269Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602468635367269:12255] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:28.815659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602468635367269:12255] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:28.818906Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602468635367269:12255] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:28.818922Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602468635367269:12255] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:28.818926Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602468635367269:12255] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:28.818936Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2675 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:28.825922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:28.828813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:28.829053Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:28.829058Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:28.829071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:28.829134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:28.829174Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602467853129599:12164]
2025-10-10T14:38:28.829832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:28.830467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:28.830534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:28.830877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:28.830950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:28.830952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:28.830953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:28.830954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:28.830956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:28.830957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:28.830958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:28.830960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:28.830961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:28.830962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:28.830963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:28.830964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:28.830966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:28.830972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:28.830986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:28.830990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:28.830994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:28.830998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:28.831002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:28.831006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:28.831010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:28.831014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:28.831027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:28.831031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:28.831035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:28.831039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:28.831047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:28.831056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:28.831063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:28.831068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:28.831073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:28.831079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:28.831084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:28.831089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:28.831095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:28.831101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:28.831105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:28.831110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:28.831115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:28.831120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:28.831124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:28.831129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:28.831134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:28.831140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:28.831146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:28.831152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:28.831157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:28.831162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:28.831167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:28.831172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:28.831177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:28.831182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:28.831232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:28.833592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:28.833947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:28.833960Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:28.833964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:28.833967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:28.833974Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2674 [2:7559602467853129599:12164]
2025-10-10T14:38:28.833986Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:28.834002Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:28.834010Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:28.834013Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:28.834061Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:28.834084Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:28.834097Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:28.834109Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:28.834181Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:28.834188Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:28.834190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:28.834193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:28.834263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:28.834271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:28.834283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:28.834301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:28.834324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:28.834353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602468635367230:2438], now have 1 active actors on pipe
2025-10-10T14:38:28.834356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602468635367415:12255], now have 1 active actors on pipe
2025-10-10T14:38:28.834364Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602467853129594:12164]
2025-10-10T14:38:28.834368Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602467853129594:12164]
2025-10-10T14:38:28.834370Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602467853129594:12164]
2025-10-10T14:38:28.834385Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:28.834404Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:28.834425Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:28.834434Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:28.834448Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:28.834451Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:28.834430Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2674
2025-10-10T14:38:28.834453Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:28.834458Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602467853129594:12164]
2025-10-10T14:38:28.834461Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:28.834479Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:28.834459Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2674
2025-10-10T14:38:28.834495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:28.834504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:28.834545Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c74a517a-5b10eeee-19cd3f03-86af4fb1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:28.834558Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:28.834563Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:28.834565Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:28.834577Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:28.834587Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:28.834607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:28.834786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:28.834793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:28.834807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:28.834895Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2675 partition: 0 MaxSeqNo: 40 sessionId: src_id|c74a517a-5b10eeee-19cd3f03-86af4fb1_0
2025-10-10T14:38:28.835318Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b30e502f-65d61d5c-6fbf36f-ed60701_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|c74a517a-5b10eeee-19cd3f03-86af4fb1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:28.838252Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c74a517a-5b10eeee-19cd3f03-86af4fb1_0] Write session: try to update token
2025-10-10T14:38:28.838276Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c74a517a-5b10eeee-19cd3f03-86af4fb1_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:28.853831Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:28.853852Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:28.853856Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:28.853858Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:28.853868Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602467853129594:12164]
2025-10-10T14:38:28.853874Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602467853129594:12164]
2025-10-10T14:38:28.853878Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602467853129594:12164]
2025-10-10T14:38:28.853933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:28.853947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:28.853952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:28.854123Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:28.857473Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:28.857496Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:28.857501Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:28.858424Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2675 sessionId: src_id|c74a517a-5b10eeee-19cd3f03-86af4fb1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:28.861186Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:28.902593Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602468635367531:11816]
2025-10-10T14:38:28.902976Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 pipe creation result: OK TabletId: 72075186224037892 Generation: 2674, pipe: [1:7559602468635367531:11816]
2025-10-10T14:38:28.966608Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:28.967214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:28.967228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:28.967289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602468635367531:11816], now have 1 active actors on pipe
2025-10-10T14:38:28.967699Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:28.968258Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c74a517a-5b10eeee-19cd3f03-86af4fb1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:28.968271Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c74a517a-5b10eeee-19cd3f03-86af4fb1_0] Write session will restart in 0.005872s
2025-10-10T14:38:28.968297Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c74a517a-5b10eeee-19cd3f03-86af4fb1_0] Write session: Do CDS request
2025-10-10T14:38:28.968303Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c74a517a-5b10eeee-19cd3f03-86af4fb1_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:28.967608Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:28.967626Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:28.967625Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 73 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602468635367531:11816]
2025-10-10T14:38:28.967646Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:28.967688Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2675 reason: error at write: Disconnected sessionId: src_id|c74a517a-5b10eeee-19cd3f03-86af4fb1_0
2025-10-10T14:38:28.967892Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2675 sessionId: src_id|c74a517a-5b10eeee-19cd3f03-86af4fb1_0 is DEAD
2025-10-10T14:38:28.975841Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c74a517a-5b10eeee-19cd3f03-86af4fb1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:28.975962Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:28.975982Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2676
2025-10-10T14:38:28.976115Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2676 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:28.976158Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2676 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:28.976169Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2676 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:28.976174Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:28.976807Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2676 sessionId:  describe result for acl check
2025-10-10T14:38:28.976846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:28.976852Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:28.976853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:28.976860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602468635367568:12259] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:28.977417Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602468635367568:12259] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:28.980050Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602468635367568:12259] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:28.984540Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602468635367568:12259] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:28.984558Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602468635367568:12259] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:28.984562Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602468635367568:12259] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:28.984570Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2676 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:28.989057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:28.991518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:28.991831Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:28.991845Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:28.991857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:28.991916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:28.991961Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602467853129864:12166]
2025-10-10T14:38:28.992650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:28.993037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:28.993094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:28.993459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:28.993536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:28.993541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:28.993543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:28.993544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:28.993545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:28.993546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:28.993547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:28.993549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:28.993550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:28.993552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:28.993553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:28.993554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:28.993556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:28.993561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:28.993575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:28.993579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:28.993583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:28.993587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:28.993590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:28.993594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:28.993598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:28.993602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:28.993606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:28.993610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:28.993614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:28.993618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:28.993625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:28.993633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:28.993640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:28.993646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:28.993650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:28.993655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:28.993660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:28.993665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:28.993669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:28.993675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:28.993679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:28.993684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:28.993689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:28.993694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:28.993698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:28.993709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:28.993714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:28.993719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:28.993725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:28.993729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:28.993734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:28.993739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:28.993743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:28.993748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:28.993753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:28.993757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:28.993802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:28.996168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:28.996744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:28.996756Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:28.996759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:28.996763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:28.996769Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2675 [2:7559602467853129864:12166]
2025-10-10T14:38:28.996782Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:28.996799Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:28.996803Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:28.996806Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:28.996809Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:28.996827Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:28.996840Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:28.996848Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:28.996912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:28.996919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:28.996921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:28.996924Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:28.996992Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:28.997002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:28.997013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:28.997024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:28.997042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:28.997068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602468635367535:2438], now have 1 active actors on pipe
2025-10-10T14:38:28.997076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602468635367741:12259], now have 1 active actors on pipe
2025-10-10T14:38:28.997084Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602467853129859:12166]
2025-10-10T14:38:28.997091Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602467853129859:12166]
2025-10-10T14:38:28.997093Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602467853129859:12166]
2025-10-10T14:38:28.997108Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:28.997126Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:28.997130Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:28.997139Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:28.997141Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:28.997145Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:28.997148Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:28.997174Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602467853129859:12166]
2025-10-10T14:38:28.997186Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:28.997192Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:28.997128Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2675
2025-10-10T14:38:28.997176Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2675
2025-10-10T14:38:28.997225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:28.997236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:28.997270Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3d238444-b7f73370-65d8b20d-1a59ae8e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:28.997284Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:28.997289Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:28.997291Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:28.997304Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:28.997315Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:28.997349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:28.997543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:28.997556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:28.997578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:28.997678Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2676 partition: 0 MaxSeqNo: 40 sessionId: src_id|3d238444-b7f73370-65d8b20d-1a59ae8e_0
2025-10-10T14:38:28.998109Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c74a517a-5b10eeee-19cd3f03-86af4fb1_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|3d238444-b7f73370-65d8b20d-1a59ae8e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:29.001041Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3d238444-b7f73370-65d8b20d-1a59ae8e_0] Write session: try to update token
2025-10-10T14:38:29.001061Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3d238444-b7f73370-65d8b20d-1a59ae8e_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:29.015689Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2676 sessionId: src_id|3d238444-b7f73370-65d8b20d-1a59ae8e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:29.016284Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:29.016306Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:29.016309Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:29.016312Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:29.016321Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602467853129859:12166]
2025-10-10T14:38:29.016325Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602467853129859:12166]
2025-10-10T14:38:29.016331Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602467853129859:12166]
2025-10-10T14:38:29.016385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:29.016400Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:29.016402Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:29.016410Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:29.016418Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:29.016422Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:29.016545Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:29.018490Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:29.068005Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602472930335123:11816]
2025-10-10T14:38:29.068536Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 pipe creation result: OK TabletId: 72075186224037892 Generation: 2675, pipe: [1:7559602472930335123:11816]
2025-10-10T14:38:29.129853Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:29.130607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:29.130631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:29.130686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602472930335123:11816], now have 1 active actors on pipe
2025-10-10T14:38:29.130974Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:29.130951Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:29.130981Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:29.130986Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:29.131019Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 74 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602472930335123:11816]
2025-10-10T14:38:29.131062Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2676 reason: error at write: Disconnected sessionId: src_id|3d238444-b7f73370-65d8b20d-1a59ae8e_0
2025-10-10T14:38:29.131254Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2676 sessionId: src_id|3d238444-b7f73370-65d8b20d-1a59ae8e_0 is DEAD
2025-10-10T14:38:29.131427Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d238444-b7f73370-65d8b20d-1a59ae8e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:29.131435Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d238444-b7f73370-65d8b20d-1a59ae8e_0] Write session will restart in 0.006914s
2025-10-10T14:38:29.131461Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d238444-b7f73370-65d8b20d-1a59ae8e_0] Write session: Do CDS request
2025-10-10T14:38:29.131467Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d238444-b7f73370-65d8b20d-1a59ae8e_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:29.139956Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3d238444-b7f73370-65d8b20d-1a59ae8e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:29.139998Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:29.140013Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2677
2025-10-10T14:38:29.140219Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2677 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:29.140290Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2677 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:29.140304Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2677 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:29.140308Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:29.140941Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2677 sessionId:  describe result for acl check
2025-10-10T14:38:29.140988Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:29.140990Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:29.140992Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:29.140998Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602472930335178:12263] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:29.141617Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602472930335178:12263] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:29.144636Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602472930335178:12263] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:29.149315Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602472930335178:12263] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:29.149349Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602472930335178:12263] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:29.149353Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602472930335178:12263] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:29.149364Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2677 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:29.154678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:29.157377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:29.157624Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:29.157639Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:29.157653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:29.157724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:29.157927Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602472148097428:12168]
2025-10-10T14:38:29.158625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:29.158974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:29.159051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:29.159428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:29.159500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:29.159508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:29.159509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:29.159510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:29.159511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:29.159513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:29.159514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:29.159516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:29.159517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:29.159519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:29.159520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:29.159522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:29.159523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:29.159530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:29.159544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:29.159549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:29.159554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:29.159559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:29.159563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:29.159567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:29.159572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:29.159577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:29.159582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:29.159587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:29.159591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:29.159595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:29.159605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:29.159615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:29.159622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:29.159628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:29.159640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:29.159646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:29.159656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:29.159662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:29.159684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:29.159695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:29.159700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:29.159710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:29.159716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:29.159726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:29.159731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:29.159741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:29.159749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:29.159759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:29.159765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:29.159775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:29.159782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:29.159792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:29.159797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:29.159803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:29.159808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:29.159814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:29.159857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:29.166337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:29.167091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:29.167109Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:29.167111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:29.167116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:29.167123Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2676 [2:7559602472148097428:12168]
2025-10-10T14:38:29.167138Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:29.167175Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:29.167178Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:29.167182Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:29.167185Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:29.167204Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:29.167218Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:29.167227Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:29.167301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:29.167309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:29.167311Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:29.167314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:29.167388Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:29.167395Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:29.167409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:29.167426Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:29.167449Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:29.167477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602472930335327:12263], now have 1 active actors on pipe
2025-10-10T14:38:29.167485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602472930335125:2438], now have 1 active actors on pipe
2025-10-10T14:38:29.167494Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602472148097423:12168]
2025-10-10T14:38:29.167503Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602472148097423:12168]
2025-10-10T14:38:29.167505Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602472148097423:12168]
2025-10-10T14:38:29.167518Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:29.167534Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:29.167540Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:29.167543Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:29.167545Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:29.167558Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:29.167562Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:29.167601Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602472148097423:12168]
2025-10-10T14:38:29.167612Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:29.167618Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:29.167596Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2676
2025-10-10T14:38:29.167674Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2676
2025-10-10T14:38:29.167789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:29.167800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:29.167832Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|41363b1b-477e2ead-37047572-2497f6ee_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:29.167847Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:29.167852Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:29.167854Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:29.167866Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:29.167877Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:29.167896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:29.168093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:29.168113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:29.168140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:29.168234Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2677 partition: 0 MaxSeqNo: 40 sessionId: src_id|41363b1b-477e2ead-37047572-2497f6ee_0
2025-10-10T14:38:29.168673Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d238444-b7f73370-65d8b20d-1a59ae8e_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|41363b1b-477e2ead-37047572-2497f6ee_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:29.171767Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|41363b1b-477e2ead-37047572-2497f6ee_0] Write session: try to update token
2025-10-10T14:38:29.171788Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|41363b1b-477e2ead-37047572-2497f6ee_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:29.188077Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:29.188099Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:29.188103Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:29.188104Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:29.188115Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602472148097423:12168]
2025-10-10T14:38:29.188119Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602472148097423:12168]
2025-10-10T14:38:29.188124Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602472148097423:12168]
2025-10-10T14:38:29.188171Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:29.188176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:29.188179Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:29.188184Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:29.188186Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:29.188189Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:29.188336Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:29.190963Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2677 sessionId: src_id|41363b1b-477e2ead-37047572-2497f6ee_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:29.193825Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:29.231303Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602472930335421:11816]
2025-10-10T14:38:29.231574Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 pipe creation result: OK TabletId: 72075186224037892 Generation: 2676, pipe: [1:7559602472930335421:11816]
2025-10-10T14:38:29.306452Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:29.306885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:29.306904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:29.306953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602472930335421:11816], now have 1 active actors on pipe
2025-10-10T14:38:29.307212Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:29.307198Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 75 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602472930335421:11816]
2025-10-10T14:38:29.307250Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:29.307253Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:29.307323Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2677 reason: error at write: Disconnected sessionId: src_id|41363b1b-477e2ead-37047572-2497f6ee_0
2025-10-10T14:38:29.307581Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2677 sessionId: src_id|41363b1b-477e2ead-37047572-2497f6ee_0 is DEAD
2025-10-10T14:38:29.307770Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:29.313441Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|41363b1b-477e2ead-37047572-2497f6ee_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:29.313459Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|41363b1b-477e2ead-37047572-2497f6ee_0] Write session will restart in 0.007096s
2025-10-10T14:38:29.313487Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|41363b1b-477e2ead-37047572-2497f6ee_0] Write session: Do CDS request
2025-10-10T14:38:29.313497Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|41363b1b-477e2ead-37047572-2497f6ee_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:29.321919Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|41363b1b-477e2ead-37047572-2497f6ee_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:29.322037Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:29.322056Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2678
2025-10-10T14:38:29.322260Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2678 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:29.322297Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2678 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:29.322303Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2678 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:29.322306Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:29.322810Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2678 sessionId:  describe result for acl check
2025-10-10T14:38:29.322842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:29.322854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:29.322856Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:29.322863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602472930335439:12267] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:29.323509Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602472930335439:12267] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:29.327087Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602472930335439:12267] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:29.330064Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602472930335439:12267] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:29.330081Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602472930335439:12267] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:29.330085Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602472930335439:12267] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:29.330094Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2678 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:29.339239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:29.341888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:29.342293Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:29.342303Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:29.342316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:29.342383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:29.342438Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602472148097696:12171]
2025-10-10T14:38:29.343031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:29.343566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:29.343614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:29.343938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:29.344001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:29.344006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:29.344008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:29.344009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:29.344010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:29.344012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:29.344013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:29.344014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:29.344015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:29.344016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:29.344017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:29.344018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:29.344019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:29.344025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:29.344038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:29.344042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:29.344046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:29.344049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:29.344054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:29.344057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:29.344061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:29.344065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:29.344068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:29.344072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:29.344075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:29.344079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:29.344090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:29.344099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:29.344105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:29.344111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:29.344116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:29.344121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:29.344125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:29.344130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:29.344135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:29.344140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:29.344143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:29.344148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:29.344153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:29.344157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:29.344161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:29.344166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:29.344170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:29.344175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:29.344179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:29.344184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:29.344189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:29.344194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:29.344198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:29.344203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:29.344207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:29.344211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:29.344256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:29.346945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:29.347561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:29.347576Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:29.347579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:29.347583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:29.347590Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2677 [2:7559602472148097696:12171]
2025-10-10T14:38:29.347604Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:29.347622Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:29.347625Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:29.347630Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:29.347632Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:29.347651Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:29.347665Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:29.347675Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:29.347756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:29.347764Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:29.347767Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:29.347770Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:29.347842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:29.347850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:29.347862Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:29.347876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:29.347893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:29.347921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602472930335555:12267], now have 1 active actors on pipe
2025-10-10T14:38:29.347929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602472930335422:2438], now have 1 active actors on pipe
2025-10-10T14:38:29.347938Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602472148097691:12171]
2025-10-10T14:38:29.347944Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602472148097691:12171]
2025-10-10T14:38:29.347947Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602472148097691:12171]
2025-10-10T14:38:29.347961Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:29.347973Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:29.347976Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:29.347977Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:29.347979Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:29.347994Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:29.348003Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:29.348032Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602472148097691:12171]
2025-10-10T14:38:29.348040Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2677
2025-10-10T14:38:29.348051Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2677
2025-10-10T14:38:29.348048Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:29.348055Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:29.348094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:29.348105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:29.348142Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1d4354a4-1d25e59f-7b73e029-2e21ab67_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:29.348155Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:29.348163Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:29.348166Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:29.348178Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:29.348192Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:29.348209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:29.348371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:29.348383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:29.348407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:29.348524Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2678 partition: 0 MaxSeqNo: 40 sessionId: src_id|1d4354a4-1d25e59f-7b73e029-2e21ab67_0
2025-10-10T14:38:29.348956Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|41363b1b-477e2ead-37047572-2497f6ee_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|1d4354a4-1d25e59f-7b73e029-2e21ab67_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:29.351776Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1d4354a4-1d25e59f-7b73e029-2e21ab67_0] Write session: try to update token
2025-10-10T14:38:29.351797Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1d4354a4-1d25e59f-7b73e029-2e21ab67_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:29.368046Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:29.368069Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:29.368073Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:29.368075Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:29.368086Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602472148097691:12171]
2025-10-10T14:38:29.368091Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602472148097691:12171]
2025-10-10T14:38:29.368096Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602472148097691:12171]
2025-10-10T14:38:29.368151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:29.368162Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:29.368165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:29.368168Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:29.368170Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:29.368175Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:29.368325Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:29.374480Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2678 sessionId: src_id|1d4354a4-1d25e59f-7b73e029-2e21ab67_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:29.377112Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:29.406421Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602472930335720:11816]
2025-10-10T14:38:29.406827Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 pipe creation result: OK TabletId: 72075186224037892 Generation: 2677, pipe: [1:7559602472930335720:11816]
2025-10-10T14:38:29.486472Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:29.487047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:29.487062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:29.487082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602472930335720:11816], now have 1 active actors on pipe
2025-10-10T14:38:29.487293Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:29.487707Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:38:29.487793Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2678 reason: status is not ok: tablet will be restarted right now sessionId: src_id|1d4354a4-1d25e59f-7b73e029-2e21ab67_0
2025-10-10T14:38:29.488003Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2678 sessionId: src_id|1d4354a4-1d25e59f-7b73e029-2e21ab67_0 is DEAD
2025-10-10T14:38:29.488208Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d4354a4-1d25e59f-7b73e029-2e21ab67_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:38:29.488184Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 76 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602472930335720:11816]
2025-10-10T14:38:29.488216Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d4354a4-1d25e59f-7b73e029-2e21ab67_0] Write session will restart in 0.006016s
2025-10-10T14:38:29.488212Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:29.488251Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d4354a4-1d25e59f-7b73e029-2e21ab67_0] Write session: Do CDS request
2025-10-10T14:38:29.488258Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d4354a4-1d25e59f-7b73e029-2e21ab67_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:29.495950Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1d4354a4-1d25e59f-7b73e029-2e21ab67_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:29.496014Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:29.496040Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2679
2025-10-10T14:38:29.496495Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2679 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:29.496539Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2679 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:29.496549Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2679 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:29.496553Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:29.497099Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2679 sessionId:  describe result for acl check
2025-10-10T14:38:29.497136Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:29.497144Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:29.497145Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:29.497151Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602472930335775:12281] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:29.497711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602472930335775:12281] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:29.499821Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602472930335775:12281] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:29.502565Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602472930335775:12281] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:29.502580Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602472930335775:12281] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:29.502583Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602472930335775:12281] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:29.502591Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2679 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:29.512611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:29.515685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:29.516083Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:29.516098Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:29.516113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:29.516183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:29.516232Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602472148098014:12180]
2025-10-10T14:38:29.516871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:29.517246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:29.517291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:29.517656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:29.517730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:29.517742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:29.517743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:29.517744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:29.517746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:29.517747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:29.517748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:29.517749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:29.517750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:29.517751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:29.517752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:29.517754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:29.517755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:29.517760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:29.517774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:29.517778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:29.517782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:29.517786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:29.517790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:29.517793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:29.517797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:29.517800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:29.517803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:29.517809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:29.517812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:29.517815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:29.517823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:29.517831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:29.517839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:29.517844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:29.517848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:29.517853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:29.517858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:29.517863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:29.517870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:29.517876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:29.517880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:29.517885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:29.517890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:29.517894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:29.517898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:29.517904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:29.517909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:29.517915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:29.517921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:29.517927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:29.517931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:29.517936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:29.517941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:29.517946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:29.517950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:29.517955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:29.517989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:29.520690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:29.521024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:29.521038Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:29.521040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:29.521044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:29.521051Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2678 [2:7559602472148098014:12180]
2025-10-10T14:38:29.521065Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:29.521085Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:29.521093Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:29.521096Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:29.521099Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:29.521117Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:29.521129Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:29.521138Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:29.521204Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:29.521210Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:29.521212Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:29.521215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:29.521289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:29.521297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:29.521305Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:29.521311Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:29.521325Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:29.521367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602472930335746:2438], now have 1 active actors on pipe
2025-10-10T14:38:29.521376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602472930335859:12281], now have 1 active actors on pipe
2025-10-10T14:38:29.521383Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602472148098009:12180]
2025-10-10T14:38:29.521385Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602472148098009:12180]
2025-10-10T14:38:29.521388Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602472148098009:12180]
2025-10-10T14:38:29.521404Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:29.521423Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:29.521443Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:29.521444Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:29.521446Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:29.521448Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:29.521450Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:29.521473Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602472148098009:12180]
2025-10-10T14:38:29.521476Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:29.521478Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:29.521497Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2678
2025-10-10T14:38:29.521549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:29.521561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:29.521593Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d373aabe-1241d0c9-2ea6f223-3d21f231_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:29.521606Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:29.521610Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:29.521616Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:29.521627Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:29.521639Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:29.521622Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2678
2025-10-10T14:38:29.521663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:29.521828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:29.521836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:29.521852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:29.521940Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2679 partition: 0 MaxSeqNo: 40 sessionId: src_id|d373aabe-1241d0c9-2ea6f223-3d21f231_0
2025-10-10T14:38:29.522386Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d4354a4-1d25e59f-7b73e029-2e21ab67_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|d373aabe-1241d0c9-2ea6f223-3d21f231_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:29.525234Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d373aabe-1241d0c9-2ea6f223-3d21f231_0] Write session: try to update token
2025-10-10T14:38:29.525257Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d373aabe-1241d0c9-2ea6f223-3d21f231_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:29.540273Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:38:29.540300Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:29.540313Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602472148098009:12180]
2025-10-10T14:38:29.540379Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:38:29.540393Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:38:29.540596Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:38:29.540754Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:29.540903Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:29.541052Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:29.541293Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:38:29.541469Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:38:29.544193Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2679 sessionId: src_id|d373aabe-1241d0c9-2ea6f223-3d21f231_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:29.546981Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:29.547755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:29.547781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:29.547826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:38:29.547937Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:38:29.554180Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:29.554198Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:29.554202Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:29.554204Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:29.554216Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602472148098009:12180]
2025-10-10T14:38:29.554221Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602472148098009:12180]
2025-10-10T14:38:29.554224Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602472148098009:12180]
2025-10-10T14:38:29.554273Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:29.554274Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:29.554281Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:29.554286Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:29.554288Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:29.554289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:29.554433Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:29.592322Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602472930336055:11816]
2025-10-10T14:38:29.601475Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 pipe creation result: OK TabletId: 72075186224037892 Generation: 2678, pipe: [1:7559602472930336055:11816]
2025-10-10T14:38:29.674590Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:29.683848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:29.683881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:29.684077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:29.684137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:29.684201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:29.684272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:29.684317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:29.684324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:29.684401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:29.684460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:29.684524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:29.684592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:29.684634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:29.684638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:29.684714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:29.684772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:29.684833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:29.684911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:29.684954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:29.684957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:29.685027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:29.685095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:29.685158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:29.685225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:29.685266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:29.685269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:29.685528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:29.685606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:29.685674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:29.685744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:29.685792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:29.685804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:29.685876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:29.685938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:29.685999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:29.686074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:29.686125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:29.686128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:29.686203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:29.686265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:29.686329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:29.686392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:29.686433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:29.686436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:29.686510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:29.686569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:29.686632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:29.686694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:29.686752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:29.686763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:29.686837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:29.686903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:29.686969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:29.687036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:29.687081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:29.687096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:29.687164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:29.687236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:29.687302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:29.687367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:29.687417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:29.687425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:29.687503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602472930336055:11816], now have 1 active actors on pipe
2025-10-10T14:38:29.688260Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d373aabe-1241d0c9-2ea6f223-3d21f231_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:29.688274Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d373aabe-1241d0c9-2ea6f223-3d21f231_0] Write session will restart in 0.008661s
2025-10-10T14:38:29.688303Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d373aabe-1241d0c9-2ea6f223-3d21f231_0] Write session: Do CDS request
2025-10-10T14:38:29.688309Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d373aabe-1241d0c9-2ea6f223-3d21f231_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:29.688902Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:29.687856Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:29.687876Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:29.687911Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2679 reason: error at write: Disconnected sessionId: src_id|d373aabe-1241d0c9-2ea6f223-3d21f231_0
2025-10-10T14:38:29.688143Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2679 sessionId: src_id|d373aabe-1241d0c9-2ea6f223-3d21f231_0 is DEAD
2025-10-10T14:38:29.688214Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:29.688269Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 77 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602472930336055:11816]
2025-10-10T14:38:29.702029Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d373aabe-1241d0c9-2ea6f223-3d21f231_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:29.702077Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:29.702098Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2680
2025-10-10T14:38:29.705895Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2680 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:29.705975Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2680 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:29.705987Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2680 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:29.705992Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:29.706455Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2680 sessionId:  describe result for acl check
2025-10-10T14:38:29.706498Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:29.706505Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:29.706506Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:29.706513Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602472930336188:12285] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:29.707535Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602472930336188:12285] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:29.711357Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602472930336188:12285] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:29.714664Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602472930336188:12285] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:29.714683Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602472930336188:12285] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:29.714687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602472930336188:12285] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:29.714697Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2680 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:29.717200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:29.719503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:29.719773Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:29.719780Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:29.719792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:29.719853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:29.719896Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602472148098283:12189]
2025-10-10T14:38:29.720594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:29.721016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:29.721069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:29.721358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:29.721435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:29.721446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:29.721448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:29.721450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:29.721451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:29.721453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:29.721454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:29.721456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:29.721457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:29.721458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:29.721459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:29.721461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:29.721462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:29.721470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:29.721483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:29.721485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:29.721488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:29.721490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:29.721493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:29.721495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:29.721497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:29.721499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:29.721503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:29.721507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:29.721511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:29.721515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:29.721524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:29.721542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:29.721551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:29.721556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:29.721562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:29.721567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:29.721572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:29.721577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:29.721582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:29.721588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:29.721592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:29.721598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:29.721603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:29.721608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:29.721611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:29.721614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:29.721619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:29.721626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:29.721629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:29.721635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:29.721639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:29.721644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:29.721648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:29.721653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:29.721658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:29.721662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:29.721701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:29.724542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:29.724877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:29.724882Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:29.724885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:29.724889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:29.724897Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2679 [2:7559602472148098283:12189]
2025-10-10T14:38:29.724912Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:29.724932Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:29.724935Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:29.724939Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:29.724942Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:29.724962Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:29.724970Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:29.724979Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:29.725046Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:29.725048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:29.725050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:29.725053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:29.725137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:29.725140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:29.725168Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:29.725182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:29.725201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:29.725225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602472930336057:2438], now have 1 active actors on pipe
2025-10-10T14:38:29.725229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602472930336340:12285], now have 1 active actors on pipe
2025-10-10T14:38:29.725238Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602472148098278:12189]
2025-10-10T14:38:29.725241Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602472148098278:12189]
2025-10-10T14:38:29.725244Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602472148098278:12189]
2025-10-10T14:38:29.725259Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:29.725275Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:29.725275Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:29.725279Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:29.725282Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:29.725293Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:29.725297Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:29.725355Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602472148098278:12189]
2025-10-10T14:38:29.725365Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:29.725371Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:29.725477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:29.725483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:29.725517Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|327893d7-86d260e8-5eeb905f-4ea5ac98_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:29.725525Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:29.725529Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:29.725532Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:29.725545Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:29.725558Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:29.725574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:29.725855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:29.725872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:29.725893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:29.726511Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d373aabe-1241d0c9-2ea6f223-3d21f231_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|327893d7-86d260e8-5eeb905f-4ea5ac98_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:29.725303Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2679
2025-10-10T14:38:29.725383Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2679
2025-10-10T14:38:29.726035Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2680 partition: 0 MaxSeqNo: 40 sessionId: src_id|327893d7-86d260e8-5eeb905f-4ea5ac98_0
2025-10-10T14:38:29.729822Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|327893d7-86d260e8-5eeb905f-4ea5ac98_0] Write session: try to update token
2025-10-10T14:38:29.729843Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|327893d7-86d260e8-5eeb905f-4ea5ac98_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:29.746529Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:29.746555Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:29.746559Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:29.746562Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:29.746573Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602472148098278:12189]
2025-10-10T14:38:29.746582Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602472148098278:12189]
2025-10-10T14:38:29.746586Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602472148098278:12189]
2025-10-10T14:38:29.746649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:29.746657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:29.746660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:29.746680Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:29.746689Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:29.746694Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:29.746848Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:29.755091Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2680 sessionId: src_id|327893d7-86d260e8-5eeb905f-4ea5ac98_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:29.757812Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:29.788390Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602472930336358:11816]
2025-10-10T14:38:29.788663Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 pipe creation result: OK TabletId: 72075186224037892 Generation: 2679, pipe: [1:7559602472930336358:11816]
2025-10-10T14:38:29.867944Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:29.868534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:29.868555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:29.868580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602472930336358:11816], now have 1 active actors on pipe
2025-10-10T14:38:29.868774Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:29.868858Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:29.868869Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:29.868873Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:29.868928Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 78 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602472930336358:11816]
2025-10-10T14:38:29.868953Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2680 reason: error at write: Disconnected sessionId: src_id|327893d7-86d260e8-5eeb905f-4ea5ac98_0
2025-10-10T14:38:29.869168Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2680 sessionId: src_id|327893d7-86d260e8-5eeb905f-4ea5ac98_0 is DEAD
2025-10-10T14:38:29.869294Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|327893d7-86d260e8-5eeb905f-4ea5ac98_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:29.869306Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|327893d7-86d260e8-5eeb905f-4ea5ac98_0] Write session will restart in 0.009391s
2025-10-10T14:38:29.869345Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|327893d7-86d260e8-5eeb905f-4ea5ac98_0] Write session: Do CDS request
2025-10-10T14:38:29.869354Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|327893d7-86d260e8-5eeb905f-4ea5ac98_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:29.879898Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|327893d7-86d260e8-5eeb905f-4ea5ac98_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:29.880280Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:29.880299Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2681
2025-10-10T14:38:29.880455Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2681 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:29.880497Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2681 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:29.880507Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2681 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:29.880515Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:29.880964Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2681 sessionId:  describe result for acl check
2025-10-10T14:38:29.881000Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:29.881012Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:29.881016Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:29.881023Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602472930336451:3295] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:29.881643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602472930336451:3295] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:29.887585Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602472930336451:3295] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:29.891132Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602472930336451:3295] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:29.891151Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602472930336451:3295] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:29.891155Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602472930336451:3295] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:29.891165Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2681 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:29.891488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:29.894425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:29.894656Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:29.894666Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:29.894675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:29.894737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:29.894788Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602472148098553:12191]
2025-10-10T14:38:29.895429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:29.895775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:29.895812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:29.896089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:29.896149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:29.896156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:29.896157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:29.896158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:29.896159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:29.896161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:29.896162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:29.896163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:29.896165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:29.896166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:29.896168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:29.896169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:29.896171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:29.896177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:29.896187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:29.896190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:29.896192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:29.896195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:29.896197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:29.896199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:29.896201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:29.896204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:29.896206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:29.896210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:29.896214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:29.896218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:29.896236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:29.896246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:29.896252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:29.896258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:29.896262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:29.896269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:29.896273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:29.896278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:29.896284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:29.896289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:29.896293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:29.896298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:29.896303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:29.896314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:29.896318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:29.896322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:29.896325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:29.896328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:29.896333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:29.896343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:29.896347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:29.896354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:29.896363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:29.896368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:29.896375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:29.896380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:29.896421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:29.899032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:29.899413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:29.899427Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:29.899430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:29.899434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:29.899441Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2680 [2:7559602472148098553:12191]
2025-10-10T14:38:29.899465Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:29.899485Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:29.899493Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:29.899497Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:29.899500Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:29.899519Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:29.899532Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:29.899552Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:29.899619Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:29.899626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:29.899628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:29.899631Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:29.899703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:29.899721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:29.899737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:29.899753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:29.899776Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:29.899804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602472930336367:2438], now have 1 active actors on pipe
2025-10-10T14:38:29.899813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602472930336655:3295], now have 1 active actors on pipe
2025-10-10T14:38:29.899821Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602472148098547:12191]
2025-10-10T14:38:29.899823Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602472148098547:12191]
2025-10-10T14:38:29.899826Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602472148098547:12191]
2025-10-10T14:38:29.899841Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:29.899857Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:29.899861Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:29.899864Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:29.899866Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:29.899850Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2680
2025-10-10T14:38:29.899866Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2680
2025-10-10T14:38:29.899883Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:29.899891Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:29.899933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:29.899943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:29.899963Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602472148098547:12191]
2025-10-10T14:38:29.899976Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:29.899983Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:29.900007Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|33fbb45f-cf67fe0b-48877f0-249d569b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:29.900021Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:29.900026Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:29.900029Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:29.900042Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:29.900055Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:29.900078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:29.900279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:29.900290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:29.900307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:29.900422Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2681 partition: 0 MaxSeqNo: 40 sessionId: src_id|33fbb45f-cf67fe0b-48877f0-249d569b_0
2025-10-10T14:38:29.900878Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|327893d7-86d260e8-5eeb905f-4ea5ac98_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|33fbb45f-cf67fe0b-48877f0-249d569b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:29.903907Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|33fbb45f-cf67fe0b-48877f0-249d569b_0] Write session: try to update token
2025-10-10T14:38:29.903931Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|33fbb45f-cf67fe0b-48877f0-249d569b_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:29.920266Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:29.920291Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:29.920295Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:29.920297Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:29.920309Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602472148098547:12191]
2025-10-10T14:38:29.920314Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602472148098547:12191]
2025-10-10T14:38:29.920318Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602472148098547:12191]
2025-10-10T14:38:29.920371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:29.920372Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:29.920379Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:29.920382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:29.920384Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:29.920388Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:29.920543Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:29.933410Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2681 sessionId: src_id|33fbb45f-cf67fe0b-48877f0-249d569b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:29.936359Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:29.969140Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602472930336668:11816]
2025-10-10T14:38:29.969485Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 pipe creation result: OK TabletId: 72075186224037892 Generation: 2680, pipe: [1:7559602472930336668:11816]
2025-10-10T14:38:30.040468Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:30.041355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:30.041374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:30.041403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602472930336668:11816], now have 1 active actors on pipe
2025-10-10T14:38:30.041647Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:30.042133Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:38:30.042186Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:30.042219Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2681 reason: status is not ok: tablet will be restarted right now sessionId: src_id|33fbb45f-cf67fe0b-48877f0-249d569b_0
2025-10-10T14:38:30.042234Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 79 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602472930336668:11816]
2025-10-10T14:38:30.042433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2681 sessionId: src_id|33fbb45f-cf67fe0b-48877f0-249d569b_0 is DEAD
2025-10-10T14:38:30.042794Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33fbb45f-cf67fe0b-48877f0-249d569b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:38:30.042804Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33fbb45f-cf67fe0b-48877f0-249d569b_0] Write session will restart in 0.009052s
2025-10-10T14:38:30.042842Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33fbb45f-cf67fe0b-48877f0-249d569b_0] Write session: Do CDS request
2025-10-10T14:38:30.042848Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33fbb45f-cf67fe0b-48877f0-249d569b_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:30.053958Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|33fbb45f-cf67fe0b-48877f0-249d569b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:30.054098Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:30.054116Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2682
2025-10-10T14:38:30.054330Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2682 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:30.054366Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2682 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:30.054374Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2682 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:30.054378Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:30.054762Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2682 sessionId:  describe result for acl check
2025-10-10T14:38:30.054794Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:30.054799Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:30.054801Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:30.054806Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602477225304001:3321] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:30.055267Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602477225304001:3321] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:30.059550Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602477225304001:3321] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:30.067516Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602477225304001:3321] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:30.067535Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602477225304001:3321] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:30.067539Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602477225304001:3321] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:30.067558Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2682 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:30.085155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:30.088839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:30.089120Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:30.089136Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:30.089152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:30.089232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:30.089302Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602476443066120:12193]
2025-10-10T14:38:30.090016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:30.090496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:30.090572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:30.090922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:30.091001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:30.091003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:30.091004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:30.091006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:30.091007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:30.091009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:30.091010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:30.091011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:30.091012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:30.091014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:30.091015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:30.091016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:30.091018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:30.091025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:30.091039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:30.091043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:30.091048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:30.091052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:30.091056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:30.091060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:30.091064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:30.091068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:30.091073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:30.091077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:30.091081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:30.091086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:30.091095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:30.091106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:30.091113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:30.091119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:30.091124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:30.091129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:30.091134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:30.091140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:30.091147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:30.091152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:30.091157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:30.091163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:30.091167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:30.091173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:30.091178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:30.091183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:30.091188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:30.091194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:30.091199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:30.091204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:30.091209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:30.091215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:30.091219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:30.091225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:30.091230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:30.091236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:30.091283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:30.094290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:30.094822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:30.094840Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:30.094843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:30.094847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:30.094854Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2681 [2:7559602476443066120:12193]
2025-10-10T14:38:30.094869Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:30.094889Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:30.094898Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:30.094902Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:30.094904Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:30.094921Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:30.094935Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:30.094948Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:30.095023Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:30.095031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:30.095034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:30.095037Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:30.095107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:30.095115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:30.095128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:30.095144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:30.095168Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:30.095193Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602476443066115:12193]
2025-10-10T14:38:30.095201Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602476443066115:12193]
2025-10-10T14:38:30.095204Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602476443066115:12193]
2025-10-10T14:38:30.095219Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:30.095242Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:30.095265Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:30.095264Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:30.095269Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:30.095271Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:30.095272Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:30.095303Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602476443066115:12193]
2025-10-10T14:38:30.095307Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:30.095373Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:30.095457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602477225304117:3321], now have 1 active actors on pipe
2025-10-10T14:38:30.095480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602477225303965:2438], now have 1 active actors on pipe
2025-10-10T14:38:30.096010Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2681
2025-10-10T14:38:30.096047Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2681
2025-10-10T14:38:30.096117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:30.096132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:30.096181Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b508c8a9-e5058da7-a9d98396-280ddd9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:30.096195Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:30.096204Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:30.096207Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:30.096221Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:30.096239Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:30.096269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:30.096442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:30.096452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:30.096468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:30.096607Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2682 partition: 0 MaxSeqNo: 40 sessionId: src_id|b508c8a9-e5058da7-a9d98396-280ddd9_0
2025-10-10T14:38:30.097052Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33fbb45f-cf67fe0b-48877f0-249d569b_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|b508c8a9-e5058da7-a9d98396-280ddd9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:30.100050Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b508c8a9-e5058da7-a9d98396-280ddd9_0] Write session: try to update token
2025-10-10T14:38:30.100072Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b508c8a9-e5058da7-a9d98396-280ddd9_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:30.116036Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:30.116063Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:30.116068Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:30.116070Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:30.116081Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602476443066115:12193]
2025-10-10T14:38:30.116087Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602476443066115:12193]
2025-10-10T14:38:30.116092Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602476443066115:12193]
2025-10-10T14:38:30.116149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:30.116158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:30.116167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:30.116312Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:30.117820Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:30.117837Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:30.117842Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:30.118872Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2682 sessionId: src_id|b508c8a9-e5058da7-a9d98396-280ddd9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:30.121725Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:30.133014Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:155: [72075186224037893][rt3.dc1--test-topic] TPersQueueReadBalancer::HandleWakeup
2025-10-10T14:38:30.133040Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 15
2025-10-10T14:38:30.142134Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602477225304270:11816]
2025-10-10T14:38:30.142508Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 pipe creation result: OK TabletId: 72075186224037892 Generation: 2681, pipe: [1:7559602477225304270:11816]
2025-10-10T14:38:30.242335Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:30.243065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:30.243097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:30.243188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602477225304270:11816], now have 1 active actors on pipe
2025-10-10T14:38:30.243970Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b508c8a9-e5058da7-a9d98396-280ddd9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:30.243982Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b508c8a9-e5058da7-a9d98396-280ddd9_0] Write session will restart in 0.007755s
2025-10-10T14:38:30.244007Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b508c8a9-e5058da7-a9d98396-280ddd9_0] Write session: Do CDS request
2025-10-10T14:38:30.244013Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b508c8a9-e5058da7-a9d98396-280ddd9_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:30.243455Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:30.243487Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:30.243512Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:30.243579Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2682 reason: error at write: Disconnected sessionId: src_id|b508c8a9-e5058da7-a9d98396-280ddd9_0
2025-10-10T14:38:30.243819Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2682 sessionId: src_id|b508c8a9-e5058da7-a9d98396-280ddd9_0 is DEAD
2025-10-10T14:38:30.243917Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:30.243931Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 15
2025-10-10T14:38:30.243964Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 80 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602477225304270:11816]
2025-10-10T14:38:30.252956Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b508c8a9-e5058da7-a9d98396-280ddd9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:30.253125Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:30.253146Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2683
2025-10-10T14:38:30.253309Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2683 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:30.253357Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2683 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:30.253363Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2683 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:30.253368Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:30.254028Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2683 sessionId:  describe result for acl check
2025-10-10T14:38:30.254083Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:30.254092Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:30.254094Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:30.254101Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602477225304305:3327] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:30.254706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602477225304305:3327] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:30.257215Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602477225304305:3327] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:30.261602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602477225304305:3327] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:30.261626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602477225304305:3327] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:30.261629Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602477225304305:3327] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:30.261640Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2683 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:30.270728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:30.273266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:30.273504Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:30.273518Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:30.273532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:30.273591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:30.273640Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602476443066395:12197]
2025-10-10T14:38:30.274295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:30.274676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:30.274728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:30.275126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:30.275209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:30.275215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:30.275216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:30.275217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:30.275219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:30.275220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:30.275222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:30.275223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:30.275224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:30.275226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:30.275227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:30.275229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:30.275230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:30.275237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:30.275252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:30.275257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:30.275261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:30.275266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:30.275270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:30.275274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:30.275279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:30.275282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:30.275288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:30.275292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:30.275300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:30.275304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:30.275317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:30.275329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:30.275340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:30.275346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:30.275351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:30.275357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:30.275362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:30.275372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:30.275378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:30.275388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:30.275392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:30.275397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:30.275402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:30.275408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:30.275417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:30.275423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:30.275435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:30.275446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:30.275453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:30.275460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:30.275469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:30.275475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:30.275484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:30.275490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:30.275499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:30.275505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:30.275552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:30.278309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:30.279168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:30.279184Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:30.279187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:30.279191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:30.279197Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2682 [2:7559602476443066395:12197]
2025-10-10T14:38:30.279211Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:30.279232Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:30.279236Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:30.279239Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:30.279242Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:30.279263Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:30.279277Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:30.279286Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:30.279355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:30.279362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:30.279364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:30.279366Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:30.279445Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:30.279453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:30.279465Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:30.279480Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:30.279501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:30.279523Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602476443066390:12197]
2025-10-10T14:38:30.279533Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602476443066390:12197]
2025-10-10T14:38:30.279535Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602476443066390:12197]
2025-10-10T14:38:30.279544Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:30.279563Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:30.279581Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:30.279584Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:30.279596Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:30.279599Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:30.279601Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:30.279614Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602476443066390:12197]
2025-10-10T14:38:30.279622Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:30.279630Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:30.279643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602477225304272:2438], now have 1 active actors on pipe
2025-10-10T14:38:30.279653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602477225304413:3327], now have 1 active actors on pipe
2025-10-10T14:38:30.279805Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2682
2025-10-10T14:38:30.279876Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2682
2025-10-10T14:38:30.280064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:30.280079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:30.280156Z node 2 :PERSQUEUE DEBUG: partition.cpp:1000: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 80296142 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-10-10T14:38:30.280200Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|719a1ee7-59521961-13a2ebda-64215d96_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:30.280213Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:30.280217Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:30.280225Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:30.280238Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:30.280255Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:30.280271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:30.280548Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 9 Generation: 1 StatsReportRound: 19 DataSize: 80296142 UsedReserveSize: 0
2025-10-10T14:38:30.280589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:30.280599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:30.280618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:30.280590Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-10-10T14:38:30.280746Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2683 partition: 0 MaxSeqNo: 40 sessionId: src_id|719a1ee7-59521961-13a2ebda-64215d96_0
2025-10-10T14:38:30.281178Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b508c8a9-e5058da7-a9d98396-280ddd9_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|719a1ee7-59521961-13a2ebda-64215d96_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:30.284181Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|719a1ee7-59521961-13a2ebda-64215d96_0] Write session: try to update token
2025-10-10T14:38:30.284205Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|719a1ee7-59521961-13a2ebda-64215d96_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:30.301047Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2683 sessionId: src_id|719a1ee7-59521961-13a2ebda-64215d96_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:30.303982Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:30.304262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:30.304290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:30.304347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:38:30.304519Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:38:30.306288Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:30.306307Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:30.306311Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:30.306313Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:30.306323Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602476443066390:12197]
2025-10-10T14:38:30.306328Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602476443066390:12197]
2025-10-10T14:38:30.306333Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602476443066390:12197]
2025-10-10T14:38:30.306379Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:30.306385Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:30.306385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:30.306389Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:30.306394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:30.306397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:30.306547Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:30.343906Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602477225304577:11816]
2025-10-10T14:38:30.344231Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 pipe creation result: OK TabletId: 72075186224037892 Generation: 2682, pipe: [1:7559602477225304577:11816]
2025-10-10T14:38:30.427873Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:30.438423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:30.438456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:30.438648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:30.438711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:30.438773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:30.438835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:30.438879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:30.438885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:30.438967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:30.439026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:30.439088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:30.439156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:30.439197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:30.439201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:30.439275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:30.439338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:30.439403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:30.439467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:30.439511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:30.439514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:30.439585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:30.439645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:30.439706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:30.439768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:30.439811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:30.439815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:30.439888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:30.439947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:30.440008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:30.440074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:30.440118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:30.440122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:30.440192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:30.440251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:30.440314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:30.440372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:30.440415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:30.440418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:30.440486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:30.440549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:30.440614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:30.440676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:30.441293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:30.441298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:30.441860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:30.441929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:30.442008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:30.442088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:30.442129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:30.442133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:30.442204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:30.442287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:30.442347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:30.442409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:30.442452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:30.442455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:30.442531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:30.442734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:30.442817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:30.442881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:30.442923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:30.442926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:30.443005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602477225304577:11816], now have 1 active actors on pipe
2025-10-10T14:38:30.443451Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:30.443512Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 81 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602477225304577:11816]
2025-10-10T14:38:30.443742Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:30.443745Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:30.443775Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2683 reason: error at write: Disconnected sessionId: src_id|719a1ee7-59521961-13a2ebda-64215d96_0
2025-10-10T14:38:30.444423Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|719a1ee7-59521961-13a2ebda-64215d96_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:30.444436Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|719a1ee7-59521961-13a2ebda-64215d96_0] Write session will restart in 0.006674s
2025-10-10T14:38:30.444460Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|719a1ee7-59521961-13a2ebda-64215d96_0] Write session: Do CDS request
2025-10-10T14:38:30.444466Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|719a1ee7-59521961-13a2ebda-64215d96_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:30.443991Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2683 sessionId: src_id|719a1ee7-59521961-13a2ebda-64215d96_0 is DEAD
2025-10-10T14:38:30.444141Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:30.451905Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|719a1ee7-59521961-13a2ebda-64215d96_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:30.452254Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:30.452284Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2684
2025-10-10T14:38:30.452396Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2684 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:30.452431Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2684 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:30.452442Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2684 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:30.452448Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:30.452848Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2684 sessionId:  describe result for acl check
2025-10-10T14:38:30.452885Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:30.452893Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:30.452894Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:30.452900Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602477225304594:3337] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:30.453487Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602477225304594:3337] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:30.456772Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602477225304594:3337] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:30.460041Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602477225304594:3337] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:30.460058Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602477225304594:3337] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:30.460062Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602477225304594:3337] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:30.460086Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2684 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:30.498401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:30.501745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:30.502041Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:30.502055Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:30.502069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:30.502153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:30.502206Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602476443066686:12201]
2025-10-10T14:38:30.502825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:30.503333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:30.503383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:30.503757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:30.503821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:30.503828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:30.503830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:30.503831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:30.503833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:30.503834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:30.503836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:30.503837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:30.503839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:30.503840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:30.503842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:30.503843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:30.503845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:30.503852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:30.503865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:30.503869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:30.503873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:30.503877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:30.503882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:30.503887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:30.503891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:30.503896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:30.503901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:30.503906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:30.503910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:30.503914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:30.503922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:30.503932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:30.503939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:30.503946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:30.503951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:30.503957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:30.503972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:30.503979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:30.503985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:30.503990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:30.504001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:30.504006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:30.504012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:30.504020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:30.504025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:30.504030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:30.504038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:30.504049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:30.504053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:30.504068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:30.504072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:30.504078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:30.504083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:30.504089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:30.504094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:30.504100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:30.504143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:30.508271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:30.508646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:30.508663Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:30.508666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:30.508670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:30.508677Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2683 [2:7559602476443066686:12201]
2025-10-10T14:38:30.508692Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:30.508715Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:30.508719Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:30.508722Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:30.508725Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:30.508744Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:30.508752Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:30.508761Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:30.508907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:30.508916Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:30.508918Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:30.508921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:30.508999Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:30.509007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:30.509019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:30.509032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:30.509052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:30.509078Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602476443066677:12201]
2025-10-10T14:38:30.509094Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602476443066677:12201]
2025-10-10T14:38:30.509096Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602476443066677:12201]
2025-10-10T14:38:30.509114Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:30.509130Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:30.509149Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:30.509152Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:30.509190Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602476443066677:12201]
2025-10-10T14:38:30.509192Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:30.509219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602477225304582:2438], now have 1 active actors on pipe
2025-10-10T14:38:30.509223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602477225304626:3337], now have 1 active actors on pipe
2025-10-10T14:38:30.509253Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:30.509255Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:30.509258Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:30.509274Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:30.512402Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2683
2025-10-10T14:38:30.512448Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2683
2025-10-10T14:38:30.517479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:30.517505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:30.517545Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2859acb4-e6c4c907-779fb536-d77db6dd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:30.517558Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:30.517565Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:30.517569Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:30.517584Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:30.517605Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:30.517625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:30.518118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:30.518132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:30.518152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:30.518634Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2684 partition: 0 MaxSeqNo: 40 sessionId: src_id|2859acb4-e6c4c907-779fb536-d77db6dd_0
2025-10-10T14:38:30.519132Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|719a1ee7-59521961-13a2ebda-64215d96_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|2859acb4-e6c4c907-779fb536-d77db6dd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:30.522048Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2859acb4-e6c4c907-779fb536-d77db6dd_0] Write session: try to update token
2025-10-10T14:38:30.522068Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2859acb4-e6c4c907-779fb536-d77db6dd_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:30.542017Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602477225304910:11816]
2025-10-10T14:38:30.545724Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 pipe creation result: OK TabletId: 72075186224037892 Generation: 2683, pipe: [1:7559602477225304910:11816]
2025-10-10T14:38:30.549937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602477225304910:11816], now have 1 active actors on pipe
2025-10-10T14:38:30.552005Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:30.552011Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:30.552015Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:30.552016Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:30.552026Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602476443066677:12201]
2025-10-10T14:38:30.552030Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602476443066677:12201]
2025-10-10T14:38:30.552034Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602476443066677:12201]
2025-10-10T14:38:30.552090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:30.552091Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:30.552097Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:30.552100Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:30.552101Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:30.552102Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:30.552256Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:30.558821Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2684 sessionId: src_id|2859acb4-e6c4c907-779fb536-d77db6dd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:30.561759Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:30.671854Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:30.672335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:30.672354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:30.672570Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:30.672551Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:30.672614Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:30.672618Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:30.672625Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 82 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602477225304910:11816]
2025-10-10T14:38:30.672699Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2684 reason: error at write: Disconnected sessionId: src_id|2859acb4-e6c4c907-779fb536-d77db6dd_0
2025-10-10T14:38:30.672929Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2684 sessionId: src_id|2859acb4-e6c4c907-779fb536-d77db6dd_0 is DEAD
2025-10-10T14:38:30.673421Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2859acb4-e6c4c907-779fb536-d77db6dd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:30.673434Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2859acb4-e6c4c907-779fb536-d77db6dd_0] Write session will restart in 0.008424s
2025-10-10T14:38:30.673460Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2859acb4-e6c4c907-779fb536-d77db6dd_0] Write session: Do CDS request
2025-10-10T14:38:30.673467Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2859acb4-e6c4c907-779fb536-d77db6dd_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:30.682942Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2859acb4-e6c4c907-779fb536-d77db6dd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:30.683320Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:30.683338Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2685
2025-10-10T14:38:30.683536Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2685 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:30.683598Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2685 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:30.683609Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2685 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:30.683613Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:30.684082Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2685 sessionId:  describe result for acl check
2025-10-10T14:38:30.684125Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:30.684133Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:30.684135Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:30.684142Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602477225304939:3419] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:30.684749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602477225304939:3419] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:30.687556Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602477225304939:3419] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:30.692248Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602477225304939:3419] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:30.692266Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602477225304939:3419] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:30.692271Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602477225304939:3419] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:30.692280Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2685 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:30.703669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:30.706442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:30.706698Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:30.706711Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:30.706724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:30.706783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:30.706830Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602476443066995:12216]
2025-10-10T14:38:30.707420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:30.707776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:30.707824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:30.708158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:30.708222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:30.708229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:30.708230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:30.708232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:30.708233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:30.708234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:30.708235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:30.708236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:30.708238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:30.708239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:30.708241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:30.708242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:30.708243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:30.708249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:30.708263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:30.708267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:30.708272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:30.708276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:30.708280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:30.708284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:30.708289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:30.708293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:30.708297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:30.708301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:30.708305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:30.708309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:30.708322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:30.708331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:30.708338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:30.708349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:30.708354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:30.708359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:30.708368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:30.708373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:30.708378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:30.708391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:30.708395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:30.708401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:30.708409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:30.708414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:30.708418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:30.708428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:30.708433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:30.708438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:30.708449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:30.708454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:30.708461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:30.708466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:30.708474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:30.708480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:30.708485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:30.708490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:30.708531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:30.714421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:30.714993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:30.715005Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:30.715007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:30.715011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:30.715019Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2684 [2:7559602476443066995:12216]
2025-10-10T14:38:30.715033Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:30.715054Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:30.715057Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:30.715060Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:30.715063Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:30.715083Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:30.715090Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:30.715106Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:30.715169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:30.715172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:30.715173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:30.715176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:30.715240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:30.715242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:30.715253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:30.715264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:30.715281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:30.715302Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602476443066990:12216]
2025-10-10T14:38:30.715305Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602476443066990:12216]
2025-10-10T14:38:30.715307Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602476443066990:12216]
2025-10-10T14:38:30.715315Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:30.715334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602477225304924:2438], now have 1 active actors on pipe
2025-10-10T14:38:30.715340Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:30.715342Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:30.715346Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:30.715349Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:30.715355Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:30.715359Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:30.715364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602477225305006:3419], now have 1 active actors on pipe
2025-10-10T14:38:30.715392Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602476443066990:12216]
2025-10-10T14:38:30.715400Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:30.715441Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:30.715587Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2684
2025-10-10T14:38:30.715654Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2684
2025-10-10T14:38:30.715730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:30.715747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:30.715782Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|880dc967-43c55cc2-956dc35f-81ac1dd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:30.715797Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:30.715802Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:30.715815Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:30.715828Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:30.715841Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:30.715857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:30.716042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:30.716051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:30.716086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:30.716192Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2685 partition: 0 MaxSeqNo: 40 sessionId: src_id|880dc967-43c55cc2-956dc35f-81ac1dd_0
2025-10-10T14:38:30.716604Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2859acb4-e6c4c907-779fb536-d77db6dd_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|880dc967-43c55cc2-956dc35f-81ac1dd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:30.719541Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|880dc967-43c55cc2-956dc35f-81ac1dd_0] Write session: try to update token
2025-10-10T14:38:30.719563Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|880dc967-43c55cc2-956dc35f-81ac1dd_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:30.741666Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:38:30.741689Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:30.741701Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602476443066990:12216]
2025-10-10T14:38:30.741754Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:38:30.741973Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:38:30.742140Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:30.742296Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:30.742450Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:30.742711Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:38:30.742750Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:38:30.743255Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:38:30.741126Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2685 sessionId: src_id|880dc967-43c55cc2-956dc35f-81ac1dd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:30.743954Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:30.744162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:30.744179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:30.744217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:38:30.744333Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:38:30.753891Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:30.753912Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:30.753916Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:30.753918Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:30.753930Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602476443066990:12216]
2025-10-10T14:38:30.753934Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602476443066990:12216]
2025-10-10T14:38:30.753939Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602476443066990:12216]
2025-10-10T14:38:30.754004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:30.754014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:30.754016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:30.754021Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:30.754029Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:30.754034Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:30.754158Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:30.772941Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602477225305227:11816]
2025-10-10T14:38:30.773271Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 pipe creation result: OK TabletId: 72075186224037892 Generation: 2684, pipe: [1:7559602477225305227:11816]
2025-10-10T14:38:30.874949Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:30.884447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:30.884486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:30.884690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:30.884770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:30.884846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:30.884924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:30.884977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:30.884987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:30.885063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:30.885134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:30.885215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:30.885287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:30.886598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:30.886620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:30.886696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:30.886767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:30.886838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:30.886911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:30.886960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:30.886968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:30.889562Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:30.889580Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:30.889599Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 83 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602477225305227:11816]
2025-10-10T14:38:30.889615Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2685 reason: error at write: Disconnected sessionId: src_id|880dc967-43c55cc2-956dc35f-81ac1dd_0
2025-10-10T14:38:30.889623Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:30.889899Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2685 sessionId: src_id|880dc967-43c55cc2-956dc35f-81ac1dd_0 is DEAD
2025-10-10T14:38:30.887043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:30.887118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:30.887183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:30.887255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:30.887305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:30.887309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:30.887384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:30.887446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:30.887508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:30.887577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:30.887620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:30.887623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:30.887695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:30.887757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:30.887818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:30.887877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:30.887925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:30.887928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:30.888003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:30.888066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:30.888133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:30.888199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:30.888245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:30.888248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:30.888319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:30.888379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:30.888444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:30.888512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:30.888556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:30.888559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:30.888630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:30.888689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:30.888754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:30.888820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:30.888862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:30.888864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:30.888940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:30.889000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:30.889063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:30.889131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:30.889173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:30.889176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:30.889256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602477225305227:11816], now have 1 active actors on pipe
2025-10-10T14:38:30.890753Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:30.893540Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|880dc967-43c55cc2-956dc35f-81ac1dd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:30.893553Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|880dc967-43c55cc2-956dc35f-81ac1dd_0] Write session will restart in 0.007336s
2025-10-10T14:38:30.893579Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|880dc967-43c55cc2-956dc35f-81ac1dd_0] Write session: Do CDS request
2025-10-10T14:38:30.893584Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|880dc967-43c55cc2-956dc35f-81ac1dd_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:30.901971Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|880dc967-43c55cc2-956dc35f-81ac1dd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:30.902433Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:30.902452Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2686
2025-10-10T14:38:30.902636Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2686 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:30.902677Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2686 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:30.902698Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2686 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:30.902707Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:30.903235Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2686 sessionId:  describe result for acl check
2025-10-10T14:38:30.903279Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:30.903281Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:30.903283Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:30.903291Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602477225305254:3417] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:30.903871Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602477225305254:3417] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:30.913368Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602477225305254:3417] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:30.917576Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602477225305254:3417] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:30.917595Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602477225305254:3417] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:30.917599Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602477225305254:3417] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:30.917609Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2686 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:30.923453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:30.926228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:30.926481Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:30.926493Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:30.926505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:30.926577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:30.926624Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602476443067270:12218]
2025-10-10T14:38:30.927157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:30.927509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:30.927587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:30.927964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:30.928034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:30.928041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:30.928042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:30.928044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:30.928045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:30.928046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:30.928048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:30.928049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:30.928050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:30.928051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:30.928063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:30.928065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:30.928067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:30.928074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:30.928088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:30.928092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:30.928096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:30.928100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:30.928105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:30.928109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:30.928113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:30.928117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:30.928122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:30.928126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:30.928130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:30.928135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:30.928143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:30.928152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:30.928164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:30.928170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:30.928180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:30.928186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:30.928190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:30.928196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:30.928200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:30.928206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:30.928211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:30.928220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:30.928225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:30.928230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:30.928239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:30.928244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:30.928249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:30.928260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:30.928264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:30.928273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:30.928278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:30.928284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:30.928292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:30.928298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:30.928308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:30.928313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:30.928354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:30.931124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:30.931469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:30.931483Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:30.931486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:30.931491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:30.931499Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2685 [2:7559602476443067270:12218]
2025-10-10T14:38:30.931515Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:30.931537Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:30.931549Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:30.931553Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:30.931555Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:30.931577Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:30.931585Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:30.931595Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:30.932005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:30.932018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:30.932020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:30.932023Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:30.932110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:30.932119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:30.932132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:30.932144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:30.932161Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:30.932186Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602476443067265:12218]
2025-10-10T14:38:30.932195Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602476443067265:12218]
2025-10-10T14:38:30.932197Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602476443067265:12218]
2025-10-10T14:38:30.932208Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:30.932220Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:30.932223Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:30.932225Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:30.932232Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:30.932250Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:30.932259Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:30.932273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602477225305238:2438], now have 1 active actors on pipe
2025-10-10T14:38:30.932277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602477225305447:3417], now have 1 active actors on pipe
2025-10-10T14:38:30.932315Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602476443067265:12218]
2025-10-10T14:38:30.932331Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:30.932334Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:30.932396Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2685
2025-10-10T14:38:30.932408Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2685
2025-10-10T14:38:30.932566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:30.932580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:30.932632Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8ac1c844-fd36d560-4c426c49-65cc004_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:30.932649Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:30.932658Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:30.932661Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:30.932685Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:30.932704Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:30.932726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:30.932953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:30.932970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:30.932996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:30.933091Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2686 partition: 0 MaxSeqNo: 40 sessionId: src_id|8ac1c844-fd36d560-4c426c49-65cc004_0
2025-10-10T14:38:30.933525Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|880dc967-43c55cc2-956dc35f-81ac1dd_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|8ac1c844-fd36d560-4c426c49-65cc004_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:30.936350Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8ac1c844-fd36d560-4c426c49-65cc004_0] Write session: try to update token
2025-10-10T14:38:30.936374Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8ac1c844-fd36d560-4c426c49-65cc004_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:30.947282Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:38:30.947316Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:30.947329Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602476443067265:12218]
2025-10-10T14:38:30.947376Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:38:30.947389Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:38:30.947600Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:38:30.947774Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:30.947952Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:30.948101Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:30.948308Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:38:30.948349Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:38:30.955834Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2686 sessionId: src_id|8ac1c844-fd36d560-4c426c49-65cc004_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:30.958999Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:30.959338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:30.959368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:30.959427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:38:30.959537Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:38:30.967468Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:30.967490Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:30.967494Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:30.967497Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:30.967508Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602476443067265:12218]
2025-10-10T14:38:30.967516Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602476443067265:12218]
2025-10-10T14:38:30.967520Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602476443067265:12218]
2025-10-10T14:38:30.967573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:30.967575Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:30.967581Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:30.967581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:30.967584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:30.967586Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:30.967727Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:30.990065Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602477225305543:11816]
2025-10-10T14:38:30.990564Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 pipe creation result: OK TabletId: 72075186224037892 Generation: 2685, pipe: [1:7559602477225305543:11816]
2025-10-10T14:38:31.088021Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:31.096455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:31.096491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:31.096677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:31.096754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:31.096831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:31.096904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:31.097319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:31.097351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:31.097430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:31.100424Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:31.100444Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 84 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602477225305543:11816]
2025-10-10T14:38:31.100472Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:31.100474Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:31.100500Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2686 reason: error at write: Disconnected sessionId: src_id|8ac1c844-fd36d560-4c426c49-65cc004_0
2025-10-10T14:38:31.100718Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2686 sessionId: src_id|8ac1c844-fd36d560-4c426c49-65cc004_0 is DEAD
2025-10-10T14:38:31.100859Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ac1c844-fd36d560-4c426c49-65cc004_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:31.100872Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ac1c844-fd36d560-4c426c49-65cc004_0] Write session will restart in 0.008950s
2025-10-10T14:38:31.100909Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ac1c844-fd36d560-4c426c49-65cc004_0] Write session: Do CDS request
2025-10-10T14:38:31.100915Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ac1c844-fd36d560-4c426c49-65cc004_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:31.097508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:31.097588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:31.097654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:31.097697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:31.097700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:31.097775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:31.097837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:31.097899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:31.097966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:31.098020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:31.098023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:31.098094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:31.098155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:31.098220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:31.098283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:31.098327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:31.098330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:31.098404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:31.098464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:31.098525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:31.098590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:31.098636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:31.098639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:31.098710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:31.098767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:31.098826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:31.098895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:31.098940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:31.098943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:31.099018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:31.099076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:31.099146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:31.099213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:31.099255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:31.099258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:31.099329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:31.099382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:31.099445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:31.099506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:31.099544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:31.099547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:31.099613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:31.099671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:31.099729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:31.099789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:31.099835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:31.099838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:31.099901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:31.099959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:31.100012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:31.100063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:31.100100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:31.100102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:31.100171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602477225305543:11816], now have 1 active actors on pipe
2025-10-10T14:38:31.100742Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:31.110978Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8ac1c844-fd36d560-4c426c49-65cc004_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:31.111105Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:31.111124Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2687
2025-10-10T14:38:31.111250Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2687 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:31.111287Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2687 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:31.111298Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2687 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:31.111303Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:31.111807Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2687 sessionId:  describe result for acl check
2025-10-10T14:38:31.111846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:31.111848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:31.111850Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:31.111857Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602481520272914:3446] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:31.112445Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602481520272914:3446] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:31.115703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602481520272914:3446] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:31.119677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602481520272914:3446] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:31.119694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602481520272914:3446] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:31.119698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602481520272914:3446] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:31.119708Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2687 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:31.122458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:31.124816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:31.125053Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:31.125065Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:31.125077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:31.125139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:31.125191Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602480738034843:12220]
2025-10-10T14:38:31.125848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:31.126224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:31.126277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:31.126643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:31.126708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:31.126715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:31.126717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:31.126718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:31.126719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:31.126721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:31.126722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:31.126723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:31.126725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:31.126726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:31.126727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:31.126728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:31.126729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:31.126737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:31.126750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:31.126755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:31.126759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:31.126763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:31.126766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:31.126770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:31.126774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:31.126778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:31.126782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:31.126786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:31.126789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:31.126794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:31.126801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:31.126811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:31.126817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:31.126823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:31.126828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:31.126834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:31.126838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:31.126843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:31.126848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:31.126854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:31.126858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:31.126864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:31.126869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:31.126874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:31.126879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:31.126885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:31.126890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:31.126895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:31.126900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:31.126906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:31.126910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:31.126915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:31.126926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:31.126932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:31.126936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:31.126941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:31.126981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:31.129773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:31.130131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:31.130147Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:31.130150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:31.130155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:31.130163Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2686 [2:7559602480738034843:12220]
2025-10-10T14:38:31.130178Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:31.130199Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:31.130202Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:31.130206Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:31.130209Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:31.130231Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:31.130245Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:31.130259Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:31.130326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:31.130335Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:31.130338Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:31.130341Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:31.130416Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:31.130424Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:31.130437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:31.130454Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:31.130489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:31.130517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602481520272841:2438], now have 1 active actors on pipe
2025-10-10T14:38:31.130525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602481520273114:3446], now have 1 active actors on pipe
2025-10-10T14:38:31.130533Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602480738034838:12220]
2025-10-10T14:38:31.130536Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602480738034838:12220]
2025-10-10T14:38:31.130538Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602480738034838:12220]
2025-10-10T14:38:31.130551Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:31.130567Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:31.130550Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2686
2025-10-10T14:38:31.130577Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:31.130580Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:31.130561Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2686
2025-10-10T14:38:31.130582Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:31.130593Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:31.130597Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:31.130649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:31.130660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:31.130676Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602480738034838:12220]
2025-10-10T14:38:31.130689Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:31.130702Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:31.130727Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|45c9a8a1-234b8a65-d7ab8ce5-cfc2c5cf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:31.130740Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:31.130745Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:31.130747Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:31.130759Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:31.130770Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:31.130798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:31.130984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:31.130998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:31.131023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:31.131136Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2687 partition: 0 MaxSeqNo: 40 sessionId: src_id|45c9a8a1-234b8a65-d7ab8ce5-cfc2c5cf_0
2025-10-10T14:38:31.131576Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ac1c844-fd36d560-4c426c49-65cc004_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|45c9a8a1-234b8a65-d7ab8ce5-cfc2c5cf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:31.134452Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|45c9a8a1-234b8a65-d7ab8ce5-cfc2c5cf_0] Write session: try to update token
2025-10-10T14:38:31.134474Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|45c9a8a1-234b8a65-d7ab8ce5-cfc2c5cf_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:31.148965Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2687 sessionId: src_id|45c9a8a1-234b8a65-d7ab8ce5-cfc2c5cf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:31.150499Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:31.150522Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:31.150526Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:31.150528Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:31.150538Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602480738034838:12220]
2025-10-10T14:38:31.150542Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602480738034838:12220]
2025-10-10T14:38:31.150549Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602480738034838:12220]
2025-10-10T14:38:31.150599Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:31.150599Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:31.150607Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:31.150611Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:31.150611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:31.150614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:31.150757Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:31.151849Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:31.200480Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602481520273147:11816]
2025-10-10T14:38:31.200772Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 pipe creation result: OK TabletId: 72075186224037892 Generation: 2686, pipe: [1:7559602481520273147:11816]
2025-10-10T14:38:31.266795Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:31.267652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:31.267674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:31.267724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602481520273147:11816], now have 1 active actors on pipe
2025-10-10T14:38:31.267947Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:31.267971Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 85 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602481520273147:11816]
2025-10-10T14:38:31.267997Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:31.268000Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:31.268107Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2687 reason: error at write: Disconnected sessionId: src_id|45c9a8a1-234b8a65-d7ab8ce5-cfc2c5cf_0
2025-10-10T14:38:31.268191Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:31.268318Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2687 sessionId: src_id|45c9a8a1-234b8a65-d7ab8ce5-cfc2c5cf_0 is DEAD
2025-10-10T14:38:31.268498Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45c9a8a1-234b8a65-d7ab8ce5-cfc2c5cf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:31.268506Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45c9a8a1-234b8a65-d7ab8ce5-cfc2c5cf_0] Write session will restart in 0.009571s
2025-10-10T14:38:31.268542Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45c9a8a1-234b8a65-d7ab8ce5-cfc2c5cf_0] Write session: Do CDS request
2025-10-10T14:38:31.268549Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45c9a8a1-234b8a65-d7ab8ce5-cfc2c5cf_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:31.278966Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|45c9a8a1-234b8a65-d7ab8ce5-cfc2c5cf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:31.279057Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:31.279083Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2688
2025-10-10T14:38:31.279204Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2688 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:31.279243Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2688 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:31.279254Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2688 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:31.279260Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:31.279821Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2688 sessionId:  describe result for acl check
2025-10-10T14:38:31.279876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:31.279882Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:31.279884Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:31.279891Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602481520273228:3449] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:31.280485Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602481520273228:3449] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:31.283539Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602481520273228:3449] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:31.287228Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602481520273228:3449] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:31.287248Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602481520273228:3449] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:31.287252Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602481520273228:3449] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:31.287260Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2688 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:31.290808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:31.293575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:31.293859Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:31.293875Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:31.293888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:31.293961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:31.294026Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602480738035123:12223]
2025-10-10T14:38:31.294648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:31.295051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:31.295105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:31.295469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:31.295545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:31.295552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:31.295553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:31.295555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:31.295556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:31.295557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:31.295558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:31.295559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:31.295561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:31.295563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:31.295564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:31.295565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:31.295566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:31.295573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:31.295587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:31.295591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:31.295595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:31.295600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:31.295605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:31.295608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:31.295612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:31.295616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:31.295620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:31.295624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:31.295628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:31.295632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:31.295642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:31.295652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:31.295658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:31.295666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:31.295671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:31.295678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:31.295683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:31.295688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:31.295693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:31.295699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:31.295703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:31.295715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:31.295719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:31.295724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:31.295732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:31.295737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:31.295742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:31.295746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:31.295751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:31.295756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:31.295761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:31.295766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:31.295770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:31.295775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:31.295782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:31.295794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:31.295837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:31.298384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:31.299105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:31.299123Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:31.299126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:31.299130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:31.299138Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2687 [2:7559602480738035123:12223]
2025-10-10T14:38:31.299152Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:31.299170Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:31.299178Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:31.299182Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:31.299184Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:31.299201Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:31.299213Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:31.299221Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:31.299284Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:31.299292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:31.299294Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:31.299297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:31.299367Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:31.299375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:31.299389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:31.299407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:31.299429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:31.299457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602481520273148:2438], now have 1 active actors on pipe
2025-10-10T14:38:31.299466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602481520273401:3449], now have 1 active actors on pipe
2025-10-10T14:38:31.299474Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602480738035118:12223]
2025-10-10T14:38:31.299476Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602480738035118:12223]
2025-10-10T14:38:31.299477Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602480738035118:12223]
2025-10-10T14:38:31.299489Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:31.299469Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2687
2025-10-10T14:38:31.299483Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2687
2025-10-10T14:38:31.299501Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:31.299503Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:31.299513Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:31.299515Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:31.299520Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:31.299523Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:31.299566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:31.299570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:31.299585Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602480738035118:12223]
2025-10-10T14:38:31.299599Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:31.299604Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:31.299633Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|86fc493a-bf68ec11-c6569e02-66a69d2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:31.299649Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:31.299653Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:31.299655Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:31.299668Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:31.299679Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:31.299709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:31.299880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:31.299891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:31.299908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:31.300036Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2688 partition: 0 MaxSeqNo: 40 sessionId: src_id|86fc493a-bf68ec11-c6569e02-66a69d2_0
2025-10-10T14:38:31.300486Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45c9a8a1-234b8a65-d7ab8ce5-cfc2c5cf_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|86fc493a-bf68ec11-c6569e02-66a69d2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:31.303307Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|86fc493a-bf68ec11-c6569e02-66a69d2_0] Write session: try to update token
2025-10-10T14:38:31.303326Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|86fc493a-bf68ec11-c6569e02-66a69d2_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:31.319058Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:31.319084Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:31.319087Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:31.319089Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:31.319101Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602480738035118:12223]
2025-10-10T14:38:31.319105Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602480738035118:12223]
2025-10-10T14:38:31.319110Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602480738035118:12223]
2025-10-10T14:38:31.319159Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:31.319162Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:31.319170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:31.319172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:31.319177Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:31.319182Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:31.319313Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:31.319312Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2688 sessionId: src_id|86fc493a-bf68ec11-c6569e02-66a69d2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:31.322129Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:31.368401Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602481520273459:11816]
2025-10-10T14:38:31.368726Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 pipe creation result: OK TabletId: 72075186224037892 Generation: 2687, pipe: [1:7559602481520273459:11816]
2025-10-10T14:38:31.435271Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:31.435877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:31.435897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:31.435948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602481520273459:11816], now have 1 active actors on pipe
2025-10-10T14:38:31.436174Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:31.436221Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:31.436224Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:31.436236Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:31.436316Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2688 reason: error at write: Disconnected sessionId: src_id|86fc493a-bf68ec11-c6569e02-66a69d2_0
2025-10-10T14:38:31.436406Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 86 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602481520273459:11816]
2025-10-10T14:38:31.436576Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2688 sessionId: src_id|86fc493a-bf68ec11-c6569e02-66a69d2_0 is DEAD
2025-10-10T14:38:31.436759Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|86fc493a-bf68ec11-c6569e02-66a69d2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:31.436770Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|86fc493a-bf68ec11-c6569e02-66a69d2_0] Write session will restart in 0.009692s
2025-10-10T14:38:31.436797Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|86fc493a-bf68ec11-c6569e02-66a69d2_0] Write session: Do CDS request
2025-10-10T14:38:31.436806Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|86fc493a-bf68ec11-c6569e02-66a69d2_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:31.447923Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|86fc493a-bf68ec11-c6569e02-66a69d2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:31.448059Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:31.448077Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2689
2025-10-10T14:38:31.448301Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2689 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:31.448342Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2689 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:31.448369Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2689 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:31.448378Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:31.448858Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2689 sessionId:  describe result for acl check
2025-10-10T14:38:31.448897Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:31.448904Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:31.448905Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:31.448913Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602481520273524:3487] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:31.449535Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602481520273524:3487] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:31.453059Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602481520273524:3487] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:31.456470Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602481520273524:3487] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:31.456487Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602481520273524:3487] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:31.456491Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602481520273524:3487] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:31.456509Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2689 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:31.461113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:31.463887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:31.464153Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:31.464166Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:31.464178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:31.464239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:31.464288Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602480738035413:12226]
2025-10-10T14:38:31.464961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:31.465327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:31.465389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:31.465714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:31.465802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:31.465810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:31.465811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:31.465812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:31.465813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:31.465815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:31.465816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:31.465818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:31.465819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:31.465820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:31.465821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:31.465823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:31.465824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:31.465830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:31.465842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:31.465847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:31.465851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:31.465854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:31.465858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:31.465862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:31.465865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:31.465869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:31.465873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:31.465877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:31.465880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:31.465884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:31.465893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:31.465903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:31.465911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:31.465916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:31.465922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:31.465927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:31.465931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:31.465936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:31.465942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:31.465955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:31.465960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:31.465966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:31.465984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:31.465995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:31.466000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:31.466012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:31.466022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:31.466028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:31.466037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:31.466041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:31.466048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:31.466053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:31.466057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:31.466062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:31.466067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:31.466078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:31.466119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:31.468800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:31.469621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:31.469637Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:31.469640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:31.469643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:31.469650Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2688 [2:7559602480738035413:12226]
2025-10-10T14:38:31.469666Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:31.469686Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:31.469697Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:31.469700Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:31.469703Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:31.469721Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:31.469729Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:31.469737Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:31.469802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:31.469810Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:31.469812Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:31.469814Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:31.469887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:31.469895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:31.469908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:31.469920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:31.469943Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:31.469982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602481520273460:2438], now have 1 active actors on pipe
2025-10-10T14:38:31.469992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602481520273678:3487], now have 1 active actors on pipe
2025-10-10T14:38:31.470000Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602480738035408:12226]
2025-10-10T14:38:31.470003Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602480738035408:12226]
2025-10-10T14:38:31.470005Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602480738035408:12226]
2025-10-10T14:38:31.470021Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:31.470037Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:31.470037Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:31.470040Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:31.470053Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:31.470058Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:31.470067Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:31.470100Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602480738035408:12226]
2025-10-10T14:38:31.470111Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:31.470113Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:31.470054Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2688
2025-10-10T14:38:31.470101Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2688
2025-10-10T14:38:31.470134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:31.470143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:31.470208Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8f70e0bf-94f35626-a0a134e7-3a87f6f6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:31.470222Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:31.470226Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:31.470229Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:31.470241Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:31.470253Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:31.470274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:31.470488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:31.470502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:31.470544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:31.470659Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2689 partition: 0 MaxSeqNo: 40 sessionId: src_id|8f70e0bf-94f35626-a0a134e7-3a87f6f6_0
2025-10-10T14:38:31.471135Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|86fc493a-bf68ec11-c6569e02-66a69d2_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|8f70e0bf-94f35626-a0a134e7-3a87f6f6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:31.474022Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8f70e0bf-94f35626-a0a134e7-3a87f6f6_0] Write session: try to update token
2025-10-10T14:38:31.474048Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8f70e0bf-94f35626-a0a134e7-3a87f6f6_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:31.490478Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:31.490503Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:31.490507Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:31.490509Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:31.490529Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602480738035408:12226]
2025-10-10T14:38:31.490535Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602480738035408:12226]
2025-10-10T14:38:31.490540Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602480738035408:12226]
2025-10-10T14:38:31.490602Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:31.490615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:31.490618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:31.490618Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:31.490625Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:31.490629Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:31.490767Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:31.489054Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2689 sessionId: src_id|8f70e0bf-94f35626-a0a134e7-3a87f6f6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:31.491798Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:31.536344Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602481520273781:11816]
2025-10-10T14:38:31.536671Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 pipe creation result: OK TabletId: 72075186224037892 Generation: 2688, pipe: [1:7559602481520273781:11816]
2025-10-10T14:38:31.607732Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:31.608104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:31.608123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:31.608164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602481520273781:11816], now have 1 active actors on pipe
2025-10-10T14:38:31.609099Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:31.609081Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:31.609098Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:31.609162Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2689 reason: error at write: Disconnected sessionId: src_id|8f70e0bf-94f35626-a0a134e7-3a87f6f6_0
2025-10-10T14:38:31.609408Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2689 sessionId: src_id|8f70e0bf-94f35626-a0a134e7-3a87f6f6_0 is DEAD
2025-10-10T14:38:31.609589Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 87 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602481520273781:11816]
2025-10-10T14:38:31.609604Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:31.613506Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f70e0bf-94f35626-a0a134e7-3a87f6f6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:31.613519Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f70e0bf-94f35626-a0a134e7-3a87f6f6_0] Write session will restart in 0.009308s
2025-10-10T14:38:31.613546Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f70e0bf-94f35626-a0a134e7-3a87f6f6_0] Write session: Do CDS request
2025-10-10T14:38:31.613555Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f70e0bf-94f35626-a0a134e7-3a87f6f6_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:31.623953Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8f70e0bf-94f35626-a0a134e7-3a87f6f6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:31.624006Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:31.624024Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2690
2025-10-10T14:38:31.624216Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2690 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:31.624259Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2690 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:31.624266Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2690 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:31.624274Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:31.624741Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2690 sessionId:  describe result for acl check
2025-10-10T14:38:31.624773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:31.624774Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:31.624775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:31.624780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602481520273862:3530] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:31.625376Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602481520273862:3530] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:31.628282Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602481520273862:3530] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:31.631720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602481520273862:3530] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:31.631734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602481520273862:3530] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:31.631737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602481520273862:3530] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:31.631756Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2690 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:31.636598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:31.639348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:31.639591Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:31.639603Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:31.639615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:31.639674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:31.639719Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602480738035730:12241]
2025-10-10T14:38:31.640406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:31.640723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:31.640766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:31.641090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:31.641154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:31.641160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:31.641162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:31.641163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:31.641164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:31.641166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:31.641167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:31.641168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:31.641169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:31.641170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:31.641171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:31.641173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:31.641174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:31.641180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:31.641194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:31.641198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:31.641203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:31.641207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:31.641212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:31.641216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:31.641220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:31.641224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:31.641228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:31.641233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:31.641237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:31.641242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:31.641249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:31.641258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:31.641268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:31.641274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:31.641279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:31.641284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:31.641289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:31.641295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:31.641300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:31.641306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:31.641318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:31.641324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:31.641341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:31.641347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:31.641351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:31.641357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:31.641362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:31.641367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:31.641371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:31.641377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:31.641381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:31.641386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:31.641391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:31.641396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:31.641400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:31.641406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:31.641447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:31.644013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:31.644514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:31.644526Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:31.644528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:31.644533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:31.644539Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2689 [2:7559602480738035730:12241]
2025-10-10T14:38:31.644553Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:31.644571Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:31.644579Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:31.644584Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:31.644587Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:31.644605Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:31.644617Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:31.644626Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:31.644689Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:31.644696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:31.644698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:31.644701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:31.644770Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:31.644777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:31.644788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:31.644805Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:31.644827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:31.644854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602481520273809:2438], now have 1 active actors on pipe
2025-10-10T14:38:31.644864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602481520274021:3530], now have 1 active actors on pipe
2025-10-10T14:38:31.644871Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602480738035725:12241]
2025-10-10T14:38:31.644874Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602480738035725:12241]
2025-10-10T14:38:31.644876Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602480738035725:12241]
2025-10-10T14:38:31.644891Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:31.644898Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:31.644901Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:31.644903Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:31.644906Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:31.644922Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:31.644891Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2689
2025-10-10T14:38:31.644903Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2689
2025-10-10T14:38:31.644925Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:31.644958Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602480738035725:12241]
2025-10-10T14:38:31.644968Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:31.644983Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:31.645099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:31.645110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:31.645141Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a1d6f56d-f6f747e1-fab6a276-ea35fe73_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:31.645153Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:31.645158Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:31.645161Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:31.645174Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:31.645185Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:31.645206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:31.645378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:31.645388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:31.645405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:31.645499Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2690 partition: 0 MaxSeqNo: 40 sessionId: src_id|a1d6f56d-f6f747e1-fab6a276-ea35fe73_0
2025-10-10T14:38:31.645920Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f70e0bf-94f35626-a0a134e7-3a87f6f6_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|a1d6f56d-f6f747e1-fab6a276-ea35fe73_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:31.648589Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a1d6f56d-f6f747e1-fab6a276-ea35fe73_0] Write session: try to update token
2025-10-10T14:38:31.648606Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a1d6f56d-f6f747e1-fab6a276-ea35fe73_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:31.664886Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:31.664909Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:31.664914Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:31.664916Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:31.664927Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602480738035725:12241]
2025-10-10T14:38:31.664932Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602480738035725:12241]
2025-10-10T14:38:31.664940Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602480738035725:12241]
2025-10-10T14:38:31.664992Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:31.664997Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:31.665001Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:31.665007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:31.664972Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2690 sessionId: src_id|a1d6f56d-f6f747e1-fab6a276-ea35fe73_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:31.665017Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:31.665027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:31.665202Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:31.667854Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:31.709853Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602481520274117:11816]
2025-10-10T14:38:31.710155Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 pipe creation result: OK TabletId: 72075186224037892 Generation: 2689, pipe: [1:7559602481520274117:11816]
2025-10-10T14:38:31.780928Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:31.781419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:31.781439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:31.781486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602481520274117:11816], now have 1 active actors on pipe
2025-10-10T14:38:31.781668Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:31.781784Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:31.781786Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:31.781790Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:31.781844Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 88 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602481520274117:11816]
2025-10-10T14:38:31.781853Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2690 reason: error at write: Disconnected sessionId: src_id|a1d6f56d-f6f747e1-fab6a276-ea35fe73_0
2025-10-10T14:38:31.782092Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2690 sessionId: src_id|a1d6f56d-f6f747e1-fab6a276-ea35fe73_0 is DEAD
2025-10-10T14:38:31.782262Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1d6f56d-f6f747e1-fab6a276-ea35fe73_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:31.782272Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1d6f56d-f6f747e1-fab6a276-ea35fe73_0] Write session will restart in 0.006334s
2025-10-10T14:38:31.782299Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1d6f56d-f6f747e1-fab6a276-ea35fe73_0] Write session: Do CDS request
2025-10-10T14:38:31.782317Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1d6f56d-f6f747e1-fab6a276-ea35fe73_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:31.790024Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a1d6f56d-f6f747e1-fab6a276-ea35fe73_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:31.790132Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:31.790150Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2691
2025-10-10T14:38:31.790289Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2691 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:31.790323Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2691 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:31.790329Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2691 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:31.790333Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:31.790848Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2691 sessionId:  describe result for acl check
2025-10-10T14:38:31.790891Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:31.790893Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:31.790895Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:31.790901Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602481520274136:3538] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:31.791551Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602481520274136:3538] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:31.794434Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602481520274136:3538] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:31.799051Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602481520274136:3538] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:31.799068Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602481520274136:3538] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:31.799072Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602481520274136:3538] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:31.799081Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2691 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:31.808434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:31.811564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:31.811796Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:31.811809Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:31.811821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:31.811885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:31.811932Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602480738036010:12243]
2025-10-10T14:38:31.812610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:31.813114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:31.813185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:31.813568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:31.813638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:31.813645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:31.813646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:31.813648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:31.813649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:31.813650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:31.813652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:31.813653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:31.813655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:31.813656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:31.813657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:31.813659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:31.813660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:31.813666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:31.813681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:31.813686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:31.813691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:31.813695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:31.813701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:31.813705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:31.813709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:31.813713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:31.813719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:31.813723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:31.813727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:31.813731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:31.813740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:31.813751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:31.813759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:31.813765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:31.813770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:31.813775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:31.813779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:31.813785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:31.813796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:31.813802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:31.813807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:31.813813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:31.813818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:31.813824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:31.813829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:31.813834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:31.813841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:31.813851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:31.813857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:31.813868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:31.813878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:31.813884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:31.813894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:31.813900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:31.813909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:31.813915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:31.813978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:31.816748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:31.817702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:31.817715Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:31.817717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:31.817722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:31.817729Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2690 [2:7559602480738036010:12243]
2025-10-10T14:38:31.817746Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:31.817769Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:31.817773Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:31.817776Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:31.817779Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:31.817798Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:31.817811Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:31.817825Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:31.817894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:31.817901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:31.817904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:31.817907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:31.817993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:31.818002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:31.818015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:31.818035Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:31.818063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:31.818089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602481520274283:3538], now have 1 active actors on pipe
2025-10-10T14:38:31.818098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602481520274121:2438], now have 1 active actors on pipe
2025-10-10T14:38:31.818109Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602480738036005:12243]
2025-10-10T14:38:31.818117Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602480738036005:12243]
2025-10-10T14:38:31.818119Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602480738036005:12243]
2025-10-10T14:38:31.818134Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:31.818149Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:31.818155Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:31.818159Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:31.818161Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:31.818171Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:31.818174Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:31.818154Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2690
2025-10-10T14:38:31.818162Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2690
2025-10-10T14:38:31.818206Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602480738036005:12243]
2025-10-10T14:38:31.818215Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:31.818223Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:31.818248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:31.818258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:31.818297Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|22c5fef-69c3fef6-a04609cc-f3cb8594_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:31.818311Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:31.818319Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:31.818322Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:31.818334Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:31.818349Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:31.818378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:31.818571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:31.818584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:31.818608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:31.818694Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2691 partition: 0 MaxSeqNo: 40 sessionId: src_id|22c5fef-69c3fef6-a04609cc-f3cb8594_0
2025-10-10T14:38:31.819114Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1d6f56d-f6f747e1-fab6a276-ea35fe73_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|22c5fef-69c3fef6-a04609cc-f3cb8594_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:31.821842Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|22c5fef-69c3fef6-a04609cc-f3cb8594_0] Write session: try to update token
2025-10-10T14:38:31.821860Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|22c5fef-69c3fef6-a04609cc-f3cb8594_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:31.837198Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2691 sessionId: src_id|22c5fef-69c3fef6-a04609cc-f3cb8594_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:31.838116Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:31.838141Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:31.838145Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:31.838147Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:31.838158Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602480738036005:12243]
2025-10-10T14:38:31.838164Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602480738036005:12243]
2025-10-10T14:38:31.838169Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602480738036005:12243]
2025-10-10T14:38:31.838223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:31.838227Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:31.838234Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:31.838238Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:31.838240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:31.838243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:31.840246Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:31.838421Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:31.882024Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602481520274439:11816]
2025-10-10T14:38:31.882378Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 pipe creation result: OK TabletId: 72075186224037892 Generation: 2690, pipe: [1:7559602481520274439:11816]
2025-10-10T14:38:31.960127Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:31.960625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:31.960660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:31.960719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602481520274439:11816], now have 1 active actors on pipe
2025-10-10T14:38:31.960996Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:31.961090Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:31.961093Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 89 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602481520274439:11816]
2025-10-10T14:38:31.961142Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:31.961145Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:31.961212Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2691 reason: error at write: Disconnected sessionId: src_id|22c5fef-69c3fef6-a04609cc-f3cb8594_0
2025-10-10T14:38:31.961435Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2691 sessionId: src_id|22c5fef-69c3fef6-a04609cc-f3cb8594_0 is DEAD
2025-10-10T14:38:31.965460Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|22c5fef-69c3fef6-a04609cc-f3cb8594_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:31.965473Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|22c5fef-69c3fef6-a04609cc-f3cb8594_0] Write session will restart in 0.006645s
2025-10-10T14:38:31.965499Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|22c5fef-69c3fef6-a04609cc-f3cb8594_0] Write session: Do CDS request
2025-10-10T14:38:31.965509Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|22c5fef-69c3fef6-a04609cc-f3cb8594_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:31.973982Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|22c5fef-69c3fef6-a04609cc-f3cb8594_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:31.974100Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:31.974121Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2692
2025-10-10T14:38:31.974278Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2692 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:31.974338Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2692 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:31.974351Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2692 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:31.974356Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:31.975334Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2692 sessionId:  describe result for acl check
2025-10-10T14:38:31.975383Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:31.975386Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:31.975388Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:31.975396Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602481520274478:3563] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:31.976056Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602481520274478:3563] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:31.978288Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602481520274478:3563] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:31.981981Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602481520274478:3563] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:31.982012Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602481520274478:3563] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:31.982017Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602481520274478:3563] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:31.982026Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2692 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:31.989383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:31.992371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:31.992666Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:31.992689Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:31.992702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:31.992773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:31.992825Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602480738036291:12245]
2025-10-10T14:38:31.993504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:31.993888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:31.993956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:31.994343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:31.994423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:31.994424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:31.994426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:31.994427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:31.994428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:31.994429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:31.994431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:31.994432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:31.994433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:31.994434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:31.994435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:31.994436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:31.994437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:31.994444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:31.994459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:31.994463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:31.994468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:31.994472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:31.994476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:31.994481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:31.994485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:31.994489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:31.994494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:31.994499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:31.994503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:31.994507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:31.994516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:31.994526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:31.994533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:31.994539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:31.994562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:31.994568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:31.994573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:31.994579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:31.994585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:31.994591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:31.994595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:31.994601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:31.994606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:31.994612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:31.994617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:31.994623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:31.994628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:31.994634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:31.994639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:31.994644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:31.994650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:31.994655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:31.994660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:31.994666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:31.994671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:31.994679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:31.994721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:31.997253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:31.997607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:31.997623Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:31.997626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:31.997630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:31.997639Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2691 [2:7559602480738036291:12245]
2025-10-10T14:38:31.997652Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:31.997672Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:31.997681Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:31.997685Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:31.997687Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:31.997706Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:31.997722Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:31.997737Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:31.997807Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:31.997817Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:31.997820Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:31.997822Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:31.997892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:31.997901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:31.997913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:31.997930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:31.997949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:31.997994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602481520274621:3563], now have 1 active actors on pipe
2025-10-10T14:38:31.997998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602481520274443:2438], now have 1 active actors on pipe
2025-10-10T14:38:31.998005Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602480738036286:12245]
2025-10-10T14:38:31.998014Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602480738036286:12245]
2025-10-10T14:38:31.998016Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602480738036286:12245]
2025-10-10T14:38:31.998030Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:31.998046Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:31.998050Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:31.998068Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:31.998069Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:31.998072Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:31.998072Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:31.998097Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602480738036286:12245]
2025-10-10T14:38:31.998072Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2691
2025-10-10T14:38:31.998073Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2691
2025-10-10T14:38:31.998101Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:31.998107Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:31.998138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:31.998144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:31.998186Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b8242db8-e875c864-9332ecd4-3a07764b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:31.998194Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:31.998198Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:31.998201Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:31.998212Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:31.998223Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:31.998238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:31.998370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:31.998380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:31.998396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:31.998490Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2692 partition: 0 MaxSeqNo: 40 sessionId: src_id|b8242db8-e875c864-9332ecd4-3a07764b_0
2025-10-10T14:38:31.998941Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|22c5fef-69c3fef6-a04609cc-f3cb8594_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|b8242db8-e875c864-9332ecd4-3a07764b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:32.001801Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b8242db8-e875c864-9332ecd4-3a07764b_0] Write session: try to update token
2025-10-10T14:38:32.001823Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b8242db8-e875c864-9332ecd4-3a07764b_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:32.017831Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2692 sessionId: src_id|b8242db8-e875c864-9332ecd4-3a07764b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:32.018787Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:32.018809Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:32.018813Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:32.018815Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:32.018826Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602480738036286:12245]
2025-10-10T14:38:32.018831Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602480738036286:12245]
2025-10-10T14:38:32.018836Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602480738036286:12245]
2025-10-10T14:38:32.018893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:32.018907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:32.018914Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:32.019062Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:32.020530Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:32.020648Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:32.020663Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:32.020668Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:32.061121Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602485815242047:11816]
2025-10-10T14:38:32.061469Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 pipe creation result: OK TabletId: 72075186224037892 Generation: 2691, pipe: [1:7559602485815242047:11816]
2025-10-10T14:38:32.138456Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:32.139143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:32.139160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:32.139209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602485815242047:11816], now have 1 active actors on pipe
2025-10-10T14:38:32.139483Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 90 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602485815242047:11816]
2025-10-10T14:38:32.139498Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:32.139503Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:32.139526Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:32.139566Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:32.140016Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8242db8-e875c864-9332ecd4-3a07764b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:32.140038Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8242db8-e875c864-9332ecd4-3a07764b_0] Write session will restart in 0.008591s
2025-10-10T14:38:32.140064Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8242db8-e875c864-9332ecd4-3a07764b_0] Write session: Do CDS request
2025-10-10T14:38:32.140070Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8242db8-e875c864-9332ecd4-3a07764b_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:32.139592Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2692 reason: error at write: Disconnected sessionId: src_id|b8242db8-e875c864-9332ecd4-3a07764b_0
2025-10-10T14:38:32.139804Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2692 sessionId: src_id|b8242db8-e875c864-9332ecd4-3a07764b_0 is DEAD
2025-10-10T14:38:32.150034Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b8242db8-e875c864-9332ecd4-3a07764b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:32.150079Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:32.150099Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2693
2025-10-10T14:38:32.150424Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2693 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:32.150475Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2693 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:32.150493Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2693 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:32.150507Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:32.151306Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2693 sessionId:  describe result for acl check
2025-10-10T14:38:32.151349Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:32.151359Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:32.151360Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:32.151367Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602485815242102:3596] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:32.152009Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602485815242102:3596] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:32.159272Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602485815242102:3596] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:32.164148Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602485815242102:3596] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:32.164167Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602485815242102:3596] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:32.164184Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602485815242102:3596] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:32.164195Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2693 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:32.167437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:32.170662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:32.170984Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:32.170998Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:32.171014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:32.171081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:32.171129Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602485033003871:12247]
2025-10-10T14:38:32.171779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:32.172154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:32.172238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:32.172590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:32.172678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:32.172686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:32.172687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:32.172689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:32.172690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:32.172692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:32.172694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:32.172695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:32.172696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:32.172698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:32.172699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:32.172700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:32.172701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:32.172708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:32.172723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:32.172728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:32.172733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:32.172737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:32.172741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:32.172746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:32.172750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:32.172753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:32.172758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:32.172763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:32.172767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:32.172772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:32.172781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:32.172790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:32.172796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:32.172801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:32.172806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:32.172810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:32.172815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:32.172820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:32.172826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:32.172831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:32.172836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:32.172842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:32.172847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:32.172852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:32.172860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:32.172865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:32.172870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:32.172876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:32.172881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:32.172886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:32.172890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:32.172905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:32.172915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:32.172921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:32.172926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:32.172935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:32.172979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:32.175796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:32.176303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:32.176319Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:32.176321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:32.176325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:32.176332Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2692 [2:7559602485033003871:12247]
2025-10-10T14:38:32.176348Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:32.176367Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:32.176375Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:32.176379Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:32.176381Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:32.176401Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:32.176413Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:32.176422Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:32.176497Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:32.176504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:32.176506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:32.176509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:32.176581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:32.176589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:32.176602Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:32.176620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:32.176643Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:32.176670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602485815242050:2438], now have 1 active actors on pipe
2025-10-10T14:38:32.176678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602485815242324:3596], now have 1 active actors on pipe
2025-10-10T14:38:32.176686Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602485033003866:12247]
2025-10-10T14:38:32.176688Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602485033003866:12247]
2025-10-10T14:38:32.176691Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602485033003866:12247]
2025-10-10T14:38:32.176704Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:32.176718Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:32.176718Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:32.176722Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:32.176724Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:32.176741Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:32.176748Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:32.176718Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2692
2025-10-10T14:38:32.176744Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2692
2025-10-10T14:38:32.176785Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602485033003866:12247]
2025-10-10T14:38:32.176802Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:32.176812Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:32.176822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:32.176827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:32.176882Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3f680d31-a1778f66-2b139eda-86dd9d31_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:32.176895Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:32.176898Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:32.176902Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:32.176913Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:32.176928Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:32.176956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:32.177237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:32.177248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:32.177264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:32.177371Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2693 partition: 0 MaxSeqNo: 40 sessionId: src_id|3f680d31-a1778f66-2b139eda-86dd9d31_0
2025-10-10T14:38:32.177796Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8242db8-e875c864-9332ecd4-3a07764b_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|3f680d31-a1778f66-2b139eda-86dd9d31_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:32.180788Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3f680d31-a1778f66-2b139eda-86dd9d31_0] Write session: try to update token
2025-10-10T14:38:32.180817Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3f680d31-a1778f66-2b139eda-86dd9d31_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:32.195704Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2693 sessionId: src_id|3f680d31-a1778f66-2b139eda-86dd9d31_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:32.197537Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:32.197558Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:32.197561Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:32.197563Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:32.197573Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602485033003866:12247]
2025-10-10T14:38:32.197578Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602485033003866:12247]
2025-10-10T14:38:32.197582Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602485033003866:12247]
2025-10-10T14:38:32.197631Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:32.197644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:32.197652Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:32.197797Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:32.197804Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:32.197810Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:32.197814Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:32.198420Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:32.239861Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602485815242361:11816]
2025-10-10T14:38:32.240203Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 pipe creation result: OK TabletId: 72075186224037892 Generation: 2692, pipe: [1:7559602485815242361:11816]
2025-10-10T14:38:32.315291Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:32.315877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:32.315897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:32.315947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602485815242361:11816], now have 1 active actors on pipe
2025-10-10T14:38:32.316172Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:32.316229Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 91 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602485815242361:11816]
2025-10-10T14:38:32.316266Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:32.316269Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:32.316278Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:32.316332Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2693 reason: error at write: Disconnected sessionId: src_id|3f680d31-a1778f66-2b139eda-86dd9d31_0
2025-10-10T14:38:32.316532Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2693 sessionId: src_id|3f680d31-a1778f66-2b139eda-86dd9d31_0 is DEAD
2025-10-10T14:38:32.316702Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f680d31-a1778f66-2b139eda-86dd9d31_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:32.316714Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f680d31-a1778f66-2b139eda-86dd9d31_0] Write session will restart in 0.008179s
2025-10-10T14:38:32.316740Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f680d31-a1778f66-2b139eda-86dd9d31_0] Write session: Do CDS request
2025-10-10T14:38:32.316746Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f680d31-a1778f66-2b139eda-86dd9d31_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:32.325853Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3f680d31-a1778f66-2b139eda-86dd9d31_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:32.326024Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:32.326045Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2694
2025-10-10T14:38:32.326198Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2694 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:32.326254Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2694 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:32.326267Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2694 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:32.326271Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:32.326826Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2694 sessionId:  describe result for acl check
2025-10-10T14:38:32.326868Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:32.326878Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:32.326880Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:32.326887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602485815242415:3591] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:32.327510Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602485815242415:3591] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:32.330168Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602485815242415:3591] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:32.334159Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602485815242415:3591] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:32.334178Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602485815242415:3591] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:32.334182Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602485815242415:3591] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:32.334192Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2694 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:32.339000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:32.342274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:32.342517Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:32.342527Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:32.342536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:32.342594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:32.342635Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602485033004155:12250]
2025-10-10T14:38:32.343141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:32.343489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:32.343573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:32.343968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:32.344042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:32.344049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:32.344051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:32.344052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:32.344053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:32.344055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:32.344056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:32.344057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:32.344059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:32.344060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:32.344061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:32.344063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:32.344064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:32.344071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:32.344084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:32.344088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:32.344092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:32.344097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:32.344101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:32.344104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:32.344109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:32.344113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:32.344118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:32.344122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:32.344126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:32.344130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:32.344139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:32.344148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:32.344154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:32.344160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:32.344165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:32.344170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:32.344175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:32.344181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:32.344185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:32.344191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:32.344200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:32.344205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:32.344223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:32.344233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:32.344237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:32.344243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:32.344253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:32.344258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:32.344268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:32.344275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:32.344284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:32.344290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:32.344309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:32.344318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:32.344323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:32.344333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:32.344375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:32.346985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:32.347843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:32.347857Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:32.347859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:32.347864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:32.347872Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2693 [2:7559602485033004155:12250]
2025-10-10T14:38:32.347888Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:32.347908Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:32.347912Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:32.347916Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:32.347919Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:32.347939Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:32.347952Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:32.347963Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:32.348034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:32.348042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:32.348044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:32.348046Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:32.348121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:32.348132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:32.348143Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:32.348154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:32.348171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:32.348194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602485815242363:2438], now have 1 active actors on pipe
2025-10-10T14:38:32.348204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602485815242581:3591], now have 1 active actors on pipe
2025-10-10T14:38:32.348213Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602485033004149:12250]
2025-10-10T14:38:32.348216Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602485033004149:12250]
2025-10-10T14:38:32.348217Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602485033004149:12250]
2025-10-10T14:38:32.348238Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:32.348254Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:32.348270Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:32.348268Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:32.348273Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:32.348275Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:32.348282Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:32.348261Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2693
2025-10-10T14:38:32.348272Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2693
2025-10-10T14:38:32.348323Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602485033004149:12250]
2025-10-10T14:38:32.348330Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:32.348333Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:32.348354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:32.348364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:32.348415Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|403d5328-c03ae057-e32c2dac-fb441aa5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:32.348428Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:32.348432Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:32.348440Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:32.348456Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:32.348473Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:32.348495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:32.348647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:32.348657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:32.348674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:32.348764Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2694 partition: 0 MaxSeqNo: 40 sessionId: src_id|403d5328-c03ae057-e32c2dac-fb441aa5_0
2025-10-10T14:38:32.349186Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f680d31-a1778f66-2b139eda-86dd9d31_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|403d5328-c03ae057-e32c2dac-fb441aa5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:32.352225Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|403d5328-c03ae057-e32c2dac-fb441aa5_0] Write session: try to update token
2025-10-10T14:38:32.352246Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|403d5328-c03ae057-e32c2dac-fb441aa5_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:32.366696Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2694 sessionId: src_id|403d5328-c03ae057-e32c2dac-fb441aa5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:32.368067Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:32.368091Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:32.368095Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:32.368097Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:32.368108Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602485033004149:12250]
2025-10-10T14:38:32.368112Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602485033004149:12250]
2025-10-10T14:38:32.368116Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602485033004149:12250]
2025-10-10T14:38:32.368167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:32.368175Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:32.368182Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:32.368189Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:32.368193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:32.368197Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:32.368343Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:32.369359Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:32.417416Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602485815242676:11816]
2025-10-10T14:38:32.417712Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 pipe creation result: OK TabletId: 72075186224037892 Generation: 2693, pipe: [1:7559602485815242676:11816]
2025-10-10T14:38:32.485792Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:32.486275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:32.486288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:32.486330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602485815242676:11816], now have 1 active actors on pipe
2025-10-10T14:38:32.486590Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:32.487311Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:32.487370Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:38:32.487449Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2694 reason: status is not ok: tablet will be restarted right now sessionId: src_id|403d5328-c03ae057-e32c2dac-fb441aa5_0
2025-10-10T14:38:32.487644Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2694 sessionId: src_id|403d5328-c03ae057-e32c2dac-fb441aa5_0 is DEAD
2025-10-10T14:38:32.487820Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 92 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602485815242676:11816]
2025-10-10T14:38:32.487940Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|403d5328-c03ae057-e32c2dac-fb441aa5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:38:32.487949Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|403d5328-c03ae057-e32c2dac-fb441aa5_0] Write session will restart in 0.006757s
2025-10-10T14:38:32.487969Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|403d5328-c03ae057-e32c2dac-fb441aa5_0] Write session: Do CDS request
2025-10-10T14:38:32.487974Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|403d5328-c03ae057-e32c2dac-fb441aa5_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:32.495981Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|403d5328-c03ae057-e32c2dac-fb441aa5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:32.496074Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:32.496096Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2695
2025-10-10T14:38:32.496229Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2695 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:32.496266Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2695 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:32.496277Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2695 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:32.496281Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:32.496757Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2695 sessionId:  describe result for acl check
2025-10-10T14:38:32.496792Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:32.496795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:32.496797Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:32.496804Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602485815242694:3613] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:32.497433Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602485815242694:3613] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:32.501205Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602485815242694:3613] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:32.506131Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602485815242694:3613] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:32.506152Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602485815242694:3613] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:32.506156Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602485815242694:3613] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:32.506165Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2695 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:32.513264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:32.513866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:32.514092Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:32.514107Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:32.514120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:32.514180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:32.514230Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602485033004451:12253]
2025-10-10T14:38:32.514885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:32.516682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:32.516739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:32.517115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:32.517198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:32.517207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:32.517208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:32.517209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:32.517211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:32.517212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:32.517213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:32.517214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:32.517216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:32.517217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:32.517218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:32.517220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:32.517221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:32.517228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:32.517241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:32.517244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:32.517249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:32.517252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:32.517256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:32.517260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:32.517263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:32.517267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:32.517271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:32.517275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:32.517279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:32.517282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:32.517292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:32.517301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:32.517308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:32.517313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:32.517318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:32.517324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:32.517348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:32.517354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:32.517359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:32.517364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:32.517369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:32.517374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:32.517380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:32.517393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:32.517397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:32.517407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:32.517412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:32.517425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:32.517435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:32.517440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:32.517451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:32.517456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:32.517466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:32.517471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:32.517482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:32.517488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:32.517530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:32.520002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:32.520638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:32.520656Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:32.520658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:32.520663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:32.520670Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2694 [2:7559602485033004451:12253]
2025-10-10T14:38:32.520685Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:32.520705Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:32.520716Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:32.520720Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:32.520723Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:32.520742Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:32.520755Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:32.520770Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:32.520849Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:32.520859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:32.520861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:32.520864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:32.520939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:32.520948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:32.520960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:32.520976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:32.520999Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:32.521026Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602485033004445:12253]
2025-10-10T14:38:32.521034Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602485033004445:12253]
2025-10-10T14:38:32.521036Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602485033004445:12253]
2025-10-10T14:38:32.521054Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:32.521129Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2694
2025-10-10T14:38:32.521076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602485815242880:3613], now have 1 active actors on pipe
2025-10-10T14:38:32.521137Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2694
2025-10-10T14:38:32.521085Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:32.521088Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:32.521089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602485815242678:2438], now have 1 active actors on pipe
2025-10-10T14:38:32.521092Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:32.521095Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:32.521111Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:32.521114Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:32.521138Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602485033004445:12253]
2025-10-10T14:38:32.521144Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:32.521174Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:32.521268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:32.521282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:32.521319Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e68a3f20-d8ec83b2-c5cb176a-f9970f98_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:32.521351Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:32.521359Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:32.521361Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:32.521374Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:32.521392Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:32.521413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:32.521639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:32.521653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:32.521671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:32.521777Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2695 partition: 0 MaxSeqNo: 40 sessionId: src_id|e68a3f20-d8ec83b2-c5cb176a-f9970f98_0
2025-10-10T14:38:32.522209Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|403d5328-c03ae057-e32c2dac-fb441aa5_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|e68a3f20-d8ec83b2-c5cb176a-f9970f98_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:32.525015Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e68a3f20-d8ec83b2-c5cb176a-f9970f98_0] Write session: try to update token
2025-10-10T14:38:32.525035Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e68a3f20-d8ec83b2-c5cb176a-f9970f98_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:32.541515Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:32.541537Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:32.541542Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:32.541545Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:32.541556Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602485033004445:12253]
2025-10-10T14:38:32.541564Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602485033004445:12253]
2025-10-10T14:38:32.541569Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602485033004445:12253]
2025-10-10T14:38:32.541626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:32.541648Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:32.541651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:32.541829Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:32.542889Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:32.542895Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:32.542900Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:32.543057Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2695 sessionId: src_id|e68a3f20-d8ec83b2-c5cb176a-f9970f98_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:32.545928Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:32.588083Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602485815243004:11816]
2025-10-10T14:38:32.588611Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 pipe creation result: OK TabletId: 72075186224037892 Generation: 2694, pipe: [1:7559602485815243004:11816]
2025-10-10T14:38:32.667696Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:32.668074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:32.668092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:32.668136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602485815243004:11816], now have 1 active actors on pipe
2025-10-10T14:38:32.668339Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:32.668365Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:32.668381Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:32.668434Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:32.668440Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2695 reason: error at write: Disconnected sessionId: src_id|e68a3f20-d8ec83b2-c5cb176a-f9970f98_0
2025-10-10T14:38:32.668497Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 93 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602485815243004:11816]
2025-10-10T14:38:32.668631Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2695 sessionId: src_id|e68a3f20-d8ec83b2-c5cb176a-f9970f98_0 is DEAD
2025-10-10T14:38:32.669427Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e68a3f20-d8ec83b2-c5cb176a-f9970f98_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:32.669437Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e68a3f20-d8ec83b2-c5cb176a-f9970f98_0] Write session will restart in 0.005455s
2025-10-10T14:38:32.669464Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e68a3f20-d8ec83b2-c5cb176a-f9970f98_0] Write session: Do CDS request
2025-10-10T14:38:32.669474Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e68a3f20-d8ec83b2-c5cb176a-f9970f98_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:32.675932Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e68a3f20-d8ec83b2-c5cb176a-f9970f98_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:32.676033Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:32.676053Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2696
2025-10-10T14:38:32.676211Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2696 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:32.676266Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2696 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:32.676279Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2696 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:32.676284Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:32.676763Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2696 sessionId:  describe result for acl check
2025-10-10T14:38:32.676804Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:32.676808Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:32.676811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:32.676817Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602485815243054:3699] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:32.677467Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602485815243054:3699] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:32.680193Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602485815243054:3699] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:32.685556Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602485815243054:3699] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:32.685575Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602485815243054:3699] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:32.685579Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602485815243054:3699] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:32.685588Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2696 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:32.692495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:32.695270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:32.695497Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:32.695510Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:32.695522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:32.695573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:32.695615Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602485033004773:12268]
2025-10-10T14:38:32.696260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:32.696571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:32.696612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:32.696939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:32.696996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:32.697003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:32.697004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:32.697005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:32.697006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:32.697008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:32.697009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:32.697010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:32.697011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:32.697013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:32.697014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:32.697015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:32.697016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:32.697023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:32.697037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:32.697042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:32.697046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:32.697050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:32.697054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:32.697059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:32.697063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:32.697067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:32.697071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:32.697075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:32.697078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:32.697083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:32.697092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:32.697101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:32.697108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:32.697114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:32.697119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:32.697124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:32.697134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:32.697139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:32.697145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:32.697154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:32.697159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:32.697169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:32.697174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:32.697180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:32.697184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:32.697190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:32.697197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:32.697203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:32.697212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:32.697217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:32.697226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:32.697233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:32.697241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:32.697247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:32.697252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:32.697263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:32.697302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:32.699861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:32.700564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:32.700580Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:32.700582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:32.700586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:32.700592Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2695 [2:7559602485033004773:12268]
2025-10-10T14:38:32.700605Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:32.700623Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:32.700627Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:32.700631Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:32.700633Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:32.700650Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:32.700663Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:32.700676Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:32.700741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:32.700749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:32.700751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:32.700754Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:32.700819Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:32.700827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:32.700839Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:32.700859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:32.700876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:32.700902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602485815243205:3699], now have 1 active actors on pipe
2025-10-10T14:38:32.700911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602485815243032:2438], now have 1 active actors on pipe
2025-10-10T14:38:32.700918Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602485033004768:12268]
2025-10-10T14:38:32.700922Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602485033004768:12268]
2025-10-10T14:38:32.700924Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602485033004768:12268]
2025-10-10T14:38:32.700998Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2695
2025-10-10T14:38:32.700939Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:32.700962Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:32.700967Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:32.700972Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:32.700974Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:32.700978Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:32.700982Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:32.701210Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2695
2025-10-10T14:38:32.701012Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602485033004768:12268]
2025-10-10T14:38:32.701019Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:32.701026Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:32.701061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:32.701067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:32.701097Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e1eda9d3-9ed34d49-ec2b0b76-d8eaa597_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:32.701104Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:32.701109Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:32.701111Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:32.701126Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:32.701138Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:32.701151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:32.701253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:32.701256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:32.701269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:32.701352Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2696 partition: 0 MaxSeqNo: 40 sessionId: src_id|e1eda9d3-9ed34d49-ec2b0b76-d8eaa597_0
2025-10-10T14:38:32.701751Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e68a3f20-d8ec83b2-c5cb176a-f9970f98_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|e1eda9d3-9ed34d49-ec2b0b76-d8eaa597_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:32.704485Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e1eda9d3-9ed34d49-ec2b0b76-d8eaa597_0] Write session: try to update token
2025-10-10T14:38:32.704503Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e1eda9d3-9ed34d49-ec2b0b76-d8eaa597_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:32.719254Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2696 sessionId: src_id|e1eda9d3-9ed34d49-ec2b0b76-d8eaa597_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:32.721515Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:38:32.721539Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:32.721550Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602485033004768:12268]
2025-10-10T14:38:32.721607Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:38:32.721612Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:38:32.721812Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:38:32.722014Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:32.722028Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:32.722171Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:32.722322Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:32.722538Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:38:32.722648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:32.722676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:32.722708Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:38:32.723035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:38:32.723195Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:38:32.731837Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:32.731865Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:32.731869Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:32.731872Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:32.731884Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602485033004768:12268]
2025-10-10T14:38:32.731888Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602485033004768:12268]
2025-10-10T14:38:32.731892Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602485033004768:12268]
2025-10-10T14:38:32.731947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:32.731956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:32.731958Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:32.731964Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:32.731964Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:32.731969Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:32.732145Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:32.768735Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602485815243344:11816]
2025-10-10T14:38:32.769023Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 pipe creation result: OK TabletId: 72075186224037892 Generation: 2695, pipe: [1:7559602485815243344:11816]
2025-10-10T14:38:32.852540Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:32.861899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:32.861933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:32.862160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:32.862252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:32.862351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:32.862452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:32.862508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:32.862518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:32.862599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:32.862669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:32.862742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:32.862810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:32.862855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:32.862870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:32.862943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:32.863017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:32.863091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:32.863166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:32.863245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:32.863254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:32.863329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:32.863402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:32.863478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:32.863550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:32.863600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:32.863608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:32.863683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:32.863755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:32.863828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:32.863913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:32.863964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:32.863973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:32.864072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:32.864149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:32.864217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:32.864289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:32.864346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:32.864356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:32.864437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:32.864524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:32.864621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:32.864718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:32.864774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:32.864783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:32.864857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:32.864929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:32.865000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:32.865074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:32.865128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:32.865135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:32.865213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:32.865284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:32.865376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:32.865456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:32.865520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:32.865530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:32.865598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:32.865671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:32.865743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:32.865817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:32.865867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:32.865876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:32.865960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602485815243344:11816], now have 1 active actors on pipe
2025-10-10T14:38:32.866211Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:32.866213Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 94 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602485815243344:11816]
2025-10-10T14:38:32.866227Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:32.866255Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:32.866261Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2696 reason: error at write: Disconnected sessionId: src_id|e1eda9d3-9ed34d49-ec2b0b76-d8eaa597_0
2025-10-10T14:38:32.866487Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2696 sessionId: src_id|e1eda9d3-9ed34d49-ec2b0b76-d8eaa597_0 is DEAD
2025-10-10T14:38:32.867269Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:32.869432Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1eda9d3-9ed34d49-ec2b0b76-d8eaa597_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:32.869445Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1eda9d3-9ed34d49-ec2b0b76-d8eaa597_0] Write session will restart in 0.009770s
2025-10-10T14:38:32.869471Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1eda9d3-9ed34d49-ec2b0b76-d8eaa597_0] Write session: Do CDS request
2025-10-10T14:38:32.869478Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1eda9d3-9ed34d49-ec2b0b76-d8eaa597_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:32.880901Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e1eda9d3-9ed34d49-ec2b0b76-d8eaa597_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:32.881033Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:32.881061Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2697
2025-10-10T14:38:32.881244Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2697 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:32.881294Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2697 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:32.881309Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2697 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:32.881318Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:32.881844Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2697 sessionId:  describe result for acl check
2025-10-10T14:38:32.881888Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:32.881897Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:32.881900Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:32.881908Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602485815243453:3698] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:32.882535Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602485815243453:3698] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:32.886351Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602485815243453:3698] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:32.890435Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602485815243453:3698] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:32.890455Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602485815243453:3698] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:32.890459Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602485815243453:3698] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:32.890470Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2697 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:32.892286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:32.895804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:32.896073Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:32.896085Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:32.896099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:32.896162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:32.896212Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602485033005058:12270]
2025-10-10T14:38:32.896801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:32.897169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:32.897230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:32.897527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:32.897575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:32.897579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:32.897580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:32.897581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:32.897582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:32.897582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:32.897583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:32.897584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:32.897585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:32.897585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:32.897586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:32.897587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:32.897588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:32.897592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:32.897601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:32.897604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:32.897606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:32.897609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:32.897611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:32.897614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:32.897616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:32.897619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:32.897621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:32.897624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:32.897626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:32.897628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:32.897635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:32.897641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:32.897645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:32.897649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:32.897652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:32.897655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:32.897658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:32.897661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:32.897664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:32.897668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:32.897670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:32.897674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:32.897676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:32.897680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:32.897682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:32.897685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:32.897688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:32.897691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:32.897694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:32.897697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:32.897700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:32.897705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:32.897707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:32.897711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:32.897714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:32.897717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:32.897739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:32.900465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:32.901179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:32.901195Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:32.901198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:32.901202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:32.901210Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2696 [2:7559602485033005058:12270]
2025-10-10T14:38:32.901222Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:32.901238Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:32.901244Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:32.901247Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:32.901249Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:32.901266Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:32.901275Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:32.901284Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:32.901360Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:32.901367Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:32.901369Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:32.901371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:32.901437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:32.901446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:32.901458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:32.901469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:32.901493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:32.901523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602485815243663:3698], now have 1 active actors on pipe
2025-10-10T14:38:32.901534Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602485033005053:12270]
2025-10-10T14:38:32.901537Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602485033005053:12270]
2025-10-10T14:38:32.901538Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602485033005053:12270]
2025-10-10T14:38:32.901552Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:32.901566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602485815243355:2438], now have 1 active actors on pipe
2025-10-10T14:38:32.901574Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:32.901579Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:32.901583Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:32.901585Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:32.901589Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:32.901591Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:32.901621Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602485033005053:12270]
2025-10-10T14:38:32.901628Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:32.901649Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:32.901663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:32.901668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:32.901639Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2696
2025-10-10T14:38:32.901640Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2696
2025-10-10T14:38:32.901710Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|968e0427-d4dd079c-d840e083-d664a0ac_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:32.901725Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:32.901729Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:32.901732Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:32.901750Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:32.901763Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:32.901788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:32.901937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:32.901962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:32.901987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:32.902139Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2697 partition: 0 MaxSeqNo: 40 sessionId: src_id|968e0427-d4dd079c-d840e083-d664a0ac_0
2025-10-10T14:38:32.902571Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1eda9d3-9ed34d49-ec2b0b76-d8eaa597_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|968e0427-d4dd079c-d840e083-d664a0ac_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:32.905377Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|968e0427-d4dd079c-d840e083-d664a0ac_0] Write session: try to update token
2025-10-10T14:38:32.905396Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|968e0427-d4dd079c-d840e083-d664a0ac_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:32.914253Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:38:32.914276Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:32.914286Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602485033005053:12270]
2025-10-10T14:38:32.914335Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:38:32.914341Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:38:32.914529Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:38:32.914682Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:32.914845Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:32.915010Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:32.915209Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:38:32.915255Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:38:32.922155Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2697 sessionId: src_id|968e0427-d4dd079c-d840e083-d664a0ac_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:32.925254Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:32.925517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:32.925543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:32.925583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:38:32.925654Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:38:32.932936Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:32.932958Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:32.932962Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:32.932964Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:32.932976Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602485033005053:12270]
2025-10-10T14:38:32.932982Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602485033005053:12270]
2025-10-10T14:38:32.932986Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602485033005053:12270]
2025-10-10T14:38:32.933054Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:32.933063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:32.933066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:32.933078Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:32.933086Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:32.933091Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:32.933212Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:32.969413Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602485815243677:11816]
2025-10-10T14:38:32.969763Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 pipe creation result: OK TabletId: 72075186224037892 Generation: 2696, pipe: [1:7559602485815243677:11816]
2025-10-10T14:38:33.064693Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:33.076918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:33.076964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:33.077157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:33.077248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:33.077529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:33.077600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:33.077645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:33.077669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:33.077742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:33.077987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:33.078056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:33.078323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:33.078548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:33.078563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:33.078638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:33.078708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:33.078779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:33.078846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:33.078895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:33.078905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:33.078974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:33.079061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:33.079134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:33.079202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:33.079254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:33.079264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:33.079336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:33.079405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:33.079473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:33.079541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:33.079591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:33.079600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:33.079672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:33.079740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:33.079812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:33.079885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:33.079937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:33.079940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:33.080014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:33.080084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:33.080159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:33.080228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:33.080283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:33.080286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:33.080357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:33.080417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:33.080477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:33.080546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:33.080588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:33.080591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:33.080664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:33.080726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:33.080790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:33.080855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:33.080898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:33.080901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:33.080971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:33.081029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:33.081095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:33.081162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:33.081208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:33.081212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:33.081289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602485815243677:11816], now have 1 active actors on pipe
2025-10-10T14:38:33.081751Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:33.081775Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:33.081823Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2697 reason: error at write: Disconnected sessionId: src_id|968e0427-d4dd079c-d840e083-d664a0ac_0
2025-10-10T14:38:33.081823Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 95 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602485815243677:11816]
2025-10-10T14:38:33.081915Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:33.082069Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2697 sessionId: src_id|968e0427-d4dd079c-d840e083-d664a0ac_0 is DEAD
2025-10-10T14:38:33.082280Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|968e0427-d4dd079c-d840e083-d664a0ac_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:33.082291Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|968e0427-d4dd079c-d840e083-d664a0ac_0] Write session will restart in 0.006643s
2025-10-10T14:38:33.082322Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|968e0427-d4dd079c-d840e083-d664a0ac_0] Write session: Do CDS request
2025-10-10T14:38:33.082332Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|968e0427-d4dd079c-d840e083-d664a0ac_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:33.082870Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:33.090009Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|968e0427-d4dd079c-d840e083-d664a0ac_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:33.090117Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:33.090135Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2698
2025-10-10T14:38:33.090376Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2698 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:33.090405Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2698 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:33.090412Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2698 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:33.090416Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:33.090917Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2698 sessionId:  describe result for acl check
2025-10-10T14:38:33.090957Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:33.090960Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:33.090962Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:33.090968Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602490110210995:3713] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:33.091615Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602490110210995:3713] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:33.097450Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602490110210995:3713] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:33.102149Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602490110210995:3713] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:33.102168Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602490110210995:3713] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:33.102172Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602490110210995:3713] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:33.102181Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2698 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:33.110984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:33.113982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:33.114285Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:33.114297Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:33.114311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:33.114377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:33.114433Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602489327972640:12272]
2025-10-10T14:38:33.115108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:33.115476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:33.115527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:33.115889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:33.115957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:33.115964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:33.115966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:33.115967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:33.115969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:33.115970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:33.115972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:33.115973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:33.115975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:33.115976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:33.115978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:33.115979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:33.115980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:33.115988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:33.116003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:33.116007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:33.116012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:33.116017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:33.116021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:33.116025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:33.116030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:33.116035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:33.116040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:33.116044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:33.116049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:33.116053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:33.116062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:33.116071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:33.116078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:33.116085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:33.116091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:33.116102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:33.116107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:33.116113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:33.116119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:33.116126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:33.116137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:33.116143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:33.116153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:33.116159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:33.116168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:33.116174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:33.116184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:33.116191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:33.116201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:33.116210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:33.116230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:33.116249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:33.116259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:33.116265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:33.116271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:33.116277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:33.116325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:33.118984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:33.119453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:33.119473Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:33.119476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:33.119480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:33.119487Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2697 [2:7559602489327972640:12272]
2025-10-10T14:38:33.119499Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:33.119518Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:33.119526Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:33.119529Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:33.119532Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:33.119549Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:33.119561Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:33.119570Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:33.119632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:33.119639Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:33.119641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:33.119644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:33.119718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:33.119725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:33.119737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:33.119752Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:33.119772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:33.119799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602490110211137:3713], now have 1 active actors on pipe
2025-10-10T14:38:33.119807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602490110210976:2438], now have 1 active actors on pipe
2025-10-10T14:38:33.119815Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602489327972635:12272]
2025-10-10T14:38:33.119822Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602489327972635:12272]
2025-10-10T14:38:33.119824Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602489327972635:12272]
2025-10-10T14:38:33.119840Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:33.119853Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:33.119862Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:33.119866Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:33.119868Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:33.119875Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:33.119879Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:33.119907Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602489327972635:12272]
2025-10-10T14:38:33.119900Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2697
2025-10-10T14:38:33.119919Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:33.119908Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2697
2025-10-10T14:38:33.119938Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:33.120338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:33.120352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:33.120396Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d0f6434-1c3697e3-f55ac88b-b14eeaa6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:33.120410Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:33.120421Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:33.120424Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:33.120437Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:33.120454Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:33.120474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:33.120669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:33.120677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:33.120694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:33.120785Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2698 partition: 0 MaxSeqNo: 40 sessionId: src_id|d0f6434-1c3697e3-f55ac88b-b14eeaa6_0
2025-10-10T14:38:33.121263Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|968e0427-d4dd079c-d840e083-d664a0ac_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|d0f6434-1c3697e3-f55ac88b-b14eeaa6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:33.132353Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d0f6434-1c3697e3-f55ac88b-b14eeaa6_0] Write session: try to update token
2025-10-10T14:38:33.132382Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d0f6434-1c3697e3-f55ac88b-b14eeaa6_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:33.139498Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:33.139522Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:33.139526Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:33.139527Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:33.139538Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602489327972635:12272]
2025-10-10T14:38:33.139546Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602489327972635:12272]
2025-10-10T14:38:33.139549Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602489327972635:12272]
2025-10-10T14:38:33.139603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:33.139610Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:33.139615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:33.139617Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:33.139618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:33.139621Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:33.139779Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:33.151855Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2698 sessionId: src_id|d0f6434-1c3697e3-f55ac88b-b14eeaa6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:33.154680Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:33.181912Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602490110211293:11816]
2025-10-10T14:38:33.182460Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 pipe creation result: OK TabletId: 72075186224037892 Generation: 2697, pipe: [1:7559602490110211293:11816]
2025-10-10T14:38:33.263390Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:33.263958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:33.263980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:33.264006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602490110211293:11816], now have 1 active actors on pipe
2025-10-10T14:38:33.264280Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:33.264297Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:33.264325Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:33.264361Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2698 reason: error at write: Disconnected sessionId: src_id|d0f6434-1c3697e3-f55ac88b-b14eeaa6_0
2025-10-10T14:38:33.264371Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 96 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602490110211293:11816]
2025-10-10T14:38:33.264541Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2698 sessionId: src_id|d0f6434-1c3697e3-f55ac88b-b14eeaa6_0 is DEAD
2025-10-10T14:38:33.264247Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:33.264913Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d0f6434-1c3697e3-f55ac88b-b14eeaa6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:33.264925Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d0f6434-1c3697e3-f55ac88b-b14eeaa6_0] Write session will restart in 0.007735s
2025-10-10T14:38:33.264960Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d0f6434-1c3697e3-f55ac88b-b14eeaa6_0] Write session: Do CDS request
2025-10-10T14:38:33.264969Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d0f6434-1c3697e3-f55ac88b-b14eeaa6_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:33.273904Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d0f6434-1c3697e3-f55ac88b-b14eeaa6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:33.274012Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:33.274043Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2699
2025-10-10T14:38:33.274198Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2699 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:33.274251Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2699 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:33.274276Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2699 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:33.274291Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:33.274815Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2699 sessionId:  describe result for acl check
2025-10-10T14:38:33.274859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:33.274868Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:33.274872Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:33.274878Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602490110211308:3767] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:33.275488Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602490110211308:3767] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:33.277638Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602490110211308:3767] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:33.282246Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602490110211308:3767] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:33.282265Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602490110211308:3767] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:33.282269Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602490110211308:3767] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:33.282280Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2699 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:33.291602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:33.294601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:33.294876Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:33.294882Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:33.294895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:33.294954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:33.295001Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602489327972929:12275]
2025-10-10T14:38:33.295681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:33.295990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:33.296041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:33.296381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:33.296447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:33.296448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:33.296450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:33.296451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:33.296452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:33.296454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:33.296455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:33.296456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:33.296458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:33.296459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:33.296460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:33.296462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:33.296463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:33.296469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:33.296484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:33.296488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:33.296493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:33.296498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:33.296502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:33.296507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:33.296511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:33.296516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:33.296520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:33.296524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:33.296528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:33.296532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:33.296543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:33.296553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:33.296559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:33.296565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:33.296569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:33.296575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:33.296579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:33.296584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:33.296589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:33.296595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:33.296599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:33.296605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:33.296611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:33.296617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:33.296622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:33.296627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:33.296632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:33.296637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:33.296641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:33.296646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:33.296651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:33.296657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:33.296661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:33.296667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:33.296672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:33.296678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:33.296718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:33.299317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:33.299787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:33.299790Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:33.299792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:33.299795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:33.299801Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2698 [2:7559602489327972929:12275]
2025-10-10T14:38:33.299810Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:33.299823Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:33.299825Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:33.299827Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:33.299829Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:33.299842Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:33.299848Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:33.299856Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:33.299903Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:33.299905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:33.299906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:33.299908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:33.299972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:33.299974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:33.299981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:33.299988Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:33.299998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:33.300015Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602489327972924:12275]
2025-10-10T14:38:33.300017Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602489327972924:12275]
2025-10-10T14:38:33.300018Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602489327972924:12275]
2025-10-10T14:38:33.300024Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:33.300036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602490110211295:2438], now have 1 active actors on pipe
2025-10-10T14:38:33.300036Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:33.300040Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:33.300041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602490110211419:3767], now have 1 active actors on pipe
2025-10-10T14:38:33.300042Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:33.300045Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:33.300054Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:33.300057Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:33.300076Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602489327972924:12275]
2025-10-10T14:38:33.300081Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:33.300089Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:33.301493Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2698
2025-10-10T14:38:33.301547Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2698
2025-10-10T14:38:33.301574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:33.301585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:33.301611Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b9c26a8b-89aa08cf-d10b8b01-7745f446_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:33.301618Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:33.301622Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:33.301624Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:33.301635Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:33.301646Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:33.301661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:33.301835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:33.301841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:33.301855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:33.301947Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2699 partition: 0 MaxSeqNo: 40 sessionId: src_id|b9c26a8b-89aa08cf-d10b8b01-7745f446_0
2025-10-10T14:38:33.302380Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d0f6434-1c3697e3-f55ac88b-b14eeaa6_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|b9c26a8b-89aa08cf-d10b8b01-7745f446_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:33.305018Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b9c26a8b-89aa08cf-d10b8b01-7745f446_0] Write session: try to update token
2025-10-10T14:38:33.305040Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b9c26a8b-89aa08cf-d10b8b01-7745f446_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:33.315962Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:38:33.315992Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:33.316005Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602489327972924:12275]
2025-10-10T14:38:33.316056Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:38:33.316061Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:38:33.316255Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:38:33.316468Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:33.316619Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:33.316785Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:33.316989Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:38:33.317039Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:38:33.321960Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2699 sessionId: src_id|b9c26a8b-89aa08cf-d10b8b01-7745f446_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:33.324620Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:33.324868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:33.324896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:33.324939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:38:33.325015Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:38:33.338444Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:33.338468Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:33.338471Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:33.338473Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:33.338485Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602489327972924:12275]
2025-10-10T14:38:33.338489Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602489327972924:12275]
2025-10-10T14:38:33.338493Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602489327972924:12275]
2025-10-10T14:38:33.338546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:33.338560Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:33.338563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:33.338588Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:33.338603Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:33.338607Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:33.338701Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:33.364697Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602490110211613:11816]
2025-10-10T14:38:33.365063Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 pipe creation result: OK TabletId: 72075186224037892 Generation: 2698, pipe: [1:7559602490110211613:11816]
2025-10-10T14:38:33.461238Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:33.470457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:33.470495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:33.470690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:33.470754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:33.470819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:33.470879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:33.470925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:33.470930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:33.471006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:33.471072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:33.471137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:33.471205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:33.471850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:33.471855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:33.471929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:33.471988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:33.472090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:33.472155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:33.472196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:33.472200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:33.472272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:33.472335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:33.472398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:33.472462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:33.472504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:33.472507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:33.472581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:33.472647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:33.472710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:33.472771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:33.472815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:33.472818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:33.472888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:33.472950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:33.473012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:33.473076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:33.473121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:33.473124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:33.473196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:33.473254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:33.474963Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:33.474979Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:33.475026Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2699 reason: error at write: Disconnected sessionId: src_id|b9c26a8b-89aa08cf-d10b8b01-7745f446_0
2025-10-10T14:38:33.475026Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 97 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602490110211613:11816]
2025-10-10T14:38:33.475060Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:33.475267Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2699 sessionId: src_id|b9c26a8b-89aa08cf-d10b8b01-7745f446_0 is DEAD
2025-10-10T14:38:33.473326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:33.475414Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b9c26a8b-89aa08cf-d10b8b01-7745f446_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:33.475423Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b9c26a8b-89aa08cf-d10b8b01-7745f446_0] Write session will restart in 0.005490s
2025-10-10T14:38:33.473637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:33.473684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:33.473687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:33.473760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:33.473823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:33.473893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:33.473980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:33.474024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:33.475450Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b9c26a8b-89aa08cf-d10b8b01-7745f446_0] Write session: Do CDS request
2025-10-10T14:38:33.474027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:33.474100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:33.475457Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b9c26a8b-89aa08cf-d10b8b01-7745f446_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:33.474164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:33.474226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:33.474290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:33.474333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:33.474338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:33.474413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:33.474474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:33.474537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:33.474604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:33.474650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:33.474653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:33.474728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602490110211613:11816], now have 1 active actors on pipe
2025-10-10T14:38:33.475604Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:33.481908Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b9c26a8b-89aa08cf-d10b8b01-7745f446_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:33.482023Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:33.482042Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2700
2025-10-10T14:38:33.482187Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2700 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:33.482223Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2700 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:33.482233Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2700 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:33.482239Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:33.482761Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2700 sessionId:  describe result for acl check
2025-10-10T14:38:33.482801Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:33.482810Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:33.482815Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:33.482822Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602490110211631:3771] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:33.483433Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602490110211631:3771] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:33.487859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602490110211631:3771] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:33.492292Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602490110211631:3771] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:33.492310Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602490110211631:3771] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:33.492314Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602490110211631:3771] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:33.492324Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2700 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:33.511836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:33.515760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:33.515985Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:33.515995Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:33.516004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:33.516048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:33.516084Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602489327973230:12278]
2025-10-10T14:38:33.516503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:33.516784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:33.516824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:33.517039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:33.517087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:33.517093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:33.517094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:33.517094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:33.517095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:33.517096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:33.517096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:33.517097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:33.517098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:33.517099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:33.517099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:33.517100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:33.517101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:33.517105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:33.517114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:33.517116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:33.517119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:33.517122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:33.517124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:33.517126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:33.517129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:33.517131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:33.517134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:33.517136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:33.517138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:33.517141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:33.517147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:33.517152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:33.517156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:33.517160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:33.517163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:33.517166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:33.517169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:33.517172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:33.517175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:33.517178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:33.517181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:33.517184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:33.517187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:33.517190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:33.517195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:33.517201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:33.517205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:33.517210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:33.517214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:33.517221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:33.517225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:33.517230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:33.517234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:33.517238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:33.517242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:33.517246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:33.517280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:33.520686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:33.521465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:33.521482Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:33.521485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:33.521489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:33.521496Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2699 [2:7559602489327973230:12278]
2025-10-10T14:38:33.521513Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:33.521534Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:33.521538Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:33.521542Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:33.521544Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:33.521563Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:33.521571Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:33.521580Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:33.521651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:33.521661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:33.521664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:33.521666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:33.521741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:33.521749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:33.521763Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:33.521779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:33.521799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:33.521830Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602489327973224:12278]
2025-10-10T14:38:33.521833Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602489327973224:12278]
2025-10-10T14:38:33.521835Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602489327973224:12278]
2025-10-10T14:38:33.521847Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:33.521863Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:33.521868Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:33.521873Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:33.521876Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:33.521887Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:33.521896Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:33.521907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602490110211770:3771], now have 1 active actors on pipe
2025-10-10T14:38:33.521917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602490110211616:2438], now have 1 active actors on pipe
2025-10-10T14:38:33.521967Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602489327973224:12278]
2025-10-10T14:38:33.521979Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:33.521989Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:33.522122Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2699
2025-10-10T14:38:33.522157Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2699
2025-10-10T14:38:33.522209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:33.522221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:33.522254Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2690fc46-a12174a8-cea438f4-b45fe650_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:33.522268Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:33.522273Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:33.522276Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:33.522289Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:33.522305Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:33.522324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:33.522525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:33.522533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:33.522549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:33.522631Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2700 partition: 0 MaxSeqNo: 40 sessionId: src_id|2690fc46-a12174a8-cea438f4-b45fe650_0
2025-10-10T14:38:33.523017Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b9c26a8b-89aa08cf-d10b8b01-7745f446_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|2690fc46-a12174a8-cea438f4-b45fe650_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:33.526031Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2690fc46-a12174a8-cea438f4-b45fe650_0] Write session: try to update token
2025-10-10T14:38:33.526055Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2690fc46-a12174a8-cea438f4-b45fe650_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:33.537326Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:38:33.537399Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:33.537416Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602489327973224:12278]
2025-10-10T14:38:33.537469Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:38:33.537488Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:38:33.537862Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:38:33.538182Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:33.538438Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:33.538699Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:33.539071Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:38:33.539127Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:38:33.541225Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2700 sessionId: src_id|2690fc46-a12174a8-cea438f4-b45fe650_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:33.543881Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:33.544518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:33.544542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:33.544582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:38:33.544687Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:38:33.554663Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:33.554686Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:33.554689Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:33.554692Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:33.554703Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602489327973224:12278]
2025-10-10T14:38:33.554708Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602489327973224:12278]
2025-10-10T14:38:33.554712Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602489327973224:12278]
2025-10-10T14:38:33.554760Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:33.554771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:33.554773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:33.554916Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:33.557561Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:33.557577Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:33.557582Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:33.576925Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602490110211946:11816]
2025-10-10T14:38:33.577435Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 pipe creation result: OK TabletId: 72075186224037892 Generation: 2699, pipe: [1:7559602490110211946:11816]
2025-10-10T14:38:33.676112Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:33.685172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:33.685214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:33.685471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:33.685541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:33.685609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:33.685692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:33.685743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:33.685752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:33.685824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:33.685889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:33.685971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:33.686040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:33.686089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:33.686096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:33.686168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:33.686239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:33.686300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:33.686360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:33.686405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:33.689560Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:33.689576Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:33.689618Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2700 reason: error at write: Disconnected sessionId: src_id|2690fc46-a12174a8-cea438f4-b45fe650_0
2025-10-10T14:38:33.686409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:33.686481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:33.686543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:33.686609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:33.686716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:33.686759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:33.686762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:33.686829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:33.686889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:33.686953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:33.687021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:33.687061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:33.687064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:33.687133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:33.687195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:33.687260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:33.687320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:33.687361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:33.687364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:33.687439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:33.687502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:33.687568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:33.687631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:33.687692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:33.687698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:33.687772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:33.687835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:33.687899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:33.687960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:33.688023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:33.688027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:33.688098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:33.688155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:33.688225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:33.688295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:33.688341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:33.688344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:33.688419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:33.688483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:33.688543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:33.688603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:33.688644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:33.688649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:33.688733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602490110211946:11816], now have 1 active actors on pipe
2025-10-10T14:38:33.689840Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2700 sessionId: src_id|2690fc46-a12174a8-cea438f4-b45fe650_0 is DEAD
2025-10-10T14:38:33.690105Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2690fc46-a12174a8-cea438f4-b45fe650_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:33.690113Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2690fc46-a12174a8-cea438f4-b45fe650_0] Write session will restart in 0.005723s
2025-10-10T14:38:33.690139Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2690fc46-a12174a8-cea438f4-b45fe650_0] Write session: Do CDS request
2025-10-10T14:38:33.690145Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2690fc46-a12174a8-cea438f4-b45fe650_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:33.690216Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:33.690809Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:33.690859Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 98 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602490110211946:11816]
2025-10-10T14:38:33.696999Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2690fc46-a12174a8-cea438f4-b45fe650_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:33.697407Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:33.697427Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2701
2025-10-10T14:38:33.697568Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2701 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:33.697611Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2701 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:33.697622Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2701 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:33.697627Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:33.698047Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2701 sessionId:  describe result for acl check
2025-10-10T14:38:33.698088Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:33.698090Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:33.698091Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:33.698098Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602490110211975:3820] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:33.698709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602490110211975:3820] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:33.701473Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602490110211975:3820] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:33.707947Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602490110211975:3820] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:33.707969Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602490110211975:3820] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:33.707973Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602490110211975:3820] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:33.707982Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2701 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:33.721134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:33.724613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:33.725183Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:33.725196Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:33.725213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:33.725293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:33.725358Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602489327973540:12286]
2025-10-10T14:38:33.726032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:33.726881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:33.726935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:33.727282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:33.727337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:33.727339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:33.727340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:33.727341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:33.727343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:33.727344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:33.727345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:33.727346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:33.727348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:33.727349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:33.727351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:33.727352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:33.727354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:33.727362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:33.727375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:33.727379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:33.727384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:33.727388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:33.727392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:33.727396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:33.727400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:33.727404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:33.727409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:33.727413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:33.727417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:33.727421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:33.727429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:33.727438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:33.727446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:33.727452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:33.727457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:33.727462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:33.727466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:33.727473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:33.727480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:33.727485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:33.727490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:33.727496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:33.727504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:33.727511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:33.727516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:33.727521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:33.727526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:33.727529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:33.727532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:33.727535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:33.727538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:33.727541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:33.727544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:33.727549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:33.727554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:33.727560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:33.727597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:33.730652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:33.731433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:33.731450Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:33.731452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:33.731456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:33.731463Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2700 [2:7559602489327973540:12286]
2025-10-10T14:38:33.731479Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:33.731500Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:33.731505Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:33.731508Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:33.731509Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:33.731524Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:33.731529Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:33.731536Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:33.731601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:33.731610Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:33.731612Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:33.731614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:33.731689Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:33.731697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:33.731710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:33.731724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:33.731745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:33.731772Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602489327973527:12286]
2025-10-10T14:38:33.731783Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602489327973527:12286]
2025-10-10T14:38:33.731785Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602489327973527:12286]
2025-10-10T14:38:33.731798Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:33.731808Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:33.731815Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:33.731817Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:33.731817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602490110211962:2438], now have 1 active actors on pipe
2025-10-10T14:38:33.731820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602490110212082:3820], now have 1 active actors on pipe
2025-10-10T14:38:33.731829Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:33.731844Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:33.731852Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:33.731890Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602489327973527:12286]
2025-10-10T14:38:33.731900Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:33.731917Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:33.731991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:33.732006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:33.732040Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f915f60a-ec7a3d1a-f71ca91c-8371b2d9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:33.732052Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:33.732061Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:33.732064Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:33.732077Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:33.731872Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2700
2025-10-10T14:38:33.732107Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:33.732130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:33.731905Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2700
2025-10-10T14:38:33.732317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:33.732329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:33.732353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:33.732514Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2701 partition: 0 MaxSeqNo: 40 sessionId: src_id|f915f60a-ec7a3d1a-f71ca91c-8371b2d9_0
2025-10-10T14:38:33.732962Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2690fc46-a12174a8-cea438f4-b45fe650_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|f915f60a-ec7a3d1a-f71ca91c-8371b2d9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:33.736035Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f915f60a-ec7a3d1a-f71ca91c-8371b2d9_0] Write session: try to update token
2025-10-10T14:38:33.736062Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f915f60a-ec7a3d1a-f71ca91c-8371b2d9_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:33.752865Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2701 sessionId: src_id|f915f60a-ec7a3d1a-f71ca91c-8371b2d9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:33.755920Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:33.756183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:33.756205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:33.756248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:38:33.756338Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:38:33.761558Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:33.761578Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:33.761582Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:33.761584Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:33.761598Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602489327973527:12286]
2025-10-10T14:38:33.761603Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602489327973527:12286]
2025-10-10T14:38:33.761607Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602489327973527:12286]
2025-10-10T14:38:33.761661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:33.761666Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:33.761669Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:33.761671Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:33.761673Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:33.761677Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:33.761829Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:33.791023Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602490110212294:11816]
2025-10-10T14:38:33.791548Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 pipe creation result: OK TabletId: 72075186224037892 Generation: 2700, pipe: [1:7559602490110212294:11816]
2025-10-10T14:38:33.886074Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:33.894970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:33.895000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:33.895202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:33.895275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:33.895341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:33.895413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:33.895463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:33.895474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:33.895546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:33.895611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:33.895680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:33.895750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:33.895796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:33.895803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:33.895871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:33.895936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:33.896005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:33.896068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:33.896115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:33.896122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:33.896195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:33.896259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:33.896324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:33.896391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:33.896438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:33.896450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:33.896524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:33.896597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:33.896669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:33.896747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:33.896797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:33.896800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:33.896876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:33.896939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:33.897005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:33.897072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:33.897121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:33.897124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:33.897194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:33.897251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:33.897312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:33.897468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:33.897516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:33.897523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:33.897591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:33.897651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:33.897717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:33.897786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:33.897833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:33.897839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:33.897904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:33.897979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:33.898044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:33.898108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:33.898900Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:33.898961Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 99 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602490110212294:11816]
2025-10-10T14:38:33.898998Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:33.899001Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:33.899033Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2701 reason: error at write: Disconnected sessionId: src_id|f915f60a-ec7a3d1a-f71ca91c-8371b2d9_0
2025-10-10T14:38:33.899265Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2701 sessionId: src_id|f915f60a-ec7a3d1a-f71ca91c-8371b2d9_0 is DEAD
2025-10-10T14:38:33.899391Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1661: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 closed with error: reason# too much attempts to restart pipe
2025-10-10T14:38:33.899457Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 27 consumer shared/user session shared/user_1_27_4594285658103637580_v1 is DEAD
2025-10-10T14:38:33.899590Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559602412800772971:11810] disconnected; active server actors: 1
2025-10-10T14:38:33.899593Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559602412800772971:11810] client user disconnected session shared/user_1_27_4594285658103637580_v1
2025-10-10T14:38:33.898154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:33.898164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:33.898243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:33.898308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:33.898374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:33.898445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:33.898491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:33.898493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:33.898549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602490110212294:11816], now have 1 active actors on pipe
2025-10-10T14:38:33.899815Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:33.901624Z :ERROR: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] Got error. Status: UNAVAILABLE. Description: <main>: Error: too much attempts to restart pipe, code: 500027 
2025-10-10T14:38:33.901782Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-10T14:38:33.901787Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-10T14:38:33.901795Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] Reconnecting session to cluster  in 0.006184s
2025-10-10T14:38:33.901990Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f915f60a-ec7a3d1a-f71ca91c-8371b2d9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:33.901997Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f915f60a-ec7a3d1a-f71ca91c-8371b2d9_0] Write session will restart in 0.009317s
2025-10-10T14:38:33.902024Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f915f60a-ec7a3d1a-f71ca91c-8371b2d9_0] Write session: Do CDS request
2025-10-10T14:38:33.902031Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f915f60a-ec7a3d1a-f71ca91c-8371b2d9_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:33.908761Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] Successfully connected. Initializing session
2025-10-10T14:38:33.909117Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-10T14:38:33.909135Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 28
2025-10-10T14:38:33.909384Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 28 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-10T14:38:33.909475Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 read init: from# ipv6:[::1]:37328, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-10T14:38:33.909575Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 auth for : user
2025-10-10T14:38:33.909836Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 Handle describe topics response
2025-10-10T14:38:33.909874Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 auth is DEAD
2025-10-10T14:38:33.909886Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 auth ok: topics# 1, initDone# 0
2025-10-10T14:38:33.910474Z :INFO: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] Got InitResponse. ReadSessionId: shared/user_1_28_16584180023090072381_v1
2025-10-10T14:38:33.910209Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 register session: topic# rt3.dc1--test-topic
2025-10-10T14:38:33.912813Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f915f60a-ec7a3d1a-f71ca91c-8371b2d9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:33.912850Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:33.912863Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2702
2025-10-10T14:38:33.913028Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2702 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:33.913062Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2702 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:33.913073Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2702 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:33.913077Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:33.914128Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2702 sessionId:  describe result for acl check
2025-10-10T14:38:33.914167Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:33.914174Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:33.914176Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:33.914182Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602490110212325:3864] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:33.914765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602490110212325:3864] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:33.915144Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559602490110212319:3860] connected; active server actors: 1
2025-10-10T14:38:33.915343Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7559602490110212319:3860] session shared/user_1_28_16584180023090072381_v1
2025-10-10T14:38:33.915355Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-10-10T14:38:33.915366Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-10-10T14:38:33.915373Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_28_16584180023090072381_v1" (Sender=[1:7559602490110212315:3860], Pipe=[1:7559602490110212319:3860], Partitions=[], ActiveFamilyCount=0)
2025-10-10T14:38:33.915386Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-10T14:38:33.915403Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-10-10T14:38:33.915412Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_28_16584180023090072381_v1" (Sender=[1:7559602490110212315:3860], Pipe=[1:7559602490110212319:3860], Partitions=[], ActiveFamilyCount=0)
2025-10-10T14:38:33.915424Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_28_16584180023090072381_v1" sender [1:7559602490110212315:3860] lock partition 0 for ReadingSession "shared/user_1_28_16584180023090072381_v1" (Sender=[1:7559602490110212315:3860], Pipe=[1:7559602490110212319:3860], Partitions=[], ActiveFamilyCount=1) generation 1 step 28
2025-10-10T14:38:33.915434Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-10-10T14:38:33.915439Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000033s
2025-10-10T14:38:33.915679Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 28 Session: "shared/user_1_28_16584180023090072381_v1" ClientId: "user" PipeClient { RawX1: 7559602490110212319 RawX2: 4503603922341652 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-10T14:38:33.915702Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-10T14:38:33.918118Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602490110212325:3864] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:33.930969Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602490110212325:3864] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:33.930990Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602490110212325:3864] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:33.930995Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602490110212325:3864] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:33.931007Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2702 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:33.963215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:33.972408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:33.972734Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:33.972746Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:33.972760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:33.972829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:33.972879Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602489327973850:9495]
2025-10-10T14:38:33.973556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:33.973983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:33.974051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:33.974416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:33.974689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:33.974697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:33.974698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:33.974699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:33.974701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:33.974702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:33.974703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:33.974705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:33.974706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:33.974708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:33.974709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:33.974710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:33.974711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:33.974719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:33.974744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:33.974748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:33.974752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:33.974756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:33.974760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:33.974764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:33.974768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:33.974772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:33.974776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:33.974780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:33.974784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:33.974789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:33.974799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:33.974808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:33.974816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:33.974823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:33.974828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:33.974833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:33.974840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:33.974845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:33.974850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:33.974855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:33.974858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:33.974863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:33.974867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:33.974872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:33.974890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:33.974896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:33.974902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:33.974907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:33.974914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:33.974919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:33.974925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:33.974930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:33.974935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:33.974941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:33.974946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:33.974951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:33.974996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:33.982037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:33.983476Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2701
2025-10-10T14:38:33.983477Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 2701, pipe: [1:7559602490110212334:3900]
2025-10-10T14:38:33.983508Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2701
2025-10-10T14:38:33.982939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:33.982958Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:33.982961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:33.982966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:33.982974Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2701 [2:7559602489327973850:9495]
2025-10-10T14:38:33.982992Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:33.983014Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:33.983018Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:33.983022Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:33.983024Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:33.983044Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:33.983053Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:33.983062Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:33.983139Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:33.983141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:33.983143Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:33.983147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:33.983228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:33.983232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:33.983248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:33.983260Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:33.983279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:33.983301Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602489327973845:9495]
2025-10-10T14:38:33.983305Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602489327973845:9495]
2025-10-10T14:38:33.983307Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602489327973845:9495]
2025-10-10T14:38:33.983317Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:33.983334Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:33.983344Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:33.983347Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:33.983349Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:33.983351Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:33.983356Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:33.983407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602490110212334:3900], now have 1 active actors on pipe
2025-10-10T14:38:33.983411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602490110212305:2438], now have 1 active actors on pipe
2025-10-10T14:38:33.983414Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602489327973845:9495]
2025-10-10T14:38:33.983428Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:33.983435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602490110212422:3864], now have 1 active actors on pipe
2025-10-10T14:38:33.983459Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:33.983584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:33.983591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:33.983606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_28_16584180023090072381_v1 on pipe: [1:7559602490110212334:3900]
2025-10-10T14:38:33.983633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:33.983636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:33.983648Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:33.983649Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_28_16584180023090072381_v1:1 with generation 2701
2025-10-10T14:38:33.983658Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:33.983660Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:33.983680Z node 2 :PERSQUEUE DEBUG: partition.cpp:3747: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_28_16584180023090072381_v1
2025-10-10T14:38:33.983683Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:33.983729Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|320751be-9757c1d1-7c46f005-4d1ef11f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:33.983736Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:38:33.983741Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:38:33.988682Z node 2 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:38:33.988721Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:38:33.988735Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:33.988743Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:33.988746Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:33.988762Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:33.988781Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:33.988790Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-10T14:38:33.988806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-10T14:38:33.988835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:33.989088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:33.989100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:33.989128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:33.988985Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 40 WriteTimestampMS: 1760106661000 SizeLag: 17206678 WriteTimestampEstimateMS: 1760107113983 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-10T14:38:33.989013Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 40 readOffset 0 committedOffset 0
2025-10-10T14:38:33.989048Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 sending to client partition status
2025-10-10T14:38:33.989391Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2702 partition: 0 MaxSeqNo: 40 sessionId: src_id|320751be-9757c1d1-7c46f005-4d1ef11f_0
2025-10-10T14:38:33.989811Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f915f60a-ec7a3d1a-f71ca91c-8371b2d9_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|320751be-9757c1d1-7c46f005-4d1ef11f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:33.992653Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|320751be-9757c1d1-7c46f005-4d1ef11f_0] Write session: try to update token
2025-10-10T14:38:33.992677Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|320751be-9757c1d1-7c46f005-4d1ef11f_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:34.004509Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:34.004529Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:34.004532Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:34.004535Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:34.004547Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602489327973845:9495]
2025-10-10T14:38:34.004552Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602489327973845:9495]
2025-10-10T14:38:34.004557Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602489327973845:9495]
2025-10-10T14:38:34.004617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:34.004626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:34.004629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:34.004721Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:34.004731Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:34.004736Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:34.004779Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:34.009533Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2702 sessionId: src_id|320751be-9757c1d1-7c46f005-4d1ef11f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:34.012526Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:34.129008Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:34.129568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:34.129590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:34.129869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_28_16584180023090072381_v1
2025-10-10T14:38:34.129891Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:34.130367Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_28_16584180023090072381_v1
2025-10-10T14:38:34.130451Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|320751be-9757c1d1-7c46f005-4d1ef11f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:38:34.130465Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|320751be-9757c1d1-7c46f005-4d1ef11f_0] Write session will restart in 0.007354s
2025-10-10T14:38:34.130492Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|320751be-9757c1d1-7c46f005-4d1ef11f_0] Write session: Do CDS request
2025-10-10T14:38:34.129876Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 0 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602490110212334:3900]
2025-10-10T14:38:34.130499Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|320751be-9757c1d1-7c46f005-4d1ef11f_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:34.129915Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:34.129982Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:38:34.130086Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2702 reason: status is not ok: tablet will be restarted right now sessionId: src_id|320751be-9757c1d1-7c46f005-4d1ef11f_0
2025-10-10T14:38:34.130285Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2702 sessionId: src_id|320751be-9757c1d1-7c46f005-4d1ef11f_0 is DEAD
2025-10-10T14:38:34.138950Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|320751be-9757c1d1-7c46f005-4d1ef11f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:34.139366Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:34.139385Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2703
2025-10-10T14:38:34.139506Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2703 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:34.139547Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2703 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:34.139561Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2703 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:34.139565Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:34.140043Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2703 sessionId:  describe result for acl check
2025-10-10T14:38:34.140099Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:34.140106Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:34.140108Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:34.140114Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602494405179965:3898] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:34.140723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602494405179965:3898] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:34.144439Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602494405179965:3898] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:34.148677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602494405179965:3898] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:34.148697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602494405179965:3898] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:34.148701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602494405179965:3898] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:34.148711Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2703 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:34.156712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:34.160079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:34.160360Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:34.160375Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:34.160391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:34.160478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:34.160523Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602493622941442:9478]
2025-10-10T14:38:34.161213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:34.161572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:34.161620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:34.161994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:34.162056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:34.162062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:34.162063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:34.162065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:34.162066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:34.162068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:34.162069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:34.162071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:34.162072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:34.162073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:34.162075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:34.162076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:34.162077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:34.162083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:34.162097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:34.162101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:34.162106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:34.162110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:34.162115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:34.162119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:34.162123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:34.162127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:34.162132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:34.162135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:34.162140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:34.162144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:34.162152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:34.162161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:34.162168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:34.162175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:34.162180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:34.162186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:34.162191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:34.162197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:34.162202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:34.162208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:34.162212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:34.162218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:34.162222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:34.162227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:34.162232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:34.162237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:34.162243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:34.162248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:34.162261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:34.162267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:34.162273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:34.162283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:34.162288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:34.162299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:34.162304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:34.162314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:34.162366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:34.165147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:34.165791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:34.165807Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:34.165810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:34.165814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:34.165821Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2702 [2:7559602493622941442:9478]
2025-10-10T14:38:34.165837Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:34.165859Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:34.165863Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:34.165868Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:34.165870Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:34.165898Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:34.165906Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:34.165934Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:34.166005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:34.166013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:34.166015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:34.166018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:34.166103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:34.166119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:34.166133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:34.166149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:34.166168Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:34.166198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602494405180123:3898], now have 1 active actors on pipe
2025-10-10T14:38:34.166206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602494405179931:2438], now have 1 active actors on pipe
2025-10-10T14:38:34.166215Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602493622941437:9478]
2025-10-10T14:38:34.166218Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602493622941437:9478]
2025-10-10T14:38:34.166221Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602493622941437:9478]
2025-10-10T14:38:34.166236Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:34.166256Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:34.166263Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:34.166267Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:34.166270Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:34.166278Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:34.166282Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:34.166318Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602493622941437:9478]
2025-10-10T14:38:34.166310Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2702
2025-10-10T14:38:34.166310Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2702
2025-10-10T14:38:34.166331Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:34.166359Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:34.166370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:34.166375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:34.166415Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|935f5b35-e245f17f-89f2c2d3-17a073e5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:34.166424Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:34.166436Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:34.166438Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:34.166472Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:34.166491Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:34.166512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:34.166668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:34.166678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:34.166697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:34.166834Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2703 partition: 0 MaxSeqNo: 40 sessionId: src_id|935f5b35-e245f17f-89f2c2d3-17a073e5_0
2025-10-10T14:38:34.167330Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|320751be-9757c1d1-7c46f005-4d1ef11f_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|935f5b35-e245f17f-89f2c2d3-17a073e5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:34.170219Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|935f5b35-e245f17f-89f2c2d3-17a073e5_0] Write session: try to update token
2025-10-10T14:38:34.170237Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|935f5b35-e245f17f-89f2c2d3-17a073e5_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:34.185732Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2703 sessionId: src_id|935f5b35-e245f17f-89f2c2d3-17a073e5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:34.186985Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:34.187005Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:34.187009Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:34.187011Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:34.187022Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602493622941437:9478]
2025-10-10T14:38:34.187027Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602493622941437:9478]
2025-10-10T14:38:34.187031Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602493622941437:9478]
2025-10-10T14:38:34.187087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:34.187103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:34.187105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:34.187257Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:34.187291Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:34.187298Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:34.187302Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:34.188620Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:34.229971Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602494405180253:3900]
2025-10-10T14:38:34.230314Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 pipe creation result: OK TabletId: 72075186224037892 Generation: 2702, pipe: [1:7559602494405180253:3900]
2025-10-10T14:38:34.303573Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:34.304260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:34.304277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:34.304327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602494405180253:3900], now have 1 active actors on pipe
2025-10-10T14:38:34.304608Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:34.305178Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|935f5b35-e245f17f-89f2c2d3-17a073e5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:34.305191Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|935f5b35-e245f17f-89f2c2d3-17a073e5_0] Write session will restart in 0.007733s
2025-10-10T14:38:34.305220Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|935f5b35-e245f17f-89f2c2d3-17a073e5_0] Write session: Do CDS request
2025-10-10T14:38:34.305227Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|935f5b35-e245f17f-89f2c2d3-17a073e5_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:34.304634Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:34.304664Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:34.304724Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:34.304749Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2703 reason: error at write: Disconnected sessionId: src_id|935f5b35-e245f17f-89f2c2d3-17a073e5_0
2025-10-10T14:38:34.304774Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 1 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602494405180253:3900]
2025-10-10T14:38:34.305000Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2703 sessionId: src_id|935f5b35-e245f17f-89f2c2d3-17a073e5_0 is DEAD
2025-10-10T14:38:34.313994Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|935f5b35-e245f17f-89f2c2d3-17a073e5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:34.314059Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:34.314077Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2704
2025-10-10T14:38:34.314248Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2704 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:34.314287Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2704 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:34.314306Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2704 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:34.314318Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:34.314789Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2704 sessionId:  describe result for acl check
2025-10-10T14:38:34.314828Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:34.314834Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:34.314838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:34.314844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602494405180289:3902] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:34.315455Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602494405180289:3902] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:34.319173Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602494405180289:3902] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:34.323157Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602494405180289:3902] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:34.323178Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602494405180289:3902] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:34.323182Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602494405180289:3902] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:34.323193Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2704 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:34.329909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:34.332951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:34.333249Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:34.333260Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:34.333273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:34.333366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:34.333420Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602493622941735:9487]
2025-10-10T14:38:34.334094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:34.334443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:34.334507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:34.334860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:34.334924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:34.334929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:34.334931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:34.334932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:34.334933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:34.334935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:34.334936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:34.334937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:34.334938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:34.334939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:34.334940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:34.334943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:34.334944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:34.334951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:34.334965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:34.334969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:34.334973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:34.334977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:34.334981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:34.334985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:34.334990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:34.334994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:34.334998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:34.335002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:34.335007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:34.335011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:34.335020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:34.335029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:34.335036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:34.335042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:34.335048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:34.335053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:34.335058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:34.335063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:34.335068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:34.335074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:34.335079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:34.335084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:34.335091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:34.335096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:34.335101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:34.335106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:34.335111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:34.335116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:34.335128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:34.335134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:34.335139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:34.335144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:34.335149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:34.335154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:34.335160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:34.335172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:34.335215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:34.337883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:34.338749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:34.338759Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:34.338762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:34.338766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:34.338776Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2703 [2:7559602493622941735:9487]
2025-10-10T14:38:34.338790Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:34.338809Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:34.338820Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:34.338824Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:34.338826Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:34.338846Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:34.338855Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:34.338863Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:34.338930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:34.338939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:34.338941Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:34.338944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:34.339013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:34.339020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:34.339031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:34.339047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:34.339062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:34.339090Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602493622941730:9487]
2025-10-10T14:38:34.339097Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602493622941730:9487]
2025-10-10T14:38:34.339100Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602493622941730:9487]
2025-10-10T14:38:34.339114Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:34.339130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602494405180254:2438], now have 1 active actors on pipe
2025-10-10T14:38:34.339139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602494405180450:3902], now have 1 active actors on pipe
2025-10-10T14:38:34.339148Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:34.339150Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:34.339154Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:34.339156Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:34.339165Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:34.339169Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:34.339205Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602493622941730:9487]
2025-10-10T14:38:34.339184Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2703
2025-10-10T14:38:34.339216Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:34.339222Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:34.339194Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2703
2025-10-10T14:38:34.339319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:34.339329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:34.339365Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4e8d4251-deab1774-c00aa868-a5b1da22_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:34.339379Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:34.339383Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:34.339385Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:34.339399Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:34.339411Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:34.339427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:34.339615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:34.339627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:34.339645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:34.339743Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2704 partition: 0 MaxSeqNo: 40 sessionId: src_id|4e8d4251-deab1774-c00aa868-a5b1da22_0
2025-10-10T14:38:34.340220Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|935f5b35-e245f17f-89f2c2d3-17a073e5_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|4e8d4251-deab1774-c00aa868-a5b1da22_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:34.343408Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4e8d4251-deab1774-c00aa868-a5b1da22_0] Write session: try to update token
2025-10-10T14:38:34.343431Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4e8d4251-deab1774-c00aa868-a5b1da22_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:34.362349Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:34.362370Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:34.362373Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:34.362375Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:34.362386Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602493622941730:9487]
2025-10-10T14:38:34.362390Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602493622941730:9487]
2025-10-10T14:38:34.362394Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602493622941730:9487]
2025-10-10T14:38:34.362448Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:34.362449Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:34.362456Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:34.362457Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:34.362459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:34.362461Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:34.362614Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:34.362649Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2704 sessionId: src_id|4e8d4251-deab1774-c00aa868-a5b1da22_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:34.365403Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:34.405465Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602494405180578:3900]
2025-10-10T14:38:34.406065Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 pipe creation result: OK TabletId: 72075186224037892 Generation: 2703, pipe: [1:7559602494405180578:3900]
2025-10-10T14:38:34.480769Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:34.481369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:34.481388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:34.481440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602494405180578:3900], now have 1 active actors on pipe
2025-10-10T14:38:34.481702Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:34.481723Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:34.481793Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2704 reason: error at write: Disconnected sessionId: src_id|4e8d4251-deab1774-c00aa868-a5b1da22_0
2025-10-10T14:38:34.482025Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2704 sessionId: src_id|4e8d4251-deab1774-c00aa868-a5b1da22_0 is DEAD
2025-10-10T14:38:34.482099Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 2 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602494405180578:3900]
2025-10-10T14:38:34.482086Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:34.482130Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:34.482221Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e8d4251-deab1774-c00aa868-a5b1da22_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:34.482231Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e8d4251-deab1774-c00aa868-a5b1da22_0] Write session will restart in 0.006314s
2025-10-10T14:38:34.482257Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e8d4251-deab1774-c00aa868-a5b1da22_0] Write session: Do CDS request
2025-10-10T14:38:34.482263Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e8d4251-deab1774-c00aa868-a5b1da22_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:34.489894Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4e8d4251-deab1774-c00aa868-a5b1da22_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:34.490049Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:34.490063Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2705
2025-10-10T14:38:34.490205Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2705 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:34.490246Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2705 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:34.490258Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2705 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:34.490262Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:34.491010Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2705 sessionId:  describe result for acl check
2025-10-10T14:38:34.491054Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:34.491061Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:34.491063Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:34.491071Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602494405180614:3917] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:34.491705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602494405180614:3917] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:34.494953Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602494405180614:3917] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:34.498919Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602494405180614:3917] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:34.498934Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602494405180614:3917] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:34.498938Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602494405180614:3917] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:34.498947Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2705 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:34.505481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:34.508686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:34.508995Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:34.509006Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:34.509019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:34.509081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:34.509128Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602493622942041:9485]
2025-10-10T14:38:34.509821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:34.510149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:34.510190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:34.510544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:34.510614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:34.510621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:34.510622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:34.510623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:34.510625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:34.510626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:34.510627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:34.510629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:34.510630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:34.510631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:34.510633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:34.510634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:34.510635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:34.510643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:34.510656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:34.510660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:34.510664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:34.510668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:34.510672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:34.510676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:34.510680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:34.510684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:34.510688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:34.510692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:34.510696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:34.510700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:34.510708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:34.510716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:34.510722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:34.510729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:34.510733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:34.510738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:34.510742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:34.510748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:34.510753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:34.510758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:34.510762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:34.510767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:34.510772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:34.510777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:34.510782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:34.510787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:34.510792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:34.510797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:34.510801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:34.510806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:34.510811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:34.510816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:34.510820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:34.510826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:34.510830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:34.510835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:34.510877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:34.514957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:34.515879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:34.515895Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:34.515897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:34.515901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:34.515908Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2704 [2:7559602493622942041:9485]
2025-10-10T14:38:34.515923Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:34.515945Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:34.515949Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:34.515952Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:34.515955Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:34.515974Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:34.515988Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:34.515998Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:34.516073Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:34.516080Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:34.516082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:34.516085Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:34.516167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:34.516175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:34.516188Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:34.516201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:34.516219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:34.516247Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602493622942036:9485]
2025-10-10T14:38:34.516254Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602493622942036:9485]
2025-10-10T14:38:34.516257Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602493622942036:9485]
2025-10-10T14:38:34.516267Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:34.516276Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:34.516278Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:34.516280Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:34.516284Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:34.516301Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:34.516309Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:34.516360Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2704
2025-10-10T14:38:34.516320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602494405180580:2438], now have 1 active actors on pipe
2025-10-10T14:38:34.516373Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2704
2025-10-10T14:38:34.516332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602494405180769:3917], now have 1 active actors on pipe
2025-10-10T14:38:34.516372Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602493622942036:9485]
2025-10-10T14:38:34.516381Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:34.516403Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:34.516650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:34.516665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:34.516714Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1bb211d9-6594d63a-8fa66c63-fa0e01a0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:34.516729Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:34.516734Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:34.516737Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:34.516752Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:34.516771Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:34.516793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:34.516987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:34.516996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:34.517018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:34.517129Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2705 partition: 0 MaxSeqNo: 40 sessionId: src_id|1bb211d9-6594d63a-8fa66c63-fa0e01a0_0
2025-10-10T14:38:34.517581Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e8d4251-deab1774-c00aa868-a5b1da22_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|1bb211d9-6594d63a-8fa66c63-fa0e01a0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:34.520501Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1bb211d9-6594d63a-8fa66c63-fa0e01a0_0] Write session: try to update token
2025-10-10T14:38:34.520518Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1bb211d9-6594d63a-8fa66c63-fa0e01a0_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:34.536635Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:34.536641Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:34.536645Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:34.536647Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:34.536657Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602493622942036:9485]
2025-10-10T14:38:34.536661Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602493622942036:9485]
2025-10-10T14:38:34.536665Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602493622942036:9485]
2025-10-10T14:38:34.536694Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:34.536700Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:34.536705Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:34.536711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:34.536720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:34.536722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:34.536876Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:34.537282Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2705 sessionId: src_id|1bb211d9-6594d63a-8fa66c63-fa0e01a0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:34.540288Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:34.582239Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602494405180920:3900]
2025-10-10T14:38:34.582654Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 pipe creation result: OK TabletId: 72075186224037892 Generation: 2704, pipe: [1:7559602494405180920:3900]
2025-10-10T14:38:34.662440Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:34.662983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:34.663002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:34.663051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602494405180920:3900], now have 1 active actors on pipe
2025-10-10T14:38:34.663300Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:34.663387Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 3 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602494405180920:3900]
2025-10-10T14:38:34.663423Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:34.663455Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:34.663457Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:34.663939Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1bb211d9-6594d63a-8fa66c63-fa0e01a0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:34.663957Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1bb211d9-6594d63a-8fa66c63-fa0e01a0_0] Write session will restart in 0.006540s
2025-10-10T14:38:34.663521Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2705 reason: error at write: Disconnected sessionId: src_id|1bb211d9-6594d63a-8fa66c63-fa0e01a0_0
2025-10-10T14:38:34.663738Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2705 sessionId: src_id|1bb211d9-6594d63a-8fa66c63-fa0e01a0_0 is DEAD
2025-10-10T14:38:34.663983Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1bb211d9-6594d63a-8fa66c63-fa0e01a0_0] Write session: Do CDS request
2025-10-10T14:38:34.664002Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1bb211d9-6594d63a-8fa66c63-fa0e01a0_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:34.671964Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1bb211d9-6594d63a-8fa66c63-fa0e01a0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:34.673922Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:34.673939Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2706
2025-10-10T14:38:34.674068Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2706 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:34.674115Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2706 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:34.674125Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2706 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:34.674128Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:34.674644Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2706 sessionId:  describe result for acl check
2025-10-10T14:38:34.674683Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:34.674690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:34.674692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:34.674700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602494405180993:3943] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:34.675278Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602494405180993:3943] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:34.678134Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602494405180993:3943] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:34.682790Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602494405180993:3943] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:34.682809Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602494405180993:3943] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:34.682812Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602494405180993:3943] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:34.682821Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2706 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:34.687440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:34.690295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:34.690548Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:34.690559Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:34.690572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:34.690638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:34.690683Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602493622942338:9483]
2025-10-10T14:38:34.691336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:34.691671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:34.691733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:34.692135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:34.692200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:34.692207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:34.692208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:34.692210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:34.692211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:34.692213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:34.692214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:34.692216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:34.692218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:34.692219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:34.692220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:34.692222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:34.692224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:34.692230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:34.692244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:34.692248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:34.692253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:34.692257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:34.692261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:34.692265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:34.692269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:34.692273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:34.692278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:34.692282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:34.692286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:34.692290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:34.692300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:34.692311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:34.692318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:34.692324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:34.692329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:34.692339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:34.692344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:34.692352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:34.692380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:34.692390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:34.692396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:34.692407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:34.692412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:34.692418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:34.692427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:34.692432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:34.692437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:34.692450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:34.692455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:34.692465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:34.692470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:34.692476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:34.692485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:34.692491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:34.692501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:34.692507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:34.692551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:34.695771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:34.696259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:34.696272Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:34.696275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:34.696279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:34.696287Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2705 [2:7559602493622942338:9483]
2025-10-10T14:38:34.696303Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:34.696326Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:34.696334Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:34.696338Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:34.696340Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:34.696360Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:34.696373Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:34.696386Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:34.696466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:34.696473Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:34.696475Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:34.696478Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:34.696550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:34.696557Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:34.696569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:34.696584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:34.696600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:34.696628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602494405180924:2438], now have 1 active actors on pipe
2025-10-10T14:38:34.696637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602494405181166:3943], now have 1 active actors on pipe
2025-10-10T14:38:34.696645Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602493622942333:9483]
2025-10-10T14:38:34.696648Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602493622942333:9483]
2025-10-10T14:38:34.696651Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602493622942333:9483]
2025-10-10T14:38:34.696663Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:34.696686Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:34.696689Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:34.696693Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:34.696696Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:34.696706Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:34.696709Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:34.696715Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2705
2025-10-10T14:38:34.696747Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602493622942333:9483]
2025-10-10T14:38:34.696723Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2705
2025-10-10T14:38:34.696759Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:34.696791Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:34.696839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:34.696849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:34.696880Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5d76257-c1dc0674-7e870cad-b2dfbc05_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:34.696893Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:34.696901Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:34.696904Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:34.696918Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:34.696935Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:34.696954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:34.697311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:34.697320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:34.697351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:34.697485Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2706 partition: 0 MaxSeqNo: 40 sessionId: src_id|5d76257-c1dc0674-7e870cad-b2dfbc05_0
2025-10-10T14:38:34.698059Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1bb211d9-6594d63a-8fa66c63-fa0e01a0_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|5d76257-c1dc0674-7e870cad-b2dfbc05_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:34.701218Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5d76257-c1dc0674-7e870cad-b2dfbc05_0] Write session: try to update token
2025-10-10T14:38:34.701258Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5d76257-c1dc0674-7e870cad-b2dfbc05_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:34.726067Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2706 sessionId: src_id|5d76257-c1dc0674-7e870cad-b2dfbc05_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:34.726912Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:38:34.726937Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:34.726954Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602493622942333:9483]
2025-10-10T14:38:34.727019Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:38:34.727042Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:38:34.727244Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:38:34.727406Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:34.727579Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:34.727745Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:34.727980Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:38:34.728036Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:38:34.729163Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:34.729466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:34.729488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:34.729528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:38:34.729903Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:38:34.741826Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:34.741844Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:34.741848Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:34.741850Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:34.741862Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602493622942333:9483]
2025-10-10T14:38:34.741867Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602493622942333:9483]
2025-10-10T14:38:34.741871Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602493622942333:9483]
2025-10-10T14:38:34.741938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:34.741942Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:34.741950Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:34.741952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:34.741954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:34.741961Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:34.742108Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:34.763484Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602494405181261:3900]
2025-10-10T14:38:34.763874Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 pipe creation result: OK TabletId: 72075186224037892 Generation: 2705, pipe: [1:7559602494405181261:3900]
2025-10-10T14:38:34.860086Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:34.868870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:34.868898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:34.869110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:34.869181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:34.869255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:34.869318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:34.869381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:34.869393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:34.869466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:34.869528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:34.869596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:34.869662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:34.869710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:34.869718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:34.869790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:34.869853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:34.869932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:34.869996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:34.870045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:34.870052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:34.870123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:34.870186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:34.870250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:34.870316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:34.870365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:34.870371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:34.870440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:34.870494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:34.870567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:34.870632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:34.870678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:34.870687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:34.870755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:34.870817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:34.870879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:34.870943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:34.870988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:34.870996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:34.871063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:34.871118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:34.871189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:34.871281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:34.871327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:34.871332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:34.871429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:34.871490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:34.871553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:34.871616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:34.871664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:34.871672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:34.871739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:34.871799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:34.871867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:34.871935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:34.871983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:34.871990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:34.872059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:34.872118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:34.872186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:34.872250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:34.872296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:34.872303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:34.872373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602494405181261:3900], now have 1 active actors on pipe
2025-10-10T14:38:34.872683Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 4 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602494405181261:3900]
2025-10-10T14:38:34.872699Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:34.872704Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:34.872718Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:34.872741Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2706 reason: error at write: Disconnected sessionId: src_id|5d76257-c1dc0674-7e870cad-b2dfbc05_0
2025-10-10T14:38:34.873229Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d76257-c1dc0674-7e870cad-b2dfbc05_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:34.873249Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d76257-c1dc0674-7e870cad-b2dfbc05_0] Write session will restart in 0.008270s
2025-10-10T14:38:34.873275Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d76257-c1dc0674-7e870cad-b2dfbc05_0] Write session: Do CDS request
2025-10-10T14:38:34.873281Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d76257-c1dc0674-7e870cad-b2dfbc05_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:34.873272Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2706 sessionId: src_id|5d76257-c1dc0674-7e870cad-b2dfbc05_0 is DEAD
2025-10-10T14:38:34.873573Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:34.883027Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5d76257-c1dc0674-7e870cad-b2dfbc05_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:34.884475Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:34.884493Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2707
2025-10-10T14:38:34.885543Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2707 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:34.885605Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2707 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:34.885611Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2707 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:34.885615Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:34.886429Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2707 sessionId:  describe result for acl check
2025-10-10T14:38:34.886470Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:34.886476Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:34.886480Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:34.886487Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602494405181372:4040] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:34.887101Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602494405181372:4040] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:34.889958Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602494405181372:4040] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:34.894082Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602494405181372:4040] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:34.894101Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602494405181372:4040] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:34.894106Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602494405181372:4040] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:34.894115Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2707 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:34.898058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:34.900957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:34.901238Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:34.901250Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:34.901264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:34.901322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:34.901385Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602493622942673:9460]
2025-10-10T14:38:34.902088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:34.902805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:34.902860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:34.903245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:34.903311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:34.903318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:34.903320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:34.903321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:34.903322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:34.903324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:34.903325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:34.903327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:34.903328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:34.903329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:34.903331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:34.903332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:34.903333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:34.903340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:34.903355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:34.903360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:34.903364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:34.903368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:34.903373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:34.903377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:34.903382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:34.903386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:34.903390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:34.903395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:34.903399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:34.903403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:34.903412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:34.903421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:34.903428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:34.903434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:34.903455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:34.903460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:34.903465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:34.903471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:34.903477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:34.903482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:34.903487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:34.903493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:34.903509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:34.903515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:34.903519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:34.903525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:34.903530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:34.903536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:34.903541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:34.903548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:34.903553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:34.903559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:34.903564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:34.903569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:34.903578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:34.903584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:34.903631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:34.906418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:34.906913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:34.906927Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:34.906929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:34.906934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:34.906941Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2706 [2:7559602493622942673:9460]
2025-10-10T14:38:34.906955Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:34.906974Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:34.906982Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:34.906986Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:34.906989Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:34.907007Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:34.907019Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:34.907029Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:34.907096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:34.907103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:34.907105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:34.907108Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:34.907175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:34.907183Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:34.907197Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:34.907211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:34.907251Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:34.907278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602494405181283:2438], now have 1 active actors on pipe
2025-10-10T14:38:34.907282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602494405181559:4040], now have 1 active actors on pipe
2025-10-10T14:38:34.907290Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602493622942668:9460]
2025-10-10T14:38:34.907292Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602493622942668:9460]
2025-10-10T14:38:34.907294Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602493622942668:9460]
2025-10-10T14:38:34.907308Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:34.907322Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:34.907324Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:34.907326Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:34.907328Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:34.907343Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:34.907346Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:34.907369Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602493622942668:9460]
2025-10-10T14:38:34.907372Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:34.907374Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:34.907342Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2706
2025-10-10T14:38:34.907391Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2706
2025-10-10T14:38:34.907476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:34.907491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:34.907536Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b35caae8-9cec2265-9377167f-83be5267_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:34.907552Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:34.907558Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:34.907561Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:34.907573Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:34.907594Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:34.907614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:34.907772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:34.907790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:34.907807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:34.907915Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2707 partition: 0 MaxSeqNo: 40 sessionId: src_id|b35caae8-9cec2265-9377167f-83be5267_0
2025-10-10T14:38:34.908471Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d76257-c1dc0674-7e870cad-b2dfbc05_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|b35caae8-9cec2265-9377167f-83be5267_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:34.911107Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b35caae8-9cec2265-9377167f-83be5267_0] Write session: try to update token
2025-10-10T14:38:34.911123Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b35caae8-9cec2265-9377167f-83be5267_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:34.926634Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2707 sessionId: src_id|b35caae8-9cec2265-9377167f-83be5267_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:34.929422Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:34.929669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:34.929700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:34.929745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:38:34.929875Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:38:34.931856Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:34.931877Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:34.931881Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:34.931883Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:34.931892Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602493622942668:9460]
2025-10-10T14:38:34.931897Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602493622942668:9460]
2025-10-10T14:38:34.931900Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602493622942668:9460]
2025-10-10T14:38:34.931952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:34.931957Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:34.931965Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:34.931968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:34.931971Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:34.931987Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:34.932115Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:34.972902Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602494405181608:3900]
2025-10-10T14:38:34.973178Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 pipe creation result: OK TabletId: 72075186224037892 Generation: 2706, pipe: [1:7559602494405181608:3900]
2025-10-10T14:38:35.049396Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:35.057947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:35.057975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:35.058149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:35.058208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:35.058275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:35.058333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:35.058380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:35.058388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:35.058451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:35.058517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:35.058584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:35.058647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:35.058690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:35.058697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:35.058767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:35.058833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:35.058899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:35.058970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:35.059018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:35.059027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:35.059102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:35.059177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:35.059245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:35.059311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:35.059358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:35.059365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:35.059435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:35.059574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:35.059679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:35.059749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:35.059796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:35.059803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:35.059876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:35.059943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:35.060011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:35.060076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:35.060136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:35.060141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:35.060212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:35.060275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:35.060348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:35.060420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:35.060471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:35.060480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:35.060552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:35.060616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:35.060686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:35.060762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:35.060876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:35.060884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:35.060955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:35.061019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:35.061081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:35.061148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:35.061192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:35.061199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:35.061268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:35.061349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:35.061414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:35.061473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:35.061524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:35.061532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:35.061605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602494405181608:3900], now have 1 active actors on pipe
2025-10-10T14:38:35.062080Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:35.062101Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 5 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602494405181608:3900]
2025-10-10T14:38:35.062154Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:35.062166Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:35.062196Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2707 reason: error at write: Disconnected sessionId: src_id|b35caae8-9cec2265-9377167f-83be5267_0
2025-10-10T14:38:35.062453Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:35.062590Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b35caae8-9cec2265-9377167f-83be5267_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:35.062597Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b35caae8-9cec2265-9377167f-83be5267_0] Write session will restart in 0.005955s
2025-10-10T14:38:35.062628Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b35caae8-9cec2265-9377167f-83be5267_0] Write session: Do CDS request
2025-10-10T14:38:35.062633Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b35caae8-9cec2265-9377167f-83be5267_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:35.062466Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2707 sessionId: src_id|b35caae8-9cec2265-9377167f-83be5267_0 is DEAD
2025-10-10T14:38:35.069979Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b35caae8-9cec2265-9377167f-83be5267_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:35.070065Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:35.070084Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2708
2025-10-10T14:38:35.070230Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2708 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:35.070281Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2708 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:35.070303Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2708 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:35.070307Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:35.070896Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2708 sessionId:  describe result for acl check
2025-10-10T14:38:35.070946Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:35.071167Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:35.071179Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:35.071186Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602498700148940:4058] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:35.071785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602498700148940:4058] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:35.075789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602498700148940:4058] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:35.079568Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602498700148940:4058] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:35.079584Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602498700148940:4058] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:35.079588Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602498700148940:4058] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:35.079596Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2708 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:35.088096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:35.088639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:35.088835Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:35.088850Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:35.088862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:35.088914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:35.088962Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602497917910266:9459]
2025-10-10T14:38:35.089642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:35.089978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:35.090025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:35.090382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:35.090443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:35.090449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:35.090450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:35.090451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:35.090453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:35.090454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:35.090455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:35.090457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:35.090458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:35.090459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:35.090461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:35.090462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:35.090463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:35.090469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:35.090483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:35.090487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:35.090491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:35.090495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:35.090499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:35.090504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:35.090507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:35.090511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:35.090515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:35.090518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:35.090522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:35.090525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:35.090534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:35.090542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:35.090549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:35.090553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:35.090558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:35.090562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:35.090566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:35.090571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:35.090575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:35.090580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:35.090584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:35.090588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:35.090593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:35.090598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:35.090602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:35.090607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:35.090612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:35.090617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:35.090622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:35.090633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:35.090637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:35.090642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:35.090651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:35.090657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:35.090662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:35.090672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:35.090711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:35.093398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:35.094034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:35.094047Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:35.094049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:35.094053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:35.094058Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2707 [2:7559602497917910266:9459]
2025-10-10T14:38:35.094072Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:35.094088Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:35.094091Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:35.094094Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:35.094097Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:35.094113Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:35.094127Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:35.094134Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:35.094198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:35.094208Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:35.094210Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:35.094212Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:35.094286Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:35.094293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:35.094303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:35.094315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:35.094334Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:35.094358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602498700149115:4058], now have 1 active actors on pipe
2025-10-10T14:38:35.094367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602498700148907:2438], now have 1 active actors on pipe
2025-10-10T14:38:35.094375Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602497917910261:9459]
2025-10-10T14:38:35.094381Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602497917910261:9459]
2025-10-10T14:38:35.094383Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602497917910261:9459]
2025-10-10T14:38:35.094398Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:35.094417Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:35.094419Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:35.094422Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:35.094423Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:35.094438Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:35.094442Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:35.094463Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602497917910261:9459]
2025-10-10T14:38:35.094436Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2707
2025-10-10T14:38:35.094470Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:35.094472Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:35.094455Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2707
2025-10-10T14:38:35.094492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:35.094501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:35.094557Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6f367ab2-75240a44-73bed374-9402f5ee_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:35.094570Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:35.094574Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:35.094576Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:35.094588Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:35.094605Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:35.094627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:35.094927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:35.094939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:35.094959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:35.095078Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2708 partition: 0 MaxSeqNo: 40 sessionId: src_id|6f367ab2-75240a44-73bed374-9402f5ee_0
2025-10-10T14:38:35.095490Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b35caae8-9cec2265-9377167f-83be5267_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|6f367ab2-75240a44-73bed374-9402f5ee_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:35.098337Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6f367ab2-75240a44-73bed374-9402f5ee_0] Write session: try to update token
2025-10-10T14:38:35.098355Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6f367ab2-75240a44-73bed374-9402f5ee_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:35.113272Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2708 sessionId: src_id|6f367ab2-75240a44-73bed374-9402f5ee_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:35.116135Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:35.116356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:35.116377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:35.116422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:38:35.116497Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:38:35.118481Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:35.118499Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:35.118503Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:35.118505Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:35.118516Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602497917910261:9459]
2025-10-10T14:38:35.118521Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602497917910261:9459]
2025-10-10T14:38:35.118525Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602497917910261:9459]
2025-10-10T14:38:35.118568Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:35.118577Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:35.118578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:35.118585Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:35.118586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:35.118588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:35.118744Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:35.162342Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602498700149234:3900]
2025-10-10T14:38:35.162651Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 pipe creation result: OK TabletId: 72075186224037892 Generation: 2707, pipe: [1:7559602498700149234:3900]
2025-10-10T14:38:35.235314Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:35.244381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:35.244416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:35.244608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:35.244678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:35.244744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:35.244815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:35.244869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:35.244882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:35.244955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:35.245024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:35.245097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:35.245169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:35.245211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:35.245220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:35.245288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:35.245375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:35.245444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:35.245516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:35.245565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:35.245573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:35.245642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:35.245708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:35.245844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:35.245927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:35.245975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:35.245986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:35.246058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:35.246123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:35.246193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:35.246260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:35.246304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:35.246312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:35.246385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:35.246449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:35.246515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:35.246578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:35.246626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:35.246637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:35.246704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:35.246767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:35.246835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:35.246905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:35.246954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:35.246960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:35.247029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:35.247089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:35.247161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:35.247229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:35.247276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:35.247283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:35.247350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:35.247414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:35.247480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:35.247550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:35.247597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:35.247605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:35.247675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:35.247742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:35.247807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:35.247880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:35.247931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:35.247939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:35.248010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602498700149234:3900], now have 1 active actors on pipe
2025-10-10T14:38:35.248262Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:35.248274Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 6 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602498700149234:3900]
2025-10-10T14:38:35.248279Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:35.248294Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:35.248327Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2708 reason: error at write: Disconnected sessionId: src_id|6f367ab2-75240a44-73bed374-9402f5ee_0
2025-10-10T14:38:35.248565Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2708 sessionId: src_id|6f367ab2-75240a44-73bed374-9402f5ee_0 is DEAD
2025-10-10T14:38:35.248733Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f367ab2-75240a44-73bed374-9402f5ee_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:35.248753Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f367ab2-75240a44-73bed374-9402f5ee_0] Write session will restart in 0.006696s
2025-10-10T14:38:35.248781Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f367ab2-75240a44-73bed374-9402f5ee_0] Write session: Do CDS request
2025-10-10T14:38:35.248787Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f367ab2-75240a44-73bed374-9402f5ee_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:35.249454Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:35.256964Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6f367ab2-75240a44-73bed374-9402f5ee_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:35.257056Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:35.257076Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2709
2025-10-10T14:38:35.257228Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2709 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:35.257280Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2709 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:35.257291Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2709 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:35.257296Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:35.257850Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2709 sessionId:  describe result for acl check
2025-10-10T14:38:35.257891Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:35.257893Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:35.257895Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:35.257915Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602498700149251:4077] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:35.258403Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602498700149251:4077] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:35.264946Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602498700149251:4077] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:35.269659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602498700149251:4077] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:35.269687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602498700149251:4077] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:35.269691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602498700149251:4077] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:35.269701Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2709 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:35.279707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:35.282886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:35.283320Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:35.283333Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:35.283347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:35.283414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:35.283461Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602497917910566:9456]
2025-10-10T14:38:35.284162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:35.284499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:35.284546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:35.284904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:35.284970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:35.284978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:35.284979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:35.284980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:35.284981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:35.284983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:35.284984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:35.284985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:35.284987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:35.284988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:35.284989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:35.284990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:35.284991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:35.284997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:35.285012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:35.285016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:35.285020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:35.285024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:35.285028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:35.285032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:35.285036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:35.285041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:35.285045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:35.285049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:35.285054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:35.285058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:35.285067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:35.285076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:35.285084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:35.285091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:35.285098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:35.285104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:35.285109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:35.285115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:35.285121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:35.285126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:35.285139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:35.285144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:35.285149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:35.285155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:35.285160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:35.285165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:35.285171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:35.285177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:35.285182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:35.285188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:35.285193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:35.285199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:35.285205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:35.285217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:35.285223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:35.285228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:35.285274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:35.288328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:35.288663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:35.288675Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:35.288678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:35.288682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:35.288690Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2708 [2:7559602497917910566:9456]
2025-10-10T14:38:35.288706Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:35.288740Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:35.288748Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:35.288752Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:35.288755Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:35.288775Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:35.288788Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:35.288797Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:35.288864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:35.288871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:35.288874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:35.288877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:35.288948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:35.288957Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:35.288969Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:35.288988Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:35.289080Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2708
2025-10-10T14:38:35.289126Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2708
2025-10-10T14:38:35.289011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:35.289038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602498700149405:4077], now have 1 active actors on pipe
2025-10-10T14:38:35.289048Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602497917910561:9456]
2025-10-10T14:38:35.289051Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602497917910561:9456]
2025-10-10T14:38:35.289054Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602497917910561:9456]
2025-10-10T14:38:35.289068Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:35.289078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602498700149236:2438], now have 1 active actors on pipe
2025-10-10T14:38:35.289088Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:35.289091Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:35.289094Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:35.289096Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:35.289116Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:35.289120Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:35.289149Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602497917910561:9456]
2025-10-10T14:38:35.289152Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:35.289154Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:35.289175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:35.289180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:35.289232Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f26b33ed-226cbb7a-dbbd0517-15bea18c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:35.289249Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:35.289253Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:35.289256Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:35.289271Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:35.289282Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:35.289302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:35.289772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:35.289791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:35.289812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:35.291268Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2709 partition: 0 MaxSeqNo: 40 sessionId: src_id|f26b33ed-226cbb7a-dbbd0517-15bea18c_0
2025-10-10T14:38:35.291731Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f367ab2-75240a44-73bed374-9402f5ee_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|f26b33ed-226cbb7a-dbbd0517-15bea18c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:35.294804Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f26b33ed-226cbb7a-dbbd0517-15bea18c_0] Write session: try to update token
2025-10-10T14:38:35.294828Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f26b33ed-226cbb7a-dbbd0517-15bea18c_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:35.309955Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2709 sessionId: src_id|f26b33ed-226cbb7a-dbbd0517-15bea18c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:35.311156Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:35.311183Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:35.311186Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:35.311188Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:35.311199Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602497917910561:9456]
2025-10-10T14:38:35.311204Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602497917910561:9456]
2025-10-10T14:38:35.311208Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602497917910561:9456]
2025-10-10T14:38:35.311255Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:35.311265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:35.311274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:35.311276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:35.311277Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:35.311282Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:35.311433Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:35.312789Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:35.348698Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602498700149564:3900]
2025-10-10T14:38:35.349041Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 pipe creation result: OK TabletId: 72075186224037892 Generation: 2708, pipe: [1:7559602498700149564:3900]
2025-10-10T14:38:35.435395Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:35.436523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:35.436546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:35.436597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602498700149564:3900], now have 1 active actors on pipe
2025-10-10T14:38:35.436890Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:35.436909Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:35.436913Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:35.436964Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 7 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602498700149564:3900]
2025-10-10T14:38:35.436996Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2709 reason: error at write: Disconnected sessionId: src_id|f26b33ed-226cbb7a-dbbd0517-15bea18c_0
2025-10-10T14:38:35.437199Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:35.437243Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2709 sessionId: src_id|f26b33ed-226cbb7a-dbbd0517-15bea18c_0 is DEAD
2025-10-10T14:38:35.437444Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f26b33ed-226cbb7a-dbbd0517-15bea18c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:35.437457Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f26b33ed-226cbb7a-dbbd0517-15bea18c_0] Write session will restart in 0.008188s
2025-10-10T14:38:35.437483Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f26b33ed-226cbb7a-dbbd0517-15bea18c_0] Write session: Do CDS request
2025-10-10T14:38:35.437500Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f26b33ed-226cbb7a-dbbd0517-15bea18c_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:35.447004Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f26b33ed-226cbb7a-dbbd0517-15bea18c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:35.447116Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:35.447134Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2710
2025-10-10T14:38:35.447298Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2710 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:35.447353Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2710 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:35.447366Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2710 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:35.447370Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:35.447893Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2710 sessionId:  describe result for acl check
2025-10-10T14:38:35.447937Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:35.447940Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:35.447942Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:35.447949Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602498700149599:4093] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:35.448525Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602498700149599:4093] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:35.450917Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602498700149599:4093] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:35.453323Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602498700149599:4093] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:35.453355Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602498700149599:4093] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:35.453359Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602498700149599:4093] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:35.453369Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2710 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:35.471721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:35.477826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:35.478155Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:35.478168Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:35.478181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:35.478250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:35.478304Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602497917910877:9445]
2025-10-10T14:38:35.479014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:35.479362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:35.479413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:35.479770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:35.479836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:35.479846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:35.479848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:35.479849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:35.479851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:35.479852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:35.479854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:35.479856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:35.479857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:35.479859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:35.479860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:35.479862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:35.479863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:35.479869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:35.479883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:35.479886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:35.479891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:35.479894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:35.479899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:35.479903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:35.479908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:35.479912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:35.479918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:35.479922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:35.479926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:35.479930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:35.479939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:35.479949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:35.479956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:35.479963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:35.479968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:35.479975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:35.479981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:35.479987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:35.479992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:35.480000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:35.480005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:35.480011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:35.480017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:35.480021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:35.480026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:35.480031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:35.480036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:35.480042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:35.480047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:35.480053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:35.480058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:35.480064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:35.480068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:35.480074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:35.480079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:35.480085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:35.480130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:35.482810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:35.483144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:35.483169Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:35.483171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:35.483175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:35.483182Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2709 [2:7559602497917910877:9445]
2025-10-10T14:38:35.483196Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:35.483220Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:35.483229Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:35.483233Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:35.483236Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:35.483254Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:35.483262Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:35.483270Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:35.483351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:35.483358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:35.483360Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:35.483363Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:35.483440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:35.483448Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:35.483461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:35.483474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:35.483499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:35.483526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602498700149640:4093], now have 1 active actors on pipe
2025-10-10T14:38:35.483534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602498700149566:2438], now have 1 active actors on pipe
2025-10-10T14:38:35.483542Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602497917910872:9445]
2025-10-10T14:38:35.483545Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602497917910872:9445]
2025-10-10T14:38:35.483548Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602497917910872:9445]
2025-10-10T14:38:35.483562Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:35.483582Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:35.483592Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:35.483595Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:35.483563Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2709
2025-10-10T14:38:35.483597Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:35.483602Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:35.483606Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:35.483632Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602497917910872:9445]
2025-10-10T14:38:35.483641Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:35.483659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:35.483668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:35.483671Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:35.483664Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2709
2025-10-10T14:38:35.483711Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8a6b94e7-3759ae38-a7434156-4475e5c5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:35.483723Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:35.483726Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:35.483729Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:35.483741Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:35.483751Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:35.483779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:35.483973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:35.483981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:35.483995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:35.484124Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2710 partition: 0 MaxSeqNo: 40 sessionId: src_id|8a6b94e7-3759ae38-a7434156-4475e5c5_0
2025-10-10T14:38:35.484567Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f26b33ed-226cbb7a-dbbd0517-15bea18c_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|8a6b94e7-3759ae38-a7434156-4475e5c5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:35.487396Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8a6b94e7-3759ae38-a7434156-4475e5c5_0] Write session: try to update token
2025-10-10T14:38:35.487418Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8a6b94e7-3759ae38-a7434156-4475e5c5_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:35.504520Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:35.504547Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:35.504550Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:35.504552Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:35.504564Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602497917910872:9445]
2025-10-10T14:38:35.504569Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602497917910872:9445]
2025-10-10T14:38:35.504574Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602497917910872:9445]
2025-10-10T14:38:35.504627Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:35.504631Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:35.504635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:35.504638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:35.504639Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:35.504645Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:35.504784Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:35.505032Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2710 sessionId: src_id|8a6b94e7-3759ae38-a7434156-4475e5c5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:35.507661Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:35.537137Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602498700149907:3900]
2025-10-10T14:38:35.537510Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 pipe creation result: OK TabletId: 72075186224037892 Generation: 2709, pipe: [1:7559602498700149907:3900]
2025-10-10T14:38:35.626110Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:35.627070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:35.627092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:35.627146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602498700149907:3900], now have 1 active actors on pipe
2025-10-10T14:38:35.627668Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:35.628168Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a6b94e7-3759ae38-a7434156-4475e5c5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:35.628179Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a6b94e7-3759ae38-a7434156-4475e5c5_0] Write session will restart in 0.007982s
2025-10-10T14:38:35.628206Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a6b94e7-3759ae38-a7434156-4475e5c5_0] Write session: Do CDS request
2025-10-10T14:38:35.628215Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a6b94e7-3759ae38-a7434156-4475e5c5_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:35.627457Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:35.627477Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:35.627569Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2710 reason: error at write: Disconnected sessionId: src_id|8a6b94e7-3759ae38-a7434156-4475e5c5_0
2025-10-10T14:38:35.627762Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2710 sessionId: src_id|8a6b94e7-3759ae38-a7434156-4475e5c5_0 is DEAD
2025-10-10T14:38:35.627948Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:35.627993Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 8 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602498700149907:3900]
2025-10-10T14:38:35.639964Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8a6b94e7-3759ae38-a7434156-4475e5c5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:35.641419Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:35.641440Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2711
2025-10-10T14:38:35.641614Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2711 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:35.641658Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2711 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:35.641665Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2711 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:35.641669Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:35.642085Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2711 sessionId:  describe result for acl check
2025-10-10T14:38:35.642116Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:35.642118Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:35.642120Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:35.642126Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602498700149925:4110] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:35.642602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602498700149925:4110] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:35.644984Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602498700149925:4110] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:35.648837Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602498700149925:4110] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:35.648856Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602498700149925:4110] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:35.648859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602498700149925:4110] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:35.648868Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2711 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:35.659216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:35.662860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:35.663203Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:35.663219Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:35.663237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:35.663328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:35.663391Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602497917911177:9441]
2025-10-10T14:38:35.664033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:35.664430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:35.664514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:35.664950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:35.665018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:35.665025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:35.665027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:35.665028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:35.665030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:35.665031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:35.665032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:35.665034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:35.665036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:35.665037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:35.665039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:35.665040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:35.665042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:35.665049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:35.665078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:35.665083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:35.665088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:35.665092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:35.665097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:35.665102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:35.665107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:35.665112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:35.665116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:35.665121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:35.665125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:35.665130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:35.665139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:35.665149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:35.665163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:35.665169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:35.665176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:35.665182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:35.665188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:35.665195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:35.665200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:35.665207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:35.665212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:35.665231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:35.665242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:35.665247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:35.665253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:35.665264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:35.665271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:35.665282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:35.665289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:35.665300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:35.665306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:35.665312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:35.665321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:35.665345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:35.665356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:35.665363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:35.665417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:35.668502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:35.669274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:35.669286Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:35.669289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:35.669293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:35.669301Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2710 [2:7559602497917911177:9441]
2025-10-10T14:38:35.669315Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:35.669358Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:35.669365Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:35.669368Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:35.669371Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:35.669392Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:35.669404Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:35.669412Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:35.669483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:35.669490Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:35.669492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:35.669495Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:35.669571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:35.669578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:35.669591Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:35.669608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:35.669625Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:35.669653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602498700150063:4110], now have 1 active actors on pipe
2025-10-10T14:38:35.669661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602498700149909:2438], now have 1 active actors on pipe
2025-10-10T14:38:35.669670Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602497917911172:9441]
2025-10-10T14:38:35.669672Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602497917911172:9441]
2025-10-10T14:38:35.669674Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602497917911172:9441]
2025-10-10T14:38:35.669683Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:35.669699Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:35.669704Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:35.669707Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:35.669709Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:35.669716Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:35.669719Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:35.669767Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602497917911172:9441]
2025-10-10T14:38:35.669770Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:35.669772Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:35.669788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:35.669797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:35.669734Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2710
2025-10-10T14:38:35.669783Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2710
2025-10-10T14:38:35.669854Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|77ec1ce2-c5f22bd-6a41adfd-445fca0b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:35.669872Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:35.669877Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:35.669879Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:35.669906Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:35.669922Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:35.669945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:35.670091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:35.670100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:35.670117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:35.670194Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2711 partition: 0 MaxSeqNo: 40 sessionId: src_id|77ec1ce2-c5f22bd-6a41adfd-445fca0b_0
2025-10-10T14:38:35.670644Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a6b94e7-3759ae38-a7434156-4475e5c5_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|77ec1ce2-c5f22bd-6a41adfd-445fca0b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:35.673583Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|77ec1ce2-c5f22bd-6a41adfd-445fca0b_0] Write session: try to update token
2025-10-10T14:38:35.673605Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|77ec1ce2-c5f22bd-6a41adfd-445fca0b_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:35.690892Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:35.690910Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:35.690915Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:35.690917Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:35.690929Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602497917911172:9441]
2025-10-10T14:38:35.690935Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602497917911172:9441]
2025-10-10T14:38:35.690939Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602497917911172:9441]
2025-10-10T14:38:35.690992Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:35.691000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:35.691003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:35.691005Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:35.691012Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:35.691018Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:35.691149Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:35.692893Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2711 sessionId: src_id|77ec1ce2-c5f22bd-6a41adfd-445fca0b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:35.695734Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:35.727580Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602498700150239:3900]
2025-10-10T14:38:35.727946Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 pipe creation result: OK TabletId: 72075186224037892 Generation: 2710, pipe: [1:7559602498700150239:3900]
2025-10-10T14:38:35.817869Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:35.818492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:35.818503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:35.818551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602498700150239:3900], now have 1 active actors on pipe
2025-10-10T14:38:35.818841Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:35.821429Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:38:35.821521Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2711 reason: status is not ok: tablet will be restarted right now sessionId: src_id|77ec1ce2-c5f22bd-6a41adfd-445fca0b_0
2025-10-10T14:38:35.821722Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2711 sessionId: src_id|77ec1ce2-c5f22bd-6a41adfd-445fca0b_0 is DEAD
2025-10-10T14:38:35.821857Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:35.821919Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 9 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602498700150239:3900]
2025-10-10T14:38:35.829462Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77ec1ce2-c5f22bd-6a41adfd-445fca0b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:38:35.829480Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77ec1ce2-c5f22bd-6a41adfd-445fca0b_0] Write session will restart in 0.007538s
2025-10-10T14:38:35.829508Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77ec1ce2-c5f22bd-6a41adfd-445fca0b_0] Write session: Do CDS request
2025-10-10T14:38:35.829514Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77ec1ce2-c5f22bd-6a41adfd-445fca0b_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:35.838126Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|77ec1ce2-c5f22bd-6a41adfd-445fca0b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:35.838159Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:35.838178Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2712
2025-10-10T14:38:35.838858Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2712 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:35.838902Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2712 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:35.838921Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2712 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:35.838931Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:35.839441Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2712 sessionId:  describe result for acl check
2025-10-10T14:38:35.839480Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:35.839488Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:35.839490Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:35.839498Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602498700150366:4158] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:35.840121Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602498700150366:4158] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:35.846835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602498700150366:4158] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:35.853447Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602498700150366:4158] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:35.853471Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602498700150366:4158] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:35.853475Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602498700150366:4158] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:35.853486Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2712 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:35.859683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:35.862394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:35.862654Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:35.862660Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:35.862673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:35.862737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:35.862779Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602497917911517:9432]
2025-10-10T14:38:35.863482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:35.863869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:35.863934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:35.864308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:35.864369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:35.864375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:35.864376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:35.864378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:35.864379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:35.864380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:35.864382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:35.864383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:35.864384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:35.864385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:35.864386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:35.864387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:35.864389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:35.864395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:35.864408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:35.864412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:35.864416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:35.864419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:35.864423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:35.864426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:35.864430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:35.864434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:35.864438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:35.864441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:35.864445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:35.864448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:35.864457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:35.864465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:35.864471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:35.864477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:35.864481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:35.864486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:35.864490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:35.864495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:35.864499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:35.864504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:35.864509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:35.864513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:35.864521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:35.864526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:35.864530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:35.864535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:35.864540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:35.864544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:35.864549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:35.864554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:35.864558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:35.864563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:35.864567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:35.864571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:35.864575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:35.864580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:35.864632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:35.867590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:35.867923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:35.867938Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:35.867941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:35.867947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:35.867955Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2711 [2:7559602497917911517:9432]
2025-10-10T14:38:35.867971Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:35.867996Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:35.868004Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:35.868008Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:35.868011Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:35.868030Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:35.868038Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:35.868052Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:35.868124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:35.868151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:35.868154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:35.868157Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:35.868358Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2711
2025-10-10T14:38:35.868422Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2711
2025-10-10T14:38:35.868632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:35.868643Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:35.868658Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:35.868672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:35.868695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:35.868720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602498700150541:4158], now have 1 active actors on pipe
2025-10-10T14:38:35.868724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602498700150264:2438], now have 1 active actors on pipe
2025-10-10T14:38:35.868741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:35.868751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:35.868775Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602497917911512:9432]
2025-10-10T14:38:35.868782Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602497917911512:9432]
2025-10-10T14:38:35.868785Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602497917911512:9432]
2025-10-10T14:38:35.868799Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:35.868815Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:35.868818Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:35.868819Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:35.868821Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:35.868837Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:35.868841Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:35.868861Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e3cdaa5b-9161932f-89749bb8-8345a501_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:35.868876Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:35.868880Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:35.868883Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:35.868895Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:35.868907Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:35.868948Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602497917911512:9432]
2025-10-10T14:38:35.868963Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:35.868981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:35.868984Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:35.869168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:35.869177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:35.869197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:35.869835Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77ec1ce2-c5f22bd-6a41adfd-445fca0b_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|e3cdaa5b-9161932f-89749bb8-8345a501_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:35.869378Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2712 partition: 0 MaxSeqNo: 40 sessionId: src_id|e3cdaa5b-9161932f-89749bb8-8345a501_0
2025-10-10T14:38:35.872695Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e3cdaa5b-9161932f-89749bb8-8345a501_0] Write session: try to update token
2025-10-10T14:38:35.872715Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e3cdaa5b-9161932f-89749bb8-8345a501_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:35.882328Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:38:35.882351Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:35.882363Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602497917911512:9432]
2025-10-10T14:38:35.882422Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:38:35.882655Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:38:35.882807Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:35.882959Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:35.883116Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:35.883310Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:38:35.883362Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:38:35.883476Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:38:35.889650Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2712 sessionId: src_id|e3cdaa5b-9161932f-89749bb8-8345a501_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:35.892803Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:35.893063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:35.893089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:35.893143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:38:35.893269Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:38:35.902046Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:35.902067Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:35.902072Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:35.902074Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:35.902086Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602497917911512:9432]
2025-10-10T14:38:35.902090Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602497917911512:9432]
2025-10-10T14:38:35.902094Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602497917911512:9432]
2025-10-10T14:38:35.902146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:35.902161Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:35.902163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:35.902166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:35.902167Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:35.902172Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:35.902308Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:35.922324Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602498700150605:3900]
2025-10-10T14:38:35.922631Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 pipe creation result: OK TabletId: 72075186224037892 Generation: 2711, pipe: [1:7559602498700150605:3900]
2025-10-10T14:38:36.026843Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:36.036844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:36.036880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:36.037079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:36.037156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:36.037228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:36.037301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:36.037395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:36.037410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:36.037485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:36.037550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:36.037617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:36.037694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:36.037746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:36.037750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:36.037821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:36.037900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:36.037968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:36.038034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:36.038079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:36.038088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:36.038159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:36.038229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:36.038309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:36.038385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:36.038431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:36.038439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:36.038508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:36.038577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:36.038643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:36.038710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:36.038755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:36.038762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:36.038857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:36.038923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:36.038989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:36.039055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:36.039101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:36.039108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:36.039177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:36.039243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:36.039313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:36.039382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:36.039429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:36.039439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:36.039508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:36.039570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:36.039638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:36.039710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:36.039756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:36.039765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:36.039833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:36.039900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:36.039967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:36.040033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:36.040081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:36.040089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:36.040156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:36.040783Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:36.040856Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:36.040863Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:36.040903Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2712 reason: error at write: Disconnected sessionId: src_id|e3cdaa5b-9161932f-89749bb8-8345a501_0
2025-10-10T14:38:36.041008Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 10 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602498700150605:3900]
2025-10-10T14:38:36.041119Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2712 sessionId: src_id|e3cdaa5b-9161932f-89749bb8-8345a501_0 is DEAD
2025-10-10T14:38:36.041349Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e3cdaa5b-9161932f-89749bb8-8345a501_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:36.040223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:36.041364Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e3cdaa5b-9161932f-89749bb8-8345a501_0] Write session will restart in 0.005116s
2025-10-10T14:38:36.040292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:36.040353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:36.040396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:36.040399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:36.040466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602498700150605:3900], now have 1 active actors on pipe
2025-10-10T14:38:36.041401Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e3cdaa5b-9161932f-89749bb8-8345a501_0] Write session: Do CDS request
2025-10-10T14:38:36.041413Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e3cdaa5b-9161932f-89749bb8-8345a501_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:36.041962Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:36.047968Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e3cdaa5b-9161932f-89749bb8-8345a501_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:36.048252Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:36.048270Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2713
2025-10-10T14:38:36.048450Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2713 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:36.048523Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2713 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:36.048535Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2713 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:36.048542Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:36.049080Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2713 sessionId:  describe result for acl check
2025-10-10T14:38:36.049117Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:36.049124Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:36.049126Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:36.049132Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602502995117916:5009] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:36.049710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602502995117916:5009] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:36.052143Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602502995117916:5009] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:36.056378Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602502995117916:5009] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:36.056394Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602502995117916:5009] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:36.056398Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602502995117916:5009] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:36.056408Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2713 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:36.070619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:36.073941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:36.074272Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:36.074288Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:36.074302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:36.074363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:36.074411Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602502212879116:9421]
2025-10-10T14:38:36.075144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:36.075436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:36.075483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:36.075844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:36.075908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:36.075914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:36.075916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:36.075917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:36.075918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:36.075920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:36.075921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:36.075923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:36.075924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:36.075926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:36.075927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:36.075929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:36.075930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:36.075937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:36.075952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:36.075957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:36.075962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:36.075967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:36.075972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:36.075976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:36.075979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:36.075984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:36.075988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:36.075993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:36.075997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:36.076002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:36.076011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:36.076020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:36.076026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:36.076033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:36.076038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:36.076044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:36.076051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:36.076057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:36.076066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:36.076072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:36.076077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:36.076083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:36.076094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:36.076099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:36.076104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:36.076110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:36.076119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:36.076126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:36.076135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:36.076141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:36.076146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:36.076156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:36.076161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:36.076168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:36.076174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:36.076184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:36.076230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:36.078893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:36.079252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:36.079266Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:36.079269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:36.079274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:36.079282Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2712 [2:7559602502212879116:9421]
2025-10-10T14:38:36.079299Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:36.079321Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:36.079324Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:36.079329Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:36.079332Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:36.079352Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:36.079362Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:36.079377Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:36.079448Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:36.079456Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:36.079459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:36.079462Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:36.079539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:36.079548Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:36.079561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:36.079580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:36.079604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:36.079633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602502995118011:5009], now have 1 active actors on pipe
2025-10-10T14:38:36.079645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602502995117904:2438], now have 1 active actors on pipe
2025-10-10T14:38:36.079655Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602502212879111:9421]
2025-10-10T14:38:36.079662Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602502212879111:9421]
2025-10-10T14:38:36.079664Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602502212879111:9421]
2025-10-10T14:38:36.079682Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:36.079704Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:36.079716Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:36.079720Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:36.079723Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:36.079724Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:36.079728Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:36.079761Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602502212879111:9421]
2025-10-10T14:38:36.079770Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:36.079770Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:36.079750Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2712
2025-10-10T14:38:36.079807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:36.079818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:36.079816Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2712
2025-10-10T14:38:36.079859Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e8f25042-d5571df4-76e58b53-1e7226e9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:36.079872Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:36.079877Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:36.079880Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:36.079891Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:36.079905Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:36.079922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:36.080085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:36.080094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:36.080111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:36.080184Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2713 partition: 0 MaxSeqNo: 40 sessionId: src_id|e8f25042-d5571df4-76e58b53-1e7226e9_0
2025-10-10T14:38:36.080645Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e3cdaa5b-9161932f-89749bb8-8345a501_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|e8f25042-d5571df4-76e58b53-1e7226e9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:36.083879Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e8f25042-d5571df4-76e58b53-1e7226e9_0] Write session: try to update token
2025-10-10T14:38:36.083903Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e8f25042-d5571df4-76e58b53-1e7226e9_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:36.100399Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:36.100419Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:36.100423Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:36.100425Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:36.100434Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602502212879111:9421]
2025-10-10T14:38:36.100440Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602502212879111:9421]
2025-10-10T14:38:36.100445Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602502212879111:9421]
2025-10-10T14:38:36.100505Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:36.100512Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:36.100518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:36.100518Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:36.100520Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:36.100523Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:36.100677Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:36.101326Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2713 sessionId: src_id|e8f25042-d5571df4-76e58b53-1e7226e9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:36.104172Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:36.140765Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602502995118235:3900]
2025-10-10T14:38:36.141130Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 pipe creation result: OK TabletId: 72075186224037892 Generation: 2712, pipe: [1:7559602502995118235:3900]
2025-10-10T14:38:36.223570Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:36.224315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:36.224328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:36.224379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602502995118235:3900], now have 1 active actors on pipe
2025-10-10T14:38:36.225198Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e8f25042-d5571df4-76e58b53-1e7226e9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:36.225210Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e8f25042-d5571df4-76e58b53-1e7226e9_0] Write session will restart in 0.006490s
2025-10-10T14:38:36.224714Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:36.224731Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:36.225236Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e8f25042-d5571df4-76e58b53-1e7226e9_0] Write session: Do CDS request
2025-10-10T14:38:36.224794Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2713 reason: error at write: Disconnected sessionId: src_id|e8f25042-d5571df4-76e58b53-1e7226e9_0
2025-10-10T14:38:36.225000Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2713 sessionId: src_id|e8f25042-d5571df4-76e58b53-1e7226e9_0 is DEAD
2025-10-10T14:38:36.225244Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e8f25042-d5571df4-76e58b53-1e7226e9_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:36.225138Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:36.225177Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 11 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602502995118235:3900]
2025-10-10T14:38:36.224681Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:36.232974Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e8f25042-d5571df4-76e58b53-1e7226e9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:36.233152Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:36.233173Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2714
2025-10-10T14:38:36.233375Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2714 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:36.233429Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2714 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:36.233445Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2714 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:36.233455Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:36.234446Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2714 sessionId:  describe result for acl check
2025-10-10T14:38:36.234488Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:36.234490Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:36.234492Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:36.234498Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602502995118253:4200] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:36.235103Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602502995118253:4200] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:36.240043Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602502995118253:4200] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:36.250437Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602502995118253:4200] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:36.250457Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602502995118253:4200] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:36.250461Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602502995118253:4200] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:36.250470Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2714 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:36.258362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:36.261258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:36.261548Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:36.261563Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:36.261578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:36.261653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:36.261705Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602502212879421:9414]
2025-10-10T14:38:36.262391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:36.262739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:36.262803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:36.263211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:36.263294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:36.263301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:36.263302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:36.263304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:36.263305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:36.263306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:36.263307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:36.263308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:36.263310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:36.263311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:36.263312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:36.263314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:36.263315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:36.263322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:36.263336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:36.263341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:36.263345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:36.263349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:36.263354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:36.263358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:36.263362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:36.263366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:36.263371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:36.263375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:36.263379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:36.263383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:36.263392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:36.263402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:36.263409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:36.263415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:36.263420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:36.263426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:36.263430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:36.263436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:36.263441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:36.263447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:36.263452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:36.263466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:36.263471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:36.263477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:36.263482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:36.263488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:36.263493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:36.263499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:36.263503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:36.263509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:36.263514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:36.263519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:36.263540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:36.263546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:36.263551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:36.263557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:36.263601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:36.266379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:36.267116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:36.267123Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:36.267126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:36.267130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:36.267136Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2713 [2:7559602502212879421:9414]
2025-10-10T14:38:36.267152Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:36.267172Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:36.267176Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:36.267179Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:36.267181Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:36.267200Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:36.267209Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:36.267219Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:36.267288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:36.267290Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:36.267292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:36.267295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:36.267379Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:36.267383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:36.267396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:36.267408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:36.267426Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:36.267449Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602502212879416:9414]
2025-10-10T14:38:36.267451Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602502212879416:9414]
2025-10-10T14:38:36.267454Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602502212879416:9414]
2025-10-10T14:38:36.267465Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:36.267475Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:36.267478Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:36.267481Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:36.267481Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:36.267498Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:36.267502Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:36.267515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602502995118432:4200], now have 1 active actors on pipe
2025-10-10T14:38:36.267519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602502995118238:2438], now have 1 active actors on pipe
2025-10-10T14:38:36.267543Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602502212879416:9414]
2025-10-10T14:38:36.267556Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:36.267569Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:36.267870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:36.267878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:36.267914Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2a94ce9a-d475bf65-7dcb261a-55c9c0c0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:36.267924Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:36.267930Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:36.267941Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:36.267955Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:36.267968Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:36.267989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:36.268206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:36.268215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:36.268232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:36.268772Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e8f25042-d5571df4-76e58b53-1e7226e9_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|2a94ce9a-d475bf65-7dcb261a-55c9c0c0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:36.267600Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2713
2025-10-10T14:38:36.267610Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2713
2025-10-10T14:38:36.268356Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2714 partition: 0 MaxSeqNo: 40 sessionId: src_id|2a94ce9a-d475bf65-7dcb261a-55c9c0c0_0
2025-10-10T14:38:36.271561Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2a94ce9a-d475bf65-7dcb261a-55c9c0c0_0] Write session: try to update token
2025-10-10T14:38:36.271578Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2a94ce9a-d475bf65-7dcb261a-55c9c0c0_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:36.288010Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:36.288030Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:36.288034Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:36.288037Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:36.288048Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602502212879416:9414]
2025-10-10T14:38:36.288053Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602502212879416:9414]
2025-10-10T14:38:36.288058Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602502212879416:9414]
2025-10-10T14:38:36.288108Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:36.288117Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:36.288126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:36.288127Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:36.288128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:36.288132Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:36.288281Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:36.293979Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2714 sessionId: src_id|2a94ce9a-d475bf65-7dcb261a-55c9c0c0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:36.296980Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:36.325614Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602502995118571:3900]
2025-10-10T14:38:36.326085Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 pipe creation result: OK TabletId: 72075186224037892 Generation: 2713, pipe: [1:7559602502995118571:3900]
2025-10-10T14:38:36.408057Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:36.408713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:36.408723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:36.408773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602502995118571:3900], now have 1 active actors on pipe
2025-10-10T14:38:36.408968Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:36.413079Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:38:36.413218Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2714 reason: status is not ok: tablet will be restarted right now sessionId: src_id|2a94ce9a-d475bf65-7dcb261a-55c9c0c0_0
2025-10-10T14:38:36.413485Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2714 sessionId: src_id|2a94ce9a-d475bf65-7dcb261a-55c9c0c0_0 is DEAD
2025-10-10T14:38:36.413772Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 12 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602502995118571:3900]
2025-10-10T14:38:36.413789Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:36.414180Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a94ce9a-d475bf65-7dcb261a-55c9c0c0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:38:36.414191Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a94ce9a-d475bf65-7dcb261a-55c9c0c0_0] Write session will restart in 0.009068s
2025-10-10T14:38:36.414218Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a94ce9a-d475bf65-7dcb261a-55c9c0c0_0] Write session: Do CDS request
2025-10-10T14:38:36.414225Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a94ce9a-d475bf65-7dcb261a-55c9c0c0_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:36.425785Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2a94ce9a-d475bf65-7dcb261a-55c9c0c0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:36.425951Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:36.425983Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2715
2025-10-10T14:38:36.426107Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2715 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:36.426142Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2715 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:36.426149Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2715 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:36.426153Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:36.426654Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2715 sessionId:  describe result for acl check
2025-10-10T14:38:36.426691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:36.426693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:36.426695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:36.426702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602502995118584:4220] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:36.427273Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602502995118584:4220] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:36.430605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602502995118584:4220] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:36.434048Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602502995118584:4220] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:36.434065Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602502995118584:4220] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:36.434069Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602502995118584:4220] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:36.434079Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2715 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:36.458587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:36.461823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:36.462050Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:36.462054Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:36.462063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:36.462107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:36.462137Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602502212879737:9406]
2025-10-10T14:38:36.462559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:36.462930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:36.462973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:36.463300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:36.463362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:36.463369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:36.463370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:36.463371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:36.463372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:36.463374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:36.463375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:36.463376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:36.463378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:36.463379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:36.463380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:36.463381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:36.463382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:36.463389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:36.463402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:36.463407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:36.463411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:36.463415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:36.463419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:36.463423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:36.463428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:36.463432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:36.463436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:36.463440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:36.463444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:36.463448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:36.463456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:36.463465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:36.463472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:36.463479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:36.463484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:36.463489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:36.463494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:36.463499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:36.463509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:36.463515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:36.463521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:36.463531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:36.463535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:36.463540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:36.463546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:36.463557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:36.463562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:36.463571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:36.463575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:36.463579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:36.463588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:36.463594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:36.463599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:36.463609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:36.463614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:36.463619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:36.463664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:36.466512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:36.467609Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2714
2025-10-10T14:38:36.467661Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2714
2025-10-10T14:38:36.466983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:36.467009Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:36.467012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:36.467016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:36.467023Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2714 [2:7559602502212879737:9406]
2025-10-10T14:38:36.467037Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:36.467057Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:36.467061Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:36.467064Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:36.467067Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:36.467085Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:36.467093Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:36.467102Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:36.467177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:36.467179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:36.467181Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:36.467184Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:36.467260Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:36.467265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:36.467276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:36.467289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:36.467304Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:36.467327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602502995118576:2438], now have 1 active actors on pipe
2025-10-10T14:38:36.467331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602502995118621:4220], now have 1 active actors on pipe
2025-10-10T14:38:36.467338Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602502212879732:9406]
2025-10-10T14:38:36.467340Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602502212879732:9406]
2025-10-10T14:38:36.467342Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602502212879732:9406]
2025-10-10T14:38:36.467355Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:36.467371Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:36.467388Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:36.467392Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:36.467418Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602502212879732:9406]
2025-10-10T14:38:36.467421Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:36.467456Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:36.467459Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:36.467461Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:36.467476Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:36.468194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:36.468204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:36.468246Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|95871de8-10dd3ab7-c7f144a0-dcba8555_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:36.468258Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:36.468264Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:36.468279Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:36.468770Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:36.468795Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:36.468817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:36.472234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:36.472245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:36.472280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:36.478003Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2715 partition: 0 MaxSeqNo: 40 sessionId: src_id|95871de8-10dd3ab7-c7f144a0-dcba8555_0
2025-10-10T14:38:36.480835Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a94ce9a-d475bf65-7dcb261a-55c9c0c0_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|95871de8-10dd3ab7-c7f144a0-dcba8555_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:36.483886Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|95871de8-10dd3ab7-c7f144a0-dcba8555_0] Write session: try to update token
2025-10-10T14:38:36.483914Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|95871de8-10dd3ab7-c7f144a0-dcba8555_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:36.493386Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:36.493403Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:36.493407Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:36.493408Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:36.493420Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602502212879732:9406]
2025-10-10T14:38:36.493425Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602502212879732:9406]
2025-10-10T14:38:36.493429Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602502212879732:9406]
2025-10-10T14:38:36.493486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:36.493488Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:36.493495Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:36.493499Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:36.493501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:36.493503Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:36.493659Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:36.507203Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2715 sessionId: src_id|95871de8-10dd3ab7-c7f144a0-dcba8555_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:36.509812Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:36.512425Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602502995118911:3900]
2025-10-10T14:38:36.512720Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 pipe creation result: OK TabletId: 72075186224037892 Generation: 2714, pipe: [1:7559602502995118911:3900]
2025-10-10T14:38:36.612341Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:36.612932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:36.612946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:36.612967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602502995118911:3900], now have 1 active actors on pipe
2025-10-10T14:38:36.613159Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:36.613233Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:36.613262Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:36.613267Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:36.613310Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 13 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602502995118911:3900]
2025-10-10T14:38:36.613357Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2715 reason: error at write: Disconnected sessionId: src_id|95871de8-10dd3ab7-c7f144a0-dcba8555_0
2025-10-10T14:38:36.613580Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2715 sessionId: src_id|95871de8-10dd3ab7-c7f144a0-dcba8555_0 is DEAD
2025-10-10T14:38:36.613748Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95871de8-10dd3ab7-c7f144a0-dcba8555_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:36.613760Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95871de8-10dd3ab7-c7f144a0-dcba8555_0] Write session will restart in 0.008036s
2025-10-10T14:38:36.613797Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95871de8-10dd3ab7-c7f144a0-dcba8555_0] Write session: Do CDS request
2025-10-10T14:38:36.613807Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95871de8-10dd3ab7-c7f144a0-dcba8555_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:36.623633Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|95871de8-10dd3ab7-c7f144a0-dcba8555_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:36.623936Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:36.623954Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2716
2025-10-10T14:38:36.624097Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2716 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:36.624135Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2716 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:36.624145Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2716 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:36.624150Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:36.624938Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2716 sessionId:  describe result for acl check
2025-10-10T14:38:36.624976Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:36.624981Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:36.624983Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:36.624989Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602502995118993:4264] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:36.625615Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602502995118993:4264] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:36.628113Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602502995118993:4264] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:36.631967Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602502995118993:4264] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:36.631983Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602502995118993:4264] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:36.631986Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602502995118993:4264] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:36.631994Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2716 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:36.637013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:36.639821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:36.640150Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:36.640164Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:36.640212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:36.640301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:36.640346Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602502212880052:9405]
2025-10-10T14:38:36.640974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:36.641259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:36.641299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:36.641631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:36.641696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:36.641702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:36.641704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:36.641705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:36.641706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:36.641707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:36.641708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:36.641710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:36.641711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:36.641713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:36.641714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:36.641716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:36.641717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:36.641723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:36.641736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:36.641740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:36.641745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:36.641748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:36.641752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:36.641757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:36.641761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:36.641765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:36.641770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:36.641774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:36.641778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:36.641782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:36.641791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:36.641800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:36.641809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:36.641817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:36.641822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:36.641830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:36.641834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:36.641840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:36.641844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:36.641851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:36.641860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:36.641865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:36.641870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:36.641892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:36.641896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:36.641901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:36.641906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:36.641916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:36.641924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:36.641929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:36.641943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:36.641948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:36.641952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:36.641957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:36.641962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:36.641967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:36.642010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:36.644502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:36.645216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:36.645231Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:36.645234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:36.645237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:36.645243Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2715 [2:7559602502212880052:9405]
2025-10-10T14:38:36.645257Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:36.645275Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:36.645279Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:36.645283Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:36.645286Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:36.645304Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:36.645314Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:36.645323Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:36.645404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:36.645412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:36.645414Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:36.645417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:36.645488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:36.645496Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:36.645507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:36.645522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:36.645544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:36.645572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602502995118925:2438], now have 1 active actors on pipe
2025-10-10T14:38:36.645582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602502995119160:4264], now have 1 active actors on pipe
2025-10-10T14:38:36.645589Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602502212880042:9405]
2025-10-10T14:38:36.645592Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602502212880042:9405]
2025-10-10T14:38:36.645594Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602502212880042:9405]
2025-10-10T14:38:36.645607Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:36.645622Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:36.645625Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:36.645629Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:36.645632Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:36.645638Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:36.645641Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:36.645680Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2715
2025-10-10T14:38:36.645684Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2715
2025-10-10T14:38:36.645669Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602502212880042:9405]
2025-10-10T14:38:36.645685Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:36.645716Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:36.645780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:36.645794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:36.645838Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a733b52d-a3ab38c5-8337b6b0-e9fa713a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:36.645853Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:36.645863Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:36.645866Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:36.645900Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:36.645918Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:36.645938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:36.646130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:36.646141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:36.646163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:36.646286Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2716 partition: 0 MaxSeqNo: 40 sessionId: src_id|a733b52d-a3ab38c5-8337b6b0-e9fa713a_0
2025-10-10T14:38:36.646720Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95871de8-10dd3ab7-c7f144a0-dcba8555_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|a733b52d-a3ab38c5-8337b6b0-e9fa713a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:36.649550Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a733b52d-a3ab38c5-8337b6b0-e9fa713a_0] Write session: try to update token
2025-10-10T14:38:36.649569Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a733b52d-a3ab38c5-8337b6b0-e9fa713a_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:36.657362Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:38:36.657377Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:36.657389Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602502212880042:9405]
2025-10-10T14:38:36.657445Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:38:36.657446Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:38:36.657638Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:38:36.657789Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:36.657938Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:36.658084Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:36.658281Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:38:36.658327Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:38:36.664512Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2716 sessionId: src_id|a733b52d-a3ab38c5-8337b6b0-e9fa713a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:36.667344Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:36.667565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:36.667586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:36.667630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:38:36.667723Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:38:36.676807Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:36.676829Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:36.676833Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:36.676836Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:36.676849Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602502212880042:9405]
2025-10-10T14:38:36.676854Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602502212880042:9405]
2025-10-10T14:38:36.676858Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602502212880042:9405]
2025-10-10T14:38:36.676916Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:36.676923Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:36.676929Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:36.676929Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:36.676932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:36.676932Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:36.677090Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:36.713686Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602502995119262:3900]
2025-10-10T14:38:36.714152Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 pipe creation result: OK TabletId: 72075186224037892 Generation: 2715, pipe: [1:7559602502995119262:3900]
2025-10-10T14:38:36.793429Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:36.802266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:36.802294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:36.802457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:36.802514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:36.802572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:36.802629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:36.802670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:36.802678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:36.802742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:36.802816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:36.802882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:36.802947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:36.802989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:36.802995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:36.803057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:36.803115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:36.803176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:36.803230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:36.803267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:36.803269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:36.803330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:36.803386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:36.803439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:36.803507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:36.803553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:36.803557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:36.803622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:36.803689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:36.803754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:36.803818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:36.803884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:36.803887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:36.803966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:36.804020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:36.804073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:36.804127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:36.804172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:36.804176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:36.804242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:36.804294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:36.804349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:36.804403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:36.804445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:36.804448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:36.804507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:36.804578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:36.804631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:36.804697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:36.804740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:36.804743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:36.804814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:36.804876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:36.804936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:36.804997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:36.805037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:36.805039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:36.805099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:36.805152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:36.805220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:36.805275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:36.805313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:36.805315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:36.805476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602502995119262:3900], now have 1 active actors on pipe
2025-10-10T14:38:36.805730Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:36.805749Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:36.805778Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:36.805781Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2716 reason: error at write: Disconnected sessionId: src_id|a733b52d-a3ab38c5-8337b6b0-e9fa713a_0
2025-10-10T14:38:36.805843Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 14 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602502995119262:3900]
2025-10-10T14:38:36.806025Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2716 sessionId: src_id|a733b52d-a3ab38c5-8337b6b0-e9fa713a_0 is DEAD
2025-10-10T14:38:36.806182Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a733b52d-a3ab38c5-8337b6b0-e9fa713a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:36.806192Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a733b52d-a3ab38c5-8337b6b0-e9fa713a_0] Write session will restart in 0.005271s
2025-10-10T14:38:36.806218Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a733b52d-a3ab38c5-8337b6b0-e9fa713a_0] Write session: Do CDS request
2025-10-10T14:38:36.806224Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a733b52d-a3ab38c5-8337b6b0-e9fa713a_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:36.806744Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:36.812968Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a733b52d-a3ab38c5-8337b6b0-e9fa713a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:36.812966Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:36.812981Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2717
2025-10-10T14:38:36.813176Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2717 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:36.813226Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2717 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:36.813237Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2717 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:36.813241Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:36.813727Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2717 sessionId:  describe result for acl check
2025-10-10T14:38:36.813767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:36.813769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:36.813771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:36.813777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602502995119283:4270] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:36.814616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602502995119283:4270] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:36.816779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:36.817693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602502995119283:4270] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:36.820181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:36.820450Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:36.820460Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:36.820475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:36.820528Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602502995119283:4270] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:36.820544Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602502995119283:4270] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:36.820540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:36.820548Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602502995119283:4270] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:36.820557Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2717 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:36.820603Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602502212880109:9399]
2025-10-10T14:38:36.821126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:36.821469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:36.821514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:36.821797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:36.821845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:36.821850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:36.821851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:36.821852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:36.821852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:36.821853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:36.821854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:36.821854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:36.821855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:36.821856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:36.821858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:36.821859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:36.821860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:36.821864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:36.821896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:36.821899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:36.821901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:36.821904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:36.821906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:36.821909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:36.821911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:36.821914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:36.821916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:36.821919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:36.821921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:36.821923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:36.821929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:36.821934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:36.821939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:36.821942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:36.821945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:36.821949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:36.821952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:36.821955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:36.821957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:36.821961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:36.821963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:36.821966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:36.821969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:36.821972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:36.821975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:36.821979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:36.821981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:36.821985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:36.821987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:36.821990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:36.821993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:36.821996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:36.821999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:36.822002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:36.822006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:36.822009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:36.822031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:36.824821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:36.825430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:36.825440Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:36.825443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:36.825447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:36.825453Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2716 [2:7559602502212880109:9399]
2025-10-10T14:38:36.825466Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:36.825483Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:36.825490Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:36.825493Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:36.825497Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:36.825514Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:36.825527Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:36.825534Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:36.825596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:36.825603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:36.825605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:36.825608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:36.825687Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:36.825694Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:36.825706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:36.825723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:36.825739Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:36.825767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602502995119320:4270], now have 1 active actors on pipe
2025-10-10T14:38:36.825775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602502995119266:2438], now have 1 active actors on pipe
2025-10-10T14:38:36.825783Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602502212880103:9399]
2025-10-10T14:38:36.825788Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602502212880103:9399]
2025-10-10T14:38:36.825790Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602502212880103:9399]
2025-10-10T14:38:36.825803Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:36.825821Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:36.825824Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:36.825827Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:36.825829Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:36.825818Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2716
2025-10-10T14:38:36.825843Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:36.825848Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:36.825819Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2716
2025-10-10T14:38:36.825897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:36.825906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:36.825921Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602502212880103:9399]
2025-10-10T14:38:36.825928Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:36.825936Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:36.825960Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|661803de-4497c4a1-bfcf030e-1f0f98f2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:36.825967Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:36.825971Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:36.825974Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:36.825985Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:36.825995Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:36.826017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:36.826161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:36.826169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:36.826182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:36.826280Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2717 partition: 0 MaxSeqNo: 40 sessionId: src_id|661803de-4497c4a1-bfcf030e-1f0f98f2_0
2025-10-10T14:38:36.826723Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a733b52d-a3ab38c5-8337b6b0-e9fa713a_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|661803de-4497c4a1-bfcf030e-1f0f98f2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:36.829649Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|661803de-4497c4a1-bfcf030e-1f0f98f2_0] Write session: try to update token
2025-10-10T14:38:36.829668Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|661803de-4497c4a1-bfcf030e-1f0f98f2_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:36.844728Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2717 sessionId: src_id|661803de-4497c4a1-bfcf030e-1f0f98f2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:36.847666Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:36.847728Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:36.847751Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:36.847754Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:36.847756Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:36.847766Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602502212880103:9399]
2025-10-10T14:38:36.847770Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602502212880103:9399]
2025-10-10T14:38:36.847774Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602502212880103:9399]
2025-10-10T14:38:36.847824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:36.847834Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:36.847839Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:36.847842Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:36.847842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:36.847847Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:36.847996Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:36.906196Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602502995119358:3900]
2025-10-10T14:38:36.906380Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 pipe creation result: OK TabletId: 72075186224037892 Generation: 2716, pipe: [1:7559602502995119358:3900]
2025-10-10T14:38:36.967165Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:36.967465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:36.967481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:36.967528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602502995119358:3900], now have 1 active actors on pipe
2025-10-10T14:38:36.967753Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:36.967805Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:36.967807Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 15 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602502995119358:3900]
2025-10-10T14:38:36.967826Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:36.967826Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:36.967925Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2717 reason: error at write: Disconnected sessionId: src_id|661803de-4497c4a1-bfcf030e-1f0f98f2_0
2025-10-10T14:38:36.968163Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2717 sessionId: src_id|661803de-4497c4a1-bfcf030e-1f0f98f2_0 is DEAD
2025-10-10T14:38:36.968327Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|661803de-4497c4a1-bfcf030e-1f0f98f2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:36.968338Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|661803de-4497c4a1-bfcf030e-1f0f98f2_0] Write session will restart in 0.008311s
2025-10-10T14:38:36.968362Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|661803de-4497c4a1-bfcf030e-1f0f98f2_0] Write session: Do CDS request
2025-10-10T14:38:36.968372Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|661803de-4497c4a1-bfcf030e-1f0f98f2_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:36.976890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:36.977864Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|661803de-4497c4a1-bfcf030e-1f0f98f2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:36.977990Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:36.978011Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2718
2025-10-10T14:38:36.978132Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2718 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:36.978169Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2718 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:36.978181Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2718 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:36.978185Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:36.978712Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2718 sessionId:  describe result for acl check
2025-10-10T14:38:36.978760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:36.978767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:36.978769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:36.978776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602502995119382:4320] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:36.979500Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602502995119382:4320] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:36.980111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:36.980309Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:36.980319Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:36.980329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:36.980376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:36.980413Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602502212880205:9379]
2025-10-10T14:38:36.980832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:36.981168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:36.981235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:36.981367Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602502995119382:4320] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:36.981586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:36.981664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:36.981670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:36.981671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:36.981673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:36.981674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:36.981676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:36.981677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:36.981678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:36.981679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:36.981680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:36.981681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:36.981686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:36.981687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:36.981693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:36.981706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:36.981711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:36.981715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:36.981719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:36.981722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:36.981726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:36.981731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:36.981735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:36.981739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:36.981743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:36.981747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:36.981751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:36.981758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:36.981767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:36.981774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:36.981779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:36.981784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:36.981794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:36.981798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:36.981804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:36.981813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:36.981818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:36.981831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:36.981841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:36.981847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:36.981856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:36.981860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:36.981865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:36.981887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:36.981892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:36.981896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:36.981902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:36.981911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:36.981915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:36.981919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:36.981929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:36.981934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:36.981943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:36.981980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:36.984397Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602502995119382:4320] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:36.984413Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602502995119382:4320] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:36.984416Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602502995119382:4320] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:36.984426Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2718 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:36.984484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:36.984831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:36.984843Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:36.984847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:36.984850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:36.984857Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2717 [2:7559602502212880205:9379]
2025-10-10T14:38:36.984871Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:36.984892Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:36.984900Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:36.984903Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:36.984906Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:36.984924Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:36.984936Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:36.984948Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:36.985013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:36.985020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:36.985022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:36.985025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:36.985093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:36.985101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:36.985112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:36.985122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:36.985140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:36.985168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602502995119414:4320], now have 1 active actors on pipe
2025-10-10T14:38:36.985176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602502995119362:2438], now have 1 active actors on pipe
2025-10-10T14:38:36.985185Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602502212880199:9379]
2025-10-10T14:38:36.985187Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602502212880199:9379]
2025-10-10T14:38:36.985196Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2717
2025-10-10T14:38:36.985189Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602502212880199:9379]
2025-10-10T14:38:36.985203Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2717
2025-10-10T14:38:36.985201Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:36.985219Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:36.985234Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:36.985237Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:36.985240Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:36.985252Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:36.985260Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:36.985299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:36.985310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:36.985341Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602502212880199:9379]
2025-10-10T14:38:36.985348Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:36.985360Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:36.985380Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9c1c882b-c3f7a313-c199255e-90f51e27_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:36.985392Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:36.985396Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:36.985398Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:36.985409Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:36.985420Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:36.985442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:36.985555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:36.985561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:36.985577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:36.985661Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2718 partition: 0 MaxSeqNo: 40 sessionId: src_id|9c1c882b-c3f7a313-c199255e-90f51e27_0
2025-10-10T14:38:36.986081Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|661803de-4497c4a1-bfcf030e-1f0f98f2_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|9c1c882b-c3f7a313-c199255e-90f51e27_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:36.988664Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9c1c882b-c3f7a313-c199255e-90f51e27_0] Write session: try to update token
2025-10-10T14:38:36.988679Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9c1c882b-c3f7a313-c199255e-90f51e27_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:37.002227Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2718 sessionId: src_id|9c1c882b-c3f7a313-c199255e-90f51e27_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:37.004965Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:37.005208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:37.005230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:37.005269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:38:37.005376Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:38:37.009220Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:37.009241Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:37.009245Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:37.009247Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:37.009256Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602502212880199:9379]
2025-10-10T14:38:37.009261Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602502212880199:9379]
2025-10-10T14:38:37.009266Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602502212880199:9379]
2025-10-10T14:38:37.009320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:37.009321Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:37.009342Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:37.009347Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:37.009347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:37.009349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:37.009488Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:37.067993Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602507290086717:3900]
2025-10-10T14:38:37.068302Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 pipe creation result: OK TabletId: 72075186224037892 Generation: 2717, pipe: [1:7559602507290086717:3900]
2025-10-10T14:38:37.126223Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:37.134276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:37.134304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:37.134490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:37.134553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:37.134618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:37.134689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:37.134740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:37.134750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:37.134819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:37.134884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:37.134955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:37.135021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:37.135066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:37.135077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:37.135141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:37.135205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:37.135272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:37.135329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:37.135372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:37.135381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:37.135451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:37.135519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:37.135586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:37.135648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:37.135691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:37.135702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:37.135777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:37.135841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:37.135903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:37.135974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:37.136021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:37.136032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:37.136103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:37.136165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:37.136234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:37.136295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:37.136349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:37.136358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:37.136425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:37.136492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:37.136561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:37.136628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:37.136670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:37.136683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:37.136753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:37.136816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:37.136879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:37.136947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:37.136992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:37.136998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:37.137073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:37.137135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:37.137200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:37.137264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:37.137315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:37.137322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:37.137408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:37.137471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:37.137537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:37.137605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:37.137648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:37.137655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:37.137735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602507290086717:3900], now have 1 active actors on pipe
2025-10-10T14:38:37.138086Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:37.138086Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 16 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602507290086717:3900]
2025-10-10T14:38:37.138106Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:37.138114Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:37.138142Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2718 reason: error at write: Disconnected sessionId: src_id|9c1c882b-c3f7a313-c199255e-90f51e27_0
2025-10-10T14:38:37.138379Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2718 sessionId: src_id|9c1c882b-c3f7a313-c199255e-90f51e27_0 is DEAD
2025-10-10T14:38:37.138541Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c1c882b-c3f7a313-c199255e-90f51e27_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:37.138552Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c1c882b-c3f7a313-c199255e-90f51e27_0] Write session will restart in 0.005057s
2025-10-10T14:38:37.138579Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c1c882b-c3f7a313-c199255e-90f51e27_0] Write session: Do CDS request
2025-10-10T14:38:37.138586Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c1c882b-c3f7a313-c199255e-90f51e27_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:37.139270Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:37.144950Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9c1c882b-c3f7a313-c199255e-90f51e27_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:37.145091Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:37.145110Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2719
2025-10-10T14:38:37.145289Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2719 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:37.145349Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2719 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:37.145363Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2719 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:37.145367Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:37.145857Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2719 sessionId:  describe result for acl check
2025-10-10T14:38:37.145906Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:37.145916Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:37.145918Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:37.145926Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602507290086737:4373] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:37.146505Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602507290086737:4373] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:37.148884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:37.149315Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602507290086737:4373] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:37.152140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:37.152204Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602507290086737:4373] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:37.152222Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602507290086737:4373] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:37.152226Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602507290086737:4373] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:37.152235Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2719 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:37.152458Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:37.152470Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:37.152484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:37.152557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:37.152615Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602506507847562:9378]
2025-10-10T14:38:37.153229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:37.153648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:37.153720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:37.154144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:37.154228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:37.154237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:37.154238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:37.154239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:37.154240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:37.154242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:37.154243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:37.154245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:37.154246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:37.154247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:37.154249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:37.154250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:37.154251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:37.154259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:37.154273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:37.154277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:37.154281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:37.154285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:37.154290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:37.154294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:37.154298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:37.154301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:37.154308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:37.154312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:37.154316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:37.154320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:37.154328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:37.154337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:37.154344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:37.154350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:37.154355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:37.154360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:37.154365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:37.154371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:37.154375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:37.154380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:37.154384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:37.154390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:37.154395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:37.154400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:37.154405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:37.154410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:37.154414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:37.154419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:37.154425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:37.154430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:37.154435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:37.154442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:37.154447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:37.154452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:37.154456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:37.154461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:37.154513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:37.157629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:37.158466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:37.158482Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:37.158485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:37.158489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:37.158497Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2718 [2:7559602506507847562:9378]
2025-10-10T14:38:37.158513Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:37.158534Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:37.158542Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:37.158546Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:37.158554Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:37.158574Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:37.158587Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:37.158596Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:37.158669Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:37.158680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:37.158682Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:37.158685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:37.158756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:37.158765Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:37.158779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:37.158791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:37.158815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:37.158845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602507290086719:2438], now have 1 active actors on pipe
2025-10-10T14:38:37.158849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602507290086771:4373], now have 1 active actors on pipe
2025-10-10T14:38:37.158857Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602506507847554:9378]
2025-10-10T14:38:37.158861Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602506507847554:9378]
2025-10-10T14:38:37.158863Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602506507847554:9378]
2025-10-10T14:38:37.158879Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:37.158895Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:37.158897Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:37.158913Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:37.158917Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:37.158918Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:37.158921Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:37.158938Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2718
2025-10-10T14:38:37.158960Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2718
2025-10-10T14:38:37.158951Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602506507847554:9378]
2025-10-10T14:38:37.158969Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:37.158975Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:37.159077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:37.159091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:37.159125Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cf77a2ab-16ca5691-c2dc82a4-d6441d30_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:37.159148Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:37.159156Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:37.159159Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:37.159174Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:37.159191Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:37.159213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:37.159420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:37.159431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:37.159455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:37.159547Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2719 partition: 0 MaxSeqNo: 40 sessionId: src_id|cf77a2ab-16ca5691-c2dc82a4-d6441d30_0
2025-10-10T14:38:37.159983Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c1c882b-c3f7a313-c199255e-90f51e27_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|cf77a2ab-16ca5691-c2dc82a4-d6441d30_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:37.162967Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf77a2ab-16ca5691-c2dc82a4-d6441d30_0] Write session: try to update token
2025-10-10T14:38:37.162994Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf77a2ab-16ca5691-c2dc82a4-d6441d30_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:37.179042Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:37.179050Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2719 sessionId: src_id|cf77a2ab-16ca5691-c2dc82a4-d6441d30_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:37.179061Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:37.179065Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:37.179068Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:37.179078Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602506507847554:9378]
2025-10-10T14:38:37.179082Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602506507847554:9378]
2025-10-10T14:38:37.179086Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602506507847554:9378]
2025-10-10T14:38:37.179136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:37.179144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:37.179147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:37.179287Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:37.179382Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:37.179398Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:37.179402Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:37.181718Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:37.238502Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602507290086782:3900]
2025-10-10T14:38:37.238839Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 pipe creation result: OK TabletId: 72075186224037892 Generation: 2718, pipe: [1:7559602507290086782:3900]
2025-10-10T14:38:37.301737Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:37.302042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:37.302058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:37.302106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602507290086782:3900], now have 1 active actors on pipe
2025-10-10T14:38:37.302416Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:37.302487Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:37.302490Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:37.302576Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2719 reason: error at write: Disconnected sessionId: src_id|cf77a2ab-16ca5691-c2dc82a4-d6441d30_0
2025-10-10T14:38:37.302782Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2719 sessionId: src_id|cf77a2ab-16ca5691-c2dc82a4-d6441d30_0 is DEAD
2025-10-10T14:38:37.302903Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 17 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602507290086782:3900]
2025-10-10T14:38:37.302400Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:37.305482Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf77a2ab-16ca5691-c2dc82a4-d6441d30_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:37.305496Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf77a2ab-16ca5691-c2dc82a4-d6441d30_0] Write session will restart in 0.006949s
2025-10-10T14:38:37.305522Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf77a2ab-16ca5691-c2dc82a4-d6441d30_0] Write session: Do CDS request
2025-10-10T14:38:37.305532Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf77a2ab-16ca5691-c2dc82a4-d6441d30_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:37.312385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:37.313998Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf77a2ab-16ca5691-c2dc82a4-d6441d30_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:37.314046Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:37.314064Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2720
2025-10-10T14:38:37.314235Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2720 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:37.314273Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2720 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:37.314293Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2720 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:37.314302Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:37.314809Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2720 sessionId:  describe result for acl check
2025-10-10T14:38:37.314851Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:37.314858Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:37.314860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:37.314866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602507290086807:4381] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:37.315072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:37.315314Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:37.315328Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:37.315341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:37.315404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:37.315453Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602506507847622:9371]
2025-10-10T14:38:37.315474Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602507290086807:4381] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:37.316065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:37.316387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:37.316435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:37.316769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:37.316842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:37.316849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:37.316850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:37.316851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:37.316852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:37.316854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:37.316855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:37.316859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:37.316860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:37.316861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:37.316862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:37.316863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:37.316865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:37.316870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:37.316882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:37.316887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:37.316891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:37.316895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:37.316899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:37.316902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:37.316906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:37.316910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:37.316915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:37.316919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:37.316922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:37.316926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:37.316934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:37.316943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:37.316949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:37.316955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:37.316960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:37.316965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:37.316969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:37.316974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:37.316979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:37.316984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:37.316988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:37.316999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:37.317004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:37.317009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:37.317014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:37.317024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:37.317029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:37.317034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:37.317038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:37.317048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:37.317052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:37.317058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:37.317067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:37.317072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:37.317077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:37.317086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:37.317128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:37.319124Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602507290086807:4381] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:37.319934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:37.320528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:37.320541Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:37.320544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:37.320548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:37.320556Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2719 [2:7559602506507847622:9371]
2025-10-10T14:38:37.320570Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:37.320588Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:37.320594Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:37.320599Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:37.320601Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:37.320619Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:37.320631Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:37.320638Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:37.320697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:37.320703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:37.320705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:37.320708Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:37.320774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:37.320783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:37.320793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:37.320805Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:37.320822Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:37.320848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602507290086783:2438], now have 1 active actors on pipe
2025-10-10T14:38:37.320861Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602506507847616:9371]
2025-10-10T14:38:37.320868Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602506507847616:9371]
2025-10-10T14:38:37.320870Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602506507847616:9371]
2025-10-10T14:38:37.320883Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:37.320895Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:37.320897Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:37.320903Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:37.320905Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:37.320912Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:37.320915Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:37.320946Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602506507847616:9371]
2025-10-10T14:38:37.320954Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:37.320923Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2719
2025-10-10T14:38:37.320956Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:37.325977Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602507290086807:4381] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:37.325996Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602507290086807:4381] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:37.325999Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602507290086807:4381] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:37.326010Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2720 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:37.326295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602507290086845:4381], now have 1 active actors on pipe
2025-10-10T14:38:37.326356Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2719
2025-10-10T14:38:37.326467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:37.326494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:37.326533Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2b5bde5d-cd4fb12b-ae78a3-fe435279_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:37.326548Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:37.326555Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:37.326558Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:37.326574Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:37.326602Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:37.326628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:37.326860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:37.326874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:37.326902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:37.327015Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2720 partition: 0 MaxSeqNo: 40 sessionId: src_id|2b5bde5d-cd4fb12b-ae78a3-fe435279_0
2025-10-10T14:38:37.327455Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf77a2ab-16ca5691-c2dc82a4-d6441d30_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|2b5bde5d-cd4fb12b-ae78a3-fe435279_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:37.330233Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2b5bde5d-cd4fb12b-ae78a3-fe435279_0] Write session: try to update token
2025-10-10T14:38:37.330251Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2b5bde5d-cd4fb12b-ae78a3-fe435279_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:37.341014Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:37.341041Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:37.341045Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:37.341049Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:37.341060Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602506507847616:9371]
2025-10-10T14:38:37.341067Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602506507847616:9371]
2025-10-10T14:38:37.341074Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602506507847616:9371]
2025-10-10T14:38:37.341126Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:37.341141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:37.341147Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:37.341149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:37.341152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:37.341152Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:37.341321Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:37.350290Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2720 sessionId: src_id|2b5bde5d-cd4fb12b-ae78a3-fe435279_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:37.353100Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:37.402339Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602507290086848:3900]
2025-10-10T14:38:37.402708Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 pipe creation result: OK TabletId: 72075186224037892 Generation: 2719, pipe: [1:7559602507290086848:3900]
2025-10-10T14:38:37.463770Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:37.464100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:37.464116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:37.464141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602507290086848:3900], now have 1 active actors on pipe
2025-10-10T14:38:37.464406Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:37.464410Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 18 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602507290086848:3900]
2025-10-10T14:38:37.464436Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:37.464439Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:37.464520Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2720 reason: error at write: Disconnected sessionId: src_id|2b5bde5d-cd4fb12b-ae78a3-fe435279_0
2025-10-10T14:38:37.464735Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2720 sessionId: src_id|2b5bde5d-cd4fb12b-ae78a3-fe435279_0 is DEAD
2025-10-10T14:38:37.464922Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b5bde5d-cd4fb12b-ae78a3-fe435279_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:37.464931Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b5bde5d-cd4fb12b-ae78a3-fe435279_0] Write session will restart in 0.009173s
2025-10-10T14:38:37.464428Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:37.464954Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b5bde5d-cd4fb12b-ae78a3-fe435279_0] Write session: Do CDS request
2025-10-10T14:38:37.464960Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b5bde5d-cd4fb12b-ae78a3-fe435279_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:37.474968Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2b5bde5d-cd4fb12b-ae78a3-fe435279_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:37.475033Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:37.475052Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2721
2025-10-10T14:38:37.477487Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2721 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:37.477544Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2721 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:37.477564Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2721 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:37.477574Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:37.478042Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2721 sessionId:  describe result for acl check
2025-10-10T14:38:37.478081Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:37.478087Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:37.478090Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:37.478096Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602507290086872:4436] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:37.478655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602507290086872:4436] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:37.479691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:37.483765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:37.484024Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:37.484037Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:37.484050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:37.484116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:37.484399Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602507290086872:4436] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:37.484179Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602506507847695:9374]
2025-10-10T14:38:37.484830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:37.485124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:37.485174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:37.485547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:37.485614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:37.485621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:37.485622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:37.485623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:37.485625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:37.485627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:37.485628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:37.485630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:37.485631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:37.485632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:37.485633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:37.485634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:37.485635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:37.485642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:37.485657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:37.485662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:37.485667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:37.485671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:37.485676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:37.485680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:37.485684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:37.485688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:37.485692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:37.485696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:37.485700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:37.485705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:37.485713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:37.485736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:37.485747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:37.485754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:37.485759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:37.485765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:37.485771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:37.485785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:37.485789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:37.485795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:37.485799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:37.485804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:37.485809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:37.485815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:37.485820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:37.485825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:37.485829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:37.485834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:37.485839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:37.485844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:37.485848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:37.485854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:37.485867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:37.485872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:37.485876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:37.485881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:37.485921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:37.488696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602507290086872:4436] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:37.488714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602507290086872:4436] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:37.488718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602507290086872:4436] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:37.488727Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2721 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:37.488891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:37.489566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:37.489582Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:37.489585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:37.489589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:37.489596Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2720 [2:7559602506507847695:9374]
2025-10-10T14:38:37.489609Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:37.489627Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:37.489634Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:37.489637Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:37.489640Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:37.490014Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2720
2025-10-10T14:38:37.490054Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2720
2025-10-10T14:38:37.489658Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:37.489673Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:37.489681Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:37.489744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:37.489747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:37.489749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:37.489751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:37.489825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:37.489827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:37.489843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:37.489856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:37.489887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:37.489910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602507290086907:4436], now have 1 active actors on pipe
2025-10-10T14:38:37.489913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602507290086849:2438], now have 1 active actors on pipe
2025-10-10T14:38:37.489922Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602506507847689:9374]
2025-10-10T14:38:37.489925Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602506507847689:9374]
2025-10-10T14:38:37.489927Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602506507847689:9374]
2025-10-10T14:38:37.489941Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:37.489955Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:37.489956Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:37.489958Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:37.489960Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:37.489971Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:37.489975Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:37.490004Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602506507847689:9374]
2025-10-10T14:38:37.490017Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:37.490035Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:37.490047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:37.490053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:37.490089Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|19d9c490-97ea3e2b-b795fe04-4e50421b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:37.490098Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:37.490101Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:37.490103Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:37.490114Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:37.490126Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:37.490145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:37.490318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:37.490327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:37.490342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:37.490435Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2721 partition: 0 MaxSeqNo: 40 sessionId: src_id|19d9c490-97ea3e2b-b795fe04-4e50421b_0
2025-10-10T14:38:37.490882Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b5bde5d-cd4fb12b-ae78a3-fe435279_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|19d9c490-97ea3e2b-b795fe04-4e50421b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:37.493741Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19d9c490-97ea3e2b-b795fe04-4e50421b_0] Write session: try to update token
2025-10-10T14:38:37.493760Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19d9c490-97ea3e2b-b795fe04-4e50421b_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:37.508766Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2721 sessionId: src_id|19d9c490-97ea3e2b-b795fe04-4e50421b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:37.510586Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:38:37.510605Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:37.510618Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602506507847689:9374]
2025-10-10T14:38:37.510676Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:38:37.510680Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:38:37.510884Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:38:37.511052Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:37.511208Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:37.511618Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:37.511370Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:37.511626Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:38:37.511667Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:38:37.511849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:37.511858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:37.511893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:38:37.511957Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:38:37.522605Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:37.522624Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:37.522627Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:37.522628Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:37.522643Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602506507847689:9374]
2025-10-10T14:38:37.522647Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602506507847689:9374]
2025-10-10T14:38:37.522650Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602506507847689:9374]
2025-10-10T14:38:37.522700Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:37.522694Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:37.522709Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:37.522712Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:37.522714Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:37.522714Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:37.522862Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:37.564720Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602507290086926:3900]
2025-10-10T14:38:37.565122Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 pipe creation result: OK TabletId: 72075186224037892 Generation: 2720, pipe: [1:7559602507290086926:3900]
2025-10-10T14:38:37.638245Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:37.646907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:37.646942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:37.647132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:37.647205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:37.647275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:37.647346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:37.647392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:37.647402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:37.647474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:37.647542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:37.647607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:37.647671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:37.647717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:37.647730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:37.647803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:37.647877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:37.647946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:37.648012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:37.648060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:37.648069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:37.648139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:37.648211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:37.648280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:37.648354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:37.648406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:37.648415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:37.648482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:37.648545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:37.648612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:37.648677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:37.648721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:37.648729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:37.648803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:37.648872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:37.648937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:37.649003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:37.649047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:37.649055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:37.649125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:37.649188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:37.649254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:37.649322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:37.649390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:37.649398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:37.649470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:37.649552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:37.649617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:37.649688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:37.649755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:37.649763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:37.649833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:37.649918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:37.649985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:37.650051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:37.650101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:37.650109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:37.650181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:37.650246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:37.650320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:37.650387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:37.650431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:37.650439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:37.650509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602507290086926:3900], now have 1 active actors on pipe
2025-10-10T14:38:37.650773Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 19 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602507290086926:3900]
2025-10-10T14:38:37.650773Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:37.650778Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:37.650808Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:37.650814Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2721 reason: error at write: Disconnected sessionId: src_id|19d9c490-97ea3e2b-b795fe04-4e50421b_0
2025-10-10T14:38:37.651018Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2721 sessionId: src_id|19d9c490-97ea3e2b-b795fe04-4e50421b_0 is DEAD
2025-10-10T14:38:37.651177Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19d9c490-97ea3e2b-b795fe04-4e50421b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:37.651186Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19d9c490-97ea3e2b-b795fe04-4e50421b_0] Write session will restart in 0.009782s
2025-10-10T14:38:37.651211Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19d9c490-97ea3e2b-b795fe04-4e50421b_0] Write session: Do CDS request
2025-10-10T14:38:37.651218Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19d9c490-97ea3e2b-b795fe04-4e50421b_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:37.651744Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:37.660814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:37.661914Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19d9c490-97ea3e2b-b795fe04-4e50421b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:37.662002Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:37.662020Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2722
2025-10-10T14:38:37.662146Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2722 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:37.662189Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2722 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:37.662199Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2722 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:37.662203Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:37.662685Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2722 sessionId:  describe result for acl check
2025-10-10T14:38:37.662728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:37.662735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:37.662737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:37.662744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602507290086954:4451] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:37.663339Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602507290086954:4451] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:37.665209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:37.665616Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:37.665630Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:37.665644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:37.665713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:37.665756Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602506507847757:9362]
2025-10-10T14:38:37.666356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:37.666536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602507290086954:4451] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:37.666695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:37.666738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:37.667045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:37.667104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:37.667111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:37.667113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:37.667114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:37.667115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:37.667116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:37.667118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:37.667119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:37.667120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:37.667121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:37.667122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:37.667123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:37.667124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:37.667130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:37.667143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:37.667147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:37.667150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:37.667154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:37.667157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:37.667161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:37.667165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:37.667168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:37.667172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:37.667175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:37.667179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:37.667183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:37.667190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:37.667197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:37.667204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:37.667209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:37.667213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:37.667218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:37.667223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:37.667228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:37.667232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:37.667237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:37.667241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:37.667245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:37.667251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:37.667255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:37.667259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:37.667264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:37.667267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:37.667272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:37.667285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:37.667291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:37.667295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:37.667300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:37.667303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:37.667308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:37.667312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:37.667317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:37.667356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:37.669889Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602507290086954:4451] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:37.669916Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602507290086954:4451] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:37.669920Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602507290086954:4451] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:37.669929Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2722 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:37.670568Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2721
2025-10-10T14:38:37.670606Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2721
2025-10-10T14:38:37.669905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:37.670217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:37.670222Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:37.670224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:37.670227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:37.670233Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2721 [2:7559602506507847757:9362]
2025-10-10T14:38:37.670245Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:37.670262Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:37.670265Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:37.670268Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:37.670270Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:37.670290Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:37.670297Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:37.670304Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:37.670361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:37.670363Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:37.670365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:37.670367Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:37.670442Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:37.670445Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:37.670455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:37.670466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:37.670481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:37.670501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602507290086928:2438], now have 1 active actors on pipe
2025-10-10T14:38:37.670505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602507290086988:4451], now have 1 active actors on pipe
2025-10-10T14:38:37.670511Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602506507847751:9362]
2025-10-10T14:38:37.670514Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602506507847751:9362]
2025-10-10T14:38:37.670516Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602506507847751:9362]
2025-10-10T14:38:37.670533Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:37.670547Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:37.670563Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:37.670566Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:37.670588Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602506507847751:9362]
2025-10-10T14:38:37.670591Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:37.670722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:37.670729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:37.670748Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:37.670751Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:37.670753Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:37.670762Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f8806b76-ba53707d-84a200d2-65caa10_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:37.670770Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:37.670771Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:37.670774Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:37.670777Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:37.670789Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:37.670820Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:37.670837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:37.671071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:37.671086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:37.671111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:37.671214Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2722 partition: 0 MaxSeqNo: 40 sessionId: src_id|f8806b76-ba53707d-84a200d2-65caa10_0
2025-10-10T14:38:37.671575Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19d9c490-97ea3e2b-b795fe04-4e50421b_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|f8806b76-ba53707d-84a200d2-65caa10_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:37.674308Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f8806b76-ba53707d-84a200d2-65caa10_0] Write session: try to update token
2025-10-10T14:38:37.674327Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f8806b76-ba53707d-84a200d2-65caa10_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:37.689513Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2722 sessionId: src_id|f8806b76-ba53707d-84a200d2-65caa10_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:37.690714Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:37.690733Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:37.690737Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:37.690739Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:37.690749Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602506507847751:9362]
2025-10-10T14:38:37.690754Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602506507847751:9362]
2025-10-10T14:38:37.690758Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602506507847751:9362]
2025-10-10T14:38:37.690809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:37.690811Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:37.690817Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:37.690824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:37.690825Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:37.690826Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:37.690964Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:37.692290Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:37.750993Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602507290086995:3900]
2025-10-10T14:38:37.751325Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 pipe creation result: OK TabletId: 72075186224037892 Generation: 2721, pipe: [1:7559602507290086995:3900]
2025-10-10T14:38:37.809424Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:37.809992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:37.810008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:37.810057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602507290086995:3900], now have 1 active actors on pipe
2025-10-10T14:38:37.810318Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:37.810389Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 20 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602507290086995:3900]
2025-10-10T14:38:37.810394Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:37.810416Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:37.810425Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:37.810486Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2722 reason: error at write: Disconnected sessionId: src_id|f8806b76-ba53707d-84a200d2-65caa10_0
2025-10-10T14:38:37.810687Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2722 sessionId: src_id|f8806b76-ba53707d-84a200d2-65caa10_0 is DEAD
2025-10-10T14:38:37.810866Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f8806b76-ba53707d-84a200d2-65caa10_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:37.810878Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f8806b76-ba53707d-84a200d2-65caa10_0] Write session will restart in 0.006151s
2025-10-10T14:38:37.810905Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f8806b76-ba53707d-84a200d2-65caa10_0] Write session: Do CDS request
2025-10-10T14:38:37.810914Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f8806b76-ba53707d-84a200d2-65caa10_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:37.817980Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f8806b76-ba53707d-84a200d2-65caa10_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:37.818041Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:37.818061Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2723
2025-10-10T14:38:37.818271Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2723 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:37.818330Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2723 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:37.818343Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2723 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:37.818348Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:37.818943Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2723 sessionId:  describe result for acl check
2025-10-10T14:38:37.818987Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:37.818994Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:37.818995Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:37.819002Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602507290087027:4489] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:37.819601Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602507290087027:4489] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:37.819945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:37.821723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602507290087027:4489] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:37.823607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:37.823846Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:37.823858Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:37.823870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:37.823928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:37.823976Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602506507847821:9356]
2025-10-10T14:38:37.824606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:37.824954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:37.825008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:37.824986Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602507290087027:4489] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:37.825014Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602507290087027:4489] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:37.825018Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602507290087027:4489] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:37.825028Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2723 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:37.825352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:37.825419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:37.825425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:37.825426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:37.825427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:37.825428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:37.825430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:37.825431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:37.825433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:37.825434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:37.825435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:37.825437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:37.825438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:37.825439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:37.825445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:37.825459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:37.825464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:37.825468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:37.825472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:37.825476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:37.825480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:37.825484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:37.825487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:37.825491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:37.825496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:37.825500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:37.825504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:37.825512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:37.825522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:37.825528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:37.825534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:37.825539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:37.825545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:37.825549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:37.825554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:37.825558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:37.825562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:37.825566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:37.825572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:37.825577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:37.825582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:37.825586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:37.825592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:37.825596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:37.825602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:37.825606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:37.825611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:37.825615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:37.825620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:37.825625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:37.825630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:37.825635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:37.825641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:37.825693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:37.828257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:37.828607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:37.828622Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:37.828624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:37.828628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:37.828635Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2722 [2:7559602506507847821:9356]
2025-10-10T14:38:37.828650Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:37.828669Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:37.828678Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:37.828682Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:37.828685Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:37.828703Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:37.828720Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:37.828728Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:37.828793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:37.828801Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:37.828803Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:37.828806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:37.828882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:37.828894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:37.828907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:37.828919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:37.828938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:37.828970Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602506507847815:9356]
2025-10-10T14:38:37.828978Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602506507847815:9356]
2025-10-10T14:38:37.828981Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602506507847815:9356]
2025-10-10T14:38:37.828996Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:37.829015Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:37.829036Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:37.829037Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:37.829040Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:37.829046Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:37.829051Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:37.829067Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602506507847815:9356]
2025-10-10T14:38:37.829070Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:37.829126Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:37.829227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602507290087003:2438], now have 1 active actors on pipe
2025-10-10T14:38:37.829239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602507290087061:4489], now have 1 active actors on pipe
2025-10-10T14:38:37.829243Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2722
2025-10-10T14:38:37.829266Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2722
2025-10-10T14:38:37.829471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:37.829483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:37.829531Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|708637f1-ff49a22-d57fde4f-38551959_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:37.829546Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:37.829551Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:37.829554Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:37.829567Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:37.829579Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:37.829595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:37.829790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:37.829797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:37.829812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:37.829930Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2723 partition: 0 MaxSeqNo: 40 sessionId: src_id|708637f1-ff49a22-d57fde4f-38551959_0
2025-10-10T14:38:37.830432Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f8806b76-ba53707d-84a200d2-65caa10_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|708637f1-ff49a22-d57fde4f-38551959_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:37.833371Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|708637f1-ff49a22-d57fde4f-38551959_0] Write session: try to update token
2025-10-10T14:38:37.833391Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|708637f1-ff49a22-d57fde4f-38551959_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:37.842120Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:38:37.842145Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:37.842159Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602506507847815:9356]
2025-10-10T14:38:37.842225Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:38:37.842488Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:38:37.842631Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:37.842775Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:37.842917Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:37.843119Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:38:37.843164Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:38:37.843285Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:38:37.858397Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2723 sessionId: src_id|708637f1-ff49a22-d57fde4f-38551959_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:37.861759Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:37.862575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:37.862602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:37.862644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:38:37.863240Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:38:37.867516Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:37.867539Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:37.867543Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:37.867545Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:37.867561Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602506507847815:9356]
2025-10-10T14:38:37.867566Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602506507847815:9356]
2025-10-10T14:38:37.867570Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602506507847815:9356]
2025-10-10T14:38:37.867621Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:37.867627Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:37.867629Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:37.867634Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:37.867639Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:37.867642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:37.867802Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:37.912545Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602507290087079:3900]
2025-10-10T14:38:37.913061Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 pipe creation result: OK TabletId: 72075186224037892 Generation: 2722, pipe: [1:7559602507290087079:3900]
2025-10-10T14:38:38.001682Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:38.010283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:38.010315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:38.010508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:38.010576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:38.010644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:38.010713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:38.011172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:38.011192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:38.011271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:38.011334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:38.011400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:38.011468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:38.011520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:38.011527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:38.011602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:38.011668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:38.011739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:38.011806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:38.011850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:38.011863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:38.011934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:38.011996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:38.012058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:38.012120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:38.012160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:38.012162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:38.012236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:38.012295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:38.012355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:38.012416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:38.012459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:38.012461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:38.012533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:38.012590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:38.012650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:38.012709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:38.012751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:38.012761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:38.012828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:38.012890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:38.012958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:38.013022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:38.013064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:38.013067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:38.013144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:38.013206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:38.013271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:38.013515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:38.013567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:38.013575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:38.013643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:38.013706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:38.013772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:38.013837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:38.013894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:38.013901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:38.013973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:38.014036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:38.014100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:38.014161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:38.014206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:38.014214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:38.014275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602507290087079:3900], now have 1 active actors on pipe
2025-10-10T14:38:38.015062Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:38.015529Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|708637f1-ff49a22-d57fde4f-38551959_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:38.015542Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|708637f1-ff49a22-d57fde4f-38551959_0] Write session will restart in 0.005848s
2025-10-10T14:38:38.015567Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|708637f1-ff49a22-d57fde4f-38551959_0] Write session: Do CDS request
2025-10-10T14:38:38.015573Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|708637f1-ff49a22-d57fde4f-38551959_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:38.015093Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:38.015157Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:38.015160Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:38.015192Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2723 reason: error at write: Disconnected sessionId: src_id|708637f1-ff49a22-d57fde4f-38551959_0
2025-10-10T14:38:38.015416Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2723 sessionId: src_id|708637f1-ff49a22-d57fde4f-38551959_0 is DEAD
2025-10-10T14:38:38.015533Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 21 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602507290087079:3900]
2025-10-10T14:38:38.022915Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|708637f1-ff49a22-d57fde4f-38551959_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:38.025492Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:38.025517Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2724
2025-10-10T14:38:38.025908Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2724 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:38.025949Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2724 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:38.025960Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2724 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:38.025965Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:38.026473Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2724 sessionId:  describe result for acl check
2025-10-10T14:38:38.026515Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:38.026522Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:38.026527Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:38.026533Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602511585054406:4537] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:38.027113Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602511585054406:4537] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:38.029795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602511585054406:4537] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:38.034115Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602511585054406:4537] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:38.034133Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602511585054406:4537] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:38.034137Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602511585054406:4537] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:38.034148Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2724 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:38.037821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:38.041632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:38.042054Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:38.042067Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:38.042082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:38.042145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:38.042193Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602510802815220:9339]
2025-10-10T14:38:38.042780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:38.043140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:38.043185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:38.043499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:38.043555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:38.043563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:38.043563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:38.043564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:38.043565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:38.043567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:38.043568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:38.043569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:38.043570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:38.043571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:38.043572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:38.043573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:38.043574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:38.043581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:38.043594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:38.043598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:38.043611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:38.043615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:38.043619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:38.043623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:38.043626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:38.043630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:38.043634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:38.043639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:38.043643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:38.043646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:38.043655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:38.043663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:38.043669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:38.043675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:38.043679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:38.043685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:38.043689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:38.043693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:38.043698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:38.043703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:38.043707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:38.043712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:38.043716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:38.043721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:38.043724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:38.043730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:38.043734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:38.043740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:38.043743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:38.043748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:38.043753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:38.043757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:38.043761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:38.043767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:38.043772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:38.043777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:38.043817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:38.046367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:38.047049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:38.047061Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:38.047064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:38.047068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:38.047074Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2723 [2:7559602510802815220:9339]
2025-10-10T14:38:38.047087Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:38.047103Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:38.047107Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:38.047110Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:38.047112Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:38.047129Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:38.047141Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:38.047150Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:38.047209Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:38.047217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:38.047219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:38.047222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:38.047292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:38.047302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:38.047312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:38.047323Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:38.047339Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:38.047365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602511585054444:4537], now have 1 active actors on pipe
2025-10-10T14:38:38.047374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602511585054398:2438], now have 1 active actors on pipe
2025-10-10T14:38:38.047382Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602510802815214:9339]
2025-10-10T14:38:38.047384Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602510802815214:9339]
2025-10-10T14:38:38.047387Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602510802815214:9339]
2025-10-10T14:38:38.047401Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:38.047420Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:38.047427Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:38.047430Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:38.047432Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:38.047442Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:38.047445Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:38.047468Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602510802815214:9339]
2025-10-10T14:38:38.047483Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:38.047509Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:38.047458Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2723
2025-10-10T14:38:38.047463Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2723
2025-10-10T14:38:38.047600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:38.047613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:38.047667Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|507521a-be29e90-c1579b22-ca685a73_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:38.047682Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:38.047687Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:38.047690Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:38.047717Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:38.047737Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:38.047770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:38.047936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:38.047945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:38.047971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:38.048080Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2724 partition: 0 MaxSeqNo: 40 sessionId: src_id|507521a-be29e90-c1579b22-ca685a73_0
2025-10-10T14:38:38.048501Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|708637f1-ff49a22-d57fde4f-38551959_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|507521a-be29e90-c1579b22-ca685a73_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:38.051318Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|507521a-be29e90-c1579b22-ca685a73_0] Write session: try to update token
2025-10-10T14:38:38.051340Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|507521a-be29e90-c1579b22-ca685a73_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:38.067149Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2724 sessionId: src_id|507521a-be29e90-c1579b22-ca685a73_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:38.069886Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:38.070882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:38.070904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:38.070928Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:38.070931Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:38.070934Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:38.070936Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:38.070945Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602510802815214:9339]
2025-10-10T14:38:38.070949Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602510802815214:9339]
2025-10-10T14:38:38.070953Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602510802815214:9339]
2025-10-10T14:38:38.071006Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:38.071011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:38.071020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:38.071022Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:38.071022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:38.071026Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:38.071155Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:38.113492Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602511585054462:3900]
2025-10-10T14:38:38.117616Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 pipe creation result: OK TabletId: 72075186224037892 Generation: 2723, pipe: [1:7559602511585054462:3900]
2025-10-10T14:38:38.187101Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:38.187351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:38:38.187403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602511585054462:3900], now have 1 active actors on pipe
2025-10-10T14:38:38.187510Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:38:38.187545Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:38.187611Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 22 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602511585054462:3900]
2025-10-10T14:38:38.197930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:38.199366Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:38.199381Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:38.199409Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2724 reason: error at write: Disconnected sessionId: src_id|507521a-be29e90-c1579b22-ca685a73_0
2025-10-10T14:38:38.199575Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2724 sessionId: src_id|507521a-be29e90-c1579b22-ca685a73_0 is DEAD
2025-10-10T14:38:38.199739Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|507521a-be29e90-c1579b22-ca685a73_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:38.199747Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|507521a-be29e90-c1579b22-ca685a73_0] Write session will restart in 0.005077s
2025-10-10T14:38:38.199772Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|507521a-be29e90-c1579b22-ca685a73_0] Write session: Do CDS request
2025-10-10T14:38:38.199779Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|507521a-be29e90-c1579b22-ca685a73_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:38.207132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:38.207420Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:38.207432Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:38.207445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:38.207529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:38.207573Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602510802815285:9333]
2025-10-10T14:38:38.208310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:38.208777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:38.208858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:38.209256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:38.209385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:38.209398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:38.209400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:38.209401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:38.209402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:38.209403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:38.209410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:38.209412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:38.209414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:38.209415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:38.209416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:38.209417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:38.209418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:38.209427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:38.209442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:38.209446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:38.209450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:38.209454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:38.209458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:38.209462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:38.209466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:38.209470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:38.209474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:38.209477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:38.209481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:38.209485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:38.209494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:38.209504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:38.209511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:38.209517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:38.209523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:38.209529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:38.209533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:38.209539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:38.209544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:38.209550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:38.209554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:38.209563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:38.209569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:38.209574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:38.209578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:38.209584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:38.209590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:38.209596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:38.209601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:38.209606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:38.209611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:38.209617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:38.209622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:38.209627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:38.209631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:38.209637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:38.209710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:38.209930Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|507521a-be29e90-c1579b22-ca685a73_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:38.210019Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:38.210035Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2725
2025-10-10T14:38:38.210161Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2725 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:38.210200Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2725 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:38.210208Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2725 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:38.210213Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:38.210642Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2725 sessionId:  describe result for acl check
2025-10-10T14:38:38.210674Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:38.210676Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:38.210678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:38.210684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602511585054497:4577] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:38.211281Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602511585054497:4577] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:38.212679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:38.213013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:38.213028Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:38.213031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:38.213035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:38.213041Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2724 [2:7559602510802815285:9333]
2025-10-10T14:38:38.213056Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:38.213073Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:38.213076Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:38.213080Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:38.213083Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:38.213101Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:38.213112Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:38.213120Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:38.213182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:38.213193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:38.213195Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:38.213198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:38.213267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:38.213275Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:38.213288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:38.213300Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:38.213319Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:38.213368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602511585054465:2438], now have 1 active actors on pipe
2025-10-10T14:38:38.213382Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602510802815279:9333]
2025-10-10T14:38:38.213389Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602510802815279:9333]
2025-10-10T14:38:38.213391Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602510802815279:9333]
2025-10-10T14:38:38.213406Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:38.213421Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:38.213422Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:38.213426Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:38.213428Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:38.213444Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:38.213449Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:38.213476Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602510802815279:9333]
2025-10-10T14:38:38.213492Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:38.213512Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:38.213691Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2724
2025-10-10T14:38:38.214252Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602511585054497:4577] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:38.219553Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602511585054497:4577] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:38.219575Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602511585054497:4577] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:38.219580Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602511585054497:4577] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:38.219589Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2725 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:38.219966Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2724
2025-10-10T14:38:38.219949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602511585054530:4577], now have 1 active actors on pipe
2025-10-10T14:38:38.220087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:38.220096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:38.220135Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3265055a-4887c331-4ab80bde-49b48c4a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:38.220162Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:38.220173Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:38.220177Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:38.220196Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:38.220218Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:38.220239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:38.220544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:38.220552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:38.220567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:38.220676Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2725 partition: 0 MaxSeqNo: 40 sessionId: src_id|3265055a-4887c331-4ab80bde-49b48c4a_0
2025-10-10T14:38:38.221120Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|507521a-be29e90-c1579b22-ca685a73_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|3265055a-4887c331-4ab80bde-49b48c4a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:38.224050Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3265055a-4887c331-4ab80bde-49b48c4a_0] Write session: try to update token
2025-10-10T14:38:38.224068Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3265055a-4887c331-4ab80bde-49b48c4a_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:38.234563Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:38.234581Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:38.234585Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:38.234587Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:38.234599Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602510802815279:9333]
2025-10-10T14:38:38.234604Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602510802815279:9333]
2025-10-10T14:38:38.234607Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602510802815279:9333]
2025-10-10T14:38:38.234657Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:38.234665Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:38.234671Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:38.234674Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:38.234676Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:38.234677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:38.234820Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:38.241152Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2725 sessionId: src_id|3265055a-4887c331-4ab80bde-49b48c4a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:38.243902Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:38.287584Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602511585054533:3900]
2025-10-10T14:38:38.287895Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 pipe creation result: OK TabletId: 72075186224037892 Generation: 2724, pipe: [1:7559602511585054533:3900]
2025-10-10T14:38:38.354422Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:38.354939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:38.354957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:38.355004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602511585054533:3900], now have 1 active actors on pipe
2025-10-10T14:38:38.355185Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:38.355200Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:38.355255Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:38.355258Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:38.355267Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 23 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602511585054533:3900]
2025-10-10T14:38:38.355321Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2725 reason: error at write: Disconnected sessionId: src_id|3265055a-4887c331-4ab80bde-49b48c4a_0
2025-10-10T14:38:38.355526Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2725 sessionId: src_id|3265055a-4887c331-4ab80bde-49b48c4a_0 is DEAD
2025-10-10T14:38:38.355674Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3265055a-4887c331-4ab80bde-49b48c4a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:38.355687Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3265055a-4887c331-4ab80bde-49b48c4a_0] Write session will restart in 0.005941s
2025-10-10T14:38:38.355713Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3265055a-4887c331-4ab80bde-49b48c4a_0] Write session: Do CDS request
2025-10-10T14:38:38.355723Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3265055a-4887c331-4ab80bde-49b48c4a_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:38.362884Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3265055a-4887c331-4ab80bde-49b48c4a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:38.363014Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:38.363036Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2726
2025-10-10T14:38:38.363203Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2726 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:38.363247Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2726 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:38.363259Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2726 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:38.363264Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:38.363795Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2726 sessionId:  describe result for acl check
2025-10-10T14:38:38.363850Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:38.363860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:38.363862Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:38.363869Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602511585054547:4591] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:38.364488Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602511585054547:4591] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:38.368826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602511585054547:4591] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:38.370249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:38.373172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:38.373445Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:38.373461Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:38.373476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:38.373544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:38.373599Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602510802815350:9319]
2025-10-10T14:38:38.374231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:38.374769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:38.374827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:38.375208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:38.375288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:38.375295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:38.375296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:38.375298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:38.375299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:38.375300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:38.375301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:38.375303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:38.375304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:38.375306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:38.375307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:38.375309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:38.375310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:38.375318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:38.375333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:38.375338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:38.375342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:38.375347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:38.375352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:38.375356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:38.375361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:38.375366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:38.375371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:38.375375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:38.375380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:38.375384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:38.375393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:38.375404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:38.375411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:38.375416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:38.375421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:38.375427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:38.375432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:38.375447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:38.375452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:38.375458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:38.375463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:38.375469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:38.375474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:38.375480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:38.375486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:38.375492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:38.375497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:38.375502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:38.375507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:38.375512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:38.375518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:38.375523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:38.375527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:38.375533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:38.375538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:38.375544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:38.375590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:38.378144Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602511585054547:4591] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:38.378165Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602511585054547:4591] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:38.378170Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602511585054547:4591] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:38.378188Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2726 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:38.378826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:38.379524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:38.379547Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:38.379549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:38.379555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:38.379562Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2725 [2:7559602510802815350:9319]
2025-10-10T14:38:38.379575Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:38.379593Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:38.379596Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:38.379600Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:38.379602Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:38.379619Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:38.379627Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:38.379634Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:38.379698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:38.379700Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:38.379702Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:38.379704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:38.379779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:38.379787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:38.379800Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:38.379817Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:38.379839Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:38.379865Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602510802815345:9319]
2025-10-10T14:38:38.379871Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602510802815345:9319]
2025-10-10T14:38:38.379873Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602510802815345:9319]
2025-10-10T14:38:38.379890Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:38.379909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602511585054597:4591], now have 1 active actors on pipe
2025-10-10T14:38:38.379918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602511585054535:2438], now have 1 active actors on pipe
2025-10-10T14:38:38.379927Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:38.379946Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:38.379954Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:38.379958Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2725
2025-10-10T14:38:38.379974Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2725
2025-10-10T14:38:38.379988Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602510802815345:9319]
2025-10-10T14:38:38.379995Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:38.380005Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:38.380008Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:38.380011Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:38.380018Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:38.380736Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2726 partition: 0 MaxSeqNo: 40 sessionId: src_id|97f7d366-d3c0f75f-5b29279c-c53bdf53_0
2025-10-10T14:38:38.381130Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3265055a-4887c331-4ab80bde-49b48c4a_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|97f7d366-d3c0f75f-5b29279c-c53bdf53_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:38.380143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:38.380152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:38.380190Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|97f7d366-d3c0f75f-5b29279c-c53bdf53_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:38.380197Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:38.380201Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:38.380203Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:38.380215Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:38.380227Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:38.380242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:38.380475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:38.380480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:38.380497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:38.383795Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|97f7d366-d3c0f75f-5b29279c-c53bdf53_0] Write session: try to update token
2025-10-10T14:38:38.383813Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|97f7d366-d3c0f75f-5b29279c-c53bdf53_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:38.392083Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:38:38.392106Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:38.392118Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602510802815345:9319]
2025-10-10T14:38:38.392174Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:38:38.392184Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:38:38.392366Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:38:38.392514Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:38.392654Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:38.392795Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:38.393002Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:38:38.393043Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:38:38.400237Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2726 sessionId: src_id|97f7d366-d3c0f75f-5b29279c-c53bdf53_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:38.402888Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:38.403127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:38.403148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:38.403193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:38:38.403335Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:38:38.410509Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:38.410528Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:38.410532Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:38.410534Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:38.410548Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602510802815345:9319]
2025-10-10T14:38:38.410553Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602510802815345:9319]
2025-10-10T14:38:38.410556Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602510802815345:9319]
2025-10-10T14:38:38.410609Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:38.410622Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:38.410620Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:38.410628Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:38.410629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:38.410632Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:38.410780Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:38.455523Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602511585054604:3900]
2025-10-10T14:38:38.455844Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 pipe creation result: OK TabletId: 72075186224037892 Generation: 2725, pipe: [1:7559602511585054604:3900]
2025-10-10T14:38:38.530110Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:38.538906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:38.538942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:38.539137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:38.539211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:38.539296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:38.539373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:38.539426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:38.539438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:38.539519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:38.539588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:38.539663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:38.539738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:38.539787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:38.539799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:38.539876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:38.539947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:38.540020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:38.540097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:38.540147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:38.540159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:38.540235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:38.540306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:38.540380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:38.540458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:38.540515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:38.540522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:38.540595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:38.540663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:38.540735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:38.540812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:38.540863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:38.540870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:38.540946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:38.541038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:38.541122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:38.541201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:38.541258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:38.541266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:38.541406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:38.541477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:38.541555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:38.541627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:38.541678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:38.541686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:38.541759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:38.541829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:38.541915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:38.541990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:38.542041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:38.542048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:38.542121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:38.542185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:38.542252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:38.542322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:38.542371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:38.542378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:38.542449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:38.542517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:38.542586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:38.542656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:38.542704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:38.542711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:38.542780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602511585054604:3900], now have 1 active actors on pipe
2025-10-10T14:38:38.543166Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:38.543181Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 24 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602511585054604:3900]
2025-10-10T14:38:38.543192Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:38.543203Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:38.543225Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2726 reason: error at write: Disconnected sessionId: src_id|97f7d366-d3c0f75f-5b29279c-c53bdf53_0
2025-10-10T14:38:38.543601Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97f7d366-d3c0f75f-5b29279c-c53bdf53_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:38.543612Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97f7d366-d3c0f75f-5b29279c-c53bdf53_0] Write session will restart in 0.006175s
2025-10-10T14:38:38.543639Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97f7d366-d3c0f75f-5b29279c-c53bdf53_0] Write session: Do CDS request
2025-10-10T14:38:38.543646Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97f7d366-d3c0f75f-5b29279c-c53bdf53_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:38.543437Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2726 sessionId: src_id|97f7d366-d3c0f75f-5b29279c-c53bdf53_0 is DEAD
2025-10-10T14:38:38.544184Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:38.551114Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|97f7d366-d3c0f75f-5b29279c-c53bdf53_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:38.551280Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:38.551298Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2727
2025-10-10T14:38:38.551589Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2727 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:38.551643Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2727 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:38.551656Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2727 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:38.551660Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:38.552167Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2727 sessionId:  describe result for acl check
2025-10-10T14:38:38.552207Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:38.552217Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:38.552219Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:38.552226Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602511585054645:4651] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:38.552841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602511585054645:4651] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:38.554149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:38.555649Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602511585054645:4651] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:38.556730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:38.556988Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:38.557003Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:38.557017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:38.557092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:38.557256Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602510802815428:9310]
2025-10-10T14:38:38.557900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:38.558175Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602511585054645:4651] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:38.558191Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602511585054645:4651] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:38.558194Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602511585054645:4651] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:38.558203Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2727 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:38.558272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:38.558326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:38.558677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:38.558750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:38.558757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:38.558759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:38.558760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:38.558761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:38.558763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:38.558764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:38.558765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:38.558767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:38.558768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:38.558770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:38.558771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:38.558772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:38.558779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:38.558793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:38.558797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:38.558801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:38.558805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:38.558808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:38.558812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:38.558816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:38.558820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:38.558824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:38.558828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:38.558831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:38.558837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:38.558845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:38.558854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:38.558861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:38.558866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:38.558870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:38.558876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:38.558881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:38.558887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:38.558891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:38.558896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:38.558906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:38.558910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:38.558918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:38.558923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:38.558926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:38.558933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:38.558938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:38.558944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:38.558952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:38.558957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:38.558961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:38.558966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:38.558973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:38.558978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:38.558994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:38.559004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:38.559045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:38.561546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:38.561909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:38.561923Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:38.561926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:38.561933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:38.561940Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2726 [2:7559602510802815428:9310]
2025-10-10T14:38:38.561954Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:38.561973Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:38.561976Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:38.561979Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:38.561982Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:38.561999Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:38.562012Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:38.562020Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:38.562079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:38.562087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:38.562089Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:38.562092Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:38.562167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:38.562175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:38.562202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:38.562219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:38.562241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:38.562266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602511585054680:4651], now have 1 active actors on pipe
2025-10-10T14:38:38.562274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602511585054619:2438], now have 1 active actors on pipe
2025-10-10T14:38:38.562282Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602510802815422:9310]
2025-10-10T14:38:38.562289Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602510802815422:9310]
2025-10-10T14:38:38.562290Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602510802815422:9310]
2025-10-10T14:38:38.562307Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:38.562317Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2726
2025-10-10T14:38:38.562326Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:38.562327Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:38.562331Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:38.562333Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:38.562347Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:38.562351Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:38.562378Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602510802815422:9310]
2025-10-10T14:38:38.562381Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:38.562383Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:38.562404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:38.562392Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2726
2025-10-10T14:38:38.562408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:38.562447Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e66381f7-93033986-ec4c83fe-abc0f250_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:38.562459Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:38.562465Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:38.562472Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:38.562483Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:38.562498Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:38.562518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:38.562640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:38.562648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:38.562662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:38.562728Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2727 partition: 0 MaxSeqNo: 40 sessionId: src_id|e66381f7-93033986-ec4c83fe-abc0f250_0
2025-10-10T14:38:38.563114Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97f7d366-d3c0f75f-5b29279c-c53bdf53_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|e66381f7-93033986-ec4c83fe-abc0f250_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:38.565896Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e66381f7-93033986-ec4c83fe-abc0f250_0] Write session: try to update token
2025-10-10T14:38:38.565915Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e66381f7-93033986-ec4c83fe-abc0f250_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:38.580512Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2727 sessionId: src_id|e66381f7-93033986-ec4c83fe-abc0f250_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:38.583961Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:38.583985Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:38.583989Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:38.583991Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:38.584002Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602510802815422:9310]
2025-10-10T14:38:38.584011Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602510802815422:9310]
2025-10-10T14:38:38.584015Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602510802815422:9310]
2025-10-10T14:38:38.584067Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:38.584067Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:38.584073Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:38.584077Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:38.584084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:38.584061Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:38.584086Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:38.584223Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:38.643429Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602511585054689:3900]
2025-10-10T14:38:38.643847Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 pipe creation result: OK TabletId: 72075186224037892 Generation: 2726, pipe: [1:7559602511585054689:3900]
2025-10-10T14:38:38.700427Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:38.700695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:38.700713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:38.700758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602511585054689:3900], now have 1 active actors on pipe
2025-10-10T14:38:38.701032Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:38.701451Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:38:38.701498Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 25 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602511585054689:3900]
2025-10-10T14:38:38.701519Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:38.701552Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2727 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e66381f7-93033986-ec4c83fe-abc0f250_0
2025-10-10T14:38:38.701755Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2727 sessionId: src_id|e66381f7-93033986-ec4c83fe-abc0f250_0 is DEAD
2025-10-10T14:38:38.701914Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e66381f7-93033986-ec4c83fe-abc0f250_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:38:38.701926Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e66381f7-93033986-ec4c83fe-abc0f250_0] Write session will restart in 0.009359s
2025-10-10T14:38:38.701951Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e66381f7-93033986-ec4c83fe-abc0f250_0] Write session: Do CDS request
2025-10-10T14:38:38.701957Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e66381f7-93033986-ec4c83fe-abc0f250_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:38.711497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:38.712881Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e66381f7-93033986-ec4c83fe-abc0f250_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:38.712963Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:38.712982Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2728
2025-10-10T14:38:38.713136Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2728 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:38.713172Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2728 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:38.713183Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2728 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:38.713188Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:38.713660Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2728 sessionId:  describe result for acl check
2025-10-10T14:38:38.713696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:38.713703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:38.713705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:38.713711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602511585054722:4646] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:38.714398Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602511585054722:4646] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:38.714863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:38.715111Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:38.715122Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:38.715134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:38.715188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:38.715234Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602510802815495:9304]
2025-10-10T14:38:38.715840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:38.716415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:38.716488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:38.716649Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602511585054722:4646] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:38.716880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:38.716979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:38.716987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:38.716988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:38.716990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:38.716991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:38.716992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:38.716994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:38.716995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:38.716996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:38.716998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:38.716999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:38.717000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:38.717001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:38.717008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:38.717021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:38.717026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:38.717033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:38.717037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:38.717041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:38.717045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:38.717050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:38.717054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:38.717058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:38.717062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:38.717066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:38.717070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:38.717080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:38.717090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:38.717097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:38.717104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:38.717109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:38.717115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:38.717119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:38.717124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:38.717129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:38.717133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:38.717138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:38.717144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:38.717149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:38.717154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:38.717159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:38.717165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:38.717170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:38.717175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:38.717179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:38.717185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:38.717189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:38.717195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:38.717200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:38.717206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:38.717211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:38.717216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:38.717257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:38.719843Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602511585054722:4646] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:38.719840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:38.719861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602511585054722:4646] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:38.719866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602511585054722:4646] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:38.719875Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2728 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:38.720494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:38.720514Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:38.720517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:38.720521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:38.720527Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2727 [2:7559602510802815495:9304]
2025-10-10T14:38:38.720539Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:38.720557Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:38.720560Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:38.720564Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:38.720566Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:38.720586Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:38.720593Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:38.720600Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:38.720668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:38.720681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:38.720682Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:38.720686Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:38.720763Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:38.720771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:38.720784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:38.720802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:38.720821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:38.720850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602511585054691:2438], now have 1 active actors on pipe
2025-10-10T14:38:38.720859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602511585054755:4646], now have 1 active actors on pipe
2025-10-10T14:38:38.720867Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602510802815489:9304]
2025-10-10T14:38:38.720874Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602510802815489:9304]
2025-10-10T14:38:38.720876Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602510802815489:9304]
2025-10-10T14:38:38.720893Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:38.720908Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:38.720911Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:38.720912Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:38.720914Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:38.720928Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:38.720932Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:38.720898Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2727
2025-10-10T14:38:38.720901Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2727
2025-10-10T14:38:38.720967Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602510802815489:9304]
2025-10-10T14:38:38.720979Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:38.720986Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:38.720994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:38.720999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:38.721049Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f251b5e0-44c63f04-eda315b7-eda4eb9c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:38.721062Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:38.721067Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:38.721069Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:38.721081Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:38.721093Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:38.721112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:38.721317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:38.721346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:38.721365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:38.721468Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2728 partition: 0 MaxSeqNo: 40 sessionId: src_id|f251b5e0-44c63f04-eda315b7-eda4eb9c_0
2025-10-10T14:38:38.721892Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e66381f7-93033986-ec4c83fe-abc0f250_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|f251b5e0-44c63f04-eda315b7-eda4eb9c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:38.724859Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f251b5e0-44c63f04-eda315b7-eda4eb9c_0] Write session: try to update token
2025-10-10T14:38:38.724876Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f251b5e0-44c63f04-eda315b7-eda4eb9c_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:38.741189Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:38.741210Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:38.741214Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:38.741216Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:38.741226Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602510802815489:9304]
2025-10-10T14:38:38.741231Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602510802815489:9304]
2025-10-10T14:38:38.741236Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602510802815489:9304]
2025-10-10T14:38:38.741285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:38.741294Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:38.741295Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:38.741297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:38.741302Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:38.741307Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:38.741453Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:38.748749Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2728 sessionId: src_id|f251b5e0-44c63f04-eda315b7-eda4eb9c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:38.751536Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:38.809478Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602511585054764:3900]
2025-10-10T14:38:38.813468Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 pipe creation result: OK TabletId: 72075186224037892 Generation: 2727, pipe: [1:7559602511585054764:3900]
2025-10-10T14:38:38.859420Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:38.859859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:38.859879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:38.859924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602511585054764:3900], now have 1 active actors on pipe
2025-10-10T14:38:38.860148Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:38.860508Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:38.860514Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 26 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602511585054764:3900]
2025-10-10T14:38:38.860538Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:38:38.860609Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2728 reason: status is not ok: tablet will be restarted right now sessionId: src_id|f251b5e0-44c63f04-eda315b7-eda4eb9c_0
2025-10-10T14:38:38.860835Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2728 sessionId: src_id|f251b5e0-44c63f04-eda315b7-eda4eb9c_0 is DEAD
2025-10-10T14:38:38.861005Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f251b5e0-44c63f04-eda315b7-eda4eb9c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:38:38.861015Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f251b5e0-44c63f04-eda315b7-eda4eb9c_0] Write session will restart in 0.005043s
2025-10-10T14:38:38.861033Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f251b5e0-44c63f04-eda315b7-eda4eb9c_0] Write session: Do CDS request
2025-10-10T14:38:38.861038Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f251b5e0-44c63f04-eda315b7-eda4eb9c_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:38.866871Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f251b5e0-44c63f04-eda315b7-eda4eb9c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:38.866926Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:38.866952Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2729
2025-10-10T14:38:38.867089Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2729 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:38.867144Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2729 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:38.867155Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2729 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:38.867159Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:38.867653Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2729 sessionId:  describe result for acl check
2025-10-10T14:38:38.867705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:38.867713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:38.867715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:38.867721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602511585054787:4698] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:38.868316Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602511585054787:4698] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:38.870327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:38.870864Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602511585054787:4698] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:38.873434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:38.873692Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:38.873703Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:38.873715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:38.873754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602511585054787:4698] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:38.873785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:38.873769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602511585054787:4698] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:38.873773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602511585054787:4698] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:38.873790Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2729 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:38.873848Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602510802815563:9302]
2025-10-10T14:38:38.874438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:38.874761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:38.874818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:38.875159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:38.875219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:38.875226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:38.875227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:38.875228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:38.875230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:38.875230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:38.875232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:38.875233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:38.875234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:38.875235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:38.875236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:38.875237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:38.875239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:38.875244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:38.875257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:38.875261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:38.875265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:38.875269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:38.875273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:38.875276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:38.875279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:38.875283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:38.875287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:38.875291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:38.875295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:38.875298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:38.875309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:38.875317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:38.875323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:38.875333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:38.875337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:38.875342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:38.875358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:38.875363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:38.875368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:38.875372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:38.875375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:38.875380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:38.875384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:38.875389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:38.875394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:38.875399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:38.875403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:38.875408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:38.875411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:38.875416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:38.875420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:38.875424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:38.875428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:38.875432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:38.875439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:38.875443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:38.875477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:38.878053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:38.878425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:38.878436Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:38.878439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:38.878443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:38.878449Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2728 [2:7559602510802815563:9302]
2025-10-10T14:38:38.878467Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:38.878486Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:38.878494Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:38.878498Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:38.878500Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:38.878518Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:38.878531Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:38.878538Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:38.878601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:38.878608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:38.878611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:38.878613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:38.878686Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:38.878693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:38.878706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:38.878718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:38.878740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:38.878770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602511585054833:4698], now have 1 active actors on pipe
2025-10-10T14:38:38.878778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602511585054771:2438], now have 1 active actors on pipe
2025-10-10T14:38:38.878787Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602510802815557:9302]
2025-10-10T14:38:38.878789Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602510802815557:9302]
2025-10-10T14:38:38.878791Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602510802815557:9302]
2025-10-10T14:38:38.878806Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:38.878826Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:38.878820Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2728
2025-10-10T14:38:38.878849Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:38.878820Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2728
2025-10-10T14:38:38.878859Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:38.878857Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:38.878862Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:38.878864Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:38.878889Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602510802815557:9302]
2025-10-10T14:38:38.878891Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:38.878898Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:38.878919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:38.878929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:38.878973Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ec43b937-858e0b48-376b3de2-66141909_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:38.878985Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:38.878989Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:38.878992Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:38.879003Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:38.879019Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:38.879038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:38.879177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:38.879186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:38.879200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:38.879333Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2729 partition: 0 MaxSeqNo: 40 sessionId: src_id|ec43b937-858e0b48-376b3de2-66141909_0
2025-10-10T14:38:38.879746Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f251b5e0-44c63f04-eda315b7-eda4eb9c_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|ec43b937-858e0b48-376b3de2-66141909_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:38.882585Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ec43b937-858e0b48-376b3de2-66141909_0] Write session: try to update token
2025-10-10T14:38:38.882605Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ec43b937-858e0b48-376b3de2-66141909_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:38.899037Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2729 sessionId: src_id|ec43b937-858e0b48-376b3de2-66141909_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:38.901684Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:38.902001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:38.902021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:38.902066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:38:38.902151Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:38:38.905670Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:38.905687Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:38.905690Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:38.905692Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:38.905702Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602510802815557:9302]
2025-10-10T14:38:38.905706Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602510802815557:9302]
2025-10-10T14:38:38.905714Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602510802815557:9302]
2025-10-10T14:38:38.905763Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:38.905768Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:38.905775Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:38.905776Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:38.905777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:38.905781Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:38.905928Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:38.960849Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602511585054844:3900]
2025-10-10T14:38:38.961161Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 pipe creation result: OK TabletId: 72075186224037892 Generation: 2728, pipe: [1:7559602511585054844:3900]
2025-10-10T14:38:39.019437Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:39.028216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:39.028247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:39.028428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:39.028496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:39.028565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:39.028635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:39.029022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:39.029033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:39.029104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:39.029165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:39.029230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:39.029297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:39.029375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:39.029385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:39.029461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:39.029526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:39.029595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:39.029668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:39.029717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:39.029721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:39.029792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:39.029868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:39.029949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:39.030021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:39.030066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:39.030074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:39.030143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:39.030210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:39.030282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:39.030363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:39.032739Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec43b937-858e0b48-376b3de2-66141909_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:39.032751Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec43b937-858e0b48-376b3de2-66141909_0] Write session will restart in 0.009986s
2025-10-10T14:38:39.032778Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec43b937-858e0b48-376b3de2-66141909_0] Write session: Do CDS request
2025-10-10T14:38:39.032784Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec43b937-858e0b48-376b3de2-66141909_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:39.030411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:39.030420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:39.030496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:39.030559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:39.030622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:39.030685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:39.030725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:39.030728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:39.030805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:39.030861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:39.030929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:39.032330Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:39.030992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:39.032349Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:39.032383Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2729 reason: error at write: Disconnected sessionId: src_id|ec43b937-858e0b48-376b3de2-66141909_0
2025-10-10T14:38:39.032663Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2729 sessionId: src_id|ec43b937-858e0b48-376b3de2-66141909_0 is DEAD
2025-10-10T14:38:39.031035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:39.032924Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 27 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602511585054844:3900]
2025-10-10T14:38:39.031038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:39.031109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:39.031168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:39.032949Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:39.031231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:39.031296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:39.031336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:39.031339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:39.031415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:39.031475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:39.031542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:39.031608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:39.031649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:39.031652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:39.031722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:39.031787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:39.031847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:39.031911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:39.031956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:39.031959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:39.032041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602511585054844:3900], now have 1 active actors on pipe
2025-10-10T14:38:39.033072Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:39.043395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:39.043944Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ec43b937-858e0b48-376b3de2-66141909_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:39.044038Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:39.044057Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2730
2025-10-10T14:38:39.044232Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2730 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:39.044277Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2730 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:39.044287Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2730 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:39.044291Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:39.044832Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2730 sessionId:  describe result for acl check
2025-10-10T14:38:39.044872Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:39.044878Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:39.044881Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:39.044887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602515880022202:4758] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:39.045526Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602515880022202:4758] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:39.046393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:39.046610Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:39.046616Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:39.046628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:39.046681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:39.046722Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602515097782967:9281]
2025-10-10T14:38:39.047383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:39.047671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:39.047716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:39.048047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:39.048105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:39.048115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:39.048116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:39.048118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:39.048119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:39.048120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:39.048121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:39.048124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:39.048125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:39.048126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:39.048128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:39.048129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:39.048130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:39.048135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:39.048149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:39.048153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:39.048157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:39.048161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:39.048165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:39.048170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:39.048174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:39.048178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:39.048184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:39.048188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:39.048192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:39.048196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:39.048204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:39.048213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:39.048219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:39.048225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:39.048231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:39.048237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:39.048241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:39.048247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:39.048252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:39.048258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:39.048262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:39.048272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:39.048278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:39.048288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:39.048293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:39.048298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:39.048305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:39.048311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:39.048317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:39.048324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:39.048333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:39.048338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:39.048345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:39.048351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:39.048321Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602515880022202:4758] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:39.048355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:39.048362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:39.048403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:39.050824Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602515880022202:4758] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:39.050881Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602515880022202:4758] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:39.050889Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602515880022202:4758] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:39.050899Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2730 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:39.050903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:39.051553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:39.051565Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:39.051567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:39.051571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:39.051578Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2729 [2:7559602515097782967:9281]
2025-10-10T14:38:39.051594Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:39.051617Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:39.051621Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:39.051627Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:39.051629Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:39.051646Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:39.051656Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:39.051672Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:39.051730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:39.051753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:39.051756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:39.051758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:39.051824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:39.051834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:39.051847Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:39.051861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:39.051880Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:39.051902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602515880022232:4758], now have 1 active actors on pipe
2025-10-10T14:38:39.051911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602515880022169:2438], now have 1 active actors on pipe
2025-10-10T14:38:39.051919Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602515097782961:9281]
2025-10-10T14:38:39.051921Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602515097782961:9281]
2025-10-10T14:38:39.051924Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602515097782961:9281]
2025-10-10T14:38:39.051941Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:39.051926Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2729
2025-10-10T14:38:39.051936Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2729
2025-10-10T14:38:39.051956Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:39.051960Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:39.051964Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:39.051966Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:39.051978Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:39.051981Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:39.052023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:39.052034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:39.052049Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602515097782961:9281]
2025-10-10T14:38:39.052058Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:39.052071Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:39.052089Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f0fa443-e3ea11b9-3fa71a3d-e7da5009_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:39.052102Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:39.052110Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:39.052113Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:39.052124Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:39.052139Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:39.052163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:39.052337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:39.052351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:39.052375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:39.052491Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2730 partition: 0 MaxSeqNo: 40 sessionId: src_id|f0fa443-e3ea11b9-3fa71a3d-e7da5009_0
2025-10-10T14:38:39.052884Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec43b937-858e0b48-376b3de2-66141909_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|f0fa443-e3ea11b9-3fa71a3d-e7da5009_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:39.055604Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f0fa443-e3ea11b9-3fa71a3d-e7da5009_0] Write session: try to update token
2025-10-10T14:38:39.055622Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f0fa443-e3ea11b9-3fa71a3d-e7da5009_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:39.069647Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2730 sessionId: src_id|f0fa443-e3ea11b9-3fa71a3d-e7da5009_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:39.072108Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:39.072128Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:39.072131Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:39.072133Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:39.072143Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602515097782961:9281]
2025-10-10T14:38:39.072149Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602515097782961:9281]
2025-10-10T14:38:39.072152Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602515097782961:9281]
2025-10-10T14:38:39.072205Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:39.072213Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:39.072215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:39.072218Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:39.072223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:39.072226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:39.072219Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:39.072360Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:39.132919Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602515880022239:3900]
2025-10-10T14:38:39.133325Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 pipe creation result: OK TabletId: 72075186224037892 Generation: 2729, pipe: [1:7559602515880022239:3900]
2025-10-10T14:38:39.188931Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:39.189203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:39.189222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:39.189265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602515880022239:3900], now have 1 active actors on pipe
2025-10-10T14:38:39.189477Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:39.189583Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 28 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602515880022239:3900]
2025-10-10T14:38:39.189628Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:38:39.189709Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2730 reason: status is not ok: tablet will be restarted right now sessionId: src_id|f0fa443-e3ea11b9-3fa71a3d-e7da5009_0
2025-10-10T14:38:39.189941Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2730 sessionId: src_id|f0fa443-e3ea11b9-3fa71a3d-e7da5009_0 is DEAD
2025-10-10T14:38:39.190081Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f0fa443-e3ea11b9-3fa71a3d-e7da5009_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:38:39.190094Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f0fa443-e3ea11b9-3fa71a3d-e7da5009_0] Write session will restart in 0.009327s
2025-10-10T14:38:39.190120Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f0fa443-e3ea11b9-3fa71a3d-e7da5009_0] Write session: Do CDS request
2025-10-10T14:38:39.190108Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:39.190126Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f0fa443-e3ea11b9-3fa71a3d-e7da5009_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:39.200921Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f0fa443-e3ea11b9-3fa71a3d-e7da5009_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:39.201013Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:39.201033Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2731
2025-10-10T14:38:39.201172Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2731 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:39.201214Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2731 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:39.201220Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2731 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:39.201224Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:39.201748Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2731 sessionId:  describe result for acl check
2025-10-10T14:38:39.202403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:39.201794Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:39.201805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:39.201807Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:39.201813Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602515880022273:4809] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:39.202429Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602515880022273:4809] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:39.205226Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602515880022273:4809] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:39.205916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:39.206340Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:39.206355Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:39.206373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:39.206472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:39.206517Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602515097783040:9261]
2025-10-10T14:38:39.207160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:39.207506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:39.207557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:39.207897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:39.207967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:39.207974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:39.207975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:39.207976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:39.207978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:39.207979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:39.207981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:39.207982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:39.207983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:39.207984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:39.207985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:39.207986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:39.207987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:39.207994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:39.208006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:39.208010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:39.208014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:39.208018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:39.208022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:39.208025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:39.208029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:39.208033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:39.208037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:39.208040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:39.208047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:39.208051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:39.208059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:39.208069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:39.208076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:39.208082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:39.208086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:39.208091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:39.208096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:39.208101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:39.208106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:39.208112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:39.208118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:39.208124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:39.208128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:39.208134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:39.208138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:39.208144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:39.208148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:39.208153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:39.208158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:39.208164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:39.208168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:39.208173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:39.208178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:39.208183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:39.208187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:39.208193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:39.208234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:39.208418Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602515880022273:4809] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:39.208438Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602515880022273:4809] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:39.208441Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602515880022273:4809] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:39.208450Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2731 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:39.210723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:39.211254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:39.211266Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:39.211271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:39.211274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:39.211281Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2730 [2:7559602515097783040:9261]
2025-10-10T14:38:39.211296Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:39.211315Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:39.211322Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:39.211326Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:39.211328Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:39.211347Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:39.211363Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:39.211371Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:39.211443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:39.211450Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:39.211452Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:39.211455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:39.211525Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:39.211530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:39.211542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:39.211553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:39.211576Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:39.211601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602515880022307:4809], now have 1 active actors on pipe
2025-10-10T14:38:39.211609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602515880022242:2438], now have 1 active actors on pipe
2025-10-10T14:38:39.211618Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602515097783035:9261]
2025-10-10T14:38:39.211620Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602515097783035:9261]
2025-10-10T14:38:39.211622Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602515097783035:9261]
2025-10-10T14:38:39.211641Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:39.211655Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:39.211672Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:39.211679Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:39.211706Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602515097783035:9261]
2025-10-10T14:38:39.211715Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:39.211692Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2730
2025-10-10T14:38:39.211695Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2730
2025-10-10T14:38:39.211744Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:39.211755Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:39.211758Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:39.211766Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:39.211847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:39.211870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:39.211920Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|70f47949-e9ef24d3-85059ac8-64fa42bc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:39.211939Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:39.211945Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:39.211948Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:39.211961Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:39.211975Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:39.212009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:39.212394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:39.212408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:39.212432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:39.212570Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2731 partition: 0 MaxSeqNo: 40 sessionId: src_id|70f47949-e9ef24d3-85059ac8-64fa42bc_0
2025-10-10T14:38:39.213027Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f0fa443-e3ea11b9-3fa71a3d-e7da5009_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|70f47949-e9ef24d3-85059ac8-64fa42bc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:39.215931Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|70f47949-e9ef24d3-85059ac8-64fa42bc_0] Write session: try to update token
2025-10-10T14:38:39.215954Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|70f47949-e9ef24d3-85059ac8-64fa42bc_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:39.224192Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:38:39.224221Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:39.224235Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602515097783035:9261]
2025-10-10T14:38:39.224292Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:38:39.224295Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:38:39.225584Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:38:39.225808Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:39.226028Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:39.226237Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:39.226528Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:38:39.226595Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:38:39.234706Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2731 sessionId: src_id|70f47949-e9ef24d3-85059ac8-64fa42bc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:39.237495Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:39.238090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:39.238123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:39.238167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:38:39.238278Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:38:39.242607Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:39.242628Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:39.242632Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:39.242634Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:39.242646Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602515097783035:9261]
2025-10-10T14:38:39.242651Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602515097783035:9261]
2025-10-10T14:38:39.242658Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602515097783035:9261]
2025-10-10T14:38:39.242713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:39.242720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:39.242723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:39.242723Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:39.242730Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:39.242742Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:39.242868Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:39.290084Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602515880022316:3900]
2025-10-10T14:38:39.290403Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 pipe creation result: OK TabletId: 72075186224037892 Generation: 2730, pipe: [1:7559602515880022316:3900]
2025-10-10T14:38:39.362967Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:39.371575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:39.371613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:39.371800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:39.371871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:39.371946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:39.372021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:39.372075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:39.372085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:39.372162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:39.372228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:39.372293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:39.372357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:39.372409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:39.372419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:39.372492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:39.372557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:39.372629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:39.372687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:39.372728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:39.372734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:39.372806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:39.372864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:39.372927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:39.372987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:39.373030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:39.373034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:39.373103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:39.373163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:39.373224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:39.373284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:39.373325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:39.373459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:39.373540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:39.373605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:39.373669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:39.373730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:39.373780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:39.373788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:39.373873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:39.373934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:39.374106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:39.374188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:39.374234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:39.374246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:39.374514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:39.374576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:39.374641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:39.374710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:39.374756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:39.374763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:39.374829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:39.374892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:39.374958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:39.375026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:39.375095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:39.375102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:39.375173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:39.375239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:39.375385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:39.375528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:39.375585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:39.375594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:39.375660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602515880022316:3900], now have 1 active actors on pipe
2025-10-10T14:38:39.375920Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:39.375924Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:39.375928Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:39.375961Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2731 reason: error at write: Disconnected sessionId: src_id|70f47949-e9ef24d3-85059ac8-64fa42bc_0
2025-10-10T14:38:39.375993Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 29 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602515880022316:3900]
2025-10-10T14:38:39.376240Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2731 sessionId: src_id|70f47949-e9ef24d3-85059ac8-64fa42bc_0 is DEAD
2025-10-10T14:38:39.376418Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|70f47949-e9ef24d3-85059ac8-64fa42bc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:39.376428Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|70f47949-e9ef24d3-85059ac8-64fa42bc_0] Write session will restart in 0.007893s
2025-10-10T14:38:39.376454Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|70f47949-e9ef24d3-85059ac8-64fa42bc_0] Write session: Do CDS request
2025-10-10T14:38:39.376460Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|70f47949-e9ef24d3-85059ac8-64fa42bc_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:39.376893Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:39.385911Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|70f47949-e9ef24d3-85059ac8-64fa42bc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:39.385965Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:39.385991Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2732
2025-10-10T14:38:39.386153Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2732 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:39.386189Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2732 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:39.386199Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2732 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:39.386204Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:39.386644Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2732 sessionId:  describe result for acl check
2025-10-10T14:38:39.386679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:39.386686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:39.386688Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:39.386695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602515880022351:4827] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:39.387246Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602515880022351:4827] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:39.387407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:39.390359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:39.390595Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602515880022351:4827] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:39.390643Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:39.390654Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:39.390668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:39.390738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:39.390797Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602515097783112:9269]
2025-10-10T14:38:39.391415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:39.391753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:39.391842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:39.392214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:39.392308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:39.392316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:39.392318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:39.392319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:39.392320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:39.392321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:39.392323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:39.392324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:39.392325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:39.392326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:39.392327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:39.392329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:39.392330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:39.392336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:39.392349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:39.392354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:39.392358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:39.392362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:39.392367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:39.392378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:39.392388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:39.392392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:39.392396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:39.392400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:39.392404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:39.392408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:39.392416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:39.392426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:39.392432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:39.392438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:39.392443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:39.392449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:39.392454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:39.392459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:39.392464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:39.392470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:39.392475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:39.392481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:39.392485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:39.392490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:39.392495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:39.392501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:39.392505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:39.392511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:39.392523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:39.392528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:39.392533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:39.392547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:39.392552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:39.392557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:39.392566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:39.392571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:39.392616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:39.393187Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602515880022351:4827] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:39.393203Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602515880022351:4827] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:39.393206Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602515880022351:4827] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:39.393215Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2732 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:39.395086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:39.395686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:39.395704Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:39.395707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:39.395711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:39.395717Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2731 [2:7559602515097783112:9269]
2025-10-10T14:38:39.395730Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:39.395747Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:39.395756Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:39.395759Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:39.395762Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:39.395780Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:39.395801Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:39.395812Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:39.395882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:39.395889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:39.395891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:39.395894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:39.395967Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:39.395975Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:39.395988Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:39.396005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:39.396027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:39.396061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602515880022319:2438], now have 1 active actors on pipe
2025-10-10T14:38:39.396067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602515880022387:4827], now have 1 active actors on pipe
2025-10-10T14:38:39.396075Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602515097783106:9269]
2025-10-10T14:38:39.396081Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602515097783106:9269]
2025-10-10T14:38:39.396083Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602515097783106:9269]
2025-10-10T14:38:39.396097Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:39.396111Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:39.396114Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:39.396116Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:39.396117Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:39.396104Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2731
2025-10-10T14:38:39.396135Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:39.396139Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:39.396144Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2731
2025-10-10T14:38:39.396166Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602515097783106:9269]
2025-10-10T14:38:39.396174Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:39.396175Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:39.396197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:39.396206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:39.396258Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|871c3658-b52aa63b-acb8bc18-a9609934_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:39.396271Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:39.396275Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:39.396277Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:39.396288Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:39.396318Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:39.396339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:39.396534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:39.396551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:39.396575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:39.396716Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2732 partition: 0 MaxSeqNo: 40 sessionId: src_id|871c3658-b52aa63b-acb8bc18-a9609934_0
2025-10-10T14:38:39.397090Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|70f47949-e9ef24d3-85059ac8-64fa42bc_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|871c3658-b52aa63b-acb8bc18-a9609934_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:39.399899Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|871c3658-b52aa63b-acb8bc18-a9609934_0] Write session: try to update token
2025-10-10T14:38:39.399922Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|871c3658-b52aa63b-acb8bc18-a9609934_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:39.415961Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:39.415984Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:39.415988Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:39.415990Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:39.416001Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602515097783106:9269]
2025-10-10T14:38:39.416009Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602515097783106:9269]
2025-10-10T14:38:39.416013Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602515097783106:9269]
2025-10-10T14:38:39.416072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:39.416072Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:39.416080Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:39.416085Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:39.416086Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:39.416089Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:39.416328Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:39.420747Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2732 sessionId: src_id|871c3658-b52aa63b-acb8bc18-a9609934_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:39.423545Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:39.476430Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602515880022394:3900]
2025-10-10T14:38:39.477691Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 pipe creation result: OK TabletId: 72075186224037892 Generation: 2731, pipe: [1:7559602515880022394:3900]
2025-10-10T14:38:39.532640Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:39.533063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:39.533093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:39.533141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602515880022394:3900], now have 1 active actors on pipe
2025-10-10T14:38:39.533417Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:39.533373Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:39.533390Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 30 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602515880022394:3900]
2025-10-10T14:38:39.533416Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:39.533419Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:39.533506Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2732 reason: error at write: Disconnected sessionId: src_id|871c3658-b52aa63b-acb8bc18-a9609934_0
2025-10-10T14:38:39.533749Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2732 sessionId: src_id|871c3658-b52aa63b-acb8bc18-a9609934_0 is DEAD
2025-10-10T14:38:39.533917Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|871c3658-b52aa63b-acb8bc18-a9609934_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:39.533944Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|871c3658-b52aa63b-acb8bc18-a9609934_0] Write session will restart in 0.007279s
2025-10-10T14:38:39.533969Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|871c3658-b52aa63b-acb8bc18-a9609934_0] Write session: Do CDS request
2025-10-10T14:38:39.533977Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|871c3658-b52aa63b-acb8bc18-a9609934_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:39.543041Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|871c3658-b52aa63b-acb8bc18-a9609934_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:39.543112Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:39.543142Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2733
2025-10-10T14:38:39.543308Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2733 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:39.543347Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2733 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:39.543354Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2733 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:39.543357Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:39.543863Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2733 sessionId:  describe result for acl check
2025-10-10T14:38:39.543905Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:39.543912Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:39.543914Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:39.543920Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602515880022442:4862] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:39.543902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:39.544510Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602515880022442:4862] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:39.546681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:39.546914Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:39.546924Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:39.546935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:39.546736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602515880022442:4862] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:39.546989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:39.547033Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602515097783197:9267]
2025-10-10T14:38:39.547574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:39.547857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:39.547902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:39.548233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:39.548285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:39.548290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:39.548291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:39.548291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:39.548294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:39.548294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:39.548295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:39.548296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:39.548296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:39.548297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:39.548298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:39.548298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:39.548299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:39.548303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:39.548314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:39.548318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:39.548323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:39.548326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:39.548330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:39.548334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:39.548338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:39.548342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:39.548347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:39.548351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:39.548354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:39.548359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:39.548365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:39.548374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:39.548381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:39.548386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:39.548391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:39.548397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:39.548402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:39.548407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:39.548412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:39.548419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:39.548424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:39.548429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:39.548433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:39.548438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:39.548442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:39.548453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:39.548457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:39.548462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:39.548471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:39.548475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:39.548480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:39.548489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:39.548494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:39.548499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:39.548503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:39.548512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:39.548547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:39.551027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:39.551130Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602515880022442:4862] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:39.551146Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602515880022442:4862] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:39.551150Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602515880022442:4862] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:39.551159Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2733 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:39.551631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:39.551645Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:39.551647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:39.551651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:39.551657Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2732 [2:7559602515097783197:9267]
2025-10-10T14:38:39.551669Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:39.551689Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:39.551692Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:39.551696Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:39.551698Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:39.551715Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:39.551727Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:39.551735Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:39.551795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:39.551802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:39.551804Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:39.551807Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:39.551870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:39.551878Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:39.551889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:39.551907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:39.551932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:39.551955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602515880022477:4862], now have 1 active actors on pipe
2025-10-10T14:38:39.551960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602515880022408:2438], now have 1 active actors on pipe
2025-10-10T14:38:39.551967Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602515097783191:9267]
2025-10-10T14:38:39.551976Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602515097783191:9267]
2025-10-10T14:38:39.551977Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602515097783191:9267]
2025-10-10T14:38:39.551991Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:39.552006Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:39.552017Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2732
2025-10-10T14:38:39.552010Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:39.552014Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:39.552038Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2732
2025-10-10T14:38:39.552016Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:39.552023Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:39.552026Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:39.552052Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602515097783191:9267]
2025-10-10T14:38:39.552057Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:39.552059Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:39.552077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:39.552081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:39.552129Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7f138913-6ee690ff-18c361a5-e4de0544_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:39.552143Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:39.552147Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:39.552149Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:39.552162Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:39.552171Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:39.552191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:39.552326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:39.552334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:39.552349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:39.552424Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2733 partition: 0 MaxSeqNo: 40 sessionId: src_id|7f138913-6ee690ff-18c361a5-e4de0544_0
2025-10-10T14:38:39.552822Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|871c3658-b52aa63b-acb8bc18-a9609934_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|7f138913-6ee690ff-18c361a5-e4de0544_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:39.555634Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7f138913-6ee690ff-18c361a5-e4de0544_0] Write session: try to update token
2025-10-10T14:38:39.555652Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7f138913-6ee690ff-18c361a5-e4de0544_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:39.570565Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2733 sessionId: src_id|7f138913-6ee690ff-18c361a5-e4de0544_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:39.572255Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:39.572274Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:39.572277Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:39.572279Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:39.572290Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602515097783191:9267]
2025-10-10T14:38:39.572294Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602515097783191:9267]
2025-10-10T14:38:39.572298Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602515097783191:9267]
2025-10-10T14:38:39.572351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:39.572367Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:39.572369Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:39.572505Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:39.573230Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:39.573364Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:39.573377Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:39.573382Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:39.634724Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602515880022484:3900]
2025-10-10T14:38:39.637178Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 pipe creation result: OK TabletId: 72075186224037892 Generation: 2732, pipe: [1:7559602515880022484:3900]
2025-10-10T14:38:39.691939Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:39.692404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:39.692434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:39.692490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602515880022484:3900], now have 1 active actors on pipe
2025-10-10T14:38:39.692742Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:39.693074Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 31 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602515880022484:3900]
2025-10-10T14:38:39.693111Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:39.693114Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:39.693169Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2733 reason: error at write: Disconnected sessionId: src_id|7f138913-6ee690ff-18c361a5-e4de0544_0
2025-10-10T14:38:39.693376Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2733 sessionId: src_id|7f138913-6ee690ff-18c361a5-e4de0544_0 is DEAD
2025-10-10T14:38:39.693404Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:39.693704Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f138913-6ee690ff-18c361a5-e4de0544_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:39.693719Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f138913-6ee690ff-18c361a5-e4de0544_0] Write session will restart in 0.006951s
2025-10-10T14:38:39.693746Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f138913-6ee690ff-18c361a5-e4de0544_0] Write session: Do CDS request
2025-10-10T14:38:39.693753Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f138913-6ee690ff-18c361a5-e4de0544_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:39.701939Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7f138913-6ee690ff-18c361a5-e4de0544_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:39.702110Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:39.702127Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2734
2025-10-10T14:38:39.702339Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2734 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:39.702380Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2734 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:39.702385Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2734 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:39.702389Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:39.702908Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2734 sessionId:  describe result for acl check
2025-10-10T14:38:39.702956Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:39.702964Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:39.702966Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:39.702973Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602515880022521:4891] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:39.703584Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602515880022521:4891] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:39.705763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602515880022521:4891] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:39.706428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:39.710281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:39.710560Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:39.710577Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:39.710593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:39.710602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602515880022521:4891] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:39.710619Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602515880022521:4891] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:39.710623Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602515880022521:4891] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:39.710633Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2734 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:39.710670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:39.710720Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602515097783271:9258]
2025-10-10T14:38:39.711336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:39.711674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:39.711733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:39.712102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:39.712185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:39.712192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:39.712193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:39.712195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:39.712197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:39.712198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:39.712200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:39.712202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:39.712203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:39.712204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:39.712206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:39.712207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:39.712209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:39.712215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:39.712229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:39.712233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:39.712237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:39.712241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:39.712246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:39.712250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:39.712255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:39.712259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:39.712264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:39.712268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:39.712272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:39.712276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:39.712286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:39.712296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:39.712312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:39.712318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:39.712323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:39.712329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:39.712338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:39.712344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:39.712355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:39.712371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:39.712376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:39.712382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:39.712388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:39.712393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:39.712398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:39.712403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:39.712409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:39.712414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:39.712419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:39.712424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:39.712432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:39.712438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:39.712442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:39.712448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:39.712459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:39.712464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:39.712505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:39.715644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:39.716183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:39.716197Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:39.716200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:39.716206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:39.716214Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2733 [2:7559602515097783271:9258]
2025-10-10T14:38:39.716230Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:39.716252Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:39.716260Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:39.716264Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:39.716267Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:39.716286Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:39.716306Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:39.716316Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:39.716378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:39.716386Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:39.716388Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:39.716390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:39.716470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:39.716479Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:39.716493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:39.716505Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:39.716527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:39.716555Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602515097783266:9258]
2025-10-10T14:38:39.716562Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602515097783266:9258]
2025-10-10T14:38:39.716564Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602515097783266:9258]
2025-10-10T14:38:39.716594Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:39.716604Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:39.716608Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:39.716610Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:39.716613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602515880022553:4891], now have 1 active actors on pipe
2025-10-10T14:38:39.716617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602515880022488:2438], now have 1 active actors on pipe
2025-10-10T14:38:39.716626Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:39.716649Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:39.716657Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:39.716693Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602515097783266:9258]
2025-10-10T14:38:39.716705Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:39.716716Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:39.716693Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2733
2025-10-10T14:38:39.716733Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2733
2025-10-10T14:38:39.716997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:39.717010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:39.717052Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a6b8a3bc-7a94fb89-de666813-7d6e3d88_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:39.717067Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:39.717072Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:39.717075Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:39.717088Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:39.717101Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:39.717125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:39.718078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:39.718091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:39.718115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:39.718209Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2734 partition: 0 MaxSeqNo: 40 sessionId: src_id|a6b8a3bc-7a94fb89-de666813-7d6e3d88_0
2025-10-10T14:38:39.718629Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f138913-6ee690ff-18c361a5-e4de0544_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|a6b8a3bc-7a94fb89-de666813-7d6e3d88_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:39.726129Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a6b8a3bc-7a94fb89-de666813-7d6e3d88_0] Write session: try to update token
2025-10-10T14:38:39.726156Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a6b8a3bc-7a94fb89-de666813-7d6e3d88_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:39.738999Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:39.739023Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:39.739027Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:39.739030Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:39.739041Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602515097783266:9258]
2025-10-10T14:38:39.739046Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602515097783266:9258]
2025-10-10T14:38:39.739051Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602515097783266:9258]
2025-10-10T14:38:39.739110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:39.739129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:39.739132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:39.739143Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:39.739153Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:39.739166Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:39.739286Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:39.745454Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2734 sessionId: src_id|a6b8a3bc-7a94fb89-de666813-7d6e3d88_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:39.748144Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:39.793393Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602515880022567:3900]
2025-10-10T14:38:39.798494Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 pipe creation result: OK TabletId: 72075186224037892 Generation: 2733, pipe: [1:7559602515880022567:3900]
2025-10-10T14:38:39.863154Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:39.863574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:39.863591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:39.863616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602515880022567:3900], now have 1 active actors on pipe
2025-10-10T14:38:39.863891Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:39.863885Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 32 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602515880022567:3900]
2025-10-10T14:38:39.863921Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:39.863924Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:39.864001Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2734 reason: error at write: Disconnected sessionId: src_id|a6b8a3bc-7a94fb89-de666813-7d6e3d88_0
2025-10-10T14:38:39.864185Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2734 sessionId: src_id|a6b8a3bc-7a94fb89-de666813-7d6e3d88_0 is DEAD
2025-10-10T14:38:39.864276Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:39.864343Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a6b8a3bc-7a94fb89-de666813-7d6e3d88_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:39.864356Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a6b8a3bc-7a94fb89-de666813-7d6e3d88_0] Write session will restart in 0.007948s
2025-10-10T14:38:39.864384Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a6b8a3bc-7a94fb89-de666813-7d6e3d88_0] Write session: Do CDS request
2025-10-10T14:38:39.864394Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a6b8a3bc-7a94fb89-de666813-7d6e3d88_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:39.873934Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a6b8a3bc-7a94fb89-de666813-7d6e3d88_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:39.874038Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:39.874066Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2735
2025-10-10T14:38:39.874220Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2735 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:39.874279Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2735 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:39.874290Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2735 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:39.874294Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:39.874837Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2735 sessionId:  describe result for acl check
2025-10-10T14:38:39.874877Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:39.874883Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:39.874885Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:39.874892Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602515880022614:4925] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:39.874936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:39.875473Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602515880022614:4925] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:39.878151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:39.878208Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602515880022614:4925] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:39.878394Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:39.878407Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:39.878419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:39.878476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:39.878522Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602515097783346:9254]
2025-10-10T14:38:39.879189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:39.879512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:39.879556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:39.879901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:39.879961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:39.879968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:39.879970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:39.879971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:39.879972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:39.879974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:39.879975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:39.879976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:39.879977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:39.879979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:39.879980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:39.879982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:39.879983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:39.879989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:39.880003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:39.880008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:39.880015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:39.880019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:39.880023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:39.880027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:39.880031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:39.880035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:39.880040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:39.880043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:39.880047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:39.880051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:39.880058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:39.880067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:39.880074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:39.880080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:39.880085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:39.880090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:39.880095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:39.880101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:39.880106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:39.880111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:39.880116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:39.880122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:39.880128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:39.880134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:39.880145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:39.880150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:39.880155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:39.880161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:39.880167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:39.880173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:39.880178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:39.880184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:39.880189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:39.880194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:39.880199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:39.880205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:39.880246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:39.881220Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602515880022614:4925] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:39.881237Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602515880022614:4925] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:39.881241Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602515880022614:4925] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:39.881250Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2735 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:39.882779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:39.883498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:39.883510Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:39.883513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:39.883517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:39.883523Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2734 [2:7559602515097783346:9254]
2025-10-10T14:38:39.883539Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:39.883558Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:39.883570Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:39.883574Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:39.883577Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:39.883597Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:39.883605Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:39.883617Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:39.883683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:39.883691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:39.883692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:39.883695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:39.883765Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:39.883773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:39.883786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:39.883799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:39.883823Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:39.883850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602515880022649:4925], now have 1 active actors on pipe
2025-10-10T14:38:39.883854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602515880022577:2438], now have 1 active actors on pipe
2025-10-10T14:38:39.883863Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602515097783340:9254]
2025-10-10T14:38:39.883865Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602515097783340:9254]
2025-10-10T14:38:39.883867Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602515097783340:9254]
2025-10-10T14:38:39.883881Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:39.883894Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:39.883904Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:39.883883Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2734
2025-10-10T14:38:39.883908Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:39.883911Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:39.883917Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:39.883920Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:39.883950Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602515097783340:9254]
2025-10-10T14:38:39.883963Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:39.883974Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:39.884015Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2734
2025-10-10T14:38:39.884094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:39.884111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:39.884144Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8ab2bfb6-a499609b-a8784c5e-d7ca5e8d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:39.884160Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:39.884164Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:39.884167Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:39.884181Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:39.884212Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:39.884233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:39.884426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:39.884436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:39.884463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:39.884637Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2735 partition: 0 MaxSeqNo: 40 sessionId: src_id|8ab2bfb6-a499609b-a8784c5e-d7ca5e8d_0
2025-10-10T14:38:39.885059Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a6b8a3bc-7a94fb89-de666813-7d6e3d88_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|8ab2bfb6-a499609b-a8784c5e-d7ca5e8d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:39.888188Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8ab2bfb6-a499609b-a8784c5e-d7ca5e8d_0] Write session: try to update token
2025-10-10T14:38:39.888208Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8ab2bfb6-a499609b-a8784c5e-d7ca5e8d_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:39.903190Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2735 sessionId: src_id|8ab2bfb6-a499609b-a8784c5e-d7ca5e8d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:39.903811Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:39.903835Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:39.903838Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:39.903840Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:39.903849Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602515097783340:9254]
2025-10-10T14:38:39.903853Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602515097783340:9254]
2025-10-10T14:38:39.903858Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602515097783340:9254]
2025-10-10T14:38:39.903910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:39.903915Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:39.903921Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:39.903923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:39.903926Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:39.903926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:39.904103Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:39.906035Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:39.965401Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602515880022656:3900]
2025-10-10T14:38:39.965755Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 pipe creation result: OK TabletId: 72075186224037892 Generation: 2734, pipe: [1:7559602515880022656:3900]
2025-10-10T14:38:40.021838Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:40.022090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:40.022099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:40.022146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602515880022656:3900], now have 1 active actors on pipe
2025-10-10T14:38:40.022341Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:40.022394Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:40.022397Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:40.022396Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:40.022459Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2735 reason: error at write: Disconnected sessionId: src_id|8ab2bfb6-a499609b-a8784c5e-d7ca5e8d_0
2025-10-10T14:38:40.022678Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2735 sessionId: src_id|8ab2bfb6-a499609b-a8784c5e-d7ca5e8d_0 is DEAD
2025-10-10T14:38:40.022883Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 33 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602515880022656:3900]
2025-10-10T14:38:40.022905Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ab2bfb6-a499609b-a8784c5e-d7ca5e8d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:40.022946Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ab2bfb6-a499609b-a8784c5e-d7ca5e8d_0] Write session will restart in 0.006469s
2025-10-10T14:38:40.022983Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ab2bfb6-a499609b-a8784c5e-d7ca5e8d_0] Write session: Do CDS request
2025-10-10T14:38:40.022989Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ab2bfb6-a499609b-a8784c5e-d7ca5e8d_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:40.030966Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8ab2bfb6-a499609b-a8784c5e-d7ca5e8d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:40.031212Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:40.031232Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2736
2025-10-10T14:38:40.031441Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2736 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:40.031480Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2736 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:40.031486Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2736 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:40.031490Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:40.032250Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2736 sessionId:  describe result for acl check
2025-10-10T14:38:40.032294Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:40.032298Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:40.032300Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:40.032306Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602520174990002:5012] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:40.032886Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602520174990002:5012] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:40.034580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:40.037645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:40.037921Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:40.037933Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:40.037947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:40.038012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:40.038068Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602519392750731:9234]
2025-10-10T14:38:40.038654Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602520174990002:5012] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:40.038730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:40.039064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:40.039110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:40.039448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:40.039512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:40.039518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:40.039519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:40.039520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:40.039521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:40.039525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:40.039526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:40.039527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:40.039528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:40.039529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:40.039531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:40.039532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:40.039533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:40.039539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:40.039551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:40.039555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:40.039559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:40.039563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:40.039567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:40.039571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:40.039575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:40.039579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:40.039583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:40.039587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:40.039591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:40.039594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:40.039601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:40.039610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:40.039616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:40.039621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:40.039626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:40.039631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:40.039635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:40.039640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:40.039645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:40.039652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:40.039658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:40.039663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:40.039675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:40.039687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:40.039692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:40.039697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:40.039701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:40.039711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:40.039716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:40.039726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:40.039731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:40.039736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:40.039743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:40.039749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:40.039758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:40.039763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:40.039803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:40.042328Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602520174990002:5012] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:40.042345Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602520174990002:5012] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:40.042348Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602520174990002:5012] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:40.042357Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2736 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:40.042504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:40.043077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:40.043091Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:40.043093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:40.043097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:40.043103Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2735 [2:7559602519392750731:9234]
2025-10-10T14:38:40.043116Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:40.043140Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:40.043152Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:40.043156Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:40.043158Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:40.043176Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:40.043184Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:40.043206Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:40.043268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:40.043274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:40.043276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:40.043278Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:40.043348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:40.043355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:40.043366Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:40.043379Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:40.043402Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:40.043427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602520174990038:5012], now have 1 active actors on pipe
2025-10-10T14:38:40.043431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602520174989967:2438], now have 1 active actors on pipe
2025-10-10T14:38:40.043439Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602519392750725:9234]
2025-10-10T14:38:40.043441Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602519392750725:9234]
2025-10-10T14:38:40.043444Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602519392750725:9234]
2025-10-10T14:38:40.043458Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:40.043452Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2735
2025-10-10T14:38:40.043477Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:40.043487Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2735
2025-10-10T14:38:40.043488Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:40.043492Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:40.043495Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:40.043499Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:40.043502Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:40.043538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:40.043550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:40.043565Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602519392750725:9234]
2025-10-10T14:38:40.043573Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:40.043575Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:40.043601Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|711c73fb-2b9c652e-1864994-590daa43_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:40.043614Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:40.043618Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:40.043621Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:40.043632Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:40.043646Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:40.043679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:40.043826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:40.043835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:40.043853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:40.043980Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2736 partition: 0 MaxSeqNo: 40 sessionId: src_id|711c73fb-2b9c652e-1864994-590daa43_0
2025-10-10T14:38:40.044393Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ab2bfb6-a499609b-a8784c5e-d7ca5e8d_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|711c73fb-2b9c652e-1864994-590daa43_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:40.047247Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|711c73fb-2b9c652e-1864994-590daa43_0] Write session: try to update token
2025-10-10T14:38:40.047264Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|711c73fb-2b9c652e-1864994-590daa43_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:40.064950Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2736 sessionId: src_id|711c73fb-2b9c652e-1864994-590daa43_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:40.067789Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:40.067462Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:40.067484Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:40.067487Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:40.067489Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:40.067498Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602519392750725:9234]
2025-10-10T14:38:40.067502Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602519392750725:9234]
2025-10-10T14:38:40.067506Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602519392750725:9234]
2025-10-10T14:38:40.067545Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:40.067551Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:40.067555Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:40.067561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:40.067569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:40.067571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:40.067718Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:40.123116Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602520174990057:3900]
2025-10-10T14:38:40.125360Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 pipe creation result: OK TabletId: 72075186224037892 Generation: 2735, pipe: [1:7559602520174990057:3900]
2025-10-10T14:38:40.188557Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:40.189054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:40.189066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:40.189118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602520174990057:3900], now have 1 active actors on pipe
2025-10-10T14:38:40.189487Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:40.189502Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 34 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602520174990057:3900]
2025-10-10T14:38:40.189509Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:40.189550Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:38:40.189634Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2736 reason: status is not ok: tablet will be restarted right now sessionId: src_id|711c73fb-2b9c652e-1864994-590daa43_0
2025-10-10T14:38:40.189851Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2736 sessionId: src_id|711c73fb-2b9c652e-1864994-590daa43_0 is DEAD
2025-10-10T14:38:40.190053Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|711c73fb-2b9c652e-1864994-590daa43_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:38:40.190064Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|711c73fb-2b9c652e-1864994-590daa43_0] Write session will restart in 0.007298s
2025-10-10T14:38:40.190092Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|711c73fb-2b9c652e-1864994-590daa43_0] Write session: Do CDS request
2025-10-10T14:38:40.190099Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|711c73fb-2b9c652e-1864994-590daa43_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:40.198941Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|711c73fb-2b9c652e-1864994-590daa43_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:40.198987Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:40.199008Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2737
2025-10-10T14:38:40.199217Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2737 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:40.199279Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2737 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:40.199290Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2737 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:40.199294Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:40.199800Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2737 sessionId:  describe result for acl check
2025-10-10T14:38:40.199839Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:40.199845Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:40.199847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:40.199853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602520174990074:5032] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:40.200427Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602520174990074:5032] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:40.202905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:40.203018Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602520174990074:5032] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:40.205977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:40.206191Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:40.206203Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:40.206216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:40.206212Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602520174990074:5032] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:40.206228Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602520174990074:5032] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:40.206232Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602520174990074:5032] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:40.206240Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2737 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:40.206269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:40.206314Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602519392750835:9237]
2025-10-10T14:38:40.206963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:40.207254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:40.207298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:40.207609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:40.207669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:40.207676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:40.207677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:40.207678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:40.207679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:40.207681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:40.207684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:40.207685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:40.207686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:40.207688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:40.207689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:40.207690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:40.207692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:40.207697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:40.207711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:40.207716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:40.207720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:40.207725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:40.207729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:40.207734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:40.207738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:40.207743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:40.207748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:40.207752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:40.207756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:40.207760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:40.207767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:40.207775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:40.207782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:40.207788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:40.207797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:40.207803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:40.207807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:40.207813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:40.207822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:40.207828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:40.207834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:40.207845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:40.207850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:40.207856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:40.207866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:40.207872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:40.207877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:40.207887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:40.207891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:40.207897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:40.207902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:40.207912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:40.207917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:40.207922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:40.207932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:40.207938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:40.207988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:40.210479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:40.210799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:40.210812Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:40.210815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:40.210819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:40.210826Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2736 [2:7559602519392750835:9237]
2025-10-10T14:38:40.210839Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:40.210862Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:40.210872Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:40.210876Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:40.210879Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:40.210898Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:40.210910Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:40.210920Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:40.210988Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:40.210998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:40.211000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:40.211003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:40.211070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:40.211078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:40.211091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:40.211109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:40.211132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:40.211160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602520174990129:5032], now have 1 active actors on pipe
2025-10-10T14:38:40.211168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602520174990059:2438], now have 1 active actors on pipe
2025-10-10T14:38:40.211176Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602519392750830:9237]
2025-10-10T14:38:40.211179Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602519392750830:9237]
2025-10-10T14:38:40.211181Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602519392750830:9237]
2025-10-10T14:38:40.211196Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:40.211215Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:40.211191Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2736
2025-10-10T14:38:40.211208Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2736
2025-10-10T14:38:40.211221Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:40.211231Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:40.211232Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:40.211234Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:40.211235Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:40.211280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:40.211289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:40.211304Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602519392750830:9237]
2025-10-10T14:38:40.211316Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:40.211334Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:40.211353Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9f197abe-95fd5625-12af96cd-1d131abd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:40.211365Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:40.211369Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:40.211372Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:40.211386Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:40.211401Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:40.211429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:40.211558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:40.211567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:40.211583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:40.211683Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2737 partition: 0 MaxSeqNo: 40 sessionId: src_id|9f197abe-95fd5625-12af96cd-1d131abd_0
2025-10-10T14:38:40.212076Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|711c73fb-2b9c652e-1864994-590daa43_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|9f197abe-95fd5625-12af96cd-1d131abd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:40.214889Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9f197abe-95fd5625-12af96cd-1d131abd_0] Write session: try to update token
2025-10-10T14:38:40.214909Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9f197abe-95fd5625-12af96cd-1d131abd_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:40.230110Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2737 sessionId: src_id|9f197abe-95fd5625-12af96cd-1d131abd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:40.231312Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:40.231333Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:40.231336Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:40.231338Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:40.231348Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602519392750830:9237]
2025-10-10T14:38:40.231353Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602519392750830:9237]
2025-10-10T14:38:40.231357Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602519392750830:9237]
2025-10-10T14:38:40.231409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:40.231408Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:40.231416Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:40.231421Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:40.231424Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:40.231427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:40.231583Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:40.232957Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:40.289506Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602520174990140:3900]
2025-10-10T14:38:40.289864Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 pipe creation result: OK TabletId: 72075186224037892 Generation: 2736, pipe: [1:7559602520174990140:3900]
2025-10-10T14:38:40.348856Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:40.349240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:40.349256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:40.349301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602520174990140:3900], now have 1 active actors on pipe
2025-10-10T14:38:40.349464Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:40.349525Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 35 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602520174990140:3900]
2025-10-10T14:38:40.349520Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:40.349572Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:40.349580Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:40.349646Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2737 reason: error at write: Disconnected sessionId: src_id|9f197abe-95fd5625-12af96cd-1d131abd_0
2025-10-10T14:38:40.349889Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2737 sessionId: src_id|9f197abe-95fd5625-12af96cd-1d131abd_0 is DEAD
2025-10-10T14:38:40.350086Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f197abe-95fd5625-12af96cd-1d131abd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:40.350100Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f197abe-95fd5625-12af96cd-1d131abd_0] Write session will restart in 0.008239s
2025-10-10T14:38:40.350127Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f197abe-95fd5625-12af96cd-1d131abd_0] Write session: Do CDS request
2025-10-10T14:38:40.350133Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f197abe-95fd5625-12af96cd-1d131abd_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:40.359914Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9f197abe-95fd5625-12af96cd-1d131abd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:40.359992Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:40.360012Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2738
2025-10-10T14:38:40.360172Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2738 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:40.360213Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2738 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:40.360224Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2738 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:40.360229Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:40.360255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:40.360681Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2738 sessionId:  describe result for acl check
2025-10-10T14:38:40.360721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:40.360730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:40.360732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:40.360739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602520174990181:5058] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:40.361322Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602520174990181:5058] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:40.363106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:40.363348Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:40.363360Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:40.363373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:40.363427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:40.363475Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602519392750913:9224]
2025-10-10T14:38:40.363874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602520174990181:5058] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:40.364142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:40.364469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:40.364530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:40.364901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:40.364971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:40.364978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:40.364979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:40.364980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:40.364982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:40.364983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:40.364984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:40.364986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:40.364987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:40.364988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:40.364989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:40.364990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:40.364994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:40.364999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:40.365012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:40.365016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:40.365021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:40.365025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:40.365029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:40.365033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:40.365036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:40.365040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:40.365045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:40.365049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:40.365053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:40.365057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:40.365063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:40.365074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:40.365081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:40.365086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:40.365091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:40.365096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:40.365099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:40.365104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:40.365109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:40.365114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:40.365118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:40.365124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:40.365133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:40.365138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:40.365142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:40.365151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:40.365156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:40.365161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:40.365169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:40.365175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:40.365184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:40.365188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:40.365192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:40.365202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:40.365206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:40.365211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:40.365253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:40.367753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602520174990181:5058] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:40.367771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602520174990181:5058] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:40.367776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602520174990181:5058] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:40.367785Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2738 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:40.367871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:40.368240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:40.368253Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:40.368256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:40.368259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:40.368265Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2737 [2:7559602519392750913:9224]
2025-10-10T14:38:40.368279Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:40.368298Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:40.368305Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:40.368309Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:40.368311Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:40.368331Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:40.368342Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:40.368351Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:40.368404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:40.368410Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:40.368412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:40.368414Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:40.368478Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:40.368634Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2737
2025-10-10T14:38:40.368643Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2737
2025-10-10T14:38:40.368777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:40.368795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:40.368811Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:40.368835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:40.368863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602520174990142:2438], now have 1 active actors on pipe
2025-10-10T14:38:40.368871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602520174990216:5058], now have 1 active actors on pipe
2025-10-10T14:38:40.368890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:40.368899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:40.368919Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602519392750907:9224]
2025-10-10T14:38:40.368924Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602519392750907:9224]
2025-10-10T14:38:40.368926Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602519392750907:9224]
2025-10-10T14:38:40.368940Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:40.368959Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:40.368958Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:40.368969Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:40.368972Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:40.368989Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:40.368998Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:40.369020Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b51614f5-3e568378-d039fb7b-ed48856f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:40.369035Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:40.369040Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:40.369042Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:40.369054Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:40.369066Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:40.369101Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602519392750907:9224]
2025-10-10T14:38:40.369114Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:40.369126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:40.369142Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:40.369394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:40.369408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:40.369434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:40.369525Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2738 partition: 0 MaxSeqNo: 40 sessionId: src_id|b51614f5-3e568378-d039fb7b-ed48856f_0
2025-10-10T14:38:40.369926Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f197abe-95fd5625-12af96cd-1d131abd_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|b51614f5-3e568378-d039fb7b-ed48856f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:40.372667Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b51614f5-3e568378-d039fb7b-ed48856f_0] Write session: try to update token
2025-10-10T14:38:40.372687Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b51614f5-3e568378-d039fb7b-ed48856f_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:40.381536Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:38:40.381555Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:40.381567Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602519392750907:9224]
2025-10-10T14:38:40.381620Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:38:40.381630Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:38:40.381801Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:38:40.381958Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:40.382103Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:40.382244Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:40.382443Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:38:40.382488Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:38:40.387173Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2738 sessionId: src_id|b51614f5-3e568378-d039fb7b-ed48856f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:40.390090Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:40.390516Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:38:40.390355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:40.390388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:40.390433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:38:40.399821Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:40.399845Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:40.399848Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:40.399850Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:40.399861Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602519392750907:9224]
2025-10-10T14:38:40.399865Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602519392750907:9224]
2025-10-10T14:38:40.399869Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602519392750907:9224]
2025-10-10T14:38:40.399918Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:40.399927Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:40.399931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:40.399933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:40.399935Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:40.399940Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:40.400074Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:40.449799Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602520174990223:3900]
2025-10-10T14:38:40.450123Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 pipe creation result: OK TabletId: 72075186224037892 Generation: 2737, pipe: [1:7559602520174990223:3900]
2025-10-10T14:38:40.513270Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:40.521315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:40.521389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:40.521575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:40.521642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:40.521705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:40.521793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:40.521854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:40.521876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:40.521946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:40.522008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:40.522070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:40.522135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:40.522184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:40.522191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:40.522260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:40.522324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:40.522386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:40.522449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:40.522498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:40.522505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:40.522573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:40.522635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:40.522701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:40.522770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:40.522818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:40.522825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:40.522893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:40.522959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:40.523025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:40.523090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:40.523140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:40.523149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:40.523217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:40.523278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:40.523342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:40.523407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:40.523448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:40.523456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:40.523530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:40.523599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:40.523669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:40.523738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:40.523787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:40.523794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:40.523864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:40.523926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:40.523991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:40.524054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:40.524103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:40.524110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:40.524176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:40.524239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:40.524305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:40.524369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:40.524415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:40.524421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:40.524488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:40.524551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:40.524617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:40.524682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:40.524726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:40.524734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:40.524793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602520174990223:3900], now have 1 active actors on pipe
2025-10-10T14:38:40.525081Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:40.525089Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 36 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602520174990223:3900]
2025-10-10T14:38:40.525123Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:40.525126Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:40.525159Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2738 reason: error at write: Disconnected sessionId: src_id|b51614f5-3e568378-d039fb7b-ed48856f_0
2025-10-10T14:38:40.525435Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2738 sessionId: src_id|b51614f5-3e568378-d039fb7b-ed48856f_0 is DEAD
2025-10-10T14:38:40.525577Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b51614f5-3e568378-d039fb7b-ed48856f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:40.525598Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b51614f5-3e568378-d039fb7b-ed48856f_0] Write session will restart in 0.009411s
2025-10-10T14:38:40.525625Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b51614f5-3e568378-d039fb7b-ed48856f_0] Write session: Do CDS request
2025-10-10T14:38:40.525631Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b51614f5-3e568378-d039fb7b-ed48856f_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:40.525890Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:40.535932Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b51614f5-3e568378-d039fb7b-ed48856f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:40.536055Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:40.536091Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2739
2025-10-10T14:38:40.536267Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2739 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:40.536311Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2739 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:40.536321Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2739 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:40.536325Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:40.536578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:40.536813Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2739 sessionId:  describe result for acl check
2025-10-10T14:38:40.536850Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:40.536852Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:40.536854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:40.536861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602520174990279:5081] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:40.537457Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602520174990279:5081] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:40.539796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602520174990279:5081] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:40.539929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:40.540179Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:40.540190Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:40.540202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:40.540260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:40.540308Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602519392751004:9222]
2025-10-10T14:38:40.540928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:40.541274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:40.541320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:40.541662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:40.541717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:40.541722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:40.541723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:40.541725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:40.541726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:40.541727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:40.541728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:40.541730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:40.541731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:40.541733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:40.541734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:40.541735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:40.541736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:40.541742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:40.541755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:40.541759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:40.541764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:40.541768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:40.541772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:40.541776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:40.541781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:40.541785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:40.541789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:40.541793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:40.541797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:40.541810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:40.541818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:40.541826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:40.541834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:40.541840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:40.541844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:40.541850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:40.541854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:40.541859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:40.541868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:40.541872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:40.541875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:40.541880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:40.541884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:40.541889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:40.541893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:40.541898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:40.541903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:40.541908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:40.541912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:40.541917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:40.541921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:40.541932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:40.541936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:40.541945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:40.541949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:40.541954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:40.541995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:40.542620Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602520174990279:5081] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:40.542635Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602520174990279:5081] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:40.542639Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602520174990279:5081] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:40.542648Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2739 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:40.544441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:40.544928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:40.544942Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:40.544944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:40.544948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:40.544954Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2738 [2:7559602519392751004:9222]
2025-10-10T14:38:40.544967Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:40.544990Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:40.544998Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:40.545002Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:40.545005Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:40.545024Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:40.545035Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:40.545046Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:40.545104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:40.545111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:40.545112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:40.545115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:40.545180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:40.545188Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:40.545200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:40.545217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:40.545239Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:40.545266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602520174990313:5081], now have 1 active actors on pipe
2025-10-10T14:38:40.545274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602520174990225:2438], now have 1 active actors on pipe
2025-10-10T14:38:40.545283Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602519392750998:9222]
2025-10-10T14:38:40.545289Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602519392750998:9222]
2025-10-10T14:38:40.545292Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602519392750998:9222]
2025-10-10T14:38:40.545309Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:40.545327Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:40.545353Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2738
2025-10-10T14:38:40.545358Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:40.545359Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2738
2025-10-10T14:38:40.545362Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:40.545380Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:40.545385Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:40.545387Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:40.545391Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602519392750998:9222]
2025-10-10T14:38:40.545395Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:40.545421Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:40.545543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:40.545556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:40.545586Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|403c481-28969da7-bf2ee3d4-3240c6a2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:40.545602Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:40.545606Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:40.545608Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:40.545621Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:40.545632Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:40.545647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:40.545861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:40.545869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:40.545887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:40.545999Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2739 partition: 0 MaxSeqNo: 40 sessionId: src_id|403c481-28969da7-bf2ee3d4-3240c6a2_0
2025-10-10T14:38:40.546447Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b51614f5-3e568378-d039fb7b-ed48856f_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|403c481-28969da7-bf2ee3d4-3240c6a2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:40.549287Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|403c481-28969da7-bf2ee3d4-3240c6a2_0] Write session: try to update token
2025-10-10T14:38:40.549305Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|403c481-28969da7-bf2ee3d4-3240c6a2_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:40.557283Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:38:40.557300Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:40.557312Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602519392750998:9222]
2025-10-10T14:38:40.557378Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:38:40.557383Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:38:40.557581Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:38:40.557745Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:40.557907Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:40.558051Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:40.558270Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:38:40.558316Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:38:40.563755Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2739 sessionId: src_id|403c481-28969da7-bf2ee3d4-3240c6a2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:40.566942Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:40.567212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:40.567234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:40.567281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:38:40.567377Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:38:40.576283Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:40.576302Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:40.576306Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:40.576313Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:40.576325Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602519392750998:9222]
2025-10-10T14:38:40.576329Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602519392750998:9222]
2025-10-10T14:38:40.576333Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602519392750998:9222]
2025-10-10T14:38:40.576390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:40.576392Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:40.576403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:40.576404Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:40.576406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:40.576409Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:40.576547Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:40.625470Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602520174990320:3900]
2025-10-10T14:38:40.625796Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 pipe creation result: OK TabletId: 72075186224037892 Generation: 2738, pipe: [1:7559602520174990320:3900]
2025-10-10T14:38:40.694008Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:40.703386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:40.703418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:40.703627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:40.703717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:40.703811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:40.703911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:40.704342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:40.704359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:40.704446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:40.704529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:40.704609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:40.704936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:40.704995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:40.705005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:40.705077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:40.705146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:40.705231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:40.705317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:40.705396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:40.705405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:40.705503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:40.705582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:40.705659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:40.705744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:40.705796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:40.705818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:40.705895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:40.705965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:40.706040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:40.706124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:40.706180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:40.706188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:40.706276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:40.706340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:40.706415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:40.706495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:40.706545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:40.706553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:40.706634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:40.706722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:40.706823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:40.706913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:40.706963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:40.706974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:40.707047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:40.707131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:40.707211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:40.707283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:40.707333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:40.707342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:40.707414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:40.707479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:40.707556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:40.707623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:40.707669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:40.707676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:40.707743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:40.707810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:40.707880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:40.707961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:40.708013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:40.708021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:40.708095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602520174990320:3900], now have 1 active actors on pipe
2025-10-10T14:38:40.708333Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:40.708351Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:40.708398Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2739 reason: error at write: Disconnected sessionId: src_id|403c481-28969da7-bf2ee3d4-3240c6a2_0
2025-10-10T14:38:40.708633Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2739 sessionId: src_id|403c481-28969da7-bf2ee3d4-3240c6a2_0 is DEAD
2025-10-10T14:38:40.708663Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 37 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602520174990320:3900]
2025-10-10T14:38:40.708702Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:40.708741Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|403c481-28969da7-bf2ee3d4-3240c6a2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:40.708753Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|403c481-28969da7-bf2ee3d4-3240c6a2_0] Write session will restart in 0.007055s
2025-10-10T14:38:40.708739Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:40.708793Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|403c481-28969da7-bf2ee3d4-3240c6a2_0] Write session: Do CDS request
2025-10-10T14:38:40.708800Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|403c481-28969da7-bf2ee3d4-3240c6a2_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:40.716915Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|403c481-28969da7-bf2ee3d4-3240c6a2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:40.717006Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:40.717025Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2740
2025-10-10T14:38:40.717160Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2740 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:40.717191Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2740 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:40.717196Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2740 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:40.717201Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:40.717693Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2740 sessionId:  describe result for acl check
2025-10-10T14:38:40.717733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:40.717740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:40.717742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:40.717750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602520174990362:5105] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:40.718343Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602520174990362:5105] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:40.719126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:40.721035Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602520174990362:5105] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:40.722187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:40.722416Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:40.722431Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:40.722444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:40.722517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:40.722562Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602519392751084:9218]
2025-10-10T14:38:40.723177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:40.723556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:40.723622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:40.723919Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602520174990362:5105] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:40.723932Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602520174990362:5105] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:40.723936Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602520174990362:5105] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:40.723944Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2740 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:40.723955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:40.724031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:40.724038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:40.724040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:40.724041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:40.724042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:40.724043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:40.724044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:40.724048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:40.724049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:40.724051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:40.724052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:40.724053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:40.724054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:40.724062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:40.724075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:40.724079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:40.724082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:40.724086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:40.724091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:40.724095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:40.724099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:40.724104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:40.724109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:40.724114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:40.724118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:40.724123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:40.724130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:40.724140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:40.724147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:40.724153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:40.724158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:40.724164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:40.724168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:40.724175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:40.724180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:40.724186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:40.724190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:40.724196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:40.724203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:40.724209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:40.724213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:40.724219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:40.724229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:40.724236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:40.724249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:40.724254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:40.724259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:40.724265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:40.724276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:40.724281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:40.724292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:40.724299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:40.724348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:40.726837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:40.727340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:40.727357Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:40.727359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:40.727363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:40.727369Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2739 [2:7559602519392751084:9218]
2025-10-10T14:38:40.727382Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:40.727402Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:40.727405Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:40.727409Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:40.727411Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:40.727430Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:40.727437Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:40.727447Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:40.727510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:40.727518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:40.727519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:40.727522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:40.727600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:40.727611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:40.727623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:40.727634Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:40.727650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:40.727671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602520174990323:2438], now have 1 active actors on pipe
2025-10-10T14:38:40.727681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602520174990397:5105], now have 1 active actors on pipe
2025-10-10T14:38:40.727690Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602519392751078:9218]
2025-10-10T14:38:40.727697Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602519392751078:9218]
2025-10-10T14:38:40.727699Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602519392751078:9218]
2025-10-10T14:38:40.727712Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:40.727723Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:40.727726Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:40.727728Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:40.727729Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:40.727745Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:40.727756Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:40.727743Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2739
2025-10-10T14:38:40.727746Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2739
2025-10-10T14:38:40.727782Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602519392751078:9218]
2025-10-10T14:38:40.727792Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:40.727793Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:40.728107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:40.728125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:40.728173Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c643bd24-6894457e-689d5ea-7bda3a6b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:40.728187Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:40.728205Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:40.728215Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:40.728235Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:40.728262Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:40.728291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:40.728488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:40.728501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:40.728523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:40.728631Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2740 partition: 0 MaxSeqNo: 40 sessionId: src_id|c643bd24-6894457e-689d5ea-7bda3a6b_0
2025-10-10T14:38:40.729078Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|403c481-28969da7-bf2ee3d4-3240c6a2_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|c643bd24-6894457e-689d5ea-7bda3a6b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:40.732044Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c643bd24-6894457e-689d5ea-7bda3a6b_0] Write session: try to update token
2025-10-10T14:38:40.732072Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c643bd24-6894457e-689d5ea-7bda3a6b_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:40.747990Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2740 sessionId: src_id|c643bd24-6894457e-689d5ea-7bda3a6b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:40.750797Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:40.750823Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:40.750827Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:40.750829Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:40.750842Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602519392751078:9218]
2025-10-10T14:38:40.750846Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:40.750847Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602519392751078:9218]
2025-10-10T14:38:40.750851Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602519392751078:9218]
2025-10-10T14:38:40.750890Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:40.750897Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:40.750901Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:40.750908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:40.750917Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:40.750920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:40.751070Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:40.808654Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602520174990408:3900]
2025-10-10T14:38:40.808966Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 pipe creation result: OK TabletId: 72075186224037892 Generation: 2739, pipe: [1:7559602520174990408:3900]
2025-10-10T14:38:40.870818Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:40.871341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:40.871363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:40.871413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602520174990408:3900], now have 1 active actors on pipe
2025-10-10T14:38:40.871663Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:40.871668Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:40.871684Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:40.871704Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 38 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602520174990408:3900]
2025-10-10T14:38:40.871724Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:40.871773Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2740 reason: error at write: Disconnected sessionId: src_id|c643bd24-6894457e-689d5ea-7bda3a6b_0
2025-10-10T14:38:40.872020Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2740 sessionId: src_id|c643bd24-6894457e-689d5ea-7bda3a6b_0 is DEAD
2025-10-10T14:38:40.872158Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c643bd24-6894457e-689d5ea-7bda3a6b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:40.872170Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c643bd24-6894457e-689d5ea-7bda3a6b_0] Write session will restart in 0.007976s
2025-10-10T14:38:40.872194Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c643bd24-6894457e-689d5ea-7bda3a6b_0] Write session: Do CDS request
2025-10-10T14:38:40.872204Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c643bd24-6894457e-689d5ea-7bda3a6b_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:40.881894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:40.881986Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c643bd24-6894457e-689d5ea-7bda3a6b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:40.882136Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:40.882156Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2741
2025-10-10T14:38:40.882431Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2741 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:40.882500Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2741 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:40.882516Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2741 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:40.882522Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:40.883068Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2741 sessionId:  describe result for acl check
2025-10-10T14:38:40.883110Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:40.883121Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:40.883124Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:40.883130Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602520174990459:5122] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:40.883667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602520174990459:5122] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:40.885126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:40.885393Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:40.885406Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:40.885421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:40.885492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:40.885542Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602519392751165:9217]
2025-10-10T14:38:40.886154Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602520174990459:5122] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:40.886185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:40.886554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:40.886601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:40.886922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:40.886986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:40.886993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:40.886994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:40.886995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:40.886997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:40.886998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:40.886999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:40.887000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:40.887002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:40.887003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:40.887004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:40.887006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:40.887006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:40.887014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:40.887027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:40.887031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:40.887036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:40.887041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:40.887046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:40.887049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:40.887054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:40.887057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:40.887062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:40.887066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:40.887070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:40.887074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:40.887081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:40.887094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:40.887106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:40.887113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:40.887122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:40.887128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:40.887137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:40.887142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:40.887152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:40.887158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:40.887169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:40.887173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:40.887179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:40.887188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:40.887192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:40.887196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:40.887200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:40.887205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:40.887209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:40.887214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:40.887224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:40.887229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:40.887233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:40.887242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:40.887247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:40.887251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:40.887289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:40.889768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602520174990459:5122] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:40.889789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602520174990459:5122] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:40.889793Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602520174990459:5122] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:40.889814Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2741 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:40.889815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:40.890210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:40.890224Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:40.890226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:40.890230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:40.890235Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2740 [2:7559602519392751165:9217]
2025-10-10T14:38:40.890250Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:40.890268Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:40.890276Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:40.890280Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:40.890283Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:40.890299Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:40.890312Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:40.890323Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:40.890713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:40.890723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:40.890727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:40.890729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:40.890805Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:40.890813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:40.890826Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:40.890843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:40.890865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:40.890892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602520174990493:5122], now have 1 active actors on pipe
2025-10-10T14:38:40.890900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602520174990416:2438], now have 1 active actors on pipe
2025-10-10T14:38:40.890908Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602519392751159:9217]
2025-10-10T14:38:40.890911Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602519392751159:9217]
2025-10-10T14:38:40.890913Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602519392751159:9217]
2025-10-10T14:38:40.890925Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:40.890940Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:40.890941Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:40.890945Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:40.890947Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:40.890960Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:40.890963Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:40.890949Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2740
2025-10-10T14:38:40.890967Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2740
2025-10-10T14:38:40.890993Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602519392751159:9217]
2025-10-10T14:38:40.891001Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:40.891002Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:40.891018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:40.891028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:40.891089Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2508f152-29d469e6-108bff31-c8a61f0c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:40.891106Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:40.891110Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:40.891112Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:40.891127Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:40.891144Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:40.891169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:40.891333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:40.891342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:40.891356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:40.891501Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2741 partition: 0 MaxSeqNo: 40 sessionId: src_id|2508f152-29d469e6-108bff31-c8a61f0c_0
2025-10-10T14:38:40.891934Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c643bd24-6894457e-689d5ea-7bda3a6b_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|2508f152-29d469e6-108bff31-c8a61f0c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:40.894770Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2508f152-29d469e6-108bff31-c8a61f0c_0] Write session: try to update token
2025-10-10T14:38:40.894790Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2508f152-29d469e6-108bff31-c8a61f0c_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:40.909276Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2741 sessionId: src_id|2508f152-29d469e6-108bff31-c8a61f0c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:40.910481Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:40.910502Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:40.910505Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:40.910511Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:40.910520Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602519392751159:9217]
2025-10-10T14:38:40.910524Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602519392751159:9217]
2025-10-10T14:38:40.910528Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602519392751159:9217]
2025-10-10T14:38:40.910579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:40.910591Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:40.910594Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:40.910732Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:40.910805Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:40.910820Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:40.910825Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:40.911892Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:40.972012Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602520174990500:3900]
2025-10-10T14:38:40.972332Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 pipe creation result: OK TabletId: 72075186224037892 Generation: 2740, pipe: [1:7559602520174990500:3900]
2025-10-10T14:38:41.036950Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:41.037527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:41.037549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:41.037599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602520174990500:3900], now have 1 active actors on pipe
2025-10-10T14:38:41.037910Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:41.038249Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 39 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602520174990500:3900]
2025-10-10T14:38:41.038294Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:38:41.038370Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2741 reason: status is not ok: tablet will be restarted right now sessionId: src_id|2508f152-29d469e6-108bff31-c8a61f0c_0
2025-10-10T14:38:41.038766Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2508f152-29d469e6-108bff31-c8a61f0c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:38:41.038781Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2508f152-29d469e6-108bff31-c8a61f0c_0] Write session will restart in 0.009672s
2025-10-10T14:38:41.038807Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2508f152-29d469e6-108bff31-c8a61f0c_0] Write session: Do CDS request
2025-10-10T14:38:41.038813Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2508f152-29d469e6-108bff31-c8a61f0c_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:41.038586Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2741 sessionId: src_id|2508f152-29d469e6-108bff31-c8a61f0c_0 is DEAD
2025-10-10T14:38:41.038789Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:41.050540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:41.053945Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2508f152-29d469e6-108bff31-c8a61f0c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:41.054066Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:41.054095Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2742
2025-10-10T14:38:41.054242Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2742 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:41.054284Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2742 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:41.054295Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2742 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:41.054300Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:41.054829Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2742 sessionId:  describe result for acl check
2025-10-10T14:38:41.054872Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:41.054874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:41.054876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:41.054883Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602524469957844:5140] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:41.055530Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602524469957844:5140] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:41.056317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:41.056614Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:41.056630Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:41.056644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:41.056720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:41.056772Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602523687718543:9216]
2025-10-10T14:38:41.057491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:41.057848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:41.057905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:41.058179Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602524469957844:5140] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:41.058271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:41.058347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:41.058359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:41.058360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:41.058361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:41.058362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:41.058364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:41.058365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:41.058367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:41.058368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:41.058369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:41.058371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:41.058372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:41.058374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:41.058381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:41.058394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:41.058398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:41.058403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:41.058407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:41.058412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:41.058416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:41.058421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:41.058425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:41.058429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:41.058432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:41.058439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:41.058442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:41.058452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:41.058461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:41.058474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:41.058484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:41.058489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:41.058493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:41.058497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:41.058503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:41.058508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:41.058513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:41.058517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:41.058522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:41.058532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:41.058536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:41.058540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:41.058546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:41.058555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:41.058560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:41.058566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:41.058571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:41.058575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:41.058580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:41.058585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:41.058590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:41.058595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:41.058600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:41.058643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:41.061241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:41.061535Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602524469957844:5140] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:41.061570Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602524469957844:5140] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:41.061574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602524469957844:5140] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:41.061584Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2742 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:41.061589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:41.061607Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:41.061613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:41.061617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:41.061624Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2741 [2:7559602523687718543:9216]
2025-10-10T14:38:41.061638Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:41.061654Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:41.061657Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:41.061661Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:41.061663Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:41.061680Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:41.061694Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:41.061702Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:41.061774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:41.061781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:41.061783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:41.061786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:41.061865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:41.061875Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:41.061887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:41.061904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:41.061925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:41.061953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602524469957877:5140], now have 1 active actors on pipe
2025-10-10T14:38:41.061966Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602523687718537:9216]
2025-10-10T14:38:41.061968Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602523687718537:9216]
2025-10-10T14:38:41.061970Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602523687718537:9216]
2025-10-10T14:38:41.061982Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:41.061961Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2741
2025-10-10T14:38:41.061992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602524469957798:2438], now have 1 active actors on pipe
2025-10-10T14:38:41.062010Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:41.062027Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:41.062031Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:41.062057Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602523687718537:9216]
2025-10-10T14:38:41.062060Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:41.062106Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:41.062110Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:41.062112Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:41.062119Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:41.062159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:41.062168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:41.062202Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|98b86bcc-7386f56f-f2bc4b4a-a21aa12d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:41.062212Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:41.062216Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:41.062219Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:41.062238Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:41.062259Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:41.062282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:41.062701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:41.062713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:41.062737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:41.062016Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2741
2025-10-10T14:38:41.062883Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2742 partition: 0 MaxSeqNo: 40 sessionId: src_id|98b86bcc-7386f56f-f2bc4b4a-a21aa12d_0
2025-10-10T14:38:41.063306Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2508f152-29d469e6-108bff31-c8a61f0c_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|98b86bcc-7386f56f-f2bc4b4a-a21aa12d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:41.066108Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|98b86bcc-7386f56f-f2bc4b4a-a21aa12d_0] Write session: try to update token
2025-10-10T14:38:41.066127Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|98b86bcc-7386f56f-f2bc4b4a-a21aa12d_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:41.085824Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:41.085848Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:41.085851Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:41.085853Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:41.085863Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602523687718537:9216]
2025-10-10T14:38:41.085867Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602523687718537:9216]
2025-10-10T14:38:41.085873Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602523687718537:9216]
2025-10-10T14:38:41.085930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:41.085943Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:41.085946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:41.086095Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:41.088215Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:41.088234Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:41.088239Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:41.087601Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2742 sessionId: src_id|98b86bcc-7386f56f-f2bc4b4a-a21aa12d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:41.090336Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:41.138396Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602524469957908:3900]
2025-10-10T14:38:41.138780Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 pipe creation result: OK TabletId: 72075186224037892 Generation: 2741, pipe: [1:7559602524469957908:3900]
2025-10-10T14:38:41.209826Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:41.210419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:41.210440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:41.210505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602524469957908:3900], now have 1 active actors on pipe
2025-10-10T14:38:41.210767Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:41.210759Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:41.210781Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:41.210839Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 40 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602524469957908:3900]
2025-10-10T14:38:41.210859Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2742 reason: error at write: Disconnected sessionId: src_id|98b86bcc-7386f56f-f2bc4b4a-a21aa12d_0
2025-10-10T14:38:41.210871Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:41.211070Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2742 sessionId: src_id|98b86bcc-7386f56f-f2bc4b4a-a21aa12d_0 is DEAD
2025-10-10T14:38:41.211211Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98b86bcc-7386f56f-f2bc4b4a-a21aa12d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:41.211223Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98b86bcc-7386f56f-f2bc4b4a-a21aa12d_0] Write session will restart in 0.008598s
2025-10-10T14:38:41.211250Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98b86bcc-7386f56f-f2bc4b4a-a21aa12d_0] Write session: Do CDS request
2025-10-10T14:38:41.211259Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98b86bcc-7386f56f-f2bc4b4a-a21aa12d_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:41.220941Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|98b86bcc-7386f56f-f2bc4b4a-a21aa12d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:41.221047Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:41.221065Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2743
2025-10-10T14:38:41.221273Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2743 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:41.221353Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2743 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:41.221369Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2743 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:41.221374Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:41.221890Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2743 sessionId:  describe result for acl check
2025-10-10T14:38:41.221938Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:41.221945Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:41.221948Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:41.221955Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602524469957925:8191] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:41.222576Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602524469957925:8191] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:41.225043Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602524469957925:8191] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:41.228760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:41.228958Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602524469957925:8191] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:41.228975Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602524469957925:8191] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:41.228979Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602524469957925:8191] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:41.228989Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2743 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:41.229274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:41.229529Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:41.229539Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:41.229551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:41.229611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:41.229658Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602523687718667:9172]
2025-10-10T14:38:41.230258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:41.230619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:41.230671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:41.230993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:41.231062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:41.231068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:41.231070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:41.231071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:41.231073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:41.231074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:41.231075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:41.231078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:41.231080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:41.231081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:41.231082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:41.231083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:41.231084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:41.231090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:41.231103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:41.231107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:41.231112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:41.231116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:41.231120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:41.231123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:41.231127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:41.231131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:41.231135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:41.231139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:41.231142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:41.231146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:41.231156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:41.231164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:41.231170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:41.231175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:41.231179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:41.231185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:41.231190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:41.231195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:41.231202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:41.231207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:41.231212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:41.231217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:41.231223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:41.231228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:41.231233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:41.231238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:41.231243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:41.231255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:41.231259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:41.231269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:41.231273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:41.231278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:41.231287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:41.231292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:41.231296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:41.231305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:41.231346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:41.233897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:41.234371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:41.234388Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:41.234390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:41.234393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:41.234400Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2742 [2:7559602523687718667:9172]
2025-10-10T14:38:41.234416Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:41.234435Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:41.234438Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:41.234441Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:41.234444Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:41.234462Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:41.234476Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:41.234485Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:41.234541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:41.234548Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:41.234549Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:41.234551Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:41.234627Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:41.234634Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:41.234646Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:41.234662Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:41.234678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:41.234706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602524469957985:8191], now have 1 active actors on pipe
2025-10-10T14:38:41.234714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602524469957910:2438], now have 1 active actors on pipe
2025-10-10T14:38:41.234723Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602523687718661:9172]
2025-10-10T14:38:41.234725Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602523687718661:9172]
2025-10-10T14:38:41.234726Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602523687718661:9172]
2025-10-10T14:38:41.234739Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:41.234753Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:41.234754Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:41.234759Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:41.234762Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:41.234777Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:41.234780Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:41.234809Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602523687718661:9172]
2025-10-10T14:38:41.234817Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:41.234822Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:41.234797Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2742
2025-10-10T14:38:41.234802Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2742
2025-10-10T14:38:41.234856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:41.234868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:41.234901Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|50cb343c-36577577-a08262f4-17bdf402_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:41.234909Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:41.234912Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:41.234914Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:41.234927Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:41.234938Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:41.234956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:41.235116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:41.235126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:41.235143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:41.235226Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2743 partition: 0 MaxSeqNo: 40 sessionId: src_id|50cb343c-36577577-a08262f4-17bdf402_0
2025-10-10T14:38:41.235644Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98b86bcc-7386f56f-f2bc4b4a-a21aa12d_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|50cb343c-36577577-a08262f4-17bdf402_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:41.238378Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|50cb343c-36577577-a08262f4-17bdf402_0] Write session: try to update token
2025-10-10T14:38:41.238400Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|50cb343c-36577577-a08262f4-17bdf402_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:41.253434Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2743 sessionId: src_id|50cb343c-36577577-a08262f4-17bdf402_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:41.256113Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:41.256458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:41.256481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:41.256522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:38:41.256617Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:38:41.260099Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:41.260121Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:41.260125Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:41.260127Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:41.260139Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602523687718661:9172]
2025-10-10T14:38:41.260143Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602523687718661:9172]
2025-10-10T14:38:41.260147Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602523687718661:9172]
2025-10-10T14:38:41.260196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:41.260209Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:41.260211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:41.260219Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:41.260228Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:41.260232Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:41.260349Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:41.308367Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602524469957996:3900]
2025-10-10T14:38:41.308637Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 pipe creation result: OK TabletId: 72075186224037892 Generation: 2742, pipe: [1:7559602524469957996:3900]
2025-10-10T14:38:41.374360Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:41.382589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:41.382629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:41.382833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:41.382914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:41.382992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:41.383074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:41.383128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:41.383139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:41.383221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:41.383294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:41.383367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:41.383443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:41.383494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:41.383502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:41.383579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:41.383643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:41.383720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:41.383791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:41.383838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:41.383846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:41.383920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:41.383990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:41.384060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:41.384131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:41.384183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:41.384191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:41.384262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:41.384329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:41.384396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:41.384473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:41.384526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:41.384535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:41.384610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:41.384676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:41.384745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:41.384815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:41.384860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:41.384866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:41.384945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:41.385014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:41.385095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:41.385168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:41.385225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:41.385231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:41.385309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:41.385401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:41.385474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:41.385546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:41.385596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:41.385604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:41.385677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:41.385743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:41.385830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:41.385900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:41.385946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:41.385953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:41.386028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:41.386093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:41.386163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:41.386240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:41.386289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:41.386297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:41.386367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602524469957996:3900], now have 1 active actors on pipe
2025-10-10T14:38:41.386632Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 41 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602524469957996:3900]
2025-10-10T14:38:41.386649Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:41.386653Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:41.386667Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:41.386699Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2743 reason: error at write: Disconnected sessionId: src_id|50cb343c-36577577-a08262f4-17bdf402_0
2025-10-10T14:38:41.386953Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2743 sessionId: src_id|50cb343c-36577577-a08262f4-17bdf402_0 is DEAD
2025-10-10T14:38:41.387121Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50cb343c-36577577-a08262f4-17bdf402_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:41.387136Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50cb343c-36577577-a08262f4-17bdf402_0] Write session will restart in 0.009116s
2025-10-10T14:38:41.387167Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50cb343c-36577577-a08262f4-17bdf402_0] Write session: Do CDS request
2025-10-10T14:38:41.387173Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50cb343c-36577577-a08262f4-17bdf402_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:41.387673Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:41.396867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:41.397910Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|50cb343c-36577577-a08262f4-17bdf402_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:41.398006Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:41.398027Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2744
2025-10-10T14:38:41.398170Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2744 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:41.398208Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2744 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:41.398218Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2744 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:41.398222Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:41.398723Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2744 sessionId:  describe result for acl check
2025-10-10T14:38:41.398772Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:41.398779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:41.398781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:41.398788Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602524469958049:8169] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:41.399440Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602524469958049:8169] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:41.400194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:41.400440Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:41.400454Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:41.400468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:41.400534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:41.400581Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602523687718750:9169]
2025-10-10T14:38:41.401207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:41.401538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:41.401594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:41.401953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:41.402032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:41.402040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:41.402041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:41.402043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:41.402044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:41.402045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:41.402047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:41.402048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:41.402050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:41.402053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:41.402054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:41.402056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:41.402057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:41.402064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:41.402076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:41.402080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:41.402084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:41.402089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:41.402093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:41.402098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:41.402102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:41.402106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:41.402111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:41.402115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:41.402119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:41.402124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:41.402132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:41.402141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:41.402149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:41.402153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:41.402158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:41.402162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:41.402167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:41.402176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:41.402182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:41.402186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:41.402190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:41.402195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:41.402201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:41.402209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:41.402216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:41.402222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:41.402232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:41.402239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:41.402248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:41.402254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:41.402263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:41.402268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:41.402273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:41.402283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:41.402288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:41.402298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:41.402324Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602524469958049:8169] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:41.402339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:41.404765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602524469958049:8169] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:41.404782Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602524469958049:8169] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:41.404786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602524469958049:8169] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:41.404795Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2744 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:41.404811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:41.405407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:41.405419Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:41.405422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:41.405426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:41.405431Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2743 [2:7559602523687718750:9169]
2025-10-10T14:38:41.405443Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:41.405462Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:41.405466Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:41.405469Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:41.405471Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:41.405489Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:41.405497Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:41.405510Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:41.405572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:41.405581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:41.405583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:41.405586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:41.405655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:41.405665Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:41.405677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:41.405688Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:41.405705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:41.405728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602524469958082:8169], now have 1 active actors on pipe
2025-10-10T14:38:41.405736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602524469958001:2438], now have 1 active actors on pipe
2025-10-10T14:38:41.405744Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602523687718744:9169]
2025-10-10T14:38:41.405751Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602523687718744:9169]
2025-10-10T14:38:41.405753Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602523687718744:9169]
2025-10-10T14:38:41.405767Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:41.405781Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:41.405785Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:41.405798Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:41.405800Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:41.405806Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:41.405810Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:41.405820Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2743
2025-10-10T14:38:41.405840Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2743
2025-10-10T14:38:41.405840Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602523687718744:9169]
2025-10-10T14:38:41.405848Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:41.405850Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:41.405866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:41.405870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:41.405920Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|164c5749-471018b-bb6c76a-d7c5c78e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:41.405934Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:41.405938Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:41.405940Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:41.405951Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:41.405961Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:41.405987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:41.406117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:41.406124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:41.406139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:41.406251Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2744 partition: 0 MaxSeqNo: 40 sessionId: src_id|164c5749-471018b-bb6c76a-d7c5c78e_0
2025-10-10T14:38:41.406633Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50cb343c-36577577-a08262f4-17bdf402_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|164c5749-471018b-bb6c76a-d7c5c78e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:41.409460Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|164c5749-471018b-bb6c76a-d7c5c78e_0] Write session: try to update token
2025-10-10T14:38:41.409479Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|164c5749-471018b-bb6c76a-d7c5c78e_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:41.424524Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2744 sessionId: src_id|164c5749-471018b-bb6c76a-d7c5c78e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:41.425526Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:41.425545Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:41.425549Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:41.425551Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:41.425561Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602523687718744:9169]
2025-10-10T14:38:41.425568Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602523687718744:9169]
2025-10-10T14:38:41.425572Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602523687718744:9169]
2025-10-10T14:38:41.425625Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:41.425634Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:41.425637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:41.425823Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:41.425827Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:41.425834Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:41.425838Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:41.427429Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:41.487068Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602524469958089:3900]
2025-10-10T14:38:41.487526Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 pipe creation result: OK TabletId: 72075186224037892 Generation: 2743, pipe: [1:7559602524469958089:3900]
2025-10-10T14:38:41.543912Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:41.544442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:41.544462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:41.544513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602524469958089:3900], now have 1 active actors on pipe
2025-10-10T14:38:41.544790Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:41.544823Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 42 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602524469958089:3900]
2025-10-10T14:38:41.544868Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:41.544914Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:41.544917Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:41.544972Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2744 reason: error at write: Disconnected sessionId: src_id|164c5749-471018b-bb6c76a-d7c5c78e_0
2025-10-10T14:38:41.545203Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2744 sessionId: src_id|164c5749-471018b-bb6c76a-d7c5c78e_0 is DEAD
2025-10-10T14:38:41.545386Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|164c5749-471018b-bb6c76a-d7c5c78e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:41.545398Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|164c5749-471018b-bb6c76a-d7c5c78e_0] Write session will restart in 0.008943s
2025-10-10T14:38:41.545434Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|164c5749-471018b-bb6c76a-d7c5c78e_0] Write session: Do CDS request
2025-10-10T14:38:41.545441Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|164c5749-471018b-bb6c76a-d7c5c78e_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:41.555985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:41.556086Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|164c5749-471018b-bb6c76a-d7c5c78e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:41.557466Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:41.557487Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2745
2025-10-10T14:38:41.557645Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2745 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:41.557692Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2745 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:41.557703Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2745 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:41.557708Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:41.559424Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2745 sessionId:  describe result for acl check
2025-10-10T14:38:41.559481Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:41.559488Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:41.559491Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:41.559499Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602524469958151:8147] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:41.559479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:41.559721Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:41.559733Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:41.559746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:41.559806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:41.559850Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602523687718847:9166]
2025-10-10T14:38:41.560114Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602524469958151:8147] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:41.560494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:41.560824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:41.560904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:41.561243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:41.561324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:41.561325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:41.561327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:41.561328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:41.561368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:41.561369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:41.561370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:41.561372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:41.561373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:41.561374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:41.561375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:41.561376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:41.561378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:41.561385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:41.561397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:41.561401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:41.561405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:41.561412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:41.561416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:41.561420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:41.561423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:41.561427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:41.561432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:41.561436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:41.561439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:41.561443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:41.561451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:41.561460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:41.561467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:41.561471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:41.561476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:41.561482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:41.561486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:41.561491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:41.561496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:41.561502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:41.561508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:41.561513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:41.561531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:41.561537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:41.561542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:41.561547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:41.561552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:41.561557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:41.561561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:41.561566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:41.561582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:41.561587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:41.561593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:41.561598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:41.561603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:41.561608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:41.561650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:41.562449Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602524469958151:8147] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:41.564276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:41.564924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:41.564938Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:41.564940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:41.564944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:41.564951Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2744 [2:7559602523687718847:9166]
2025-10-10T14:38:41.564964Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:41.564981Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:41.564984Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:41.564988Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:41.564991Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:41.565008Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:41.565021Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:41.565034Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:41.565090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:41.565096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:41.565098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:41.565101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:41.565167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:41.565175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:41.565186Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:41.565198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:41.565220Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:41.565247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602524469958103:2438], now have 1 active actors on pipe
2025-10-10T14:38:41.565258Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602523687718841:9166]
2025-10-10T14:38:41.565264Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602523687718841:9166]
2025-10-10T14:38:41.565266Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602523687718841:9166]
2025-10-10T14:38:41.565283Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:41.565258Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602524469958151:8147] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:41.565279Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602524469958151:8147] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:41.565283Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602524469958151:8147] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:41.565301Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:41.565292Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2745 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:41.565320Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:41.565327Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:41.565355Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:41.565367Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:41.565370Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:41.565375Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602523687718841:9166]
2025-10-10T14:38:41.565378Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:41.565380Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:41.565530Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2744
2025-10-10T14:38:41.566098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602524469958183:8147], now have 1 active actors on pipe
2025-10-10T14:38:41.566165Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2744
2025-10-10T14:38:41.566223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:41.566246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:41.566274Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c06cfb65-b17ce796-b818c621-c23884b9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:41.566288Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:41.566297Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:41.566299Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:41.566313Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:41.566331Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:41.566349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:41.566533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:41.566542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:41.566559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:41.566665Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2745 partition: 0 MaxSeqNo: 40 sessionId: src_id|c06cfb65-b17ce796-b818c621-c23884b9_0
2025-10-10T14:38:41.567142Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|164c5749-471018b-bb6c76a-d7c5c78e_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|c06cfb65-b17ce796-b818c621-c23884b9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:41.569897Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c06cfb65-b17ce796-b818c621-c23884b9_0] Write session: try to update token
2025-10-10T14:38:41.569916Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c06cfb65-b17ce796-b818c621-c23884b9_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:41.578066Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:38:41.578086Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:41.578097Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602523687718841:9166]
2025-10-10T14:38:41.578149Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:38:41.578152Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:38:41.578323Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:38:41.578451Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:41.578591Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:41.578729Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:41.578918Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:38:41.578952Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:38:41.586373Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2745 sessionId: src_id|c06cfb65-b17ce796-b818c621-c23884b9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:41.588845Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:41.589030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:41.589049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:41.589081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:38:41.589178Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:38:41.597608Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:41.597629Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:41.597634Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:41.597635Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:41.597648Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602523687718841:9166]
2025-10-10T14:38:41.597652Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602523687718841:9166]
2025-10-10T14:38:41.597659Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602523687718841:9166]
2025-10-10T14:38:41.597709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:41.597721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:41.597723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:41.597722Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:41.597729Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:41.597733Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:41.597873Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:41.645316Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602524469958191:3900]
2025-10-10T14:38:41.645645Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 pipe creation result: OK TabletId: 72075186224037892 Generation: 2744, pipe: [1:7559602524469958191:3900]
2025-10-10T14:38:41.715592Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:41.724024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:41.724057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:41.724239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:41.724297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:41.724356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:41.724418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:41.724459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:41.724464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:41.724532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:41.724590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:41.724650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:41.724716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:41.724955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:41.724958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:41.725028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:41.725085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:41.725149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:41.725209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:41.725250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:41.725254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:41.725323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:41.725540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:41.725615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:41.725684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:41.725730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:41.725738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:41.725818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:41.725885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:41.728201Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:41.728220Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:41.728254Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2745 reason: error at write: Disconnected sessionId: src_id|c06cfb65-b17ce796-b818c621-c23884b9_0
2025-10-10T14:38:41.728558Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2745 sessionId: src_id|c06cfb65-b17ce796-b818c621-c23884b9_0 is DEAD
2025-10-10T14:38:41.728698Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 43 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602524469958191:3900]
2025-10-10T14:38:41.728723Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:41.725951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:41.726021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:41.726062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:41.726065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:41.726134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:41.726197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:41.726262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:41.726324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:41.726366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:41.726370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:41.726441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:41.726503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:41.726570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:41.726631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:41.726674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:41.726679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:41.726750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:41.726812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:41.726876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:41.726940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:41.727073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:41.727077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:41.727147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:41.727208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:41.727270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:41.727337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:41.727381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:41.727384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:41.727460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:41.727522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:41.727586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:41.727655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:41.727702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:41.727705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:41.727782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602524469958191:3900], now have 1 active actors on pipe
2025-10-10T14:38:41.729120Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:41.729533Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c06cfb65-b17ce796-b818c621-c23884b9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:41.729550Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c06cfb65-b17ce796-b818c621-c23884b9_0] Write session will restart in 0.008351s
2025-10-10T14:38:41.729575Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c06cfb65-b17ce796-b818c621-c23884b9_0] Write session: Do CDS request
2025-10-10T14:38:41.729582Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c06cfb65-b17ce796-b818c621-c23884b9_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:41.738936Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c06cfb65-b17ce796-b818c621-c23884b9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:41.739026Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:41.739046Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2746
2025-10-10T14:38:41.739197Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2746 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:41.739231Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2746 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:41.739238Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2746 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:41.739243Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:41.739745Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2746 sessionId:  describe result for acl check
2025-10-10T14:38:41.739785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:41.739787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:41.739789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:41.739795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602524469958207:8127] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:41.740385Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602524469958207:8127] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:41.743930Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602524469958207:8127] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:41.745105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:41.748589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:41.748835Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:41.748849Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:41.748862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:41.748921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:41.748965Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602523687718933:9157]
2025-10-10T14:38:41.749008Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602524469958207:8127] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:41.749026Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602524469958207:8127] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:41.749030Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602524469958207:8127] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:41.749040Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2746 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:41.749644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:41.749954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:41.749996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:41.750339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:41.750391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:41.750392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:41.750393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:41.750395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:41.750396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:41.750397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:41.750399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:41.750400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:41.750402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:41.750403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:41.750404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:41.750405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:41.750408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:41.750414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:41.750427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:41.750432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:41.750436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:41.750440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:41.750444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:41.750448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:41.750451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:41.750456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:41.750460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:41.750463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:41.750467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:41.750470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:41.750478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:41.750487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:41.750494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:41.750499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:41.750504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:41.750509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:41.750514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:41.750519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:41.750523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:41.750528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:41.750532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:41.750538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:41.750542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:41.750548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:41.750554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:41.750560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:41.750565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:41.750572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:41.750577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:41.750583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:41.750588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:41.750594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:41.750598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:41.750604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:41.750608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:41.750614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:41.750658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:41.753936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:41.754526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:41.754537Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:41.754539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:41.754543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:41.754550Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2745 [2:7559602523687718933:9157]
2025-10-10T14:38:41.754565Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:41.754584Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:41.754588Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:41.754592Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:41.754595Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:41.754615Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:41.754623Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:41.754632Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:41.754697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:41.754706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:41.754709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:41.754711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:41.754791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:41.754802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:41.754816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:41.754829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:41.754850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:41.754880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602524469958271:8127], now have 1 active actors on pipe
2025-10-10T14:38:41.754889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602524469958194:2438], now have 1 active actors on pipe
2025-10-10T14:38:41.754898Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602523687718928:9157]
2025-10-10T14:38:41.754900Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602523687718928:9157]
2025-10-10T14:38:41.754903Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602523687718928:9157]
2025-10-10T14:38:41.754918Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:41.754937Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:41.754944Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:41.754948Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:41.754952Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:41.754960Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:41.754969Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:41.754956Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2745
2025-10-10T14:38:41.754960Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2745
2025-10-10T14:38:41.755000Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602523687718928:9157]
2025-10-10T14:38:41.755010Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:41.755030Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:41.755044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:41.755048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:41.755087Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|eb674f8-6bd15f38-9c5b8a79-1fe6e61c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:41.755096Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:41.755100Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:41.755102Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:41.755114Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:41.755124Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:41.755149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:41.755337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:41.755343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:41.755358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:41.755462Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2746 partition: 0 MaxSeqNo: 40 sessionId: src_id|eb674f8-6bd15f38-9c5b8a79-1fe6e61c_0
2025-10-10T14:38:41.755881Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c06cfb65-b17ce796-b818c621-c23884b9_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|eb674f8-6bd15f38-9c5b8a79-1fe6e61c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:41.758626Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eb674f8-6bd15f38-9c5b8a79-1fe6e61c_0] Write session: try to update token
2025-10-10T14:38:41.758644Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eb674f8-6bd15f38-9c5b8a79-1fe6e61c_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:41.772473Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2746 sessionId: src_id|eb674f8-6bd15f38-9c5b8a79-1fe6e61c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:41.774578Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:41.774602Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:41.774605Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:41.774607Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:41.774618Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602523687718928:9157]
2025-10-10T14:38:41.774623Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602523687718928:9157]
2025-10-10T14:38:41.774627Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602523687718928:9157]
2025-10-10T14:38:41.774681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:41.774686Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:41.774693Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:41.774697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:41.774699Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:41.774701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:41.774842Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:41.775266Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:41.829078Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602524469958290:3900]
2025-10-10T14:38:41.829417Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 pipe creation result: OK TabletId: 72075186224037892 Generation: 2745, pipe: [1:7559602524469958290:3900]
2025-10-10T14:38:41.897115Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:41.897677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:41.897695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:41.897741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602524469958290:3900], now have 1 active actors on pipe
2025-10-10T14:38:41.898026Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:41.898552Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb674f8-6bd15f38-9c5b8a79-1fe6e61c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:41.898564Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb674f8-6bd15f38-9c5b8a79-1fe6e61c_0] Write session will restart in 0.007378s
2025-10-10T14:38:41.898601Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb674f8-6bd15f38-9c5b8a79-1fe6e61c_0] Write session: Do CDS request
2025-10-10T14:38:41.898607Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb674f8-6bd15f38-9c5b8a79-1fe6e61c_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:41.898057Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:41.898075Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:41.898163Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2746 reason: error at write: Disconnected sessionId: src_id|eb674f8-6bd15f38-9c5b8a79-1fe6e61c_0
2025-10-10T14:38:41.898367Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2746 sessionId: src_id|eb674f8-6bd15f38-9c5b8a79-1fe6e61c_0 is DEAD
2025-10-10T14:38:41.898659Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 44 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602524469958290:3900]
2025-10-10T14:38:41.898676Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:41.907319Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eb674f8-6bd15f38-9c5b8a79-1fe6e61c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:41.907458Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:41.907476Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2747
2025-10-10T14:38:41.907626Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2747 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:41.907663Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2747 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:41.907674Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2747 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:41.907679Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:41.908159Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2747 sessionId:  describe result for acl check
2025-10-10T14:38:41.908196Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:41.908199Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:41.908200Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:41.908207Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602524469958342:8128] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:41.908825Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602524469958342:8128] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:41.909141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:41.911142Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602524469958342:8128] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:41.912573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:41.912785Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:41.912796Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:41.912808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:41.912863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:41.912908Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602523687719021:9155]
2025-10-10T14:38:41.913563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:41.913932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:41.913988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:41.914060Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602524469958342:8128] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:41.914084Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602524469958342:8128] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:41.914088Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602524469958342:8128] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:41.914098Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2747 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:41.914357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:41.914433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:41.914440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:41.914441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:41.914443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:41.914444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:41.914445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:41.914446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:41.914448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:41.914449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:41.914450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:41.914452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:41.914453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:41.914454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:41.914461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:41.914474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:41.914478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:41.914484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:41.914487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:41.914491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:41.914494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:41.914498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:41.914501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:41.914506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:41.914509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:41.914512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:41.914515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:41.914524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:41.914532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:41.914538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:41.914543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:41.914548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:41.914554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:41.914558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:41.914563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:41.914568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:41.914573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:41.914578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:41.914593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:41.914601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:41.914607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:41.914612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:41.914619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:41.914624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:41.914628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:41.914632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:41.914636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:41.914642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:41.914648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:41.914651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:41.914656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:41.914660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:41.914670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:41.914709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:41.917517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:41.918189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:41.918205Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:41.918207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:41.918211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:41.918217Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2746 [2:7559602523687719021:9155]
2025-10-10T14:38:41.918231Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:41.918249Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:41.918253Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:41.918257Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:41.918260Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:41.918289Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:41.918301Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:41.918313Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:41.918373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:41.918381Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:41.918383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:41.918386Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:41.918452Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:41.918455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:41.918467Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:41.918480Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:41.918497Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:41.918518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602524469958375:8128], now have 1 active actors on pipe
2025-10-10T14:38:41.918528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602524469958295:2438], now have 1 active actors on pipe
2025-10-10T14:38:41.918536Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602523687719015:9155]
2025-10-10T14:38:41.918541Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602523687719015:9155]
2025-10-10T14:38:41.918543Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602523687719015:9155]
2025-10-10T14:38:41.918558Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:41.918573Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:41.918580Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:41.918586Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:41.918588Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:41.918594Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:41.918597Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:41.918624Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602523687719015:9155]
2025-10-10T14:38:41.918639Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:41.918661Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:41.918742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:41.918758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:41.918796Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6d3ab166-20cff181-343e098e-6bb7c40e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:41.918806Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:41.918811Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:41.918814Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:41.918841Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:41.918855Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:41.918877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:41.919054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:41.919065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:41.919099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:41.919589Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb674f8-6bd15f38-9c5b8a79-1fe6e61c_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|6d3ab166-20cff181-343e098e-6bb7c40e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:41.918644Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2746
2025-10-10T14:38:41.918646Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2746
2025-10-10T14:38:41.919191Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2747 partition: 0 MaxSeqNo: 40 sessionId: src_id|6d3ab166-20cff181-343e098e-6bb7c40e_0
2025-10-10T14:38:41.922307Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6d3ab166-20cff181-343e098e-6bb7c40e_0] Write session: try to update token
2025-10-10T14:38:41.922325Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6d3ab166-20cff181-343e098e-6bb7c40e_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:41.936498Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:38:41.936524Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:41.936536Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602523687719015:9155]
2025-10-10T14:38:41.936596Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:38:41.936603Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:38:41.936772Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:38:41.936909Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:41.937014Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2747 sessionId: src_id|6d3ab166-20cff181-343e098e-6bb7c40e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:41.937054Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:41.937200Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:41.937414Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:38:41.937458Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:38:41.939779Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:41.940023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:41.940042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:41.940095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:38:41.940196Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:38:41.950385Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:41.950426Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:41.950429Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:41.950431Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:41.950444Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602523687719015:9155]
2025-10-10T14:38:41.950448Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602523687719015:9155]
2025-10-10T14:38:41.950452Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602523687719015:9155]
2025-10-10T14:38:41.950511Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:41.950519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:41.950521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:41.950666Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:41.950682Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:41.950688Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:41.950695Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:41.999060Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602524469958384:3900]
2025-10-10T14:38:41.999443Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 pipe creation result: OK TabletId: 72075186224037892 Generation: 2746, pipe: [1:7559602524469958384:3900]
2025-10-10T14:38:42.073198Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:42.081594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:42.081626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:42.081813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:42.081878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:42.081943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:42.082011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:42.082061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:42.082074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:42.082148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:42.082211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:42.082270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:42.082338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:42.082390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:42.082398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:42.082472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:42.082534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:42.082595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:42.082656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:42.082699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:42.082706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:42.082768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:42.082826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:42.082884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:42.082958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:42.083005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:42.083015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:42.083081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:42.083147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:42.083213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:42.083281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:42.083331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:42.083338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:42.083409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:42.083475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:42.083536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:42.083601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:42.083649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:42.083655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:42.083728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:42.083791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:42.083860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:42.083933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:42.083982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:42.083989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:42.084061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:42.084129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:42.084194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:42.084262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:42.084308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:42.084317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:42.084388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:42.084458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:42.084527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:42.084592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:42.084639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:42.084649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:42.084720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:42.084780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:42.084844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:42.084904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:42.084951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:42.084960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:42.085034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602524469958384:3900], now have 1 active actors on pipe
2025-10-10T14:38:42.085405Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:42.085429Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:42.085482Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2747 reason: error at write: Disconnected sessionId: src_id|6d3ab166-20cff181-343e098e-6bb7c40e_0
2025-10-10T14:38:42.085711Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2747 sessionId: src_id|6d3ab166-20cff181-343e098e-6bb7c40e_0 is DEAD
2025-10-10T14:38:42.085729Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 45 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602524469958384:3900]
2025-10-10T14:38:42.085746Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:42.085932Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d3ab166-20cff181-343e098e-6bb7c40e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:42.085944Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d3ab166-20cff181-343e098e-6bb7c40e_0] Write session will restart in 0.009932s
2025-10-10T14:38:42.085972Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d3ab166-20cff181-343e098e-6bb7c40e_0] Write session: Do CDS request
2025-10-10T14:38:42.085978Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d3ab166-20cff181-343e098e-6bb7c40e_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:42.086340Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:42.096958Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6d3ab166-20cff181-343e098e-6bb7c40e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:42.097038Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:42.097066Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2748
2025-10-10T14:38:42.097195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:42.097215Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2748 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:42.097253Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2748 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:42.097264Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2748 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:42.097268Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:42.097785Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2748 sessionId:  describe result for acl check
2025-10-10T14:38:42.097831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:42.097840Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:42.097842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:42.097849Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602528764925734:8111] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:42.098425Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602528764925734:8111] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:42.100733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:42.100992Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:42.101005Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:42.101018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:42.101086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:42.101132Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602527982686405:9150]
2025-10-10T14:38:42.101164Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602528764925734:8111] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:42.101772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:42.102162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:42.102215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:42.102565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:42.102637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:42.102645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:42.102646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:42.102648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:42.102649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:42.102652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:42.102653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:42.102654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:42.102656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:42.102657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:42.102658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:42.102659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:42.102660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:42.102666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:42.102678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:42.102682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:42.102686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:42.102689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:42.102693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:42.102697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:42.102700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:42.102704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:42.102708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:42.102712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:42.102715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:42.102719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:42.102728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:42.102737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:42.102743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:42.102749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:42.102754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:42.102759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:42.102764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:42.102769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:42.102774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:42.102779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:42.102787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:42.102793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:42.102798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:42.102803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:42.102808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:42.102813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:42.102818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:42.102823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:42.102828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:42.102833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:42.102837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:42.102841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:42.102845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:42.102850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:42.102854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:42.102859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:42.102899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:42.105450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:42.105452Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602528764925734:8111] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:42.105471Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602528764925734:8111] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:42.105475Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602528764925734:8111] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:42.105484Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2748 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:42.105837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:42.105849Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:42.105851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:42.105856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:42.105862Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2747 [2:7559602527982686405:9150]
2025-10-10T14:38:42.105876Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:42.105893Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:42.105903Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:42.105907Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:42.105909Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:42.105926Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:42.105943Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:42.105952Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:42.106230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:42.106240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:42.106242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:42.106244Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:42.106320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:42.106333Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:42.106345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:42.106358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:42.106456Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2747
2025-10-10T14:38:42.106474Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2747
2025-10-10T14:38:42.106374Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:42.106402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602528764925767:8111], now have 1 active actors on pipe
2025-10-10T14:38:42.106406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602528764925683:2438], now have 1 active actors on pipe
2025-10-10T14:38:42.106414Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602527982686399:9150]
2025-10-10T14:38:42.106416Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602527982686399:9150]
2025-10-10T14:38:42.106418Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602527982686399:9150]
2025-10-10T14:38:42.106432Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:42.106448Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:42.106448Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:42.106451Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:42.106453Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:42.106464Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:42.106467Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:42.106496Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602527982686399:9150]
2025-10-10T14:38:42.106499Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:42.106501Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:42.106519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:42.106524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:42.106577Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|339af079-49a769b1-a972d5-989997f0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:42.106585Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:42.106589Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:42.106593Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:42.106605Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:42.106616Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:42.106634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:42.106841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:42.106857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:42.106880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:42.107021Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2748 partition: 0 MaxSeqNo: 40 sessionId: src_id|339af079-49a769b1-a972d5-989997f0_0
2025-10-10T14:38:42.107429Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d3ab166-20cff181-343e098e-6bb7c40e_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|339af079-49a769b1-a972d5-989997f0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:42.110450Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|339af079-49a769b1-a972d5-989997f0_0] Write session: try to update token
2025-10-10T14:38:42.110470Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|339af079-49a769b1-a972d5-989997f0_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:42.128008Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:42.128031Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:42.128035Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:42.128037Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:42.128053Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602527982686399:9150]
2025-10-10T14:38:42.128058Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602527982686399:9150]
2025-10-10T14:38:42.128063Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602527982686399:9150]
2025-10-10T14:38:42.128112Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:42.128116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:42.128119Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:42.128123Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:42.128124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:42.128127Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:42.128279Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:42.131964Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2748 sessionId: src_id|339af079-49a769b1-a972d5-989997f0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:42.136520Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:42.185926Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602528764925788:3900]
2025-10-10T14:38:42.186166Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 pipe creation result: OK TabletId: 72075186224037892 Generation: 2747, pipe: [1:7559602528764925788:3900]
2025-10-10T14:38:42.250389Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:42.251255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:42.251277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:42.251325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602528764925788:3900], now have 1 active actors on pipe
2025-10-10T14:38:42.251582Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:42.252071Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:42.252087Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:42.252149Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2748 reason: error at write: Disconnected sessionId: src_id|339af079-49a769b1-a972d5-989997f0_0
2025-10-10T14:38:42.252492Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|339af079-49a769b1-a972d5-989997f0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:42.252504Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|339af079-49a769b1-a972d5-989997f0_0] Write session will restart in 0.007218s
2025-10-10T14:38:42.252542Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|339af079-49a769b1-a972d5-989997f0_0] Write session: Do CDS request
2025-10-10T14:38:42.252549Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|339af079-49a769b1-a972d5-989997f0_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:42.252338Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2748 sessionId: src_id|339af079-49a769b1-a972d5-989997f0_0 is DEAD
2025-10-10T14:38:42.252479Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 46 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602528764925788:3900]
2025-10-10T14:38:42.252493Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:42.260945Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|339af079-49a769b1-a972d5-989997f0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:42.261360Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:42.261380Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2749
2025-10-10T14:38:42.261518Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2749 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:42.261551Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2749 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:42.261557Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2749 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:42.261561Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:42.262081Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2749 sessionId:  describe result for acl check
2025-10-10T14:38:42.262113Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:42.262115Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:42.262117Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:42.262124Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602528764925808:8045] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:42.262704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602528764925808:8045] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:42.265243Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602528764925808:8045] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:42.269289Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602528764925808:8045] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:42.269307Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602528764925808:8045] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:42.269312Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602528764925808:8045] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:42.269321Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2749 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:42.274281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:42.277592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:42.277869Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:42.277883Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:42.277895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:42.277956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:42.277993Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602527982686534:9115]
2025-10-10T14:38:42.278600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:42.278978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:42.279036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:42.279377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:42.279456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:42.279462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:42.279464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:42.279464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:42.279465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:42.279467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:42.279468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:42.279469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:42.279470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:42.279471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:42.279474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:42.279475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:42.279476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:42.279481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:42.279495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:42.279498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:42.279502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:42.279505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:42.279509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:42.279512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:42.279515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:42.279519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:42.279522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:42.279525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:42.279529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:42.279532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:42.279540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:42.279550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:42.279556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:42.279561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:42.279566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:42.279570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:42.279575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:42.279580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:42.279584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:42.279588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:42.279592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:42.279598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:42.279602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:42.279607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:42.279611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:42.279617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:42.279622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:42.279627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:42.279631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:42.279637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:42.279642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:42.279646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:42.279651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:42.279656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:42.279660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:42.279666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:42.279707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:42.282942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:42.283288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:42.283303Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:42.283306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:42.283310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:42.283318Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2748 [2:7559602527982686534:9115]
2025-10-10T14:38:42.283332Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:42.283353Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:42.283356Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:42.283360Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:42.283363Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:42.283381Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:42.283389Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:42.283400Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:42.283480Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:42.283490Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:42.283491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:42.283494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:42.283575Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:42.283584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:42.283596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:42.283613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:42.283635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:42.283688Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602527982686528:9115]
2025-10-10T14:38:42.283693Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602527982686528:9115]
2025-10-10T14:38:42.283695Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602527982686528:9115]
2025-10-10T14:38:42.283710Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:42.283727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602528764925800:2438], now have 1 active actors on pipe
2025-10-10T14:38:42.283734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602528764925868:8045], now have 1 active actors on pipe
2025-10-10T14:38:42.283740Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:42.283756Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:42.283764Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:42.283799Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602527982686528:9115]
2025-10-10T14:38:42.283807Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:42.283856Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:42.283868Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:42.283870Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:42.283879Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:42.283998Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2748
2025-10-10T14:38:42.284040Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2748
2025-10-10T14:38:42.284074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:42.284089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:42.284126Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|34dc42d-7d8a6e4b-668744de-a6b828cb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:42.284148Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:42.284153Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:42.284156Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:42.284168Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:42.284182Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:42.284201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:42.284457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:42.284470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:42.284489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:42.284662Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2749 partition: 0 MaxSeqNo: 40 sessionId: src_id|34dc42d-7d8a6e4b-668744de-a6b828cb_0
2025-10-10T14:38:42.285158Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|339af079-49a769b1-a972d5-989997f0_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|34dc42d-7d8a6e4b-668744de-a6b828cb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:42.288121Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|34dc42d-7d8a6e4b-668744de-a6b828cb_0] Write session: try to update token
2025-10-10T14:38:42.288146Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|34dc42d-7d8a6e4b-668744de-a6b828cb_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:42.296370Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:38:42.296395Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:42.296406Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602527982686528:9115]
2025-10-10T14:38:42.296460Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:38:42.296463Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:38:42.296646Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:38:42.296790Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:42.296944Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:42.297122Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:42.297432Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:38:42.297493Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:38:42.303510Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2749 sessionId: src_id|34dc42d-7d8a6e4b-668744de-a6b828cb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:42.306254Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:42.306516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:42.306542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:42.306607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:38:42.306705Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:38:42.315186Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:42.315211Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:42.315214Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:42.315216Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:42.315228Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602527982686528:9115]
2025-10-10T14:38:42.315233Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602527982686528:9115]
2025-10-10T14:38:42.315237Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602527982686528:9115]
2025-10-10T14:38:42.315300Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:42.315298Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:42.315305Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:42.315308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:42.315310Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:42.315311Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:42.315462Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:42.352893Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602528764925893:3900]
2025-10-10T14:38:42.353382Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 pipe creation result: OK TabletId: 72075186224037892 Generation: 2748, pipe: [1:7559602528764925893:3900]
2025-10-10T14:38:42.434112Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:42.443246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:42.443281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:42.443491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:42.443581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:42.443660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:42.443736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:42.443791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:42.443802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:42.443877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:42.443957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:42.444045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:42.444133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:42.444419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:42.444436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:42.444519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:42.444586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:42.444662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:42.444741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:42.444792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:42.444801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:42.444883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:42.444956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:42.445026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:42.445107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:42.445157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:42.445165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:42.445242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:42.445316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:42.445407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:42.445480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:42.445530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:42.445540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:42.445622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:42.445691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:42.445781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:42.445862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:42.445917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:42.445925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:42.445998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:42.446060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:42.446129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:42.446199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:42.446240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:42.446245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:42.446308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:42.446365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:42.446432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:42.446506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:42.446550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:42.446559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:42.446635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:42.446699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:42.446762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:42.446826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:42.446874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:42.446881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:42.446947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:42.447008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:42.447073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:42.447137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:42.447183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:42.447190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:42.447259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602528764925893:3900], now have 1 active actors on pipe
2025-10-10T14:38:42.448003Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:42.448009Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 47 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602528764925893:3900]
2025-10-10T14:38:42.448019Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:42.448052Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2749 reason: error at write: Disconnected sessionId: src_id|34dc42d-7d8a6e4b-668744de-a6b828cb_0
2025-10-10T14:38:42.448063Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:42.448262Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2749 sessionId: src_id|34dc42d-7d8a6e4b-668744de-a6b828cb_0 is DEAD
2025-10-10T14:38:42.448392Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:42.448429Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|34dc42d-7d8a6e4b-668744de-a6b828cb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:42.448441Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|34dc42d-7d8a6e4b-668744de-a6b828cb_0] Write session will restart in 0.006579s
2025-10-10T14:38:42.448476Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|34dc42d-7d8a6e4b-668744de-a6b828cb_0] Write session: Do CDS request
2025-10-10T14:38:42.448482Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|34dc42d-7d8a6e4b-668744de-a6b828cb_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:42.455938Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|34dc42d-7d8a6e4b-668744de-a6b828cb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:42.456082Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:42.456107Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2750
2025-10-10T14:38:42.456255Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2750 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:42.456305Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2750 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:42.456318Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2750 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:42.456322Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:42.456845Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2750 sessionId:  describe result for acl check
2025-10-10T14:38:42.456885Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:42.456893Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:42.456895Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:42.456901Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602528764925944:8053] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:42.457497Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602528764925944:8053] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:42.458837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:42.460452Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602528764925944:8053] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:42.462066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:42.462297Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:42.462312Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:42.462326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:42.462385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:42.462431Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602527982686634:9112]
2025-10-10T14:38:42.463017Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602528764925944:8053] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:42.463033Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602528764925944:8053] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:42.463036Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602528764925944:8053] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:42.463045Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2750 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:42.463087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:42.463423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:42.463473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:42.463811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:42.463871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:42.463878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:42.463880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:42.463881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:42.463882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:42.463884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:42.463885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:42.463886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:42.463887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:42.463888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:42.463890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:42.463891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:42.463892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:42.463898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:42.463911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:42.463916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:42.463920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:42.463924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:42.463928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:42.463933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:42.463937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:42.463941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:42.463946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:42.463950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:42.463955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:42.463959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:42.463966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:42.463977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:42.463985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:42.463991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:42.463995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:42.464001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:42.464005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:42.464011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:42.464016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:42.464022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:42.464026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:42.464032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:42.464037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:42.464043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:42.464048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:42.464053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:42.464058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:42.464064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:42.464074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:42.464079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:42.464086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:42.464091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:42.464096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:42.464101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:42.464106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:42.464117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:42.464160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:42.466626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:42.466958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:42.466974Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:42.466977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:42.466981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:42.466988Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2749 [2:7559602527982686634:9112]
2025-10-10T14:38:42.467001Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:42.467023Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:42.467033Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:42.467037Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:42.467039Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:42.467057Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:42.467070Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:42.467078Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:42.467135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:42.467143Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:42.467145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:42.467148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:42.467220Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:42.467229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:42.467242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:42.467260Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:42.467283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:42.467312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602528764925895:2438], now have 1 active actors on pipe
2025-10-10T14:38:42.467323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602528764925977:8053], now have 1 active actors on pipe
2025-10-10T14:38:42.467331Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602527982686628:9112]
2025-10-10T14:38:42.467333Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602527982686628:9112]
2025-10-10T14:38:42.467335Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602527982686628:9112]
2025-10-10T14:38:42.467351Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:42.467368Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:42.467349Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2749
2025-10-10T14:38:42.467370Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:42.467378Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:42.467380Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:42.467389Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:42.467392Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:42.467413Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2749
2025-10-10T14:38:42.467432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:42.467443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:42.467458Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602527982686628:9112]
2025-10-10T14:38:42.467471Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:42.467477Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:42.467510Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|be564b96-88813ad2-2c15c1f5-e8f40043_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:42.467523Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:42.467532Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:42.467535Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:42.467547Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:42.467562Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:42.467590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:42.467735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:42.467746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:42.467763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:42.467850Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2750 partition: 0 MaxSeqNo: 40 sessionId: src_id|be564b96-88813ad2-2c15c1f5-e8f40043_0
2025-10-10T14:38:42.468248Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|34dc42d-7d8a6e4b-668744de-a6b828cb_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|be564b96-88813ad2-2c15c1f5-e8f40043_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:42.471271Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|be564b96-88813ad2-2c15c1f5-e8f40043_0] Write session: try to update token
2025-10-10T14:38:42.471294Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|be564b96-88813ad2-2c15c1f5-e8f40043_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:42.486226Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2750 sessionId: src_id|be564b96-88813ad2-2c15c1f5-e8f40043_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:42.487555Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:42.487572Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:42.487576Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:42.487578Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:42.487587Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602527982686628:9112]
2025-10-10T14:38:42.487592Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602527982686628:9112]
2025-10-10T14:38:42.487595Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602527982686628:9112]
2025-10-10T14:38:42.487646Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:42.487646Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:42.487655Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:42.487659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:42.487659Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:42.487661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:42.487803Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:42.489034Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:42.547944Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602528764926001:3900]
2025-10-10T14:38:42.548252Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 pipe creation result: OK TabletId: 72075186224037892 Generation: 2749, pipe: [1:7559602528764926001:3900]
2025-10-10T14:38:42.606704Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:42.607170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:42.607187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:42.607235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602528764926001:3900], now have 1 active actors on pipe
2025-10-10T14:38:42.607477Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:42.607504Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:42.607527Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:42.607531Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:42.607582Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 48 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602528764926001:3900]
2025-10-10T14:38:42.607605Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2750 reason: error at write: Disconnected sessionId: src_id|be564b96-88813ad2-2c15c1f5-e8f40043_0
2025-10-10T14:38:42.607782Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2750 sessionId: src_id|be564b96-88813ad2-2c15c1f5-e8f40043_0 is DEAD
2025-10-10T14:38:42.607933Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be564b96-88813ad2-2c15c1f5-e8f40043_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:42.607946Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be564b96-88813ad2-2c15c1f5-e8f40043_0] Write session will restart in 0.006715s
2025-10-10T14:38:42.607971Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be564b96-88813ad2-2c15c1f5-e8f40043_0] Write session: Do CDS request
2025-10-10T14:38:42.607978Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be564b96-88813ad2-2c15c1f5-e8f40043_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:42.615851Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|be564b96-88813ad2-2c15c1f5-e8f40043_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:42.617488Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:42.617506Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2751
2025-10-10T14:38:42.617697Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2751 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:42.617746Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2751 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:42.617759Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2751 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:42.617763Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:42.618249Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2751 sessionId:  describe result for acl check
2025-10-10T14:38:42.618290Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:42.618297Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:42.618299Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:42.618305Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602528764926052:8034] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:42.618889Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602528764926052:8034] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:42.619619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:42.621358Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602528764926052:8034] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:42.623118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:42.623372Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:42.623386Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:42.623400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:42.623467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:42.623517Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602527982686724:9107]
2025-10-10T14:38:42.624098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:42.624470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:42.624551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:42.624446Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602528764926052:8034] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:42.624463Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602528764926052:8034] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:42.624467Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602528764926052:8034] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:42.624476Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2751 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:42.624930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:42.625021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:42.625028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:42.625030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:42.625031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:42.625033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:42.625034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:42.625035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:42.625036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:42.625038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:42.625040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:42.625041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:42.625042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:42.625043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:42.625051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:42.625065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:42.625069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:42.625072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:42.625076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:42.625080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:42.625084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:42.625088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:42.625092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:42.625096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:42.625100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:42.625104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:42.625108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:42.625119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:42.625134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:42.625141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:42.625148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:42.625153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:42.625159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:42.625164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:42.625169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:42.625178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:42.625182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:42.625186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:42.625191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:42.625196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:42.625201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:42.625205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:42.625210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:42.625214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:42.625219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:42.625223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:42.625228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:42.625233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:42.625244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:42.625249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:42.625254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:42.625258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:42.625263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:42.625319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:42.628052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:42.628815Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2750
2025-10-10T14:38:42.628862Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2750
2025-10-10T14:38:42.628408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:42.628424Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:42.628427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:42.628431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:42.628438Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2750 [2:7559602527982686724:9107]
2025-10-10T14:38:42.628452Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:42.628471Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:42.628478Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:42.628482Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:42.628484Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:42.628503Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:42.628511Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:42.628520Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:42.628591Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:42.628592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:42.628594Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:42.628597Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:42.628672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:42.628675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:42.628688Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:42.628699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:42.628715Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:42.628737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602528764926087:8034], now have 1 active actors on pipe
2025-10-10T14:38:42.628741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602528764926002:2438], now have 1 active actors on pipe
2025-10-10T14:38:42.628749Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602527982686719:9107]
2025-10-10T14:38:42.628752Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602527982686719:9107]
2025-10-10T14:38:42.628754Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602527982686719:9107]
2025-10-10T14:38:42.628772Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:42.628784Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:42.628787Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:42.628787Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:42.628789Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:42.628803Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:42.628806Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:42.628835Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602527982686719:9107]
2025-10-10T14:38:42.628840Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:42.628840Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:42.629079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:42.629096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:42.629129Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d3f35b6f-d4e266d8-88247262-9862ebc8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:42.629144Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:42.629151Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:42.629154Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:42.629165Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:42.629178Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:42.629199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:42.629399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:42.629414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:42.629448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:42.629544Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2751 partition: 0 MaxSeqNo: 40 sessionId: src_id|d3f35b6f-d4e266d8-88247262-9862ebc8_0
2025-10-10T14:38:42.629957Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be564b96-88813ad2-2c15c1f5-e8f40043_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|d3f35b6f-d4e266d8-88247262-9862ebc8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:42.632820Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d3f35b6f-d4e266d8-88247262-9862ebc8_0] Write session: try to update token
2025-10-10T14:38:42.632838Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d3f35b6f-d4e266d8-88247262-9862ebc8_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:42.652219Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2751 sessionId: src_id|d3f35b6f-d4e266d8-88247262-9862ebc8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:42.652637Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:42.652658Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:42.652662Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:42.652664Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:42.652674Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602527982686719:9107]
2025-10-10T14:38:42.652678Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602527982686719:9107]
2025-10-10T14:38:42.652682Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602527982686719:9107]
2025-10-10T14:38:42.652740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:42.652748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:42.652751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:42.652755Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:42.652763Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:42.652767Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:42.652890Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:42.655045Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:42.707662Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602528764926097:3900]
2025-10-10T14:38:42.708071Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 pipe creation result: OK TabletId: 72075186224037892 Generation: 2750, pipe: [1:7559602528764926097:3900]
2025-10-10T14:38:42.773613Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:42.774287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:42.774307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:42.774359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602528764926097:3900], now have 1 active actors on pipe
2025-10-10T14:38:42.774647Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:42.774640Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:42.774673Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 49 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602528764926097:3900]
2025-10-10T14:38:42.774697Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:42.774700Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:42.774781Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2751 reason: error at write: Disconnected sessionId: src_id|d3f35b6f-d4e266d8-88247262-9862ebc8_0
2025-10-10T14:38:42.774996Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2751 sessionId: src_id|d3f35b6f-d4e266d8-88247262-9862ebc8_0 is DEAD
2025-10-10T14:38:42.775157Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d3f35b6f-d4e266d8-88247262-9862ebc8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:42.775169Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d3f35b6f-d4e266d8-88247262-9862ebc8_0] Write session will restart in 0.009885s
2025-10-10T14:38:42.775196Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d3f35b6f-d4e266d8-88247262-9862ebc8_0] Write session: Do CDS request
2025-10-10T14:38:42.775220Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d3f35b6f-d4e266d8-88247262-9862ebc8_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:42.785941Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d3f35b6f-d4e266d8-88247262-9862ebc8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:42.787024Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:42.787043Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2752
2025-10-10T14:38:42.789378Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2752 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:42.789452Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2752 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:42.789463Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2752 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:42.789469Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:42.790001Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2752 sessionId:  describe result for acl check
2025-10-10T14:38:42.790054Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:42.790056Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:42.790058Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:42.790064Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602528764926153:8012] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:42.790051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:42.790695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602528764926153:8012] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:42.792705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602528764926153:8012] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:42.793596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:42.793883Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:42.793897Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:42.793911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:42.793974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:42.794030Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602527982686815:9103]
2025-10-10T14:38:42.794669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:42.795023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:42.795075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:42.795428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:42.795493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:42.795503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:42.795504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:42.795506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:42.795507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:42.795508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:42.795510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:42.795512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:42.795513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:42.795515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:42.795516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:42.795517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:42.795519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:42.795525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:42.795539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:42.795543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:42.795547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:42.795550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:42.795553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:42.795558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:42.795562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:42.795566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:42.795571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:42.795574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:42.795578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:42.795582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:42.795590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:42.795599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:42.795607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:42.795612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:42.795617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:42.795623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:42.795630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:42.795636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:42.795641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:42.795646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:42.795650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:42.795657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:42.795662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:42.795668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:42.795671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:42.795676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:42.795681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:42.795687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:42.795691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:42.795697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:42.795702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:42.795708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:42.795712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:42.795717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:42.795722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:42.795727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:42.795765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:42.796008Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602528764926153:8012] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:42.796026Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602528764926153:8012] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:42.796030Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602528764926153:8012] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:42.796041Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2752 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:42.798338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:42.798688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:42.798708Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:42.798711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:42.798716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:42.798723Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2751 [2:7559602527982686815:9103]
2025-10-10T14:38:42.798737Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:42.798759Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:42.798762Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:42.798766Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:42.798769Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:42.798787Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:42.798799Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:42.798807Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:42.798877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:42.798884Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:42.798886Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:42.798889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:42.798971Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:42.798979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:42.798990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:42.799005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:42.799026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:42.799050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602528764926187:8012], now have 1 active actors on pipe
2025-10-10T14:38:42.799054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602528764926098:2438], now have 1 active actors on pipe
2025-10-10T14:38:42.799061Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602527982686810:9103]
2025-10-10T14:38:42.799063Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602527982686810:9103]
2025-10-10T14:38:42.799065Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602527982686810:9103]
2025-10-10T14:38:42.799082Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:42.799098Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:42.799104Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:42.799108Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:42.799086Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2751
2025-10-10T14:38:42.799111Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:42.799090Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2751
2025-10-10T14:38:42.799116Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:42.799120Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:42.799160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:42.799183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:42.799200Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602527982686810:9103]
2025-10-10T14:38:42.799208Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:42.799214Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:42.799248Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f96f7106-edb7611b-97e27872-9d9c8705_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:42.799260Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:42.799264Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:42.799266Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:42.799277Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:42.799288Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:42.799321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:42.799479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:42.799488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:42.799505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:42.799647Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2752 partition: 0 MaxSeqNo: 40 sessionId: src_id|f96f7106-edb7611b-97e27872-9d9c8705_0
2025-10-10T14:38:42.800077Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d3f35b6f-d4e266d8-88247262-9862ebc8_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|f96f7106-edb7611b-97e27872-9d9c8705_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:42.803073Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f96f7106-edb7611b-97e27872-9d9c8705_0] Write session: try to update token
2025-10-10T14:38:42.803097Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f96f7106-edb7611b-97e27872-9d9c8705_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:42.818625Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2752 sessionId: src_id|f96f7106-edb7611b-97e27872-9d9c8705_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:42.819192Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:42.819214Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:42.819217Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:42.819219Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:42.819229Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602527982686810:9103]
2025-10-10T14:38:42.819234Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602527982686810:9103]
2025-10-10T14:38:42.819239Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602527982686810:9103]
2025-10-10T14:38:42.819289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:42.819300Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:42.819303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:42.819306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:42.819307Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:42.819311Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:42.819448Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:42.821325Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:42.875087Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602528764926203:3900]
2025-10-10T14:38:42.877627Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 pipe creation result: OK TabletId: 72075186224037892 Generation: 2751, pipe: [1:7559602528764926203:3900]
2025-10-10T14:38:42.935003Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:42.935605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:42.935625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:42.935674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602528764926203:3900], now have 1 active actors on pipe
2025-10-10T14:38:42.935885Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:42.935943Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:42.935975Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:42.935979Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:42.936007Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 50 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602528764926203:3900]
2025-10-10T14:38:42.936077Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2752 reason: error at write: Disconnected sessionId: src_id|f96f7106-edb7611b-97e27872-9d9c8705_0
2025-10-10T14:38:42.936304Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2752 sessionId: src_id|f96f7106-edb7611b-97e27872-9d9c8705_0 is DEAD
2025-10-10T14:38:42.936428Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f96f7106-edb7611b-97e27872-9d9c8705_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:42.936439Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f96f7106-edb7611b-97e27872-9d9c8705_0] Write session will restart in 0.005903s
2025-10-10T14:38:42.936465Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f96f7106-edb7611b-97e27872-9d9c8705_0] Write session: Do CDS request
2025-10-10T14:38:42.936485Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f96f7106-edb7611b-97e27872-9d9c8705_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:42.943982Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f96f7106-edb7611b-97e27872-9d9c8705_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:42.944076Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:42.944094Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2753
2025-10-10T14:38:42.944232Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2753 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:42.944270Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2753 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:42.944282Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2753 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:42.944286Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:42.944718Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2753 sessionId:  describe result for acl check
2025-10-10T14:38:42.944765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:42.944772Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:42.944774Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:42.944780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602528764926245:7988] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:42.945361Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602528764926245:7988] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:42.947167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:42.947825Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602528764926245:7988] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:42.951377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:42.951424Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602528764926245:7988] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:42.951442Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602528764926245:7988] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:42.951446Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602528764926245:7988] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:42.951456Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2753 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:42.951625Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:42.951638Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:42.951652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:42.951712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:42.951759Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602527982686907:9101]
2025-10-10T14:38:42.952372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:42.952718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:42.952770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:42.953135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:42.953225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:42.953236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:42.953237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:42.953239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:42.953240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:42.953241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:42.953243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:42.953244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:42.953246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:42.953247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:42.953248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:42.953250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:42.953251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:42.953258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:42.953272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:42.953276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:42.953280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:42.953285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:42.953289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:42.953293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:42.953297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:42.953301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:42.953306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:42.953310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:42.953314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:42.953318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:42.953326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:42.953351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:42.953362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:42.953368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:42.953373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:42.953379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:42.953384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:42.953389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:42.953394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:42.953400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:42.953405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:42.953410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:42.953416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:42.953421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:42.953426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:42.953432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:42.953438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:42.953442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:42.953447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:42.953451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:42.953457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:42.953462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:42.953466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:42.953470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:42.953474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:42.953493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:42.953535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:42.956095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:42.956907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:42.956926Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:42.956929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:42.956933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:42.956940Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2752 [2:7559602527982686907:9101]
2025-10-10T14:38:42.956955Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:42.956975Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:42.956979Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:42.956983Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:42.956986Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:42.957006Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:42.957020Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:42.957034Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:42.957118Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:42.957127Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:42.957129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:42.957132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:42.957221Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:42.957231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:42.957245Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:42.957258Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:42.957276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:42.957301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602528764926204:2438], now have 1 active actors on pipe
2025-10-10T14:38:42.957410Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2752
2025-10-10T14:38:42.957306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602528764926288:7988], now have 1 active actors on pipe
2025-10-10T14:38:42.957442Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2752
2025-10-10T14:38:42.957315Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602527982686901:9101]
2025-10-10T14:38:42.957319Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602527982686901:9101]
2025-10-10T14:38:42.957321Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602527982686901:9101]
2025-10-10T14:38:42.957369Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:42.957374Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:42.957376Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:42.957376Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:42.957394Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:42.957412Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:42.957414Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:42.957452Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602527982686901:9101]
2025-10-10T14:38:42.957455Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:42.957457Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:42.957496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:42.957502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:42.957540Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|75675d56-90576ab7-d75083d8-35ea23fd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:42.957548Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:42.957552Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:42.957555Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:42.957566Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:42.957578Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:42.957603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:42.957816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:42.957831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:42.957847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:42.957971Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2753 partition: 0 MaxSeqNo: 40 sessionId: src_id|75675d56-90576ab7-d75083d8-35ea23fd_0
2025-10-10T14:38:42.958407Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f96f7106-edb7611b-97e27872-9d9c8705_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|75675d56-90576ab7-d75083d8-35ea23fd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:42.961241Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|75675d56-90576ab7-d75083d8-35ea23fd_0] Write session: try to update token
2025-10-10T14:38:42.961258Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|75675d56-90576ab7-d75083d8-35ea23fd_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:42.975924Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2753 sessionId: src_id|75675d56-90576ab7-d75083d8-35ea23fd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:42.977221Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:42.977247Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:42.977250Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:42.977253Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:42.977264Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602527982686901:9101]
2025-10-10T14:38:42.977268Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602527982686901:9101]
2025-10-10T14:38:42.977272Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602527982686901:9101]
2025-10-10T14:38:42.977381Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:42.977404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:42.977406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:42.977559Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:42.977579Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:42.977584Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:42.977616Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:42.978810Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:43.036375Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602533059893597:3900]
2025-10-10T14:38:43.036665Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 pipe creation result: OK TabletId: 72075186224037892 Generation: 2752, pipe: [1:7559602533059893597:3900]
2025-10-10T14:38:43.091458Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:43.091907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:43.091923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:43.091972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602533059893597:3900], now have 1 active actors on pipe
2025-10-10T14:38:43.092266Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:43.092283Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:43.092283Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 51 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602533059893597:3900]
2025-10-10T14:38:43.092304Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:43.092268Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:43.092362Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2753 reason: error at write: Disconnected sessionId: src_id|75675d56-90576ab7-d75083d8-35ea23fd_0
2025-10-10T14:38:43.092575Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2753 sessionId: src_id|75675d56-90576ab7-d75083d8-35ea23fd_0 is DEAD
2025-10-10T14:38:43.092755Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75675d56-90576ab7-d75083d8-35ea23fd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:43.092767Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75675d56-90576ab7-d75083d8-35ea23fd_0] Write session will restart in 0.008612s
2025-10-10T14:38:43.092792Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75675d56-90576ab7-d75083d8-35ea23fd_0] Write session: Do CDS request
2025-10-10T14:38:43.092798Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75675d56-90576ab7-d75083d8-35ea23fd_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:43.102858Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|75675d56-90576ab7-d75083d8-35ea23fd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:43.102933Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:43.102950Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2754
2025-10-10T14:38:43.103104Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2754 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:43.103148Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2754 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:43.103160Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2754 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:43.103164Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:43.103182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:43.103746Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2754 sessionId:  describe result for acl check
2025-10-10T14:38:43.103789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:43.103795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:43.103797Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:43.103803Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602533059893653:7956] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:43.104290Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602533059893653:7956] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:43.106141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:43.106353Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:43.106365Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:43.106377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:43.106365Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602533059893653:7956] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:43.106437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:43.106478Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602532277654296:9090]
2025-10-10T14:38:43.107089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:43.107376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:43.107419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:43.107748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:43.107805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:43.107812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:43.107814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:43.107815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:43.107816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:43.107817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:43.107819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:43.107820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:43.107821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:43.107823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:43.107824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:43.107826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:43.107827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:43.107833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:43.107846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:43.107850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:43.107855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:43.107860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:43.107865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:43.107869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:43.107874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:43.107878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:43.107883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:43.107887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:43.107891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:43.107894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:43.107901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:43.107910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:43.107917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:43.107923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:43.107928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:43.107934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:43.107939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:43.107945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:43.107950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:43.107955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:43.107960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:43.107966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:43.107976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:43.107982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:43.107987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:43.107997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:43.108002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:43.108012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:43.108017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:43.108024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:43.108033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:43.108039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:43.108047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:43.108053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:43.108058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:43.108064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:43.108112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:43.108672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602533059893653:7956] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:43.108697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602533059893653:7956] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:43.108701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602533059893653:7956] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:43.108708Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2754 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:43.110479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:43.111107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:43.111124Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:43.111126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:43.111130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:43.111135Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2753 [2:7559602532277654296:9090]
2025-10-10T14:38:43.111148Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:43.111165Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:43.111169Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:43.111175Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:43.111177Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:43.111194Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:43.111207Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:43.111215Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:43.111270Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:43.111277Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:43.111279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:43.111281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:43.111351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:43.111359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:43.111371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:43.111390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:43.111413Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:43.111440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602533059893688:7956], now have 1 active actors on pipe
2025-10-10T14:38:43.111449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602533059893598:2438], now have 1 active actors on pipe
2025-10-10T14:38:43.111457Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602532277654290:9090]
2025-10-10T14:38:43.111464Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602532277654290:9090]
2025-10-10T14:38:43.111466Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602532277654290:9090]
2025-10-10T14:38:43.111480Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:43.111468Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2753
2025-10-10T14:38:43.111500Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:43.111488Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2753
2025-10-10T14:38:43.111519Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:43.111521Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:43.111525Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:43.111530Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:43.111532Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:43.111563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:43.111573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:43.111591Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602532277654290:9090]
2025-10-10T14:38:43.111604Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:43.111615Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:43.111638Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e712d40e-d7bae02f-a3b7c94d-43735039_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:43.111645Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:43.111655Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:43.111658Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:43.111668Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:43.111678Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:43.111703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:43.111871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:43.111878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:43.111891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:43.111972Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2754 partition: 0 MaxSeqNo: 40 sessionId: src_id|e712d40e-d7bae02f-a3b7c94d-43735039_0
2025-10-10T14:38:43.112336Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75675d56-90576ab7-d75083d8-35ea23fd_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|e712d40e-d7bae02f-a3b7c94d-43735039_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:43.115071Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e712d40e-d7bae02f-a3b7c94d-43735039_0] Write session: try to update token
2025-10-10T14:38:43.115088Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e712d40e-d7bae02f-a3b7c94d-43735039_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:43.129918Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2754 sessionId: src_id|e712d40e-d7bae02f-a3b7c94d-43735039_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:43.131967Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:43.131997Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:43.132002Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:43.132003Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:43.132016Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602532277654290:9090]
2025-10-10T14:38:43.132022Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602532277654290:9090]
2025-10-10T14:38:43.132027Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602532277654290:9090]
2025-10-10T14:38:43.132088Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:43.132105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:43.132114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:43.132184Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:43.132221Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:43.132227Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:43.132307Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:43.133403Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:43.192515Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602533059893696:3900]
2025-10-10T14:38:43.192801Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 pipe creation result: OK TabletId: 72075186224037892 Generation: 2753, pipe: [1:7559602533059893696:3900]
2025-10-10T14:38:43.247884Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:43.248108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:43.248116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:43.248152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602533059893696:3900], now have 1 active actors on pipe
2025-10-10T14:38:43.248377Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:43.248400Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:43.248401Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:43.248425Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:43.248446Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 52 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602533059893696:3900]
2025-10-10T14:38:43.248488Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2754 reason: error at write: Disconnected sessionId: src_id|e712d40e-d7bae02f-a3b7c94d-43735039_0
2025-10-10T14:38:43.248722Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2754 sessionId: src_id|e712d40e-d7bae02f-a3b7c94d-43735039_0 is DEAD
2025-10-10T14:38:43.248873Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e712d40e-d7bae02f-a3b7c94d-43735039_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:43.248884Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e712d40e-d7bae02f-a3b7c94d-43735039_0] Write session will restart in 0.008644s
2025-10-10T14:38:43.248908Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e712d40e-d7bae02f-a3b7c94d-43735039_0] Write session: Do CDS request
2025-10-10T14:38:43.248917Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e712d40e-d7bae02f-a3b7c94d-43735039_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:43.258891Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e712d40e-d7bae02f-a3b7c94d-43735039_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:43.258998Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:43.259067Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2755
2025-10-10T14:38:43.259157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:43.259225Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2755 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:43.259286Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2755 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:43.259297Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2755 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:43.259300Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:43.259830Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2755 sessionId:  describe result for acl check
2025-10-10T14:38:43.259868Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:43.259877Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:43.259879Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:43.259887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602533059893781:7897] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:43.260471Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602533059893781:7897] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:43.262654Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602533059893781:7897] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:43.262920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:43.263181Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:43.263192Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:43.263205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:43.263266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:43.263570Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602532277654431:9074]
2025-10-10T14:38:43.264212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:43.264543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:43.264593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:43.264924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:43.264980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:43.264986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:43.264987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:43.264989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:43.264990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:43.264991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:43.264993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:43.264994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:43.264995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:43.264997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:43.264998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:43.264999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:43.265000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:43.265006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:43.265020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:43.265024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:43.265028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:43.265032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:43.265038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:43.265042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:43.265046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:43.265050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:43.265054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:43.265058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:43.265061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:43.265065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:43.265072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:43.265082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:43.265089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:43.265094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:43.265100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:43.265111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:43.265115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:43.265125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:43.265130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:43.265135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:43.265141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:43.265148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:43.265153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:43.265164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:43.265168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:43.265174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:43.265183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:43.265189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:43.265197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:43.265204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:43.265210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:43.265216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:43.265220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:43.265229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:43.265236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:43.265242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:43.265284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:43.265417Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602533059893781:7897] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:43.265430Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602533059893781:7897] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:43.265434Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602533059893781:7897] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:43.265443Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2755 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:43.267684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:43.268289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:43.268302Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:43.268304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:43.268308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:43.268316Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2754 [2:7559602532277654431:9074]
2025-10-10T14:38:43.268329Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:43.268345Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:43.268349Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:43.268353Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:43.268355Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:43.268372Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:43.268384Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:43.268392Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:43.268454Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:43.268461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:43.268463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:43.268466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:43.268542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:43.268550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:43.268562Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:43.268580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:43.268603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:43.268630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602533059893724:2438], now have 1 active actors on pipe
2025-10-10T14:38:43.268639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602533059893809:7897], now have 1 active actors on pipe
2025-10-10T14:38:43.268648Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602532277654425:9074]
2025-10-10T14:38:43.268651Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602532277654425:9074]
2025-10-10T14:38:43.268653Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602532277654425:9074]
2025-10-10T14:38:43.268669Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:43.268689Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:43.268681Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2754
2025-10-10T14:38:43.268696Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:43.268700Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:43.268702Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:43.268712Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:43.268697Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2754
2025-10-10T14:38:43.268716Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:43.268740Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602532277654425:9074]
2025-10-10T14:38:43.268749Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:43.268757Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:43.268785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:43.268794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:43.268833Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2489951c-8a69fecf-15a59900-cf76ae3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:43.268845Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:43.268849Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:43.268852Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:43.268864Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:43.268878Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:43.268892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:43.269034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:43.269042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:43.269056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:43.269139Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2755 partition: 0 MaxSeqNo: 40 sessionId: src_id|2489951c-8a69fecf-15a59900-cf76ae3_0
2025-10-10T14:38:43.269518Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e712d40e-d7bae02f-a3b7c94d-43735039_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|2489951c-8a69fecf-15a59900-cf76ae3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:43.272435Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2489951c-8a69fecf-15a59900-cf76ae3_0] Write session: try to update token
2025-10-10T14:38:43.272456Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2489951c-8a69fecf-15a59900-cf76ae3_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:43.287140Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2755 sessionId: src_id|2489951c-8a69fecf-15a59900-cf76ae3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:43.288559Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:43.288587Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:43.288591Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:43.288593Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:43.288603Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602532277654425:9074]
2025-10-10T14:38:43.288611Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602532277654425:9074]
2025-10-10T14:38:43.288616Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602532277654425:9074]
2025-10-10T14:38:43.288674Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:43.288692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:43.288695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:43.288847Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:43.290093Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:43.290297Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:43.290311Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:43.290316Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:43.348710Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602533059893820:3900]
2025-10-10T14:38:43.349042Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 pipe creation result: OK TabletId: 72075186224037892 Generation: 2754, pipe: [1:7559602533059893820:3900]
2025-10-10T14:38:43.411530Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:43.411938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:43.411960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:43.412018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602533059893820:3900], now have 1 active actors on pipe
2025-10-10T14:38:43.412249Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:43.412278Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 53 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602533059893820:3900]
2025-10-10T14:38:43.412313Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:43.412356Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:43.412359Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:43.412433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2755 reason: error at write: Disconnected sessionId: src_id|2489951c-8a69fecf-15a59900-cf76ae3_0
2025-10-10T14:38:43.412645Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2755 sessionId: src_id|2489951c-8a69fecf-15a59900-cf76ae3_0 is DEAD
2025-10-10T14:38:43.412797Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2489951c-8a69fecf-15a59900-cf76ae3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:43.412808Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2489951c-8a69fecf-15a59900-cf76ae3_0] Write session will restart in 0.007135s
2025-10-10T14:38:43.412843Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2489951c-8a69fecf-15a59900-cf76ae3_0] Write session: Do CDS request
2025-10-10T14:38:43.412850Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2489951c-8a69fecf-15a59900-cf76ae3_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:43.420927Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2489951c-8a69fecf-15a59900-cf76ae3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:43.421551Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:43.421569Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2756
2025-10-10T14:38:43.421767Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2756 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:43.421809Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2756 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:43.421815Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2756 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:43.421819Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:43.422334Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2756 sessionId:  describe result for acl check
2025-10-10T14:38:43.422385Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:43.422391Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:43.422394Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:43.422401Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602533059893864:7881] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:43.422996Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602533059893864:7881] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:43.425456Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602533059893864:7881] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:43.427709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:43.428316Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602533059893864:7881] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:43.428356Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602533059893864:7881] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:43.428365Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602533059893864:7881] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:43.428374Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2756 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:43.431554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:43.431773Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:43.431786Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:43.431799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:43.431857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:43.431947Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602532277654529:9069]
2025-10-10T14:38:43.432552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:43.432962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:43.433019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:43.433392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:43.433464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:43.433472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:43.433473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:43.433475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:43.433476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:43.433478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:43.433479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:43.433481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:43.433483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:43.433484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:43.433486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:43.433488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:43.433489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:43.433497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:43.433513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:43.433518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:43.433523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:43.433527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:43.433531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:43.433536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:43.433540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:43.433545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:43.433550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:43.433554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:43.433558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:43.433562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:43.433571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:43.433583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:43.433589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:43.433596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:43.433601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:43.433606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:43.433611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:43.433616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:43.433621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:43.433626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:43.433631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:43.433636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:43.433650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:43.433655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:43.433660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:43.433665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:43.433670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:43.433687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:43.433691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:43.433696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:43.433704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:43.433708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:43.433712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:43.433718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:43.433722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:43.433733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:43.433793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:43.437180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:43.437938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:43.437954Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:43.437957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:43.437961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:43.437968Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2755 [2:7559602532277654529:9069]
2025-10-10T14:38:43.437982Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:43.438003Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:43.438015Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:43.438019Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:43.438027Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:43.438047Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:43.438060Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:43.438072Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:43.438140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:43.438148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:43.438150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:43.438153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:43.438230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:43.438238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:43.438253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:43.438267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:43.438290Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:43.438320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602533059893823:2438], now have 1 active actors on pipe
2025-10-10T14:38:43.438329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602533059893911:7881], now have 1 active actors on pipe
2025-10-10T14:38:43.438338Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602532277654523:9069]
2025-10-10T14:38:43.438345Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602532277654523:9069]
2025-10-10T14:38:43.438347Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602532277654523:9069]
2025-10-10T14:38:43.438361Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:43.438380Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:43.438385Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:43.438388Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:43.438390Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:43.438402Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:43.438411Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:43.438445Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602532277654523:9069]
2025-10-10T14:38:43.438457Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:43.438425Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2755
2025-10-10T14:38:43.438472Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2755
2025-10-10T14:38:43.438607Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:43.438722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:43.438741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:43.438778Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c467634a-19c38247-2a6deaa2-94046af8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:43.438788Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:43.438793Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:43.438796Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:43.438810Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:43.438829Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:43.438854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:43.439018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:43.439031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:43.439055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:43.439162Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2756 partition: 0 MaxSeqNo: 40 sessionId: src_id|c467634a-19c38247-2a6deaa2-94046af8_0
2025-10-10T14:38:43.439593Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2489951c-8a69fecf-15a59900-cf76ae3_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|c467634a-19c38247-2a6deaa2-94046af8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:43.442590Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c467634a-19c38247-2a6deaa2-94046af8_0] Write session: try to update token
2025-10-10T14:38:43.442611Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c467634a-19c38247-2a6deaa2-94046af8_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:43.457148Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2756 sessionId: src_id|c467634a-19c38247-2a6deaa2-94046af8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:43.458532Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:43.458555Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:43.458558Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:43.458559Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:43.458566Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602532277654523:9069]
2025-10-10T14:38:43.458570Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602532277654523:9069]
2025-10-10T14:38:43.458573Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602532277654523:9069]
2025-10-10T14:38:43.458616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:43.458622Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:43.458624Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:43.458631Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:43.458638Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:43.458642Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:43.458755Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:43.459827Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:43.512536Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602533059893923:3900]
2025-10-10T14:38:43.512860Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 pipe creation result: OK TabletId: 72075186224037892 Generation: 2755, pipe: [1:7559602533059893923:3900]
2025-10-10T14:38:43.576808Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:43.577276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:43.577296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:43.577359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602533059893923:3900], now have 1 active actors on pipe
2025-10-10T14:38:43.577586Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:43.577961Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:38:43.578052Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2756 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c467634a-19c38247-2a6deaa2-94046af8_0
2025-10-10T14:38:43.578251Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2756 sessionId: src_id|c467634a-19c38247-2a6deaa2-94046af8_0 is DEAD
2025-10-10T14:38:43.578414Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c467634a-19c38247-2a6deaa2-94046af8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:38:43.578427Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c467634a-19c38247-2a6deaa2-94046af8_0] Write session will restart in 0.007527s
2025-10-10T14:38:43.578454Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c467634a-19c38247-2a6deaa2-94046af8_0] Write session: Do CDS request
2025-10-10T14:38:43.578461Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c467634a-19c38247-2a6deaa2-94046af8_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:43.578435Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:43.578483Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 54 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602533059893923:3900]
2025-10-10T14:38:43.586887Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c467634a-19c38247-2a6deaa2-94046af8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:43.587112Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:43.587131Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2757
2025-10-10T14:38:43.587290Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2757 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:43.587328Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2757 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:43.587340Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2757 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:43.587345Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:43.587828Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2757 sessionId:  describe result for acl check
2025-10-10T14:38:43.587866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:43.587872Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:43.587874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:43.587880Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602533059893992:7853] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:43.588449Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602533059893992:7853] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:43.589459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:43.593273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:43.593566Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:43.593581Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:43.593594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:43.593656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:43.593704Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602532277654637:9063]
2025-10-10T14:38:43.594389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:43.594545Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602533059893992:7853] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:43.595515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:43.595598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:43.596006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:43.596067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:43.596074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:43.596075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:43.596076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:43.596078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:43.596079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:43.596081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:43.596082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:43.596084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:43.596085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:43.596087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:43.596088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:43.596089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:43.596097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:43.596110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:43.596114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:43.596117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:43.596121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:43.596125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:43.596129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:43.596134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:43.596138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:43.596152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:43.596157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:43.596161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:43.596166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:43.596174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:43.596183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:43.596190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:43.596197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:43.596202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:43.596207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:43.596211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:43.596216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:43.596222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:43.596228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:43.596232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:43.596236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:43.596241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:43.596247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:43.596251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:43.596256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:43.596262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:43.596273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:43.596277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:43.596282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:43.596293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:43.596298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:43.596307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:43.596312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:43.596316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:43.596321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:43.596371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:43.599106Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602533059893992:7853] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:43.599128Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602533059893992:7853] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:43.599124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:43.599132Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602533059893992:7853] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:43.599143Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2757 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:43.599486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:43.599501Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:43.599503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:43.599508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:43.599516Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2756 [2:7559602532277654637:9063]
2025-10-10T14:38:43.599530Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:43.599550Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:43.599560Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:43.599565Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:43.599567Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:43.599585Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:43.599597Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:43.599605Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:43.599682Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:43.599689Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:43.599691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:43.599694Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:43.599766Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:43.599778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:43.599790Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:43.599801Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:43.599818Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:43.599850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602533059893936:2438], now have 1 active actors on pipe
2025-10-10T14:38:43.599858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602533059894028:7853], now have 1 active actors on pipe
2025-10-10T14:38:43.599865Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602532277654632:9063]
2025-10-10T14:38:43.599873Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602532277654632:9063]
2025-10-10T14:38:43.599877Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602532277654632:9063]
2025-10-10T14:38:43.599889Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:43.599905Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:43.599928Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:43.599932Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:43.599941Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:43.599952Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:43.599954Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:43.599920Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2756
2025-10-10T14:38:43.599966Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602532277654632:9063]
2025-10-10T14:38:43.599954Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2756
2025-10-10T14:38:43.599970Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:43.599971Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:43.600095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:43.600111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:43.600154Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3e01a1f-8000e301-e31a4508-27425e2b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:43.600169Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:43.600174Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:43.600180Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:43.600193Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:43.600219Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:43.600240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:43.600491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:43.600515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:43.600540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:43.600646Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2757 partition: 0 MaxSeqNo: 40 sessionId: src_id|3e01a1f-8000e301-e31a4508-27425e2b_0
2025-10-10T14:38:43.601057Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c467634a-19c38247-2a6deaa2-94046af8_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|3e01a1f-8000e301-e31a4508-27425e2b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:43.604007Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3e01a1f-8000e301-e31a4508-27425e2b_0] Write session: try to update token
2025-10-10T14:38:43.604029Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3e01a1f-8000e301-e31a4508-27425e2b_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:43.620297Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:43.620320Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:43.620324Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:43.620327Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:43.620338Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602532277654632:9063]
2025-10-10T14:38:43.620344Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602532277654632:9063]
2025-10-10T14:38:43.620348Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602532277654632:9063]
2025-10-10T14:38:43.620401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:43.620414Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:43.620422Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:43.620558Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:43.623207Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2757 sessionId: src_id|3e01a1f-8000e301-e31a4508-27425e2b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:43.625396Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:43.625423Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:43.625427Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:43.625932Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:43.678940Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602533059894036:3900]
2025-10-10T14:38:43.679262Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 pipe creation result: OK TabletId: 72075186224037892 Generation: 2756, pipe: [1:7559602533059894036:3900]
2025-10-10T14:38:43.742854Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:43.743337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:43.743351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:43.743397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602533059894036:3900], now have 1 active actors on pipe
2025-10-10T14:38:43.743619Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:43.743656Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:43.743684Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:43.743688Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:43.743723Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 55 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602533059894036:3900]
2025-10-10T14:38:43.743780Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2757 reason: error at write: Disconnected sessionId: src_id|3e01a1f-8000e301-e31a4508-27425e2b_0
2025-10-10T14:38:43.743983Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2757 sessionId: src_id|3e01a1f-8000e301-e31a4508-27425e2b_0 is DEAD
2025-10-10T14:38:43.744117Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e01a1f-8000e301-e31a4508-27425e2b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:43.744136Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e01a1f-8000e301-e31a4508-27425e2b_0] Write session will restart in 0.006031s
2025-10-10T14:38:43.744160Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e01a1f-8000e301-e31a4508-27425e2b_0] Write session: Do CDS request
2025-10-10T14:38:43.744170Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e01a1f-8000e301-e31a4508-27425e2b_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:43.751961Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3e01a1f-8000e301-e31a4508-27425e2b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:43.752085Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:43.752102Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2758
2025-10-10T14:38:43.752277Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2758 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:43.752319Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2758 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:43.752331Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2758 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:43.752336Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:43.752832Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2758 sessionId:  describe result for acl check
2025-10-10T14:38:43.752875Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:43.752882Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:43.752884Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:43.752891Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602533059894089:7854] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:43.753523Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602533059894089:7854] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:43.755149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:43.755746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602533059894089:7854] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:43.758263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:43.758487Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:43.758498Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:43.758511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:43.758556Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602533059894089:7854] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:43.758571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:43.758573Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602533059894089:7854] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:43.758577Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602533059894089:7854] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:43.758587Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2758 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:43.758617Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602532277654736:9057]
2025-10-10T14:38:43.759228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:43.759544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:43.759589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:43.759913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:43.759971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:43.759978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:43.759979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:43.759981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:43.759982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:43.759983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:43.759985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:43.759986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:43.759987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:43.759988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:43.759989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:43.759991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:43.759992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:43.759998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:43.760010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:43.760015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:43.760019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:43.760023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:43.760029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:43.760033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:43.760038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:43.760041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:43.760046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:43.760050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:43.760054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:43.760058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:43.760067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:43.760076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:43.760082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:43.760087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:43.760097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:43.760102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:43.760112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:43.760119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:43.760129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:43.760134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:43.760139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:43.760144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:43.760149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:43.760154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:43.760159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:43.760164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:43.760169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:43.760178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:43.760183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:43.760188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:43.760193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:43.760202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:43.760206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:43.760212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:43.760216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:43.760221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:43.760261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:43.762826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:43.763437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:43.763451Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:43.763454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:43.763458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:43.763464Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2757 [2:7559602532277654736:9057]
2025-10-10T14:38:43.763476Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:43.763493Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:43.763497Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:43.763500Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:43.763503Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:43.763523Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:43.763537Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:43.763549Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:43.763605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:43.763611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:43.763612Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:43.763614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:43.763680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:43.763687Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:43.763698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:43.763709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:43.763726Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:43.763754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602533059894126:7854], now have 1 active actors on pipe
2025-10-10T14:38:43.763758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602533059894037:2438], now have 1 active actors on pipe
2025-10-10T14:38:43.763766Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602532277654729:9057]
2025-10-10T14:38:43.763768Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602532277654729:9057]
2025-10-10T14:38:43.763771Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602532277654729:9057]
2025-10-10T14:38:43.763784Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:43.763797Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:43.763803Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:43.763807Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:43.763813Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:43.763816Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:43.763819Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:43.763827Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2757
2025-10-10T14:38:43.763839Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2757
2025-10-10T14:38:43.763843Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602532277654729:9057]
2025-10-10T14:38:43.763853Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:43.763866Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:43.763907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:43.763918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:43.763947Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|327cbc51-1db5b62b-59bb92f4-90f51326_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:43.763959Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:43.763962Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:43.763964Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:43.763974Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:43.763984Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:43.763998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:43.764155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:43.764162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:43.764175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:43.764258Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2758 partition: 0 MaxSeqNo: 40 sessionId: src_id|327cbc51-1db5b62b-59bb92f4-90f51326_0
2025-10-10T14:38:43.764663Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e01a1f-8000e301-e31a4508-27425e2b_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|327cbc51-1db5b62b-59bb92f4-90f51326_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:43.767625Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|327cbc51-1db5b62b-59bb92f4-90f51326_0] Write session: try to update token
2025-10-10T14:38:43.767647Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|327cbc51-1db5b62b-59bb92f4-90f51326_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:43.782512Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:38:43.782537Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:43.782550Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602532277654729:9057]
2025-10-10T14:38:43.782604Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:38:43.782612Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:38:43.782787Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:38:43.782944Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:43.783093Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:43.783239Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:43.783439Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:38:43.783488Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:38:43.786178Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2758 sessionId: src_id|327cbc51-1db5b62b-59bb92f4-90f51326_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:43.788840Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:43.789076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:43.789099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:43.789140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:38:43.789241Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:38:43.793624Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:43.793646Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:43.793649Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:43.793651Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:43.793665Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602532277654729:9057]
2025-10-10T14:38:43.793669Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602532277654729:9057]
2025-10-10T14:38:43.793673Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602532277654729:9057]
2025-10-10T14:38:43.793716Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:43.793720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:43.793729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:43.793731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:43.793732Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:43.793737Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:43.793889Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:43.845030Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602533059894144:3900]
2025-10-10T14:38:43.845708Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 pipe creation result: OK TabletId: 72075186224037892 Generation: 2757, pipe: [1:7559602533059894144:3900]
2025-10-10T14:38:43.916200Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:43.924603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:43.924640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:43.924843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:43.924921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:43.924992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:43.925062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:43.925166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:43.925177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:43.925250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:43.925315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:43.925403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:43.925484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:43.925537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:43.925546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:43.925623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:43.925694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:43.925776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:43.925846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:43.925895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:43.925903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:43.925979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:43.926048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:43.926119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:43.926191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:43.926231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:43.926235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:43.926301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:43.926364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:43.926424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:43.926483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:43.926529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:43.926532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:43.926604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:43.926665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:43.926727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:43.926786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:43.926831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:43.926837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:43.926906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:43.926969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:43.927040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:43.927100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:43.927143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:43.927146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:43.929577Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 56 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602533059894144:3900]
2025-10-10T14:38:43.927221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:43.929620Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:43.927282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:43.927345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:43.927410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:43.927452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:43.927455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:43.927528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:43.927587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:43.927646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:43.927715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:43.927760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:43.927763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:43.927838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:43.927900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:43.927965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:43.928032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:43.928082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:43.928085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:43.928174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602533059894144:3900], now have 1 active actors on pipe
2025-10-10T14:38:43.929588Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:43.929870Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:38:43.929930Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2758 reason: status is not ok: tablet will be restarted right now sessionId: src_id|327cbc51-1db5b62b-59bb92f4-90f51326_0
2025-10-10T14:38:43.930334Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|327cbc51-1db5b62b-59bb92f4-90f51326_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:38:43.930346Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|327cbc51-1db5b62b-59bb92f4-90f51326_0] Write session will restart in 0.006601s
2025-10-10T14:38:43.930371Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|327cbc51-1db5b62b-59bb92f4-90f51326_0] Write session: Do CDS request
2025-10-10T14:38:43.930377Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|327cbc51-1db5b62b-59bb92f4-90f51326_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:43.930237Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2758 sessionId: src_id|327cbc51-1db5b62b-59bb92f4-90f51326_0 is DEAD
2025-10-10T14:38:43.942029Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|327cbc51-1db5b62b-59bb92f4-90f51326_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:43.942136Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:43.942157Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2759
2025-10-10T14:38:43.942300Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2759 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:43.942349Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2759 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:43.942362Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2759 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:43.942366Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:43.942784Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2759 sessionId:  describe result for acl check
2025-10-10T14:38:43.942823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:43.942830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:43.942832Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:43.942838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602533059894164:7849] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:43.943421Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602533059894164:7849] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:43.946365Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602533059894164:7849] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:43.954205Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602533059894164:7849] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:43.954224Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602533059894164:7849] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:43.954228Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602533059894164:7849] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:43.954237Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2759 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:43.954383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:43.955162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:43.955405Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:43.955416Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:43.955429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:43.955486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:43.955538Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602532277654836:9058]
2025-10-10T14:38:43.956182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:43.958507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:43.958598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:43.959008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:43.959079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:43.959087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:43.959088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:43.959090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:43.959092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:43.959093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:43.959094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:43.959096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:43.959098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:43.959099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:43.959100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:43.959101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:43.959103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:43.959110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:43.959127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:43.959131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:43.959135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:43.959139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:43.959143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:43.959147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:43.959151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:43.959155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:43.959161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:43.959165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:43.959170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:43.959173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:43.959183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:43.959192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:43.959199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:43.959205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:43.959210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:43.959215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:43.959220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:43.959225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:43.959230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:43.959236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:43.959240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:43.959246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:43.959250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:43.959255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:43.959260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:43.959273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:43.959279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:43.959285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:43.959290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:43.959296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:43.959302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:43.959307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:43.959312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:43.959317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:43.959328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:43.959333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:43.959370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:43.962389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:43.963140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:43.963166Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:43.963168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:43.963172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:43.963179Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2758 [2:7559602532277654836:9058]
2025-10-10T14:38:43.963193Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:43.963213Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:43.963216Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:43.963220Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:43.963222Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:43.963239Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:43.963253Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:43.963261Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:43.963324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:43.963333Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:43.963335Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:43.963337Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:43.963406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:43.963414Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:43.963427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:43.963437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:43.963453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:43.963474Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602532277654830:9058]
2025-10-10T14:38:43.963482Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602532277654830:9058]
2025-10-10T14:38:43.963484Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602532277654830:9058]
2025-10-10T14:38:43.963493Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:43.963508Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:43.963509Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:43.963515Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:43.963517Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:43.963523Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:43.963526Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:43.963536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602533059894150:2438], now have 1 active actors on pipe
2025-10-10T14:38:43.963539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602533059894240:7849], now have 1 active actors on pipe
2025-10-10T14:38:43.963568Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602532277654830:9058]
2025-10-10T14:38:43.963576Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:43.963745Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2758
2025-10-10T14:38:43.963811Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2758
2025-10-10T14:38:43.963671Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:43.963872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:43.963880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:43.963914Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|18d34f65-4a5690b5-10c3cebe-a1cab7c3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:43.963934Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:43.963939Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:43.963942Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:43.963956Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:43.963970Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:43.963992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:43.964207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:43.964233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:43.964261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:43.964388Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2759 partition: 0 MaxSeqNo: 40 sessionId: src_id|18d34f65-4a5690b5-10c3cebe-a1cab7c3_0
2025-10-10T14:38:43.964811Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|327cbc51-1db5b62b-59bb92f4-90f51326_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|18d34f65-4a5690b5-10c3cebe-a1cab7c3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:43.967720Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|18d34f65-4a5690b5-10c3cebe-a1cab7c3_0] Write session: try to update token
2025-10-10T14:38:43.967740Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|18d34f65-4a5690b5-10c3cebe-a1cab7c3_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:43.985492Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:43.985514Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:43.985517Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:43.985525Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:43.985538Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602532277654830:9058]
2025-10-10T14:38:43.985543Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602532277654830:9058]
2025-10-10T14:38:43.985547Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602532277654830:9058]
2025-10-10T14:38:43.985602Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:43.985602Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:43.985608Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:43.985612Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:43.985617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:43.985620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:43.985770Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:43.988126Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2759 sessionId: src_id|18d34f65-4a5690b5-10c3cebe-a1cab7c3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:43.990926Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:44.029646Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602537354861549:3900]
2025-10-10T14:38:44.030014Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 pipe creation result: OK TabletId: 72075186224037892 Generation: 2758, pipe: [1:7559602537354861549:3900]
2025-10-10T14:38:44.134743Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:44.135047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:44.135069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:44.135118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602537354861549:3900], now have 1 active actors on pipe
2025-10-10T14:38:44.137644Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 57 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602537354861549:3900]
2025-10-10T14:38:44.137680Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:44.137701Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:44.137748Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:44.137756Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:44.137820Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2759 reason: error at write: Disconnected sessionId: src_id|18d34f65-4a5690b5-10c3cebe-a1cab7c3_0
2025-10-10T14:38:44.138037Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2759 sessionId: src_id|18d34f65-4a5690b5-10c3cebe-a1cab7c3_0 is DEAD
2025-10-10T14:38:44.138182Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18d34f65-4a5690b5-10c3cebe-a1cab7c3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:44.138202Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18d34f65-4a5690b5-10c3cebe-a1cab7c3_0] Write session will restart in 0.006498s
2025-10-10T14:38:44.138227Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18d34f65-4a5690b5-10c3cebe-a1cab7c3_0] Write session: Do CDS request
2025-10-10T14:38:44.138235Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18d34f65-4a5690b5-10c3cebe-a1cab7c3_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:44.145868Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|18d34f65-4a5690b5-10c3cebe-a1cab7c3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:44.145991Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:44.146007Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2760
2025-10-10T14:38:44.146160Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2760 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:44.146192Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2760 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:44.146203Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2760 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:44.146216Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:44.146715Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2760 sessionId:  describe result for acl check
2025-10-10T14:38:44.146756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:44.146762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:44.146765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:44.146771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602537354861564:7840] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:44.147378Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602537354861564:7840] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:44.150043Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602537354861564:7840] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:44.152428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:44.155912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:44.156165Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:44.156183Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:44.156196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:44.156047Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602537354861564:7840] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:44.156067Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602537354861564:7840] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:44.156071Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602537354861564:7840] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:44.156081Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2760 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:44.156276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:44.156324Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602536572622231:9045]
2025-10-10T14:38:44.156929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:44.157309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:44.157383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:44.157729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:44.157815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:44.157817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:44.157818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:44.157819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:44.157820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:44.157822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:44.157823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:44.157824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:44.157826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:44.157827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:44.157829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:44.157830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:44.157831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:44.157838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:44.157851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:44.157854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:44.157858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:44.157862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:44.157866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:44.157869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:44.157873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:44.157877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:44.157881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:44.157885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:44.157889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:44.157893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:44.157901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:44.157911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:44.157918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:44.157923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:44.157927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:44.157932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:44.157937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:44.157943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:44.157947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:44.157953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:44.157957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:44.157962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:44.157966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:44.157972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:44.157975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:44.157980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:44.157986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:44.157991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:44.157995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:44.158000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:44.158005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:44.158010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:44.158014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:44.158018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:44.158023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:44.158031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:44.158070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:44.160782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:44.161539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:44.161554Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:44.161557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:44.161562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:44.161572Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2759 [2:7559602536572622231:9045]
2025-10-10T14:38:44.161591Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:44.161612Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:44.161624Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:44.161630Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:44.161632Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:44.161653Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:44.161662Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:44.161677Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:44.161770Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:44.161780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:44.161782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:44.161785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:44.161863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:44.161872Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:44.161886Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:44.161897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:44.161924Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:44.161948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602537354861643:7840], now have 1 active actors on pipe
2025-10-10T14:38:44.161957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602537354861551:2438], now have 1 active actors on pipe
2025-10-10T14:38:44.161966Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602536572622226:9045]
2025-10-10T14:38:44.161968Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602536572622226:9045]
2025-10-10T14:38:44.161970Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602536572622226:9045]
2025-10-10T14:38:44.161987Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:44.162002Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:44.162003Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:44.162006Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:44.162008Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:44.162024Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:44.162028Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:44.162048Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2759
2025-10-10T14:38:44.162050Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2759
2025-10-10T14:38:44.162070Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602536572622226:9045]
2025-10-10T14:38:44.162082Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:44.162090Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:44.162115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:44.162120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:44.162166Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3712b89-68b86d14-2aaceb-eb46e7bd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:44.162181Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:44.162187Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:44.162190Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:44.162205Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:44.162222Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:44.162242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:44.162729Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2760 partition: 0 MaxSeqNo: 40 sessionId: src_id|3712b89-68b86d14-2aaceb-eb46e7bd_0
2025-10-10T14:38:44.162547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:44.162555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:44.162573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:44.163937Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18d34f65-4a5690b5-10c3cebe-a1cab7c3_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|3712b89-68b86d14-2aaceb-eb46e7bd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:44.166758Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3712b89-68b86d14-2aaceb-eb46e7bd_0] Write session: try to update token
2025-10-10T14:38:44.166778Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3712b89-68b86d14-2aaceb-eb46e7bd_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:44.182934Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:44.182959Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:44.182964Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:44.182967Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:44.182978Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602536572622226:9045]
2025-10-10T14:38:44.182984Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602536572622226:9045]
2025-10-10T14:38:44.182988Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602536572622226:9045]
2025-10-10T14:38:44.183046Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:44.183050Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:44.183058Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:44.183058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:44.183062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:44.183063Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:44.183215Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:44.183752Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2760 sessionId: src_id|3712b89-68b86d14-2aaceb-eb46e7bd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:44.186692Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:44.238023Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602537354861655:3900]
2025-10-10T14:38:44.238417Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 pipe creation result: OK TabletId: 72075186224037892 Generation: 2759, pipe: [1:7559602537354861655:3900]
2025-10-10T14:38:44.307224Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:44.307469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:44.307485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:44.307529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602537354861655:3900], now have 1 active actors on pipe
2025-10-10T14:38:44.307738Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 58 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602537354861655:3900]
2025-10-10T14:38:44.307754Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:44.307738Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:44.307772Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:44.307774Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:44.307841Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2760 reason: error at write: Disconnected sessionId: src_id|3712b89-68b86d14-2aaceb-eb46e7bd_0
2025-10-10T14:38:44.308033Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2760 sessionId: src_id|3712b89-68b86d14-2aaceb-eb46e7bd_0 is DEAD
2025-10-10T14:38:44.308192Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3712b89-68b86d14-2aaceb-eb46e7bd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:44.308203Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3712b89-68b86d14-2aaceb-eb46e7bd_0] Write session will restart in 0.005130s
2025-10-10T14:38:44.308227Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3712b89-68b86d14-2aaceb-eb46e7bd_0] Write session: Do CDS request
2025-10-10T14:38:44.308235Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3712b89-68b86d14-2aaceb-eb46e7bd_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:44.314902Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3712b89-68b86d14-2aaceb-eb46e7bd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:44.315019Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:44.315049Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2761
2025-10-10T14:38:44.315187Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2761 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:44.315226Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2761 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:44.315238Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2761 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:44.315242Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:44.315759Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2761 sessionId:  describe result for acl check
2025-10-10T14:38:44.315803Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:44.315805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:44.315806Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:44.315813Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602537354861701:7789] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:44.316404Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602537354861701:7789] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:44.319118Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602537354861701:7789] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:44.319954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:44.323823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:44.324083Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:44.324096Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:44.324109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:44.324172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:44.324219Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602536572622372:9032]
2025-10-10T14:38:44.324225Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602537354861701:7789] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:44.324246Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602537354861701:7789] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:44.324251Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602537354861701:7789] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:44.324262Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2761 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:44.324883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:44.325223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:44.325296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:44.325707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:44.325789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:44.325798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:44.325800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:44.325801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:44.325803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:44.325804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:44.325805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:44.325807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:44.325808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:44.325810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:44.325812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:44.325813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:44.325815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:44.325822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:44.325836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:44.325841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:44.325845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:44.325850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:44.325854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:44.325859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:44.325863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:44.325867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:44.325873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:44.325877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:44.325882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:44.325886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:44.325896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:44.325905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:44.325913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:44.325920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:44.325925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:44.325931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:44.325936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:44.325942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:44.325947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:44.325953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:44.325958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:44.325963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:44.325969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:44.325974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:44.325979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:44.325985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:44.325995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:44.326001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:44.326007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:44.326014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:44.326025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:44.326031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:44.326038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:44.326045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:44.326050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:44.326058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:44.326100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:44.328655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:44.329040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:44.329054Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:44.329057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:44.329061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:44.329067Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2760 [2:7559602536572622372:9032]
2025-10-10T14:38:44.329082Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:44.329099Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:44.329107Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:44.329111Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:44.329113Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:44.329132Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:44.329144Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:44.329152Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:44.329217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:44.329223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:44.329225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:44.329228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:44.329653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:44.329662Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:44.329677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:44.329692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:44.329716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:44.329757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602537354861683:2438], now have 1 active actors on pipe
2025-10-10T14:38:44.329766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602537354861773:7789], now have 1 active actors on pipe
2025-10-10T14:38:44.329774Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602536572622367:9032]
2025-10-10T14:38:44.329779Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602536572622367:9032]
2025-10-10T14:38:44.329691Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2760
2025-10-10T14:38:44.329699Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2760
2025-10-10T14:38:44.329781Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602536572622367:9032]
2025-10-10T14:38:44.329797Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:44.329813Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:44.329818Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:44.329824Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:44.329826Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:44.329834Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:44.329837Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:44.329853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:44.329859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:44.329898Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602536572622367:9032]
2025-10-10T14:38:44.329911Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:44.329919Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:44.329931Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|56895644-3e4b0e69-42947f9c-a5e3e035_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:44.329943Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:44.329952Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:44.329955Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:44.329967Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:44.329979Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:44.330013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:44.330209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:44.330217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:44.330232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:44.330347Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2761 partition: 0 MaxSeqNo: 40 sessionId: src_id|56895644-3e4b0e69-42947f9c-a5e3e035_0
2025-10-10T14:38:44.330775Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3712b89-68b86d14-2aaceb-eb46e7bd_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|56895644-3e4b0e69-42947f9c-a5e3e035_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:44.333557Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|56895644-3e4b0e69-42947f9c-a5e3e035_0] Write session: try to update token
2025-10-10T14:38:44.333574Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|56895644-3e4b0e69-42947f9c-a5e3e035_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:44.349665Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:44.349683Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:44.349686Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:44.349689Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:44.349699Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602536572622367:9032]
2025-10-10T14:38:44.349704Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602536572622367:9032]
2025-10-10T14:38:44.349708Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602536572622367:9032]
2025-10-10T14:38:44.349775Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:44.349776Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:44.349783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:44.349786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:44.349799Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:44.349804Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:44.351770Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2761 sessionId: src_id|56895644-3e4b0e69-42947f9c-a5e3e035_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:44.349932Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:44.354674Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:44.408034Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602537354861785:3900]
2025-10-10T14:38:44.408463Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 pipe creation result: OK TabletId: 72075186224037892 Generation: 2760, pipe: [1:7559602537354861785:3900]
2025-10-10T14:38:44.467408Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:44.467917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:44.467935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:44.467987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602537354861785:3900], now have 1 active actors on pipe
2025-10-10T14:38:44.468232Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:44.468248Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 59 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602537354861785:3900]
2025-10-10T14:38:44.468290Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:44.468293Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:44.468360Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2761 reason: error at write: Disconnected sessionId: src_id|56895644-3e4b0e69-42947f9c-a5e3e035_0
2025-10-10T14:38:44.468247Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:44.468611Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2761 sessionId: src_id|56895644-3e4b0e69-42947f9c-a5e3e035_0 is DEAD
2025-10-10T14:38:44.468818Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56895644-3e4b0e69-42947f9c-a5e3e035_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:44.468831Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56895644-3e4b0e69-42947f9c-a5e3e035_0] Write session will restart in 0.007893s
2025-10-10T14:38:44.468858Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56895644-3e4b0e69-42947f9c-a5e3e035_0] Write session: Do CDS request
2025-10-10T14:38:44.468867Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56895644-3e4b0e69-42947f9c-a5e3e035_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:44.481093Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|56895644-3e4b0e69-42947f9c-a5e3e035_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:44.481616Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:44.481644Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2762
2025-10-10T14:38:44.481812Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2762 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:44.481850Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2762 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:44.481861Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2762 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:44.481866Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:44.482273Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2762 sessionId:  describe result for acl check
2025-10-10T14:38:44.482312Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:44.482318Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:44.482322Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:44.482328Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602537354861803:7782] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:44.482886Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602537354861803:7782] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:44.486723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602537354861803:7782] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:44.489287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:44.492404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:44.492613Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602537354861803:7782] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:44.492633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602537354861803:7782] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:44.492637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602537354861803:7782] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:44.492646Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2762 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:44.492649Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:44.492665Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:44.492679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:44.492744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:44.492797Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602536572622486:9028]
2025-10-10T14:38:44.493423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:44.493786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:44.493835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:44.494188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:44.494272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:44.494277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:44.494279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:44.494280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:44.494282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:44.494284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:44.494285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:44.494286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:44.494287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:44.494289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:44.494290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:44.494291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:44.494293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:44.494299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:44.494313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:44.494316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:44.494318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:44.494320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:44.494323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:44.494325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:44.494327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:44.494329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:44.494331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:44.494334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:44.494336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:44.494338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:44.494344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:44.494350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:44.494356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:44.494359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:44.494363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:44.494366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:44.494369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:44.494372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:44.494375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:44.494378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:44.494382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:44.494389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:44.494393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:44.494398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:44.494404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:44.494409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:44.494413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:44.494416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:44.494418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:44.494421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:44.494424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:44.494427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:44.494429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:44.494433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:44.494436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:44.494439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:44.494462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:44.497012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:44.497405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:44.497417Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:44.497420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:44.497424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:44.497431Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2761 [2:7559602536572622486:9028]
2025-10-10T14:38:44.497445Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:44.497464Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:44.497471Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:44.497475Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:44.497478Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:44.497496Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:44.497511Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:44.497519Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:44.497590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:44.497600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:44.497602Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:44.497604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:44.497677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:44.497682Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:44.497693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:44.497708Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:44.497724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:44.497766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602537354861881:7782], now have 1 active actors on pipe
2025-10-10T14:38:44.497775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602537354861787:2438], now have 1 active actors on pipe
2025-10-10T14:38:44.497783Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602536572622481:9028]
2025-10-10T14:38:44.497789Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602536572622481:9028]
2025-10-10T14:38:44.497791Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602536572622481:9028]
2025-10-10T14:38:44.497807Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:44.497824Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:44.497825Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:44.497828Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:44.497830Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:44.497845Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:44.497851Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:44.497864Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2761
2025-10-10T14:38:44.497878Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2761
2025-10-10T14:38:44.497882Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602536572622481:9028]
2025-10-10T14:38:44.497890Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:44.497905Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:44.497925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:44.497929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:44.497964Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9d550c00-e6711e6-6afb9e89-f2ba9c39_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:44.497972Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:44.497976Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:44.497979Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:44.497994Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:44.498014Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:44.498034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:44.498171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:44.498180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:44.498199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:44.498303Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2762 partition: 0 MaxSeqNo: 40 sessionId: src_id|9d550c00-e6711e6-6afb9e89-f2ba9c39_0
2025-10-10T14:38:44.498724Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56895644-3e4b0e69-42947f9c-a5e3e035_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|9d550c00-e6711e6-6afb9e89-f2ba9c39_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:44.501479Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9d550c00-e6711e6-6afb9e89-f2ba9c39_0] Write session: try to update token
2025-10-10T14:38:44.501499Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9d550c00-e6711e6-6afb9e89-f2ba9c39_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:44.516137Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2762 sessionId: src_id|9d550c00-e6711e6-6afb9e89-f2ba9c39_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:44.518235Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:44.518252Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:44.518255Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:44.518257Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:44.518268Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602536572622481:9028]
2025-10-10T14:38:44.518272Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602536572622481:9028]
2025-10-10T14:38:44.518276Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602536572622481:9028]
2025-10-10T14:38:44.518324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:44.518326Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:44.518336Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:44.518338Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:44.518353Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:44.518358Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:44.518474Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:44.518824Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:44.568302Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602537354861907:3900]
2025-10-10T14:38:44.568627Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 pipe creation result: OK TabletId: 72075186224037892 Generation: 2761, pipe: [1:7559602537354861907:3900]
2025-10-10T14:38:44.637826Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:44.638655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:44.638688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:44.638744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602537354861907:3900], now have 1 active actors on pipe
2025-10-10T14:38:44.639371Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:44.641243Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d550c00-e6711e6-6afb9e89-f2ba9c39_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:44.641256Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d550c00-e6711e6-6afb9e89-f2ba9c39_0] Write session will restart in 0.008168s
2025-10-10T14:38:44.641281Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d550c00-e6711e6-6afb9e89-f2ba9c39_0] Write session: Do CDS request
2025-10-10T14:38:44.641287Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d550c00-e6711e6-6afb9e89-f2ba9c39_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:44.639154Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:44.639175Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:44.639177Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 60 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602537354861907:3900]
2025-10-10T14:38:44.639202Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:44.639265Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2762 reason: error at write: Disconnected sessionId: src_id|9d550c00-e6711e6-6afb9e89-f2ba9c39_0
2025-10-10T14:38:44.639474Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2762 sessionId: src_id|9d550c00-e6711e6-6afb9e89-f2ba9c39_0 is DEAD
2025-10-10T14:38:44.650688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:44.650877Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9d550c00-e6711e6-6afb9e89-f2ba9c39_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:44.650952Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:44.650984Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2763
2025-10-10T14:38:44.651120Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2763 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:44.651167Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2763 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:44.651179Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2763 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:44.651183Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:44.653816Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2763 sessionId:  describe result for acl check
2025-10-10T14:38:44.653859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:44.653865Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:44.653868Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:44.653874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602537354861978:7754] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:44.653990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:44.654215Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:44.654228Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:44.654241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:44.654305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:44.654347Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602536572622590:9027]
2025-10-10T14:38:44.654433Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602537354861978:7754] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:44.655021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:44.655395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:44.655445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:44.655802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:44.655871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:44.655877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:44.655879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:44.655880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:44.655881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:44.655883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:44.655884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:44.655885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:44.655887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:44.655888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:44.655889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:44.655890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:44.655891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:44.655898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:44.655910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:44.655915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:44.655919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:44.655923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:44.655928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:44.655931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:44.655935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:44.655939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:44.655943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:44.655947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:44.655951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:44.655955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:44.655962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:44.655971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:44.655978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:44.655983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:44.655989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:44.655995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:44.655999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:44.656005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:44.656010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:44.656016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:44.656020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:44.656026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:44.656033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:44.656037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:44.656042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:44.656046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:44.656057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:44.656062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:44.656066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:44.656077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:44.656082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:44.656088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:44.656098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:44.656103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:44.656108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:44.656118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:44.656160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:44.656822Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602537354861978:7754] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:44.658629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:44.658946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:44.658959Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:44.658962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:44.658965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:44.658972Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2762 [2:7559602536572622590:9027]
2025-10-10T14:38:44.658987Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:44.659006Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:44.659013Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:44.659017Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:44.659019Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:44.659038Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:44.659049Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:44.659058Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:44.659125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:44.659131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:44.659133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:44.659135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:44.659214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:44.659221Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:44.659233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:44.659247Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:44.659266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:44.659293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602537354861910:2438], now have 1 active actors on pipe
2025-10-10T14:38:44.659304Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602536572622584:9027]
2025-10-10T14:38:44.659310Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602536572622584:9027]
2025-10-10T14:38:44.659312Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602536572622584:9027]
2025-10-10T14:38:44.659326Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:44.659344Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:44.659345Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:44.659351Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:44.659361Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:44.659354Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:44.659368Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:44.659345Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2762
2025-10-10T14:38:44.659400Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602536572622584:9027]
2025-10-10T14:38:44.659406Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:44.659422Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:44.659755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602537354861978:7754] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:44.659772Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602537354861978:7754] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:44.659776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602537354861978:7754] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:44.659785Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2763 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:44.659998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602537354862013:7754], now have 1 active actors on pipe
2025-10-10T14:38:44.660051Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2762
2025-10-10T14:38:44.660122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:44.660130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:44.660159Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c54b089b-808c061e-8bd99247-47ba1e1f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:44.660168Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:44.660186Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:44.660193Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:44.660207Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:44.660220Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:44.660234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:44.660390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:44.660404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:44.660430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:44.660527Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2763 partition: 0 MaxSeqNo: 40 sessionId: src_id|c54b089b-808c061e-8bd99247-47ba1e1f_0
2025-10-10T14:38:44.660936Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d550c00-e6711e6-6afb9e89-f2ba9c39_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|c54b089b-808c061e-8bd99247-47ba1e1f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:44.663736Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c54b089b-808c061e-8bd99247-47ba1e1f_0] Write session: try to update token
2025-10-10T14:38:44.663758Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c54b089b-808c061e-8bd99247-47ba1e1f_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:44.679309Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2763 sessionId: src_id|c54b089b-808c061e-8bd99247-47ba1e1f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:44.680724Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:44.680745Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:44.680748Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:44.680751Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:44.680761Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602536572622584:9027]
2025-10-10T14:38:44.680766Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602536572622584:9027]
2025-10-10T14:38:44.680771Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602536572622584:9027]
2025-10-10T14:38:44.680826Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:44.680833Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:44.680839Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:44.680839Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:44.680841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:44.680844Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:44.680991Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:44.682111Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:44.739287Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602537354862019:3900]
2025-10-10T14:38:44.739728Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 pipe creation result: OK TabletId: 72075186224037892 Generation: 2762, pipe: [1:7559602537354862019:3900]
2025-10-10T14:38:44.800180Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:44.800711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:44.800735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:44.800783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602537354862019:3900], now have 1 active actors on pipe
2025-10-10T14:38:44.801034Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:44.801054Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:44.801072Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:44.801081Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:44.801121Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 61 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602537354862019:3900]
2025-10-10T14:38:44.801155Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2763 reason: error at write: Disconnected sessionId: src_id|c54b089b-808c061e-8bd99247-47ba1e1f_0
2025-10-10T14:38:44.801526Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2763 sessionId: src_id|c54b089b-808c061e-8bd99247-47ba1e1f_0 is DEAD
2025-10-10T14:38:44.801573Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c54b089b-808c061e-8bd99247-47ba1e1f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:44.801584Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c54b089b-808c061e-8bd99247-47ba1e1f_0] Write session will restart in 0.007206s
2025-10-10T14:38:44.801611Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c54b089b-808c061e-8bd99247-47ba1e1f_0] Write session: Do CDS request
2025-10-10T14:38:44.801621Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c54b089b-808c061e-8bd99247-47ba1e1f_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:44.809953Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c54b089b-808c061e-8bd99247-47ba1e1f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:44.810711Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:44.810733Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2764
2025-10-10T14:38:44.810928Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2764 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:44.810968Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2764 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:44.810975Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2764 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:44.810979Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:44.811460Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2764 sessionId:  describe result for acl check
2025-10-10T14:38:44.811491Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:44.811494Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:44.811496Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:44.811503Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602537354862055:7741] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:44.812130Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602537354862055:7741] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:44.814644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602537354862055:7741] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:44.817873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:44.818062Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602537354862055:7741] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:44.818080Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602537354862055:7741] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:44.818085Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602537354862055:7741] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:44.818095Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2764 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:44.818493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:44.818783Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:44.818796Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:44.818811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:44.818889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:44.818937Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602536572622695:9024]
2025-10-10T14:38:44.819579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:44.821643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:44.821718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:44.822093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:44.822179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:44.822188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:44.822189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:44.822190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:44.822191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:44.822193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:44.822194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:44.822195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:44.822197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:44.822199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:44.822200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:44.822201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:44.822203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:44.822210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:44.822224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:44.822228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:44.822232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:44.822236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:44.822240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:44.822244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:44.822247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:44.822251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:44.822255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:44.822259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:44.822263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:44.822267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:44.822276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:44.822285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:44.822291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:44.822297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:44.822302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:44.822309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:44.822314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:44.822319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:44.822324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:44.822329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:44.822334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:44.822339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:44.822345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:44.822350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:44.822361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:44.822366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:44.822371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:44.822375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:44.822379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:44.822384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:44.822390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:44.822395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:44.822400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:44.822405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:44.822418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:44.822424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:44.822474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:44.825069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:44.825770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:44.825784Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:44.825787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:44.825794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:44.825801Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2763 [2:7559602536572622695:9024]
2025-10-10T14:38:44.825816Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:44.825841Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:44.825850Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:44.825854Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:44.825857Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:44.825875Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:44.825888Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:44.825901Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:44.825971Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:44.825978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:44.825981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:44.825984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:44.826059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:44.826067Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:44.826082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:44.826102Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:44.826120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:44.826144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602537354862022:2438], now have 1 active actors on pipe
2025-10-10T14:38:44.826154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602537354862121:7741], now have 1 active actors on pipe
2025-10-10T14:38:44.826162Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602536572622689:9024]
2025-10-10T14:38:44.826164Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602536572622689:9024]
2025-10-10T14:38:44.826167Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602536572622689:9024]
2025-10-10T14:38:44.826185Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:44.826207Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:44.826198Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2763
2025-10-10T14:38:44.826222Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2763
2025-10-10T14:38:44.826225Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:44.826226Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:44.826231Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:44.826232Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:44.826235Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:44.826264Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602536572622689:9024]
2025-10-10T14:38:44.826277Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:44.826291Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:44.826300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:44.826305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:44.826362Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1b3d0430-29d2993a-2f650ead-7d516d60_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:44.826375Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:44.826380Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:44.826383Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:44.826395Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:44.826406Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:44.826429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:44.826577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:44.826587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:44.826607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:44.826691Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2764 partition: 0 MaxSeqNo: 40 sessionId: src_id|1b3d0430-29d2993a-2f650ead-7d516d60_0
2025-10-10T14:38:44.827122Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c54b089b-808c061e-8bd99247-47ba1e1f_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|1b3d0430-29d2993a-2f650ead-7d516d60_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:44.829979Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1b3d0430-29d2993a-2f650ead-7d516d60_0] Write session: try to update token
2025-10-10T14:38:44.829998Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1b3d0430-29d2993a-2f650ead-7d516d60_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:44.845901Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2764 sessionId: src_id|1b3d0430-29d2993a-2f650ead-7d516d60_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:44.847036Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:44.847054Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:44.847059Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:44.847061Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:44.847073Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602536572622689:9024]
2025-10-10T14:38:44.847079Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602536572622689:9024]
2025-10-10T14:38:44.847083Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602536572622689:9024]
2025-10-10T14:38:44.847138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:44.847141Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:44.847149Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:44.847154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:44.847154Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:44.847157Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:44.847308Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:44.848921Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:44.901091Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602537354862136:3900]
2025-10-10T14:38:44.901450Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 pipe creation result: OK TabletId: 72075186224037892 Generation: 2763, pipe: [1:7559602537354862136:3900]
2025-10-10T14:38:44.963252Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:44.963863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:44.963876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:44.963925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602537354862136:3900], now have 1 active actors on pipe
2025-10-10T14:38:44.964148Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:44.964181Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 62 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602537354862136:3900]
2025-10-10T14:38:44.964233Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:38:44.964312Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2764 reason: status is not ok: tablet will be restarted right now sessionId: src_id|1b3d0430-29d2993a-2f650ead-7d516d60_0
2025-10-10T14:38:44.964519Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2764 sessionId: src_id|1b3d0430-29d2993a-2f650ead-7d516d60_0 is DEAD
2025-10-10T14:38:44.964525Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:44.964704Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b3d0430-29d2993a-2f650ead-7d516d60_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:38:44.964713Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b3d0430-29d2993a-2f650ead-7d516d60_0] Write session will restart in 0.006117s
2025-10-10T14:38:44.964738Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b3d0430-29d2993a-2f650ead-7d516d60_0] Write session: Do CDS request
2025-10-10T14:38:44.964744Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b3d0430-29d2993a-2f650ead-7d516d60_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:44.971862Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1b3d0430-29d2993a-2f650ead-7d516d60_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:44.971952Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:44.971971Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2765
2025-10-10T14:38:44.972112Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2765 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:44.972159Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2765 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:44.972169Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2765 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:44.972174Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:44.972594Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2765 sessionId:  describe result for acl check
2025-10-10T14:38:44.972628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:44.972635Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:44.972638Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:44.972644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602537354862170:7722] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:44.973224Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602537354862170:7722] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:44.976169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:44.975524Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602537354862170:7722] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:44.979567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:44.979816Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:44.979829Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:44.979842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:44.979919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:44.979962Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602536572622799:9022]
2025-10-10T14:38:44.980060Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602537354862170:7722] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:44.980076Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602537354862170:7722] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:44.980080Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602537354862170:7722] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:44.980089Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2765 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:44.980603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:44.980927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:44.980972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:44.981276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:44.981372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:44.981374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:44.981375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:44.981375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:44.981377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:44.981378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:44.981379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:44.981381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:44.981382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:44.981383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:44.981385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:44.981386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:44.981387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:44.981393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:44.981407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:44.981411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:44.981416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:44.981420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:44.981424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:44.981428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:44.981433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:44.981437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:44.981441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:44.981445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:44.981449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:44.981454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:44.981461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:44.981470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:44.981478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:44.981484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:44.981488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:44.981494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:44.981499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:44.981505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:44.981510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:44.981516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:44.981520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:44.981526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:44.981530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:44.981536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:44.981540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:44.981546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:44.981551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:44.981556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:44.981561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:44.981567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:44.981572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:44.981578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:44.981583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:44.981589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:44.981594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:44.981600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:44.981643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:44.984161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:44.984705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:44.984717Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:44.984720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:44.984723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:44.984730Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2764 [2:7559602536572622799:9022]
2025-10-10T14:38:44.984745Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:44.984764Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:44.984773Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:44.984788Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:44.984794Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:44.984811Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:44.984822Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:44.984830Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:44.984895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:44.984903Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:44.984905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:44.984907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:44.984978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:44.984985Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:44.984996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:44.985008Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:44.985029Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:44.985057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602537354862234:7722], now have 1 active actors on pipe
2025-10-10T14:38:44.985066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602537354862140:2438], now have 1 active actors on pipe
2025-10-10T14:38:44.985074Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602536572622793:9022]
2025-10-10T14:38:44.985080Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602536572622793:9022]
2025-10-10T14:38:44.985082Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602536572622793:9022]
2025-10-10T14:38:44.985096Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:44.985113Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:44.985118Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:44.985122Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:44.985125Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:44.985132Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:44.985137Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:44.985144Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2764
2025-10-10T14:38:44.985164Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602536572622793:9022]
2025-10-10T14:38:44.985172Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:44.985183Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:44.985188Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2764
2025-10-10T14:38:44.985202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:44.985209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:44.985241Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2b77f01d-dd9da236-13623b9e-595c2b5e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:44.985249Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:44.985253Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:44.985255Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:44.985267Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:44.985277Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:44.985295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:44.985451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:44.985459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:44.985473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:44.985547Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2765 partition: 0 MaxSeqNo: 40 sessionId: src_id|2b77f01d-dd9da236-13623b9e-595c2b5e_0
2025-10-10T14:38:44.985973Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b3d0430-29d2993a-2f650ead-7d516d60_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|2b77f01d-dd9da236-13623b9e-595c2b5e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:44.988869Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2b77f01d-dd9da236-13623b9e-595c2b5e_0] Write session: try to update token
2025-10-10T14:38:44.988888Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2b77f01d-dd9da236-13623b9e-595c2b5e_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:45.002277Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2765 sessionId: src_id|2b77f01d-dd9da236-13623b9e-595c2b5e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:45.004597Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:45.004614Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:45.004616Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:45.004618Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:45.004626Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602536572622793:9022]
2025-10-10T14:38:45.004629Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602536572622793:9022]
2025-10-10T14:38:45.004632Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602536572622793:9022]
2025-10-10T14:38:45.004679Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:45.004681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:45.004690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:45.004692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:45.004693Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:45.004698Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:45.004835Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:45.005131Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:45.064400Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602541649829542:3900]
2025-10-10T14:38:45.064692Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 pipe creation result: OK TabletId: 72075186224037892 Generation: 2764, pipe: [1:7559602541649829542:3900]
2025-10-10T14:38:45.120213Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:45.120630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:45.120647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:45.120696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602541649829542:3900], now have 1 active actors on pipe
2025-10-10T14:38:45.120919Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:45.120942Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:45.120948Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 63 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602541649829542:3900]
2025-10-10T14:38:45.120970Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:45.120972Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:45.121038Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2765 reason: error at write: Disconnected sessionId: src_id|2b77f01d-dd9da236-13623b9e-595c2b5e_0
2025-10-10T14:38:45.121243Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2765 sessionId: src_id|2b77f01d-dd9da236-13623b9e-595c2b5e_0 is DEAD
2025-10-10T14:38:45.121430Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b77f01d-dd9da236-13623b9e-595c2b5e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:45.121441Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b77f01d-dd9da236-13623b9e-595c2b5e_0] Write session will restart in 0.008351s
2025-10-10T14:38:45.121466Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b77f01d-dd9da236-13623b9e-595c2b5e_0] Write session: Do CDS request
2025-10-10T14:38:45.121475Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b77f01d-dd9da236-13623b9e-595c2b5e_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:45.131016Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2b77f01d-dd9da236-13623b9e-595c2b5e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:45.131131Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:45.131154Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2766
2025-10-10T14:38:45.131324Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2766 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:45.131373Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2766 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:45.131385Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2766 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:45.131389Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:45.131800Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2766 sessionId:  describe result for acl check
2025-10-10T14:38:45.131838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:45.131845Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:45.131846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:45.131852Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602541649829615:7703] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:45.132416Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602541649829615:7703] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:45.133346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:45.134912Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602541649829615:7703] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:45.136463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:45.136707Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:45.136718Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:45.136730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:45.136780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:45.136827Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602540867590201:9021]
2025-10-10T14:38:45.137461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:45.137709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602541649829615:7703] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:45.137738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602541649829615:7703] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:45.137742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602541649829615:7703] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:45.137752Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2766 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:45.137775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:45.137817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:45.138134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:45.138189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:45.138194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:45.138195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:45.138196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:45.138198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:45.138199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:45.138200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:45.138201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:45.138203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:45.138204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:45.138206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:45.138207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:45.138208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:45.138213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:45.138227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:45.138231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:45.138235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:45.138240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:45.138244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:45.138248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:45.138252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:45.138256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:45.138260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:45.138264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:45.138269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:45.138273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:45.138279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:45.138289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:45.138295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:45.138301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:45.138305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:45.138311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:45.138315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:45.138320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:45.138329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:45.138335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:45.138339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:45.138344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:45.138349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:45.138354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:45.138358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:45.138363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:45.138368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:45.138373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:45.138377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:45.138383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:45.138392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:45.138397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:45.138401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:45.138406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:45.138409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:45.138414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:45.138455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:45.140784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:45.141248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:45.141260Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:45.141262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:45.141267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:45.141273Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2765 [2:7559602540867590201:9021]
2025-10-10T14:38:45.141285Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:45.141304Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:45.141312Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:45.141315Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:45.141318Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:45.141357Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:45.141371Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:45.141379Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:45.141433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:45.141439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:45.141441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:45.141444Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:45.141508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:45.141516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:45.141528Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:45.141540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:45.141557Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:45.141583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602541649829667:7703], now have 1 active actors on pipe
2025-10-10T14:38:45.141591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602541649829544:2438], now have 1 active actors on pipe
2025-10-10T14:38:45.141598Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602540867590196:9021]
2025-10-10T14:38:45.141605Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602540867590196:9021]
2025-10-10T14:38:45.141607Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602540867590196:9021]
2025-10-10T14:38:45.141621Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:45.141641Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:45.141651Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:45.141655Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:45.141656Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:45.141657Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:45.141659Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:45.141661Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2765
2025-10-10T14:38:45.141693Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602540867590196:9021]
2025-10-10T14:38:45.141700Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:45.141673Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2765
2025-10-10T14:38:45.141703Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:45.141740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:45.141751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:45.141791Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|62898093-1292a216-4765fae2-b65cc7e1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:45.141804Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:45.141812Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:45.141816Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:45.141827Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:45.141842Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:45.141868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:45.142004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:45.142015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:45.142038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:45.142131Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2766 partition: 0 MaxSeqNo: 40 sessionId: src_id|62898093-1292a216-4765fae2-b65cc7e1_0
2025-10-10T14:38:45.142535Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b77f01d-dd9da236-13623b9e-595c2b5e_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|62898093-1292a216-4765fae2-b65cc7e1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:45.145267Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|62898093-1292a216-4765fae2-b65cc7e1_0] Write session: try to update token
2025-10-10T14:38:45.145284Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|62898093-1292a216-4765fae2-b65cc7e1_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:45.161026Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:45.161048Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:45.161052Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:45.161054Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:45.161065Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602540867590196:9021]
2025-10-10T14:38:45.161070Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602540867590196:9021]
2025-10-10T14:38:45.161078Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602540867590196:9021]
2025-10-10T14:38:45.161130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:45.161143Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:45.161143Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:45.161146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:45.161151Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:45.161155Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:45.161283Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:45.161582Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2766 sessionId: src_id|62898093-1292a216-4765fae2-b65cc7e1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:45.164297Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:45.221086Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602541649829684:3900]
2025-10-10T14:38:45.221462Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 pipe creation result: OK TabletId: 72075186224037892 Generation: 2765, pipe: [1:7559602541649829684:3900]
2025-10-10T14:38:45.281119Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:45.281460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:45.281482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:45.281529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602541649829684:3900], now have 1 active actors on pipe
2025-10-10T14:38:45.281733Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:45.281830Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 64 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602541649829684:3900]
2025-10-10T14:38:45.281832Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:45.281840Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:45.281873Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:45.281919Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2766 reason: error at write: Disconnected sessionId: src_id|62898093-1292a216-4765fae2-b65cc7e1_0
2025-10-10T14:38:45.282151Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2766 sessionId: src_id|62898093-1292a216-4765fae2-b65cc7e1_0 is DEAD
2025-10-10T14:38:45.282408Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|62898093-1292a216-4765fae2-b65cc7e1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:45.282419Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|62898093-1292a216-4765fae2-b65cc7e1_0] Write session will restart in 0.005305s
2025-10-10T14:38:45.282445Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|62898093-1292a216-4765fae2-b65cc7e1_0] Write session: Do CDS request
2025-10-10T14:38:45.282454Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|62898093-1292a216-4765fae2-b65cc7e1_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:45.288899Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|62898093-1292a216-4765fae2-b65cc7e1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:45.288985Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:45.289003Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2767
2025-10-10T14:38:45.289193Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2767 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:45.289257Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2767 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:45.289264Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2767 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:45.289268Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:45.289749Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2767 sessionId:  describe result for acl check
2025-10-10T14:38:45.289791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:45.289798Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:45.289800Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:45.289807Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602541649829700:7699] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:45.290413Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602541649829700:7699] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:45.292992Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602541649829700:7699] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:45.294138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:45.297367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:45.297762Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:45.297776Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:45.297776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602541649829700:7699] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:45.297801Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602541649829700:7699] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:45.297805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602541649829700:7699] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:45.297792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:45.297815Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2767 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:45.297864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:45.297915Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602540867590310:9011]
2025-10-10T14:38:45.298503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:45.298847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:45.298895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:45.299235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:45.299304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:45.299311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:45.299312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:45.299314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:45.299315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:45.299316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:45.299317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:45.299319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:45.299320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:45.299321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:45.299322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:45.299323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:45.299327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:45.299333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:45.299346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:45.299349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:45.299353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:45.299357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:45.299361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:45.299365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:45.299369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:45.299373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:45.299377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:45.299381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:45.299385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:45.299389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:45.299397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:45.299405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:45.299412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:45.299418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:45.299422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:45.299428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:45.299432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:45.299437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:45.299442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:45.299447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:45.299451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:45.299456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:45.299461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:45.299466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:45.299470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:45.299475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:45.299482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:45.299487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:45.299491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:45.299496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:45.299500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:45.299505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:45.299509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:45.299514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:45.299518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:45.299523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:45.299564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:45.302127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:45.302962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:45.302976Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:45.302979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:45.302983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:45.302990Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2766 [2:7559602540867590310:9011]
2025-10-10T14:38:45.303004Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:45.303024Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:45.303033Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:45.303037Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:45.303040Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:45.303061Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:45.303073Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:45.303082Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:45.303150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:45.303157Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:45.303159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:45.303162Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:45.303243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:45.303251Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:45.303264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:45.303280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:45.303302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:45.303331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602541649829784:7699], now have 1 active actors on pipe
2025-10-10T14:38:45.303341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602541649829685:2438], now have 1 active actors on pipe
2025-10-10T14:38:45.303350Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602540867590305:9011]
2025-10-10T14:38:45.303356Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602540867590305:9011]
2025-10-10T14:38:45.303359Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602540867590305:9011]
2025-10-10T14:38:45.303376Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:45.303398Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:45.303397Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:45.303402Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:45.303404Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:45.303416Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:45.303420Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:45.303416Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2766
2025-10-10T14:38:45.303450Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602540867590305:9011]
2025-10-10T14:38:45.303459Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:45.303460Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2766
2025-10-10T14:38:45.303470Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:45.303487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:45.303493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:45.303533Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dd6f601f-bbb818df-5e14485e-75736c20_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:45.303548Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:45.303552Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:45.303554Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:45.303565Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:45.303578Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:45.303604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:45.303743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:45.303754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:45.303769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:45.303902Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2767 partition: 0 MaxSeqNo: 40 sessionId: src_id|dd6f601f-bbb818df-5e14485e-75736c20_0
2025-10-10T14:38:45.304316Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|62898093-1292a216-4765fae2-b65cc7e1_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|dd6f601f-bbb818df-5e14485e-75736c20_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:45.307081Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dd6f601f-bbb818df-5e14485e-75736c20_0] Write session: try to update token
2025-10-10T14:38:45.307100Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dd6f601f-bbb818df-5e14485e-75736c20_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:45.323662Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:45.323679Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:45.323682Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:45.323684Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:45.323693Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602540867590305:9011]
2025-10-10T14:38:45.323698Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602540867590305:9011]
2025-10-10T14:38:45.323702Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602540867590305:9011]
2025-10-10T14:38:45.323753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:45.323754Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:45.323762Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:45.323762Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:45.323764Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:45.323767Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:45.323935Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:45.324032Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2767 sessionId: src_id|dd6f601f-bbb818df-5e14485e-75736c20_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:45.326832Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:45.381853Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602541649829820:3900]
2025-10-10T14:38:45.382166Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 pipe creation result: OK TabletId: 72075186224037892 Generation: 2766, pipe: [1:7559602541649829820:3900]
2025-10-10T14:38:45.442339Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:45.442782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:45.442798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:45.442847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602541649829820:3900], now have 1 active actors on pipe
2025-10-10T14:38:45.443146Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:45.443155Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 65 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602541649829820:3900]
2025-10-10T14:38:45.443165Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:45.443186Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:45.443239Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2767 reason: error at write: Disconnected sessionId: src_id|dd6f601f-bbb818df-5e14485e-75736c20_0
2025-10-10T14:38:45.443462Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2767 sessionId: src_id|dd6f601f-bbb818df-5e14485e-75736c20_0 is DEAD
2025-10-10T14:38:45.443637Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd6f601f-bbb818df-5e14485e-75736c20_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:45.443649Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd6f601f-bbb818df-5e14485e-75736c20_0] Write session will restart in 0.006225s
2025-10-10T14:38:45.443675Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd6f601f-bbb818df-5e14485e-75736c20_0] Write session: Do CDS request
2025-10-10T14:38:45.443682Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd6f601f-bbb818df-5e14485e-75736c20_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:45.444194Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:45.450921Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dd6f601f-bbb818df-5e14485e-75736c20_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:45.451027Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:45.451046Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2768
2025-10-10T14:38:45.451184Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2768 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:45.451221Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2768 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:45.451232Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2768 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:45.451237Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:45.451763Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2768 sessionId:  describe result for acl check
2025-10-10T14:38:45.451798Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:45.451805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:45.451807Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:45.451813Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602541649829866:7642] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:45.452390Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602541649829866:7642] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:45.454719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:45.455089Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602541649829866:7642] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:45.458642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602541649829866:7642] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:45.458658Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602541649829866:7642] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:45.458662Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602541649829866:7642] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:45.458671Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2768 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:45.459316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:45.459655Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:45.459671Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:45.459684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:45.459743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:45.459787Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602540867590470:8977]
2025-10-10T14:38:45.460365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:45.460652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:45.460693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:45.461006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:45.461064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:45.461069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:45.461071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:45.461072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:45.461073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:45.461074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:45.461075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:45.461076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:45.461078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:45.461079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:45.461081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:45.461082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:45.461083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:45.461089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:45.461104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:45.461108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:45.461113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:45.461116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:45.461121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:45.461124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:45.461130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:45.461135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:45.461139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:45.461143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:45.461148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:45.461153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:45.461160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:45.461169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:45.461180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:45.461191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:45.461195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:45.461205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:45.461210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:45.461219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:45.461224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:45.461232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:45.461238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:45.461244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:45.461253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:45.461258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:45.461266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:45.461272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:45.461280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:45.461289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:45.461293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:45.461302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:45.461307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:45.461312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:45.461320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:45.461326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:45.461347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:45.461353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:45.461397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:45.463953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:45.464510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:45.464521Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:45.464523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:45.464526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:45.464533Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2767 [2:7559602540867590470:8977]
2025-10-10T14:38:45.464547Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:45.464566Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:45.464574Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:45.464578Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:45.464580Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:45.464598Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:45.464610Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:45.464617Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:45.464677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:45.464685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:45.464687Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:45.464689Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:45.464768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:45.464777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:45.464788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:45.464801Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:45.464819Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:45.464842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602541649829920:7642], now have 1 active actors on pipe
2025-10-10T14:38:45.464851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602541649829821:2438], now have 1 active actors on pipe
2025-10-10T14:38:45.464858Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602540867590464:8977]
2025-10-10T14:38:45.464860Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602540867590464:8977]
2025-10-10T14:38:45.464862Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602540867590464:8977]
2025-10-10T14:38:45.464879Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:45.464897Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:45.464899Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:45.464905Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:45.464907Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:45.464916Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:45.464920Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:45.464930Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2767
2025-10-10T14:38:45.464935Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2767
2025-10-10T14:38:45.464947Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602540867590464:8977]
2025-10-10T14:38:45.464966Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:45.464998Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:45.465070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:45.465082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:45.465116Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|eafb0241-25ee1bd0-edd64c98-b09344fe_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:45.465145Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:45.465149Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:45.465152Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:45.465165Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:45.465178Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:45.465199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:45.465438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:45.465450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:45.465473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:45.465592Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2768 partition: 0 MaxSeqNo: 40 sessionId: src_id|eafb0241-25ee1bd0-edd64c98-b09344fe_0
2025-10-10T14:38:45.466004Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd6f601f-bbb818df-5e14485e-75736c20_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|eafb0241-25ee1bd0-edd64c98-b09344fe_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:45.468771Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eafb0241-25ee1bd0-edd64c98-b09344fe_0] Write session: try to update token
2025-10-10T14:38:45.468792Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eafb0241-25ee1bd0-edd64c98-b09344fe_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:45.477130Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:38:45.477150Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:45.477163Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602540867590464:8977]
2025-10-10T14:38:45.477207Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:38:45.477213Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:38:45.477405Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:38:45.477551Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:45.477707Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:45.477865Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:45.478065Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:38:45.478104Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:38:45.486368Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2768 sessionId: src_id|eafb0241-25ee1bd0-edd64c98-b09344fe_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:45.489023Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:45.489464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:45.489485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:45.489529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:38:45.489609Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:38:45.496322Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:45.496338Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:45.496341Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:45.496343Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:45.496355Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602540867590464:8977]
2025-10-10T14:38:45.496360Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602540867590464:8977]
2025-10-10T14:38:45.496364Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602540867590464:8977]
2025-10-10T14:38:45.496416Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:45.496424Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:45.496432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:45.496459Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:45.496476Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:45.496481Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:45.496572Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:45.543135Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602541649829933:3900]
2025-10-10T14:38:45.545860Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 pipe creation result: OK TabletId: 72075186224037892 Generation: 2767, pipe: [1:7559602541649829933:3900]
2025-10-10T14:38:45.611243Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:45.620101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:45.620133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:45.620324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:45.620385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:45.620455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:45.620528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:45.620797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:45.620802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:45.620883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:45.620942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:45.621001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:45.621067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:45.621109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:45.621112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:45.621181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:45.621242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:45.621303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:45.621532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:45.621581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:45.621585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:45.621656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:45.621735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:45.621803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:45.621870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:45.621912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:45.621915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:45.621988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:45.622047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:45.622111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:45.624246Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:45.624310Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:45.624312Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:45.624345Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2768 reason: error at write: Disconnected sessionId: src_id|eafb0241-25ee1bd0-edd64c98-b09344fe_0
2025-10-10T14:38:45.624558Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2768 sessionId: src_id|eafb0241-25ee1bd0-edd64c98-b09344fe_0 is DEAD
2025-10-10T14:38:45.624633Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 66 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602541649829933:3900]
2025-10-10T14:38:45.624737Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eafb0241-25ee1bd0-edd64c98-b09344fe_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:45.624750Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eafb0241-25ee1bd0-edd64c98-b09344fe_0] Write session will restart in 0.005750s
2025-10-10T14:38:45.624783Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eafb0241-25ee1bd0-edd64c98-b09344fe_0] Write session: Do CDS request
2025-10-10T14:38:45.624789Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eafb0241-25ee1bd0-edd64c98-b09344fe_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:45.622172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:45.622232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:45.622235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:45.622306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:45.622368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:45.622429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:45.622490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:45.622535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:45.622541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:45.622618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:45.622682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:45.622748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:45.622818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:45.622860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:45.622863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:45.622938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:45.622997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:45.623058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:45.623122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:45.623165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:45.623168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:45.623240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:45.623303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:45.623367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:45.623426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:45.623470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:45.623472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:45.623552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:45.623615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:45.623678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:45.623745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:45.623789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:45.623792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:45.623865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602541649829933:3900], now have 1 active actors on pipe
2025-10-10T14:38:45.624637Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:45.631850Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eafb0241-25ee1bd0-edd64c98-b09344fe_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:45.632622Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:45.632642Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2769
2025-10-10T14:38:45.633148Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2769 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:45.633181Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2769 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:45.633188Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2769 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:45.633192Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:45.634171Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2769 sessionId:  describe result for acl check
2025-10-10T14:38:45.634212Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:45.634216Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:45.634218Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:45.634224Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602541649829960:7624] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:45.634843Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602541649829960:7624] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:45.639520Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602541649829960:7624] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:45.645986Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602541649829960:7624] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:45.646007Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602541649829960:7624] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:45.646011Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602541649829960:7624] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:45.646021Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2769 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:45.645962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:45.650041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:45.650323Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:45.650338Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:45.650353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:45.650447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:45.650502Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602540867590579:8964]
2025-10-10T14:38:45.651211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:45.652876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:45.652944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:45.653368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:45.653447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:45.653449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:45.653451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:45.653453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:45.653454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:45.653456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:45.653457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:45.653459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:45.653461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:45.653462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:45.653464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:45.653465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:45.653467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:45.653474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:45.653490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:45.653495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:45.653499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:45.653504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:45.653509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:45.653514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:45.653519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:45.653523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:45.653528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:45.653532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:45.653537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:45.653541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:45.653551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:45.653560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:45.653568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:45.653575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:45.653582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:45.653589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:45.653594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:45.653601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:45.653607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:45.653613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:45.653619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:45.653625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:45.653631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:45.653639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:45.653650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:45.653657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:45.653663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:45.653670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:45.653676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:45.653682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:45.653690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:45.653696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:45.653701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:45.653707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:45.653728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:45.653734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:45.653781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:45.658112Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2768
2025-10-10T14:38:45.658170Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2768
2025-10-10T14:38:45.656745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:45.657595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:45.657602Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:45.657605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:45.657609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:45.657617Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2768 [2:7559602540867590579:8964]
2025-10-10T14:38:45.657632Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:45.657657Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:45.657662Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:45.657666Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:45.657669Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:45.657689Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:45.657697Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:45.657707Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:45.657797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:45.657800Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:45.657801Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:45.657805Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:45.657891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:45.657894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:45.657908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:45.657919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:45.657935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:45.657959Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602540867590573:8964]
2025-10-10T14:38:45.657962Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602540867590573:8964]
2025-10-10T14:38:45.657965Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602540867590573:8964]
2025-10-10T14:38:45.657979Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:45.657996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602541649829947:2438], now have 1 active actors on pipe
2025-10-10T14:38:45.658003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602541649830048:7624], now have 1 active actors on pipe
2025-10-10T14:38:45.658002Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:45.658006Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:45.658008Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:45.658009Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:45.658027Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:45.658030Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:45.658077Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602540867590573:8964]
2025-10-10T14:38:45.658085Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:45.658094Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:45.658204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:45.658214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:45.658255Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|55e077ea-1123db95-4ba17e5c-e89caea6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:45.658266Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:45.658283Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:45.658286Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:45.658300Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:45.658314Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:45.658334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:45.658621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:45.658632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:45.658651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:45.658740Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2769 partition: 0 MaxSeqNo: 40 sessionId: src_id|55e077ea-1123db95-4ba17e5c-e89caea6_0
2025-10-10T14:38:45.661657Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eafb0241-25ee1bd0-edd64c98-b09344fe_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|55e077ea-1123db95-4ba17e5c-e89caea6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:45.664655Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|55e077ea-1123db95-4ba17e5c-e89caea6_0] Write session: try to update token
2025-10-10T14:38:45.664686Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|55e077ea-1123db95-4ba17e5c-e89caea6_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:45.670849Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:38:45.670868Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:45.670882Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602540867590573:8964]
2025-10-10T14:38:45.670933Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:38:45.670942Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:38:45.671135Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:38:45.671295Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:45.671446Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:45.671594Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:45.671797Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:38:45.671838Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:38:45.681315Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2769 sessionId: src_id|55e077ea-1123db95-4ba17e5c-e89caea6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:45.684228Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:45.684474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:45.684495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:45.684539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:38:45.684909Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:38:45.690283Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:45.690310Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:45.690313Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:45.690318Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:45.690327Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602540867590573:8964]
2025-10-10T14:38:45.690331Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602540867590573:8964]
2025-10-10T14:38:45.690333Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602540867590573:8964]
2025-10-10T14:38:45.690388Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:45.690395Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:45.690396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:45.690399Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:45.690400Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:45.690404Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:45.690547Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:45.724879Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602541649830060:3900]
2025-10-10T14:38:45.725226Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 pipe creation result: OK TabletId: 72075186224037892 Generation: 2768, pipe: [1:7559602541649830060:3900]
2025-10-10T14:38:45.807704Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:45.819213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:45.819244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:45.819435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:45.819512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:45.819571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:45.819638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:45.820157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:45.820166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:45.820236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:45.820293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:45.820357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:45.820421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:45.820462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:45.820465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:45.820538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:45.820595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:45.820657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:45.820720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:45.820761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:45.820764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:45.820836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:45.820899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:45.820963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:45.821023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:45.821063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:45.821067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:45.821133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:45.821197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:45.821254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:45.821314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:45.821934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:45.821944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:45.822022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:45.822082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:45.822158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:45.822217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:45.822259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:45.822273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:45.822342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:45.822398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:45.822461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:45.822524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:45.822564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:45.822567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:45.822635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:45.822692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:45.822749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:45.822807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:45.822848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:45.822851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:45.822918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:45.822975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:45.823035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:45.823097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:45.823138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:45.823141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:45.823206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:45.823259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:45.823318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:45.823379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:45.823419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:45.823422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:45.823496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602541649830060:3900], now have 1 active actors on pipe
2025-10-10T14:38:45.824500Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:45.824577Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:45.824580Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:45.824614Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2769 reason: error at write: Disconnected sessionId: src_id|55e077ea-1123db95-4ba17e5c-e89caea6_0
2025-10-10T14:38:45.824815Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2769 sessionId: src_id|55e077ea-1123db95-4ba17e5c-e89caea6_0 is DEAD
2025-10-10T14:38:45.824861Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 67 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602541649830060:3900]
2025-10-10T14:38:45.824968Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55e077ea-1123db95-4ba17e5c-e89caea6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:45.824979Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55e077ea-1123db95-4ba17e5c-e89caea6_0] Write session will restart in 0.005615s
2025-10-10T14:38:45.825005Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55e077ea-1123db95-4ba17e5c-e89caea6_0] Write session: Do CDS request
2025-10-10T14:38:45.825012Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55e077ea-1123db95-4ba17e5c-e89caea6_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:45.824992Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:45.833941Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|55e077ea-1123db95-4ba17e5c-e89caea6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:45.834059Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:45.834091Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2770
2025-10-10T14:38:45.837616Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2770 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:45.837694Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2770 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:45.837721Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2770 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:45.837731Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:45.838309Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2770 sessionId:  describe result for acl check
2025-10-10T14:38:45.838347Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:45.838357Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:45.838359Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:45.838367Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602541649830140:7613] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:45.838964Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602541649830140:7613] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:45.839783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:45.842303Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602541649830140:7613] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:45.843806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:45.844077Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:45.844089Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:45.844102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:45.844173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:45.844217Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602540867590688:8972]
2025-10-10T14:38:45.844859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:45.845197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:45.845245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:45.845465Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602541649830140:7613] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:45.845482Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602541649830140:7613] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:45.845487Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602541649830140:7613] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:45.845496Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2770 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:45.845597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:45.845660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:45.845667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:45.845669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:45.845670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:45.845671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:45.845672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:45.845674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:45.845675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:45.845676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:45.845677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:45.845679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:45.845680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:45.845681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:45.845687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:45.845700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:45.845704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:45.845720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:45.845724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:45.845728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:45.845731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:45.845735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:45.845739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:45.845743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:45.845747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:45.845751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:45.845755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:45.845763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:45.845772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:45.845778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:45.845784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:45.845788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:45.845794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:45.845798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:45.845803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:45.845808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:45.845813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:45.845817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:45.845822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:45.845828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:45.845833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:45.845837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:45.845842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:45.845849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:45.845854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:45.845859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:45.845864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:45.845868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:45.845873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:45.845877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:45.845883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:45.845888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:45.845893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:45.845930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:45.848539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:45.849220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:45.849233Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:45.849235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:45.849239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:45.849246Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2769 [2:7559602540867590688:8972]
2025-10-10T14:38:45.849260Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:45.849277Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:45.849280Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:45.849287Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:45.849289Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:45.849325Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:45.849350Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:45.849366Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:45.849427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:45.849436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:45.849439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:45.849442Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:45.849513Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:45.849520Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:45.849531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:45.849545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:45.849565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:45.849599Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602540867590683:8972]
2025-10-10T14:38:45.849605Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602540867590683:8972]
2025-10-10T14:38:45.849607Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602540867590683:8972]
2025-10-10T14:38:45.849623Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:45.849642Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:45.849656Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:45.849665Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:45.849680Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:45.849686Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:45.849691Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:45.849692Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602540867590683:8972]
2025-10-10T14:38:45.849695Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:45.849700Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:45.849944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602541649830174:7613], now have 1 active actors on pipe
2025-10-10T14:38:45.849953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602541649830070:2438], now have 1 active actors on pipe
2025-10-10T14:38:45.850305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:45.850313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:45.850348Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|856792af-6cf1c5c2-e2635122-53297985_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:45.850356Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:45.850360Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:45.850363Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:45.850374Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:45.850386Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:45.850402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:45.850665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:45.850677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:45.850713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:45.851273Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55e077ea-1123db95-4ba17e5c-e89caea6_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|856792af-6cf1c5c2-e2635122-53297985_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:45.850119Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2769
2025-10-10T14:38:45.850126Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2769
2025-10-10T14:38:45.850819Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2770 partition: 0 MaxSeqNo: 40 sessionId: src_id|856792af-6cf1c5c2-e2635122-53297985_0
2025-10-10T14:38:45.854066Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|856792af-6cf1c5c2-e2635122-53297985_0] Write session: try to update token
2025-10-10T14:38:45.854088Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|856792af-6cf1c5c2-e2635122-53297985_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:45.870678Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:45.870697Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:45.870701Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:45.870703Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:45.870715Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602540867590683:8972]
2025-10-10T14:38:45.870721Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602540867590683:8972]
2025-10-10T14:38:45.870726Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602540867590683:8972]
2025-10-10T14:38:45.870778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:45.870787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:45.870791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:45.870790Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:45.870798Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:45.870802Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:45.871302Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:45.876169Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2770 sessionId: src_id|856792af-6cf1c5c2-e2635122-53297985_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:45.878800Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:45.924569Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602541649830186:3900]
2025-10-10T14:38:45.924848Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 pipe creation result: OK TabletId: 72075186224037892 Generation: 2769, pipe: [1:7559602541649830186:3900]
2025-10-10T14:38:45.993295Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:45.993769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:45.993788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:45.993839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602541649830186:3900], now have 1 active actors on pipe
2025-10-10T14:38:45.994098Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:45.994572Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|856792af-6cf1c5c2-e2635122-53297985_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:45.994584Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|856792af-6cf1c5c2-e2635122-53297985_0] Write session will restart in 0.008164s
2025-10-10T14:38:45.994610Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|856792af-6cf1c5c2-e2635122-53297985_0] Write session: Do CDS request
2025-10-10T14:38:45.994616Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|856792af-6cf1c5c2-e2635122-53297985_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:45.994100Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:45.994118Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:45.994152Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 68 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602541649830186:3900]
2025-10-10T14:38:45.994168Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:45.994197Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2770 reason: error at write: Disconnected sessionId: src_id|856792af-6cf1c5c2-e2635122-53297985_0
2025-10-10T14:38:45.994412Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2770 sessionId: src_id|856792af-6cf1c5c2-e2635122-53297985_0 is DEAD
2025-10-10T14:38:46.003944Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|856792af-6cf1c5c2-e2635122-53297985_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:46.004025Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:46.004045Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2771
2025-10-10T14:38:46.004198Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2771 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:46.004234Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2771 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:46.004243Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2771 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:46.004247Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:46.004775Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2771 sessionId:  describe result for acl check
2025-10-10T14:38:46.004815Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:46.004821Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:46.004823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:46.004830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602545944797556:7585] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:46.004944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:46.005497Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602545944797556:7585] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:46.008334Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602545944797556:7585] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:46.008676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:46.008953Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:46.008973Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:46.008990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:46.009058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:46.009107Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602545162558095:8971]
2025-10-10T14:38:46.009786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:46.010092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:46.010136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:46.010485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:46.010549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:46.010556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:46.010557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:46.010559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:46.010560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:46.010561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:46.010563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:46.010564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:46.010565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:46.010567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:46.010568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:46.010570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:46.010571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:46.010577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:46.010590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:46.010595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:46.010598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:46.010602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:46.010605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:46.010609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:46.010613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:46.010617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:46.010622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:46.010626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:46.010630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:46.010634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:46.010642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:46.010650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:46.010657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:46.010663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:46.010669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:46.010681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:46.010686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:46.010692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:46.010698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:46.010704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:46.010708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:46.010713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:46.010717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:46.010721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:46.010725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:46.010730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:46.010733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:46.010738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:46.010744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:46.010753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:46.010758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:46.010774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:46.010784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:46.010788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:46.010794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:46.010799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:46.010843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:46.011336Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602545944797556:7585] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:46.011353Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602545944797556:7585] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:46.011357Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602545944797556:7585] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:46.011366Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2771 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:46.013680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:46.014387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:46.014400Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:46.014403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:46.014407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:46.014416Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2770 [2:7559602545162558095:8971]
2025-10-10T14:38:46.014430Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:46.014449Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:46.014453Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:46.014458Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:46.014460Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:46.014480Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:46.014488Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:46.014496Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:46.014560Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:46.014569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:46.014571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:46.014574Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:46.014646Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:46.014655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:46.014669Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:46.014684Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:46.014709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:46.014736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602545944797592:7585], now have 1 active actors on pipe
2025-10-10T14:38:46.014744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602541649830188:2438], now have 1 active actors on pipe
2025-10-10T14:38:46.014752Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602545162558089:8971]
2025-10-10T14:38:46.014757Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602545162558089:8971]
2025-10-10T14:38:46.014759Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602545162558089:8971]
2025-10-10T14:38:46.014776Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:46.014790Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:46.014794Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:46.014799Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:46.014801Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:46.014812Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:46.014816Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:46.014796Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2770
2025-10-10T14:38:46.014808Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2770
2025-10-10T14:38:46.014850Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602545162558089:8971]
2025-10-10T14:38:46.014862Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:46.014867Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:46.014880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:46.014891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:46.014945Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d1f9fabb-5f4e7ca7-3be3f4d0-73a66d25_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:46.014958Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:46.014962Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:46.014964Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:46.014975Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:46.014990Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:46.015014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:46.015187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:46.015198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:46.015213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:46.015344Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2771 partition: 0 MaxSeqNo: 40 sessionId: src_id|d1f9fabb-5f4e7ca7-3be3f4d0-73a66d25_0
2025-10-10T14:38:46.015746Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|856792af-6cf1c5c2-e2635122-53297985_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|d1f9fabb-5f4e7ca7-3be3f4d0-73a66d25_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:46.018595Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d1f9fabb-5f4e7ca7-3be3f4d0-73a66d25_0] Write session: try to update token
2025-10-10T14:38:46.018621Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d1f9fabb-5f4e7ca7-3be3f4d0-73a66d25_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:46.035638Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:46.035656Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:46.035661Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:46.035663Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:46.035675Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602545162558089:8971]
2025-10-10T14:38:46.035681Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602545162558089:8971]
2025-10-10T14:38:46.035686Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602545162558089:8971]
2025-10-10T14:38:46.035745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:46.035744Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:46.035751Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:46.035754Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:46.035758Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:46.035758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:46.035923Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:46.042467Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2771 sessionId: src_id|d1f9fabb-5f4e7ca7-3be3f4d0-73a66d25_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:46.047413Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:46.094038Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602545944797599:3900]
2025-10-10T14:38:46.094475Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 pipe creation result: OK TabletId: 72075186224037892 Generation: 2770, pipe: [1:7559602545944797599:3900]
2025-10-10T14:38:46.158870Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:46.159507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:46.159528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:46.159554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602545944797599:3900], now have 1 active actors on pipe
2025-10-10T14:38:46.159888Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 69 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602545944797599:3900]
2025-10-10T14:38:46.159937Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:46.159939Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:46.160022Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2771 reason: error at write: Disconnected sessionId: src_id|d1f9fabb-5f4e7ca7-3be3f4d0-73a66d25_0
2025-10-10T14:38:46.160268Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2771 sessionId: src_id|d1f9fabb-5f4e7ca7-3be3f4d0-73a66d25_0 is DEAD
2025-10-10T14:38:46.160536Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:46.159945Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:46.160610Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1f9fabb-5f4e7ca7-3be3f4d0-73a66d25_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:46.160621Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1f9fabb-5f4e7ca7-3be3f4d0-73a66d25_0] Write session will restart in 0.007668s
2025-10-10T14:38:46.160646Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1f9fabb-5f4e7ca7-3be3f4d0-73a66d25_0] Write session: Do CDS request
2025-10-10T14:38:46.160655Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1f9fabb-5f4e7ca7-3be3f4d0-73a66d25_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:46.169987Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d1f9fabb-5f4e7ca7-3be3f4d0-73a66d25_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:46.170436Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:46.170454Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2772
2025-10-10T14:38:46.171009Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2772 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:46.171061Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2772 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:46.171071Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2772 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:46.171075Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:46.171619Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2772 sessionId:  describe result for acl check
2025-10-10T14:38:46.171662Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:46.171664Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:46.171665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:46.171673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602545944797616:7584] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:46.172295Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602545944797616:7584] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:46.178671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602545944797616:7584] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:46.183536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602545944797616:7584] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:46.183556Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602545944797616:7584] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:46.183560Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602545944797616:7584] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:46.183569Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2772 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:46.185637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:46.189732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:46.189986Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:46.189996Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:46.190009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:46.190063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:46.190106Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602545162558210:8965]
2025-10-10T14:38:46.190770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:46.191182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:46.191250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:46.191630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:46.191700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:46.191706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:46.191708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:46.191709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:46.191710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:46.191711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:46.191713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:46.191714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:46.191716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:46.191717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:46.191718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:46.191719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:46.191720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:46.191728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:46.191743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:46.191747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:46.191751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:46.191756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:46.191760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:46.191764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:46.191768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:46.191773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:46.191777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:46.191781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:46.191785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:46.191789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:46.191800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:46.191810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:46.191816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:46.191822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:46.191827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:46.191833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:46.191838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:46.191843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:46.191848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:46.191853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:46.191858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:46.191863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:46.191868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:46.191873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:46.191877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:46.191883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:46.191888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:46.191893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:46.191898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:46.191903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:46.191907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:46.191917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:46.191928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:46.191933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:46.191938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:46.191943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:46.191994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:46.194611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:46.194969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:46.194983Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:46.194985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:46.194989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:46.194995Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2771 [2:7559602545162558210:8965]
2025-10-10T14:38:46.195009Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:46.195028Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:46.195037Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:46.195041Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:46.195043Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:46.195062Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:46.195075Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:46.195084Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:46.195149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:46.195157Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:46.195159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:46.195162Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:46.195232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:46.195240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:46.195253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:46.195265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:46.195285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:46.195322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602545944797701:7584], now have 1 active actors on pipe
2025-10-10T14:38:46.195332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602545944797601:2438], now have 1 active actors on pipe
2025-10-10T14:38:46.195340Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602545162558203:8965]
2025-10-10T14:38:46.195342Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602545162558203:8965]
2025-10-10T14:38:46.195345Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602545162558203:8965]
2025-10-10T14:38:46.195357Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:46.195371Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:46.195373Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:46.195377Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:46.195379Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:46.195389Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:46.195392Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:46.195420Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602545162558203:8965]
2025-10-10T14:38:46.195428Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:46.195395Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2771
2025-10-10T14:38:46.195442Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:46.195455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:46.195401Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2771
2025-10-10T14:38:46.195461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:46.195851Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|292b0947-1c446a40-b90f4210-c492bcca_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:46.195869Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:46.195873Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:46.195875Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:46.195886Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:46.195897Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:46.195924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:46.196095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:46.196102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:46.196118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:46.196214Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2772 partition: 0 MaxSeqNo: 40 sessionId: src_id|292b0947-1c446a40-b90f4210-c492bcca_0
2025-10-10T14:38:46.196658Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1f9fabb-5f4e7ca7-3be3f4d0-73a66d25_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|292b0947-1c446a40-b90f4210-c492bcca_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:46.199356Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|292b0947-1c446a40-b90f4210-c492bcca_0] Write session: try to update token
2025-10-10T14:38:46.199374Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|292b0947-1c446a40-b90f4210-c492bcca_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:46.216752Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:46.216774Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:46.216778Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:46.216780Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:46.216791Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602545162558203:8965]
2025-10-10T14:38:46.216796Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602545162558203:8965]
2025-10-10T14:38:46.216803Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602545162558203:8965]
2025-10-10T14:38:46.216865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:46.216866Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:46.216874Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:46.216874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:46.216876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:46.216878Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:46.217071Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:46.216667Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2772 sessionId: src_id|292b0947-1c446a40-b90f4210-c492bcca_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:46.219790Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:46.260431Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602545944797716:3900]
2025-10-10T14:38:46.263534Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 pipe creation result: OK TabletId: 72075186224037892 Generation: 2771, pipe: [1:7559602545944797716:3900]
2025-10-10T14:38:46.331361Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:46.331865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:46.331880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:46.331927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602545944797716:3900], now have 1 active actors on pipe
2025-10-10T14:38:46.332187Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:46.332176Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:46.332194Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:46.332218Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 70 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602545944797716:3900]
2025-10-10T14:38:46.332241Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:46.332262Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2772 reason: error at write: Disconnected sessionId: src_id|292b0947-1c446a40-b90f4210-c492bcca_0
2025-10-10T14:38:46.332484Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2772 sessionId: src_id|292b0947-1c446a40-b90f4210-c492bcca_0 is DEAD
2025-10-10T14:38:46.332829Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|292b0947-1c446a40-b90f4210-c492bcca_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:46.332853Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|292b0947-1c446a40-b90f4210-c492bcca_0] Write session will restart in 0.007078s
2025-10-10T14:38:46.332880Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|292b0947-1c446a40-b90f4210-c492bcca_0] Write session: Do CDS request
2025-10-10T14:38:46.332889Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|292b0947-1c446a40-b90f4210-c492bcca_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:46.340898Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|292b0947-1c446a40-b90f4210-c492bcca_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:46.340963Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:46.340982Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2773
2025-10-10T14:38:46.341127Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2773 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:46.341163Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2773 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:46.341169Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2773 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:46.341173Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:46.341688Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2773 sessionId:  describe result for acl check
2025-10-10T14:38:46.341732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:46.341734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:46.341736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:46.341742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602545944797757:7565] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:46.342336Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602545944797757:7565] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:46.344783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602545944797757:7565] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:46.346178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:46.349683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:46.349953Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:46.349966Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:46.349980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:46.350044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:46.350079Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602545162558322:8967]
2025-10-10T14:38:46.350558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:46.350967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:46.351034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:46.351396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:46.351259Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602545944797757:7565] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:46.351281Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602545944797757:7565] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:46.351285Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602545944797757:7565] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:46.351295Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2773 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:46.351459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:46.351465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:46.351467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:46.351468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:46.351470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:46.351471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:46.351473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:46.351474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:46.351476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:46.351477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:46.351478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:46.351479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:46.351480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:46.351487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:46.351501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:46.351505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:46.351510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:46.351514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:46.351518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:46.351522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:46.351527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:46.351531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:46.351535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:46.351539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:46.351543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:46.351546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:46.351554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:46.351564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:46.351571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:46.351577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:46.351582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:46.351587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:46.351592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:46.351598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:46.351602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:46.351607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:46.351612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:46.351617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:46.351623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:46.351629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:46.351633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:46.351639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:46.351644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:46.351650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:46.351659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:46.351664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:46.351674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:46.351679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:46.351688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:46.351694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:46.351714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:46.351719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:46.351763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:46.354529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:46.355261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:46.355272Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:46.355274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:46.355279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:46.355286Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2772 [2:7559602545162558322:8967]
2025-10-10T14:38:46.355300Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:46.355320Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:46.355333Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:46.355336Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:46.355341Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:46.355360Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:46.355368Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:46.355376Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:46.355445Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:46.355453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:46.355455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:46.355458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:46.355531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:46.355539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:46.355550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:46.355565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:46.355582Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:46.355609Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602545162558317:8967]
2025-10-10T14:38:46.355617Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602545162558317:8967]
2025-10-10T14:38:46.355619Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602545162558317:8967]
2025-10-10T14:38:46.355630Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:46.355645Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:46.355651Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:46.355655Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:46.355657Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:46.355666Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:46.355669Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:46.355705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602545944797826:7565], now have 1 active actors on pipe
2025-10-10T14:38:46.355715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602545944797718:2438], now have 1 active actors on pipe
2025-10-10T14:38:46.355718Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602545162558317:8967]
2025-10-10T14:38:46.355726Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:46.355737Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:46.355777Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2772
2025-10-10T14:38:46.355777Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2772
2025-10-10T14:38:46.355988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:46.356000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:46.356036Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|24f402c-af4c7a9a-19e122fe-2c438b49_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:46.356049Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:46.356060Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:46.356062Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:46.356075Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:46.356091Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:46.356109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:46.356389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:46.356398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:46.356414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:46.356606Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2773 partition: 0 MaxSeqNo: 40 sessionId: src_id|24f402c-af4c7a9a-19e122fe-2c438b49_0
2025-10-10T14:38:46.356958Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|292b0947-1c446a40-b90f4210-c492bcca_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|24f402c-af4c7a9a-19e122fe-2c438b49_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:46.359831Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|24f402c-af4c7a9a-19e122fe-2c438b49_0] Write session: try to update token
2025-10-10T14:38:46.359850Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|24f402c-af4c7a9a-19e122fe-2c438b49_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:46.374299Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:38:46.374316Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:46.374328Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602545162558317:8967]
2025-10-10T14:38:46.374379Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:38:46.374383Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:38:46.374560Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:38:46.374729Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:46.374884Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:46.375041Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:46.375248Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:38:46.375293Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:38:46.377544Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2773 sessionId: src_id|24f402c-af4c7a9a-19e122fe-2c438b49_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:46.380266Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:46.380494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:46.380512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:46.380565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:38:46.380683Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:38:46.386284Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:46.386298Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:46.386301Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:46.386303Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:46.386313Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602545162558317:8967]
2025-10-10T14:38:46.386316Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602545162558317:8967]
2025-10-10T14:38:46.386319Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602545162558317:8967]
2025-10-10T14:38:46.386367Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:46.386374Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:46.386382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:46.386385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:46.386390Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:46.386394Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:46.386523Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:46.432469Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602545944797862:3900]
2025-10-10T14:38:46.432730Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 pipe creation result: OK TabletId: 72075186224037892 Generation: 2772, pipe: [1:7559602545944797862:3900]
2025-10-10T14:38:46.504935Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:46.513406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:46.513434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:46.513623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:46.513690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:46.513771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:46.513845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:46.513893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:46.513902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:46.513976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:46.514044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:46.514113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:46.514188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:46.514233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:46.514241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:46.514309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:46.514371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:46.514435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:46.514500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:46.514547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:46.514554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:46.514623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:46.515063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:46.515130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:46.515197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:46.515241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:46.515248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:46.515317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:46.515384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:46.515446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:46.515514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:46.515559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:46.515565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:46.515633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:46.515694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:46.515757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:46.515819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:46.515865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:46.515873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:46.515945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:46.516008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:46.516073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:46.516137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:46.516182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:46.516189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:46.516253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:46.516315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:46.516379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:46.516446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:46.516492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:46.516498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:46.516565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:46.516628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:46.516697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:46.516762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:46.516808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:46.516815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:46.516884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:46.516949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:46.517014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:46.517078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:46.517121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:46.517129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:46.517195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602545944797862:3900], now have 1 active actors on pipe
2025-10-10T14:38:46.517474Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:46.517488Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 71 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602545944797862:3900]
2025-10-10T14:38:46.517495Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:46.517515Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:46.517527Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2773 reason: error at write: Disconnected sessionId: src_id|24f402c-af4c7a9a-19e122fe-2c438b49_0
2025-10-10T14:38:46.517766Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2773 sessionId: src_id|24f402c-af4c7a9a-19e122fe-2c438b49_0 is DEAD
2025-10-10T14:38:46.517930Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24f402c-af4c7a9a-19e122fe-2c438b49_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:46.517941Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24f402c-af4c7a9a-19e122fe-2c438b49_0] Write session will restart in 0.009388s
2025-10-10T14:38:46.517981Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24f402c-af4c7a9a-19e122fe-2c438b49_0] Write session: Do CDS request
2025-10-10T14:38:46.517988Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24f402c-af4c7a9a-19e122fe-2c438b49_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:46.517989Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:46.529099Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|24f402c-af4c7a9a-19e122fe-2c438b49_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:46.529212Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:46.529230Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2774
2025-10-10T14:38:46.529374Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2774 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:46.529413Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2774 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:46.529424Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2774 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:46.529428Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:46.529932Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2774 sessionId:  describe result for acl check
2025-10-10T14:38:46.530064Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:46.530070Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:46.530072Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:46.530080Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602545944797941:7483] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:46.530232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:46.530690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602545944797941:7483] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:46.532811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602545944797941:7483] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:46.533484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:46.533720Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:46.533732Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:46.533746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:46.533813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:46.533859Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602545162558485:8940]
2025-10-10T14:38:46.534460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:46.534784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:46.534828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:46.535059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:46.535096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:46.535102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:46.535103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:46.535103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:46.535104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:46.535105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:46.535106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:46.535107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:46.535108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:46.535109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:46.535110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:46.535110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:46.535111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:46.535115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:46.535124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:46.535127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:46.535129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:46.535132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:46.535135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:46.535137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:46.535140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:46.535142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:46.535144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:46.535147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:46.535151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:46.535155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:46.535163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:46.535171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:46.535178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:46.535183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:46.535188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:46.535193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:46.535198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:46.535204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:46.535208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:46.535214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:46.535218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:46.535223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:46.535229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:46.535234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:46.535236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:46.535239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:46.535242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:46.535246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:46.535249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:46.535253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:46.535255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:46.535260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:46.535262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:46.535266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:46.535271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:46.535276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:46.535310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:46.535527Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602545944797941:7483] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:46.535542Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602545944797941:7483] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:46.535546Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602545944797941:7483] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:46.535555Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2774 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:46.537647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:46.537969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:46.537981Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:46.537983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:46.537986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:46.537991Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2773 [2:7559602545162558485:8940]
2025-10-10T14:38:46.538000Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:46.538013Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:46.538015Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:46.538018Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:46.538020Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:46.538032Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:46.538037Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:46.538044Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:46.538090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:46.538097Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:46.538098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:46.538100Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:46.538150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:46.538156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:46.538163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:46.538169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:46.538179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:46.538194Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602545162558480:8940]
2025-10-10T14:38:46.538198Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602545162558480:8940]
2025-10-10T14:38:46.538200Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602545162558480:8940]
2025-10-10T14:38:46.538209Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:46.538218Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:46.538219Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:46.538221Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:46.538226Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:46.538229Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:46.538231Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:46.538239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602545944797975:7483], now have 1 active actors on pipe
2025-10-10T14:38:46.538242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602545944797865:2438], now have 1 active actors on pipe
2025-10-10T14:38:46.538258Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602545162558480:8940]
2025-10-10T14:38:46.538264Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:46.538320Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:46.538294Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2773
2025-10-10T14:38:46.538332Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2773
2025-10-10T14:38:46.538477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:46.538483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:46.538509Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d267883a-dc5424f7-b742a447-154feff9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:46.538519Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:46.538523Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:46.538525Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:46.538537Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:46.538555Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:46.538575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:46.538788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:46.538795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:46.538809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:46.538905Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2774 partition: 0 MaxSeqNo: 40 sessionId: src_id|d267883a-dc5424f7-b742a447-154feff9_0
2025-10-10T14:38:46.539616Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24f402c-af4c7a9a-19e122fe-2c438b49_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|d267883a-dc5424f7-b742a447-154feff9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:46.542746Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d267883a-dc5424f7-b742a447-154feff9_0] Write session: try to update token
2025-10-10T14:38:46.542770Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d267883a-dc5424f7-b742a447-154feff9_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:46.558512Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:46.558532Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:46.558535Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:46.558538Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:46.558547Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602545162558480:8940]
2025-10-10T14:38:46.558552Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602545162558480:8940]
2025-10-10T14:38:46.558557Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602545162558480:8940]
2025-10-10T14:38:46.558615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:46.558617Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:46.558624Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:46.558626Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:46.558626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:46.558630Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:46.558783Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:46.557854Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2774 sessionId: src_id|d267883a-dc5424f7-b742a447-154feff9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:46.560589Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:46.619480Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602545944797994:3900]
2025-10-10T14:38:46.619921Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 pipe creation result: OK TabletId: 72075186224037892 Generation: 2773, pipe: [1:7559602545944797994:3900]
2025-10-10T14:38:46.678939Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:46.679592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:46.679605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:46.679655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602545944797994:3900], now have 1 active actors on pipe
2025-10-10T14:38:46.679972Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 72 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602545944797994:3900]
2025-10-10T14:38:46.680015Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:46.680068Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:38:46.680147Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2774 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d267883a-dc5424f7-b742a447-154feff9_0
2025-10-10T14:38:46.679936Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:46.680552Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d267883a-dc5424f7-b742a447-154feff9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:38:46.680563Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d267883a-dc5424f7-b742a447-154feff9_0] Write session will restart in 0.005222s
2025-10-10T14:38:46.680589Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d267883a-dc5424f7-b742a447-154feff9_0] Write session: Do CDS request
2025-10-10T14:38:46.680597Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d267883a-dc5424f7-b742a447-154feff9_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:46.680388Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2774 sessionId: src_id|d267883a-dc5424f7-b742a447-154feff9_0 is DEAD
2025-10-10T14:38:46.686808Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d267883a-dc5424f7-b742a447-154feff9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:46.688248Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:46.688265Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2775
2025-10-10T14:38:46.689140Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2775 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:46.689191Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2775 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:46.689203Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2775 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:46.689207Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:46.689781Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2775 sessionId:  describe result for acl check
2025-10-10T14:38:46.689819Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:46.689828Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:46.689831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:46.689838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602545944798020:7464] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:46.690445Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602545944798020:7464] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:46.693581Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602545944798020:7464] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:46.696537Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602545944798020:7464] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:46.696552Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602545944798020:7464] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:46.696556Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602545944798020:7464] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:46.696565Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2775 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:46.703821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:46.707388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:46.707629Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:46.707639Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:46.707653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:46.707719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:46.707815Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602545162558600:8933]
2025-10-10T14:38:46.708468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:46.708856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:46.708927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:46.709286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:46.709400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:46.709407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:46.709408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:46.709409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:46.709412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:46.709413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:46.709414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:46.709415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:46.709417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:46.709418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:46.709419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:46.709421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:46.709422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:46.709428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:46.709442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:46.709447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:46.709450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:46.709454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:46.709458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:46.709462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:46.709465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:46.709469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:46.709473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:46.709476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:46.709479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:46.709483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:46.709493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:46.709501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:46.709508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:46.709513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:46.709530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:46.709535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:46.709540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:46.709544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:46.709552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:46.709557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:46.709561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:46.709579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:46.709584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:46.709589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:46.709593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:46.709598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:46.709602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:46.709607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:46.709612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:46.709616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:46.709621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:46.709626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:46.709630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:46.709635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:46.709638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:46.709643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:46.709681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:46.712333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:46.712980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:46.712995Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:46.712997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:46.713001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:46.713008Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2774 [2:7559602545162558600:8933]
2025-10-10T14:38:46.713021Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:46.713039Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:46.713042Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:46.713046Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:46.713049Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:46.713067Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:46.713084Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:46.713092Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:46.713158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:46.713165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:46.713167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:46.713169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:46.713248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:46.713258Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:46.713271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:46.713285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:46.713305Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:46.713351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602545944798061:7464], now have 1 active actors on pipe
2025-10-10T14:38:46.713356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602545944797996:2438], now have 1 active actors on pipe
2025-10-10T14:38:46.713364Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602545162558595:8933]
2025-10-10T14:38:46.713372Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602545162558595:8933]
2025-10-10T14:38:46.713374Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602545162558595:8933]
2025-10-10T14:38:46.713391Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:46.713411Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2774
2025-10-10T14:38:46.713407Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:46.713458Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2774
2025-10-10T14:38:46.713410Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:46.713414Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:46.713416Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:46.713428Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:46.713431Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:46.713460Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602545162558595:8933]
2025-10-10T14:38:46.713467Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:46.713474Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:46.713617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:46.713628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:46.713663Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4847fbf3-1d66e8ed-c8f6e883-fad92611_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:46.713675Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:46.713680Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:46.713682Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:46.713707Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:46.713723Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:46.713744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:46.713947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:46.713961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:46.713990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:46.714106Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2775 partition: 0 MaxSeqNo: 40 sessionId: src_id|4847fbf3-1d66e8ed-c8f6e883-fad92611_0
2025-10-10T14:38:46.714517Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d267883a-dc5424f7-b742a447-154feff9_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|4847fbf3-1d66e8ed-c8f6e883-fad92611_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:46.717217Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4847fbf3-1d66e8ed-c8f6e883-fad92611_0] Write session: try to update token
2025-10-10T14:38:46.717237Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4847fbf3-1d66e8ed-c8f6e883-fad92611_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:46.726581Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:38:46.726596Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:46.726608Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602545162558595:8933]
2025-10-10T14:38:46.726652Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:38:46.726658Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:38:46.726840Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:38:46.726984Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:46.727132Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:46.727284Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:46.727466Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:38:46.727511Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:38:46.732076Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2775 sessionId: src_id|4847fbf3-1d66e8ed-c8f6e883-fad92611_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:46.734962Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:46.735168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:46.735193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:46.735237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:38:46.735353Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:38:46.745268Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:46.745291Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:46.745295Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:46.745298Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:46.745310Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602545162558595:8933]
2025-10-10T14:38:46.745314Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602545162558595:8933]
2025-10-10T14:38:46.745318Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602545162558595:8933]
2025-10-10T14:38:46.745387Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:46.745394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:46.745395Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:46.745400Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:46.745415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:46.745418Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:46.745573Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:46.780127Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602545944798116:3900]
2025-10-10T14:38:46.780548Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 pipe creation result: OK TabletId: 72075186224037892 Generation: 2774, pipe: [1:7559602545944798116:3900]
2025-10-10T14:38:46.862795Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:46.871616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:46.871644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:46.871827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:46.871887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:46.871948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:46.872013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:46.872068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:46.872078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:46.872145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:46.872213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:46.872271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:46.872342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:46.872389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:46.872396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:46.872464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:46.872523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:46.872585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:46.872654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:46.872698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:46.872706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:46.872772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:46.872836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:46.872899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:46.872961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:46.873005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:46.873012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:46.873077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:46.873139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:46.873206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:46.873270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:46.873318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:46.873320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:46.873403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:46.873466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:46.873529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:46.873592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:46.873638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:46.873645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:46.873727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:46.873857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:46.873985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:46.874052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:46.874098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:46.874105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:46.874172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:46.874237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:46.874302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:46.874366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:46.874413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:46.874420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:46.874485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:46.874548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:46.874615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:46.874689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:46.874729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:46.874731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:46.874848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:46.874911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:46.874973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:46.875038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:46.875084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:46.875091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:46.875160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602545944798116:3900], now have 1 active actors on pipe
2025-10-10T14:38:46.875365Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:46.875405Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:46.875409Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:46.875436Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 73 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602545944798116:3900]
2025-10-10T14:38:46.875453Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2775 reason: error at write: Disconnected sessionId: src_id|4847fbf3-1d66e8ed-c8f6e883-fad92611_0
2025-10-10T14:38:46.875677Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2775 sessionId: src_id|4847fbf3-1d66e8ed-c8f6e883-fad92611_0 is DEAD
2025-10-10T14:38:46.875832Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4847fbf3-1d66e8ed-c8f6e883-fad92611_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:46.875844Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4847fbf3-1d66e8ed-c8f6e883-fad92611_0] Write session will restart in 0.005292s
2025-10-10T14:38:46.875871Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4847fbf3-1d66e8ed-c8f6e883-fad92611_0] Write session: Do CDS request
2025-10-10T14:38:46.875877Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4847fbf3-1d66e8ed-c8f6e883-fad92611_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:46.876349Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:46.882912Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4847fbf3-1d66e8ed-c8f6e883-fad92611_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:46.883026Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:46.883055Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2776
2025-10-10T14:38:46.883193Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2776 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:46.883228Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2776 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:46.883251Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2776 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:46.883260Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:46.883697Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2776 sessionId:  describe result for acl check
2025-10-10T14:38:46.883732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:46.883736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:46.883738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:46.883743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602545944798142:7437] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:46.884305Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602545944798142:7437] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:46.887303Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602545944798142:7437] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:46.888648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:46.892011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:46.892193Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602545944798142:7437] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:46.892211Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602545944798142:7437] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:46.892214Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602545944798142:7437] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:46.892224Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2776 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:46.892243Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:46.892254Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:46.892266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:46.892327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:46.892380Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602545162558714:8930]
2025-10-10T14:38:46.893027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:46.893364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:46.893409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:46.893755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:46.893815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:46.893821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:46.893822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:46.893823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:46.893824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:46.893826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:46.893827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:46.893829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:46.893830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:46.893831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:46.893833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:46.893834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:46.893835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:46.893840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:46.893855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:46.893859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:46.893863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:46.893867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:46.893871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:46.893875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:46.893879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:46.893882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:46.893886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:46.893890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:46.893893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:46.893896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:46.893904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:46.893915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:46.893921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:46.893928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:46.893932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:46.893938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:46.893943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:46.893948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:46.893953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:46.893958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:46.893963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:46.893968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:46.893973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:46.893984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:46.893989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:46.893999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:46.894005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:46.894015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:46.894019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:46.894026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:46.894038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:46.894043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:46.894052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:46.894058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:46.894063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:46.894068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:46.894113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:46.896515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:46.896882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:46.896892Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:46.896894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:46.896897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:46.896902Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2775 [2:7559602545162558714:8930]
2025-10-10T14:38:46.896912Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:46.896934Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:46.896937Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:46.896940Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:46.896941Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:46.896956Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:46.896962Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:46.896969Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:46.897013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:46.897019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:46.897020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:46.897022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:46.897088Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:46.897098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:46.897107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:46.897113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:46.897123Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:46.897158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602545944798236:7437], now have 1 active actors on pipe
2025-10-10T14:38:46.897167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602545944798127:2438], now have 1 active actors on pipe
2025-10-10T14:38:46.897175Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602545162558709:8930]
2025-10-10T14:38:46.897181Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602545162558709:8930]
2025-10-10T14:38:46.897182Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602545162558709:8930]
2025-10-10T14:38:46.897193Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:46.897209Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:46.897214Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:46.897216Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:46.897218Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:46.897219Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:46.897226Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2775
2025-10-10T14:38:46.897231Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2775
2025-10-10T14:38:46.897221Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:46.897243Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602545162558709:8930]
2025-10-10T14:38:46.897245Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:46.897248Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:46.897264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:46.897268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:46.897303Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5045b658-99400d2c-ae6adeed-9a6b4464_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:46.897312Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:46.897317Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:46.897319Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:46.897350Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:46.897362Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:46.897380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:46.897555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:46.897570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:46.897597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:46.897701Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2776 partition: 0 MaxSeqNo: 40 sessionId: src_id|5045b658-99400d2c-ae6adeed-9a6b4464_0
2025-10-10T14:38:46.898057Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4847fbf3-1d66e8ed-c8f6e883-fad92611_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|5045b658-99400d2c-ae6adeed-9a6b4464_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:46.900799Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5045b658-99400d2c-ae6adeed-9a6b4464_0] Write session: try to update token
2025-10-10T14:38:46.900821Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5045b658-99400d2c-ae6adeed-9a6b4464_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:46.921369Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:46.921399Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:46.921407Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:46.921411Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:46.921425Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602545162558709:8930]
2025-10-10T14:38:46.921432Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602545162558709:8930]
2025-10-10T14:38:46.921435Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602545162558709:8930]
2025-10-10T14:38:46.921491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:46.921500Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:46.921516Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:46.921522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:46.921524Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:46.921532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:46.921677Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:46.922566Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2776 sessionId: src_id|5045b658-99400d2c-ae6adeed-9a6b4464_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:46.925305Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:46.975739Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602545944798247:3900]
2025-10-10T14:38:46.976377Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 pipe creation result: OK TabletId: 72075186224037892 Generation: 2775, pipe: [1:7559602545944798247:3900]
2025-10-10T14:38:47.043047Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:47.044145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:47.044168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:47.044221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602545944798247:3900], now have 1 active actors on pipe
2025-10-10T14:38:47.044523Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:47.044481Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 74 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602545944798247:3900]
2025-10-10T14:38:47.044498Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:47.044502Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:47.044526Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:47.044593Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2776 reason: error at write: Disconnected sessionId: src_id|5045b658-99400d2c-ae6adeed-9a6b4464_0
2025-10-10T14:38:47.044816Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2776 sessionId: src_id|5045b658-99400d2c-ae6adeed-9a6b4464_0 is DEAD
2025-10-10T14:38:47.045540Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5045b658-99400d2c-ae6adeed-9a6b4464_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:47.045552Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5045b658-99400d2c-ae6adeed-9a6b4464_0] Write session will restart in 0.005993s
2025-10-10T14:38:47.045583Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5045b658-99400d2c-ae6adeed-9a6b4464_0] Write session: Do CDS request
2025-10-10T14:38:47.045592Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5045b658-99400d2c-ae6adeed-9a6b4464_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:47.052963Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5045b658-99400d2c-ae6adeed-9a6b4464_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:47.053017Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:47.053035Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2777
2025-10-10T14:38:47.053174Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2777 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:47.053216Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2777 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:47.053223Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2777 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:47.053227Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:47.053707Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2777 sessionId:  describe result for acl check
2025-10-10T14:38:47.053738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:47.053739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:47.053741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:47.053747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602550239765570:7418] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:47.054369Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602550239765570:7418] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:47.056811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602550239765570:7418] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:47.058570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:47.062145Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602550239765570:7418] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:47.062166Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602550239765570:7418] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:47.062170Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602550239765570:7418] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:47.062180Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2777 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:47.062574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:47.062859Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:47.062872Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:47.062886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:47.062949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:47.063027Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602549457526127:8927]
2025-10-10T14:38:47.063684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:47.064078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:47.064134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:47.064471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:47.064532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:47.064533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:47.064534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:47.064536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:47.064537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:47.064539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:47.064541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:47.064542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:47.064544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:47.064545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:47.064546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:47.064548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:47.064549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:47.064559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:47.064575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:47.064579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:47.064584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:47.064588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:47.064592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:47.064596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:47.064600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:47.064604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:47.064610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:47.064615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:47.064619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:47.064623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:47.064631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:47.064641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:47.064650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:47.064657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:47.064662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:47.064667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:47.064672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:47.064678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:47.064683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:47.064688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:47.064693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:47.064698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:47.064702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:47.064708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:47.064713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:47.064720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:47.064725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:47.064730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:47.064735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:47.064744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:47.064749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:47.064755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:47.064760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:47.064765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:47.064770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:47.064776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:47.064820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:47.067834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:47.068552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:47.068566Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:47.068569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:47.068574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:47.068581Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2776 [2:7559602549457526127:8927]
2025-10-10T14:38:47.068595Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:47.068614Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:47.068617Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:47.068621Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:47.068624Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:47.068643Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:47.068651Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:47.068660Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:47.068729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:47.068736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:47.068740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:47.068743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:47.068814Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:47.068822Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:47.068835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:47.068846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:47.068861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:47.068886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602550239765545:2438], now have 1 active actors on pipe
2025-10-10T14:38:47.068894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602550239765655:7418], now have 1 active actors on pipe
2025-10-10T14:38:47.068903Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602549457526121:8927]
2025-10-10T14:38:47.068905Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602549457526121:8927]
2025-10-10T14:38:47.068907Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602549457526121:8927]
2025-10-10T14:38:47.068920Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:47.068939Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:47.068949Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:47.068952Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:47.068958Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:47.068959Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:47.068963Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:47.068996Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602549457526121:8927]
2025-10-10T14:38:47.068965Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2776
2025-10-10T14:38:47.069004Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:47.069005Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:47.069028Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2776
2025-10-10T14:38:47.069067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:47.069077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:47.069108Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|189b015a-f4f92fc1-fd67c07-5409a472_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:47.069120Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:47.069129Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:47.069132Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:47.069145Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:47.069155Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:47.069173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:47.069406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:47.069416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:47.069432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:47.069578Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2777 partition: 0 MaxSeqNo: 40 sessionId: src_id|189b015a-f4f92fc1-fd67c07-5409a472_0
2025-10-10T14:38:47.070050Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5045b658-99400d2c-ae6adeed-9a6b4464_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|189b015a-f4f92fc1-fd67c07-5409a472_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:47.072861Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|189b015a-f4f92fc1-fd67c07-5409a472_0] Write session: try to update token
2025-10-10T14:38:47.072883Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|189b015a-f4f92fc1-fd67c07-5409a472_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:47.083143Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:38:47.083166Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:47.083179Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602549457526121:8927]
2025-10-10T14:38:47.083245Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:38:47.083249Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:38:47.083493Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:38:47.083656Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:47.083809Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:47.083972Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:47.084182Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:38:47.084228Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:38:47.092866Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2777 sessionId: src_id|189b015a-f4f92fc1-fd67c07-5409a472_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:47.095592Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:47.095840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:47.095861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:47.095912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:38:47.096003Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:38:47.102508Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:47.102532Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:47.102536Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:47.102539Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:47.102550Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602549457526121:8927]
2025-10-10T14:38:47.102554Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602549457526121:8927]
2025-10-10T14:38:47.102559Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602549457526121:8927]
2025-10-10T14:38:47.102614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:47.102619Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:47.102623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:47.102626Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:47.102626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:47.102643Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:47.102771Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:47.144661Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602550239765666:3900]
2025-10-10T14:38:47.145025Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 pipe creation result: OK TabletId: 72075186224037892 Generation: 2776, pipe: [1:7559602550239765666:3900]
2025-10-10T14:38:47.225045Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:47.233590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:47.233620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:47.233818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:47.233888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:47.233950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:47.234010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:47.234053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:47.234057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:47.234129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:47.234194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:47.234295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:47.234362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:47.234402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:47.234405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:47.234472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:47.234530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:47.234587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:47.234648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:47.234687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:47.234689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:47.234759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:47.234817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:47.234875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:47.234935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:47.234975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:47.234978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:47.235044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:47.235103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:47.235162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:47.237147Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:47.237233Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 75 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602550239765666:3900]
2025-10-10T14:38:47.237260Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:47.237263Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:47.237299Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2777 reason: error at write: Disconnected sessionId: src_id|189b015a-f4f92fc1-fd67c07-5409a472_0
2025-10-10T14:38:47.235221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:47.235337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:47.235340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:47.235411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:47.235468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:47.235525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:47.235590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:47.235631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:47.235634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:47.235703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:47.235761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:47.235819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:47.235877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:47.235919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:47.235922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:47.235986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:47.236042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:47.236101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:47.236160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:47.236199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:47.236202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:47.236271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:47.236328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:47.236387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:47.236445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:47.236489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:47.236492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:47.236559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:47.236616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:47.236673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:47.236733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:47.236777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:47.236780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:47.236858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602550239765666:3900], now have 1 active actors on pipe
2025-10-10T14:38:47.237524Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2777 sessionId: src_id|189b015a-f4f92fc1-fd67c07-5409a472_0 is DEAD
2025-10-10T14:38:47.237752Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|189b015a-f4f92fc1-fd67c07-5409a472_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:47.237769Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|189b015a-f4f92fc1-fd67c07-5409a472_0] Write session will restart in 0.008784s
2025-10-10T14:38:47.237794Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|189b015a-f4f92fc1-fd67c07-5409a472_0] Write session: Do CDS request
2025-10-10T14:38:47.237801Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|189b015a-f4f92fc1-fd67c07-5409a472_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:47.238125Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:47.248184Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:47.248204Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2778
2025-10-10T14:38:47.248243Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|189b015a-f4f92fc1-fd67c07-5409a472_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:47.248474Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2778 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:47.248526Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2778 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:47.248537Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2778 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:47.248540Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:47.249016Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2778 sessionId:  describe result for acl check
2025-10-10T14:38:47.249056Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:47.249062Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:47.249064Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:47.249071Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602550239765723:7423] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:47.250108Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602550239765723:7423] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:47.252941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:47.253111Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602550239765723:7423] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:47.256897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:47.257070Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602550239765723:7423] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:47.257086Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602550239765723:7423] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:47.257089Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602550239765723:7423] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:47.257100Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2778 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:47.257139Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:47.257152Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:47.257165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:47.257229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:47.257275Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602549457526246:8925]
2025-10-10T14:38:47.257864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:47.258228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:47.258295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:47.258675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:47.258742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:47.258749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:47.258750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:47.258751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:47.258753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:47.258754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:47.258756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:47.258757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:47.258758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:47.258760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:47.258761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:47.258762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:47.258763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:47.258770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:47.258784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:47.258788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:47.258793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:47.258797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:47.258801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:47.258805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:47.258809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:47.258813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:47.258818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:47.258822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:47.258826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:47.258830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:47.258838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:47.258847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:47.258860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:47.258866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:47.258870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:47.258875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:47.258880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:47.258901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:47.258912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:47.258917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:47.258926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:47.258932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:47.258937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:47.258943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:47.258953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:47.258959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:47.258968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:47.258974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:47.258980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:47.258986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:47.258997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:47.259007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:47.259011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:47.259015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:47.259025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:47.259039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:47.259085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:47.261706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:47.262009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:47.262020Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:47.262023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:47.262027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:47.262033Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2777 [2:7559602549457526246:8925]
2025-10-10T14:38:47.262046Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:47.262064Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:47.262074Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:47.262077Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:47.262080Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:47.262096Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:47.262104Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:47.262112Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:47.262178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:47.262186Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:47.262188Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:47.262190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:47.262407Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2777
2025-10-10T14:38:47.262427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:47.262408Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2777
2025-10-10T14:38:47.262436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:47.262448Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:47.262459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:47.262478Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:47.262502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602550239765778:7423], now have 1 active actors on pipe
2025-10-10T14:38:47.262510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602550239765669:2438], now have 1 active actors on pipe
2025-10-10T14:38:47.262525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:47.262531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:47.262554Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602549457526240:8925]
2025-10-10T14:38:47.262560Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602549457526240:8925]
2025-10-10T14:38:47.262563Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602549457526240:8925]
2025-10-10T14:38:47.262576Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:47.262589Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:47.262602Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:47.262606Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:47.262608Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:47.262612Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:47.262615Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:47.262634Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|38be9b97-f2dae59e-8b6de423-87cb1f28_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:47.262642Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:47.262646Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:47.262649Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:47.262658Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:47.262674Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:47.262710Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602549457526240:8925]
2025-10-10T14:38:47.262722Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:47.262728Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:47.262733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:47.263026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:47.263038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:47.263062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:47.263160Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2778 partition: 0 MaxSeqNo: 40 sessionId: src_id|38be9b97-f2dae59e-8b6de423-87cb1f28_0
2025-10-10T14:38:47.263582Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|189b015a-f4f92fc1-fd67c07-5409a472_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|38be9b97-f2dae59e-8b6de423-87cb1f28_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:47.266280Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|38be9b97-f2dae59e-8b6de423-87cb1f28_0] Write session: try to update token
2025-10-10T14:38:47.266298Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|38be9b97-f2dae59e-8b6de423-87cb1f28_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:47.284852Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:47.284874Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:47.284879Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:47.284881Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:47.284891Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602549457526240:8925]
2025-10-10T14:38:47.284896Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602549457526240:8925]
2025-10-10T14:38:47.284901Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602549457526240:8925]
2025-10-10T14:38:47.284952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:47.284961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:47.284964Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:47.285020Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:47.285034Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:47.285041Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:47.285103Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:47.285155Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2778 sessionId: src_id|38be9b97-f2dae59e-8b6de423-87cb1f28_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:47.287901Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:47.337201Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602550239765791:3900]
2025-10-10T14:38:47.341656Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 pipe creation result: OK TabletId: 72075186224037892 Generation: 2777, pipe: [1:7559602550239765791:3900]
2025-10-10T14:38:47.408486Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:47.409141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:47.409171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:47.409230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602550239765791:3900], now have 1 active actors on pipe
2025-10-10T14:38:47.409493Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:47.409716Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:38:47.409828Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2778 reason: status is not ok: tablet will be restarted right now sessionId: src_id|38be9b97-f2dae59e-8b6de423-87cb1f28_0
2025-10-10T14:38:47.409922Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 76 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602550239765791:3900]
2025-10-10T14:38:47.409968Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:47.410030Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2778 sessionId: src_id|38be9b97-f2dae59e-8b6de423-87cb1f28_0 is DEAD
2025-10-10T14:38:47.413669Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38be9b97-f2dae59e-8b6de423-87cb1f28_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:38:47.413708Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38be9b97-f2dae59e-8b6de423-87cb1f28_0] Write session will restart in 0.008122s
2025-10-10T14:38:47.413735Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38be9b97-f2dae59e-8b6de423-87cb1f28_0] Write session: Do CDS request
2025-10-10T14:38:47.413742Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38be9b97-f2dae59e-8b6de423-87cb1f28_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:47.422975Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|38be9b97-f2dae59e-8b6de423-87cb1f28_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:47.423152Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:47.423173Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2779
2025-10-10T14:38:47.423803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:47.423397Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2779 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:47.423453Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2779 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:47.423459Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2779 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:47.423463Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:47.423869Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2779 sessionId:  describe result for acl check
2025-10-10T14:38:47.423899Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:47.423900Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:47.423902Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:47.423909Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602550239765874:7397] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:47.424441Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602550239765874:7397] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:47.427169Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602550239765874:7397] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:47.427629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:47.427894Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:47.427900Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:47.427912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:47.427971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:47.428017Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602549457526377:8920]
2025-10-10T14:38:47.428682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:47.429035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:47.429100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:47.429461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:47.429548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:47.429550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:47.429551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:47.429552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:47.429554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:47.429555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:47.429557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:47.429558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:47.429559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:47.429560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:47.429562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:47.429563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:47.429564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:47.429572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:47.429585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:47.429589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:47.429592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:47.429597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:47.429601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:47.429605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:47.429610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:47.429614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:47.429619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:47.429624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:47.429630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:47.429634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:47.429645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:47.429655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:47.429662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:47.429669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:47.429674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:47.429693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:47.429697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:47.429704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:47.429709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:47.429715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:47.429720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:47.429726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:47.429732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:47.429737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:47.429742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:47.429748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:47.429753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:47.429766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:47.429771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:47.429777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:47.429782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:47.429787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:47.429791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:47.429796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:47.429801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:47.429807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:47.429852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:47.433967Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602550239765874:7397] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:47.433988Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602550239765874:7397] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:47.433992Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602550239765874:7397] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:47.434002Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2779 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:47.434323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:47.434683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:47.434700Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:47.434703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:47.434709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:47.434720Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2778 [2:7559602549457526377:8920]
2025-10-10T14:38:47.434736Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:47.434757Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:47.434768Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:47.434773Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:47.434776Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:47.434798Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:47.434808Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:47.434816Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:47.434891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:47.434899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:47.434901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:47.434904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:47.434976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:47.434984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:47.434998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:47.435011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:47.435040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:47.435064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602550239765911:7397], now have 1 active actors on pipe
2025-10-10T14:38:47.435068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602550239765792:2438], now have 1 active actors on pipe
2025-10-10T14:38:47.435077Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602549457526363:8920]
2025-10-10T14:38:47.435081Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602549457526363:8920]
2025-10-10T14:38:47.435084Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602549457526363:8920]
2025-10-10T14:38:47.435098Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:47.435120Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:47.435119Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:47.435135Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:47.435138Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:47.435143Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:47.435146Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:47.435137Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2778
2025-10-10T14:38:47.435176Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2778
2025-10-10T14:38:47.435186Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602549457526363:8920]
2025-10-10T14:38:47.435196Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:47.435214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:47.435223Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:47.435224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:47.435280Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|903b343f-6665b1b9-7ec95e25-9b9e7146_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:47.435294Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:47.435298Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:47.435301Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:47.435312Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:47.435328Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:47.435359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:47.435691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:47.435702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:47.435721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:47.435874Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2779 partition: 0 MaxSeqNo: 40 sessionId: src_id|903b343f-6665b1b9-7ec95e25-9b9e7146_0
2025-10-10T14:38:47.437607Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38be9b97-f2dae59e-8b6de423-87cb1f28_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|903b343f-6665b1b9-7ec95e25-9b9e7146_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:47.440783Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|903b343f-6665b1b9-7ec95e25-9b9e7146_0] Write session: try to update token
2025-10-10T14:38:47.440807Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|903b343f-6665b1b9-7ec95e25-9b9e7146_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:47.456273Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2779 sessionId: src_id|903b343f-6665b1b9-7ec95e25-9b9e7146_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:47.459023Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:47.459247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:47.459270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:47.459312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:38:47.462343Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:47.462361Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:47.462364Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:47.462366Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:47.462375Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602549457526363:8920]
2025-10-10T14:38:47.462380Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602549457526363:8920]
2025-10-10T14:38:47.462383Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602549457526363:8920]
2025-10-10T14:38:47.462431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:47.462439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:47.462442Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:47.462443Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:47.462450Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:47.462454Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:47.462584Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:47.459406Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:38:47.510243Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602550239765940:3900]
2025-10-10T14:38:47.510599Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 pipe creation result: OK TabletId: 72075186224037892 Generation: 2778, pipe: [1:7559602550239765940:3900]
2025-10-10T14:38:47.584630Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:47.597216Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:47.597230Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:47.597235Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:47.597267Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2779 reason: error at write: Disconnected sessionId: src_id|903b343f-6665b1b9-7ec95e25-9b9e7146_0
2025-10-10T14:38:47.597286Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 77 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602550239765940:3900]
2025-10-10T14:38:47.593691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:47.593719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:47.593896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:47.593958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:47.594023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:47.594090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:47.594135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:47.594141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:47.594216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:47.594275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:47.594335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:47.594404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:47.594449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:47.594452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:47.594528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:47.594593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:47.594656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:47.594718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:47.594759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:47.594761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:47.594828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:47.594888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:47.594950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:47.595023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:47.595068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:47.595071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:47.595140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:47.595202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:47.595272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:47.595338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:47.595381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:47.595384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:47.595460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:47.595522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:47.595577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:47.595639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:47.595684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:47.595687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:47.595758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:47.595815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:47.595878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:47.595945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:47.595989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:47.595996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:47.596062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:47.596118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:47.596181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:47.596243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:47.596286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:47.596290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:47.596357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:47.596417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:47.596484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:47.596546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:47.597537Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2779 sessionId: src_id|903b343f-6665b1b9-7ec95e25-9b9e7146_0 is DEAD
2025-10-10T14:38:47.596585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:47.596588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:47.596657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:47.596713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:47.596775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:47.596839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:47.596883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:47.596886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:47.596960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602550239765940:3900], now have 1 active actors on pipe
2025-10-10T14:38:47.598558Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:47.601573Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|903b343f-6665b1b9-7ec95e25-9b9e7146_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:47.601586Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|903b343f-6665b1b9-7ec95e25-9b9e7146_0] Write session will restart in 0.007184s
2025-10-10T14:38:47.601613Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|903b343f-6665b1b9-7ec95e25-9b9e7146_0] Write session: Do CDS request
2025-10-10T14:38:47.601619Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|903b343f-6665b1b9-7ec95e25-9b9e7146_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:47.609900Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|903b343f-6665b1b9-7ec95e25-9b9e7146_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:47.610312Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:47.610333Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2780
2025-10-10T14:38:47.610482Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2780 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:47.610521Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2780 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:47.610534Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2780 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:47.610539Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:47.611100Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2780 sessionId:  describe result for acl check
2025-10-10T14:38:47.611140Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:47.611142Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:47.611144Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:47.611151Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602550239765979:7348] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:47.611781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602550239765979:7348] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:47.614203Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602550239765979:7348] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:47.617483Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602550239765979:7348] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:47.617500Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602550239765979:7348] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:47.617505Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602550239765979:7348] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:47.617514Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2780 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:47.618089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:47.621689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:47.621882Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:47.621887Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:47.621895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:47.621957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:47.621999Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602549457526535:8890]
2025-10-10T14:38:47.622436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:47.622756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:47.622792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:47.623017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:47.623052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:47.623052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:47.623053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:47.623054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:47.623055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:47.623056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:47.623056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:47.623057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:47.623058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:47.623058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:47.623059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:47.623060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:47.623061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:47.623065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:47.623074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:47.623076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:47.623079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:47.623081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:47.623083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:47.623086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:47.623088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:47.623090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:47.623093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:47.623095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:47.623098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:47.623100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:47.623106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:47.623113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:47.623117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:47.623121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:47.623123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:47.623127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:47.623130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:47.623133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:47.623136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:47.623139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:47.623142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:47.623145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:47.623149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:47.623153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:47.623155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:47.623158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:47.623161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:47.623165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:47.623167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:47.623170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:47.623175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:47.623180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:47.623182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:47.623185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:47.623188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:47.623191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:47.623213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:47.627375Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2779
2025-10-10T14:38:47.627397Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2779
2025-10-10T14:38:47.628066Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2780 partition: 0 MaxSeqNo: 40 sessionId: src_id|3ea4f091-a158037b-fa5cc048-ddd46869_0
2025-10-10T14:38:47.626195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:47.628506Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|903b343f-6665b1b9-7ec95e25-9b9e7146_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|3ea4f091-a158037b-fa5cc048-ddd46869_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:47.626751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:47.626755Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:47.626757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:47.626759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:47.626765Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2779 [2:7559602549457526535:8890]
2025-10-10T14:38:47.626774Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:47.626788Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:47.626790Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:47.626793Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:47.626794Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:47.626807Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:47.626813Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:47.626820Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:47.626865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:47.626866Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:47.626868Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:47.626871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:47.626937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:47.626941Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:47.626951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:47.626961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:47.626976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:47.626998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602550239765954:2438], now have 1 active actors on pipe
2025-10-10T14:38:47.627005Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602549457526529:8890]
2025-10-10T14:38:47.627008Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602549457526529:8890]
2025-10-10T14:38:47.627010Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602549457526529:8890]
2025-10-10T14:38:47.627024Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:47.627032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602550239766064:7348], now have 1 active actors on pipe
2025-10-10T14:38:47.627041Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:47.627041Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:47.627044Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:47.627046Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:47.627055Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:47.627059Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:47.627082Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602549457526529:8890]
2025-10-10T14:38:47.627089Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:47.627096Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:47.627683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:47.627690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:47.627720Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3ea4f091-a158037b-fa5cc048-ddd46869_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:47.627727Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:47.627730Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:47.627732Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:47.627741Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:47.627751Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:47.627762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:47.627947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:47.627949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:47.627964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:47.631397Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3ea4f091-a158037b-fa5cc048-ddd46869_0] Write session: try to update token
2025-10-10T14:38:47.631419Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3ea4f091-a158037b-fa5cc048-ddd46869_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:47.651135Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2780 sessionId: src_id|3ea4f091-a158037b-fa5cc048-ddd46869_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:47.654033Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:47.654282Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:38:47.654300Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:47.654311Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602549457526529:8890]
2025-10-10T14:38:47.654371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:47.654387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:47.654416Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:38:47.654604Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:38:47.654753Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:47.654894Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:47.655042Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:47.655252Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:38:47.655316Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:38:47.655353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:38:47.655425Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:38:47.655488Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:38:47.667451Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:47.667471Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:47.667475Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:47.667477Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:47.667488Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602549457526529:8890]
2025-10-10T14:38:47.667493Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602549457526529:8890]
2025-10-10T14:38:47.667496Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602549457526529:8890]
2025-10-10T14:38:47.667548Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:47.667553Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:47.667557Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:47.667559Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:47.667560Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:47.667565Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:47.667701Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:47.697640Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602550239766078:3900]
2025-10-10T14:38:47.697988Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 pipe creation result: OK TabletId: 72075186224037892 Generation: 2779, pipe: [1:7559602550239766078:3900]
2025-10-10T14:38:47.783695Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:47.791998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:47.792032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:47.792222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:47.792304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:47.792382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:47.792453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:47.792509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:47.792521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:47.792602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:47.792680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:47.792757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:47.792824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:47.792865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:47.792868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:47.792939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:47.792995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:47.793054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:47.793113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:47.793151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:47.793153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:47.793227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:47.793288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:47.793463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:47.793534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:47.793576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:47.793582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:47.793657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:47.793749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:47.796063Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 78 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602550239766078:3900]
2025-10-10T14:38:47.796104Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:47.796149Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:47.796152Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:47.796185Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2780 reason: error at write: Disconnected sessionId: src_id|3ea4f091-a158037b-fa5cc048-ddd46869_0
2025-10-10T14:38:47.796400Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2780 sessionId: src_id|3ea4f091-a158037b-fa5cc048-ddd46869_0 is DEAD
2025-10-10T14:38:47.793843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:47.793947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:47.793991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:47.793994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:47.794073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:47.794140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:47.794205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:47.794272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:47.794319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:47.794322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:47.794402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:47.794471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:47.794542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:47.794619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:47.794663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:47.794665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:47.794741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:47.794812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:47.794885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:47.794954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:47.794997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:47.794999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:47.795069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:47.795125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:47.795196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:47.795257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:47.795299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:47.795301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:47.795379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:47.795440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:47.795510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:47.795584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:47.795626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:47.795629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:47.795703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602550239766078:3900], now have 1 active actors on pipe
2025-10-10T14:38:47.797399Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:47.799816Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ea4f091-a158037b-fa5cc048-ddd46869_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:47.799829Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ea4f091-a158037b-fa5cc048-ddd46869_0] Write session will restart in 0.007786s
2025-10-10T14:38:47.799858Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ea4f091-a158037b-fa5cc048-ddd46869_0] Write session: Do CDS request
2025-10-10T14:38:47.799864Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ea4f091-a158037b-fa5cc048-ddd46869_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:47.809215Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3ea4f091-a158037b-fa5cc048-ddd46869_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:47.812271Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:47.812291Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2781
2025-10-10T14:38:47.812494Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2781 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:47.812557Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2781 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:47.812569Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2781 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:47.812574Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:47.813075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:47.813147Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2781 sessionId:  describe result for acl check
2025-10-10T14:38:47.813185Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:47.813193Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:47.813195Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:47.813202Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602550239766167:7330] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:47.813843Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602550239766167:7330] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:47.816680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:47.816892Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602550239766167:7330] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:47.816922Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:47.816934Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:47.816947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:47.817009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:47.817061Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602549457526656:8892]
2025-10-10T14:38:47.817748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:47.818051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:47.818101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:47.818434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:47.818495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:47.818501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:47.818503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:47.818504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:47.818505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:47.818507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:47.818508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:47.818510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:47.818511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:47.818512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:47.818514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:47.818515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:47.818516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:47.818522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:47.818536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:47.818540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:47.818545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:47.818549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:47.818554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:47.818558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:47.818563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:47.818567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:47.818572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:47.818576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:47.818580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:47.818584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:47.818592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:47.818601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:47.818608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:47.818614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:47.818629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:47.818635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:47.818639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:47.818645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:47.818649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:47.818655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:47.818660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:47.818665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:47.818671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:47.818677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:47.818682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:47.818687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:47.818692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:47.818698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:47.818702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:47.818708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:47.818717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:47.818722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:47.818726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:47.818734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:47.818738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:47.818747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:47.818788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:47.819644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602550239766167:7330] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:47.819658Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602550239766167:7330] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:47.819663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602550239766167:7330] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:47.819671Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2781 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:47.821270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:47.821612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:47.821623Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:47.821625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:47.821629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:47.821635Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2780 [2:7559602549457526656:8892]
2025-10-10T14:38:47.821648Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:47.821666Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:47.821669Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:47.821682Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:47.821685Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:47.821718Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:47.821731Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:47.821739Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:47.821806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:47.821813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:47.821815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:47.821818Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:47.821886Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:47.821893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:47.822012Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2780
2025-10-10T14:38:47.822019Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2780
2025-10-10T14:38:47.821906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:47.821922Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:47.821948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:47.821971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602550239766082:2438], now have 1 active actors on pipe
2025-10-10T14:38:47.821974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602550239766205:7330], now have 1 active actors on pipe
2025-10-10T14:38:47.821981Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602549457526650:8892]
2025-10-10T14:38:47.821983Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602549457526650:8892]
2025-10-10T14:38:47.821985Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602549457526650:8892]
2025-10-10T14:38:47.821999Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:47.822014Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:47.822021Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:47.822024Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:47.822026Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:47.822028Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:47.822031Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:47.822057Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602549457526650:8892]
2025-10-10T14:38:47.822060Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:47.822068Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:47.822080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:47.822084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:47.822136Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fc2b8d9-b8a4fe64-c840b3ab-8e17e466_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:47.822143Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:47.822147Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:47.822149Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:47.822161Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:47.822172Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:47.822189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:47.822327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:47.822331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:47.822349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:47.822446Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2781 partition: 0 MaxSeqNo: 40 sessionId: src_id|fc2b8d9-b8a4fe64-c840b3ab-8e17e466_0
2025-10-10T14:38:47.822869Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ea4f091-a158037b-fa5cc048-ddd46869_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|fc2b8d9-b8a4fe64-c840b3ab-8e17e466_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:47.825709Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fc2b8d9-b8a4fe64-c840b3ab-8e17e466_0] Write session: try to update token
2025-10-10T14:38:47.825728Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fc2b8d9-b8a4fe64-c840b3ab-8e17e466_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:47.840915Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2781 sessionId: src_id|fc2b8d9-b8a4fe64-c840b3ab-8e17e466_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:47.843634Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:47.845178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:47.845208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:47.845233Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:47.845237Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:47.845241Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:47.845244Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:47.845253Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602549457526650:8892]
2025-10-10T14:38:47.845263Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602549457526650:8892]
2025-10-10T14:38:47.845267Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602549457526650:8892]
2025-10-10T14:38:47.845354Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:47.845373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:47.845376Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:47.845429Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:47.845451Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:47.845456Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:47.845516Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:47.896292Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602550239766215:3900]
2025-10-10T14:38:47.896782Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 pipe creation result: OK TabletId: 72075186224037892 Generation: 2780, pipe: [1:7559602550239766215:3900]
2025-10-10T14:38:47.961016Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:47.961668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:38:47.961746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602550239766215:3900], now have 1 active actors on pipe
2025-10-10T14:38:47.962360Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:38:47.962455Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:47.962459Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:47.962541Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2781 reason: error at write: Disconnected sessionId: src_id|fc2b8d9-b8a4fe64-c840b3ab-8e17e466_0
2025-10-10T14:38:47.962739Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 79 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602550239766215:3900]
2025-10-10T14:38:47.962761Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:47.962775Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2781 sessionId: src_id|fc2b8d9-b8a4fe64-c840b3ab-8e17e466_0 is DEAD
2025-10-10T14:38:47.963491Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc2b8d9-b8a4fe64-c840b3ab-8e17e466_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:47.963504Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc2b8d9-b8a4fe64-c840b3ab-8e17e466_0] Write session will restart in 0.008780s
2025-10-10T14:38:47.963531Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc2b8d9-b8a4fe64-c840b3ab-8e17e466_0] Write session: Do CDS request
2025-10-10T14:38:47.963537Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc2b8d9-b8a4fe64-c840b3ab-8e17e466_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:47.973921Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fc2b8d9-b8a4fe64-c840b3ab-8e17e466_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:47.974581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:47.974771Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:47.974795Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2782
2025-10-10T14:38:47.975927Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2782 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:47.975984Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2782 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:47.975995Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2782 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:47.975999Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:47.976585Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2782 sessionId:  describe result for acl check
2025-10-10T14:38:47.976643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:47.976645Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:47.976647Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:47.976656Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602550239766303:7317] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:47.977302Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602550239766303:7317] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:47.979877Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602550239766303:7317] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:47.981131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:47.981402Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:47.981415Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:47.981427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:47.981488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:47.981532Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602549457526777:8887]
2025-10-10T14:38:47.982212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:47.982675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:47.982738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:47.983116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:47.983181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:47.983182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:47.983184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:47.983185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:47.983186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:47.983188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:47.983189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:47.983190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:47.983192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:47.983193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:47.983194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:47.983195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:47.983197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:47.983203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:47.983216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:47.983223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:47.983226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:47.983231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:47.983235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:47.983239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:47.983244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:47.983248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:47.983252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:47.983256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:47.983259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:47.983263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:47.983271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:47.983280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:47.983287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:47.983292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:47.983299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:47.983304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:47.983308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:47.983313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:47.983318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:47.983323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:47.983328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:47.983333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:47.983338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:47.983344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:47.983350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:47.983355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:47.983361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:47.983376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:47.983380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:47.983386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:47.983390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:47.983396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:47.983400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:47.983405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:47.983410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:47.983415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:47.983457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:47.983542Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602550239766303:7317] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:47.983556Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602550239766303:7317] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:47.983560Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602550239766303:7317] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:47.983570Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2782 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:47.987933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:47.988257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:47.988272Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:47.988276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:47.988280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:47.988288Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2781 [2:7559602549457526777:8887]
2025-10-10T14:38:47.988304Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:47.988323Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:47.988327Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:47.988331Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:47.988333Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:47.988351Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:47.988359Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:47.988366Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:47.988436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:47.988444Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:47.988446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:47.988448Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:47.988527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:47.988535Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:47.988549Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:47.988567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:47.988665Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2781
2025-10-10T14:38:47.988682Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2781
2025-10-10T14:38:47.988590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:47.988616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602550239766219:2438], now have 1 active actors on pipe
2025-10-10T14:38:47.988620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602550239766331:7317], now have 1 active actors on pipe
2025-10-10T14:38:47.988629Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602549457526772:8887]
2025-10-10T14:38:47.988631Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602549457526772:8887]
2025-10-10T14:38:47.988634Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602549457526772:8887]
2025-10-10T14:38:47.988651Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:47.988665Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:47.988671Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:47.988675Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:47.988677Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:47.988682Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:47.988685Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:47.988721Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602549457526772:8887]
2025-10-10T14:38:47.988728Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:47.988735Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:47.988922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:47.988936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:47.988971Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d1e4f6f6-fbec8f7b-1004ab87-c3450f4f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:47.988987Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:47.989000Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:47.989003Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:47.989017Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:47.989035Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:47.989057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:47.989266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:47.989278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:47.989301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:47.989431Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2782 partition: 0 MaxSeqNo: 40 sessionId: src_id|d1e4f6f6-fbec8f7b-1004ab87-c3450f4f_0
2025-10-10T14:38:47.989882Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc2b8d9-b8a4fe64-c840b3ab-8e17e466_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|d1e4f6f6-fbec8f7b-1004ab87-c3450f4f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:47.992667Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d1e4f6f6-fbec8f7b-1004ab87-c3450f4f_0] Write session: try to update token
2025-10-10T14:38:47.992690Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d1e4f6f6-fbec8f7b-1004ab87-c3450f4f_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:48.000927Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:38:48.000944Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:48.000956Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602549457526772:8887]
2025-10-10T14:38:48.001008Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:38:48.001076Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:38:48.001194Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:38:48.001355Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:48.001514Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:48.001650Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:48.001862Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:38:48.001909Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:38:48.009254Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2782 sessionId: src_id|d1e4f6f6-fbec8f7b-1004ab87-c3450f4f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:48.011870Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:48.012256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:48.012289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:48.012333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:38:48.012476Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:38:48.021183Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:48.021207Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:48.021210Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:48.021213Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:48.021224Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602549457526772:8887]
2025-10-10T14:38:48.021229Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602549457526772:8887]
2025-10-10T14:38:48.021233Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602549457526772:8887]
2025-10-10T14:38:48.021283Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:48.021285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:48.021293Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:48.021294Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:48.021297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:48.021297Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:48.021462Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:48.063225Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602554534733637:3900]
2025-10-10T14:38:48.063727Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 pipe creation result: OK TabletId: 72075186224037892 Generation: 2781, pipe: [1:7559602554534733637:3900]
2025-10-10T14:38:48.142034Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:48.151835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:48.151864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:48.152056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:48.152121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:48.152191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:48.152264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:48.152313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:48.152318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:48.152394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:48.152452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:48.152513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:48.152588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:48.152630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:48.152634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:48.152710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:48.152773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:48.152840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:48.152906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:48.152952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:48.152955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:48.153032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:48.153096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:48.153164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:48.153229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:48.153273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:48.153276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:48.153378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:48.153446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:48.153510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:48.153577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:48.153622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:48.153638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:48.153733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:48.153797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:48.153859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:48.153934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:48.153982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:48.153989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:48.154066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:48.154125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:48.154193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:48.154267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:48.154311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:48.154317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:48.154391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:48.154449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:48.154510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:48.154573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:48.154622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:48.154625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:48.154697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:48.154754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:48.154817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:48.154879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:48.154924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:48.154927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:48.155003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:48.155061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:48.155123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:48.155183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:48.155227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:48.155230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:48.155318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602554534733637:3900], now have 1 active actors on pipe
2025-10-10T14:38:48.156894Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:48.160405Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 80 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602554534733637:3900]
2025-10-10T14:38:48.160407Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:48.160412Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:48.160443Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:48.160449Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2782 reason: error at write: Disconnected sessionId: src_id|d1e4f6f6-fbec8f7b-1004ab87-c3450f4f_0
2025-10-10T14:38:48.160708Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2782 sessionId: src_id|d1e4f6f6-fbec8f7b-1004ab87-c3450f4f_0 is DEAD
2025-10-10T14:38:48.160911Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1e4f6f6-fbec8f7b-1004ab87-c3450f4f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:48.160921Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1e4f6f6-fbec8f7b-1004ab87-c3450f4f_0] Write session will restart in 0.005934s
2025-10-10T14:38:48.160948Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1e4f6f6-fbec8f7b-1004ab87-c3450f4f_0] Write session: Do CDS request
2025-10-10T14:38:48.160955Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1e4f6f6-fbec8f7b-1004ab87-c3450f4f_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:48.167908Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d1e4f6f6-fbec8f7b-1004ab87-c3450f4f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:48.169760Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:48.169797Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2783
2025-10-10T14:38:48.169948Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2783 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:48.169990Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2783 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:48.170002Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2783 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:48.170006Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:48.170542Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2783 sessionId:  describe result for acl check
2025-10-10T14:38:48.170584Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:48.170591Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:48.170594Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:48.170601Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602554534733656:7306] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:48.171194Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602554534733656:7306] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:48.174759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602554534733656:7306] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:48.177297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:48.179777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:48.180046Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:48.180061Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:48.180075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:48.180151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:48.180149Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602554534733656:7306] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:48.180200Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602553752494197:8879]
2025-10-10T14:38:48.180170Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602554534733656:7306] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:48.180173Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602554534733656:7306] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:48.180183Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2783 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:48.180837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:48.181194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:48.181261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:48.181637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:48.181717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:48.181724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:48.181726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:48.181727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:48.181729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:48.181731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:48.181732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:48.181734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:48.181735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:48.181737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:48.181738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:48.181739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:48.181741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:48.181748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:48.181763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:48.181768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:48.181773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:48.181778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:48.181783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:48.181787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:48.181792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:48.181797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:48.181801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:48.181806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:48.181821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:48.181826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:48.181834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:48.181843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:48.181856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:48.181863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:48.181870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:48.181876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:48.181881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:48.181887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:48.181892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:48.181899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:48.181903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:48.181910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:48.181915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:48.181920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:48.181931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:48.181937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:48.181942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:48.181947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:48.181951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:48.181964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:48.181974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:48.181980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:48.181985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:48.181991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:48.181996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:48.182014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:48.182060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:48.184626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:48.185220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:48.185232Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:48.185235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:48.185240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:48.185247Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2782 [2:7559602553752494197:8879]
2025-10-10T14:38:48.185260Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:48.185279Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:48.185290Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:48.185295Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:48.185297Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:48.185316Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:48.185346Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:48.185355Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:48.185418Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:48.185427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:48.185429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:48.185432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:48.185613Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2782
2025-10-10T14:38:48.185614Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2782
2025-10-10T14:38:48.185501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:48.185510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:48.185521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:48.185533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:48.185551Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:48.185573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602554534733640:2438], now have 1 active actors on pipe
2025-10-10T14:38:48.185577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602554534733754:7306], now have 1 active actors on pipe
2025-10-10T14:38:48.185586Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602553752494192:8879]
2025-10-10T14:38:48.185588Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602553752494192:8879]
2025-10-10T14:38:48.185591Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602553752494192:8879]
2025-10-10T14:38:48.185605Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:48.185622Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:48.185625Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:48.185627Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:48.185629Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:48.185641Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:48.185644Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:48.185704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:48.185709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:48.185725Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602553752494192:8879]
2025-10-10T14:38:48.185733Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:48.185747Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:48.185767Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4bd3fee2-5eef7682-c7ad3b6-9f488852_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:48.185775Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:48.185780Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:48.185782Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:48.185793Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:48.185804Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:48.185827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:48.186150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:48.186164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:48.186188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:48.186310Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2783 partition: 0 MaxSeqNo: 40 sessionId: src_id|4bd3fee2-5eef7682-c7ad3b6-9f488852_0
2025-10-10T14:38:48.186837Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1e4f6f6-fbec8f7b-1004ab87-c3450f4f_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|4bd3fee2-5eef7682-c7ad3b6-9f488852_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:48.189656Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4bd3fee2-5eef7682-c7ad3b6-9f488852_0] Write session: try to update token
2025-10-10T14:38:48.189689Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4bd3fee2-5eef7682-c7ad3b6-9f488852_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:48.206356Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2783 sessionId: src_id|4bd3fee2-5eef7682-c7ad3b6-9f488852_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:48.209131Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:48.209373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:48.209396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:48.209439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:38:48.209537Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:38:48.212472Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:48.212490Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:48.212493Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:48.212495Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:48.212506Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602553752494192:8879]
2025-10-10T14:38:48.212511Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602553752494192:8879]
2025-10-10T14:38:48.212515Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602553752494192:8879]
2025-10-10T14:38:48.212566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:48.212570Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:48.212578Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:48.212583Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:48.212584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:48.212587Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:48.212731Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:48.260814Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602554534733766:3900]
2025-10-10T14:38:48.261095Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 pipe creation result: OK TabletId: 72075186224037892 Generation: 2782, pipe: [1:7559602554534733766:3900]
2025-10-10T14:38:48.331576Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:48.340207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:48.340236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:48.340438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:48.340522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:48.340606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:48.340688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:48.340740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:48.340751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:48.340833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:48.340903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:48.340973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:48.341047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:48.341096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:48.341107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:48.341184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:48.341258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:48.341355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:48.341433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:48.341481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:48.341491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:48.341575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:48.341640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:48.341723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:48.341791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:48.341836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:48.341843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:48.341907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:48.341969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:48.342032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:48.342104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:48.342149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:48.342156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:48.342225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:48.342289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:48.342352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:48.342416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:48.342465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:48.342473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:48.342541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:48.342608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:48.342679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:48.342747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:48.342794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:48.342801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:48.342874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:48.342943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:48.343003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:48.343068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:48.343110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:48.343113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:48.343183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:48.343242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:48.343308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:48.343376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:48.343423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:48.343425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:48.343497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:48.343558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:48.343618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:48.343677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:48.343723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:48.343726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:48.343813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602554534733766:3900], now have 1 active actors on pipe
2025-10-10T14:38:48.344574Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4bd3fee2-5eef7682-c7ad3b6-9f488852_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:48.344098Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:48.344586Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4bd3fee2-5eef7682-c7ad3b6-9f488852_0] Write session will restart in 0.005848s
2025-10-10T14:38:48.344157Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:48.344160Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:48.344193Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2783 reason: error at write: Disconnected sessionId: src_id|4bd3fee2-5eef7682-c7ad3b6-9f488852_0
2025-10-10T14:38:48.344206Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 81 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602554534733766:3900]
2025-10-10T14:38:48.344408Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2783 sessionId: src_id|4bd3fee2-5eef7682-c7ad3b6-9f488852_0 is DEAD
2025-10-10T14:38:48.344626Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4bd3fee2-5eef7682-c7ad3b6-9f488852_0] Write session: Do CDS request
2025-10-10T14:38:48.344633Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4bd3fee2-5eef7682-c7ad3b6-9f488852_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:48.345072Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:48.351924Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4bd3fee2-5eef7682-c7ad3b6-9f488852_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:48.352035Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:48.352056Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2784
2025-10-10T14:38:48.352749Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2784 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:48.352810Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2784 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:48.352820Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2784 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:48.352824Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:48.353369Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2784 sessionId:  describe result for acl check
2025-10-10T14:38:48.353414Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:48.353416Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:48.353418Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:48.353436Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602554534733784:7290] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:48.354044Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602554534733784:7290] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:48.358323Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602554534733784:7290] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:48.361085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:48.364540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:48.364745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602554534733784:7290] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:48.364764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602554534733784:7290] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:48.364768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602554534733784:7290] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:48.364779Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2784 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:48.364789Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:48.364804Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:48.364819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:48.364890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:48.364940Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602553752494323:8880]
2025-10-10T14:38:48.365601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:48.365966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:48.366023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:48.366366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:48.366436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:48.366444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:48.366445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:48.366447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:48.366448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:48.366450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:48.366451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:48.366452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:48.366454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:48.366455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:48.366456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:48.366458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:48.366459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:48.366466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:48.366482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:48.366487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:48.366491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:48.366495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:48.366500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:48.366504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:48.366508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:48.366512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:48.366516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:48.366520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:48.366524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:48.366529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:48.366538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:48.366547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:48.366554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:48.366561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:48.366565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:48.366571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:48.366575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:48.366581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:48.366586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:48.366591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:48.366604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:48.366610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:48.366619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:48.366625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:48.366629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:48.366640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:48.366644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:48.366650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:48.366658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:48.366664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:48.366669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:48.366674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:48.366678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:48.366684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:48.366694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:48.366699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:48.366764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:48.369262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:48.369596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:48.369611Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:48.369614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:48.369618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:48.369625Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2783 [2:7559602553752494323:8880]
2025-10-10T14:38:48.369637Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:48.369654Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:48.369658Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:48.369671Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:48.369674Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:48.369691Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:48.369699Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:48.369707Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:48.369767Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:48.369777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:48.369778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:48.369781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:48.369850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:48.369857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:48.369870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:48.369886Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:48.369908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:48.369947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602554534733769:2438], now have 1 active actors on pipe
2025-10-10T14:38:48.369955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602554534733885:7290], now have 1 active actors on pipe
2025-10-10T14:38:48.369963Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602553752494318:8880]
2025-10-10T14:38:48.369969Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602553752494318:8880]
2025-10-10T14:38:48.369971Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602553752494318:8880]
2025-10-10T14:38:48.369984Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:48.369999Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:48.370002Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:48.370009Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:48.370012Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:48.370020Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:48.370023Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:48.370018Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2783
2025-10-10T14:38:48.370049Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602553752494318:8880]
2025-10-10T14:38:48.370042Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2783
2025-10-10T14:38:48.370057Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:48.370060Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:48.370076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:48.370083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:48.370143Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9e88d1bd-b972d377-d5267af6-2678ad29_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:48.370155Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:48.370164Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:48.370166Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:48.370178Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:48.370189Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:48.370212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:48.370382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:48.370400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:48.370425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:48.370552Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2784 partition: 0 MaxSeqNo: 40 sessionId: src_id|9e88d1bd-b972d377-d5267af6-2678ad29_0
2025-10-10T14:38:48.370987Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4bd3fee2-5eef7682-c7ad3b6-9f488852_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|9e88d1bd-b972d377-d5267af6-2678ad29_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:48.373995Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9e88d1bd-b972d377-d5267af6-2678ad29_0] Write session: try to update token
2025-10-10T14:38:48.374015Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9e88d1bd-b972d377-d5267af6-2678ad29_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:48.389357Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2784 sessionId: src_id|9e88d1bd-b972d377-d5267af6-2678ad29_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:48.391981Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:48.393163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:48.393192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:48.393217Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:48.393220Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:48.393229Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:48.393231Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:48.393239Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602553752494318:8880]
2025-10-10T14:38:48.393244Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602553752494318:8880]
2025-10-10T14:38:48.393247Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602553752494318:8880]
2025-10-10T14:38:48.393295Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:48.393311Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:48.393315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:48.393315Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:48.393324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:48.393327Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:48.393477Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:48.444636Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602554534733896:3900]
2025-10-10T14:38:48.445016Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 pipe creation result: OK TabletId: 72075186224037892 Generation: 2783, pipe: [1:7559602554534733896:3900]
2025-10-10T14:38:48.516748Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:48.518757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:38:48.518835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602554534733896:3900], now have 1 active actors on pipe
2025-10-10T14:38:48.519074Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:38:48.519180Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:48.519183Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:48.519262Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2784 reason: error at write: Disconnected sessionId: src_id|9e88d1bd-b972d377-d5267af6-2678ad29_0
2025-10-10T14:38:48.519431Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2784 sessionId: src_id|9e88d1bd-b972d377-d5267af6-2678ad29_0 is DEAD
2025-10-10T14:38:48.519618Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 82 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602554534733896:3900]
2025-10-10T14:38:48.519633Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:48.521781Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e88d1bd-b972d377-d5267af6-2678ad29_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:48.521792Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e88d1bd-b972d377-d5267af6-2678ad29_0] Write session will restart in 0.007218s
2025-10-10T14:38:48.521818Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e88d1bd-b972d377-d5267af6-2678ad29_0] Write session: Do CDS request
2025-10-10T14:38:48.521825Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e88d1bd-b972d377-d5267af6-2678ad29_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:48.531900Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9e88d1bd-b972d377-d5267af6-2678ad29_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:48.532001Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:48.532017Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2785
2025-10-10T14:38:48.534009Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2785 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:48.534053Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2785 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:48.534058Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2785 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:48.534063Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:48.534499Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2785 sessionId:  describe result for acl check
2025-10-10T14:38:48.534548Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:48.534551Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:48.534554Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:48.534562Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602554534734000:7262] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:48.535279Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602554534734000:7262] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:48.536944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:48.538383Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602554534734000:7262] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:48.540598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:48.540857Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:48.540871Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:48.540886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:48.540973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:48.541038Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602553752494498:8849]
2025-10-10T14:38:48.541529Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602554534734000:7262] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:48.541546Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602554534734000:7262] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:48.541550Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602554534734000:7262] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:48.541559Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2785 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:48.541707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:48.542031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:48.542099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:48.542449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:48.542526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:48.542535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:48.542536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:48.542537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:48.542539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:48.542540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:48.542541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:48.542543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:48.542544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:48.542546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:48.542547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:48.542548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:48.542550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:48.542557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:48.542571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:48.542576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:48.542581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:48.542585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:48.542590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:48.542594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:48.542598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:48.542602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:48.542607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:48.542611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:48.542615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:48.542619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:48.542628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:48.542637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:48.542646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:48.542652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:48.542658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:48.542664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:48.542669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:48.542675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:48.542686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:48.542692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:48.542698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:48.542704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:48.542713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:48.542719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:48.542724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:48.542735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:48.542740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:48.542751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:48.542762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:48.542767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:48.542776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:48.542782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:48.542792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:48.542798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:48.542807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:48.542813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:48.542861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:48.545359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:48.545712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:48.545727Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:48.545730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:48.545734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:48.545741Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2784 [2:7559602553752494498:8849]
2025-10-10T14:38:48.545756Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:48.545773Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:48.545782Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:48.545786Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:48.545789Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:48.545806Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:48.545820Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:48.545833Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:48.545890Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:48.545892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:48.545895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:48.545897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:48.546115Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2784
2025-10-10T14:38:48.546120Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2784
2025-10-10T14:38:48.546405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:48.546421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:48.546436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:48.546450Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:48.546471Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:48.546497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602554534734040:7262], now have 1 active actors on pipe
2025-10-10T14:38:48.546501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602554534733911:2438], now have 1 active actors on pipe
2025-10-10T14:38:48.546521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:48.546526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:48.546549Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602553752494486:8849]
2025-10-10T14:38:48.546551Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602553752494486:8849]
2025-10-10T14:38:48.546554Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602553752494486:8849]
2025-10-10T14:38:48.546570Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:48.546587Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:48.546589Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:48.546593Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:48.546595Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:48.546606Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:48.546609Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:48.546632Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|27f55f5-42234619-e63e1b61-9fce0d87_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:48.546640Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:48.546644Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:48.546646Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:48.546660Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:48.546672Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:48.546699Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602553752494486:8849]
2025-10-10T14:38:48.546708Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:48.546714Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:48.546720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:48.546905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:48.546913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:48.546932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:48.547205Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2785 partition: 0 MaxSeqNo: 40 sessionId: src_id|27f55f5-42234619-e63e1b61-9fce0d87_0
2025-10-10T14:38:48.547664Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e88d1bd-b972d377-d5267af6-2678ad29_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|27f55f5-42234619-e63e1b61-9fce0d87_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:48.550689Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|27f55f5-42234619-e63e1b61-9fce0d87_0] Write session: try to update token
2025-10-10T14:38:48.550712Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|27f55f5-42234619-e63e1b61-9fce0d87_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:48.565077Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:38:48.565099Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:48.565111Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602553752494486:8849]
2025-10-10T14:38:48.565166Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:38:48.565387Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:38:48.565538Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:48.565706Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:48.565860Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:48.566070Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:38:48.566112Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:38:48.566278Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:38:48.569388Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2785 sessionId: src_id|27f55f5-42234619-e63e1b61-9fce0d87_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:48.572247Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:48.572952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:48.572975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:48.573019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:38:48.573305Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:38:48.584772Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:48.584793Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:48.584796Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:48.584799Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:48.584811Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602553752494486:8849]
2025-10-10T14:38:48.584816Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602553752494486:8849]
2025-10-10T14:38:48.584821Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602553752494486:8849]
2025-10-10T14:38:48.584876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:48.584879Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:48.584885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:48.584887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:48.584890Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:48.584895Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:48.585029Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:48.619231Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602554534734063:3900]
2025-10-10T14:38:48.619503Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 pipe creation result: OK TabletId: 72075186224037892 Generation: 2784, pipe: [1:7559602554534734063:3900]
2025-10-10T14:38:48.712692Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:48.722076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:48.722110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:48.722311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:48.722372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:48.722434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:48.722499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:48.722542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:48.722548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:48.722623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:48.722684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:48.722747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:48.722817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:48.722864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:48.722867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:48.722942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:48.723000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:48.723064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:48.723132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:48.723176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:48.723179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:48.723247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:48.723307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:48.723372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:48.723434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:48.723476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:48.723480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:48.723550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:48.723634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:48.723700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:48.723763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:48.723814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:48.723817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:48.723889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:48.723969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:48.724033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:48.724097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:48.724140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:48.724143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:48.724217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:48.724278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:48.724617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:48.724691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:48.724737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:48.724745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:48.724817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:48.724880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:48.724946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:48.725015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:48.725063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:48.725073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:48.725146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:48.725210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:48.725276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:48.725449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:48.725498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:48.725506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:48.725573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:48.725642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:48.725721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:48.725789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:48.725836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:48.725845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:48.725912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602554534734063:3900], now have 1 active actors on pipe
2025-10-10T14:38:48.726594Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 83 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602554534734063:3900]
2025-10-10T14:38:48.726607Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:48.726612Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:48.726638Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:48.726645Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2785 reason: error at write: Disconnected sessionId: src_id|27f55f5-42234619-e63e1b61-9fce0d87_0
2025-10-10T14:38:48.726874Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2785 sessionId: src_id|27f55f5-42234619-e63e1b61-9fce0d87_0 is DEAD
2025-10-10T14:38:48.727134Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|27f55f5-42234619-e63e1b61-9fce0d87_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:48.727146Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|27f55f5-42234619-e63e1b61-9fce0d87_0] Write session will restart in 0.006533s
2025-10-10T14:38:48.727174Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|27f55f5-42234619-e63e1b61-9fce0d87_0] Write session: Do CDS request
2025-10-10T14:38:48.727180Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|27f55f5-42234619-e63e1b61-9fce0d87_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:48.727405Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:48.735758Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|27f55f5-42234619-e63e1b61-9fce0d87_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:48.735900Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:48.735920Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2786
2025-10-10T14:38:48.736091Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2786 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:48.736136Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2786 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:48.736143Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2786 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:48.736147Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:48.736679Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2786 sessionId:  describe result for acl check
2025-10-10T14:38:48.736727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:48.736734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:48.736736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:48.736744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602554534734078:7227] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:48.737279Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602554534734078:7227] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:48.740686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602554534734078:7227] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:48.750879Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602554534734078:7227] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:48.750914Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602554534734078:7227] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:48.750920Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602554534734078:7227] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:48.750934Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2786 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:48.752483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:48.761538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:48.761872Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:48.761886Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:48.761899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:48.761965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:48.762037Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602553752494626:8833]
2025-10-10T14:38:48.762650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:48.763072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:48.763132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:48.763471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:48.763542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:48.763553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:48.763554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:48.763556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:48.763557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:48.763559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:48.763560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:48.763561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:48.763562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:48.763564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:48.763565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:48.763566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:48.763567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:48.763575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:48.763589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:48.763594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:48.763599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:48.763603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:48.763607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:48.763611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:48.763616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:48.763620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:48.763624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:48.763627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:48.763630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:48.763634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:48.763643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:48.763653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:48.763659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:48.763666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:48.763674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:48.763680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:48.763686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:48.763691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:48.763697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:48.763703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:48.763708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:48.763713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:48.763719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:48.763724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:48.763729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:48.763735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:48.763740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:48.763746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:48.763753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:48.763758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:48.763767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:48.763773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:48.763777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:48.763782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:48.763787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:48.763793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:48.763846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:48.766618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:48.767155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:48.767166Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:48.767169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:48.767174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:48.767181Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2785 [2:7559602553752494626:8833]
2025-10-10T14:38:48.767196Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:48.767219Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:48.767227Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:48.767231Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:48.767234Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:48.767252Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:48.767265Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:48.767273Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:48.767340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:48.767347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:48.767349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:48.767352Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:48.767427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:48.767436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:48.767448Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:48.767459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:48.767474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:48.767497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602554534734066:2438], now have 1 active actors on pipe
2025-10-10T14:38:48.767504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602554534734181:7227], now have 1 active actors on pipe
2025-10-10T14:38:48.767510Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602553752494620:8833]
2025-10-10T14:38:48.767512Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602553752494620:8833]
2025-10-10T14:38:48.767514Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602553752494620:8833]
2025-10-10T14:38:48.767524Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:48.767536Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:48.767544Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:48.767547Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:48.767550Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:48.767563Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:48.767566Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:48.767581Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602553752494620:8833]
2025-10-10T14:38:48.767583Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:48.767593Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:48.767706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:48.767720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:48.767753Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d9b3794d-6942f0ad-afd774f4-b32caf23_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:48.767763Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:48.767767Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:48.767771Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:48.767783Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:48.767797Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:48.767813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:48.767970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:48.767977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:48.767993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:48.768555Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|27f55f5-42234619-e63e1b61-9fce0d87_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|d9b3794d-6942f0ad-afd774f4-b32caf23_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:48.767567Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2785
2025-10-10T14:38:48.767606Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2785
2025-10-10T14:38:48.768108Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2786 partition: 0 MaxSeqNo: 40 sessionId: src_id|d9b3794d-6942f0ad-afd774f4-b32caf23_0
2025-10-10T14:38:48.771438Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d9b3794d-6942f0ad-afd774f4-b32caf23_0] Write session: try to update token
2025-10-10T14:38:48.771458Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d9b3794d-6942f0ad-afd774f4-b32caf23_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:48.789433Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:48.789456Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:48.789461Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:48.789463Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:48.789475Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602553752494620:8833]
2025-10-10T14:38:48.789479Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602553752494620:8833]
2025-10-10T14:38:48.789487Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602553752494620:8833]
2025-10-10T14:38:48.789541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:48.789540Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:48.789547Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:48.789549Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:48.789551Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:48.789560Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:48.789754Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:48.790831Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2786 sessionId: src_id|d9b3794d-6942f0ad-afd774f4-b32caf23_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:48.793820Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:48.826591Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602554534734201:3900]
2025-10-10T14:38:48.826960Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 pipe creation result: OK TabletId: 72075186224037892 Generation: 2785, pipe: [1:7559602554534734201:3900]
2025-10-10T14:38:48.906985Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:48.907642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:48.907666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:48.907719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602554534734201:3900], now have 1 active actors on pipe
2025-10-10T14:38:48.907956Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:48.908008Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 84 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602554534734201:3900]
2025-10-10T14:38:48.908020Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:48.908049Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:38:48.908129Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2786 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d9b3794d-6942f0ad-afd774f4-b32caf23_0
2025-10-10T14:38:48.908358Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2786 sessionId: src_id|d9b3794d-6942f0ad-afd774f4-b32caf23_0 is DEAD
2025-10-10T14:38:48.908485Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9b3794d-6942f0ad-afd774f4-b32caf23_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:38:48.908495Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9b3794d-6942f0ad-afd774f4-b32caf23_0] Write session will restart in 0.007071s
2025-10-10T14:38:48.908521Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9b3794d-6942f0ad-afd774f4-b32caf23_0] Write session: Do CDS request
2025-10-10T14:38:48.908538Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9b3794d-6942f0ad-afd774f4-b32caf23_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:48.916920Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d9b3794d-6942f0ad-afd774f4-b32caf23_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:48.917055Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:48.917076Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2787
2025-10-10T14:38:48.917213Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2787 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:48.917250Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2787 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:48.917272Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2787 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:48.917280Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:48.917797Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2787 sessionId:  describe result for acl check
2025-10-10T14:38:48.917836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:48.917843Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:48.917845Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:48.917852Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602554534734219:7195] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:48.918453Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602554534734219:7195] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:48.920994Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602554534734219:7195] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:48.926053Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602554534734219:7195] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:48.926072Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602554534734219:7195] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:48.926076Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602554534734219:7195] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:48.926086Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2787 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:48.929300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:48.933299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:48.933580Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:48.933594Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:48.933607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:48.933683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:48.933732Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602553752494753:8825]
2025-10-10T14:38:48.934379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:48.934785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:48.934875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:48.935349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:48.935487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:48.935498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:48.935499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:48.935500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:48.935501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:48.935503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:48.935504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:48.935506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:48.935507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:48.935509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:48.935510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:48.935512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:48.935513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:48.935521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:48.935551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:48.935557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:48.935561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:48.935566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:48.935570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:48.935576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:48.935580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:48.935585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:48.935590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:48.935594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:48.935599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:48.935604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:48.935620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:48.935639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:48.935655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:48.935671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:48.935677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:48.935682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:48.935687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:48.935695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:48.935705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:48.935711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:48.935722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:48.935728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:48.935734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:48.935744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:48.935756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:48.935761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:48.935774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:48.935781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:48.935794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:48.935799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:48.935811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:48.935817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:48.935827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:48.935834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:48.935847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:48.935858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:48.935903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:48.938623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:48.939011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:48.939024Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:48.939026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:48.939031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:48.939038Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2786 [2:7559602553752494753:8825]
2025-10-10T14:38:48.939052Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:48.939072Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:48.939080Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:48.939084Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:48.939087Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:48.939108Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:48.939124Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:48.939140Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:48.939211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:48.939218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:48.939221Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:48.939223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:48.939293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:48.939305Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:48.939318Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:48.939329Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:48.939345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:48.939373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602554534734206:2438], now have 1 active actors on pipe
2025-10-10T14:38:48.939382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602554534734305:7195], now have 1 active actors on pipe
2025-10-10T14:38:48.939392Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602553752494748:8825]
2025-10-10T14:38:48.939395Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602553752494748:8825]
2025-10-10T14:38:48.939397Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602553752494748:8825]
2025-10-10T14:38:48.939413Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:48.939428Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:48.939431Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:48.939438Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:48.939449Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:48.939464Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:48.939472Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:48.939452Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2786
2025-10-10T14:38:48.939470Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2786
2025-10-10T14:38:48.939504Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602553752494748:8825]
2025-10-10T14:38:48.939517Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:48.939535Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:48.939665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:48.939676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:48.939707Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bf2c4f9f-df4c58c0-4ddbdd82-9b36f128_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:48.939720Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:48.939729Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:48.939732Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:48.939744Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:48.939755Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:48.939778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:48.939935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:48.939941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:48.939955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:48.940082Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2787 partition: 0 MaxSeqNo: 40 sessionId: src_id|bf2c4f9f-df4c58c0-4ddbdd82-9b36f128_0
2025-10-10T14:38:48.940515Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9b3794d-6942f0ad-afd774f4-b32caf23_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|bf2c4f9f-df4c58c0-4ddbdd82-9b36f128_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:48.943523Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bf2c4f9f-df4c58c0-4ddbdd82-9b36f128_0] Write session: try to update token
2025-10-10T14:38:48.943548Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bf2c4f9f-df4c58c0-4ddbdd82-9b36f128_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:48.960250Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2787 sessionId: src_id|bf2c4f9f-df4c58c0-4ddbdd82-9b36f128_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:48.960476Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:48.960496Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:48.960499Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:48.960501Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:48.960511Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602553752494748:8825]
2025-10-10T14:38:48.960515Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602553752494748:8825]
2025-10-10T14:38:48.960520Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602553752494748:8825]
2025-10-10T14:38:48.960568Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:48.960581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:48.960583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:48.960728Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:48.963221Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:48.963440Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:48.963455Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:48.963459Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:49.008352Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602558829701633:3900]
2025-10-10T14:38:49.009239Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 pipe creation result: OK TabletId: 72075186224037892 Generation: 2786, pipe: [1:7559602558829701633:3900]
2025-10-10T14:38:49.077296Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:49.080406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:49.080438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:49.080491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602558829701633:3900], now have 1 active actors on pipe
2025-10-10T14:38:49.080790Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:49.080773Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:49.080820Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 85 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602558829701633:3900]
2025-10-10T14:38:49.081256Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bf2c4f9f-df4c58c0-4ddbdd82-9b36f128_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:49.081266Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bf2c4f9f-df4c58c0-4ddbdd82-9b36f128_0] Write session will restart in 0.007178s
2025-10-10T14:38:49.081293Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bf2c4f9f-df4c58c0-4ddbdd82-9b36f128_0] Write session: Do CDS request
2025-10-10T14:38:49.081302Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bf2c4f9f-df4c58c0-4ddbdd82-9b36f128_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:49.080837Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:49.080844Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:49.080908Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2787 reason: error at write: Disconnected sessionId: src_id|bf2c4f9f-df4c58c0-4ddbdd82-9b36f128_0
2025-10-10T14:38:49.081078Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2787 sessionId: src_id|bf2c4f9f-df4c58c0-4ddbdd82-9b36f128_0 is DEAD
2025-10-10T14:38:49.089870Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bf2c4f9f-df4c58c0-4ddbdd82-9b36f128_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:49.089942Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:49.089962Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2788
2025-10-10T14:38:49.090112Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2788 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:49.090153Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2788 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:49.090161Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2788 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:49.090165Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:49.090609Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2788 sessionId:  describe result for acl check
2025-10-10T14:38:49.090651Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:49.090655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:49.090657Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:49.090663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602558829701651:7173] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:49.091271Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602558829701651:7173] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:49.094173Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602558829701651:7173] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:49.096030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:49.099162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:49.099419Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:49.099431Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:49.099444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:49.099506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:49.099550Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602558047462176:8829]
2025-10-10T14:38:49.099579Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602558829701651:7173] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:49.099597Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602558829701651:7173] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:49.099602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602558829701651:7173] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:49.099611Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2788 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:49.100194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:49.100533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:49.100584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:49.100921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:49.100982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:49.100988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:49.100990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:49.100991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:49.100992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:49.100994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:49.100995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:49.100996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:49.100997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:49.100999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:49.101000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:49.101002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:49.101003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:49.101009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:49.101024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:49.101028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:49.101032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:49.101036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:49.101040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:49.101045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:49.101049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:49.101053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:49.101058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:49.101063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:49.101067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:49.101071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:49.101080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:49.101089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:49.101095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:49.101106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:49.101115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:49.101125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:49.101134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:49.101145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:49.101154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:49.101164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:49.101172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:49.101182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:49.101191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:49.101201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:49.101210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:49.101219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:49.101224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:49.101234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:49.101238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:49.101244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:49.101254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:49.101260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:49.101268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:49.101275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:49.101283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:49.101289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:49.101350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:49.104948Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2787
2025-10-10T14:38:49.104964Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2787
2025-10-10T14:38:49.106338Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bf2c4f9f-df4c58c0-4ddbdd82-9b36f128_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|39bc1881-2bc14059-5f24f937-e536b5d6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:49.104113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:49.104564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:49.104569Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:49.104572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:49.104576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:49.104583Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2787 [2:7559602558047462176:8829]
2025-10-10T14:38:49.104596Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:49.104616Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:49.104619Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:49.104622Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:49.104625Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:49.104641Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:49.104650Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:49.104658Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:49.104716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:49.104718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:49.104722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:49.104725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:49.104801Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:49.104804Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:49.104816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:49.104829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:49.104847Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:49.104870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602558829701634:2438], now have 1 active actors on pipe
2025-10-10T14:38:49.104874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602558829701754:7173], now have 1 active actors on pipe
2025-10-10T14:38:49.104882Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602558047462171:8829]
2025-10-10T14:38:49.104885Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602558047462171:8829]
2025-10-10T14:38:49.104887Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602558047462171:8829]
2025-10-10T14:38:49.104901Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:49.104917Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:49.104919Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:49.104925Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:49.104935Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:49.104938Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:49.104939Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:49.104963Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602558047462171:8829]
2025-10-10T14:38:49.104966Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:49.104968Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:49.105220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:49.105226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:49.105255Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|39bc1881-2bc14059-5f24f937-e536b5d6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:49.105263Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:49.105267Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:49.105270Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:49.105281Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:49.105291Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:49.105305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:49.105591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:49.105594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:49.105609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:49.109215Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|39bc1881-2bc14059-5f24f937-e536b5d6_0] Write session: try to update token
2025-10-10T14:38:49.109237Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|39bc1881-2bc14059-5f24f937-e536b5d6_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:49.105747Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2788 partition: 0 MaxSeqNo: 40 sessionId: src_id|39bc1881-2bc14059-5f24f937-e536b5d6_0
2025-10-10T14:38:49.127863Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:49.127892Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:49.127896Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:49.127898Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:49.127910Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602558047462171:8829]
2025-10-10T14:38:49.127916Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602558047462171:8829]
2025-10-10T14:38:49.127920Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602558047462171:8829]
2025-10-10T14:38:49.127974Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:49.127979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:49.127981Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:49.127986Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:49.127988Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:49.127991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:49.128141Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:49.130026Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2788 sessionId: src_id|39bc1881-2bc14059-5f24f937-e536b5d6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:49.132864Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:49.180895Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602558829701767:3900]
2025-10-10T14:38:49.181230Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 pipe creation result: OK TabletId: 72075186224037892 Generation: 2787, pipe: [1:7559602558829701767:3900]
2025-10-10T14:38:49.253773Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:49.254521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:49.254533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:49.254595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602558829701767:3900], now have 1 active actors on pipe
2025-10-10T14:38:49.255307Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 86 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602558829701767:3900]
2025-10-10T14:38:49.255348Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:49.255351Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:49.255412Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2788 reason: error at write: Disconnected sessionId: src_id|39bc1881-2bc14059-5f24f937-e536b5d6_0
2025-10-10T14:38:49.255609Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2788 sessionId: src_id|39bc1881-2bc14059-5f24f937-e536b5d6_0 is DEAD
2025-10-10T14:38:49.255743Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:49.255994Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39bc1881-2bc14059-5f24f937-e536b5d6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:49.256006Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39bc1881-2bc14059-5f24f937-e536b5d6_0] Write session will restart in 0.005812s
2025-10-10T14:38:49.256041Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39bc1881-2bc14059-5f24f937-e536b5d6_0] Write session: Do CDS request
2025-10-10T14:38:49.256048Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39bc1881-2bc14059-5f24f937-e536b5d6_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:49.256272Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:49.262965Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|39bc1881-2bc14059-5f24f937-e536b5d6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:49.265490Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:49.265509Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2789
2025-10-10T14:38:49.265687Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2789 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:49.265743Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2789 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:49.265756Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2789 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:49.265761Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:49.266271Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2789 sessionId:  describe result for acl check
2025-10-10T14:38:49.266313Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:49.266320Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:49.266322Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:49.266329Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602558829701786:7152] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:49.266969Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602558829701786:7152] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:49.269849Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602558829701786:7152] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:49.271833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:49.275269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:49.275483Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602558829701786:7152] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:49.275504Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602558829701786:7152] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:49.275507Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602558829701786:7152] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:49.275517Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2789 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:49.275522Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:49.275535Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:49.275550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:49.275620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:49.275671Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602558047462307:8822]
2025-10-10T14:38:49.276344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:49.276696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:49.276764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:49.277136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:49.277230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:49.277241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:49.277242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:49.277243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:49.277244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:49.277245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:49.277246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:49.277248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:49.277249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:49.277250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:49.277252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:49.277253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:49.277254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:49.277261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:49.277275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:49.277280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:49.277284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:49.277288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:49.277293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:49.277297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:49.277302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:49.277306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:49.277310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:49.277314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:49.277318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:49.277322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:49.277362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:49.277373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:49.277380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:49.277387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:49.277392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:49.277398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:49.277402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:49.277408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:49.277414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:49.277419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:49.277424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:49.277429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:49.277435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:49.277441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:49.277445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:49.277462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:49.277467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:49.277473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:49.277477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:49.277483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:49.277490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:49.277495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:49.277500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:49.277505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:49.277510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:49.277515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:49.277556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:49.280509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:49.281179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:49.281196Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:49.281198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:49.281202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:49.281209Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2788 [2:7559602558047462307:8822]
2025-10-10T14:38:49.281224Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:49.281253Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:49.281259Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:49.281263Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:49.281265Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:49.281283Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:49.281297Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:49.281312Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:49.281418Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:49.281427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:49.281428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:49.281431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:49.281499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:49.281509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:49.281522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:49.281534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:49.281551Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:49.281574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602558829701768:2438], now have 1 active actors on pipe
2025-10-10T14:38:49.281578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602558829701890:7152], now have 1 active actors on pipe
2025-10-10T14:38:49.281585Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602558047462302:8822]
2025-10-10T14:38:49.281588Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602558047462302:8822]
2025-10-10T14:38:49.281590Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602558047462302:8822]
2025-10-10T14:38:49.281609Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:49.281626Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:49.281659Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:49.281667Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:49.281695Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602558047462302:8822]
2025-10-10T14:38:49.281703Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:49.281689Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2788
2025-10-10T14:38:49.281696Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2788
2025-10-10T14:38:49.281734Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:49.281742Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:49.281744Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:49.281750Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:49.281823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:49.281838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:49.281881Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ea5adf2-c35d5946-303130b9-d4ac6802_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:49.281896Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:49.281906Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:49.281908Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:49.281922Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:49.281940Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:49.281961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:49.282157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:49.282166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:49.282182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:49.282316Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2789 partition: 0 MaxSeqNo: 40 sessionId: src_id|ea5adf2-c35d5946-303130b9-d4ac6802_0
2025-10-10T14:38:49.282724Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39bc1881-2bc14059-5f24f937-e536b5d6_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|ea5adf2-c35d5946-303130b9-d4ac6802_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:49.285713Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ea5adf2-c35d5946-303130b9-d4ac6802_0] Write session: try to update token
2025-10-10T14:38:49.285735Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ea5adf2-c35d5946-303130b9-d4ac6802_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:49.294719Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:38:49.294741Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:49.294753Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602558047462302:8822]
2025-10-10T14:38:49.294807Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:38:49.294993Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:38:49.295151Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:49.295295Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:49.295438Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:49.295630Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:38:49.295677Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:38:49.295795Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:38:49.304535Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2789 sessionId: src_id|ea5adf2-c35d5946-303130b9-d4ac6802_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:49.307369Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:49.307653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:49.307677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:49.307723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:38:49.307856Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:38:49.315370Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:49.315397Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:49.315401Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:49.315403Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:49.315416Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602558047462302:8822]
2025-10-10T14:38:49.315421Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602558047462302:8822]
2025-10-10T14:38:49.315425Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602558047462302:8822]
2025-10-10T14:38:49.315480Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:49.315484Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:49.315487Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:49.315491Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:49.315494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:49.315496Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:49.315649Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:49.357456Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602558829701902:3900]
2025-10-10T14:38:49.357790Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 pipe creation result: OK TabletId: 72075186224037892 Generation: 2788, pipe: [1:7559602558829701902:3900]
2025-10-10T14:38:49.436918Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:49.445835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:49.445864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:49.446064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:49.446128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:49.446189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:49.446252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:49.446299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:49.446304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:49.446378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:49.446438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:49.446502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:49.446574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:49.446749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:49.446753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:49.446825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:49.446887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:49.446951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:49.447015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:49.447055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:49.447059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:49.447133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:49.447197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:49.447261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:49.447319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:49.447361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:49.447365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:49.447434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:49.447490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:49.447550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:49.447611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:49.447651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:49.447654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:49.447723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:49.447783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:49.447844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:49.447904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:49.447946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:49.447949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:49.448019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:49.448084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:49.448151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:49.448219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:49.448260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:49.448266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:49.448340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:49.448400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:49.448462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:49.448523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:49.448571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:49.448573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:49.448644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:49.448705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:49.448772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:49.448834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:49.448879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:49.448882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:49.448949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:49.449008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:49.449071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:49.449132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:49.449172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:49.449175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:49.449268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602558829701902:3900], now have 1 active actors on pipe
2025-10-10T14:38:49.449979Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:49.449995Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:49.450005Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:49.450035Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2789 reason: error at write: Disconnected sessionId: src_id|ea5adf2-c35d5946-303130b9-d4ac6802_0
2025-10-10T14:38:49.450058Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 87 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602558829701902:3900]
2025-10-10T14:38:49.450210Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2789 sessionId: src_id|ea5adf2-c35d5946-303130b9-d4ac6802_0 is DEAD
2025-10-10T14:38:49.450371Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea5adf2-c35d5946-303130b9-d4ac6802_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:49.450383Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea5adf2-c35d5946-303130b9-d4ac6802_0] Write session will restart in 0.009966s
2025-10-10T14:38:49.450418Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea5adf2-c35d5946-303130b9-d4ac6802_0] Write session: Do CDS request
2025-10-10T14:38:49.450424Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea5adf2-c35d5946-303130b9-d4ac6802_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:49.450092Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:49.461978Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ea5adf2-c35d5946-303130b9-d4ac6802_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:49.463244Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:49.463265Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2790
2025-10-10T14:38:49.463672Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2790 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:49.463721Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2790 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:49.463727Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2790 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:49.463732Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:49.464223Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2790 sessionId:  describe result for acl check
2025-10-10T14:38:49.464248Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:49.464250Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:49.464251Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:49.464259Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602558829701938:7146] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:49.464784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602558829701938:7146] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:49.468692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602558829701938:7146] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:49.472406Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602558829701938:7146] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:49.472426Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602558829701938:7146] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:49.472430Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602558829701938:7146] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:49.472441Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2790 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:49.474781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:49.478465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:49.478824Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:49.478840Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:49.478854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:49.478945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:49.478995Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602558047462451:8813]
2025-10-10T14:38:49.479690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:49.480086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:49.480161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:49.480543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:49.480613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:49.480620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:49.480622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:49.480623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:49.480624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:49.480626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:49.480627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:49.480629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:49.480630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:49.480632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:49.480633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:49.480635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:49.480636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:49.480653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:49.480667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:49.480671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:49.480675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:49.480679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:49.480684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:49.480693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:49.480697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:49.480702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:49.480706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:49.480715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:49.480718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:49.480723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:49.480738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:49.480764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:49.480776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:49.480782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:49.480787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:49.480797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:49.480802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:49.480812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:49.480818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:49.480828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:49.480833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:49.480839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:49.480843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:49.480849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:49.480854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:49.480866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:49.480871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:49.480876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:49.480883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:49.480888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:49.480893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:49.480898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:49.480902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:49.480908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:49.480912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:49.480917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:49.480959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:49.483725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:49.484138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:49.484151Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:49.484154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:49.484158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:49.484167Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2789 [2:7559602558047462451:8813]
2025-10-10T14:38:49.484182Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:49.484208Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:49.484225Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:49.484229Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:49.484232Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:49.484252Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:49.484266Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:49.484276Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:49.484360Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:49.484367Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:49.484369Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:49.484372Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:49.484622Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2789
2025-10-10T14:38:49.484626Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2789
2025-10-10T14:38:49.484820Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:49.484830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:49.484842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:49.484859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:49.484880Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:49.484912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602558829701904:2438], now have 1 active actors on pipe
2025-10-10T14:38:49.484921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602558829702023:7146], now have 1 active actors on pipe
2025-10-10T14:38:49.484936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:49.484946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:49.484970Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602558047462446:8813]
2025-10-10T14:38:49.484979Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602558047462446:8813]
2025-10-10T14:38:49.484981Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602558047462446:8813]
2025-10-10T14:38:49.484995Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:49.485011Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:49.485016Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:49.485030Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:49.485032Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:49.485033Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:49.485037Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:49.485058Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|29a672fd-73cecf8c-b558b988-6680f8e1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:49.485070Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:49.485075Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:49.485079Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:49.485090Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:49.485107Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:49.485154Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602558047462446:8813]
2025-10-10T14:38:49.485165Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:49.485172Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:49.485179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:49.485464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:49.485476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:49.485498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:49.485603Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2790 partition: 0 MaxSeqNo: 40 sessionId: src_id|29a672fd-73cecf8c-b558b988-6680f8e1_0
2025-10-10T14:38:49.486074Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea5adf2-c35d5946-303130b9-d4ac6802_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|29a672fd-73cecf8c-b558b988-6680f8e1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:49.488829Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|29a672fd-73cecf8c-b558b988-6680f8e1_0] Write session: try to update token
2025-10-10T14:38:49.488848Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|29a672fd-73cecf8c-b558b988-6680f8e1_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:49.502029Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:38:49.502050Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:49.502061Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602558047462446:8813]
2025-10-10T14:38:49.502107Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:38:49.502113Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:38:49.502305Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:38:49.502469Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:49.502626Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:49.502775Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:49.502977Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:38:49.503025Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:38:49.503240Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2790 sessionId: src_id|29a672fd-73cecf8c-b558b988-6680f8e1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:49.505922Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:49.506139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:49.506160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:49.506208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:38:49.506330Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:38:49.525085Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:49.525106Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:49.525109Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:49.525112Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:49.525123Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602558047462446:8813]
2025-10-10T14:38:49.525128Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602558047462446:8813]
2025-10-10T14:38:49.525132Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602558047462446:8813]
2025-10-10T14:38:49.525180Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:49.525186Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:49.525187Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:49.525191Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:49.525195Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:49.525198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:49.525359Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:49.553576Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602558829702051:3900]
2025-10-10T14:38:49.565475Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 pipe creation result: OK TabletId: 72075186224037892 Generation: 2789, pipe: [1:7559602558829702051:3900]
2025-10-10T14:38:49.647598Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:49.656106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:49.656143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:49.656348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:49.656423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:49.656496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:49.656571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:49.656625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:49.656636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:49.656712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:49.656785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:49.656858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:49.656934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:49.656980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:49.656988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:49.657066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:49.657138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:49.657216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:49.657289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:49.657792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:49.657805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:49.657885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:49.657957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:49.658029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:49.658100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:49.658148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:49.658157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:49.658228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:49.658294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:49.658359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:49.658427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:49.658473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:49.658479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:49.658551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:49.658616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:49.658683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:49.658753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:49.658803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:49.658810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:49.658882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:49.658953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:49.659023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:49.659096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:49.659146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:49.659156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:49.659230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:49.659293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:49.659358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:49.659428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:49.659478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:49.659484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:49.659558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:49.659622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:49.659689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:49.659758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:49.659805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:49.659811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:49.659886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:49.659955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:49.660023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:49.660097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:49.660145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:49.660152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:49.660218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602558829702051:3900], now have 1 active actors on pipe
2025-10-10T14:38:49.660812Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:49.660874Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 88 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602558829702051:3900]
2025-10-10T14:38:49.660904Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:49.660911Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:49.660940Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2790 reason: error at write: Disconnected sessionId: src_id|29a672fd-73cecf8c-b558b988-6680f8e1_0
2025-10-10T14:38:49.661170Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2790 sessionId: src_id|29a672fd-73cecf8c-b558b988-6680f8e1_0 is DEAD
2025-10-10T14:38:49.661024Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:49.661541Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|29a672fd-73cecf8c-b558b988-6680f8e1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:49.661553Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|29a672fd-73cecf8c-b558b988-6680f8e1_0] Write session will restart in 0.009286s
2025-10-10T14:38:49.661580Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|29a672fd-73cecf8c-b558b988-6680f8e1_0] Write session: Do CDS request
2025-10-10T14:38:49.661587Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|29a672fd-73cecf8c-b558b988-6680f8e1_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:49.672001Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|29a672fd-73cecf8c-b558b988-6680f8e1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:49.672273Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:49.672297Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2791
2025-10-10T14:38:49.672445Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2791 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:49.672485Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2791 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:49.672491Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2791 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:49.672496Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:49.673037Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2791 sessionId:  describe result for acl check
2025-10-10T14:38:49.673078Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:49.673086Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:49.673087Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:49.673093Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602558829702115:7106] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:49.673748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602558829702115:7106] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:49.676666Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602558829702115:7106] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:49.677301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:49.681141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:49.681394Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:49.681408Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:49.681422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:49.681490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:49.681488Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602558829702115:7106] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:49.681505Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602558829702115:7106] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:49.681509Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602558829702115:7106] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:49.681518Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2791 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:49.681547Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602558047462620:8781]
2025-10-10T14:38:49.682199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:49.682524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:49.682577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:49.682915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:49.683000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:49.683009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:49.683010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:49.683012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:49.683014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:49.683015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:49.683016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:49.683018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:49.683019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:49.683020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:49.683021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:49.683022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:49.683024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:49.683031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:49.683044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:49.683049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:49.683053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:49.683057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:49.683061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:49.683065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:49.683069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:49.683073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:49.683078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:49.683083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:49.683087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:49.683091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:49.683101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:49.683111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:49.683118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:49.683124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:49.683129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:49.683134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:49.683139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:49.683154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:49.683159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:49.683172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:49.683177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:49.683182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:49.683188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:49.683199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:49.683203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:49.683209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:49.683214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:49.683219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:49.683226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:49.683231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:49.683236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:49.683241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:49.683245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:49.683250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:49.683261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:49.683267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:49.683305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:49.687014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:49.687778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:49.687794Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:49.687797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:49.687802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:49.687809Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2790 [2:7559602558047462620:8781]
2025-10-10T14:38:49.687825Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:49.687858Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:49.687869Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:49.687874Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:49.687877Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:49.687897Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:49.687905Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:49.687914Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:49.687983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:49.687991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:49.687993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:49.687996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:49.688070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:49.688078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:49.688091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:49.688109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:49.688133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:49.688160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602558829702199:7106], now have 1 active actors on pipe
2025-10-10T14:38:49.688169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602558829702079:2438], now have 1 active actors on pipe
2025-10-10T14:38:49.688177Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602558047462615:8781]
2025-10-10T14:38:49.688182Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602558047462615:8781]
2025-10-10T14:38:49.688185Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602558047462615:8781]
2025-10-10T14:38:49.688199Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:49.688210Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:49.688218Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:49.688218Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:49.688219Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:49.688235Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:49.688243Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:49.688274Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602558047462615:8781]
2025-10-10T14:38:49.688249Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2790
2025-10-10T14:38:49.688283Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:49.688255Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2790
2025-10-10T14:38:49.688307Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:49.688321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:49.688331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:49.688369Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7ec93dfe-dff4d790-94129f03-17203651_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:49.688382Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:49.688391Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:49.688394Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:49.688406Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:49.688421Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:49.688441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:49.688610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:49.688624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:49.688650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:49.688785Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2791 partition: 0 MaxSeqNo: 40 sessionId: src_id|7ec93dfe-dff4d790-94129f03-17203651_0
2025-10-10T14:38:49.689225Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|29a672fd-73cecf8c-b558b988-6680f8e1_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|7ec93dfe-dff4d790-94129f03-17203651_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:49.692550Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7ec93dfe-dff4d790-94129f03-17203651_0] Write session: try to update token
2025-10-10T14:38:49.692572Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7ec93dfe-dff4d790-94129f03-17203651_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:49.709042Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:49.709067Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:49.709070Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:49.709072Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:49.709083Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602558047462615:8781]
2025-10-10T14:38:49.709087Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602558047462615:8781]
2025-10-10T14:38:49.709098Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602558047462615:8781]
2025-10-10T14:38:49.709161Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:49.709160Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:49.709168Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:49.709172Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:49.709174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:49.709177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:49.709325Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:49.712538Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2791 sessionId: src_id|7ec93dfe-dff4d790-94129f03-17203651_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:49.715381Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:49.760974Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602558829702210:3900]
2025-10-10T14:38:49.761176Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 pipe creation result: OK TabletId: 72075186224037892 Generation: 2790, pipe: [1:7559602558829702210:3900]
2025-10-10T14:38:49.830707Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:49.831350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:49.831368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:49.831420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602558829702210:3900], now have 1 active actors on pipe
2025-10-10T14:38:49.831649Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:49.831996Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:49.832015Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:49.832084Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2791 reason: error at write: Disconnected sessionId: src_id|7ec93dfe-dff4d790-94129f03-17203651_0
2025-10-10T14:38:49.832284Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2791 sessionId: src_id|7ec93dfe-dff4d790-94129f03-17203651_0 is DEAD
2025-10-10T14:38:49.832497Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ec93dfe-dff4d790-94129f03-17203651_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:49.832509Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ec93dfe-dff4d790-94129f03-17203651_0] Write session will restart in 0.005732s
2025-10-10T14:38:49.832535Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ec93dfe-dff4d790-94129f03-17203651_0] Write session: Do CDS request
2025-10-10T14:38:49.832541Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ec93dfe-dff4d790-94129f03-17203651_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:49.832357Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 89 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602558829702210:3900]
2025-10-10T14:38:49.832395Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:49.840020Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7ec93dfe-dff4d790-94129f03-17203651_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:49.840116Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:49.840138Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2792
2025-10-10T14:38:49.840311Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2792 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:49.840373Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2792 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:49.840385Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2792 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:49.840410Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:49.840909Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2792 sessionId:  describe result for acl check
2025-10-10T14:38:49.840948Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:49.840957Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:49.840959Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:49.840966Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602558829702236:7087] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:49.841613Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602558829702236:7087] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:49.844960Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602558829702236:7087] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:49.848241Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602558829702236:7087] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:49.848258Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602558829702236:7087] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:49.848263Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602558829702236:7087] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:49.848273Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2792 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:49.848284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:49.852295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:49.852551Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:49.852581Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:49.852600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:49.852675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:49.852724Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602558047462753:8783]
2025-10-10T14:38:49.853388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:49.853787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:49.853844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:49.854162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:49.854236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:49.854242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:49.854244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:49.854245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:49.854246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:49.854247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:49.854249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:49.854250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:49.854251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:49.854252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:49.854254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:49.854255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:49.854256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:49.854262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:49.854274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:49.854278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:49.854281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:49.854285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:49.854289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:49.854292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:49.854296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:49.854299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:49.854303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:49.854307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:49.854310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:49.854314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:49.854323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:49.854331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:49.854337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:49.854343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:49.854347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:49.854352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:49.854356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:49.854360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:49.854365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:49.854371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:49.854378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:49.854382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:49.854387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:49.854397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:49.854401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:49.854406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:49.854410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:49.854415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:49.854419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:49.854424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:49.854429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:49.854439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:49.854443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:49.854452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:49.854457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:49.854461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:49.854501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:49.856899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:49.857454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:49.857468Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:49.857470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:49.857475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:49.857482Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2791 [2:7559602558047462753:8783]
2025-10-10T14:38:49.857495Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:49.857514Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:49.857517Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:49.857521Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:49.857523Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:49.857541Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:49.857549Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:49.857558Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:49.857620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:49.857628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:49.857630Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:49.857633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:49.857720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:49.857731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:49.857742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:49.857754Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:49.857770Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:49.857796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602558829702221:2438], now have 1 active actors on pipe
2025-10-10T14:38:49.857809Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602558047462747:8783]
2025-10-10T14:38:49.857818Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602558047462747:8783]
2025-10-10T14:38:49.857821Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602558047462747:8783]
2025-10-10T14:38:49.857834Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:49.857844Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:49.857846Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:49.857847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602558829702344:7087], now have 1 active actors on pipe
2025-10-10T14:38:49.857848Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:49.857855Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:49.857883Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:49.857892Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:49.857897Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2791
2025-10-10T14:38:49.857921Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602558047462747:8783]
2025-10-10T14:38:49.857929Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:49.857948Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2791
2025-10-10T14:38:49.857943Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:49.858009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:49.858022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:49.858053Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bd93af14-91470d30-c2ce2696-b6884b5f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:49.858066Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:49.858069Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:49.858071Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:49.858086Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:49.858098Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:49.858116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:49.858297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:49.858306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:49.858320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:49.858444Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2792 partition: 0 MaxSeqNo: 40 sessionId: src_id|bd93af14-91470d30-c2ce2696-b6884b5f_0
2025-10-10T14:38:49.858889Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ec93dfe-dff4d790-94129f03-17203651_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|bd93af14-91470d30-c2ce2696-b6884b5f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:49.861790Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bd93af14-91470d30-c2ce2696-b6884b5f_0] Write session: try to update token
2025-10-10T14:38:49.861812Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bd93af14-91470d30-c2ce2696-b6884b5f_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:49.877857Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:49.877879Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:49.877884Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:49.877886Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:49.877896Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602558047462747:8783]
2025-10-10T14:38:49.877902Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602558047462747:8783]
2025-10-10T14:38:49.877906Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602558047462747:8783]
2025-10-10T14:38:49.877957Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:49.877966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:49.877969Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:49.877973Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:49.877979Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:49.877984Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:49.878117Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:49.879091Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2792 sessionId: src_id|bd93af14-91470d30-c2ce2696-b6884b5f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:49.881871Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:49.932484Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602558829702359:3900]
2025-10-10T14:38:49.932811Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 pipe creation result: OK TabletId: 72075186224037892 Generation: 2791, pipe: [1:7559602558829702359:3900]
2025-10-10T14:38:49.995663Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:49.996466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:49.996487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:49.996540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602558829702359:3900], now have 1 active actors on pipe
2025-10-10T14:38:49.996785Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:49.996817Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:49.996835Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 90 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602558829702359:3900]
2025-10-10T14:38:49.996837Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:49.996866Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:49.996920Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2792 reason: error at write: Disconnected sessionId: src_id|bd93af14-91470d30-c2ce2696-b6884b5f_0
2025-10-10T14:38:49.997143Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2792 sessionId: src_id|bd93af14-91470d30-c2ce2696-b6884b5f_0 is DEAD
2025-10-10T14:38:49.997304Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd93af14-91470d30-c2ce2696-b6884b5f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:49.997316Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd93af14-91470d30-c2ce2696-b6884b5f_0] Write session will restart in 0.008171s
2025-10-10T14:38:49.997367Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd93af14-91470d30-c2ce2696-b6884b5f_0] Write session: Do CDS request
2025-10-10T14:38:49.997374Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd93af14-91470d30-c2ce2696-b6884b5f_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:50.007307Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bd93af14-91470d30-c2ce2696-b6884b5f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:50.007997Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:50.008018Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2793
2025-10-10T14:38:50.008240Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2793 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:50.008282Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2793 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:50.008294Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2793 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:50.008298Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:50.008742Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2793 sessionId:  describe result for acl check
2025-10-10T14:38:50.008788Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:50.008808Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:50.008810Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:50.008817Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602563124669740:7071] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:50.009296Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602563124669740:7071] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:50.011381Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602563124669740:7071] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:50.013358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:50.017820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:50.017850Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602563124669740:7071] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:50.017870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602563124669740:7071] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:50.017874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602563124669740:7071] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:50.017884Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2793 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:50.018406Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:50.018421Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:50.018438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:50.018507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:50.018596Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602562342430181:8779]
2025-10-10T14:38:50.019130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:50.019429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:50.019476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:50.019746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:50.019799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:50.019805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:50.019806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:50.019807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:50.019807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:50.019808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:50.019809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:50.019810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:50.019811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:50.019811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:50.019812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:50.019813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:50.019813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:50.019817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:50.019827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:50.019830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:50.019832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:50.019834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:50.019837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:50.019839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:50.019841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:50.019843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:50.019846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:50.019848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:50.019850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:50.019852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:50.019858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:50.019864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:50.019869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:50.019872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:50.019877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:50.019880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:50.019883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:50.019886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:50.019889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:50.019892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:50.019895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:50.019898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:50.019901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:50.019904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:50.019907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:50.019910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:50.019915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:50.019918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:50.019921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:50.019924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:50.019927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:50.019930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:50.019933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:50.019936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:50.019939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:50.019942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:50.019964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:50.022505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:50.022857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:50.022869Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:50.022871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:50.022875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:50.022882Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2792 [2:7559602562342430181:8779]
2025-10-10T14:38:50.022903Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:50.022927Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:50.022931Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:50.022934Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:50.022937Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:50.022953Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:50.022961Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:50.022970Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:50.023029Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:50.023037Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:50.023041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:50.023043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:50.023228Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2792
2025-10-10T14:38:50.023231Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2792
2025-10-10T14:38:50.023298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:50.023308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:50.023319Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:50.023331Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:50.023354Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:50.023381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602563124669783:7071], now have 1 active actors on pipe
2025-10-10T14:38:50.023388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602558829702361:2438], now have 1 active actors on pipe
2025-10-10T14:38:50.023406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:50.023414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:50.023435Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602562342430176:8779]
2025-10-10T14:38:50.023443Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602562342430176:8779]
2025-10-10T14:38:50.023445Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602562342430176:8779]
2025-10-10T14:38:50.023460Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:50.023474Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:50.023476Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:50.023477Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:50.023479Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:50.023494Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:50.023501Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:50.023523Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5f5aaa3a-52e52531-4a8da005-a1d8c6af_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:50.023535Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:50.023539Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:50.023541Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:50.023553Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:50.023564Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:50.023595Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602562342430176:8779]
2025-10-10T14:38:50.023605Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:50.023615Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:50.023616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:50.023787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:50.023799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:50.023824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:50.023940Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2793 partition: 0 MaxSeqNo: 40 sessionId: src_id|5f5aaa3a-52e52531-4a8da005-a1d8c6af_0
2025-10-10T14:38:50.024370Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd93af14-91470d30-c2ce2696-b6884b5f_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|5f5aaa3a-52e52531-4a8da005-a1d8c6af_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:50.027155Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5f5aaa3a-52e52531-4a8da005-a1d8c6af_0] Write session: try to update token
2025-10-10T14:38:50.027174Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5f5aaa3a-52e52531-4a8da005-a1d8c6af_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:50.043797Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2793 sessionId: src_id|5f5aaa3a-52e52531-4a8da005-a1d8c6af_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:50.043862Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:50.043884Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:50.043888Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:50.043890Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:50.043900Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602562342430176:8779]
2025-10-10T14:38:50.043906Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602562342430176:8779]
2025-10-10T14:38:50.043910Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602562342430176:8779]
2025-10-10T14:38:50.043966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:50.043980Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:50.043982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:50.044119Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:50.044127Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:50.044133Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:50.044137Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:50.046623Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:50.096863Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602563124669794:3900]
2025-10-10T14:38:50.097219Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 pipe creation result: OK TabletId: 72075186224037892 Generation: 2792, pipe: [1:7559602563124669794:3900]
2025-10-10T14:38:50.161112Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:50.161590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:50.161605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:50.161667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602563124669794:3900], now have 1 active actors on pipe
2025-10-10T14:38:50.161897Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:50.162061Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:50.162090Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 91 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602563124669794:3900]
2025-10-10T14:38:50.162131Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:38:50.162230Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2793 reason: status is not ok: tablet will be restarted right now sessionId: src_id|5f5aaa3a-52e52531-4a8da005-a1d8c6af_0
2025-10-10T14:38:50.162446Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2793 sessionId: src_id|5f5aaa3a-52e52531-4a8da005-a1d8c6af_0 is DEAD
2025-10-10T14:38:50.162622Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f5aaa3a-52e52531-4a8da005-a1d8c6af_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:38:50.162634Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f5aaa3a-52e52531-4a8da005-a1d8c6af_0] Write session will restart in 0.006207s
2025-10-10T14:38:50.162659Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f5aaa3a-52e52531-4a8da005-a1d8c6af_0] Write session: Do CDS request
2025-10-10T14:38:50.162665Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f5aaa3a-52e52531-4a8da005-a1d8c6af_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:50.172892Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5f5aaa3a-52e52531-4a8da005-a1d8c6af_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:50.173000Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:50.173018Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2794
2025-10-10T14:38:50.173544Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2794 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:50.173587Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2794 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:50.173591Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2794 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:50.173596Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:50.174072Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2794 sessionId:  describe result for acl check
2025-10-10T14:38:50.174111Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:50.174119Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:50.174123Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:50.174128Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602563124669810:7039] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:50.174581Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602563124669810:7039] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:50.177457Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602563124669810:7039] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:50.185796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602563124669810:7039] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:50.185816Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602563124669810:7039] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:50.185821Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602563124669810:7039] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:50.185831Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2794 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:50.187855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:50.191750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:50.192004Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:50.192016Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:50.192028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:50.192089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:50.192132Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602562342430318:8776]
2025-10-10T14:38:50.192756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:50.193119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:50.193165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:50.193486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:50.193610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:50.193616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:50.193618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:50.193619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:50.193620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:50.193621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:50.193622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:50.193624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:50.193625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:50.193626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:50.193627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:50.193628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:50.193640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:50.193645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:50.193659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:50.193663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:50.193667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:50.193671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:50.193675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:50.193679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:50.193682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:50.193686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:50.193690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:50.193694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:50.193698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:50.193702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:50.193710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:50.193719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:50.193724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:50.193730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:50.193734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:50.193739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:50.193742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:50.193747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:50.193752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:50.193757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:50.193760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:50.193765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:50.193770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:50.193774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:50.193779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:50.193784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:50.193788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:50.193794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:50.193798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:50.193802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:50.193809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:50.193815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:50.193819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:50.193823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:50.193828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:50.193833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:50.193873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:50.198553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:50.199322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:50.199339Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:50.199342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:50.199346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:50.199354Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2793 [2:7559602562342430318:8776]
2025-10-10T14:38:50.199372Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:50.199391Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:50.199403Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:50.199407Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:50.199410Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:50.199429Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:50.199437Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:50.199449Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:50.199516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:50.199524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:50.199526Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:50.199528Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:50.199597Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:50.199604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:50.199617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:50.199633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:50.199655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:50.199699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602563124669918:7039], now have 1 active actors on pipe
2025-10-10T14:38:50.199708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602563124669796:2438], now have 1 active actors on pipe
2025-10-10T14:38:50.199716Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602562342430311:8776]
2025-10-10T14:38:50.199719Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602562342430311:8776]
2025-10-10T14:38:50.199721Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602562342430311:8776]
2025-10-10T14:38:50.199734Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:50.199747Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:50.199749Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:50.199753Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:50.199755Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:50.199766Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:50.199769Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:50.199780Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2793
2025-10-10T14:38:50.199822Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2793
2025-10-10T14:38:50.199803Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602562342430311:8776]
2025-10-10T14:38:50.199813Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:50.199820Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:50.199833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:50.199838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:50.199891Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|24bbe522-e272b6a4-f4d0bd96-d8837a4c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:50.199904Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:50.199910Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:50.199916Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:50.199928Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:50.199938Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:50.199962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:50.200164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:50.200181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:50.200206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:50.200302Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2794 partition: 0 MaxSeqNo: 40 sessionId: src_id|24bbe522-e272b6a4-f4d0bd96-d8837a4c_0
2025-10-10T14:38:50.200715Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f5aaa3a-52e52531-4a8da005-a1d8c6af_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|24bbe522-e272b6a4-f4d0bd96-d8837a4c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:50.203710Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|24bbe522-e272b6a4-f4d0bd96-d8837a4c_0] Write session: try to update token
2025-10-10T14:38:50.203731Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|24bbe522-e272b6a4-f4d0bd96-d8837a4c_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:50.220012Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:50.220037Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:50.220042Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:50.220044Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:50.220054Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602562342430311:8776]
2025-10-10T14:38:50.220060Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602562342430311:8776]
2025-10-10T14:38:50.220065Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602562342430311:8776]
2025-10-10T14:38:50.220116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:50.220126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:50.220134Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:50.220272Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:50.221462Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:50.221491Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:50.221496Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:50.228402Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2794 sessionId: src_id|24bbe522-e272b6a4-f4d0bd96-d8837a4c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:50.230920Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:50.262233Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602563124669933:3900]
2025-10-10T14:38:50.262479Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 pipe creation result: OK TabletId: 72075186224037892 Generation: 2793, pipe: [1:7559602563124669933:3900]
2025-10-10T14:38:50.342692Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:50.343174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:50.343191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:50.343215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602563124669933:3900], now have 1 active actors on pipe
2025-10-10T14:38:50.343429Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:50.343520Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 92 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602563124669933:3900]
2025-10-10T14:38:50.343678Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:38:50.343710Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:50.343758Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2794 reason: status is not ok: tablet will be restarted right now sessionId: src_id|24bbe522-e272b6a4-f4d0bd96-d8837a4c_0
2025-10-10T14:38:50.343958Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2794 sessionId: src_id|24bbe522-e272b6a4-f4d0bd96-d8837a4c_0 is DEAD
2025-10-10T14:38:50.345550Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24bbe522-e272b6a4-f4d0bd96-d8837a4c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:38:50.345561Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24bbe522-e272b6a4-f4d0bd96-d8837a4c_0] Write session will restart in 0.005565s
2025-10-10T14:38:50.345587Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24bbe522-e272b6a4-f4d0bd96-d8837a4c_0] Write session: Do CDS request
2025-10-10T14:38:50.345593Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24bbe522-e272b6a4-f4d0bd96-d8837a4c_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:50.354004Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|24bbe522-e272b6a4-f4d0bd96-d8837a4c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:50.357487Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:50.357506Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2795
2025-10-10T14:38:50.359191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:50.361453Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2795 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:50.361510Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2795 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:50.361516Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2795 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:50.361522Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:50.362061Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2795 sessionId:  describe result for acl check
2025-10-10T14:38:50.362102Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:50.362109Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:50.362111Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:50.362119Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602563124670034:7043] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:50.362710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602563124670034:7043] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:50.362934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:50.363180Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:50.363193Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:50.363207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:50.363273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:50.363321Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602562342430452:8759]
2025-10-10T14:38:50.363950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:50.364310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:50.364372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:50.364734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:50.364800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:50.364806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:50.364808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:50.364809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:50.364811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:50.364812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:50.364813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:50.364815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:50.364816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:50.364818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:50.364819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:50.364821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:50.364822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:50.364828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:50.364841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:50.364845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:50.364849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:50.364853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:50.364858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:50.364862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:50.364866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:50.364871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:50.364875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:50.364879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:50.364893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:50.364897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:50.364905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:50.364915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:50.364921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:50.364928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:50.364932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:50.364938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:50.364943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:50.364949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:50.364961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:50.364967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:50.364976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:50.364982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:50.364987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:50.364996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:50.365001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:50.365006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:50.365013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:50.365019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:50.365023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:50.365029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:50.365044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:50.365057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:50.365062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:50.365067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:50.365071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:50.365077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:50.365126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:50.365388Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602563124670034:7043] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:50.367963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:50.368495Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602563124670034:7043] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:50.368509Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602563124670034:7043] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:50.368513Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602563124670034:7043] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:50.368521Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2795 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:50.368858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:50.368873Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:50.368876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:50.368880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:50.368886Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2794 [2:7559602562342430452:8759]
2025-10-10T14:38:50.368899Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:50.368917Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:50.368921Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:50.368925Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:50.368927Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:50.368946Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:50.368954Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:50.368965Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:50.369031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:50.369040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:50.369041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:50.369045Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:50.369109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:50.369116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:50.369129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:50.369141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:50.369163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:50.369190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602563124670067:7043], now have 1 active actors on pipe
2025-10-10T14:38:50.369200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602563124669936:2438], now have 1 active actors on pipe
2025-10-10T14:38:50.369208Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602562342430447:8759]
2025-10-10T14:38:50.369210Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602562342430447:8759]
2025-10-10T14:38:50.369212Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602562342430447:8759]
2025-10-10T14:38:50.369226Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:50.369242Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:50.369264Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:50.369269Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:50.369272Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:50.369272Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:50.369274Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:50.369252Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2794
2025-10-10T14:38:50.369257Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2794
2025-10-10T14:38:50.369302Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602562342430447:8759]
2025-10-10T14:38:50.369310Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:50.369315Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:50.369360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:50.369371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:50.369412Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dfc04d72-ae53d416-3d91d0e8-be8e43bb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:50.369424Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:50.369428Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:50.369431Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:50.369443Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:50.369454Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:50.369477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:50.369612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:50.369622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:50.369650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:50.369768Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2795 partition: 0 MaxSeqNo: 40 sessionId: src_id|dfc04d72-ae53d416-3d91d0e8-be8e43bb_0
2025-10-10T14:38:50.370162Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24bbe522-e272b6a4-f4d0bd96-d8837a4c_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|dfc04d72-ae53d416-3d91d0e8-be8e43bb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:50.372884Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dfc04d72-ae53d416-3d91d0e8-be8e43bb_0] Write session: try to update token
2025-10-10T14:38:50.372903Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dfc04d72-ae53d416-3d91d0e8-be8e43bb_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:50.388707Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:50.388726Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:50.388730Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:50.388732Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:50.388745Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602562342430447:8759]
2025-10-10T14:38:50.388749Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602562342430447:8759]
2025-10-10T14:38:50.388753Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602562342430447:8759]
2025-10-10T14:38:50.388800Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:50.388800Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:50.388805Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:50.388808Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:50.388809Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:50.388810Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:50.388945Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:50.390137Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2795 sessionId: src_id|dfc04d72-ae53d416-3d91d0e8-be8e43bb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:50.393083Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:50.443496Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602563124670074:3900]
2025-10-10T14:38:50.443939Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 pipe creation result: OK TabletId: 72075186224037892 Generation: 2794, pipe: [1:7559602563124670074:3900]
2025-10-10T14:38:50.505415Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:50.505800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:50.505814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:50.505856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602563124670074:3900], now have 1 active actors on pipe
2025-10-10T14:38:50.506032Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:50.506099Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 93 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602563124670074:3900]
2025-10-10T14:38:50.506099Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:50.506154Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:38:50.506236Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2795 reason: status is not ok: tablet will be restarted right now sessionId: src_id|dfc04d72-ae53d416-3d91d0e8-be8e43bb_0
2025-10-10T14:38:50.506456Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2795 sessionId: src_id|dfc04d72-ae53d416-3d91d0e8-be8e43bb_0 is DEAD
2025-10-10T14:38:50.506602Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dfc04d72-ae53d416-3d91d0e8-be8e43bb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:38:50.506614Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dfc04d72-ae53d416-3d91d0e8-be8e43bb_0] Write session will restart in 0.008793s
2025-10-10T14:38:50.506641Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dfc04d72-ae53d416-3d91d0e8-be8e43bb_0] Write session: Do CDS request
2025-10-10T14:38:50.506646Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dfc04d72-ae53d416-3d91d0e8-be8e43bb_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:50.517059Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dfc04d72-ae53d416-3d91d0e8-be8e43bb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:50.517170Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:50.517200Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2796
2025-10-10T14:38:50.517353Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2796 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:50.517395Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2796 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:50.517406Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2796 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:50.517411Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:50.517889Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2796 sessionId:  describe result for acl check
2025-10-10T14:38:50.517927Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:50.517935Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:50.517937Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:50.517943Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602563124670172:7028] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:50.518560Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602563124670172:7028] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:50.519750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:50.521210Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602563124670172:7028] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:50.523538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:50.523778Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:50.523791Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:50.523802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:50.523856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:50.523903Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602562342430600:8756]
2025-10-10T14:38:50.524069Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602563124670172:7028] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:50.524083Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602563124670172:7028] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:50.524087Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602563124670172:7028] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:50.524096Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2796 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:50.524515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:50.524813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:50.524856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:50.525175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:50.525232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:50.525239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:50.525240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:50.525241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:50.525242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:50.525243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:50.525244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:50.525245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:50.525246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:50.525247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:50.525249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:50.525250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:50.525252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:50.525257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:50.525270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:50.525275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:50.525279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:50.525283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:50.525287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:50.525292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:50.525295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:50.525299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:50.525304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:50.525308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:50.525311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:50.525315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:50.525323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:50.525349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:50.525360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:50.525365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:50.525376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:50.525381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:50.525385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:50.525390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:50.525394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:50.525399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:50.525404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:50.525409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:50.525414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:50.525419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:50.525422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:50.525428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:50.525438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:50.525443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:50.525461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:50.525470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:50.525480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:50.525485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:50.525491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:50.525500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:50.525509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:50.525519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:50.525561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:50.528192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:50.528727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:50.528740Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:50.528743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:50.528747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:50.528754Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2795 [2:7559602562342430600:8756]
2025-10-10T14:38:50.528768Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:50.528788Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:50.528798Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:50.528803Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:50.528805Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:50.528826Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:50.528840Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:50.528853Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:50.528932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:50.528942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:50.528945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:50.528947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:50.529026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:50.529035Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:50.529046Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:50.529062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:50.529084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:50.529114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602563124670204:7028], now have 1 active actors on pipe
2025-10-10T14:38:50.529125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602563124670076:2438], now have 1 active actors on pipe
2025-10-10T14:38:50.529134Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602562342430595:8756]
2025-10-10T14:38:50.529137Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602562342430595:8756]
2025-10-10T14:38:50.529140Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602562342430595:8756]
2025-10-10T14:38:50.529153Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:50.529164Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:50.529167Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:50.529169Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:50.529169Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:50.529187Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:50.529190Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:50.529173Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2795
2025-10-10T14:38:50.529174Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2795
2025-10-10T14:38:50.529226Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602562342430595:8756]
2025-10-10T14:38:50.529238Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:50.529245Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:50.529254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:50.529259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:50.529312Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|607b0a65-14b5e0ed-def93894-dd1cfd60_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:50.529325Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:50.529345Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:50.529347Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:50.529361Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:50.529377Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:50.529401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:50.529637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:50.529646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:50.529662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:50.529770Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2796 partition: 0 MaxSeqNo: 40 sessionId: src_id|607b0a65-14b5e0ed-def93894-dd1cfd60_0
2025-10-10T14:38:50.530188Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dfc04d72-ae53d416-3d91d0e8-be8e43bb_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|607b0a65-14b5e0ed-def93894-dd1cfd60_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:50.532960Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|607b0a65-14b5e0ed-def93894-dd1cfd60_0] Write session: try to update token
2025-10-10T14:38:50.532980Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|607b0a65-14b5e0ed-def93894-dd1cfd60_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:50.548981Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:50.549002Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:50.549010Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:50.549012Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:50.549022Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602562342430595:8756]
2025-10-10T14:38:50.549026Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602562342430595:8756]
2025-10-10T14:38:50.549030Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602562342430595:8756]
2025-10-10T14:38:50.549084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:50.549095Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:50.549097Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:50.549100Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:50.549102Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:50.549107Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:50.549318Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:50.550468Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2796 sessionId: src_id|607b0a65-14b5e0ed-def93894-dd1cfd60_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:50.553656Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:50.606279Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602563124670233:3900]
2025-10-10T14:38:50.606619Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 pipe creation result: OK TabletId: 72075186224037892 Generation: 2795, pipe: [1:7559602563124670233:3900]
2025-10-10T14:38:50.667102Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:50.667934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:50.667952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:50.668002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602563124670233:3900], now have 1 active actors on pipe
2025-10-10T14:38:50.668238Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:50.668260Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 94 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602563124670233:3900]
2025-10-10T14:38:50.668270Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:50.668275Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:50.668292Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:50.668346Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2796 reason: error at write: Disconnected sessionId: src_id|607b0a65-14b5e0ed-def93894-dd1cfd60_0
2025-10-10T14:38:50.668551Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2796 sessionId: src_id|607b0a65-14b5e0ed-def93894-dd1cfd60_0 is DEAD
2025-10-10T14:38:50.668745Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|607b0a65-14b5e0ed-def93894-dd1cfd60_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:50.668756Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|607b0a65-14b5e0ed-def93894-dd1cfd60_0] Write session will restart in 0.008384s
2025-10-10T14:38:50.668782Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|607b0a65-14b5e0ed-def93894-dd1cfd60_0] Write session: Do CDS request
2025-10-10T14:38:50.668793Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|607b0a65-14b5e0ed-def93894-dd1cfd60_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:50.679001Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|607b0a65-14b5e0ed-def93894-dd1cfd60_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:50.678995Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:50.679014Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2797
2025-10-10T14:38:50.679249Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2797 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:50.679288Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2797 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:50.679295Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2797 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:50.679305Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:50.679776Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2797 sessionId:  describe result for acl check
2025-10-10T14:38:50.679826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:50.679832Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:50.679834Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:50.679841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602563124670352:6977] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:50.680444Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602563124670352:6977] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:50.682204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:50.682627Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602563124670352:6977] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:50.685595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:50.685869Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:50.685883Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:50.685897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:50.685955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:50.685993Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602562342430775:8728]
2025-10-10T14:38:50.686025Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602563124670352:6977] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:50.686040Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602563124670352:6977] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:50.686044Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602563124670352:6977] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:50.686054Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2797 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:50.686625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:50.686955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:50.687004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:50.687326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:50.687384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:50.687390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:50.687392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:50.687393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:50.687395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:50.687396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:50.687398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:50.687399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:50.687401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:50.687402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:50.687404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:50.687405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:50.687407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:50.687413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:50.687426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:50.687431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:50.687435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:50.687440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:50.687444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:50.687449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:50.687453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:50.687458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:50.687462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:50.687466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:50.687470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:50.687474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:50.687483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:50.687492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:50.687505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:50.687511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:50.687517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:50.687522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:50.687531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:50.687537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:50.687546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:50.687552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:50.687563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:50.687569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:50.687574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:50.687579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:50.687584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:50.687589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:50.687604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:50.687610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:50.687616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:50.687622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:50.687626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:50.687632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:50.687636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:50.687641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:50.687647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:50.687653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:50.687696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:50.690217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:50.690568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:50.690584Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:50.690587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:50.690591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:50.690597Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2796 [2:7559602562342430775:8728]
2025-10-10T14:38:50.690611Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:50.690627Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:50.690635Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:50.690639Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:50.690641Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:50.690658Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:50.690671Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:50.690684Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:50.690748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:50.690756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:50.690758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:50.690761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:50.690828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:50.690835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:50.690847Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:50.690864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:50.690886Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:50.691024Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2796
2025-10-10T14:38:50.691065Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2796
2025-10-10T14:38:50.690907Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602562342430770:8728]
2025-10-10T14:38:50.690929Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602562342430770:8728]
2025-10-10T14:38:50.690931Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602562342430770:8728]
2025-10-10T14:38:50.690950Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:50.690965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602563124670382:6977], now have 1 active actors on pipe
2025-10-10T14:38:50.690969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602563124670256:2438], now have 1 active actors on pipe
2025-10-10T14:38:50.690979Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:50.690977Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:50.690982Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:50.690984Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:50.690996Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:50.690999Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:50.691026Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602562342430770:8728]
2025-10-10T14:38:50.691034Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:50.691034Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:50.691067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:50.691072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:50.691105Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|97ad0539-37f56168-329f2587-cc373ad4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:50.691114Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:50.691117Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:50.691120Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:50.691132Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:50.691143Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:50.691162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:50.691323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:50.691347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:50.691377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:50.691499Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2797 partition: 0 MaxSeqNo: 40 sessionId: src_id|97ad0539-37f56168-329f2587-cc373ad4_0
2025-10-10T14:38:50.691932Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|607b0a65-14b5e0ed-def93894-dd1cfd60_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|97ad0539-37f56168-329f2587-cc373ad4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:50.694691Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|97ad0539-37f56168-329f2587-cc373ad4_0] Write session: try to update token
2025-10-10T14:38:50.694711Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|97ad0539-37f56168-329f2587-cc373ad4_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:50.710318Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:50.710342Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:50.710346Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:50.710348Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:50.710358Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602562342430770:8728]
2025-10-10T14:38:50.710363Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602562342430770:8728]
2025-10-10T14:38:50.710368Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602562342430770:8728]
2025-10-10T14:38:50.710423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:50.710430Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:50.710436Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:50.710437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:50.710439Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:50.710439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:50.710587Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:50.712007Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2797 sessionId: src_id|97ad0539-37f56168-329f2587-cc373ad4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:50.714952Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:50.768558Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602563124670393:3900]
2025-10-10T14:38:50.768876Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 pipe creation result: OK TabletId: 72075186224037892 Generation: 2796, pipe: [1:7559602563124670393:3900]
2025-10-10T14:38:50.827395Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:50.827870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:50.827888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:50.827933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602563124670393:3900], now have 1 active actors on pipe
2025-10-10T14:38:50.828260Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:50.828290Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 95 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602563124670393:3900]
2025-10-10T14:38:50.828323Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:50.828326Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:50.828263Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:50.828393Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2797 reason: error at write: Disconnected sessionId: src_id|97ad0539-37f56168-329f2587-cc373ad4_0
2025-10-10T14:38:50.828614Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2797 sessionId: src_id|97ad0539-37f56168-329f2587-cc373ad4_0 is DEAD
2025-10-10T14:38:50.828748Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97ad0539-37f56168-329f2587-cc373ad4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:50.828769Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97ad0539-37f56168-329f2587-cc373ad4_0] Write session will restart in 0.006285s
2025-10-10T14:38:50.828795Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97ad0539-37f56168-329f2587-cc373ad4_0] Write session: Do CDS request
2025-10-10T14:38:50.828804Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97ad0539-37f56168-329f2587-cc373ad4_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:50.835888Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|97ad0539-37f56168-329f2587-cc373ad4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:50.835961Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:50.835979Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2798
2025-10-10T14:38:50.836084Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2798 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:50.836120Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2798 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:50.836132Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2798 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:50.836136Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:50.836635Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2798 sessionId:  describe result for acl check
2025-10-10T14:38:50.836682Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:50.836684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:50.836686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:50.836692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602563124670416:6940] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:50.837371Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602563124670416:6940] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:50.840210Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602563124670416:6940] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:50.842501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:50.846132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:50.846348Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602563124670416:6940] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:50.846390Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:50.846403Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:50.846376Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602563124670416:6940] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:50.846380Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602563124670416:6940] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:50.846418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:50.846390Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2798 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:50.846491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:50.846553Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602562342430913:8715]
2025-10-10T14:38:50.847186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:50.847561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:50.847621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:50.847979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:50.848070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:50.848078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:50.848079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:50.848081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:50.848082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:50.848083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:50.848085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:50.848086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:50.848088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:50.848089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:50.848090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:50.848092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:50.848093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:50.848101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:50.848116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:50.848121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:50.848125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:50.848130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:50.848134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:50.848138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:50.848142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:50.848146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:50.848151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:50.848155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:50.848160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:50.848164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:50.848173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:50.848182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:50.848189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:50.848195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:50.848200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:50.848205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:50.848210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:50.848216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:50.848227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:50.848233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:50.848237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:50.848243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:50.848248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:50.848253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:50.848258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:50.848264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:50.848269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:50.848275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:50.848279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:50.848285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:50.848296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:50.848301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:50.848311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:50.848317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:50.848321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:50.848327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:50.848374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:50.850940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:50.851346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:50.851360Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:50.851362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:50.851367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:50.851374Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2797 [2:7559602562342430913:8715]
2025-10-10T14:38:50.851386Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:50.851403Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:50.851406Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:50.851410Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:50.851412Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:50.851429Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:50.851437Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:50.851445Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:50.851507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:50.851513Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:50.851515Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:50.851518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:50.851604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:50.851613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:50.851625Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:50.851642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:50.851664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:50.851690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602563124670401:2438], now have 1 active actors on pipe
2025-10-10T14:38:50.851698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602563124670530:6940], now have 1 active actors on pipe
2025-10-10T14:38:50.851725Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602562342430908:8715]
2025-10-10T14:38:50.851734Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602562342430908:8715]
2025-10-10T14:38:50.851736Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602562342430908:8715]
2025-10-10T14:38:50.851752Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:50.851766Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:50.851782Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:50.851785Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:50.851769Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2797
2025-10-10T14:38:50.851775Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2797
2025-10-10T14:38:50.851799Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:50.851808Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602562342430908:8715]
2025-10-10T14:38:50.851810Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:50.851811Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:50.851813Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:50.851820Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:50.851850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:50.851855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:50.851887Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ab333367-7b2c67f4-b4ab4ca8-cd22c521_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:50.851900Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:50.851909Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:50.851912Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:50.851923Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:50.851936Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:50.851953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:50.852125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:50.852135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:50.852152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:50.852237Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2798 partition: 0 MaxSeqNo: 40 sessionId: src_id|ab333367-7b2c67f4-b4ab4ca8-cd22c521_0
2025-10-10T14:38:50.852648Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97ad0539-37f56168-329f2587-cc373ad4_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|ab333367-7b2c67f4-b4ab4ca8-cd22c521_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:50.855422Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ab333367-7b2c67f4-b4ab4ca8-cd22c521_0] Write session: try to update token
2025-10-10T14:38:50.855440Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ab333367-7b2c67f4-b4ab4ca8-cd22c521_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:50.869048Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:38:50.869072Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:50.869083Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602562342430908:8715]
2025-10-10T14:38:50.869138Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:38:50.869136Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:38:50.869314Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:38:50.869482Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:50.869646Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:50.869793Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:50.870000Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:38:50.870051Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:38:50.870257Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2798 sessionId: src_id|ab333367-7b2c67f4-b4ab4ca8-cd22c521_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:50.873055Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:50.873319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:50.873357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:50.873396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:38:50.873506Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:38:50.881899Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:50.881919Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:50.881922Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:50.881924Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:50.881936Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602562342430908:8715]
2025-10-10T14:38:50.881940Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602562342430908:8715]
2025-10-10T14:38:50.881944Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602562342430908:8715]
2025-10-10T14:38:50.881993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:50.881999Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:50.882003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:50.882006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:50.882012Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:50.882016Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:50.882143Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:50.928363Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602563124670545:3900]
2025-10-10T14:38:50.928767Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 pipe creation result: OK TabletId: 72075186224037892 Generation: 2797, pipe: [1:7559602563124670545:3900]
2025-10-10T14:38:50.997909Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:51.006695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:51.006728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:51.006920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:51.006996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:51.007065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:51.007137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:51.007186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:51.007195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:51.007270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:51.007335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:51.007400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:51.007477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:51.007524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:51.007533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:51.007603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:51.007672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:51.007739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:51.007810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:51.007866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:51.008414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:51.008509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:51.008587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:51.008655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:51.008723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:51.008775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:51.008785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:51.008860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:51.008928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:51.009000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:51.009074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:51.009120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:51.009130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:51.009204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:51.009272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:51.009364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:51.009430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:51.009480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:51.009488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:51.009560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:51.009643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:51.009714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:51.009784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:51.009832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:51.009840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:51.009913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:51.009974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:51.010039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:51.010115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:51.010175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:51.010181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:51.010255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:51.010330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:51.011805Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab333367-7b2c67f4-b4ab4ca8-cd22c521_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:51.011817Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab333367-7b2c67f4-b4ab4ca8-cd22c521_0] Write session will restart in 0.005689s
2025-10-10T14:38:51.011845Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab333367-7b2c67f4-b4ab4ca8-cd22c521_0] Write session: Do CDS request
2025-10-10T14:38:51.011861Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab333367-7b2c67f4-b4ab4ca8-cd22c521_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:51.011246Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:51.011315Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:51.011319Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:51.011353Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2798 reason: error at write: Disconnected sessionId: src_id|ab333367-7b2c67f4-b4ab4ca8-cd22c521_0
2025-10-10T14:38:51.011588Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2798 sessionId: src_id|ab333367-7b2c67f4-b4ab4ca8-cd22c521_0 is DEAD
2025-10-10T14:38:51.011647Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 96 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602563124670545:3900]
2025-10-10T14:38:51.010401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:51.010476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:51.010521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:51.010524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:51.010675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:51.010734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:51.010801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:51.010870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:51.010915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:51.010918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:51.011000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602563124670545:3900], now have 1 active actors on pipe
2025-10-10T14:38:51.011844Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:51.018915Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ab333367-7b2c67f4-b4ab4ca8-cd22c521_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:51.018968Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:51.018989Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2799
2025-10-10T14:38:51.019172Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2799 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:51.019209Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2799 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:51.019220Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2799 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:51.019224Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:51.019711Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2799 sessionId:  describe result for acl check
2025-10-10T14:38:51.019754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:51.019756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:51.019761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:51.019767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602567419637857:6932] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:51.020381Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602567419637857:6932] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:51.023507Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602567419637857:6932] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:51.026443Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602567419637857:6932] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:51.026459Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602567419637857:6932] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:51.026463Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602567419637857:6932] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:51.026473Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2799 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:51.027554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:51.031456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:51.031738Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:51.031744Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:51.031758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:51.031830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:51.031880Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602566637398349:8723]
2025-10-10T14:38:51.032597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:51.033018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:51.033087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:51.033485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:51.033568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:51.033575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:51.033576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:51.033577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:51.033578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:51.033580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:51.033582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:51.033583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:51.033585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:51.033586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:51.033588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:51.033590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:51.033591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:51.033599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:51.033614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:51.033634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:51.033639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:51.033642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:51.033664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:51.033668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:51.033672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:51.033676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:51.033680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:51.033690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:51.033693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:51.033697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:51.033706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:51.033721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:51.033733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:51.033739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:51.033746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:51.033757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:51.033762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:51.033772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:51.033777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:51.033787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:51.033791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:51.033796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:51.033804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:51.033810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:51.033815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:51.033821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:51.033827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:51.033833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:51.033837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:51.033842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:51.033846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:51.033857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:51.033861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:51.033866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:51.033876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:51.033882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:51.033926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:51.036690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:51.037444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:51.037461Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:51.037464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:51.037468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:51.037478Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2798 [2:7559602566637398349:8723]
2025-10-10T14:38:51.037494Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:51.037517Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:51.037530Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:51.037534Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:51.037537Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:51.037557Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:51.037565Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:51.037573Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:51.037659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:51.037668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:51.037671Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:51.037673Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:51.037749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:51.037757Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:51.037769Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:51.037779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:51.037795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:51.037824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602567419637973:6932], now have 1 active actors on pipe
2025-10-10T14:38:51.037836Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602566637398344:8723]
2025-10-10T14:38:51.037838Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602566637398344:8723]
2025-10-10T14:38:51.037840Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602566637398344:8723]
2025-10-10T14:38:51.037853Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:51.037862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602567419637844:2438], now have 1 active actors on pipe
2025-10-10T14:38:51.037871Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:51.037876Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:51.037879Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:51.037881Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:51.037885Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:51.037888Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:51.037926Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602566637398344:8723]
2025-10-10T14:38:51.037936Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:51.037948Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:51.037932Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2798
2025-10-10T14:38:51.037983Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2798
2025-10-10T14:38:51.038071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:51.038082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:51.038116Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|96cbb93b-2611b15b-394f8014-8e6995da_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:51.038129Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:51.038132Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:51.038135Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:51.038149Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:51.038163Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:51.038179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:51.038355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:51.038363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:51.038380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:51.038481Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2799 partition: 0 MaxSeqNo: 40 sessionId: src_id|96cbb93b-2611b15b-394f8014-8e6995da_0
2025-10-10T14:38:51.038895Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab333367-7b2c67f4-b4ab4ca8-cd22c521_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|96cbb93b-2611b15b-394f8014-8e6995da_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:51.041893Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|96cbb93b-2611b15b-394f8014-8e6995da_0] Write session: try to update token
2025-10-10T14:38:51.041919Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|96cbb93b-2611b15b-394f8014-8e6995da_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:51.056873Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2799 sessionId: src_id|96cbb93b-2611b15b-394f8014-8e6995da_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:51.059026Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:51.059048Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:51.059052Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:51.059054Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:51.059065Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602566637398344:8723]
2025-10-10T14:38:51.059070Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602566637398344:8723]
2025-10-10T14:38:51.059074Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602566637398344:8723]
2025-10-10T14:38:51.059124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:51.059133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:51.059131Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:51.059135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:51.059140Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:51.059149Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:51.059286Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:51.059607Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:51.111630Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602567419637986:3900]
2025-10-10T14:38:51.113721Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 pipe creation result: OK TabletId: 72075186224037892 Generation: 2798, pipe: [1:7559602567419637986:3900]
2025-10-10T14:38:51.176458Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:51.177039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:51.177052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:51.177101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602567419637986:3900], now have 1 active actors on pipe
2025-10-10T14:38:51.177391Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:51.177416Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:51.177482Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 97 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602567419637986:3900]
2025-10-10T14:38:51.177511Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:51.177524Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:51.177597Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2799 reason: error at write: Disconnected sessionId: src_id|96cbb93b-2611b15b-394f8014-8e6995da_0
2025-10-10T14:38:51.177798Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2799 sessionId: src_id|96cbb93b-2611b15b-394f8014-8e6995da_0 is DEAD
2025-10-10T14:38:51.177976Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96cbb93b-2611b15b-394f8014-8e6995da_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:51.177987Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96cbb93b-2611b15b-394f8014-8e6995da_0] Write session will restart in 0.007066s
2025-10-10T14:38:51.178013Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96cbb93b-2611b15b-394f8014-8e6995da_0] Write session: Do CDS request
2025-10-10T14:38:51.178022Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96cbb93b-2611b15b-394f8014-8e6995da_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:51.185942Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|96cbb93b-2611b15b-394f8014-8e6995da_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:51.185997Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:51.186016Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2800
2025-10-10T14:38:51.186150Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2800 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:51.186185Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2800 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:51.186196Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2800 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:51.186199Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:51.186636Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2800 sessionId:  describe result for acl check
2025-10-10T14:38:51.186672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:51.186674Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:51.186676Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:51.186682Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602567419638033:6917] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:51.187251Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602567419638033:6917] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:51.189665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602567419638033:6917] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:51.190696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:51.194766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:51.195033Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:51.195058Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:51.195072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:51.195140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:51.195197Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602566637398490:8722]
2025-10-10T14:38:51.195190Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602567419638033:6917] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:51.195213Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602567419638033:6917] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:51.195217Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602567419638033:6917] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:51.195235Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2800 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:51.195838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:51.196130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:51.196182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:51.196526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:51.196595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:51.196596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:51.196598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:51.196599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:51.196601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:51.196602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:51.196604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:51.196605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:51.196607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:51.196608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:51.196609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:51.196611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:51.196612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:51.196619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:51.196636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:51.196642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:51.196647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:51.196652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:51.196656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:51.196660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:51.196664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:51.196668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:51.196673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:51.196677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:51.196681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:51.196686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:51.196695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:51.196704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:51.196712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:51.196718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:51.196723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:51.196729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:51.196733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:51.196739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:51.196744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:51.196750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:51.196755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:51.196762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:51.196767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:51.196779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:51.196787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:51.196798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:51.196803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:51.196809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:51.196814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:51.196820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:51.196825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:51.196831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:51.196836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:51.196841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:51.196846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:51.196851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:51.196902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:51.199614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:51.200342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:51.200356Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:51.200358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:51.200362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:51.200368Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2799 [2:7559602566637398490:8722]
2025-10-10T14:38:51.200382Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:51.200402Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:51.200411Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:51.200414Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:51.200417Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:51.200436Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:51.200448Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:51.200461Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:51.200529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:51.200537Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:51.200539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:51.200541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:51.200609Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:51.200615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:51.200623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:51.200630Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:51.200640Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:51.200661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602567419637988:2438], now have 1 active actors on pipe
2025-10-10T14:38:51.200667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602567419638120:6917], now have 1 active actors on pipe
2025-10-10T14:38:51.200673Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602566637398485:8722]
2025-10-10T14:38:51.200675Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602566637398485:8722]
2025-10-10T14:38:51.200677Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602566637398485:8722]
2025-10-10T14:38:51.200688Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:51.200706Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:51.200712Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:51.200716Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:51.200719Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:51.200727Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:51.200730Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:51.200737Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2799
2025-10-10T14:38:51.200742Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2799
2025-10-10T14:38:51.200764Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602566637398485:8722]
2025-10-10T14:38:51.200777Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:51.200779Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:51.200801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:51.200806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:51.200844Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a2ee5b37-e4e51766-6fb1c51f-1811bba1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:51.200857Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:51.200861Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:51.200863Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:51.200874Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:51.200883Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:51.200902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:51.201065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:51.201073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:51.201089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:51.201205Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2800 partition: 0 MaxSeqNo: 40 sessionId: src_id|a2ee5b37-e4e51766-6fb1c51f-1811bba1_0
2025-10-10T14:38:51.201628Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96cbb93b-2611b15b-394f8014-8e6995da_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|a2ee5b37-e4e51766-6fb1c51f-1811bba1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:51.204369Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a2ee5b37-e4e51766-6fb1c51f-1811bba1_0] Write session: try to update token
2025-10-10T14:38:51.204388Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a2ee5b37-e4e51766-6fb1c51f-1811bba1_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:51.222001Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:51.222031Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:51.222035Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:51.222037Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:51.222051Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602566637398485:8722]
2025-10-10T14:38:51.222056Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602566637398485:8722]
2025-10-10T14:38:51.222060Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602566637398485:8722]
2025-10-10T14:38:51.222110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:51.222126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:51.222134Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:51.222135Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:51.222142Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:51.222147Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:51.222292Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:51.222290Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2800 sessionId: src_id|a2ee5b37-e4e51766-6fb1c51f-1811bba1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:51.225569Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:51.277540Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602567419638131:3900]
2025-10-10T14:38:51.277949Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 pipe creation result: OK TabletId: 72075186224037892 Generation: 2799, pipe: [1:7559602567419638131:3900]
2025-10-10T14:38:51.345001Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:51.345353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:51.345381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:51.345439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602567419638131:3900], now have 1 active actors on pipe
2025-10-10T14:38:51.345725Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:51.345725Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:51.345744Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:51.345831Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2800 reason: error at write: Disconnected sessionId: src_id|a2ee5b37-e4e51766-6fb1c51f-1811bba1_0
2025-10-10T14:38:51.346033Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2800 sessionId: src_id|a2ee5b37-e4e51766-6fb1c51f-1811bba1_0 is DEAD
2025-10-10T14:38:51.346051Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 98 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602567419638131:3900]
2025-10-10T14:38:51.346085Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:51.346405Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2ee5b37-e4e51766-6fb1c51f-1811bba1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:51.346415Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2ee5b37-e4e51766-6fb1c51f-1811bba1_0] Write session will restart in 0.007727s
2025-10-10T14:38:51.346441Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2ee5b37-e4e51766-6fb1c51f-1811bba1_0] Write session: Do CDS request
2025-10-10T14:38:51.346450Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2ee5b37-e4e51766-6fb1c51f-1811bba1_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:51.355953Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a2ee5b37-e4e51766-6fb1c51f-1811bba1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:51.356194Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:51.356214Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2801
2025-10-10T14:38:51.356362Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2801 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:51.356402Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2801 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:51.356413Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2801 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:51.356417Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:51.356902Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2801 sessionId:  describe result for acl check
2025-10-10T14:38:51.356943Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:51.356950Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:51.356952Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:51.356959Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602567419638179:6904] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:51.357544Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602567419638179:6904] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:51.360286Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602567419638179:6904] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:51.361627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:51.365726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:51.366018Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:51.366029Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:51.366043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:51.366012Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602567419638179:6904] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:51.366033Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602567419638179:6904] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:51.366037Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602567419638179:6904] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:51.366060Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2801 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:51.366102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:51.366144Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602566637398631:8719]
2025-10-10T14:38:51.366790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:51.367094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:51.367152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:51.367409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:51.367452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:51.367457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:51.367458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:51.367459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:51.367460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:51.367460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:51.367461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:51.367462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:51.367463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:51.367463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:51.367464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:51.367465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:51.367466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:51.367470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:51.367479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:51.367482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:51.367484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:51.367486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:51.367488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:51.367490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:51.367492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:51.367495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:51.367497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:51.367499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:51.367501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:51.367503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:51.367509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:51.367515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:51.367520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:51.367524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:51.367527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:51.367530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:51.367533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:51.367536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:51.367539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:51.367542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:51.367545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:51.367548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:51.367552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:51.367555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:51.367558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:51.367561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:51.367564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:51.367567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:51.367570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:51.367573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:51.367576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:51.367579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:51.367582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:51.367585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:51.367590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:51.367594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:51.367617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:51.370104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:51.370432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:51.370445Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:51.370447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:51.370450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:51.370456Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2800 [2:7559602566637398631:8719]
2025-10-10T14:38:51.370468Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:51.370485Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:51.370489Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:51.370492Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:51.370495Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:51.370512Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:51.370520Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:51.370528Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:51.370589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:51.370596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:51.370616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:51.370623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:51.370689Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:51.370696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:51.370706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:51.370716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:51.370737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:51.370758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602567419638133:2438], now have 1 active actors on pipe
2025-10-10T14:38:51.370766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602567419638270:6904], now have 1 active actors on pipe
2025-10-10T14:38:51.370772Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602566637398626:8719]
2025-10-10T14:38:51.370775Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602566637398626:8719]
2025-10-10T14:38:51.370777Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602566637398626:8719]
2025-10-10T14:38:51.370787Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:51.370800Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:51.370802Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:51.370805Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:51.370809Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:51.370815Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:51.370819Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:51.370845Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602566637398626:8719]
2025-10-10T14:38:51.370854Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:51.370865Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:51.370847Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2800
2025-10-10T14:38:51.370858Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2800
2025-10-10T14:38:51.370889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:51.370897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:51.370934Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|63bbc042-7c52b524-6da06cf9-2572a444_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:51.370946Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:51.370950Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:51.370952Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:51.370963Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:51.370973Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:51.370985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:51.371134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:51.371144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:51.371170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:51.371286Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2801 partition: 0 MaxSeqNo: 40 sessionId: src_id|63bbc042-7c52b524-6da06cf9-2572a444_0
2025-10-10T14:38:51.371662Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2ee5b37-e4e51766-6fb1c51f-1811bba1_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|63bbc042-7c52b524-6da06cf9-2572a444_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:51.374520Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|63bbc042-7c52b524-6da06cf9-2572a444_0] Write session: try to update token
2025-10-10T14:38:51.374540Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|63bbc042-7c52b524-6da06cf9-2572a444_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:51.388958Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2801 sessionId: src_id|63bbc042-7c52b524-6da06cf9-2572a444_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:51.391667Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:51.392233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:51.392266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:51.392292Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:51.392295Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:51.392299Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:51.392300Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:51.392309Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602566637398626:8719]
2025-10-10T14:38:51.392315Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602566637398626:8719]
2025-10-10T14:38:51.392320Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602566637398626:8719]
2025-10-10T14:38:51.392385Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:51.392390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:51.392398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:51.392399Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:51.392401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:51.392402Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:51.392539Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:51.445979Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602567419638281:3900]
2025-10-10T14:38:51.446354Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 pipe creation result: OK TabletId: 72075186224037892 Generation: 2800, pipe: [1:7559602567419638281:3900]
2025-10-10T14:38:51.511386Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:51.511931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:38:51.512001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602567419638281:3900], now have 1 active actors on pipe
2025-10-10T14:38:51.512127Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:38:51.512192Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:51.512249Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 99 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602567419638281:3900]
2025-10-10T14:38:51.512271Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1661: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 closed with error: reason# too much attempts to restart pipe
2025-10-10T14:38:51.512306Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:51.512316Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:51.512335Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2801 reason: error at write: Disconnected sessionId: src_id|63bbc042-7c52b524-6da06cf9-2572a444_0
2025-10-10T14:38:51.512391Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2801 sessionId: src_id|63bbc042-7c52b524-6da06cf9-2572a444_0 is DEAD
2025-10-10T14:38:51.512413Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 28 consumer shared/user session shared/user_1_28_16584180023090072381_v1 is DEAD
2025-10-10T14:38:51.512543Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559602490110212319:3860] disconnected; active server actors: 1
2025-10-10T14:38:51.512553Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559602490110212319:3860] client user disconnected session shared/user_1_28_16584180023090072381_v1
2025-10-10T14:38:51.512740Z :ERROR: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] Got error. Status: UNAVAILABLE. Description: <main>: Error: too much attempts to restart pipe, code: 500027 
2025-10-10T14:38:51.512756Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63bbc042-7c52b524-6da06cf9-2572a444_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:51.512764Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63bbc042-7c52b524-6da06cf9-2572a444_0] Write session will restart in 0.007912s
2025-10-10T14:38:51.512790Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63bbc042-7c52b524-6da06cf9-2572a444_0] Write session: Do CDS request
2025-10-10T14:38:51.512797Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63bbc042-7c52b524-6da06cf9-2572a444_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:51.512911Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-10T14:38:51.512916Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-10T14:38:51.512923Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] Reconnecting session to cluster  in 0.005401s
2025-10-10T14:38:51.519737Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] Successfully connected. Initializing session
2025-10-10T14:38:51.521821Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|63bbc042-7c52b524-6da06cf9-2572a444_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:51.522714Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:51.522716Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-10T14:38:51.522720Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 29
2025-10-10T14:38:51.522744Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2802
2025-10-10T14:38:51.522909Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 29 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-10T14:38:51.522921Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2802 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:51.522955Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2802 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:51.522960Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2802 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:51.522965Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:51.522971Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 read init: from# ipv6:[::1]:37328, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-10T14:38:51.523047Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 auth for : user
2025-10-10T14:38:51.524736Z :INFO: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] Got InitResponse. ReadSessionId: shared/user_1_29_2309620461212798167_v1
2025-10-10T14:38:51.523443Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2802 sessionId:  describe result for acl check
2025-10-10T14:38:51.523481Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:51.523483Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:51.523485Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:51.523491Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602567419638345:6869] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:51.524103Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602567419638345:6869] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:51.524171Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 Handle describe topics response
2025-10-10T14:38:51.524190Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 auth is DEAD
2025-10-10T14:38:51.524311Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 auth ok: topics# 1, initDone# 0
2025-10-10T14:38:51.524606Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 register session: topic# rt3.dc1--test-topic
2025-10-10T14:38:51.524767Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559602567419638383:6883] connected; active server actors: 1
2025-10-10T14:38:51.524778Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7559602567419638383:6883] session shared/user_1_29_2309620461212798167_v1
2025-10-10T14:38:51.524786Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-10-10T14:38:51.524796Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-10-10T14:38:51.524802Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_29_2309620461212798167_v1" (Sender=[1:7559602567419638322:6883], Pipe=[1:7559602567419638383:6883], Partitions=[], ActiveFamilyCount=0)
2025-10-10T14:38:51.524806Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-10T14:38:51.524820Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-10-10T14:38:51.524828Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_29_2309620461212798167_v1" (Sender=[1:7559602567419638322:6883], Pipe=[1:7559602567419638383:6883], Partitions=[], ActiveFamilyCount=0)
2025-10-10T14:38:51.524841Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_29_2309620461212798167_v1" sender [1:7559602567419638322:6883] lock partition 0 for ReadingSession "shared/user_1_29_2309620461212798167_v1" (Sender=[1:7559602567419638322:6883], Pipe=[1:7559602567419638383:6883], Partitions=[], ActiveFamilyCount=1) generation 1 step 29
2025-10-10T14:38:51.524848Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-10-10T14:38:51.524852Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000030s
2025-10-10T14:38:51.525074Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 29 Session: "shared/user_1_29_2309620461212798167_v1" ClientId: "user" PipeClient { RawX1: 7559602567419638383 RawX2: 4503603922344675 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-10T14:38:51.525102Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-10T14:38:51.526711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602567419638345:6869] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:51.532796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:51.533002Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602567419638345:6869] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:51.533022Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602567419638345:6869] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:51.533027Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602567419638345:6869] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:51.533037Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2802 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:51.533443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:51.533677Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:51.533691Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:51.533701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:51.533759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:51.533810Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602566637398787:8717]
2025-10-10T14:38:51.534443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:51.535232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:51.535299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:51.535649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:51.535722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:51.535731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:51.535733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:51.535734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:51.535736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:51.535737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:51.535738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:51.535740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:51.535741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:51.535743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:51.535744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:51.535746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:51.535747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:51.535753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:51.535765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:51.535781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:51.535786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:51.535790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:51.535794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:51.535799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:51.535803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:51.535808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:51.535812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:51.535816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:51.535820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:51.535825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:51.535833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:51.535843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:51.535850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:51.535856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:51.535861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:51.535867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:51.535871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:51.535877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:51.535885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:51.535890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:51.535895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:51.535900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:51.535906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:51.535913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:51.535918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:51.535924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:51.535934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:51.535940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:51.535944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:51.535950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:51.535955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:51.535960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:51.535965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:51.535970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:51.535975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:51.535980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:51.536017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:51.548639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:51.549005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:51.549018Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:51.549021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:51.549025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:51.549033Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2801 [2:7559602566637398787:8717]
2025-10-10T14:38:51.549049Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:51.549071Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:51.549079Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:51.549083Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:51.549087Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:51.549108Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:51.549121Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:51.549131Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:51.549198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:51.549207Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:51.549209Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:51.549211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:51.549307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:51.549316Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:51.549341Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:51.549354Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:51.549371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:51.549403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602567419638283:2438], now have 1 active actors on pipe
2025-10-10T14:38:51.549412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602567419638425:6869], now have 1 active actors on pipe
2025-10-10T14:38:51.549416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602567419638393:6861], now have 1 active actors on pipe
2025-10-10T14:38:51.549424Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602566637398781:8717]
2025-10-10T14:38:51.549427Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602566637398781:8717]
2025-10-10T14:38:51.549429Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602566637398781:8717]
2025-10-10T14:38:51.549446Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:51.549465Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:51.549492Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:51.549502Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:51.549541Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602566637398781:8717]
2025-10-10T14:38:51.549549Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:51.549662Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2801
2025-10-10T14:38:51.549706Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2801
2025-10-10T14:38:51.549732Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 2801, pipe: [1:7559602567419638393:6861]
2025-10-10T14:38:51.549592Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:51.549615Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:51.549618Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:51.549627Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:51.549969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:51.549984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:51.550002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_29_2309620461212798167_v1 on pipe: [1:7559602567419638393:6861]
2025-10-10T14:38:51.550031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:51.550039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:51.550044Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_29_2309620461212798167_v1:1 with generation 2801
2025-10-10T14:38:51.550057Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:51.550072Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:51.550078Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:51.550102Z node 2 :PERSQUEUE DEBUG: partition.cpp:3747: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_29_2309620461212798167_v1
2025-10-10T14:38:51.550110Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:51.550163Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b8755bf1-9a03e133-a18d40d-58e55031_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:51.550175Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:38:51.550181Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:38:51.554673Z node 2 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:38:51.554709Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:38:51.554720Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:51.554727Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:51.554729Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:51.554744Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:51.554766Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:51.554779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-10T14:38:51.554796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-10T14:38:51.554817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:51.554979Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 40 WriteTimestampMS: 1760106661000 SizeLag: 17206678 WriteTimestampEstimateMS: 1760107131548 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-10T14:38:51.555013Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 40 readOffset 0 committedOffset 0
2025-10-10T14:38:51.555028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:51.555043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:51.555054Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 sending to client partition status
2025-10-10T14:38:51.555077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:51.555195Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2802 partition: 0 MaxSeqNo: 40 sessionId: src_id|b8755bf1-9a03e133-a18d40d-58e55031_0
2025-10-10T14:38:51.555521Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63bbc042-7c52b524-6da06cf9-2572a444_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|b8755bf1-9a03e133-a18d40d-58e55031_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:51.558374Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b8755bf1-9a03e133-a18d40d-58e55031_0] Write session: try to update token
2025-10-10T14:38:51.558396Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b8755bf1-9a03e133-a18d40d-58e55031_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:51.575416Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2802 sessionId: src_id|b8755bf1-9a03e133-a18d40d-58e55031_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:51.578196Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:51.578410Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:51.578433Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:51.578437Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:51.578439Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:51.578450Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602566637398781:8717]
2025-10-10T14:38:51.578454Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602566637398781:8717]
2025-10-10T14:38:51.578458Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602566637398781:8717]
2025-10-10T14:38:51.578496Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:51.578517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:51.578520Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:51.578525Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:51.578526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:51.578547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:51.578556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:51.578558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:51.578691Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:51.693591Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:51.694380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_29_2309620461212798167_v1
2025-10-10T14:38:51.694398Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:51.694589Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_29_2309620461212798167_v1
2025-10-10T14:38:51.696028Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8755bf1-9a03e133-a18d40d-58e55031_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:38:51.696040Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8755bf1-9a03e133-a18d40d-58e55031_0] Write session will restart in 0.006935s
2025-10-10T14:38:51.696076Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8755bf1-9a03e133-a18d40d-58e55031_0] Write session: Do CDS request
2025-10-10T14:38:51.696083Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8755bf1-9a03e133-a18d40d-58e55031_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:51.695266Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:38:51.695356Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2802 reason: status is not ok: tablet will be restarted right now sessionId: src_id|b8755bf1-9a03e133-a18d40d-58e55031_0
2025-10-10T14:38:51.695544Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2802 sessionId: src_id|b8755bf1-9a03e133-a18d40d-58e55031_0 is DEAD
2025-10-10T14:38:51.695670Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 0 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602567419638393:6861]
2025-10-10T14:38:51.695683Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:51.703948Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b8755bf1-9a03e133-a18d40d-58e55031_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:51.704056Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:51.704078Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2803
2025-10-10T14:38:51.704192Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2803 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:51.704236Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2803 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:51.704246Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2803 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:51.704251Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:51.704804Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2803 sessionId:  describe result for acl check
2025-10-10T14:38:51.704850Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:51.704858Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:51.704861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:51.704868Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602567419638484:6834] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:51.705469Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602567419638484:6834] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:51.709482Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602567419638484:6834] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:51.714140Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602567419638484:6834] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:51.714162Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602567419638484:6834] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:51.714166Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602567419638484:6834] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:51.714175Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2803 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:51.723560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:51.727111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:51.727362Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:51.727374Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:51.727387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:51.727444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:51.727487Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602566637398969:8692]
2025-10-10T14:38:51.728142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:51.728530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:51.728613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:51.728977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:51.729083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:51.729091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:51.729092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:51.729094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:51.729095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:51.729097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:51.729099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:51.729100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:51.729101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:51.729102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:51.729103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:51.729105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:51.729106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:51.729112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:51.729127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:51.729130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:51.729134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:51.729137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:51.729141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:51.729145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:51.729148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:51.729152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:51.729155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:51.729159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:51.729162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:51.729166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:51.729175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:51.729184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:51.729190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:51.729195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:51.729200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:51.729205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:51.729210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:51.729226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:51.729238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:51.729243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:51.729247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:51.729253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:51.729258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:51.729262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:51.729266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:51.729271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:51.729281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:51.729286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:51.729294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:51.729299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:51.729306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:51.729315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:51.729319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:51.729344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:51.729349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:51.729354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:51.729389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:51.732688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:51.733486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:51.733510Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:51.733513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:51.733519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:51.733527Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2802 [2:7559602566637398969:8692]
2025-10-10T14:38:51.733546Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:51.733575Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:51.733590Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:51.733595Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:51.733597Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:51.733629Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:51.733638Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:51.733647Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:51.733735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:51.733747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:51.733750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:51.733752Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:51.733839Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:51.733866Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:51.733883Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:51.733904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:51.733932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:51.733968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602567419638471:2438], now have 1 active actors on pipe
2025-10-10T14:38:51.733988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602567419638529:6834], now have 1 active actors on pipe
2025-10-10T14:38:51.733998Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602566637398964:8692]
2025-10-10T14:38:51.734000Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602566637398964:8692]
2025-10-10T14:38:51.734003Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602566637398964:8692]
2025-10-10T14:38:51.734019Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:51.734038Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:51.734062Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:51.734070Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:51.734078Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:51.734090Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:51.734092Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:51.734117Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602566637398964:8692]
2025-10-10T14:38:51.734123Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:51.734132Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:51.734374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:51.734391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:51.734440Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|df26c572-ae2d763-16fb3369-504c91b7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:51.734460Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:51.734465Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:51.734469Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:51.734483Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:51.734498Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:51.734518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:51.734741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:51.734755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:51.734789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:51.735360Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8755bf1-9a03e133-a18d40d-58e55031_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|df26c572-ae2d763-16fb3369-504c91b7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:51.734218Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2802
2025-10-10T14:38:51.734271Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2802
2025-10-10T14:38:51.734900Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2803 partition: 0 MaxSeqNo: 40 sessionId: src_id|df26c572-ae2d763-16fb3369-504c91b7_0
2025-10-10T14:38:51.738270Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|df26c572-ae2d763-16fb3369-504c91b7_0] Write session: try to update token
2025-10-10T14:38:51.738291Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|df26c572-ae2d763-16fb3369-504c91b7_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:51.755208Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2803 sessionId: src_id|df26c572-ae2d763-16fb3369-504c91b7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:51.758211Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:51.758606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:51.758632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:51.758676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:38:51.765240Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:51.765275Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:51.765279Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:51.765281Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:51.765294Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602566637398964:8692]
2025-10-10T14:38:51.765300Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602566637398964:8692]
2025-10-10T14:38:51.765305Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602566637398964:8692]
2025-10-10T14:38:51.759445Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:38:51.765377Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:51.765394Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:51.765408Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:51.765414Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:51.765424Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:51.765427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:51.765586Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:51.795671Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602567419638633:6861]
2025-10-10T14:38:51.796027Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 pipe creation result: OK TabletId: 72075186224037892 Generation: 2802, pipe: [1:7559602567419638633:6861]
2025-10-10T14:38:51.883893Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:51.892079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:51.892108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:51.892288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:51.892350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:51.892417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:51.892480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:51.892731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:51.892741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:51.892807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:51.892875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:51.892943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:51.893014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:51.893050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:51.893054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:51.893120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:51.893183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:51.893250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:51.893311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:51.893374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:51.893381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:51.893448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:51.893773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:51.893834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:51.893908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:51.893956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:51.893964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:51.894038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:51.894109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:51.894184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:51.894256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:51.894303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:51.894310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:51.894394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:51.894460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:51.894533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:51.894610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:51.894656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:51.894663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:51.894732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:51.894796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:51.894867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:51.894941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:51.894984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:51.894993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:51.895064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:51.895132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:51.895198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:51.895268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:51.895315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:51.895325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:51.895397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:51.895463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:51.895534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:51.895602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:51.895645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:51.895657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:51.895730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:51.895795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:51.895866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:51.895939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:51.895992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:51.896000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:51.896069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602567419638633:6861], now have 1 active actors on pipe
2025-10-10T14:38:51.896312Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:51.896345Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 1 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602567419638633:6861]
2025-10-10T14:38:51.896378Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:51.896386Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:51.896417Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2803 reason: error at write: Disconnected sessionId: src_id|df26c572-ae2d763-16fb3369-504c91b7_0
2025-10-10T14:38:51.896725Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2803 sessionId: src_id|df26c572-ae2d763-16fb3369-504c91b7_0 is DEAD
2025-10-10T14:38:51.896781Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df26c572-ae2d763-16fb3369-504c91b7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:51.896795Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df26c572-ae2d763-16fb3369-504c91b7_0] Write session will restart in 0.008453s
2025-10-10T14:38:51.896739Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:51.896823Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df26c572-ae2d763-16fb3369-504c91b7_0] Write session: Do CDS request
2025-10-10T14:38:51.896830Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df26c572-ae2d763-16fb3369-504c91b7_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:51.906973Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|df26c572-ae2d763-16fb3369-504c91b7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:51.907277Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:51.907298Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2804
2025-10-10T14:38:51.907440Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2804 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:51.907479Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2804 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:51.907491Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2804 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:51.907495Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:51.907984Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2804 sessionId:  describe result for acl check
2025-10-10T14:38:51.908026Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:51.908032Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:51.908034Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:51.908040Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602567419638709:6794] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:51.908610Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602567419638709:6794] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:51.911509Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602567419638709:6794] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:51.915670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:51.916036Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602567419638709:6794] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:51.916054Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602567419638709:6794] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:51.916058Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602567419638709:6794] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:51.916067Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2804 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:51.916188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:51.916698Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:51.916714Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:51.916729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:51.916817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:51.916866Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602566637399112:8685]
2025-10-10T14:38:51.917502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:51.917881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:51.917930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:51.918255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:51.918330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:51.918339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:51.918340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:51.918341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:51.918342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:51.918344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:51.918345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:51.918347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:51.918348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:51.918349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:51.918351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:51.918352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:51.918354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:51.918361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:51.918375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:51.918381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:51.918385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:51.918389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:51.918394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:51.918398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:51.918401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:51.918404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:51.918408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:51.918411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:51.918415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:51.918419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:51.918429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:51.918438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:51.918446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:51.918451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:51.918455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:51.918461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:51.918467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:51.918473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:51.918478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:51.918484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:51.918489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:51.918494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:51.918500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:51.918505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:51.918512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:51.918517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:51.918522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:51.918531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:51.918541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:51.918546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:51.918556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:51.918562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:51.918566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:51.918571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:51.918576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:51.918581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:51.918624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:51.921241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:51.921870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:51.921885Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:51.921887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:51.921892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:51.921898Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2803 [2:7559602566637399112:8685]
2025-10-10T14:38:51.921911Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:51.921930Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:51.921934Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:51.921938Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:51.921941Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:51.921959Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:51.921973Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:51.921982Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:51.922264Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2803
2025-10-10T14:38:51.922293Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2803
2025-10-10T14:38:51.922038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:51.922049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:51.922053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:51.922055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:51.922265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:51.922268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:51.922281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:51.922295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:51.922314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:51.922338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602567419638644:2438], now have 1 active actors on pipe
2025-10-10T14:38:51.922341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602567419638780:6794], now have 1 active actors on pipe
2025-10-10T14:38:51.922356Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602566637399106:8685]
2025-10-10T14:38:51.922360Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602566637399106:8685]
2025-10-10T14:38:51.922362Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602566637399106:8685]
2025-10-10T14:38:51.922378Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:51.922391Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:51.922402Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:51.922406Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:51.922408Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:51.922408Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:51.922411Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:51.922441Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602566637399106:8685]
2025-10-10T14:38:51.922449Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:51.922454Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:51.922632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:51.922641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:51.922676Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3c48bb63-f6dade7c-8f5182b3-a9bfefe_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:51.922685Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:51.922689Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:51.922692Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:51.922704Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:51.922717Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:51.922735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:51.922934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:51.922947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:51.922981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:51.923131Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2804 partition: 0 MaxSeqNo: 40 sessionId: src_id|3c48bb63-f6dade7c-8f5182b3-a9bfefe_0
2025-10-10T14:38:51.923560Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df26c572-ae2d763-16fb3369-504c91b7_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|3c48bb63-f6dade7c-8f5182b3-a9bfefe_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:51.926313Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3c48bb63-f6dade7c-8f5182b3-a9bfefe_0] Write session: try to update token
2025-10-10T14:38:51.926335Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3c48bb63-f6dade7c-8f5182b3-a9bfefe_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:51.934624Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:38:51.934649Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:51.934666Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602566637399106:8685]
2025-10-10T14:38:51.934717Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:38:51.934738Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:38:51.934929Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:38:51.935065Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:51.935196Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:51.935330Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:51.935514Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:38:51.935554Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:38:51.943635Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2804 sessionId: src_id|3c48bb63-f6dade7c-8f5182b3-a9bfefe_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:51.946406Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:51.946806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:51.946836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:51.946881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:38:51.946988Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:38:51.953841Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:51.953865Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:51.953870Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:51.953872Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:51.953885Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602566637399106:8685]
2025-10-10T14:38:51.953891Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602566637399106:8685]
2025-10-10T14:38:51.953896Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602566637399106:8685]
2025-10-10T14:38:51.953954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:51.953956Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:51.953964Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:51.953965Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:51.953966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:51.953969Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:51.954113Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:51.996386Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602567419638792:6861]
2025-10-10T14:38:51.996700Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 pipe creation result: OK TabletId: 72075186224037892 Generation: 2803, pipe: [1:7559602567419638792:6861]
2025-10-10T14:38:52.070103Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:52.078906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:52.078938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:52.079122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:52.079189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:52.079255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:52.079320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:52.079370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:52.079380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:52.079461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:52.079529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:52.079602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:52.079683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:52.079732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:52.079740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:52.079821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:52.079889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:52.079954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:52.080022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:52.080067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:52.080075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:52.080143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:52.080209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:52.080280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:52.080347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:52.080394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:52.080403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:52.080479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:52.080548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:52.080620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:52.080690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:52.080737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:52.080745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:52.080818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:52.080888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:52.080963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:52.081036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:52.081088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:52.081093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:52.081168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:52.081245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:52.081321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:52.081411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:52.081463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:52.081472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:52.081548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:52.081630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:52.081710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:52.081789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:52.081844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:52.081851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:52.081927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:52.081997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:52.082068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:52.082141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:52.082193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:52.082202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:52.082279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:52.082356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:52.082426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:52.082496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:52.082546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:52.082555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:52.082628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602567419638792:6861], now have 1 active actors on pipe
2025-10-10T14:38:52.082955Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:52.083046Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 2 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602567419638792:6861]
2025-10-10T14:38:52.083499Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:52.083511Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:52.083559Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2804 reason: error at write: Disconnected sessionId: src_id|3c48bb63-f6dade7c-8f5182b3-a9bfefe_0
2025-10-10T14:38:52.083860Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2804 sessionId: src_id|3c48bb63-f6dade7c-8f5182b3-a9bfefe_0 is DEAD
2025-10-10T14:38:52.083961Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c48bb63-f6dade7c-8f5182b3-a9bfefe_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:52.083973Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c48bb63-f6dade7c-8f5182b3-a9bfefe_0] Write session will restart in 0.009747s
2025-10-10T14:38:52.084001Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c48bb63-f6dade7c-8f5182b3-a9bfefe_0] Write session: Do CDS request
2025-10-10T14:38:52.084007Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c48bb63-f6dade7c-8f5182b3-a9bfefe_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:52.084001Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:52.097944Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3c48bb63-f6dade7c-8f5182b3-a9bfefe_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:52.098083Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:52.098115Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2805
2025-10-10T14:38:52.098246Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2805 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:52.098283Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2805 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:52.098304Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2805 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:52.098308Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:52.098495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:52.098717Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2805 sessionId:  describe result for acl check
2025-10-10T14:38:52.098756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:52.098765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:52.098767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:52.098774Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602571714606197:6786] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:52.099346Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602571714606197:6786] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:52.101547Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602571714606197:6786] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:52.101917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:52.102146Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:52.102160Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:52.102173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:52.102225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:52.102270Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602570932366551:8681]
2025-10-10T14:38:52.102803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:52.103120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:52.103159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:52.103476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:52.103566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:52.103572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:52.103574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:52.103575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:52.103576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:52.103577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:52.103579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:52.103580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:52.103581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:52.103583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:52.103584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:52.103585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:52.103587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:52.103593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:52.103603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:52.103606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:52.103608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:52.103611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:52.103613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:52.103615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:52.103617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:52.103619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:52.103622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:52.103624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:52.103626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:52.103628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:52.103634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:52.103639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:52.103644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:52.103648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:52.103652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:52.103656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:52.103659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:52.103662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:52.103665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:52.103668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:52.103670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:52.103674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:52.103677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:52.103680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:52.103683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:52.103686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:52.103689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:52.103693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:52.103695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:52.103699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:52.103704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:52.103707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:52.103710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:52.103713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:52.103716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:52.103720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:52.103755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:52.104082Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602571714606197:6786] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:52.104097Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602571714606197:6786] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:52.104101Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602571714606197:6786] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:52.104109Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2805 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:52.106139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:52.106898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:52.106913Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:52.106915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:52.106919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:52.106926Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2804 [2:7559602570932366551:8681]
2025-10-10T14:38:52.106940Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:52.106958Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:52.106962Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:52.106966Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:52.106969Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:52.106989Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:52.107002Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:52.107012Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:52.107080Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:52.107087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:52.107089Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:52.107091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:52.107164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:52.107171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:52.107184Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:52.107201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:52.107223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:52.107249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602571714606231:6786], now have 1 active actors on pipe
2025-10-10T14:38:52.107257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602571714606090:2438], now have 1 active actors on pipe
2025-10-10T14:38:52.107265Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602570932366546:8681]
2025-10-10T14:38:52.107272Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602570932366546:8681]
2025-10-10T14:38:52.107274Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602570932366546:8681]
2025-10-10T14:38:52.107289Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:52.107305Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:52.107307Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:52.107317Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:52.107319Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:52.107323Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:52.107327Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:52.107353Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602570932366546:8681]
2025-10-10T14:38:52.107364Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:52.107371Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:52.113235Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2804
2025-10-10T14:38:52.113270Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2804
2025-10-10T14:38:52.113461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:52.113481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:52.113521Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bf3df29a-d9ce986-78e95d2c-f4685a73_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:52.113531Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:52.113536Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:52.113539Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:52.113550Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:52.113567Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:52.113594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:52.113793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:52.113803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:52.113818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:52.113895Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2805 partition: 0 MaxSeqNo: 40 sessionId: src_id|bf3df29a-d9ce986-78e95d2c-f4685a73_0
2025-10-10T14:38:52.114305Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c48bb63-f6dade7c-8f5182b3-a9bfefe_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|bf3df29a-d9ce986-78e95d2c-f4685a73_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:52.117100Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bf3df29a-d9ce986-78e95d2c-f4685a73_0] Write session: try to update token
2025-10-10T14:38:52.117119Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bf3df29a-d9ce986-78e95d2c-f4685a73_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:52.131517Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:38:52.131544Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:52.131557Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602570932366546:8681]
2025-10-10T14:38:52.131621Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:38:52.131630Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:38:52.131819Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:38:52.131974Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:52.132123Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:52.132296Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:52.132519Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:38:52.132577Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:38:52.138628Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2805 sessionId: src_id|bf3df29a-d9ce986-78e95d2c-f4685a73_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:52.141532Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:52.142035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:52.142061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:52.142104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:38:52.142200Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:38:52.145052Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:52.145079Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:52.145083Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:52.145085Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:52.145097Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602570932366546:8681]
2025-10-10T14:38:52.145102Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602570932366546:8681]
2025-10-10T14:38:52.145106Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602570932366546:8681]
2025-10-10T14:38:52.145158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:52.145160Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:52.145167Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:52.145172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:52.145172Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:52.145174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:52.145322Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:52.185501Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602571714606239:6861]
2025-10-10T14:38:52.189626Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 pipe creation result: OK TabletId: 72075186224037892 Generation: 2804, pipe: [1:7559602571714606239:6861]
2025-10-10T14:38:52.265316Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:52.273663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:52.273695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:52.273906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:52.273984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:52.274062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:52.274143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:52.274189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:52.274199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:52.274271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:52.274335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:52.274406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:52.274500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:52.274557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:52.274566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:52.274640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:52.274704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:52.274772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:52.274845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:52.274893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:52.274900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:52.274970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:52.275043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:52.277394Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:52.277419Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:52.275107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:52.275177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:52.275216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:52.275219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:52.275295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:52.275355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:52.275414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:52.277431Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 3 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602571714606239:6861]
2025-10-10T14:38:52.275477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:52.277454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2805 reason: error at write: Disconnected sessionId: src_id|bf3df29a-d9ce986-78e95d2c-f4685a73_0
2025-10-10T14:38:52.275521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:52.277458Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:52.275524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:52.275599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:52.275661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:52.275721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:52.275784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:52.275828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:52.275831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:52.275902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:52.275961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:52.276027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:52.276087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:52.276133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:52.276136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:52.276209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:52.276269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:52.276349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:52.276412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:52.276456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:52.276459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:52.276532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:52.276599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:52.276661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:52.276724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:52.276767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:52.276770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:52.276845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:52.276904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:52.276965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:52.277024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:52.277067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:52.277070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:52.277148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602571714606239:6861], now have 1 active actors on pipe
2025-10-10T14:38:52.277697Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2805 sessionId: src_id|bf3df29a-d9ce986-78e95d2c-f4685a73_0 is DEAD
2025-10-10T14:38:52.278492Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:52.281565Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bf3df29a-d9ce986-78e95d2c-f4685a73_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:52.281588Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bf3df29a-d9ce986-78e95d2c-f4685a73_0] Write session will restart in 0.006417s
2025-10-10T14:38:52.281631Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bf3df29a-d9ce986-78e95d2c-f4685a73_0] Write session: Do CDS request
2025-10-10T14:38:52.281637Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bf3df29a-d9ce986-78e95d2c-f4685a73_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:52.288936Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bf3df29a-d9ce986-78e95d2c-f4685a73_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:52.289049Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:52.289069Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2806
2025-10-10T14:38:52.289225Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2806 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:52.289262Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2806 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:52.289274Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2806 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:52.289278Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:52.289819Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2806 sessionId:  describe result for acl check
2025-10-10T14:38:52.289858Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:52.289864Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:52.289866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:52.289872Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602571714606253:6751] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:52.290506Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602571714606253:6751] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:52.293946Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602571714606253:6751] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:52.298437Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602571714606253:6751] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:52.298459Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602571714606253:6751] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:52.298463Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602571714606253:6751] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:52.298474Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2806 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:52.304134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:52.307580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:52.307845Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:52.307867Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:52.307881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:52.307952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:52.308000Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602570932366700:8673]
2025-10-10T14:38:52.308626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:52.309003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:52.309061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:52.309435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:52.309504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:52.309512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:52.309513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:52.309515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:52.309517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:52.309518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:52.309520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:52.309522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:52.309523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:52.309525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:52.309527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:52.309528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:52.309530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:52.309536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:52.309552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:52.309557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:52.309562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:52.309566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:52.309571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:52.309576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:52.309580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:52.309584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:52.309589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:52.309607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:52.309611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:52.309615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:52.309624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:52.309633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:52.309640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:52.309646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:52.309651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:52.309656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:52.309662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:52.309667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:52.309672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:52.309677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:52.309682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:52.309686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:52.309692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:52.309697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:52.309701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:52.309713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:52.309718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:52.309730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:52.309735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:52.309742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:52.309747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:52.309753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:52.309759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:52.309764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:52.309769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:52.309774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:52.309825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:52.312412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:52.313307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:52.313323Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:52.313326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:52.313342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:52.313349Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2805 [2:7559602570932366700:8673]
2025-10-10T14:38:52.313363Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:52.313384Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:52.313387Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:52.313391Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:52.313393Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:52.313413Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:52.313426Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:52.313449Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:52.313522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:52.313529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:52.313531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:52.313534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:52.313972Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2805
2025-10-10T14:38:52.314037Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2805
2025-10-10T14:38:52.313619Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:52.313628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:52.313649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:52.313661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:52.313679Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:52.313703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602571714606241:2438], now have 1 active actors on pipe
2025-10-10T14:38:52.313707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602571714606310:6751], now have 1 active actors on pipe
2025-10-10T14:38:52.313716Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602570932366694:8673]
2025-10-10T14:38:52.313718Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602570932366694:8673]
2025-10-10T14:38:52.313720Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602570932366694:8673]
2025-10-10T14:38:52.313733Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:52.313747Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:52.313751Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:52.313754Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:52.313756Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:52.313763Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:52.313766Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:52.313797Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602570932366694:8673]
2025-10-10T14:38:52.313804Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:52.313809Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:52.314168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:52.314173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:52.314203Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3402e39-7bb74cb3-ee32612f-816f6c87_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:52.314216Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:52.314221Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:52.314223Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:52.314245Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:52.314258Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:52.314273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:52.314469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:52.314479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:52.314497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:52.314573Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2806 partition: 0 MaxSeqNo: 40 sessionId: src_id|3402e39-7bb74cb3-ee32612f-816f6c87_0
2025-10-10T14:38:52.315064Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bf3df29a-d9ce986-78e95d2c-f4685a73_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|3402e39-7bb74cb3-ee32612f-816f6c87_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:52.317848Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3402e39-7bb74cb3-ee32612f-816f6c87_0] Write session: try to update token
2025-10-10T14:38:52.317870Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3402e39-7bb74cb3-ee32612f-816f6c87_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:52.325701Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:38:52.325726Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:52.325737Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602570932366694:8673]
2025-10-10T14:38:52.325789Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:38:52.325793Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:38:52.325985Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:38:52.326132Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:52.326276Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:52.326412Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:52.326609Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:38:52.326649Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:38:52.332615Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2806 sessionId: src_id|3402e39-7bb74cb3-ee32612f-816f6c87_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:52.335462Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:52.335727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:52.335752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:52.335806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:38:52.335932Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:38:52.344695Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:52.344721Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:52.344725Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:52.344727Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:52.344740Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602570932366694:8673]
2025-10-10T14:38:52.344744Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602570932366694:8673]
2025-10-10T14:38:52.344749Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602570932366694:8673]
2025-10-10T14:38:52.344802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:52.344804Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:52.344810Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:52.344812Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:52.344813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:52.344838Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:52.344966Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:52.377835Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602571714606391:6861]
2025-10-10T14:38:52.378191Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 pipe creation result: OK TabletId: 72075186224037892 Generation: 2805, pipe: [1:7559602571714606391:6861]
2025-10-10T14:38:52.470429Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:52.479081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:52.479121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:52.479315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:52.479389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:52.479456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:52.479525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:52.479582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:52.479593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:52.479661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:52.479726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:52.479794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:52.479872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:52.479920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:52.479931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:52.480004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:52.480070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:52.480145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:52.480213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:52.480264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:52.480272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:52.480347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:52.480414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:52.480481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:52.480557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:52.480607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:52.480615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:52.480683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:52.480745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:52.480811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:52.480876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:52.480920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:52.480928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:52.480997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:52.481062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:52.481130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:52.481195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:52.481243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:52.481250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:52.481323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:52.481408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:52.481482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:52.481556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:52.481615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:52.481619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:52.481690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:52.481759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:52.481831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:52.481895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:52.481939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:52.481946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:52.482036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:52.482099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:52.482162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:52.482233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:52.482286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:52.482294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:52.482362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:52.482421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:52.482496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:52.482568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:52.482613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:52.482621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:52.482685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602571714606391:6861], now have 1 active actors on pipe
2025-10-10T14:38:52.483007Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 4 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602571714606391:6861]
2025-10-10T14:38:52.483060Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:52.483067Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:52.483102Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2806 reason: error at write: Disconnected sessionId: src_id|3402e39-7bb74cb3-ee32612f-816f6c87_0
2025-10-10T14:38:52.483345Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2806 sessionId: src_id|3402e39-7bb74cb3-ee32612f-816f6c87_0 is DEAD
2025-10-10T14:38:52.483361Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:52.483707Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:52.484228Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3402e39-7bb74cb3-ee32612f-816f6c87_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:52.484244Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3402e39-7bb74cb3-ee32612f-816f6c87_0] Write session will restart in 0.009884s
2025-10-10T14:38:52.484270Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3402e39-7bb74cb3-ee32612f-816f6c87_0] Write session: Do CDS request
2025-10-10T14:38:52.484276Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3402e39-7bb74cb3-ee32612f-816f6c87_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:52.495972Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3402e39-7bb74cb3-ee32612f-816f6c87_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:52.496082Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:52.496104Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2807
2025-10-10T14:38:52.496224Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2807 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:52.496265Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2807 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:52.496270Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2807 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:52.496275Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:52.496709Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2807 sessionId:  describe result for acl check
2025-10-10T14:38:52.496747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:52.496749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:52.496751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:52.496757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602571714606501:6753] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:52.497380Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602571714606501:6753] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:52.499160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:52.500464Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602571714606501:6753] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:52.503316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:52.503584Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:52.503606Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:52.503620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:52.503693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:52.503745Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602570932366857:8660]
2025-10-10T14:38:52.504409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:52.504796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:52.504852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:52.505199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:52.505280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:52.505290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:52.505291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:52.505293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:52.505294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:52.505295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:52.505297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:52.505298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:52.505299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:52.505300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:52.505302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:52.505303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:52.505304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:52.505310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:52.505324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:52.505343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:52.505347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:52.505351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:52.505355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:52.505359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:52.505363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:52.505367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:52.505371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:52.505375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:52.505379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:52.505382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:52.505394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:52.505403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:52.505409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:52.505417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:52.505421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:52.505427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:52.505431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:52.505436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:52.505442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:52.505447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:52.505451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:52.505456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:52.505460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:52.505465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:52.505469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:52.505473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:52.505478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:52.505483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:52.505488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:52.505493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:52.505498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:52.505503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:52.505508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:52.505514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:52.505519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:52.505534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:52.505575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:52.505565Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602571714606501:6753] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:52.505584Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602571714606501:6753] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:52.505588Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602571714606501:6753] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:52.505607Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2807 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:52.508144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:52.508815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:52.508833Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:52.508836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:52.508840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:52.508846Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2806 [2:7559602570932366857:8660]
2025-10-10T14:38:52.508861Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:52.508880Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:52.508890Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:52.508894Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:52.508897Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:52.508916Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:52.508931Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:52.508942Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:52.509007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:52.509015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:52.509017Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:52.509020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:52.509094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:52.509099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:52.509114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:52.509126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:52.509148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:52.509176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602571714606535:6753], now have 1 active actors on pipe
2025-10-10T14:38:52.509185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602571714606393:2438], now have 1 active actors on pipe
2025-10-10T14:38:52.509193Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602570932366852:8660]
2025-10-10T14:38:52.509196Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602570932366852:8660]
2025-10-10T14:38:52.509198Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602570932366852:8660]
2025-10-10T14:38:52.509213Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:52.509234Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:52.509240Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:52.509244Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:52.509246Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:52.509257Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:52.509261Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:52.509288Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602570932366852:8660]
2025-10-10T14:38:52.509298Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:52.509300Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:52.509349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:52.509360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:52.509399Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1af902c7-85ce4429-54d8c40c-a57802df_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:52.509412Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:52.509416Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:52.509420Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:52.509433Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:52.509252Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2806
2025-10-10T14:38:52.509263Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2806
2025-10-10T14:38:52.509444Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:52.509468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:52.509675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:52.509683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:52.509699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:52.509811Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2807 partition: 0 MaxSeqNo: 40 sessionId: src_id|1af902c7-85ce4429-54d8c40c-a57802df_0
2025-10-10T14:38:52.510312Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3402e39-7bb74cb3-ee32612f-816f6c87_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|1af902c7-85ce4429-54d8c40c-a57802df_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:52.513228Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1af902c7-85ce4429-54d8c40c-a57802df_0] Write session: try to update token
2025-10-10T14:38:52.513249Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1af902c7-85ce4429-54d8c40c-a57802df_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:52.530152Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:52.530176Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:52.530180Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:52.530182Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:52.530195Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602570932366852:8660]
2025-10-10T14:38:52.530200Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602570932366852:8660]
2025-10-10T14:38:52.530205Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602570932366852:8660]
2025-10-10T14:38:52.530261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:52.530262Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:52.530269Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:52.530274Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:52.530276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:52.530278Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:52.530429Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:52.532019Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2807 sessionId: src_id|1af902c7-85ce4429-54d8c40c-a57802df_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:52.534940Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:52.583129Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602571714606544:6861]
2025-10-10T14:38:52.583462Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 pipe creation result: OK TabletId: 72075186224037892 Generation: 2806, pipe: [1:7559602571714606544:6861]
2025-10-10T14:38:52.646532Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:52.647076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:52.647094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:52.647145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602571714606544:6861], now have 1 active actors on pipe
2025-10-10T14:38:52.647404Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:52.647962Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1af902c7-85ce4429-54d8c40c-a57802df_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:52.647974Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1af902c7-85ce4429-54d8c40c-a57802df_0] Write session will restart in 0.009379s
2025-10-10T14:38:52.648016Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1af902c7-85ce4429-54d8c40c-a57802df_0] Write session: Do CDS request
2025-10-10T14:38:52.648023Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1af902c7-85ce4429-54d8c40c-a57802df_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:52.647519Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 5 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602571714606544:6861]
2025-10-10T14:38:52.647564Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:52.647567Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:52.647626Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2807 reason: error at write: Disconnected sessionId: src_id|1af902c7-85ce4429-54d8c40c-a57802df_0
2025-10-10T14:38:52.647814Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2807 sessionId: src_id|1af902c7-85ce4429-54d8c40c-a57802df_0 is DEAD
2025-10-10T14:38:52.647982Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:52.658961Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1af902c7-85ce4429-54d8c40c-a57802df_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:52.659031Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:52.659053Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2808
2025-10-10T14:38:52.659210Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2808 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:52.659251Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2808 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:52.659262Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2808 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:52.659268Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:52.659892Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2808 sessionId:  describe result for acl check
2025-10-10T14:38:52.659931Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:52.659933Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:52.659935Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:52.659941Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602571714606634:6728] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:52.660533Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602571714606634:6728] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:52.663403Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602571714606634:6728] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:52.664354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:52.667892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:52.668136Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:52.668147Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:52.668160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:52.668155Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602571714606634:6728] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:52.668170Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602571714606634:6728] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:52.668174Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602571714606634:6728] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:52.668183Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2808 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:52.668209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:52.668275Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602570932367004:8671]
2025-10-10T14:38:52.668924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:52.669296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:52.669409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:52.669850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:52.669957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:52.669967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:52.669968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:52.669970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:52.669972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:52.669973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:52.669974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:52.669976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:52.669977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:52.669979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:52.669980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:52.669981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:52.669983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:52.669989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:52.670005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:52.670010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:52.670015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:52.670019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:52.670024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:52.670028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:52.670032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:52.670037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:52.670041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:52.670046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:52.670050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:52.670055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:52.670068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:52.670078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:52.670086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:52.670100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:52.670106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:52.670117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:52.670123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:52.670133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:52.670138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:52.670146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:52.670152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:52.670158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:52.670164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:52.670170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:52.670177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:52.670183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:52.670194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:52.670201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:52.670224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:52.670235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:52.670241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:52.670248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:52.670253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:52.670259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:52.670270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:52.670275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:52.670320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:52.672759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:52.673578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:52.673607Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:52.673609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:52.673613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:52.673619Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2807 [2:7559602570932367004:8671]
2025-10-10T14:38:52.673633Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:52.673648Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:52.673652Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:52.673655Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:52.673658Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:52.673675Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:52.673685Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:52.673697Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:52.673759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:52.673766Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:52.673768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:52.673771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:52.673840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:52.673846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:52.673859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:52.673874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:52.673895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:52.673923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602571714606698:6728], now have 1 active actors on pipe
2025-10-10T14:38:52.673932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602571714606557:2438], now have 1 active actors on pipe
2025-10-10T14:38:52.673939Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602570932366999:8671]
2025-10-10T14:38:52.673946Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602570932366999:8671]
2025-10-10T14:38:52.673949Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602570932366999:8671]
2025-10-10T14:38:52.673962Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:52.673977Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:52.673980Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:52.673991Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:52.673993Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:52.673996Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:52.673999Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:52.674020Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602570932366999:8671]
2025-10-10T14:38:52.674027Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:52.674011Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2807
2025-10-10T14:38:52.674014Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2807
2025-10-10T14:38:52.674032Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:52.674110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:52.674122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:52.674166Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ebb71a56-c51066f5-39113eae-318561e2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:52.674179Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:52.674184Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:52.674186Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:52.674198Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:52.674214Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:52.674227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:52.674424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:52.674440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:52.674466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:52.674630Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2808 partition: 0 MaxSeqNo: 40 sessionId: src_id|ebb71a56-c51066f5-39113eae-318561e2_0
2025-10-10T14:38:52.675060Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1af902c7-85ce4429-54d8c40c-a57802df_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|ebb71a56-c51066f5-39113eae-318561e2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:52.677917Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ebb71a56-c51066f5-39113eae-318561e2_0] Write session: try to update token
2025-10-10T14:38:52.677936Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ebb71a56-c51066f5-39113eae-318561e2_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:52.692646Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2808 sessionId: src_id|ebb71a56-c51066f5-39113eae-318561e2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:52.694197Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:52.694221Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:52.694224Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:52.694226Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:52.694238Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602570932366999:8671]
2025-10-10T14:38:52.694246Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602570932366999:8671]
2025-10-10T14:38:52.694250Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602570932366999:8671]
2025-10-10T14:38:52.694304Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:52.694317Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:52.694320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:52.694319Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:52.694329Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:52.694333Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:52.694465Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:52.695528Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:52.747925Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602571714606722:6861]
2025-10-10T14:38:52.749598Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 pipe creation result: OK TabletId: 72075186224037892 Generation: 2807, pipe: [1:7559602571714606722:6861]
2025-10-10T14:38:52.811506Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:52.812034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:52.812050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:52.812099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602571714606722:6861], now have 1 active actors on pipe
2025-10-10T14:38:52.812335Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:52.812333Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:52.812364Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:52.812368Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:52.812395Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 6 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602571714606722:6861]
2025-10-10T14:38:52.812435Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2808 reason: error at write: Disconnected sessionId: src_id|ebb71a56-c51066f5-39113eae-318561e2_0
2025-10-10T14:38:52.812659Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2808 sessionId: src_id|ebb71a56-c51066f5-39113eae-318561e2_0 is DEAD
2025-10-10T14:38:52.812822Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ebb71a56-c51066f5-39113eae-318561e2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:52.812831Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ebb71a56-c51066f5-39113eae-318561e2_0] Write session will restart in 0.008042s
2025-10-10T14:38:52.812858Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ebb71a56-c51066f5-39113eae-318561e2_0] Write session: Do CDS request
2025-10-10T14:38:52.812867Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ebb71a56-c51066f5-39113eae-318561e2_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:52.821884Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ebb71a56-c51066f5-39113eae-318561e2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:52.821968Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:52.821985Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2809
2025-10-10T14:38:52.822153Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2809 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:52.822192Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2809 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:52.822204Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2809 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:52.822207Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:52.822694Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2809 sessionId:  describe result for acl check
2025-10-10T14:38:52.822738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:52.822757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:52.822759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:52.822765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602571714606808:6690] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:52.823399Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602571714606808:6690] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:52.825749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602571714606808:6690] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:52.829869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:52.833878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:52.834040Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602571714606808:6690] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:52.834065Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602571714606808:6690] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:52.834070Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602571714606808:6690] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:52.834079Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2809 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:52.834181Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:52.834195Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:52.834208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:52.834277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:52.834328Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602570932367191:8628]
2025-10-10T14:38:52.834960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:52.835311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:52.835363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:52.835652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:52.835698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:52.835703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:52.835705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:52.835705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:52.835706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:52.835707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:52.835708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:52.835709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:52.835710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:52.835711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:52.835711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:52.835712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:52.835713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:52.835717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:52.835727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:52.835730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:52.835733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:52.835735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:52.835738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:52.835740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:52.835743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:52.835746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:52.835748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:52.835753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:52.835756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:52.835760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:52.835769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:52.835778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:52.835785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:52.835790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:52.835795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:52.835800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:52.835805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:52.835811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:52.835815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:52.835822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:52.835827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:52.835833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:52.835838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:52.835843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:52.835849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:52.835854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:52.835857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:52.835861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:52.835863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:52.835866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:52.835869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:52.835873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:52.835878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:52.835883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:52.835888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:52.835894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:52.835935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:52.838421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:52.838783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:52.838799Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:52.838801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:52.838805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:52.838813Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2808 [2:7559602570932367191:8628]
2025-10-10T14:38:52.838827Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:52.838847Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:52.838851Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:52.838855Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:52.838857Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:52.838875Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:52.838889Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:52.838898Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:52.838962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:52.838970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:52.838973Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:52.838975Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:52.839046Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:52.839057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:52.839069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:52.839081Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:52.839098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:52.839123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602571714606881:6690], now have 1 active actors on pipe
2025-10-10T14:38:52.839128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602571714606736:2438], now have 1 active actors on pipe
2025-10-10T14:38:52.839137Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602570932367186:8628]
2025-10-10T14:38:52.839145Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602570932367186:8628]
2025-10-10T14:38:52.839149Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602570932367186:8628]
2025-10-10T14:38:52.839164Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:52.839183Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:52.839184Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:52.839201Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:52.839201Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:52.839204Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:52.839204Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:52.839230Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602570932367186:8628]
2025-10-10T14:38:52.839239Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:52.839211Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2808
2025-10-10T14:38:52.839241Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:52.839214Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2808
2025-10-10T14:38:52.839269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:52.839279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:52.839323Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c516b03a-f83a01e4-376023d1-f202f476_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:52.839336Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:52.839346Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:52.839348Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:52.839361Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:52.839376Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:52.839399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:52.839547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:52.839555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:52.839570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:52.839678Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2809 partition: 0 MaxSeqNo: 40 sessionId: src_id|c516b03a-f83a01e4-376023d1-f202f476_0
2025-10-10T14:38:52.840003Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ebb71a56-c51066f5-39113eae-318561e2_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|c516b03a-f83a01e4-376023d1-f202f476_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:52.842831Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c516b03a-f83a01e4-376023d1-f202f476_0] Write session: try to update token
2025-10-10T14:38:52.842851Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c516b03a-f83a01e4-376023d1-f202f476_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:52.857670Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2809 sessionId: src_id|c516b03a-f83a01e4-376023d1-f202f476_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:52.860100Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:52.860125Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:52.860129Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:52.860130Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:52.860142Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602570932367186:8628]
2025-10-10T14:38:52.860147Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602570932367186:8628]
2025-10-10T14:38:52.860151Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602570932367186:8628]
2025-10-10T14:38:52.860196Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:52.860201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:52.860203Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:52.860208Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:52.860209Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:52.860212Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:52.860340Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:52.860341Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:52.912335Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602571714606895:6861]
2025-10-10T14:38:52.912674Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 pipe creation result: OK TabletId: 72075186224037892 Generation: 2808, pipe: [1:7559602571714606895:6861]
2025-10-10T14:38:52.975309Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:52.975757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:52.975775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:52.975821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602571714606895:6861], now have 1 active actors on pipe
2025-10-10T14:38:52.976010Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:52.976034Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 7 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602571714606895:6861]
2025-10-10T14:38:52.976040Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:52.976045Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:52.976068Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:52.976124Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2809 reason: error at write: Disconnected sessionId: src_id|c516b03a-f83a01e4-376023d1-f202f476_0
2025-10-10T14:38:52.976357Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2809 sessionId: src_id|c516b03a-f83a01e4-376023d1-f202f476_0 is DEAD
2025-10-10T14:38:52.976542Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c516b03a-f83a01e4-376023d1-f202f476_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:52.976551Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c516b03a-f83a01e4-376023d1-f202f476_0] Write session will restart in 0.009210s
2025-10-10T14:38:52.976578Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c516b03a-f83a01e4-376023d1-f202f476_0] Write session: Do CDS request
2025-10-10T14:38:52.976585Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c516b03a-f83a01e4-376023d1-f202f476_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:52.986990Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c516b03a-f83a01e4-376023d1-f202f476_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:52.987058Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:52.987078Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2810
2025-10-10T14:38:52.987250Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2810 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:52.987289Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2810 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:52.987303Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2810 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:52.987307Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:52.987793Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2810 sessionId:  describe result for acl check
2025-10-10T14:38:52.987836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:52.987845Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:52.987848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:52.987854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602571714606985:6677] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:52.988440Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602571714606985:6677] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:52.990737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602571714606985:6677] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:52.991262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:52.994736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:52.994916Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602571714606985:6677] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:52.994934Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602571714606985:6677] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:52.994938Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602571714606985:6677] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:52.994947Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2810 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:52.994994Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:52.995005Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:52.995018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:52.995075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:52.995132Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602570932367341:8623]
2025-10-10T14:38:52.995762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:52.996038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:52.996084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:52.996401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:52.996463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:52.996469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:52.996470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:52.996471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:52.996473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:52.996474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:52.996475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:52.996477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:52.996478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:52.996479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:52.996480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:52.996482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:52.996483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:52.996490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:52.996504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:52.996509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:52.996513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:52.996517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:52.996521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:52.996526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:52.996530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:52.996534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:52.996544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:52.996552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:52.996556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:52.996564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:52.996574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:52.996587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:52.996599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:52.996610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:52.996615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:52.996625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:52.996634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:52.996639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:52.996644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:52.996649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:52.996653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:52.996657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:52.996662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:52.996671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:52.996676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:52.996682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:52.996691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:52.996696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:52.996703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:52.996713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:52.996722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:52.996730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:52.996734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:52.996745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:52.996753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:52.996758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:52.996799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:52.999404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:52.999753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:52.999766Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:52.999769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:52.999773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:52.999780Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2809 [2:7559602570932367341:8623]
2025-10-10T14:38:52.999795Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:52.999814Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:52.999818Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:52.999822Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:52.999825Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:52.999843Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:52.999856Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:52.999866Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:52.999938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:52.999945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:52.999948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:52.999951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:53.000024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:53.000033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:53.000045Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:53.000058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:53.000094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:53.000125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602571714606899:2438], now have 1 active actors on pipe
2025-10-10T14:38:53.000133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602571714607038:6677], now have 1 active actors on pipe
2025-10-10T14:38:53.000141Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602570932367336:8623]
2025-10-10T14:38:53.000144Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602570932367336:8623]
2025-10-10T14:38:53.000147Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602570932367336:8623]
2025-10-10T14:38:53.000153Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2809
2025-10-10T14:38:53.000160Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2809
2025-10-10T14:38:53.000160Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:53.000179Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:53.000178Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:53.000182Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:53.000184Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:53.000196Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:53.000199Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:53.000238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:53.000249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:53.000265Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602570932367336:8623]
2025-10-10T14:38:53.000273Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:53.000294Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:53.000313Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2f6c01e5-38690a49-a95b62e7-b5dc988_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:53.000325Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:53.000331Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:53.000339Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:53.000351Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:53.000368Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:53.000392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:53.000550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:53.000565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:53.000590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:53.000676Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2810 partition: 0 MaxSeqNo: 40 sessionId: src_id|2f6c01e5-38690a49-a95b62e7-b5dc988_0
2025-10-10T14:38:53.001158Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c516b03a-f83a01e4-376023d1-f202f476_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|2f6c01e5-38690a49-a95b62e7-b5dc988_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:53.004046Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2f6c01e5-38690a49-a95b62e7-b5dc988_0] Write session: try to update token
2025-10-10T14:38:53.004069Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2f6c01e5-38690a49-a95b62e7-b5dc988_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:53.019839Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:53.019861Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:53.019865Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:53.019867Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:53.019879Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602570932367336:8623]
2025-10-10T14:38:53.019884Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602570932367336:8623]
2025-10-10T14:38:53.019891Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602570932367336:8623]
2025-10-10T14:38:53.019942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:53.019950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:53.019952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:53.019954Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:53.019961Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:53.019966Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:53.019966Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2810 sessionId: src_id|2f6c01e5-38690a49-a95b62e7-b5dc988_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:53.020095Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:53.022662Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:53.076196Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602576009574346:6861]
2025-10-10T14:38:53.076536Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 pipe creation result: OK TabletId: 72075186224037892 Generation: 2809, pipe: [1:7559602576009574346:6861]
2025-10-10T14:38:53.138869Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:53.139609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:53.139627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:53.139672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602576009574346:6861], now have 1 active actors on pipe
2025-10-10T14:38:53.139879Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:53.140325Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:53.140379Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 8 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602576009574346:6861]
2025-10-10T14:38:53.140404Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:38:53.140481Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2810 reason: status is not ok: tablet will be restarted right now sessionId: src_id|2f6c01e5-38690a49-a95b62e7-b5dc988_0
2025-10-10T14:38:53.140695Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2810 sessionId: src_id|2f6c01e5-38690a49-a95b62e7-b5dc988_0 is DEAD
2025-10-10T14:38:53.140882Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f6c01e5-38690a49-a95b62e7-b5dc988_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:38:53.140899Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f6c01e5-38690a49-a95b62e7-b5dc988_0] Write session will restart in 0.005725s
2025-10-10T14:38:53.140939Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f6c01e5-38690a49-a95b62e7-b5dc988_0] Write session: Do CDS request
2025-10-10T14:38:53.140946Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f6c01e5-38690a49-a95b62e7-b5dc988_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:53.147887Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2f6c01e5-38690a49-a95b62e7-b5dc988_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:53.147970Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:53.147995Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2811
2025-10-10T14:38:53.148092Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2811 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:53.148129Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2811 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:53.148135Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2811 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:53.148139Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:53.148654Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2811 sessionId:  describe result for acl check
2025-10-10T14:38:53.148698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:53.148700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:53.148702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:53.148708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602576009574363:6667] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:53.149270Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602576009574363:6667] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:53.153155Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602576009574363:6667] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:53.158022Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602576009574363:6667] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:53.158040Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602576009574363:6667] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:53.158043Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602576009574363:6667] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:53.158054Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2811 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:53.159767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:53.164113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:53.164487Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:53.164507Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:53.164524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:53.164602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:53.164659Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602575227334789:8613]
2025-10-10T14:38:53.165250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:53.165741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:53.165811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:53.166184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:53.166261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:53.166268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:53.166270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:53.166272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:53.166273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:53.166275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:53.166276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:53.166278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:53.166279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:53.166281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:53.166283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:53.166284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:53.166286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:53.166293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:53.166309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:53.166314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:53.166319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:53.166323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:53.166328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:53.166333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:53.166337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:53.166342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:53.166347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:53.166352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:53.166356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:53.166361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:53.166372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:53.166382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:53.166399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:53.166406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:53.166410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:53.166415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:53.166420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:53.166426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:53.166431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:53.166437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:53.166442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:53.166447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:53.166452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:53.166457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:53.166462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:53.166468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:53.166473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:53.166478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:53.166483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:53.166490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:53.166496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:53.166504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:53.166509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:53.166514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:53.166523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:53.166528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:53.166567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:53.173510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:53.174346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:53.174366Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:53.174369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:53.174374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:53.174381Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2810 [2:7559602575227334789:8613]
2025-10-10T14:38:53.174398Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:53.174421Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:53.174433Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:53.174437Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:53.174440Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:53.174461Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:53.174469Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:53.174479Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:53.174554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:53.174561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:53.174564Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:53.174566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:53.174643Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:53.174651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:53.174665Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:53.174683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:53.174706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:53.174733Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602575227334784:8613]
2025-10-10T14:38:53.174741Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602575227334784:8613]
2025-10-10T14:38:53.174743Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602575227334784:8613]
2025-10-10T14:38:53.174755Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:53.174776Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:53.174776Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:53.174783Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:53.174785Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:53.174798Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:53.174806Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:53.174818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602576009574488:6667], now have 1 active actors on pipe
2025-10-10T14:38:53.174822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602576009574348:2438], now have 1 active actors on pipe
2025-10-10T14:38:53.174863Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602575227334784:8613]
2025-10-10T14:38:53.174880Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:53.174878Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2810
2025-10-10T14:38:53.174919Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2810
2025-10-10T14:38:53.174963Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:53.175256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:53.175267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:53.175303Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|94070275-1f0628bf-fed6d74c-a52be9b1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:53.175316Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:53.175321Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:53.175328Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:53.175340Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:53.175352Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:53.175376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:53.175608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:53.175616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:53.175630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:53.175900Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2811 partition: 0 MaxSeqNo: 40 sessionId: src_id|94070275-1f0628bf-fed6d74c-a52be9b1_0
2025-10-10T14:38:53.176319Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f6c01e5-38690a49-a95b62e7-b5dc988_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|94070275-1f0628bf-fed6d74c-a52be9b1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:53.179183Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|94070275-1f0628bf-fed6d74c-a52be9b1_0] Write session: try to update token
2025-10-10T14:38:53.179202Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|94070275-1f0628bf-fed6d74c-a52be9b1_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:53.194880Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:53.194910Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:53.194913Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:53.194916Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:53.194927Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602575227334784:8613]
2025-10-10T14:38:53.194934Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602575227334784:8613]
2025-10-10T14:38:53.194938Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602575227334784:8613]
2025-10-10T14:38:53.194993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:53.195007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:53.195011Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:53.195015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:53.195020Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:53.195025Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:53.195177Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:53.197657Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2811 sessionId: src_id|94070275-1f0628bf-fed6d74c-a52be9b1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:53.200232Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:53.240535Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602576009574503:6861]
2025-10-10T14:38:53.241011Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 pipe creation result: OK TabletId: 72075186224037892 Generation: 2810, pipe: [1:7559602576009574503:6861]
2025-10-10T14:38:53.318497Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:53.319085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:53.319110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:53.319158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602576009574503:6861], now have 1 active actors on pipe
2025-10-10T14:38:53.319405Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:53.319427Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:53.319494Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 9 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602576009574503:6861]
2025-10-10T14:38:53.319521Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:38:53.319606Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2811 reason: status is not ok: tablet will be restarted right now sessionId: src_id|94070275-1f0628bf-fed6d74c-a52be9b1_0
2025-10-10T14:38:53.319816Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2811 sessionId: src_id|94070275-1f0628bf-fed6d74c-a52be9b1_0 is DEAD
2025-10-10T14:38:53.320005Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94070275-1f0628bf-fed6d74c-a52be9b1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:38:53.320017Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94070275-1f0628bf-fed6d74c-a52be9b1_0] Write session will restart in 0.008305s
2025-10-10T14:38:53.320042Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94070275-1f0628bf-fed6d74c-a52be9b1_0] Write session: Do CDS request
2025-10-10T14:38:53.320049Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94070275-1f0628bf-fed6d74c-a52be9b1_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:53.329933Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|94070275-1f0628bf-fed6d74c-a52be9b1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:53.330015Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:53.330046Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2812
2025-10-10T14:38:53.330182Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2812 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:53.330232Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2812 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:53.330242Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2812 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:53.330247Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:53.330799Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2812 sessionId:  describe result for acl check
2025-10-10T14:38:53.330850Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:53.330851Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:53.330853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:53.330860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602576009574592:6645] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:53.331439Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602576009574592:6645] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:53.333702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602576009574592:6645] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:53.337362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:53.337605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602576009574592:6645] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:53.337621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602576009574592:6645] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:53.337625Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602576009574592:6645] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:53.337635Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2812 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:53.337891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:53.338115Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:53.338126Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:53.338139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:53.338194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:53.338246Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602575227334943:8611]
2025-10-10T14:38:53.338946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:53.339236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:53.339279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:53.339618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:53.339675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:53.339682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:53.339683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:53.339685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:53.339686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:53.339688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:53.339689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:53.339691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:53.339692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:53.339694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:53.339695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:53.339697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:53.339712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:53.339718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:53.339733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:53.339738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:53.339743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:53.339748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:53.339753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:53.339758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:53.339763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:53.339768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:53.339772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:53.339777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:53.339782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:53.339786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:53.339794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:53.339809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:53.339817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:53.339824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:53.339835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:53.339842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:53.339854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:53.339865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:53.339871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:53.339881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:53.339887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:53.339898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:53.339903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:53.339910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:53.339915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:53.339921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:53.339926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:53.339932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:53.339943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:53.339949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:53.339959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:53.339965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:53.339970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:53.339983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:53.339992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:53.339999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:53.340051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:53.342645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:53.343061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:53.343076Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:53.343078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:53.343083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:53.343090Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2811 [2:7559602575227334943:8611]
2025-10-10T14:38:53.343105Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:53.343123Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:53.343131Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:53.343136Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:53.343139Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:53.343156Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:53.343172Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:53.343182Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:53.343247Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:53.343256Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:53.343258Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:53.343261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:53.343359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:53.343368Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:53.343380Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:53.343391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:53.343407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:53.343437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602576009574650:6645], now have 1 active actors on pipe
2025-10-10T14:38:53.343446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602576009574505:2438], now have 1 active actors on pipe
2025-10-10T14:38:53.343454Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602575227334937:8611]
2025-10-10T14:38:53.343457Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602575227334937:8611]
2025-10-10T14:38:53.343459Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602575227334937:8611]
2025-10-10T14:38:53.343475Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:53.343489Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:53.343495Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:53.343498Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:53.343500Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:53.343498Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2811
2025-10-10T14:38:53.343512Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:53.343512Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2811
2025-10-10T14:38:53.343521Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:53.343551Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602575227334937:8611]
2025-10-10T14:38:53.343561Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:53.343562Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:53.343583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:53.343588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:53.343644Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bf9e54b6-846e455e-1ba1f866-e67fdd27_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:53.343661Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:53.343666Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:53.343668Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:53.343682Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:53.343696Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:53.343721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:53.344005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:53.344018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:53.344039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:53.344141Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2812 partition: 0 MaxSeqNo: 40 sessionId: src_id|bf9e54b6-846e455e-1ba1f866-e67fdd27_0
2025-10-10T14:38:53.344554Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94070275-1f0628bf-fed6d74c-a52be9b1_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|bf9e54b6-846e455e-1ba1f866-e67fdd27_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:53.347300Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bf9e54b6-846e455e-1ba1f866-e67fdd27_0] Write session: try to update token
2025-10-10T14:38:53.347321Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bf9e54b6-846e455e-1ba1f866-e67fdd27_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:53.363218Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2812 sessionId: src_id|bf9e54b6-846e455e-1ba1f866-e67fdd27_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:53.363762Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:53.363784Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:53.363787Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:53.363789Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:53.363800Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602575227334937:8611]
2025-10-10T14:38:53.363804Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602575227334937:8611]
2025-10-10T14:38:53.363808Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602575227334937:8611]
2025-10-10T14:38:53.363857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:53.363872Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:53.363874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:53.363940Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:53.363955Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:53.363962Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:53.364011Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:53.365890Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:53.421431Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602576009574661:6861]
2025-10-10T14:38:53.421798Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 pipe creation result: OK TabletId: 72075186224037892 Generation: 2811, pipe: [1:7559602576009574661:6861]
2025-10-10T14:38:53.479812Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:53.480911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:53.480931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:53.480980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602576009574661:6861], now have 1 active actors on pipe
2025-10-10T14:38:53.481242Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:53.481261Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:53.481277Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 10 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602576009574661:6861]
2025-10-10T14:38:53.481297Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:53.481268Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:53.481349Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2812 reason: error at write: Disconnected sessionId: src_id|bf9e54b6-846e455e-1ba1f866-e67fdd27_0
2025-10-10T14:38:53.481613Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2812 sessionId: src_id|bf9e54b6-846e455e-1ba1f866-e67fdd27_0 is DEAD
2025-10-10T14:38:53.481767Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bf9e54b6-846e455e-1ba1f866-e67fdd27_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:53.481777Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bf9e54b6-846e455e-1ba1f866-e67fdd27_0] Write session will restart in 0.006291s
2025-10-10T14:38:53.481813Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bf9e54b6-846e455e-1ba1f866-e67fdd27_0] Write session: Do CDS request
2025-10-10T14:38:53.481820Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bf9e54b6-846e455e-1ba1f866-e67fdd27_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:53.488933Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bf9e54b6-846e455e-1ba1f866-e67fdd27_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:53.489014Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:53.489036Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2813
2025-10-10T14:38:53.489190Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2813 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:53.489236Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2813 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:53.489248Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2813 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:53.489253Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:53.489831Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2813 sessionId:  describe result for acl check
2025-10-10T14:38:53.489875Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:53.489877Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:53.489880Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:53.489886Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602576009574677:6629] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:53.490501Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602576009574677:6629] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:53.493350Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602576009574677:6629] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:53.496309Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602576009574677:6629] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:53.496326Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602576009574677:6629] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:53.496330Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602576009574677:6629] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:53.496339Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2813 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:53.501524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:53.505802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:53.506076Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:53.506090Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:53.506104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:53.506167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:53.506216Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602575227335108:8601]
2025-10-10T14:38:53.506888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:53.507404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:53.507471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:53.507854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:53.508390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:53.508401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:53.508402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:53.508404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:53.508405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:53.508407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:53.508408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:53.508410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:53.508411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:53.508413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:53.508414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:53.508416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:53.508417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:53.508425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:53.508439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:53.508444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:53.508449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:53.508454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:53.508459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:53.508463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:53.508468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:53.508473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:53.508478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:53.508482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:53.508487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:53.508491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:53.508501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:53.508512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:53.508519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:53.508531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:53.508544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:53.508554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:53.508559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:53.508566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:53.508573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:53.508583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:53.508592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:53.508599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:53.508618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:53.508626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:53.508631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:53.508636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:53.508641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:53.508647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:53.508652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:53.508658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:53.508666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:53.508673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:53.508677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:53.508683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:53.508687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:53.508693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:53.508735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:53.512787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:53.513142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:53.513160Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:53.513164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:53.513169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:53.513177Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2812 [2:7559602575227335108:8601]
2025-10-10T14:38:53.513206Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:53.513230Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:53.513234Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:53.513238Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:53.513241Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:53.513261Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:53.513287Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:53.513296Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:53.513722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:53.513733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:53.513735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:53.513738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:53.513826Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:53.513835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:53.513853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:53.513868Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:53.513889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:53.513917Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602575227335103:8601]
2025-10-10T14:38:53.513924Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602575227335103:8601]
2025-10-10T14:38:53.513927Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602575227335103:8601]
2025-10-10T14:38:53.513939Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:53.513956Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:53.513962Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:53.513966Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:53.513969Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:53.513973Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:53.513977Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:53.513990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602576009574804:6629], now have 1 active actors on pipe
2025-10-10T14:38:53.513994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602576009574662:2438], now have 1 active actors on pipe
2025-10-10T14:38:53.514037Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602575227335103:8601]
2025-10-10T14:38:53.514050Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:53.514060Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:53.514063Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2812
2025-10-10T14:38:53.514105Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2812
2025-10-10T14:38:53.514307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:53.514318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:53.514355Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|85151eba-be144b4e-4b55ff11-6898b765_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:53.514369Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:53.514378Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:53.514381Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:53.514408Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:53.514424Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:53.514447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:53.514652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:53.514660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:53.514676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:53.515306Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bf9e54b6-846e455e-1ba1f866-e67fdd27_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|85151eba-be144b4e-4b55ff11-6898b765_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:53.514804Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2813 partition: 0 MaxSeqNo: 40 sessionId: src_id|85151eba-be144b4e-4b55ff11-6898b765_0
2025-10-10T14:38:53.518072Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85151eba-be144b4e-4b55ff11-6898b765_0] Write session: try to update token
2025-10-10T14:38:53.518092Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85151eba-be144b4e-4b55ff11-6898b765_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:53.532940Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2813 sessionId: src_id|85151eba-be144b4e-4b55ff11-6898b765_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:53.535722Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:53.536609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:53.536631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:53.536656Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:53.536660Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:53.536663Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:53.536665Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:53.536676Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602575227335103:8601]
2025-10-10T14:38:53.536681Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602575227335103:8601]
2025-10-10T14:38:53.536688Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602575227335103:8601]
2025-10-10T14:38:53.536735Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:53.536747Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:53.536751Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:53.536753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:53.536760Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:53.536763Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:53.536901Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:53.581553Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602576009574819:6861]
2025-10-10T14:38:53.581853Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 pipe creation result: OK TabletId: 72075186224037892 Generation: 2812, pipe: [1:7559602576009574819:6861]
2025-10-10T14:38:53.654085Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:38:53.654223Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:53.654233Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:53.654333Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2813 reason: error at write: Disconnected sessionId: src_id|85151eba-be144b4e-4b55ff11-6898b765_0
2025-10-10T14:38:53.653428Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:53.653886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:38:53.653951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602576009574819:6861], now have 1 active actors on pipe
2025-10-10T14:38:53.654560Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2813 sessionId: src_id|85151eba-be144b4e-4b55ff11-6898b765_0 is DEAD
2025-10-10T14:38:53.654673Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85151eba-be144b4e-4b55ff11-6898b765_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:53.654686Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85151eba-be144b4e-4b55ff11-6898b765_0] Write session will restart in 0.007592s
2025-10-10T14:38:53.654713Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85151eba-be144b4e-4b55ff11-6898b765_0] Write session: Do CDS request
2025-10-10T14:38:53.654719Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85151eba-be144b4e-4b55ff11-6898b765_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:53.654763Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:53.654813Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 11 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602576009574819:6861]
2025-10-10T14:38:53.665923Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85151eba-be144b4e-4b55ff11-6898b765_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:53.666034Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:53.666053Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2814
2025-10-10T14:38:53.666205Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2814 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:53.666242Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2814 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:53.666249Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2814 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:53.666253Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:53.666907Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2814 sessionId:  describe result for acl check
2025-10-10T14:38:53.666947Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:53.666954Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:53.666956Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:53.666963Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602576009574913:6633] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:53.667589Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602576009574913:6633] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:53.670246Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602576009574913:6633] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:53.671053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:53.675341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:53.675596Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:53.675609Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:53.675622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:53.675488Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602576009574913:6633] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:53.675508Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602576009574913:6633] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:53.675512Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602576009574913:6633] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:53.675521Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2814 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:53.675682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:53.675730Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602575227335261:8596]
2025-10-10T14:38:53.676364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:53.676726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:53.676783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:53.677157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:53.677231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:53.677238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:53.677240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:53.677241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:53.677243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:53.677244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:53.677246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:53.677247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:53.677249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:53.677250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:53.677252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:53.677253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:53.677254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:53.677262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:53.677275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:53.677280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:53.677284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:53.677288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:53.677292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:53.677297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:53.677301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:53.677305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:53.677310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:53.677314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:53.677318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:53.677323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:53.677350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:53.677360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:53.677366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:53.677371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:53.677376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:53.677381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:53.677386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:53.677392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:53.677398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:53.677403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:53.677410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:53.677416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:53.677421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:53.677427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:53.677433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:53.677446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:53.677451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:53.677456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:53.677465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:53.677471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:53.677475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:53.677481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:53.677492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:53.677498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:53.677507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:53.677512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:53.677553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:53.680531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:53.681128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:53.681141Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:53.681145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:53.681149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:53.681155Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2813 [2:7559602575227335261:8596]
2025-10-10T14:38:53.681181Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:53.681204Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:53.681216Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:53.681220Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:53.681223Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:53.681244Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:53.681257Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:53.681270Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:53.681365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:53.681375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:53.681377Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:53.681381Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:53.681465Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:53.681472Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:53.681485Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:53.681495Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:53.681511Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:53.681543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602576009574832:2438], now have 1 active actors on pipe
2025-10-10T14:38:53.681557Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602575227335256:8596]
2025-10-10T14:38:53.681564Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602575227335256:8596]
2025-10-10T14:38:53.681566Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602575227335256:8596]
2025-10-10T14:38:53.681597Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:53.681609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602576009574980:6633], now have 1 active actors on pipe
2025-10-10T14:38:53.681619Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:53.681641Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:53.681649Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:53.681650Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2813
2025-10-10T14:38:53.681706Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2813
2025-10-10T14:38:53.681684Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602575227335256:8596]
2025-10-10T14:38:53.681693Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:53.681698Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:53.681701Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:53.681703Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:53.681711Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:53.681843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:53.681853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:53.681887Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8bcce7e6-208a01ce-b7eb86ab-807e5af0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:53.681900Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:53.681905Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:53.681908Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:53.681919Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:53.681931Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:53.681947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:53.682160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:53.682173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:53.682196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:53.682283Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2814 partition: 0 MaxSeqNo: 40 sessionId: src_id|8bcce7e6-208a01ce-b7eb86ab-807e5af0_0
2025-10-10T14:38:53.682728Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85151eba-be144b4e-4b55ff11-6898b765_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|8bcce7e6-208a01ce-b7eb86ab-807e5af0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:53.685516Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8bcce7e6-208a01ce-b7eb86ab-807e5af0_0] Write session: try to update token
2025-10-10T14:38:53.685537Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8bcce7e6-208a01ce-b7eb86ab-807e5af0_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:53.701308Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2814 sessionId: src_id|8bcce7e6-208a01ce-b7eb86ab-807e5af0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:53.704071Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:53.703681Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:53.703698Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:53.703702Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:53.703705Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:53.703716Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602575227335256:8596]
2025-10-10T14:38:53.703721Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602575227335256:8596]
2025-10-10T14:38:53.703726Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602575227335256:8596]
2025-10-10T14:38:53.703778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:53.703787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:53.703790Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:53.703939Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:53.703940Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:53.703947Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:53.703956Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:53.755121Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602576009574991:6861]
2025-10-10T14:38:53.755459Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 pipe creation result: OK TabletId: 72075186224037892 Generation: 2813, pipe: [1:7559602576009574991:6861]
2025-10-10T14:38:53.821747Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:53.822285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:53.822305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:53.822349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602576009574991:6861], now have 1 active actors on pipe
2025-10-10T14:38:53.822525Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:53.822966Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:53.823021Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 12 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602576009574991:6861]
2025-10-10T14:38:53.823023Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:38:53.823113Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2814 reason: status is not ok: tablet will be restarted right now sessionId: src_id|8bcce7e6-208a01ce-b7eb86ab-807e5af0_0
2025-10-10T14:38:53.823322Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2814 sessionId: src_id|8bcce7e6-208a01ce-b7eb86ab-807e5af0_0 is DEAD
2025-10-10T14:38:53.823498Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8bcce7e6-208a01ce-b7eb86ab-807e5af0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:38:53.823510Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8bcce7e6-208a01ce-b7eb86ab-807e5af0_0] Write session will restart in 0.007169s
2025-10-10T14:38:53.823535Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8bcce7e6-208a01ce-b7eb86ab-807e5af0_0] Write session: Do CDS request
2025-10-10T14:38:53.823541Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8bcce7e6-208a01ce-b7eb86ab-807e5af0_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:53.831906Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8bcce7e6-208a01ce-b7eb86ab-807e5af0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:53.832435Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:53.832453Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2815
2025-10-10T14:38:53.832599Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2815 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:53.832635Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2815 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:53.832655Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2815 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:53.832660Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:53.833155Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2815 sessionId:  describe result for acl check
2025-10-10T14:38:53.833201Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:53.833207Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:53.833209Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:53.833217Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602576009575043:6562] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:53.833832Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602576009575043:6562] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:53.837151Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602576009575043:6562] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:53.839128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:53.842846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:53.843094Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:53.843105Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:53.843118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:53.843180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:53.843226Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602575227335454:8576]
2025-10-10T14:38:53.843147Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602576009575043:6562] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:53.843168Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602576009575043:6562] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:53.843187Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602576009575043:6562] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:53.843197Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2815 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:53.843809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:53.844092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:53.844129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:53.844350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:53.844392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:53.844396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:53.844397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:53.844398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:53.844398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:53.844399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:53.844400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:53.844401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:53.844402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:53.844403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:53.844403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:53.844404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:53.844405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:53.844409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:53.844418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:53.844431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:53.844434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:53.844436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:53.844439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:53.844442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:53.844445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:53.844447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:53.844451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:53.844453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:53.844456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:53.844458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:53.844464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:53.844470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:53.844475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:53.844478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:53.844481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:53.844485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:53.844487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:53.844491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:53.844493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:53.844497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:53.844499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:53.844503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:53.844509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:53.844514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:53.844520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:53.844525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:53.844529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:53.844534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:53.844538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:53.844543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:53.844546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:53.844551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:53.844556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:53.844561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:53.844566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:53.844571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:53.844597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:53.847370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:53.848106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:53.848119Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:53.848121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:53.848125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:53.848132Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2814 [2:7559602575227335454:8576]
2025-10-10T14:38:53.848148Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:53.848166Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:53.848174Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:53.848178Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:53.848180Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:53.848199Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:53.848211Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:53.848220Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:53.848283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:53.848291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:53.848293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:53.848296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:53.848364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:53.848373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:53.848384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:53.848394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:53.848418Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:53.848440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602576009575171:6562], now have 1 active actors on pipe
2025-10-10T14:38:53.848444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602576009575022:2438], now have 1 active actors on pipe
2025-10-10T14:38:53.848452Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602575227335449:8576]
2025-10-10T14:38:53.848454Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602575227335449:8576]
2025-10-10T14:38:53.848457Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602575227335449:8576]
2025-10-10T14:38:53.848470Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:53.848479Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:53.848482Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:53.848484Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:53.848485Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:53.848501Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:53.848505Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:53.848493Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2814
2025-10-10T14:38:53.848535Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602575227335449:8576]
2025-10-10T14:38:53.848549Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:53.848554Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:53.848514Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2814
2025-10-10T14:38:53.848564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:53.848569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:53.848622Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b0851faf-d644541e-af2945f2-7014b5e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:53.848635Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:53.848639Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:53.848642Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:53.848653Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:53.848664Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:53.848689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:53.848844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:53.848852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:53.848868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:53.848965Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2815 partition: 0 MaxSeqNo: 40 sessionId: src_id|b0851faf-d644541e-af2945f2-7014b5e_0
2025-10-10T14:38:53.849384Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8bcce7e6-208a01ce-b7eb86ab-807e5af0_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|b0851faf-d644541e-af2945f2-7014b5e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:53.852154Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b0851faf-d644541e-af2945f2-7014b5e_0] Write session: try to update token
2025-10-10T14:38:53.852176Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b0851faf-d644541e-af2945f2-7014b5e_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:53.866978Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2815 sessionId: src_id|b0851faf-d644541e-af2945f2-7014b5e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:53.868953Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:53.868970Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:53.868973Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:53.868976Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:53.868985Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602575227335449:8576]
2025-10-10T14:38:53.868990Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602575227335449:8576]
2025-10-10T14:38:53.868994Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602575227335449:8576]
2025-10-10T14:38:53.869038Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:53.869045Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:53.869047Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:53.869049Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:53.869053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:53.869056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:53.869208Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:53.869873Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:53.923019Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602576009575185:6861]
2025-10-10T14:38:53.923242Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 pipe creation result: OK TabletId: 72075186224037892 Generation: 2814, pipe: [1:7559602576009575185:6861]
2025-10-10T14:38:53.983494Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:53.984043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:53.984059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:53.984109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602576009575185:6861], now have 1 active actors on pipe
2025-10-10T14:38:53.984332Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:53.984412Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:53.984421Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 13 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602576009575185:6861]
2025-10-10T14:38:53.984447Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:38:53.984528Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2815 reason: status is not ok: tablet will be restarted right now sessionId: src_id|b0851faf-d644541e-af2945f2-7014b5e_0
2025-10-10T14:38:53.984738Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2815 sessionId: src_id|b0851faf-d644541e-af2945f2-7014b5e_0 is DEAD
2025-10-10T14:38:53.984933Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0851faf-d644541e-af2945f2-7014b5e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:38:53.984941Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0851faf-d644541e-af2945f2-7014b5e_0] Write session will restart in 0.008825s
2025-10-10T14:38:53.984967Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0851faf-d644541e-af2945f2-7014b5e_0] Write session: Do CDS request
2025-10-10T14:38:53.984973Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0851faf-d644541e-af2945f2-7014b5e_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:53.994981Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b0851faf-d644541e-af2945f2-7014b5e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:53.995041Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:53.995060Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2816
2025-10-10T14:38:53.995235Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2816 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:53.995298Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2816 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:53.995308Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2816 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:53.995313Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:53.995793Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2816 sessionId:  describe result for acl check
2025-10-10T14:38:53.995839Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:53.995847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:53.995850Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:53.995857Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602576009575274:6552] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:53.996457Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602576009575274:6552] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:53.998807Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602576009575274:6552] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:53.999687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:54.003481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:54.003716Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:54.003729Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:54.003742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:54.003810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:54.003856Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602579522302906:8573]
2025-10-10T14:38:54.003875Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602576009575274:6552] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:54.003890Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602576009575274:6552] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:54.003893Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602576009575274:6552] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:54.003903Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2816 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:54.004476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:54.004797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:54.004842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:54.005188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:54.005251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:54.005258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:54.005259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:54.005260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:54.005261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:54.005263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:54.005264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:54.005265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:54.005266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:54.005268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:54.005269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:54.005270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:54.005272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:54.005278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:54.005290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:54.005294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:54.005298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:54.005301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:54.005305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:54.005308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:54.005312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:54.005316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:54.005320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:54.005323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:54.005328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:54.005344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:54.005352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:54.005361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:54.005369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:54.005374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:54.005378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:54.005383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:54.005387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:54.005392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:54.005396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:54.005400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:54.005404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:54.005409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:54.005413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:54.005418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:54.005422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:54.005426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:54.005431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:54.005436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:54.005441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:54.005445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:54.005449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:54.005453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:54.005458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:54.005463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:54.005468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:54.005473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:54.005513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:54.008037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:54.008426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:54.008436Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:54.008439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:54.008444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:54.008449Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2815 [2:7559602579522302906:8573]
2025-10-10T14:38:54.008462Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:54.008479Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:54.008487Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:54.008491Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:54.008493Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:54.008510Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:54.008521Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:54.008529Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:54.008589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:54.008596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:54.008598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:54.008600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:54.008670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:54.008678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:54.008689Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:54.008704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:54.008724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:54.008751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602580304542631:6552], now have 1 active actors on pipe
2025-10-10T14:38:54.008759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602576009575189:2438], now have 1 active actors on pipe
2025-10-10T14:38:54.008767Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602575227335605:8573]
2025-10-10T14:38:54.008769Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602575227335605:8573]
2025-10-10T14:38:54.008771Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602575227335605:8573]
2025-10-10T14:38:54.008803Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:54.008825Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:54.008820Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2815
2025-10-10T14:38:54.008842Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:54.008826Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2815
2025-10-10T14:38:54.008845Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:54.008868Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602575227335605:8573]
2025-10-10T14:38:54.008873Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:54.008875Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:54.008877Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:54.008879Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:54.008886Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:54.008895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:54.008900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:54.008949Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dd290399-f0d26f1d-db476deb-323429b0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:54.008962Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:54.008966Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:54.008968Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:54.008981Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:54.008993Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:54.009009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:54.009204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:54.009220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:54.009246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:54.009531Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2816 partition: 0 MaxSeqNo: 40 sessionId: src_id|dd290399-f0d26f1d-db476deb-323429b0_0
2025-10-10T14:38:54.009926Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0851faf-d644541e-af2945f2-7014b5e_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|dd290399-f0d26f1d-db476deb-323429b0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:54.012760Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dd290399-f0d26f1d-db476deb-323429b0_0] Write session: try to update token
2025-10-10T14:38:54.012782Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dd290399-f0d26f1d-db476deb-323429b0_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:54.028601Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:54.028625Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:54.028629Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:54.028631Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:54.028644Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602575227335605:8573]
2025-10-10T14:38:54.028650Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602575227335605:8573]
2025-10-10T14:38:54.028655Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602575227335605:8573]
2025-10-10T14:38:54.028703Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:54.028707Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:54.028713Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:54.028717Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:54.028717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:54.028720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:54.028859Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:54.029873Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2816 sessionId: src_id|dd290399-f0d26f1d-db476deb-323429b0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:54.032832Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:54.084268Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602580304542642:6861]
2025-10-10T14:38:54.084563Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 pipe creation result: OK TabletId: 72075186224037892 Generation: 2815, pipe: [1:7559602580304542642:6861]
2025-10-10T14:38:54.147575Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:54.148092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:54.148152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:54.148201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602580304542642:6861], now have 1 active actors on pipe
2025-10-10T14:38:54.148525Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 14 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602580304542642:6861]
2025-10-10T14:38:54.148580Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:54.148583Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:54.148646Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2816 reason: error at write: Disconnected sessionId: src_id|dd290399-f0d26f1d-db476deb-323429b0_0
2025-10-10T14:38:54.148644Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:54.148831Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:54.148850Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2816 sessionId: src_id|dd290399-f0d26f1d-db476deb-323429b0_0 is DEAD
2025-10-10T14:38:54.149226Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd290399-f0d26f1d-db476deb-323429b0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:54.149236Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd290399-f0d26f1d-db476deb-323429b0_0] Write session will restart in 0.008171s
2025-10-10T14:38:54.149263Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd290399-f0d26f1d-db476deb-323429b0_0] Write session: Do CDS request
2025-10-10T14:38:54.149273Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd290399-f0d26f1d-db476deb-323429b0_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:54.159003Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dd290399-f0d26f1d-db476deb-323429b0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:54.159702Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:54.159733Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2817
2025-10-10T14:38:54.159881Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2817 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:54.159925Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2817 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:54.159935Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2817 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:54.159940Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:54.160477Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2817 sessionId:  describe result for acl check
2025-10-10T14:38:54.160517Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:54.160524Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:54.160527Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:54.160534Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602580304542752:6527] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:54.161135Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602580304542752:6527] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:54.163173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:54.163833Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602580304542752:6527] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:54.167076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:54.167327Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:54.167338Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:54.167349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:54.167370Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602580304542752:6527] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:54.167386Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602580304542752:6527] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:54.167390Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602580304542752:6527] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:54.167398Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2817 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:54.167402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:54.167448Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602579522303063:8571]
2025-10-10T14:38:54.167962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:54.168301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:54.168358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:54.168680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:54.168726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:54.168732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:54.168733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:54.168734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:54.168735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:54.168736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:54.168736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:54.168737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:54.168738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:54.168739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:54.168740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:54.168740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:54.168741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:54.168746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:54.168755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:54.168758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:54.168761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:54.168763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:54.168766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:54.168768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:54.168771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:54.168774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:54.168778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:54.168782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:54.168786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:54.168789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:54.168799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:54.168808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:54.168815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:54.168821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:54.168828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:54.168834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:54.168838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:54.168842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:54.168846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:54.168851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:54.168855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:54.168860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:54.168865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:54.168869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:54.168873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:54.168879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:54.168884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:54.168888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:54.168892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:54.168896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:54.168901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:54.168905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:54.168909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:54.168914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:54.168918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:54.168923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:54.168958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:54.171573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:54.172382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:54.172395Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:54.172398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:54.172402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:54.172409Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2816 [2:7559602579522303063:8571]
2025-10-10T14:38:54.172424Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:54.172444Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:54.172453Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:54.172457Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:54.172459Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:54.172479Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:54.172492Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:54.172504Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:54.172572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:54.172584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:54.172586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:54.172588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:54.172665Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:54.172674Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:54.172688Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:54.172705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:54.172727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:54.172756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602580304542644:2438], now have 1 active actors on pipe
2025-10-10T14:38:54.172759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602580304542794:6527], now have 1 active actors on pipe
2025-10-10T14:38:54.172768Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602579522303058:8571]
2025-10-10T14:38:54.172770Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602579522303058:8571]
2025-10-10T14:38:54.172772Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602579522303058:8571]
2025-10-10T14:38:54.172791Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:54.172810Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:54.172821Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:54.172797Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2816
2025-10-10T14:38:54.172827Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:54.172829Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:54.172832Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:54.172835Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:54.172823Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2816
2025-10-10T14:38:54.172879Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602579522303058:8571]
2025-10-10T14:38:54.172895Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:54.172911Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:54.172912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:54.172918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:54.172973Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f9876ae0-eed65eeb-2eaa2cdb-f8a271e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:54.172989Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:54.172994Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:54.172996Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:54.173007Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:54.173019Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:54.173037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:54.173252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:54.173265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:54.173283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:54.173390Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2817 partition: 0 MaxSeqNo: 40 sessionId: src_id|f9876ae0-eed65eeb-2eaa2cdb-f8a271e_0
2025-10-10T14:38:54.173861Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd290399-f0d26f1d-db476deb-323429b0_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|f9876ae0-eed65eeb-2eaa2cdb-f8a271e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:54.176673Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f9876ae0-eed65eeb-2eaa2cdb-f8a271e_0] Write session: try to update token
2025-10-10T14:38:54.176692Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f9876ae0-eed65eeb-2eaa2cdb-f8a271e_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:54.193371Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2817 sessionId: src_id|f9876ae0-eed65eeb-2eaa2cdb-f8a271e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:54.195127Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:54.195145Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:54.195149Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:54.195151Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:54.195162Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602579522303058:8571]
2025-10-10T14:38:54.195167Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602579522303058:8571]
2025-10-10T14:38:54.195171Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602579522303058:8571]
2025-10-10T14:38:54.195217Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:54.195223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:54.195224Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:54.195231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:54.195234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:54.195240Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:54.195383Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:54.196132Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:54.245655Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602580304542805:6861]
2025-10-10T14:38:54.245992Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 pipe creation result: OK TabletId: 72075186224037892 Generation: 2816, pipe: [1:7559602580304542805:6861]
2025-10-10T14:38:54.314489Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:54.314801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:54.314814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:54.314864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602580304542805:6861], now have 1 active actors on pipe
2025-10-10T14:38:54.315148Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:54.315827Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:54.315907Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 15 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602580304542805:6861]
2025-10-10T14:38:54.315934Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:38:54.316364Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9876ae0-eed65eeb-2eaa2cdb-f8a271e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:38:54.316377Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9876ae0-eed65eeb-2eaa2cdb-f8a271e_0] Write session will restart in 0.006492s
2025-10-10T14:38:54.316400Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9876ae0-eed65eeb-2eaa2cdb-f8a271e_0] Write session: Do CDS request
2025-10-10T14:38:54.316406Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9876ae0-eed65eeb-2eaa2cdb-f8a271e_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:54.316004Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2817 reason: status is not ok: tablet will be restarted right now sessionId: src_id|f9876ae0-eed65eeb-2eaa2cdb-f8a271e_0
2025-10-10T14:38:54.316220Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2817 sessionId: src_id|f9876ae0-eed65eeb-2eaa2cdb-f8a271e_0 is DEAD
2025-10-10T14:38:54.323981Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f9876ae0-eed65eeb-2eaa2cdb-f8a271e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:54.324083Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:54.324104Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2818
2025-10-10T14:38:54.324247Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2818 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:54.324298Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2818 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:54.324309Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2818 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:54.324313Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:54.324875Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2818 sessionId:  describe result for acl check
2025-10-10T14:38:54.324926Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:54.324933Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:54.324935Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:54.324942Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602580304542821:6522] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:54.325629Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602580304542821:6522] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:54.329985Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602580304542821:6522] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:54.333948Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602580304542821:6522] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:54.333967Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602580304542821:6522] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:54.333972Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602580304542821:6522] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:54.333982Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2818 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:54.334762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:54.338963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:54.339240Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:54.339251Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:54.339263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:54.339341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:54.339388Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602579522303224:8568]
2025-10-10T14:38:54.340029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:54.340394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:54.340448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:54.340804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:54.340864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:54.340870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:54.340872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:54.340873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:54.340874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:54.340875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:54.340876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:54.340878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:54.340879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:54.340881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:54.340882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:54.340883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:54.340884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:54.340891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:54.340904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:54.340909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:54.340913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:54.340917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:54.340920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:54.340924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:54.340928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:54.340932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:54.340937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:54.340941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:54.340944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:54.340948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:54.340956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:54.340965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:54.340972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:54.340977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:54.340983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:54.340988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:54.340992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:54.340997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:54.341002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:54.341008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:54.341012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:54.341017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:54.341022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:54.341027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:54.341039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:54.341045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:54.341057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:54.341062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:54.341066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:54.341071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:54.341076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:54.341082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:54.341087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:54.341094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:54.341099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:54.341104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:54.341147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:54.345430Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2817
2025-10-10T14:38:54.343886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:54.345470Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2817
2025-10-10T14:38:54.344619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:54.344625Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:54.344628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:54.344632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:54.344640Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2817 [2:7559602579522303224:8568]
2025-10-10T14:38:54.344654Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:54.344673Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:54.344676Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:54.344680Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:54.344682Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:54.344701Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:54.344710Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:54.344718Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:54.344780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:54.344782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:54.344784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:54.344787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:54.344860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:54.344863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:54.344876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:54.344900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:54.344913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:54.344934Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602579522303219:8568]
2025-10-10T14:38:54.344937Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602579522303219:8568]
2025-10-10T14:38:54.344939Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602579522303219:8568]
2025-10-10T14:38:54.344954Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:54.344969Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:54.344979Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:54.344981Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:54.345005Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602579522303219:8568]
2025-10-10T14:38:54.345007Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:54.345013Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:54.345017Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:54.345019Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:54.345026Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:54.345345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602580304542955:6522], now have 1 active actors on pipe
2025-10-10T14:38:54.345350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602580304542806:2438], now have 1 active actors on pipe
2025-10-10T14:38:54.345583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:54.345589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:54.345620Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|29281b2b-9d5c561-a87553ea-8b6603f9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:54.345629Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:54.345634Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:54.345637Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:54.345653Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:54.345675Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:54.345692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:54.345909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:54.345922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:54.345946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:54.346145Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2818 partition: 0 MaxSeqNo: 40 sessionId: src_id|29281b2b-9d5c561-a87553ea-8b6603f9_0
2025-10-10T14:38:54.346620Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9876ae0-eed65eeb-2eaa2cdb-f8a271e_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|29281b2b-9d5c561-a87553ea-8b6603f9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:54.349591Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|29281b2b-9d5c561-a87553ea-8b6603f9_0] Write session: try to update token
2025-10-10T14:38:54.349612Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|29281b2b-9d5c561-a87553ea-8b6603f9_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:54.365150Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2818 sessionId: src_id|29281b2b-9d5c561-a87553ea-8b6603f9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:54.366635Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:54.366655Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:54.366660Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:54.366663Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:54.366673Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602579522303219:8568]
2025-10-10T14:38:54.366678Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602579522303219:8568]
2025-10-10T14:38:54.366683Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602579522303219:8568]
2025-10-10T14:38:54.366738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:54.366751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:54.366760Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:54.366816Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:54.366829Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:54.366834Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:54.366898Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:54.367948Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:54.416098Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602580304542968:6861]
2025-10-10T14:38:54.416466Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 pipe creation result: OK TabletId: 72075186224037892 Generation: 2817, pipe: [1:7559602580304542968:6861]
2025-10-10T14:38:54.486280Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:54.486853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:54.486869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:54.486921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602580304542968:6861], now have 1 active actors on pipe
2025-10-10T14:38:54.487157Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:54.487186Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:54.487192Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:54.487204Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:54.487652Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|29281b2b-9d5c561-a87553ea-8b6603f9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:54.487662Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|29281b2b-9d5c561-a87553ea-8b6603f9_0] Write session will restart in 0.009628s
2025-10-10T14:38:54.487689Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|29281b2b-9d5c561-a87553ea-8b6603f9_0] Write session: Do CDS request
2025-10-10T14:38:54.487696Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|29281b2b-9d5c561-a87553ea-8b6603f9_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:54.487256Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 16 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602580304542968:6861]
2025-10-10T14:38:54.487265Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2818 reason: error at write: Disconnected sessionId: src_id|29281b2b-9d5c561-a87553ea-8b6603f9_0
2025-10-10T14:38:54.487482Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2818 sessionId: src_id|29281b2b-9d5c561-a87553ea-8b6603f9_0 is DEAD
2025-10-10T14:38:54.498938Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|29281b2b-9d5c561-a87553ea-8b6603f9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:54.499073Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:54.499093Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2819
2025-10-10T14:38:54.499234Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2819 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:54.499282Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2819 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:54.499293Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2819 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:54.499298Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:54.499841Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2819 sessionId:  describe result for acl check
2025-10-10T14:38:54.499895Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:54.499904Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:54.499906Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:54.499913Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602580304543054:6512] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:54.500571Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602580304543054:6512] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:54.502993Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602580304543054:6512] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:54.504146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:54.507934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:54.508185Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:54.508196Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:54.508210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:54.508277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:54.508299Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602580304543054:6512] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:54.508319Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602580304543054:6512] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:54.508323Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602580304543054:6512] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:54.508333Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2819 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:54.508324Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602579522303394:8564]
2025-10-10T14:38:54.508921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:54.509349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:54.509413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:54.509840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:54.509926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:54.509933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:54.509935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:54.509936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:54.509938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:54.509939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:54.509940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:54.509941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:54.509943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:54.509944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:54.509946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:54.509947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:54.509949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:54.509956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:54.509972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:54.509977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:54.509982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:54.509986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:54.509989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:54.509994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:54.509998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:54.510002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:54.510006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:54.510009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:54.510013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:54.510017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:54.510026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:54.510036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:54.510044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:54.510050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:54.510055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:54.510060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:54.510065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:54.510071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:54.510077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:54.510082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:54.510087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:54.510093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:54.510098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:54.510105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:54.510110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:54.510115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:54.510120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:54.510125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:54.510130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:54.510136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:54.510141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:54.510155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:54.510160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:54.510170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:54.510175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:54.510186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:54.510229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:54.512863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:54.513577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:54.513592Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:54.513596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:54.513601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:54.513608Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2818 [2:7559602579522303394:8564]
2025-10-10T14:38:54.513625Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:54.513646Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:54.513650Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:54.513654Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:54.513656Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:54.513675Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:54.513684Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:54.513692Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:54.513760Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:54.513762Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:54.513764Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:54.513767Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:54.513842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:54.513845Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:54.513857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:54.513869Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:54.513888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:54.513910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602580304543122:6512], now have 1 active actors on pipe
2025-10-10T14:38:54.513914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602580304542969:2438], now have 1 active actors on pipe
2025-10-10T14:38:54.513922Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602579522303389:8564]
2025-10-10T14:38:54.513924Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602579522303389:8564]
2025-10-10T14:38:54.513927Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602579522303389:8564]
2025-10-10T14:38:54.513942Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:54.513960Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:54.513967Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:54.513972Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:54.513974Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:54.513977Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:54.513981Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:54.514012Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602579522303389:8564]
2025-10-10T14:38:54.514019Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:54.514025Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:54.514645Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2818
2025-10-10T14:38:54.514683Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2818
2025-10-10T14:38:54.514808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:54.514827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:54.514862Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d39eb0eb-7d2e1a8d-f7a06958-586d3502_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:54.514890Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:54.514895Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:54.514898Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:54.514913Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:54.514925Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:54.514949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:54.515172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:54.515185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:54.515210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:54.515337Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2819 partition: 0 MaxSeqNo: 40 sessionId: src_id|d39eb0eb-7d2e1a8d-f7a06958-586d3502_0
2025-10-10T14:38:54.515779Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|29281b2b-9d5c561-a87553ea-8b6603f9_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|d39eb0eb-7d2e1a8d-f7a06958-586d3502_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:54.518865Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d39eb0eb-7d2e1a8d-f7a06958-586d3502_0] Write session: try to update token
2025-10-10T14:38:54.518889Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d39eb0eb-7d2e1a8d-f7a06958-586d3502_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:54.533873Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:38:54.533894Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:54.533908Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602579522303389:8564]
2025-10-10T14:38:54.533946Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:38:54.533961Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:38:54.534174Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:38:54.534422Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:54.534695Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:54.534852Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:54.535070Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:38:54.535115Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:38:54.536721Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2819 sessionId: src_id|d39eb0eb-7d2e1a8d-f7a06958-586d3502_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:54.539528Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:54.539760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:54.539785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:54.539825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:38:54.539934Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:38:54.547268Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:54.547288Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:54.547291Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:54.547294Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:54.547306Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602579522303389:8564]
2025-10-10T14:38:54.547310Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602579522303389:8564]
2025-10-10T14:38:54.547315Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602579522303389:8564]
2025-10-10T14:38:54.547371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:54.547374Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:54.547380Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:54.547382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:54.547395Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:54.547400Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:54.547524Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:54.587992Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602580304543137:6861]
2025-10-10T14:38:54.588331Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 pipe creation result: OK TabletId: 72075186224037892 Generation: 2818, pipe: [1:7559602580304543137:6861]
2025-10-10T14:38:54.665402Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:54.672970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:54.672995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:54.673157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:54.673208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:54.673265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:54.673428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:54.673478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:54.673483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:54.673571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:54.677217Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 17 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602580304543137:6861]
2025-10-10T14:38:54.677251Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:54.677253Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:54.673633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:54.677277Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2819 reason: error at write: Disconnected sessionId: src_id|d39eb0eb-7d2e1a8d-f7a06958-586d3502_0
2025-10-10T14:38:54.673696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:54.677405Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:54.673763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:54.673809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:54.673812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:54.673886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:54.673944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:54.674003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:54.674061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:54.674106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:54.674109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:54.674180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:54.674244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:54.674307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:54.674370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:54.674420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:54.674424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:54.674495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:54.674555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:54.674619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:54.674682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:54.674724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:54.674728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:54.674799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:54.674859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:54.674922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:54.674986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:54.675032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:54.675044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:54.675120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:54.675175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:54.675230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:54.675285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:54.675322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:54.675324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:54.675409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:54.675473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:54.675531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:54.675582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:54.675621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:54.675624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:54.675694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:54.675749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:54.675806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:54.675873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:54.675918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:54.675921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:54.675984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:54.676033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:54.676084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:54.676140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:54.676185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:54.676187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:54.676255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602580304543137:6861], now have 1 active actors on pipe
2025-10-10T14:38:54.677382Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:54.678160Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d39eb0eb-7d2e1a8d-f7a06958-586d3502_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:54.678168Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d39eb0eb-7d2e1a8d-f7a06958-586d3502_0] Write session will restart in 0.008068s
2025-10-10T14:38:54.678189Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d39eb0eb-7d2e1a8d-f7a06958-586d3502_0] Write session: Do CDS request
2025-10-10T14:38:54.678196Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d39eb0eb-7d2e1a8d-f7a06958-586d3502_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:54.677497Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2819 sessionId: src_id|d39eb0eb-7d2e1a8d-f7a06958-586d3502_0 is DEAD
2025-10-10T14:38:54.689879Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d39eb0eb-7d2e1a8d-f7a06958-586d3502_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:54.692529Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:54.692553Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2820
2025-10-10T14:38:54.692735Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2820 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:54.692779Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2820 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:54.692786Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2820 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:54.692791Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:54.693287Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2820 sessionId:  describe result for acl check
2025-10-10T14:38:54.693317Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:54.693319Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:54.693322Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:54.693345Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602580304543283:6475] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:54.694946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:54.693935Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602580304543283:6475] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:54.696812Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602580304543283:6475] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:54.699494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:54.699760Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:54.699766Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:54.699779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:54.699845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:54.699886Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602579522303555:8552]
2025-10-10T14:38:54.700533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:54.700873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:54.700928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:54.701317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:54.701399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:54.701406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:54.701408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:54.701409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:54.701411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:54.701412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:54.701414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:54.701415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:54.701417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:54.701418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:54.701420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:54.701421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:54.701423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:54.701430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:54.701444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:54.701449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:54.701453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:54.701458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:54.701462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:54.701466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:54.701471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:54.701475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:54.701482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:54.701486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:54.701490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:54.701495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:54.701504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:54.701513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:54.701520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:54.701526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:54.701531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:54.701536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:54.701541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:54.701548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:54.701567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:54.701579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:54.701584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:54.701590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:54.701596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:54.701602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:54.701606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:54.701612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:54.701618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:54.701623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:54.701629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:54.701634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:54.701640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:54.701645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:54.701650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:54.701654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:54.701659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:54.701665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:54.701707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:54.704396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:54.705027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:54.705045Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:54.705049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:54.705052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:54.705059Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2819 [2:7559602579522303555:8552]
2025-10-10T14:38:54.705073Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:54.705096Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:54.705104Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:54.705108Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:54.705111Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:54.705143Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:54.705157Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:54.705166Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:54.705239Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:54.705250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:54.705252Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:54.705256Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:54.699891Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602580304543283:6475] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:54.699921Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602580304543283:6475] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:54.699926Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602580304543283:6475] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:54.699938Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2820 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:54.705327Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:54.705358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:54.705371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:54.705382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:54.705400Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:54.705436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602580304543315:6475], now have 1 active actors on pipe
2025-10-10T14:38:54.705440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602580304543158:2438], now have 1 active actors on pipe
2025-10-10T14:38:54.705448Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602579522303550:8552]
2025-10-10T14:38:54.705451Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602579522303550:8552]
2025-10-10T14:38:54.705453Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602579522303550:8552]
2025-10-10T14:38:54.705468Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:54.705483Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:54.705484Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:54.705486Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:54.705488Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:54.705500Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:54.705503Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:54.705535Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602579522303550:8552]
2025-10-10T14:38:54.705542Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:54.705566Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2819
2025-10-10T14:38:54.705576Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2819
2025-10-10T14:38:54.705651Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:54.705774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:54.705786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:54.705823Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|eefa292d-e40123d1-6aa52d12-d1390966_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:54.705843Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:54.705849Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:54.705852Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:54.705865Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:54.705879Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:54.705898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:54.706076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:54.706082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:54.706097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:54.706222Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2820 partition: 0 MaxSeqNo: 40 sessionId: src_id|eefa292d-e40123d1-6aa52d12-d1390966_0
2025-10-10T14:38:54.706665Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d39eb0eb-7d2e1a8d-f7a06958-586d3502_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|eefa292d-e40123d1-6aa52d12-d1390966_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:54.709610Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eefa292d-e40123d1-6aa52d12-d1390966_0] Write session: try to update token
2025-10-10T14:38:54.709632Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eefa292d-e40123d1-6aa52d12-d1390966_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:54.728035Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2820 sessionId: src_id|eefa292d-e40123d1-6aa52d12-d1390966_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:54.730946Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:54.731527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:54.731555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:54.731580Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:54.731584Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:54.731587Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:54.731590Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:54.731601Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602579522303550:8552]
2025-10-10T14:38:54.731606Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602579522303550:8552]
2025-10-10T14:38:54.731611Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602579522303550:8552]
2025-10-10T14:38:54.731656Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:54.731663Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:54.731668Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:54.731690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:54.731698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:54.731701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:54.731864Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:54.773448Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602580304543326:6861]
2025-10-10T14:38:54.773863Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 pipe creation result: OK TabletId: 72075186224037892 Generation: 2819, pipe: [1:7559602580304543326:6861]
2025-10-10T14:38:54.851797Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:54.852844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:38:54.852911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602580304543326:6861], now have 1 active actors on pipe
2025-10-10T14:38:54.853029Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:38:54.853136Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:54.853146Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:54.853234Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2820 reason: error at write: Disconnected sessionId: src_id|eefa292d-e40123d1-6aa52d12-d1390966_0
2025-10-10T14:38:54.853411Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2820 sessionId: src_id|eefa292d-e40123d1-6aa52d12-d1390966_0 is DEAD
2025-10-10T14:38:54.853571Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:54.853626Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 18 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602580304543326:6861]
2025-10-10T14:38:54.853791Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eefa292d-e40123d1-6aa52d12-d1390966_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:54.853816Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eefa292d-e40123d1-6aa52d12-d1390966_0] Write session will restart in 0.009184s
2025-10-10T14:38:54.853842Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eefa292d-e40123d1-6aa52d12-d1390966_0] Write session: Do CDS request
2025-10-10T14:38:54.853848Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eefa292d-e40123d1-6aa52d12-d1390966_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:54.863928Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eefa292d-e40123d1-6aa52d12-d1390966_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:54.864316Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:54.864336Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2821
2025-10-10T14:38:54.864449Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2821 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:54.864480Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2821 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:54.864487Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2821 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:54.864491Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:54.865295Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2821 sessionId:  describe result for acl check
2025-10-10T14:38:54.865351Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:54.865359Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:54.865361Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:54.865367Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602580304543400:6440] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:54.865994Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602580304543400:6440] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:54.868631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602580304543400:6440] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:54.875377Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602580304543400:6440] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:54.875396Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602580304543400:6440] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:54.875400Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602580304543400:6440] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:54.875409Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2821 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:54.875467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:54.876127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:54.876318Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:54.876333Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:54.876345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:54.876393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:54.876437Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602579522303747:8538]
2025-10-10T14:38:54.877062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:54.877479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:54.877564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:54.877908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:54.877977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:54.877995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:54.877996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:54.877998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:54.877999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:54.878000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:54.878001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:54.878003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:54.878004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:54.878005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:54.878006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:54.878007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:54.878008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:54.878016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:54.878028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:54.878032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:54.878036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:54.878040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:54.878044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:54.878050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:54.878054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:54.878058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:54.878062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:54.878067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:54.878071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:54.878074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:54.878082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:54.878091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:54.878097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:54.878103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:54.878107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:54.878113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:54.878118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:54.878123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:54.878127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:54.878132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:54.878137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:54.878142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:54.878146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:54.878150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:54.878154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:54.878158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:54.878162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:54.878167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:54.878172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:54.878177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:54.878181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:54.878186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:54.878190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:54.878195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:54.878201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:54.878206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:54.878244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:54.880691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:54.881005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:54.881018Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:54.881021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:54.881025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:54.881030Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2820 [2:7559602579522303747:8538]
2025-10-10T14:38:54.881043Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:54.881060Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:54.881063Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:54.881067Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:54.881070Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:54.881098Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:54.881110Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:54.881118Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:54.881172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:54.881178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:54.881181Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:54.881183Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:54.881247Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:54.881254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:54.881266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:54.881284Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:54.881301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:54.881400Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2820
2025-10-10T14:38:54.881400Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2820
2025-10-10T14:38:54.881906Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2821 partition: 0 MaxSeqNo: 40 sessionId: src_id|4087ad65-71df060a-e0b3b8f7-fdf3dff7_0
2025-10-10T14:38:54.882287Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eefa292d-e40123d1-6aa52d12-d1390966_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|4087ad65-71df060a-e0b3b8f7-fdf3dff7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:54.881327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602580304543501:6440], now have 1 active actors on pipe
2025-10-10T14:38:54.881353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602580304543346:2438], now have 1 active actors on pipe
2025-10-10T14:38:54.881362Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602579522303741:8538]
2025-10-10T14:38:54.881365Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602579522303741:8538]
2025-10-10T14:38:54.881367Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602579522303741:8538]
2025-10-10T14:38:54.881382Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:54.881398Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:54.881401Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:54.881405Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:54.881407Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:54.881415Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:54.881418Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:54.881445Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602579522303741:8538]
2025-10-10T14:38:54.881448Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:54.881450Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:54.881465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:54.881470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:54.881525Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4087ad65-71df060a-e0b3b8f7-fdf3dff7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:54.881533Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:54.881539Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:54.881542Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:54.881566Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:54.881577Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:54.881597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:54.881785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:54.881788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:54.881804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:54.885069Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4087ad65-71df060a-e0b3b8f7-fdf3dff7_0] Write session: try to update token
2025-10-10T14:38:54.885088Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4087ad65-71df060a-e0b3b8f7-fdf3dff7_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:54.900789Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2821 sessionId: src_id|4087ad65-71df060a-e0b3b8f7-fdf3dff7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:54.901677Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:54.901696Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:54.901700Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:54.901702Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:54.901713Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602579522303741:8538]
2025-10-10T14:38:54.901717Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602579522303741:8538]
2025-10-10T14:38:54.901722Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602579522303741:8538]
2025-10-10T14:38:54.901773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:54.901775Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:54.901782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:54.901782Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:54.901785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:54.901805Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:54.901935Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:54.903582Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:54.953857Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602580304543525:6861]
2025-10-10T14:38:54.954210Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 pipe creation result: OK TabletId: 72075186224037892 Generation: 2820, pipe: [1:7559602580304543525:6861]
2025-10-10T14:38:55.018768Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:55.019378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:55.019398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:55.019450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602580304543525:6861], now have 1 active actors on pipe
2025-10-10T14:38:55.019702Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:55.019682Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:55.019701Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:55.019703Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:55.019762Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 19 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602580304543525:6861]
2025-10-10T14:38:55.019769Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2821 reason: error at write: Disconnected sessionId: src_id|4087ad65-71df060a-e0b3b8f7-fdf3dff7_0
2025-10-10T14:38:55.020012Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2821 sessionId: src_id|4087ad65-71df060a-e0b3b8f7-fdf3dff7_0 is DEAD
2025-10-10T14:38:55.020185Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4087ad65-71df060a-e0b3b8f7-fdf3dff7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:55.020197Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4087ad65-71df060a-e0b3b8f7-fdf3dff7_0] Write session will restart in 0.006900s
2025-10-10T14:38:55.020222Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4087ad65-71df060a-e0b3b8f7-fdf3dff7_0] Write session: Do CDS request
2025-10-10T14:38:55.020229Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4087ad65-71df060a-e0b3b8f7-fdf3dff7_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:55.027911Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4087ad65-71df060a-e0b3b8f7-fdf3dff7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:55.027951Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:55.027973Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2822
2025-10-10T14:38:55.028154Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2822 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:55.028193Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2822 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:55.028204Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2822 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:55.028208Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:55.028715Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2822 sessionId:  describe result for acl check
2025-10-10T14:38:55.028759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:55.028761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:55.028763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:55.028769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602584599510838:6417] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:55.029376Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602584599510838:6417] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:55.032972Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602584599510838:6417] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:55.036463Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602584599510838:6417] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:55.036482Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602584599510838:6417] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:55.036486Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602584599510838:6417] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:55.036496Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2822 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:55.037055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:55.040797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:55.041059Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:55.041072Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:55.041085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:55.041161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:55.041212Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602583817271213:8524]
2025-10-10T14:38:55.041914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:55.042306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:55.042353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:55.042684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:55.042757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:55.042764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:55.042766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:55.042767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:55.042769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:55.042770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:55.042772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:55.042773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:55.042775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:55.042776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:55.042777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:55.042779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:55.042780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:55.042787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:55.042803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:55.042807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:55.042812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:55.042816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:55.042821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:55.042826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:55.042831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:55.042835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:55.042840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:55.042844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:55.042849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:55.042853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:55.042862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:55.042871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:55.042879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:55.042905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:55.042912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:55.042922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:55.042927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:55.042934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:55.042940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:55.042946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:55.042955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:55.042962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:55.042972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:55.042979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:55.042988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:55.042994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:55.043005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:55.043011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:55.043016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:55.043022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:55.043028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:55.043039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:55.043043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:55.043054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:55.043060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:55.043070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:55.043118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:55.045795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:55.046207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:55.046218Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:55.046220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:55.046224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:55.046230Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2821 [2:7559602583817271213:8524]
2025-10-10T14:38:55.046244Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:55.046262Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:55.046270Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:55.046274Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:55.046276Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:55.046295Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:55.046304Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:55.046317Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:55.046380Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:55.046387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:55.046389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:55.046392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:55.046471Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:55.046478Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:55.046491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:55.046504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:55.046527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:55.046553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602584599510975:6417], now have 1 active actors on pipe
2025-10-10T14:38:55.046559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602584599510823:2438], now have 1 active actors on pipe
2025-10-10T14:38:55.046566Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602583817271208:8524]
2025-10-10T14:38:55.046567Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602583817271208:8524]
2025-10-10T14:38:55.046569Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602583817271208:8524]
2025-10-10T14:38:55.046582Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:55.046602Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:55.046611Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:55.046614Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:55.046616Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:55.046623Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:55.046626Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:55.046657Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602583817271208:8524]
2025-10-10T14:38:55.046637Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2821
2025-10-10T14:38:55.046669Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:55.046651Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2821
2025-10-10T14:38:55.046683Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:55.046704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:55.046709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:55.046746Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b8c7967d-ef5a71e4-791c6bfa-dbb8f2c7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:55.046758Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:55.046762Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:55.046765Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:55.046777Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:55.046792Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:55.046811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:55.046958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:55.046966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:55.046981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:55.047053Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2822 partition: 0 MaxSeqNo: 40 sessionId: src_id|b8c7967d-ef5a71e4-791c6bfa-dbb8f2c7_0
2025-10-10T14:38:55.047542Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4087ad65-71df060a-e0b3b8f7-fdf3dff7_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|b8c7967d-ef5a71e4-791c6bfa-dbb8f2c7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:55.050360Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b8c7967d-ef5a71e4-791c6bfa-dbb8f2c7_0] Write session: try to update token
2025-10-10T14:38:55.050381Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b8c7967d-ef5a71e4-791c6bfa-dbb8f2c7_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:55.058444Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:38:55.058464Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:55.058475Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602583817271208:8524]
2025-10-10T14:38:55.058531Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:38:55.058534Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:38:55.058716Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:38:55.058865Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:55.059004Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:55.059156Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:55.059353Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:38:55.059395Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:38:55.065097Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2822 sessionId: src_id|b8c7967d-ef5a71e4-791c6bfa-dbb8f2c7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:55.067656Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:55.068292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:55.068318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:55.068363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:38:55.068449Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:38:55.076048Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:55.076065Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:55.076067Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:55.076069Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:55.076080Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602583817271208:8524]
2025-10-10T14:38:55.076084Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602583817271208:8524]
2025-10-10T14:38:55.076087Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602583817271208:8524]
2025-10-10T14:38:55.076133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:55.076137Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:55.076143Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:55.076144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:55.076154Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:55.076159Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:55.076262Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:55.120056Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602584599510988:6861]
2025-10-10T14:38:55.120400Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 pipe creation result: OK TabletId: 72075186224037892 Generation: 2821, pipe: [1:7559602584599510988:6861]
2025-10-10T14:38:55.194125Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:55.201995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:55.202020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:55.202182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:55.202253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:55.202321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:55.202399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:55.202443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:55.202448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:55.202522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:55.202582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:55.202653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:55.202719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:55.202761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:55.202764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:55.202840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:55.202902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:55.202973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:55.203041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:55.203090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:55.203094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:55.203168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:55.203235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:55.203296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:55.203358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:55.203403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:55.203406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:55.203481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:55.203541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:55.203599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:55.203651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:55.203695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:55.203698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:55.203770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:55.203836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:55.203898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:55.203953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:55.203992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:55.203996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:55.204056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:55.204108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:55.204163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:55.204216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:55.204254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:55.204256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:55.204317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:55.204367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:55.204423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:55.204478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:55.204516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:55.204518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:55.204578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:55.204645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:55.204710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:55.204766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:55.204805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:55.204808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:55.204885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:55.204939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:55.204995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:55.205054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:55.205100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:55.205103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:55.205435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602584599510988:6861], now have 1 active actors on pipe
2025-10-10T14:38:55.206548Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:55.205905Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:55.205926Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:55.205959Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2822 reason: error at write: Disconnected sessionId: src_id|b8c7967d-ef5a71e4-791c6bfa-dbb8f2c7_0
2025-10-10T14:38:55.206170Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2822 sessionId: src_id|b8c7967d-ef5a71e4-791c6bfa-dbb8f2c7_0 is DEAD
2025-10-10T14:38:55.206384Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 20 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602584599510988:6861]
2025-10-10T14:38:55.206409Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:55.209456Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8c7967d-ef5a71e4-791c6bfa-dbb8f2c7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:55.209471Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8c7967d-ef5a71e4-791c6bfa-dbb8f2c7_0] Write session will restart in 0.005648s
2025-10-10T14:38:55.209499Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8c7967d-ef5a71e4-791c6bfa-dbb8f2c7_0] Write session: Do CDS request
2025-10-10T14:38:55.209506Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8c7967d-ef5a71e4-791c6bfa-dbb8f2c7_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:55.217870Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b8c7967d-ef5a71e4-791c6bfa-dbb8f2c7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:55.217990Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:55.218008Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2823
2025-10-10T14:38:55.218168Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2823 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:55.218208Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2823 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:55.218219Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2823 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:55.218224Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:55.218852Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2823 sessionId:  describe result for acl check
2025-10-10T14:38:55.218891Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:55.218893Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:55.218895Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:55.218903Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602584599511034:6410] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:55.219506Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602584599511034:6410] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:55.222664Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602584599511034:6410] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:55.226229Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602584599511034:6410] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:55.226246Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602584599511034:6410] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:55.226250Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602584599511034:6410] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:55.226261Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2823 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:55.226676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:55.230485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:55.230702Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:55.230714Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:55.230726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:55.230783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:55.230828Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602583817271378:8513]
2025-10-10T14:38:55.231463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:55.231844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:55.231912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:55.232266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:55.232329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:55.232335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:55.232336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:55.232337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:55.232338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:55.232340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:55.232341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:55.232342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:55.232344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:55.232345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:55.232346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:55.232348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:55.232349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:55.232356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:55.232370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:55.232374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:55.232379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:55.232383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:55.232388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:55.232392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:55.232396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:55.232400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:55.232405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:55.232409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:55.232412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:55.232417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:55.232424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:55.232433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:55.232444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:55.232451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:55.232455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:55.232465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:55.232468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:55.232474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:55.232479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:55.232490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:55.232494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:55.232500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:55.232507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:55.232511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:55.232517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:55.232523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:55.232529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:55.232535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:55.232544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:55.232551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:55.232555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:55.232561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:55.232564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:55.232570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:55.232575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:55.232580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:55.232622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:55.235238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:55.235820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:55.235832Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:55.235835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:55.235839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:55.235845Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2822 [2:7559602583817271378:8513]
2025-10-10T14:38:55.235858Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:55.235878Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:55.235884Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:55.235887Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:55.235890Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:55.235908Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:55.235922Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:55.235932Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:55.235992Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:55.236000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:55.236002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:55.236005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:55.236074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:55.236081Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:55.236091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:55.236106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:55.236122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:55.236151Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602583817271373:8513]
2025-10-10T14:38:55.236154Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602583817271373:8513]
2025-10-10T14:38:55.236156Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602583817271373:8513]
2025-10-10T14:38:55.236168Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:55.236186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602584599511145:6410], now have 1 active actors on pipe
2025-10-10T14:38:55.236194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602584599510991:2438], now have 1 active actors on pipe
2025-10-10T14:38:55.236203Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:55.236224Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:55.236231Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:55.236233Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2822
2025-10-10T14:38:55.236257Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:55.236260Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602583817271373:8513]
2025-10-10T14:38:55.236263Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:55.236276Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2822
2025-10-10T14:38:55.236269Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:55.236272Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:55.236280Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:55.236303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:55.236314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:55.236345Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2baa20db-ac337579-5bf29b07-c1ecc3f5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:55.236358Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:55.236364Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:55.236366Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:55.236379Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:55.236389Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:55.236411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:55.236581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:55.236589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:55.236605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:55.236699Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2823 partition: 0 MaxSeqNo: 40 sessionId: src_id|2baa20db-ac337579-5bf29b07-c1ecc3f5_0
2025-10-10T14:38:55.237116Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8c7967d-ef5a71e4-791c6bfa-dbb8f2c7_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|2baa20db-ac337579-5bf29b07-c1ecc3f5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:55.240015Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2baa20db-ac337579-5bf29b07-c1ecc3f5_0] Write session: try to update token
2025-10-10T14:38:55.240038Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2baa20db-ac337579-5bf29b07-c1ecc3f5_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:55.247868Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:38:55.247885Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:55.247896Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602583817271373:8513]
2025-10-10T14:38:55.247946Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:38:55.247948Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:38:55.248121Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:38:55.248274Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:55.248421Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:55.248562Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:55.248759Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:38:55.248804Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:38:55.254657Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2823 sessionId: src_id|2baa20db-ac337579-5bf29b07-c1ecc3f5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:55.257540Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:55.257794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:55.257818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:55.257865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:38:55.257990Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:38:55.266276Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:55.266296Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:55.266300Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:55.266302Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:55.266312Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602583817271373:8513]
2025-10-10T14:38:55.266316Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602583817271373:8513]
2025-10-10T14:38:55.266319Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602583817271373:8513]
2025-10-10T14:38:55.266366Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:55.266377Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:55.266378Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:55.266382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:55.266385Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:55.266389Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:55.266515Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:55.306452Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602584599511158:6861]
2025-10-10T14:38:55.306751Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 pipe creation result: OK TabletId: 72075186224037892 Generation: 2822, pipe: [1:7559602584599511158:6861]
2025-10-10T14:38:55.382869Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:55.391609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:55.391640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:55.391825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:55.391890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:55.391957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:55.392022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:55.392600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:55.392613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:55.392684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:55.392748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:55.392813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:55.392880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:55.392926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:55.392934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:55.393001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:55.393063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:55.393129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:55.393195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:55.393240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:55.393248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:55.393314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:55.393405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:55.393468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:55.393533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:55.393589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:55.393596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:55.393661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:55.393723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:55.393786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:55.393849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:55.393895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:55.393902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:55.393973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:55.394040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:55.394107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:55.394175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:55.394223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:55.394230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:55.394298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:55.394365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:55.394437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:55.394503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:55.394552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:55.394555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:55.394625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:55.394692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:55.394758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:55.394823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:55.394885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:55.394892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:55.394961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:55.395023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:55.395093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:55.395171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:55.395222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:55.395228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:55.395299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:55.395365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:55.395428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:55.395493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:55.395545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:55.395553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:55.395625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602584599511158:6861], now have 1 active actors on pipe
2025-10-10T14:38:55.395865Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:55.395867Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 21 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602584599511158:6861]
2025-10-10T14:38:55.395890Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:55.395890Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:55.395922Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2823 reason: error at write: Disconnected sessionId: src_id|2baa20db-ac337579-5bf29b07-c1ecc3f5_0
2025-10-10T14:38:55.396153Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2823 sessionId: src_id|2baa20db-ac337579-5bf29b07-c1ecc3f5_0 is DEAD
2025-10-10T14:38:55.396175Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:55.396360Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2baa20db-ac337579-5bf29b07-c1ecc3f5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:55.396372Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2baa20db-ac337579-5bf29b07-c1ecc3f5_0] Write session will restart in 0.009968s
2025-10-10T14:38:55.396410Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2baa20db-ac337579-5bf29b07-c1ecc3f5_0] Write session: Do CDS request
2025-10-10T14:38:55.396417Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2baa20db-ac337579-5bf29b07-c1ecc3f5_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:55.407968Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2baa20db-ac337579-5bf29b07-c1ecc3f5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:55.408029Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:55.408055Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2824
2025-10-10T14:38:55.408209Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2824 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:55.408254Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2824 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:55.408264Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2824 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:55.408268Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:55.408711Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2824 sessionId:  describe result for acl check
2025-10-10T14:38:55.408745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:55.408751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:55.408753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:55.408759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602584599511239:6401] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:55.409360Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602584599511239:6401] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:55.412107Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602584599511239:6401] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:55.413154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:55.416972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:55.417263Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:55.417275Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:55.417288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:55.417371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:55.417418Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602583817271541:8512]
2025-10-10T14:38:55.417309Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602584599511239:6401] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:55.417324Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602584599511239:6401] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:55.417341Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602584599511239:6401] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:55.417351Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2824 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:55.418073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:55.418429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:55.418485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:55.418839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:55.418899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:55.418906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:55.418907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:55.418909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:55.418910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:55.418911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:55.418913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:55.418914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:55.418916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:55.418917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:55.418918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:55.418920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:55.418921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:55.418928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:55.418941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:55.418946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:55.418951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:55.418955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:55.418959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:55.418964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:55.418968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:55.418983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:55.418988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:55.418991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:55.418995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:55.418999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:55.419008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:55.419017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:55.419024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:55.419031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:55.419035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:55.419041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:55.419046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:55.419051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:55.419056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:55.419062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:55.419066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:55.419072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:55.419076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:55.419082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:55.419086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:55.419093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:55.419098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:55.419103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:55.419107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:55.419114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:55.419119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:55.419125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:55.419129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:55.419135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:55.419140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:55.419145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:55.419190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:55.422300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:55.422647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:55.422660Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:55.422663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:55.422668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:55.422675Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2823 [2:7559602583817271541:8512]
2025-10-10T14:38:55.422690Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:55.422710Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:55.422719Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:55.422723Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:55.422726Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:55.422745Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:55.422757Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:55.422766Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:55.422831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:55.422838Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:55.422840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:55.422844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:55.422913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:55.422921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:55.422934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:55.422948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:55.422969Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:55.422996Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602583817271536:8512]
2025-10-10T14:38:55.423004Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602583817271536:8512]
2025-10-10T14:38:55.423006Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602583817271536:8512]
2025-10-10T14:38:55.423022Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:55.423025Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:55.423027Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:55.423029Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:55.423046Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:55.423067Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:55.423075Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:55.423088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602584599511316:6401], now have 1 active actors on pipe
2025-10-10T14:38:55.423096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602584599511161:2438], now have 1 active actors on pipe
2025-10-10T14:38:55.423129Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602583817271536:8512]
2025-10-10T14:38:55.423142Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:55.423121Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2823
2025-10-10T14:38:55.423143Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2823
2025-10-10T14:38:55.423213Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:55.423376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:55.423382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:55.423876Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6db3a668-77203522-3821409b-b055b2a7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:55.423894Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:55.423899Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:55.423902Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:55.423916Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:55.423937Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:55.423961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:55.424186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:55.424203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:55.424224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:55.424390Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2824 partition: 0 MaxSeqNo: 40 sessionId: src_id|6db3a668-77203522-3821409b-b055b2a7_0
2025-10-10T14:38:55.424893Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2baa20db-ac337579-5bf29b07-c1ecc3f5_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|6db3a668-77203522-3821409b-b055b2a7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:55.427960Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6db3a668-77203522-3821409b-b055b2a7_0] Write session: try to update token
2025-10-10T14:38:55.427985Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6db3a668-77203522-3821409b-b055b2a7_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:55.449114Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2824 sessionId: src_id|6db3a668-77203522-3821409b-b055b2a7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:55.451880Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:55.451731Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:55.451751Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:55.451755Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:55.451758Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:55.451770Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602583817271536:8512]
2025-10-10T14:38:55.451774Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602583817271536:8512]
2025-10-10T14:38:55.451779Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602583817271536:8512]
2025-10-10T14:38:55.451832Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:55.451836Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:55.451840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:55.451843Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:55.451843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:55.451847Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:55.451988Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:55.495865Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602584599511328:6861]
2025-10-10T14:38:55.496197Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 pipe creation result: OK TabletId: 72075186224037892 Generation: 2823, pipe: [1:7559602584599511328:6861]
2025-10-10T14:38:55.572809Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:55.573143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:55.573161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:55.573214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602584599511328:6861], now have 1 active actors on pipe
2025-10-10T14:38:55.573635Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:55.573870Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:55.573882Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:55.573947Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2824 reason: error at write: Disconnected sessionId: src_id|6db3a668-77203522-3821409b-b055b2a7_0
2025-10-10T14:38:55.574150Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2824 sessionId: src_id|6db3a668-77203522-3821409b-b055b2a7_0 is DEAD
2025-10-10T14:38:55.574301Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:55.574551Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6db3a668-77203522-3821409b-b055b2a7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:55.574571Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6db3a668-77203522-3821409b-b055b2a7_0] Write session will restart in 0.005581s
2025-10-10T14:38:55.574343Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 22 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602584599511328:6861]
2025-10-10T14:38:55.574590Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6db3a668-77203522-3821409b-b055b2a7_0] Write session: Do CDS request
2025-10-10T14:38:55.574598Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6db3a668-77203522-3821409b-b055b2a7_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:55.581952Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6db3a668-77203522-3821409b-b055b2a7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:55.581991Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:55.582007Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2825
2025-10-10T14:38:55.582197Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2825 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:55.582235Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2825 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:55.582248Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2825 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:55.582253Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:55.582754Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2825 sessionId:  describe result for acl check
2025-10-10T14:38:55.582796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:55.582802Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:55.582805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:55.582811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602584599511348:6388] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:55.583439Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602584599511348:6388] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:55.586558Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602584599511348:6388] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:55.589265Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602584599511348:6388] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:55.589280Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602584599511348:6388] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:55.589284Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602584599511348:6388] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:55.589294Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2825 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:55.589288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:55.593217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:55.593526Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:55.593544Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:55.593557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:55.593622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:55.593668Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602583817271720:8504]
2025-10-10T14:38:55.594294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:55.594633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:55.594682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:55.595011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:55.595086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:55.595092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:55.595093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:55.595094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:55.595096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:55.595097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:55.595099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:55.595100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:55.595101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:55.595103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:55.595104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:55.595106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:55.595107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:55.595113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:55.595126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:55.595130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:55.595134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:55.595138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:55.595141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:55.595145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:55.595149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:55.595152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:55.595157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:55.595160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:55.595163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:55.595168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:55.595176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:55.595186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:55.595193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:55.595198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:55.595211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:55.595216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:55.595221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:55.595225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:55.595230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:55.595236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:55.595240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:55.595246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:55.595250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:55.595256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:55.595260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:55.595265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:55.595271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:55.595275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:55.595280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:55.595286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:55.595292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:55.595298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:55.595310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:55.595316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:55.595320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:55.595325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:55.595361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:55.599248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:55.600233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:55.600249Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:55.600252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:55.600256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:55.600263Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2824 [2:7559602583817271720:8504]
2025-10-10T14:38:55.600277Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:55.600298Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:55.600302Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:55.600306Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:55.600309Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:55.600327Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:55.600335Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:55.600344Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:55.600412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:55.600420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:55.600422Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:55.600425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:55.600498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:55.600508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:55.600520Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:55.600531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:55.600548Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:55.600574Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602583817271713:8504]
2025-10-10T14:38:55.600582Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602583817271713:8504]
2025-10-10T14:38:55.600584Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602583817271713:8504]
2025-10-10T14:38:55.600593Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:55.600605Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:55.600609Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:55.600612Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:55.600617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602584599511486:6388], now have 1 active actors on pipe
2025-10-10T14:38:55.600630Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:55.600645Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:55.600648Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:55.600661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602584599511330:2438], now have 1 active actors on pipe
2025-10-10T14:38:55.600697Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602583817271713:8504]
2025-10-10T14:38:55.600710Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:55.600739Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:55.600817Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2824
2025-10-10T14:38:55.600858Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2824
2025-10-10T14:38:55.600949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:55.600965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:55.601002Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|37281812-3d3e4a7a-e5127aca-70387c1c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:55.601016Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:55.601021Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:55.601023Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:55.601034Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:55.601046Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:55.601064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:55.601300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:55.601313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:55.601355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:55.601482Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2825 partition: 0 MaxSeqNo: 40 sessionId: src_id|37281812-3d3e4a7a-e5127aca-70387c1c_0
2025-10-10T14:38:55.602007Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6db3a668-77203522-3821409b-b055b2a7_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|37281812-3d3e4a7a-e5127aca-70387c1c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:55.604846Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|37281812-3d3e4a7a-e5127aca-70387c1c_0] Write session: try to update token
2025-10-10T14:38:55.604865Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|37281812-3d3e4a7a-e5127aca-70387c1c_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:55.619492Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:38:55.619514Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:55.619527Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602583817271713:8504]
2025-10-10T14:38:55.619587Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:38:55.619589Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:38:55.619805Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:38:55.619969Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:55.620112Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:55.620292Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:55.620619Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:38:55.620667Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:38:55.622900Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2825 sessionId: src_id|37281812-3d3e4a7a-e5127aca-70387c1c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:55.625663Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:55.625903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:55.625925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:55.625980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:38:55.626095Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:38:55.631582Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:55.631603Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:55.631607Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:55.631609Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:55.631620Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602583817271713:8504]
2025-10-10T14:38:55.631624Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602583817271713:8504]
2025-10-10T14:38:55.631631Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602583817271713:8504]
2025-10-10T14:38:55.631676Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:55.631682Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:55.631689Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:55.631689Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:55.631692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:55.631693Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:55.631830Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:55.674584Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602584599511512:6861]
2025-10-10T14:38:55.674902Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 pipe creation result: OK TabletId: 72075186224037892 Generation: 2824, pipe: [1:7559602584599511512:6861]
2025-10-10T14:38:55.749884Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:55.757881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:55.757913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:55.758101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:55.758159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:55.758224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:55.758284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:55.758510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:55.758520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:55.758582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:55.758637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:55.758696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:55.758760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:55.758801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:55.758806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:55.758867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:55.758921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:55.758981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:55.759046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:55.759099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:55.759105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:55.759167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:55.759224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:55.759284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:55.759341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:55.759402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:55.759408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:55.759466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:55.759519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:55.759576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:55.759633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:55.759674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:55.759680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:55.759741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:55.759814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:55.759877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:55.759936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:55.759978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:55.759983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:55.760042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:55.760096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:55.760154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:55.760228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:55.760271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:55.760278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:55.760339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:55.760396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:55.760464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:55.760523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:55.760565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:55.760570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:55.760630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:55.760682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:55.760740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:55.760805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:55.760846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:55.760851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:55.760910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:55.760964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:55.761027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:55.761088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:55.761130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:55.761135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:55.761184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602584599511512:6861], now have 1 active actors on pipe
2025-10-10T14:38:55.761448Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 23 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602584599511512:6861]
2025-10-10T14:38:55.761475Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:55.761480Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:55.761484Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:55.761515Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2825 reason: error at write: Disconnected sessionId: src_id|37281812-3d3e4a7a-e5127aca-70387c1c_0
2025-10-10T14:38:55.761760Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:55.761814Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2825 sessionId: src_id|37281812-3d3e4a7a-e5127aca-70387c1c_0 is DEAD
2025-10-10T14:38:55.761945Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|37281812-3d3e4a7a-e5127aca-70387c1c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:55.761956Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|37281812-3d3e4a7a-e5127aca-70387c1c_0] Write session will restart in 0.007193s
2025-10-10T14:38:55.761980Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|37281812-3d3e4a7a-e5127aca-70387c1c_0] Write session: Do CDS request
2025-10-10T14:38:55.761986Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|37281812-3d3e4a7a-e5127aca-70387c1c_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:55.770930Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|37281812-3d3e4a7a-e5127aca-70387c1c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:55.770964Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:55.770983Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2826
2025-10-10T14:38:55.771175Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2826 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:55.771215Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2826 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:55.771226Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2826 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:55.771231Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:55.771753Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2826 sessionId:  describe result for acl check
2025-10-10T14:38:55.771790Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:55.771792Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:55.771794Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:55.771800Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602584599511563:6368] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:55.772371Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602584599511563:6368] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:55.775566Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602584599511563:6368] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:55.776742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:55.780460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:55.780675Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:55.780686Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:55.780697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:55.780756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:55.780801Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602583817271886:8508]
2025-10-10T14:38:55.780804Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602584599511563:6368] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:55.780818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602584599511563:6368] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:55.780822Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602584599511563:6368] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:55.780830Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2826 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:55.781456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:55.781737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:55.781779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:55.782105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:55.782161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:55.782168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:55.782170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:55.782171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:55.782172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:55.782174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:55.782175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:55.782177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:55.782178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:55.782179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:55.782181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:55.782183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:55.782184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:55.782189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:55.782203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:55.782207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:55.782212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:55.782216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:55.782220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:55.782223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:55.782228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:55.782232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:55.782237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:55.782241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:55.782245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:55.782249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:55.782256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:55.782264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:55.782271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:55.782276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:55.782281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:55.782286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:55.782290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:55.782296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:55.782301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:55.782306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:55.782313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:55.782318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:55.782328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:55.782333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:55.782337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:55.782343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:55.782347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:55.782352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:55.782357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:55.782362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:55.782371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:55.782377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:55.782381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:55.782387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:55.782392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:55.782398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:55.782444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:55.784805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:55.785376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:55.785388Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:55.785391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:55.785394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:55.785400Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2825 [2:7559602583817271886:8508]
2025-10-10T14:38:55.785413Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:55.785431Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:55.785438Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:55.785442Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:55.785445Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:55.785462Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:55.785476Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:55.785483Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:55.785549Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:55.785557Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:55.785559Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:55.785561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:55.785628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:55.785636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:55.785647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:55.785659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:55.785680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:55.785708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602584599511514:2438], now have 1 active actors on pipe
2025-10-10T14:38:55.785717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602584599511671:6368], now have 1 active actors on pipe
2025-10-10T14:38:55.785725Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602583817271881:8508]
2025-10-10T14:38:55.785727Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602583817271881:8508]
2025-10-10T14:38:55.785730Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602583817271881:8508]
2025-10-10T14:38:55.785745Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:55.785734Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2825
2025-10-10T14:38:55.785764Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:55.785739Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2825
2025-10-10T14:38:55.785765Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:55.785769Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:55.785771Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:55.785785Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:55.785789Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:55.785825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:55.785834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:55.785853Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602583817271881:8508]
2025-10-10T14:38:55.785864Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:55.785887Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:55.785896Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1663ec98-896fab15-e14d3d4b-f6db83e0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:55.785904Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:55.785909Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:55.785911Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:55.785922Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:55.785934Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:55.785960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:55.786153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:55.786167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:55.786188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:55.786308Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2826 partition: 0 MaxSeqNo: 40 sessionId: src_id|1663ec98-896fab15-e14d3d4b-f6db83e0_0
2025-10-10T14:38:55.786712Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|37281812-3d3e4a7a-e5127aca-70387c1c_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|1663ec98-896fab15-e14d3d4b-f6db83e0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:55.789551Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1663ec98-896fab15-e14d3d4b-f6db83e0_0] Write session: try to update token
2025-10-10T14:38:55.789574Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1663ec98-896fab15-e14d3d4b-f6db83e0_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:55.803819Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2826 sessionId: src_id|1663ec98-896fab15-e14d3d4b-f6db83e0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:55.805075Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:55.805092Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:55.805095Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:55.805097Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:55.805108Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602583817271881:8508]
2025-10-10T14:38:55.805112Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602583817271881:8508]
2025-10-10T14:38:55.805117Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602583817271881:8508]
2025-10-10T14:38:55.805166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:55.805173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:55.805173Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:55.805177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:55.805181Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:55.805189Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:55.805313Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:55.806514Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:55.861529Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602584599511691:6861]
2025-10-10T14:38:55.861871Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 pipe creation result: OK TabletId: 72075186224037892 Generation: 2825, pipe: [1:7559602584599511691:6861]
2025-10-10T14:38:55.920129Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:55.920967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:55.920987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:55.921030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602584599511691:6861], now have 1 active actors on pipe
2025-10-10T14:38:55.921293Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:38:55.921221Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:55.921431Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2826 reason: status is not ok: tablet will be restarted right now sessionId: src_id|1663ec98-896fab15-e14d3d4b-f6db83e0_0
2025-10-10T14:38:55.921662Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2826 sessionId: src_id|1663ec98-896fab15-e14d3d4b-f6db83e0_0 is DEAD
2025-10-10T14:38:55.921830Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1663ec98-896fab15-e14d3d4b-f6db83e0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:38:55.921843Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1663ec98-896fab15-e14d3d4b-f6db83e0_0] Write session will restart in 0.007744s
2025-10-10T14:38:55.921851Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 24 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602584599511691:6861]
2025-10-10T14:38:55.921871Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:55.921871Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1663ec98-896fab15-e14d3d4b-f6db83e0_0] Write session: Do CDS request
2025-10-10T14:38:55.921899Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1663ec98-896fab15-e14d3d4b-f6db83e0_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:55.930991Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1663ec98-896fab15-e14d3d4b-f6db83e0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:55.931137Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:55.931153Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2827
2025-10-10T14:38:55.931351Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2827 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:55.931417Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2827 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:55.931428Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2827 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:55.931433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:55.931992Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2827 sessionId:  describe result for acl check
2025-10-10T14:38:55.932028Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:55.932033Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:55.932035Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:55.932052Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602584599511763:6317] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:55.932689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602584599511763:6317] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:55.938812Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602584599511763:6317] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:55.942170Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602584599511763:6317] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:55.942184Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602584599511763:6317] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:55.942188Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602584599511763:6317] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:55.942199Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2827 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:55.944009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:55.948850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:55.949121Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:55.949133Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:55.949146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:55.949206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:55.949248Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602583817272092:8485]
2025-10-10T14:38:55.949994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:55.953257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:55.953369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:55.953821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:55.953886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:55.953888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:55.953890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:55.953891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:55.953892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:55.953893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:55.953895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:55.953896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:55.953898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:55.953899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:55.953901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:55.953902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:55.953904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:55.953912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:55.953927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:55.953932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:55.953937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:55.953941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:55.953946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:55.953951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:55.953956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:55.953960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:55.953968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:55.953972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:55.953977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:55.953981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:55.953991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:55.954001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:55.954009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:55.954016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:55.954021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:55.954026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:55.954031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:55.954037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:55.954044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:55.954051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:55.954056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:55.954062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:55.954068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:55.954074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:55.954080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:55.954086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:55.954091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:55.954098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:55.954103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:55.954109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:55.954115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:55.954121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:55.954129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:55.954135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:55.954141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:55.954147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:55.954194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:55.960024Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2826
2025-10-10T14:38:55.960068Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2826
2025-10-10T14:38:55.958458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:55.959302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:55.959309Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:55.959311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:55.959315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:55.959323Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2826 [2:7559602583817272092:8485]
2025-10-10T14:38:55.959339Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:55.959363Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:55.959367Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:55.959371Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:55.959374Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:55.959395Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:55.959403Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:55.959412Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:55.959481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:55.959483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:55.959485Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:55.959488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:55.959570Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:55.959573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:55.959588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:55.959602Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:55.959621Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:55.959644Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602583817272087:8485]
2025-10-10T14:38:55.959647Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602583817272087:8485]
2025-10-10T14:38:55.959649Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602583817272087:8485]
2025-10-10T14:38:55.959658Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:55.959674Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:55.959673Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:55.959677Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:55.959680Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:55.959691Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:55.959695Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:55.959706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602584599511708:2438], now have 1 active actors on pipe
2025-10-10T14:38:55.959711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602584599511874:6317], now have 1 active actors on pipe
2025-10-10T14:38:55.959749Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602583817272087:8485]
2025-10-10T14:38:55.959758Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:55.959796Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:55.960192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:55.960199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:55.960234Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|38566ed7-4b8d06cd-270ab6e1-89853a77_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:55.960243Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:55.960248Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:55.960251Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:55.960263Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:55.960276Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:55.960292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:55.960747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:55.960758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:55.960777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:55.961047Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2827 partition: 0 MaxSeqNo: 40 sessionId: src_id|38566ed7-4b8d06cd-270ab6e1-89853a77_0
2025-10-10T14:38:55.961585Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1663ec98-896fab15-e14d3d4b-f6db83e0_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|38566ed7-4b8d06cd-270ab6e1-89853a77_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:55.964583Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|38566ed7-4b8d06cd-270ab6e1-89853a77_0] Write session: try to update token
2025-10-10T14:38:55.964604Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|38566ed7-4b8d06cd-270ab6e1-89853a77_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:55.980091Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2827 sessionId: src_id|38566ed7-4b8d06cd-270ab6e1-89853a77_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:55.982822Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:55.983621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:55.983639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:55.985397Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:55.985411Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:55.985415Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:55.985417Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:55.985431Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602583817272087:8485]
2025-10-10T14:38:55.985436Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602583817272087:8485]
2025-10-10T14:38:55.985440Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602583817272087:8485]
2025-10-10T14:38:55.985483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:38:55.985497Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:55.985504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:55.985506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:55.985657Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:55.989406Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:55.989420Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:55.989425Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:55.989570Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:38:56.022467Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602588894479185:6861]
2025-10-10T14:38:56.025828Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 pipe creation result: OK TabletId: 72075186224037892 Generation: 2826, pipe: [1:7559602588894479185:6861]
2025-10-10T14:38:56.110132Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:56.118971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:56.119004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:56.119190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:56.119258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:56.119326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:56.119393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:56.119458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:56.119471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:56.119542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:56.119603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:56.119668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:56.119731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:56.119771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:56.119775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:56.119846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:56.119906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:56.119968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:56.120027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:56.120069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:56.120072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:56.120140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:56.120200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:56.120262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:56.120323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:56.120365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:56.120368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:56.120434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:56.120492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:56.120553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:56.120617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:56.120657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:56.120661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:56.120731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:56.120787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:56.120845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:56.120909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:56.121270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:56.121275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:56.123442Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:56.123748Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:56.123760Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:56.123790Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2827 reason: error at write: Disconnected sessionId: src_id|38566ed7-4b8d06cd-270ab6e1-89853a77_0
2025-10-10T14:38:56.124005Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2827 sessionId: src_id|38566ed7-4b8d06cd-270ab6e1-89853a77_0 is DEAD
2025-10-10T14:38:56.124164Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38566ed7-4b8d06cd-270ab6e1-89853a77_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:56.124177Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38566ed7-4b8d06cd-270ab6e1-89853a77_0] Write session will restart in 0.008150s
2025-10-10T14:38:56.124181Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 25 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602588894479185:6861]
2025-10-10T14:38:56.124213Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38566ed7-4b8d06cd-270ab6e1-89853a77_0] Write session: Do CDS request
2025-10-10T14:38:56.124220Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38566ed7-4b8d06cd-270ab6e1-89853a77_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:56.121625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:56.121688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:56.121747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:56.121809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:56.121849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:56.121852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:56.121926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:56.121982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:56.122043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:56.122099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:56.122139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:56.122142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:56.122211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:56.122270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:56.122328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:56.122389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:56.122429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:56.122432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:56.122500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:56.122560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:56.122623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:56.122687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:56.122731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:56.122734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:56.122814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602588894479185:6861], now have 1 active actors on pipe
2025-10-10T14:38:56.123932Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:56.136107Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|38566ed7-4b8d06cd-270ab6e1-89853a77_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:56.136536Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:56.136555Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2828
2025-10-10T14:38:56.136706Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2828 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:56.136745Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2828 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:56.136756Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2828 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:56.136760Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:56.137320Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2828 sessionId:  describe result for acl check
2025-10-10T14:38:56.137377Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:56.137379Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:56.137381Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:56.137388Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602588894479243:6305] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:56.138039Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602588894479243:6305] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:56.143922Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602588894479243:6305] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:56.147208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:56.153994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:56.153974Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602588894479243:6305] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:56.153990Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602588894479243:6305] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:56.153995Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602588894479243:6305] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:56.154004Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2828 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:56.154221Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:56.154234Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:56.154248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:56.154311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:56.154350Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602588112239556:8471]
2025-10-10T14:38:56.154892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:56.155277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:56.155323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:56.155603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:56.155642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:56.155643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:56.155644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:56.155645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:56.155646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:56.155647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:56.155648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:56.155649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:56.155650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:56.155650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:56.155651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:56.155652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:56.155652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:56.155657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:56.155666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:56.155668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:56.155670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:56.155673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:56.155675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:56.155677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:56.155680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:56.155682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:56.155685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:56.155687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:56.155689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:56.155691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:56.155699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:56.155704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:56.155709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:56.155713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:56.155716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:56.155719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:56.155722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:56.155725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:56.155731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:56.155735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:56.155738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:56.155741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:56.155744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:56.155748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:56.155751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:56.155754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:56.155757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:56.155761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:56.155763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:56.155767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:56.155770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:56.155773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:56.155776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:56.155779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:56.155783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:56.155786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:56.155809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:56.158638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:56.159406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:56.159421Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:56.159423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:56.159428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:56.159434Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2827 [2:7559602588112239556:8471]
2025-10-10T14:38:56.159447Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:56.159467Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:56.159475Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:56.159480Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:56.159483Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:56.159502Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:56.159512Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:56.159521Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:56.159594Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:56.159601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:56.159603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:56.159607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:56.159674Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:56.159681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:56.159693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:56.159707Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:56.159724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:56.159742Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602588112239549:8471]
2025-10-10T14:38:56.159744Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602588112239549:8471]
2025-10-10T14:38:56.159745Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602588112239549:8471]
2025-10-10T14:38:56.159752Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:56.159762Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:56.159765Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:56.159767Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:56.159768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602588894479187:2438], now have 1 active actors on pipe
2025-10-10T14:38:56.159772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602588894479347:6305], now have 1 active actors on pipe
2025-10-10T14:38:56.159777Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:56.159795Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:56.159798Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:56.159825Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602588112239549:8471]
2025-10-10T14:38:56.159831Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:56.159841Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:56.160292Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2827
2025-10-10T14:38:56.160352Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2827
2025-10-10T14:38:56.160561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:56.160577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:56.160611Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6ae7d5cc-fc7676ef-53cfc38d-4f48a329_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:56.160627Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:56.160638Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:56.160641Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:56.160654Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:56.160677Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:56.160695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:56.160961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:56.160975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:56.161001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:56.161198Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2828 partition: 0 MaxSeqNo: 40 sessionId: src_id|6ae7d5cc-fc7676ef-53cfc38d-4f48a329_0
2025-10-10T14:38:56.161703Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38566ed7-4b8d06cd-270ab6e1-89853a77_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|6ae7d5cc-fc7676ef-53cfc38d-4f48a329_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:56.164620Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6ae7d5cc-fc7676ef-53cfc38d-4f48a329_0] Write session: try to update token
2025-10-10T14:38:56.164647Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6ae7d5cc-fc7676ef-53cfc38d-4f48a329_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:56.178718Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:38:56.178802Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:56.178815Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602588112239549:8471]
2025-10-10T14:38:56.178872Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:38:56.179047Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:38:56.179175Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:56.179302Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:56.179435Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:56.179621Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:38:56.179652Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:38:56.179773Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:38:56.182608Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2828 sessionId: src_id|6ae7d5cc-fc7676ef-53cfc38d-4f48a329_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:56.185455Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:56.186135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:56.186153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:56.186193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:38:56.186423Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:38:56.195314Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:56.195334Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:56.195338Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:56.195340Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:56.195351Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602588112239549:8471]
2025-10-10T14:38:56.195356Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602588112239549:8471]
2025-10-10T14:38:56.195359Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602588112239549:8471]
2025-10-10T14:38:56.195412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:56.195419Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:56.195421Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:56.195423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:56.195428Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:56.195432Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:56.195557Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:56.225445Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602588894479359:6861]
2025-10-10T14:38:56.226051Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 pipe creation result: OK TabletId: 72075186224037892 Generation: 2827, pipe: [1:7559602588894479359:6861]
2025-10-10T14:38:56.311730Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:56.319941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:56.319966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:56.320141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:56.320204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:56.320267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:56.320341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:56.320388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:56.320395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:56.320458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:56.320515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:56.320585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:56.320645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:56.320690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:56.320696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:56.320760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:56.320825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:56.320887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:56.320948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:56.320990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:56.320996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:56.321063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:56.321131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:56.321194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:56.321265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:56.321319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:56.321345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:56.321422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:56.321498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:56.321588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:56.321654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:56.321698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:56.321704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:56.321770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:56.321828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:56.321888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:56.321954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:56.321996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:56.322003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:56.322066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:56.322125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:56.322185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:56.322247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:56.322295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:56.322302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:56.322368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:56.322438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:56.322505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:56.322570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:56.322610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:56.322615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:56.322679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:56.322733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:56.322797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:56.322857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:56.322900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:56.322905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:56.322968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:56.323026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:56.323084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:56.323140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:56.323181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:56.323189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:56.323251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602588894479359:6861], now have 1 active actors on pipe
2025-10-10T14:38:56.323459Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:56.323519Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 26 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602588894479359:6861]
2025-10-10T14:38:56.323721Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:56.323733Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:56.323764Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2828 reason: error at write: Disconnected sessionId: src_id|6ae7d5cc-fc7676ef-53cfc38d-4f48a329_0
2025-10-10T14:38:56.323943Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2828 sessionId: src_id|6ae7d5cc-fc7676ef-53cfc38d-4f48a329_0 is DEAD
2025-10-10T14:38:56.324080Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6ae7d5cc-fc7676ef-53cfc38d-4f48a329_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:56.324088Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6ae7d5cc-fc7676ef-53cfc38d-4f48a329_0] Write session will restart in 0.007840s
2025-10-10T14:38:56.324115Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6ae7d5cc-fc7676ef-53cfc38d-4f48a329_0] Write session: Do CDS request
2025-10-10T14:38:56.324121Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6ae7d5cc-fc7676ef-53cfc38d-4f48a329_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:56.324352Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:56.332913Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6ae7d5cc-fc7676ef-53cfc38d-4f48a329_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:56.333036Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:56.333049Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2829
2025-10-10T14:38:56.333169Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2829 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:56.333205Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2829 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:56.333229Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2829 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:56.333235Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:56.333739Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2829 sessionId:  describe result for acl check
2025-10-10T14:38:56.333779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:56.333790Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:56.333792Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:56.333800Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602588894479396:6283] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:56.334461Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602588894479396:6283] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:56.337123Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602588894479396:6283] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:56.340794Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602588894479396:6283] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:56.340810Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602588894479396:6283] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:56.340814Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602588894479396:6283] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:56.340823Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2829 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:56.343012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:56.347476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:56.347768Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:56.347778Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:56.347790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:56.347842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:56.347888Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602588112239728:8467]
2025-10-10T14:38:56.348564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:56.348973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:56.349020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:56.349385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:56.349445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:56.349451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:56.349453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:56.349454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:56.349455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:56.349457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:56.349458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:56.349459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:56.349461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:56.349462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:56.349464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:56.349465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:56.349467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:56.349472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:56.349485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:56.349489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:56.349494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:56.349498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:56.349502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:56.349506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:56.349510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:56.349514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:56.349518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:56.349534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:56.349538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:56.349542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:56.349551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:56.349560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:56.349566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:56.349572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:56.349577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:56.349582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:56.349587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:56.349597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:56.349602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:56.349607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:56.349617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:56.349622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:56.349627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:56.349637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:56.349641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:56.349646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:56.349655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:56.349661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:56.349669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:56.349677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:56.349684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:56.349690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:56.349695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:56.349701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:56.349705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:56.349711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:56.349751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:56.352394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:56.353025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:56.353037Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:56.353039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:56.353043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:56.353051Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2828 [2:7559602588112239728:8467]
2025-10-10T14:38:56.353066Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:56.353086Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:56.353089Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:56.353093Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:56.353095Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:56.353113Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:56.353126Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:56.353135Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:56.353202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:56.353209Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:56.353212Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:56.353215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:56.353286Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:56.353293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:56.353304Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:56.353319Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:56.353361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:56.353390Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602588112239723:8467]
2025-10-10T14:38:56.353398Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602588112239723:8467]
2025-10-10T14:38:56.353401Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602588112239723:8467]
2025-10-10T14:38:56.353416Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:56.353435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602588894479361:2438], now have 1 active actors on pipe
2025-10-10T14:38:56.353437Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:56.353441Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:56.353443Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:56.353443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602588894479520:6283], now have 1 active actors on pipe
2025-10-10T14:38:56.353451Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:56.353467Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:56.353471Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:56.353505Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602588112239723:8467]
2025-10-10T14:38:56.353493Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2828
2025-10-10T14:38:56.353554Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2828
2025-10-10T14:38:56.353516Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:56.353517Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:56.353668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:56.353676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:56.353710Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|be6b7562-1c789be7-b163f3e7-f679d40c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:56.353738Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:56.353743Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:56.353746Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:56.353761Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:56.353793Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:56.353815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:56.354021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:56.354049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:56.354073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:56.354208Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2829 partition: 0 MaxSeqNo: 40 sessionId: src_id|be6b7562-1c789be7-b163f3e7-f679d40c_0
2025-10-10T14:38:56.354618Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6ae7d5cc-fc7676ef-53cfc38d-4f48a329_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|be6b7562-1c789be7-b163f3e7-f679d40c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:56.357399Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|be6b7562-1c789be7-b163f3e7-f679d40c_0] Write session: try to update token
2025-10-10T14:38:56.357423Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|be6b7562-1c789be7-b163f3e7-f679d40c_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:56.365729Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:38:56.365748Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:56.365759Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602588112239723:8467]
2025-10-10T14:38:56.365811Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:38:56.365820Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:38:56.365997Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:38:56.366178Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:56.366324Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:56.366467Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:56.366682Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:38:56.366725Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:38:56.372555Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2829 sessionId: src_id|be6b7562-1c789be7-b163f3e7-f679d40c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:56.375381Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:56.375609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:56.375628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:56.375688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:38:56.375786Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:38:56.384361Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:56.384377Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:56.384380Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:56.384382Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:56.384394Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602588112239723:8467]
2025-10-10T14:38:56.384399Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602588112239723:8467]
2025-10-10T14:38:56.384404Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602588112239723:8467]
2025-10-10T14:38:56.384456Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:56.384458Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:56.384469Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:56.384473Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:56.384474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:56.384478Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:56.384617Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:56.427793Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602588894479537:6861]
2025-10-10T14:38:56.433655Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 pipe creation result: OK TabletId: 72075186224037892 Generation: 2828, pipe: [1:7559602588894479537:6861]
2025-10-10T14:38:56.507573Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:56.517663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:56.517700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:56.517893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:56.517962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:56.518039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:56.518114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:56.518801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:56.518819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:56.518898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:56.518972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:56.519041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:56.519122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:56.519177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:56.519185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:56.519260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:56.519324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:56.519395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:56.519468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:56.519523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:56.519532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:56.519611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:56.519686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:56.519756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:56.519826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:56.519874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:56.519883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:56.519956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:56.520025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:56.520089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:56.520170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:56.520225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:56.520234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:56.520312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:56.520382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:56.520452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:56.520523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:56.520572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:56.520579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:56.520652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:56.520720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:56.520795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:56.520865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:56.520917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:56.520928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:56.521003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:56.521066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:56.521131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:56.521201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:56.521250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:56.521259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:56.521364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:56.521435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:56.521507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:56.521597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:56.521645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:56.521652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:56.521724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:56.521799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:56.521870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:56.521941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:56.521990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:56.521997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:56.522076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602588894479537:6861], now have 1 active actors on pipe
2025-10-10T14:38:56.522394Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:56.522459Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:56.522464Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 27 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602588894479537:6861]
2025-10-10T14:38:56.522465Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:56.522500Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2829 reason: error at write: Disconnected sessionId: src_id|be6b7562-1c789be7-b163f3e7-f679d40c_0
2025-10-10T14:38:56.522810Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2829 sessionId: src_id|be6b7562-1c789be7-b163f3e7-f679d40c_0 is DEAD
2025-10-10T14:38:56.522903Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be6b7562-1c789be7-b163f3e7-f679d40c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:56.522923Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be6b7562-1c789be7-b163f3e7-f679d40c_0] Write session will restart in 0.009095s
2025-10-10T14:38:56.522949Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be6b7562-1c789be7-b163f3e7-f679d40c_0] Write session: Do CDS request
2025-10-10T14:38:56.522955Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be6b7562-1c789be7-b163f3e7-f679d40c_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:56.522884Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:56.532934Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|be6b7562-1c789be7-b163f3e7-f679d40c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:56.533055Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:56.533071Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2830
2025-10-10T14:38:56.533189Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2830 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:56.533224Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2830 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:56.533230Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2830 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:56.533234Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:56.533830Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2830 sessionId:  describe result for acl check
2025-10-10T14:38:56.533872Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:56.533880Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:56.533883Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:56.533890Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602588894479592:6275] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:56.535104Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602588894479592:6275] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:56.538716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602588894479592:6275] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:56.541701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:56.545510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:56.545579Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602588894479592:6275] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:56.545595Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602588894479592:6275] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:56.545599Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602588894479592:6275] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:56.545609Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2830 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:56.545782Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:56.545797Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:56.545812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:56.545875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:56.545917Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602588112239909:8436]
2025-10-10T14:38:56.546518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:56.547073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:56.547126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:56.547465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:56.547533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:56.547534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:56.547536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:56.547537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:56.547538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:56.547539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:56.547541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:56.547542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:56.547543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:56.547545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:56.547546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:56.547547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:56.547548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:56.547554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:56.547567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:56.547571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:56.547575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:56.547579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:56.547583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:56.547587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:56.547591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:56.547594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:56.547599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:56.547602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:56.547606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:56.547609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:56.547617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:56.547626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:56.547633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:56.547650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:56.547655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:56.547660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:56.547665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:56.547670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:56.547675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:56.547681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:56.547685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:56.547690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:56.547703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:56.547709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:56.547713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:56.547720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:56.547724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:56.547729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:56.547738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:56.547742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:56.547747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:56.547751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:56.547756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:56.547766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:56.547770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:56.547775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:56.547816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:56.550427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:56.550794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:56.550814Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:56.550817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:56.550821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:56.550829Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2829 [2:7559602588112239909:8436]
2025-10-10T14:38:56.550843Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:56.550862Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:56.550866Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:56.550870Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:56.550873Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:56.550892Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:56.550908Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:56.550917Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:56.550991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:56.551001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:56.551004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:56.551006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:56.551085Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:56.551094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:56.551106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:56.551123Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:56.551146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:56.551176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602588894479540:2438], now have 1 active actors on pipe
2025-10-10T14:38:56.551185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602588894479702:6275], now have 1 active actors on pipe
2025-10-10T14:38:56.551195Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602588112239904:8436]
2025-10-10T14:38:56.551202Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602588112239904:8436]
2025-10-10T14:38:56.551204Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602588112239904:8436]
2025-10-10T14:38:56.551223Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:56.551245Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:56.551254Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:56.551258Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:56.551261Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:56.551266Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:56.551271Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:56.551258Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2829
2025-10-10T14:38:56.551304Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2829
2025-10-10T14:38:56.551302Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602588112239904:8436]
2025-10-10T14:38:56.551311Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:56.551329Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:56.551357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:56.551363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:56.551401Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c9b8e67f-aeec600c-845c5e80-42c9d56c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:56.551410Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:56.551414Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:56.551417Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:56.551430Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:56.551441Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:56.551457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:56.551696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:56.551709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:56.551729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:56.551847Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2830 partition: 0 MaxSeqNo: 40 sessionId: src_id|c9b8e67f-aeec600c-845c5e80-42c9d56c_0
2025-10-10T14:38:56.556129Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be6b7562-1c789be7-b163f3e7-f679d40c_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|c9b8e67f-aeec600c-845c5e80-42c9d56c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:56.559436Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c9b8e67f-aeec600c-845c5e80-42c9d56c_0] Write session: try to update token
2025-10-10T14:38:56.559462Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c9b8e67f-aeec600c-845c5e80-42c9d56c_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:56.571976Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:56.571996Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:56.571998Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:56.572000Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:56.572008Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602588112239904:8436]
2025-10-10T14:38:56.572012Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602588112239904:8436]
2025-10-10T14:38:56.572016Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602588112239904:8436]
2025-10-10T14:38:56.572063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:56.572070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:56.572070Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:56.572071Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:56.572076Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:56.572081Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:56.572202Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:56.577167Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2830 sessionId: src_id|c9b8e67f-aeec600c-845c5e80-42c9d56c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:56.579875Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:56.622290Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602588894479724:6861]
2025-10-10T14:38:56.622453Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 pipe creation result: OK TabletId: 72075186224037892 Generation: 2829, pipe: [1:7559602588894479724:6861]
2025-10-10T14:38:56.688138Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:56.688735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:56.688756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:56.688823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602588894479724:6861], now have 1 active actors on pipe
2025-10-10T14:38:56.689114Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:56.689099Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:56.689134Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 28 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602588894479724:6861]
2025-10-10T14:38:56.689150Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:56.689153Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:56.689234Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2830 reason: error at write: Disconnected sessionId: src_id|c9b8e67f-aeec600c-845c5e80-42c9d56c_0
2025-10-10T14:38:56.689451Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2830 sessionId: src_id|c9b8e67f-aeec600c-845c5e80-42c9d56c_0 is DEAD
2025-10-10T14:38:56.689641Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9b8e67f-aeec600c-845c5e80-42c9d56c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:56.689661Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9b8e67f-aeec600c-845c5e80-42c9d56c_0] Write session will restart in 0.005487s
2025-10-10T14:38:56.689687Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9b8e67f-aeec600c-845c5e80-42c9d56c_0] Write session: Do CDS request
2025-10-10T14:38:56.689693Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9b8e67f-aeec600c-845c5e80-42c9d56c_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:56.696845Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c9b8e67f-aeec600c-845c5e80-42c9d56c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:56.696997Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:56.697012Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2831
2025-10-10T14:38:56.697206Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2831 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:56.697245Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2831 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:56.697255Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2831 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:56.697261Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:56.697725Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2831 sessionId:  describe result for acl check
2025-10-10T14:38:56.697762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:56.697769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:56.697771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:56.697778Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602588894479739:6250] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:56.698398Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602588894479739:6250] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:56.700831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602588894479739:6250] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:56.705300Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602588894479739:6250] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:56.705321Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602588894479739:6250] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:56.705326Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602588894479739:6250] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:56.705350Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2831 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:56.709782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:56.713854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:56.714112Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:56.714125Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:56.714139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:56.714205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:56.714255Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602588112240081:8432]
2025-10-10T14:38:56.714970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:56.715302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:56.715351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:56.715687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:56.715739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:56.715740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:56.715742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:56.715743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:56.715744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:56.715746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:56.715747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:56.715749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:56.715750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:56.715751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:56.715753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:56.715754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:56.715755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:56.715761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:56.715776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:56.715781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:56.715786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:56.715790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:56.715795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:56.715799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:56.715803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:56.715808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:56.715813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:56.715817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:56.715821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:56.715825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:56.715833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:56.715842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:56.715849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:56.715855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:56.715860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:56.715866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:56.715872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:56.715878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:56.715883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:56.715889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:56.715893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:56.715899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:56.715904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:56.715911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:56.715916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:56.715922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:56.715927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:56.715933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:56.715938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:56.715944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:56.715950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:56.715958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:56.715962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:56.715969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:56.715974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:56.715980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:56.716023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:56.718813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:56.719566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:56.719581Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:56.719584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:56.719589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:56.719595Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2830 [2:7559602588112240081:8432]
2025-10-10T14:38:56.719609Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:56.719627Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:56.719631Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:56.719635Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:56.719637Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:56.719656Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:56.719669Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:56.719677Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:56.719741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:56.719749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:56.719751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:56.719754Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:56.719826Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:56.719835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:56.719849Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:56.719861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:56.719880Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:56.719909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602588894479727:2438], now have 1 active actors on pipe
2025-10-10T14:38:56.719913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602588894479848:6250], now have 1 active actors on pipe
2025-10-10T14:38:56.719923Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602588112240076:8432]
2025-10-10T14:38:56.719925Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602588112240076:8432]
2025-10-10T14:38:56.719927Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602588112240076:8432]
2025-10-10T14:38:56.719943Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:56.719959Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:56.719964Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:56.719968Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:56.719971Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:56.719977Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:56.719981Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:56.720008Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602588112240076:8432]
2025-10-10T14:38:56.720022Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:56.720042Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:56.720159Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2830
2025-10-10T14:38:56.720209Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2830
2025-10-10T14:38:56.720295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:56.720306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:56.720339Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5c971b26-1d7f9d90-24107afc-f437501e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:56.720353Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:56.720358Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:56.720360Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:56.720373Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:56.720385Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:56.720401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:56.720659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:56.720673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:56.720698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:56.720818Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2831 partition: 0 MaxSeqNo: 40 sessionId: src_id|5c971b26-1d7f9d90-24107afc-f437501e_0
2025-10-10T14:38:56.721305Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9b8e67f-aeec600c-845c5e80-42c9d56c_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|5c971b26-1d7f9d90-24107afc-f437501e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:56.724035Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5c971b26-1d7f9d90-24107afc-f437501e_0] Write session: try to update token
2025-10-10T14:38:56.724056Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5c971b26-1d7f9d90-24107afc-f437501e_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:56.732294Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:38:56.732314Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:56.732326Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602588112240076:8432]
2025-10-10T14:38:56.732383Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:38:56.732389Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:38:56.732557Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:38:56.732701Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:56.732843Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:56.732997Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:56.733183Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:38:56.733226Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:38:56.739508Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2831 sessionId: src_id|5c971b26-1d7f9d90-24107afc-f437501e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:56.742450Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:56.742703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:56.742725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:56.742769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:38:56.742892Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:38:56.753722Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:56.753740Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:56.753744Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:56.753746Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:56.753763Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602588112240076:8432]
2025-10-10T14:38:56.753767Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602588112240076:8432]
2025-10-10T14:38:56.753771Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602588112240076:8432]
2025-10-10T14:38:56.753828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:56.753836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:56.753835Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:56.753838Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:56.753842Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:56.753847Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:56.753982Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:56.789206Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602588894479901:6861]
2025-10-10T14:38:56.789550Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 pipe creation result: OK TabletId: 72075186224037892 Generation: 2830, pipe: [1:7559602588894479901:6861]
2025-10-10T14:38:56.872702Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:56.881655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:56.881685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:56.881870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:56.881945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:56.882015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:56.882087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:56.882143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:56.882149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:56.882221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:56.882278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:56.882337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:56.882411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:56.882455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:56.882458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:56.882536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:56.882596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:56.882662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:56.882733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:56.882774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:56.882777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:56.882844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:56.882909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:56.882976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:56.883036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:56.883077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:56.883080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:56.883156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:56.883219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:56.883284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:56.883348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:56.883391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:56.883394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:56.883473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:56.883533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:56.883589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:56.883652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:56.883701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:56.883704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:56.883776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:56.883838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:56.883905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:56.883978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:56.884030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:56.884034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:56.884110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:56.884175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:56.884248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:56.884319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:56.884363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:56.884366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:56.884441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:56.884513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:56.884578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:56.884648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:56.884697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:56.884700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:56.884772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:56.884840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:56.884904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:56.884971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:56.885018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:56.885021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:56.885123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602588894479901:6861], now have 1 active actors on pipe
2025-10-10T14:38:56.885436Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:56.885505Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 29 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602588894479901:6861]
2025-10-10T14:38:56.885508Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:56.885523Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:56.885560Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2831 reason: error at write: Disconnected sessionId: src_id|5c971b26-1d7f9d90-24107afc-f437501e_0
2025-10-10T14:38:56.885525Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:56.885801Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2831 sessionId: src_id|5c971b26-1d7f9d90-24107afc-f437501e_0 is DEAD
2025-10-10T14:38:56.886077Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c971b26-1d7f9d90-24107afc-f437501e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:56.886090Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c971b26-1d7f9d90-24107afc-f437501e_0] Write session will restart in 0.008978s
2025-10-10T14:38:56.886117Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c971b26-1d7f9d90-24107afc-f437501e_0] Write session: Do CDS request
2025-10-10T14:38:56.886123Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c971b26-1d7f9d90-24107afc-f437501e_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:56.895917Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5c971b26-1d7f9d90-24107afc-f437501e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:56.896063Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:56.896080Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2832
2025-10-10T14:38:56.896220Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2832 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:56.896260Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2832 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:56.896272Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2832 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:56.896277Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:56.897020Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2832 sessionId:  describe result for acl check
2025-10-10T14:38:56.897067Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:56.897073Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:56.897076Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:56.897082Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602588894479963:6240] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:56.897888Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602588894479963:6240] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:56.901480Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602588894479963:6240] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:56.903621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:56.904117Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602588894479963:6240] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:56.904132Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602588894479963:6240] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:56.904136Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602588894479963:6240] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:56.904145Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2832 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:56.908318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:56.908600Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:56.908612Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:56.908624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:56.908684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:56.908734Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602588112240253:8428]
2025-10-10T14:38:56.909429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:56.909788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:56.909838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:56.910174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:56.910234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:56.910240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:56.910241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:56.910242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:56.910244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:56.910245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:56.910247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:56.910248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:56.910250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:56.910251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:56.910252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:56.910254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:56.910256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:56.910262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:56.910277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:56.910281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:56.910285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:56.910289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:56.910294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:56.910298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:56.910302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:56.910306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:56.910310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:56.910315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:56.910319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:56.910324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:56.910332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:56.910341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:56.910347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:56.910353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:56.910358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:56.910363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:56.910369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:56.910375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:56.910379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:56.910385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:56.910389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:56.910395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:56.910399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:56.910409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:56.910414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:56.910419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:56.910430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:56.910435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:56.910440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:56.910449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:56.910454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:56.910460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:56.910465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:56.910474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:56.910481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:56.910486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:56.910527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:56.913290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:56.914624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:56.914642Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:56.914644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:56.914648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:56.914656Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2831 [2:7559602588112240253:8428]
2025-10-10T14:38:56.914675Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:56.914695Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:56.914707Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:56.914711Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:56.914714Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:56.914735Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:56.914750Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:56.914759Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:56.914831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:56.914840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:56.914842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:56.914845Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:56.914924Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:56.914935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:56.914948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:56.914962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:56.914981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:56.915003Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602588112240247:8428]
2025-10-10T14:38:56.915013Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602588112240247:8428]
2025-10-10T14:38:56.915016Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602588112240247:8428]
2025-10-10T14:38:56.915035Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:56.915056Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:56.915081Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:56.915089Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:56.915122Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602588112240247:8428]
2025-10-10T14:38:56.915130Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:56.915267Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:56.915275Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:56.915277Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:56.915283Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:56.915543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602588894480075:6240], now have 1 active actors on pipe
2025-10-10T14:38:56.915559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602588894479912:2438], now have 1 active actors on pipe
2025-10-10T14:38:56.915790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:56.915803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:56.915839Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|427fb65e-17825219-bbd5e596-d39a80c4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:56.915856Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:56.915875Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:56.915883Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:56.915898Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:56.915916Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:56.915935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:56.916122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:56.916130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:56.916148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:56.916726Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c971b26-1d7f9d90-24107afc-f437501e_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|427fb65e-17825219-bbd5e596-d39a80c4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:56.915605Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2831
2025-10-10T14:38:56.915617Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2831
2025-10-10T14:38:56.916326Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2832 partition: 0 MaxSeqNo: 40 sessionId: src_id|427fb65e-17825219-bbd5e596-d39a80c4_0
2025-10-10T14:38:56.919565Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|427fb65e-17825219-bbd5e596-d39a80c4_0] Write session: try to update token
2025-10-10T14:38:56.919582Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|427fb65e-17825219-bbd5e596-d39a80c4_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:56.935253Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:56.935277Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:56.935280Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:56.935282Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:56.935292Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602588112240247:8428]
2025-10-10T14:38:56.935299Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602588112240247:8428]
2025-10-10T14:38:56.935303Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602588112240247:8428]
2025-10-10T14:38:56.935357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:56.935373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:56.935375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:56.935460Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2832 sessionId: src_id|427fb65e-17825219-bbd5e596-d39a80c4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:56.935515Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:56.937426Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:56.937441Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:56.937449Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:56.938495Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:56.985800Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602588894480111:6861]
2025-10-10T14:38:56.985995Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 pipe creation result: OK TabletId: 72075186224037892 Generation: 2831, pipe: [1:7559602588894480111:6861]
2025-10-10T14:38:57.061878Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:57.062479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:57.062495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:57.062543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602588894480111:6861], now have 1 active actors on pipe
2025-10-10T14:38:57.062831Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:57.062838Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:57.062842Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:57.062889Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 30 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602588894480111:6861]
2025-10-10T14:38:57.062926Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2832 reason: error at write: Disconnected sessionId: src_id|427fb65e-17825219-bbd5e596-d39a80c4_0
2025-10-10T14:38:57.063467Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|427fb65e-17825219-bbd5e596-d39a80c4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:57.063478Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|427fb65e-17825219-bbd5e596-d39a80c4_0] Write session will restart in 0.008105s
2025-10-10T14:38:57.063505Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|427fb65e-17825219-bbd5e596-d39a80c4_0] Write session: Do CDS request
2025-10-10T14:38:57.063511Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|427fb65e-17825219-bbd5e596-d39a80c4_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:57.063152Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2832 sessionId: src_id|427fb65e-17825219-bbd5e596-d39a80c4_0 is DEAD
2025-10-10T14:38:57.062817Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:57.072938Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|427fb65e-17825219-bbd5e596-d39a80c4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:57.073013Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:57.073030Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2833
2025-10-10T14:38:57.073173Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2833 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:57.073217Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2833 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:57.073227Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2833 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:57.073231Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:57.073870Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2833 sessionId:  describe result for acl check
2025-10-10T14:38:57.073907Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:57.073913Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:57.073915Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:57.073923Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602593189447434:6203] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:57.074533Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602593189447434:6203] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:57.077055Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602593189447434:6203] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:57.079746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602593189447434:6203] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:57.079760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602593189447434:6203] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:57.079764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602593189447434:6203] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:57.079772Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2833 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:57.090030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:57.096691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:57.096953Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:57.096958Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:57.096970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:57.097030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:57.097069Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602592407207759:8406]
2025-10-10T14:38:57.097737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:57.101546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:57.101629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:57.101984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:57.102050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:57.102051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:57.102052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:57.102054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:57.102055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:57.102057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:57.102058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:57.102061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:57.102062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:57.102064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:57.102065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:57.102067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:57.102068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:57.102075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:57.102094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:57.102096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:57.102099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:57.102101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:57.102103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:57.102106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:57.102108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:57.102110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:57.102114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:57.102118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:57.102122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:57.102126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:57.102135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:57.102145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:57.102152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:57.102158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:57.102163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:57.102169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:57.102174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:57.102180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:57.102185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:57.102191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:57.102197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:57.102202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:57.102206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:57.102209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:57.102212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:57.102216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:57.102219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:57.102223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:57.102225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:57.102229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:57.102235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:57.102240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:57.102245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:57.102250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:57.102255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:57.102261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:57.102307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:57.105548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:57.107220Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2832
2025-10-10T14:38:57.107267Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2832
2025-10-10T14:38:57.108149Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2833 partition: 0 MaxSeqNo: 40 sessionId: src_id|23c49c9f-6640d695-b947f886-73cc3706_0
2025-10-10T14:38:57.106365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:57.106381Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:57.106384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:57.106388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:57.106396Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2832 [2:7559602592407207759:8406]
2025-10-10T14:38:57.106413Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:57.106431Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:57.106435Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:57.106439Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:57.106442Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:57.106460Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:57.106467Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:57.106476Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:57.106539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:57.106541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:57.106542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:57.106545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:57.106622Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:57.106625Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:57.106637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:57.106650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:57.106670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:57.106691Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602592407207754:8406]
2025-10-10T14:38:57.106694Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602592407207754:8406]
2025-10-10T14:38:57.106695Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602592407207754:8406]
2025-10-10T14:38:57.106713Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:57.106727Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:57.106745Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:57.106748Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:57.106759Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:57.106762Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:57.106764Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:57.106780Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602592407207754:8406]
2025-10-10T14:38:57.106783Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:57.106861Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:57.107124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602593189447482:6203], now have 1 active actors on pipe
2025-10-10T14:38:57.107132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602593189447409:2438], now have 1 active actors on pipe
2025-10-10T14:38:57.107630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:57.107639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:57.107688Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|23c49c9f-6640d695-b947f886-73cc3706_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:57.107698Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:57.107703Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:57.107707Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:57.107721Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:57.107734Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:57.107752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:57.107972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:57.107979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:57.108012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:57.108672Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|427fb65e-17825219-bbd5e596-d39a80c4_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|23c49c9f-6640d695-b947f886-73cc3706_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:57.111699Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|23c49c9f-6640d695-b947f886-73cc3706_0] Write session: try to update token
2025-10-10T14:38:57.111722Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|23c49c9f-6640d695-b947f886-73cc3706_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:57.128369Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2833 sessionId: src_id|23c49c9f-6640d695-b947f886-73cc3706_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:57.131098Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:57.131118Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:57.131122Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:57.131124Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:57.131135Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602592407207754:8406]
2025-10-10T14:38:57.131140Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602592407207754:8406]
2025-10-10T14:38:57.131144Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602592407207754:8406]
2025-10-10T14:38:57.131196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:57.131201Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:57.131204Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:57.131207Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:57.131208Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:57.131213Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:57.131270Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:57.131336Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:57.163080Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602593189447586:6861]
2025-10-10T14:38:57.163394Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 pipe creation result: OK TabletId: 72075186224037892 Generation: 2832, pipe: [1:7559602593189447586:6861]
2025-10-10T14:38:57.255332Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:57.255628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:57.255644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:57.255690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602593189447586:6861], now have 1 active actors on pipe
2025-10-10T14:38:57.256021Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 31 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602593189447586:6861]
2025-10-10T14:38:57.256059Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:57.256062Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:57.256122Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:57.256129Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2833 reason: error at write: Disconnected sessionId: src_id|23c49c9f-6640d695-b947f886-73cc3706_0
2025-10-10T14:38:57.256482Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23c49c9f-6640d695-b947f886-73cc3706_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:57.256495Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23c49c9f-6640d695-b947f886-73cc3706_0] Write session will restart in 0.006010s
2025-10-10T14:38:57.256528Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23c49c9f-6640d695-b947f886-73cc3706_0] Write session: Do CDS request
2025-10-10T14:38:57.256534Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23c49c9f-6640d695-b947f886-73cc3706_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:57.256330Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2833 sessionId: src_id|23c49c9f-6640d695-b947f886-73cc3706_0 is DEAD
2025-10-10T14:38:57.256494Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:57.263940Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|23c49c9f-6640d695-b947f886-73cc3706_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:57.265673Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:57.265690Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2834
2025-10-10T14:38:57.265819Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2834 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:57.265855Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2834 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:57.265866Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2834 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:57.265870Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:57.266306Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2834 sessionId:  describe result for acl check
2025-10-10T14:38:57.266346Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:57.266348Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:57.266351Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:57.266357Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602593189447604:6190] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:57.266964Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602593189447604:6190] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:57.270083Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602593189447604:6190] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:57.277012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:57.277406Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602593189447604:6190] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:57.277422Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602593189447604:6190] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:57.277426Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602593189447604:6190] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:57.277436Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2834 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:57.280744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:57.281010Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:57.281023Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:57.281036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:57.281097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:57.281143Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602592407207934:8404]
2025-10-10T14:38:57.281870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:57.282238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:57.282288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:57.282661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:57.282722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:57.282728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:57.282730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:57.282731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:57.282733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:57.282735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:57.282736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:57.282738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:57.282740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:57.282741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:57.282742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:57.282744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:57.282745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:57.282751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:57.282766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:57.282771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:57.282776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:57.282781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:57.282786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:57.282790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:57.282795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:57.282799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:57.282805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:57.282809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:57.282814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:57.282818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:57.282825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:57.282835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:57.282842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:57.282849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:57.282855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:57.282861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:57.282871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:57.282877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:57.282883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:57.282893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:57.282899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:57.282910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:57.282915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:57.282921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:57.282931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:57.282938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:57.282948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:57.282954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:57.282964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:57.282970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:57.282983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:57.282993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:57.283000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:57.283011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:57.283017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:57.283027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:57.283073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:57.285684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:57.286541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:57.286554Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:57.286556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:57.286560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:57.286566Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2833 [2:7559602592407207934:8404]
2025-10-10T14:38:57.286580Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:57.286598Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:57.286605Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:57.286609Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:57.286612Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:57.286632Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:57.286640Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:57.286648Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:57.286722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:57.286730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:57.286732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:57.286734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:57.286804Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:57.286812Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:57.286825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:57.286838Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:57.286860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:57.286888Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602592407207928:8404]
2025-10-10T14:38:57.286894Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602592407207928:8404]
2025-10-10T14:38:57.286897Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602592407207928:8404]
2025-10-10T14:38:57.286911Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:57.286927Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:57.286931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602593189447589:2438], now have 1 active actors on pipe
2025-10-10T14:38:57.286936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602593189447755:6190], now have 1 active actors on pipe
2025-10-10T14:38:57.286944Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:57.286952Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:57.286955Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:57.286958Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:57.286962Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:57.286993Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602592407207928:8404]
2025-10-10T14:38:57.286972Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2833
2025-10-10T14:38:57.287006Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:57.287013Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:57.286980Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2833
2025-10-10T14:38:57.287179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:57.287194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:57.287239Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2f506ca2-d68f0900-c6661c12-deaeec2f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:57.287253Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:57.287258Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:57.287260Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:57.287272Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:57.287296Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:57.287311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:57.287745Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2834 partition: 0 MaxSeqNo: 40 sessionId: src_id|2f506ca2-d68f0900-c6661c12-deaeec2f_0
2025-10-10T14:38:57.288252Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23c49c9f-6640d695-b947f886-73cc3706_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|2f506ca2-d68f0900-c6661c12-deaeec2f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:57.291270Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2f506ca2-d68f0900-c6661c12-deaeec2f_0] Write session: try to update token
2025-10-10T14:38:57.291297Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2f506ca2-d68f0900-c6661c12-deaeec2f_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:57.287561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:57.287572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:57.287613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:57.299831Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:38:57.299852Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:57.299864Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602592407207928:8404]
2025-10-10T14:38:57.299913Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:38:57.299917Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:38:57.300109Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:38:57.300261Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:57.300409Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:57.300542Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:57.300740Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:38:57.300788Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:38:57.307849Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2834 sessionId: src_id|2f506ca2-d68f0900-c6661c12-deaeec2f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:57.310679Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:57.310904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:57.310930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:57.310992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:38:57.311094Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:38:57.319891Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:57.319918Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:57.319922Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:57.319925Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:57.319941Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602592407207928:8404]
2025-10-10T14:38:57.319946Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602592407207928:8404]
2025-10-10T14:38:57.319950Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602592407207928:8404]
2025-10-10T14:38:57.319987Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:57.319993Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:57.319994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:57.319997Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:57.320004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:57.320006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:57.320163Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:57.369138Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602593189447767:6861]
2025-10-10T14:38:57.373715Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 pipe creation result: OK TabletId: 72075186224037892 Generation: 2833, pipe: [1:7559602593189447767:6861]
2025-10-10T14:38:57.441265Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:57.450650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:57.450679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:57.450857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:57.450927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:57.451001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:57.451070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:57.451121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:57.451131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:57.451201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:57.451271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:57.451348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:57.451422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:57.451472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:57.451479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:57.451558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:57.451643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:57.451714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:57.451783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:57.451824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:57.451827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:57.451912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:57.451983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:57.452052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:57.452118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:57.452163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:57.452166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:57.452237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:57.452298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:57.452360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:57.452416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:57.452456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:57.452459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:57.452527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:57.452585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:57.452643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:57.452717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:57.452766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:57.452769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:57.452846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:57.452901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:57.452958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:57.453024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:57.453081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:57.453085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:57.453154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:57.453209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:57.453270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:57.453484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:57.453555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:57.453563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:57.453641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:57.453711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:57.453778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:57.453839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:57.453888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:57.453891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:57.453969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:57.454024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:57.454081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:57.454150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:57.454200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:57.454202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:57.454263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602593189447767:6861], now have 1 active actors on pipe
2025-10-10T14:38:57.456040Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:57.457824Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:57.457894Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 32 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602593189447767:6861]
2025-10-10T14:38:57.457932Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:38:57.457985Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2834 reason: status is not ok: tablet will be restarted right now sessionId: src_id|2f506ca2-d68f0900-c6661c12-deaeec2f_0
2025-10-10T14:38:57.458242Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2834 sessionId: src_id|2f506ca2-d68f0900-c6661c12-deaeec2f_0 is DEAD
2025-10-10T14:38:57.459376Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f506ca2-d68f0900-c6661c12-deaeec2f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:38:57.459389Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f506ca2-d68f0900-c6661c12-deaeec2f_0] Write session will restart in 0.007026s
2025-10-10T14:38:57.459418Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f506ca2-d68f0900-c6661c12-deaeec2f_0] Write session: Do CDS request
2025-10-10T14:38:57.459438Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f506ca2-d68f0900-c6661c12-deaeec2f_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:57.468958Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2f506ca2-d68f0900-c6661c12-deaeec2f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:57.469395Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:57.469414Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2835
2025-10-10T14:38:57.469608Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2835 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:57.469648Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2835 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:57.469658Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2835 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:57.469663Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:57.470169Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2835 sessionId:  describe result for acl check
2025-10-10T14:38:57.470210Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:57.470219Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:57.470221Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:57.470229Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602593189447783:6156] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:57.470881Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602593189447783:6156] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:57.474359Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602593189447783:6156] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:57.479394Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602593189447783:6156] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:57.479409Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602593189447783:6156] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:57.479413Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602593189447783:6156] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:57.479421Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2835 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:57.481642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:57.486044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:57.486317Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:57.486330Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:57.486343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:57.486398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:57.486447Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602592407208120:8401]
2025-10-10T14:38:57.487107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:57.487521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:57.487597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:57.487963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:57.488041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:57.488047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:57.488049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:57.488050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:57.488051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:57.488053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:57.488055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:57.488056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:57.488057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:57.488059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:57.488060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:57.488062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:57.488063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:57.488070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:57.488085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:57.488090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:57.488094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:57.488098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:57.488103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:57.488107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:57.488111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:57.488115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:57.488120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:57.488125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:57.488134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:57.488138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:57.488148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:57.488161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:57.488173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:57.488179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:57.488188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:57.488194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:57.488199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:57.488210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:57.488216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:57.488226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:57.488231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:57.488238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:57.488243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:57.488249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:57.488260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:57.488266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:57.488275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:57.488280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:57.488289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:57.488294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:57.488299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:57.488309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:57.488313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:57.488324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:57.488328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:57.488339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:57.488384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:57.491375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:57.492048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:57.492063Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:57.492067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:57.492072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:57.492081Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2834 [2:7559602592407208120:8401]
2025-10-10T14:38:57.492097Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:57.492121Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:57.492131Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:57.492136Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:57.492138Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:57.492162Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:57.492177Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:57.492188Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:57.492266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:57.492279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:57.492281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:57.492284Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:57.492497Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2834
2025-10-10T14:38:57.492551Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2834
2025-10-10T14:38:57.492840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:57.492856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:57.492873Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:57.492887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:57.492906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:57.492940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602593189447769:2438], now have 1 active actors on pipe
2025-10-10T14:38:57.492950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602593189447933:6156], now have 1 active actors on pipe
2025-10-10T14:38:57.492978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:57.492992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:57.493013Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602592407208115:8401]
2025-10-10T14:38:57.493019Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602592407208115:8401]
2025-10-10T14:38:57.493021Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602592407208115:8401]
2025-10-10T14:38:57.493037Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:57.493058Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:57.493062Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:57.493062Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:57.493064Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:57.493080Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:57.493085Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:57.493111Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|60d3503f-cf51cac0-55b24e3f-f361d5eb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:57.493121Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:57.493125Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:57.493127Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:57.493140Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:57.493153Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:57.493202Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602592407208115:8401]
2025-10-10T14:38:57.493212Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:57.493218Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:57.493227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:57.493499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:57.493528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:57.493553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:57.493731Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2835 partition: 0 MaxSeqNo: 40 sessionId: src_id|60d3503f-cf51cac0-55b24e3f-f361d5eb_0
2025-10-10T14:38:57.497705Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f506ca2-d68f0900-c6661c12-deaeec2f_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|60d3503f-cf51cac0-55b24e3f-f361d5eb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:57.502059Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|60d3503f-cf51cac0-55b24e3f-f361d5eb_0] Write session: try to update token
2025-10-10T14:38:57.502092Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|60d3503f-cf51cac0-55b24e3f-f361d5eb_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:57.508040Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:38:57.508063Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:57.508076Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602592407208115:8401]
2025-10-10T14:38:57.508135Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:38:57.508138Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:38:57.508479Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:38:57.508744Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:57.509003Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:57.509188Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:57.509540Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:38:57.509599Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:38:57.525896Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2835 sessionId: src_id|60d3503f-cf51cac0-55b24e3f-f361d5eb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:57.529040Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:57.529485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:57.529525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:57.529571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:38:57.529757Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:38:57.534684Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:57.534703Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:57.534707Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:57.534709Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:57.534722Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602592407208115:8401]
2025-10-10T14:38:57.534727Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602592407208115:8401]
2025-10-10T14:38:57.534731Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602592407208115:8401]
2025-10-10T14:38:57.534784Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:57.534791Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:57.534793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:57.534797Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:57.534804Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:57.534806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:57.534992Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:57.558234Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602593189447948:6861]
2025-10-10T14:38:57.558565Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 pipe creation result: OK TabletId: 72075186224037892 Generation: 2834, pipe: [1:7559602593189447948:6861]
2025-10-10T14:38:57.653316Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:57.662315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:57.662342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:57.662529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:57.662601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:57.662676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:57.662751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:57.663093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:57.663105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:57.663181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:57.663252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:57.663328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:57.663404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:57.663451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:57.663458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:57.663536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:57.663617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:57.663684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:57.663756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:57.663804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:57.663812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:57.663878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:57.663937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:57.664006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:57.664073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:57.664119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:57.664121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:57.664190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:57.664246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:57.664314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:57.664381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:57.664426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:57.664431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:57.664496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:57.664558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:57.664617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:57.664680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:57.664735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:57.664742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:57.664806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:57.664859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:57.664922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:57.664985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:57.665032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:57.665043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:57.665120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:57.665192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:57.665263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:57.665350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:57.665400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:57.665408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:57.665475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:57.665545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:57.665605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:57.665675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:57.665727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:57.665734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:57.665805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:57.665869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:57.665931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:57.665993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:57.666037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:57.666043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:57.666125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602593189447948:6861], now have 1 active actors on pipe
2025-10-10T14:38:57.666419Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:57.666431Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:57.666432Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:57.666467Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2835 reason: error at write: Disconnected sessionId: src_id|60d3503f-cf51cac0-55b24e3f-f361d5eb_0
2025-10-10T14:38:57.666480Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 33 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602593189447948:6861]
2025-10-10T14:38:57.666684Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2835 sessionId: src_id|60d3503f-cf51cac0-55b24e3f-f361d5eb_0 is DEAD
2025-10-10T14:38:57.666845Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60d3503f-cf51cac0-55b24e3f-f361d5eb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:57.666858Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60d3503f-cf51cac0-55b24e3f-f361d5eb_0] Write session will restart in 0.009900s
2025-10-10T14:38:57.666884Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60d3503f-cf51cac0-55b24e3f-f361d5eb_0] Write session: Do CDS request
2025-10-10T14:38:57.666890Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60d3503f-cf51cac0-55b24e3f-f361d5eb_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:57.666895Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:57.677883Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|60d3503f-cf51cac0-55b24e3f-f361d5eb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:57.677977Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:57.677993Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2836
2025-10-10T14:38:57.678147Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2836 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:57.678195Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2836 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:57.678206Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2836 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:57.678211Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:57.678807Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2836 sessionId:  describe result for acl check
2025-10-10T14:38:57.678845Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:57.678854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:57.678856Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:57.678863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602593189448045:6134] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:57.679477Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602593189448045:6134] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:57.681921Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602593189448045:6134] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:57.682659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:57.686724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:57.686979Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:57.686993Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:57.687017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:57.687087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:57.687111Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602593189448045:6134] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:57.687127Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602593189448045:6134] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:57.687131Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602593189448045:6134] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:57.687141Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2836 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:57.687135Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602592407208295:8399]
2025-10-10T14:38:57.687775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:57.688086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:57.688133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:57.688455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:57.688534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:57.688542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:57.688544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:57.688545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:57.688546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:57.688547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:57.688549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:57.688551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:57.688552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:57.688554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:57.688555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:57.688556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:57.688557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:57.688564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:57.688578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:57.688581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:57.688583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:57.688585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:57.688588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:57.688590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:57.688592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:57.688594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:57.688597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:57.688599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:57.688601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:57.688603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:57.688610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:57.688616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:57.688621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:57.688625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:57.688628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:57.688631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:57.688634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:57.688638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:57.688641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:57.688645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:57.688648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:57.688651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:57.688654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:57.688658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:57.688661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:57.688664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:57.688668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:57.688671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:57.688674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:57.688678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:57.688682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:57.688685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:57.688688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:57.688692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:57.688696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:57.688699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:57.688725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:57.691434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:57.692192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:57.692206Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:57.692208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:57.692213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:57.692220Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2835 [2:7559602592407208295:8399]
2025-10-10T14:38:57.692235Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:57.692256Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:57.692264Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:57.692268Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:57.692270Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:57.692289Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:57.692297Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:57.692306Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:57.692382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:57.692389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:57.692391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:57.692394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:57.692468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:57.692476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:57.692489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:57.692507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:57.692530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:57.692559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602593189447962:2438], now have 1 active actors on pipe
2025-10-10T14:38:57.692567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602593189448131:6134], now have 1 active actors on pipe
2025-10-10T14:38:57.692575Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602592407208290:8399]
2025-10-10T14:38:57.692582Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602592407208290:8399]
2025-10-10T14:38:57.692584Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602592407208290:8399]
2025-10-10T14:38:57.692599Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:57.692613Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:57.692614Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:57.692623Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:57.692626Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:57.692631Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:57.692635Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:57.692666Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602592407208290:8399]
2025-10-10T14:38:57.692674Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:57.692678Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:57.692638Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2835
2025-10-10T14:38:57.692667Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2835
2025-10-10T14:38:57.692706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:57.692717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:57.692755Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|811be196-3d3eba21-8fe895f3-78222e73_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:57.692770Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:57.692775Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:57.692777Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:57.692789Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:57.692799Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:57.692815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:57.692961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:57.692968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:57.692983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:57.693232Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2836 partition: 0 MaxSeqNo: 40 sessionId: src_id|811be196-3d3eba21-8fe895f3-78222e73_0
2025-10-10T14:38:57.693695Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60d3503f-cf51cac0-55b24e3f-f361d5eb_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|811be196-3d3eba21-8fe895f3-78222e73_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:57.696675Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|811be196-3d3eba21-8fe895f3-78222e73_0] Write session: try to update token
2025-10-10T14:38:57.696698Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|811be196-3d3eba21-8fe895f3-78222e73_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:57.714223Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2836 sessionId: src_id|811be196-3d3eba21-8fe895f3-78222e73_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:57.717056Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:57.717405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:57.717439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:57.717487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:38:57.717589Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:38:57.730273Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:57.730299Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:57.730302Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:57.730305Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:57.730317Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602592407208290:8399]
2025-10-10T14:38:57.730322Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602592407208290:8399]
2025-10-10T14:38:57.730326Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602592407208290:8399]
2025-10-10T14:38:57.730394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:57.730396Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:57.730404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:57.730405Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:57.730407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:57.730426Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:57.730572Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:57.766618Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602593189448142:6861]
2025-10-10T14:38:57.766904Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 pipe creation result: OK TabletId: 72075186224037892 Generation: 2835, pipe: [1:7559602593189448142:6861]
2025-10-10T14:38:57.854848Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:57.868923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:57.868963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:57.869157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:57.869231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:57.869309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:57.869408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:57.869463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:57.869479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:57.869569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:57.869627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:57.869692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:57.869760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:57.869805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:57.869808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:57.869882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:57.869942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:57.870009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:57.870081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:57.870124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:57.870127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:57.870203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:57.870273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:57.870337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:57.870406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:57.870449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:57.870452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:57.870527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:57.870589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:57.870654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:57.870715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:57.870758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:57.870761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:57.870833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:57.870896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:57.870958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:57.871030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:57.871075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:57.871078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:57.871153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:57.871214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:57.871284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:57.871352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:57.871398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:57.871401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:57.871479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:57.871546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:57.871613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:57.871675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:57.871722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:57.871730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:57.873273Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|811be196-3d3eba21-8fe895f3-78222e73_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:57.872699Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:57.873291Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|811be196-3d3eba21-8fe895f3-78222e73_0] Write session will restart in 0.008404s
2025-10-10T14:38:57.872770Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 34 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602593189448142:6861]
2025-10-10T14:38:57.872798Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:57.872801Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:57.872844Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2836 reason: error at write: Disconnected sessionId: src_id|811be196-3d3eba21-8fe895f3-78222e73_0
2025-10-10T14:38:57.873072Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2836 sessionId: src_id|811be196-3d3eba21-8fe895f3-78222e73_0 is DEAD
2025-10-10T14:38:57.873319Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|811be196-3d3eba21-8fe895f3-78222e73_0] Write session: Do CDS request
2025-10-10T14:38:57.873325Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|811be196-3d3eba21-8fe895f3-78222e73_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:57.871801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:57.871865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:57.871928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:57.871990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:57.872034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:57.872038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:57.872110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:57.872176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:57.872244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:57.872308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:57.872349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:57.872353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:57.872436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602593189448142:6861], now have 1 active actors on pipe
2025-10-10T14:38:57.874161Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:57.882958Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|811be196-3d3eba21-8fe895f3-78222e73_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:57.885480Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:57.885506Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2837
2025-10-10T14:38:57.885806Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2837 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:57.885861Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2837 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:57.885872Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2837 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:57.885876Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:57.886349Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2837 sessionId:  describe result for acl check
2025-10-10T14:38:57.886385Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:57.886391Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:57.886397Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:57.886407Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602593189448171:6117] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:57.887495Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602593189448171:6117] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:57.891067Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602593189448171:6117] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:57.894505Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602593189448171:6117] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:57.894520Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602593189448171:6117] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:57.894524Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602593189448171:6117] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:57.894545Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2837 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:57.899626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:57.900602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:57.900830Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:57.900843Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:57.900856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:57.900920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:57.900969Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602592407208472:8395]
2025-10-10T14:38:57.901670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:57.901997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:57.902046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:57.902372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:57.902434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:57.902436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:57.902437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:57.902439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:57.902441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:57.902442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:57.902444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:57.902445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:57.902447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:57.902448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:57.902450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:57.902451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:57.902453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:57.902459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:57.902474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:57.902478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:57.902482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:57.902486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:57.902490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:57.902495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:57.902500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:57.902504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:57.902509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:57.902513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:57.902518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:57.902522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:57.902530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:57.902539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:57.902547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:57.902553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:57.902560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:57.902566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:57.902571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:57.902577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:57.902583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:57.902589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:57.902593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:57.902599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:57.902605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:57.902611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:57.902616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:57.902623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:57.902628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:57.902634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:57.902639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:57.902644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:57.902650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:57.902657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:57.902661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:57.902667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:57.902672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:57.902679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:57.902723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:57.905442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:57.906045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:57.906060Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:57.906063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:57.906067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:57.906074Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2836 [2:7559602592407208472:8395]
2025-10-10T14:38:57.906088Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:57.906109Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:57.906118Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:57.906121Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:57.906124Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:57.906155Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:57.906167Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:57.906176Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:57.906246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:57.906253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:57.906255Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:57.906258Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:57.906331Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:57.906339Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:57.906352Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:57.906367Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:57.906388Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:57.906416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602593189448155:2438], now have 1 active actors on pipe
2025-10-10T14:38:57.906424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602593189448321:6117], now have 1 active actors on pipe
2025-10-10T14:38:57.906432Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602592407208467:8395]
2025-10-10T14:38:57.906436Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602592407208467:8395]
2025-10-10T14:38:57.906439Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602592407208467:8395]
2025-10-10T14:38:57.906452Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:57.906475Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:57.906484Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:57.906490Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:57.906496Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:57.906499Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:57.906499Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:57.906484Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2836
2025-10-10T14:38:57.906526Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602592407208467:8395]
2025-10-10T14:38:57.906491Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2836
2025-10-10T14:38:57.906538Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:57.906544Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:57.906600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:57.906610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:57.906641Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|44549b93-3dadee79-2f76f6f1-d69546_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:57.906653Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:57.906662Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:57.906664Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:57.906678Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:57.906694Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:57.906714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:57.907031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:57.907048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:57.907072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:57.907204Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2837 partition: 0 MaxSeqNo: 40 sessionId: src_id|44549b93-3dadee79-2f76f6f1-d69546_0
2025-10-10T14:38:57.907613Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|811be196-3d3eba21-8fe895f3-78222e73_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|44549b93-3dadee79-2f76f6f1-d69546_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:57.916122Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|44549b93-3dadee79-2f76f6f1-d69546_0] Write session: try to update token
2025-10-10T14:38:57.916149Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|44549b93-3dadee79-2f76f6f1-d69546_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:57.931908Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:57.931929Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:57.931933Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:57.931935Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:57.931946Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602592407208467:8395]
2025-10-10T14:38:57.931950Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602592407208467:8395]
2025-10-10T14:38:57.931954Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602592407208467:8395]
2025-10-10T14:38:57.932012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:57.932020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:57.932033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:57.932074Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:57.932087Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:57.932092Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:57.932200Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:57.941212Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2837 sessionId: src_id|44549b93-3dadee79-2f76f6f1-d69546_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:57.944484Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:57.972930Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602593189448335:6861]
2025-10-10T14:38:57.973509Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 pipe creation result: OK TabletId: 72075186224037892 Generation: 2836, pipe: [1:7559602593189448335:6861]
2025-10-10T14:38:58.056054Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:58.056400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:58.056414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:58.056466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602593189448335:6861], now have 1 active actors on pipe
2025-10-10T14:38:58.056720Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:58.057610Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 35 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602593189448335:6861]
2025-10-10T14:38:58.057644Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:38:58.057735Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2837 reason: status is not ok: tablet will be restarted right now sessionId: src_id|44549b93-3dadee79-2f76f6f1-d69546_0
2025-10-10T14:38:58.057981Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2837 sessionId: src_id|44549b93-3dadee79-2f76f6f1-d69546_0 is DEAD
2025-10-10T14:38:58.058141Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:58.058294Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|44549b93-3dadee79-2f76f6f1-d69546_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:38:58.058305Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|44549b93-3dadee79-2f76f6f1-d69546_0] Write session will restart in 0.007570s
2025-10-10T14:38:58.058331Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|44549b93-3dadee79-2f76f6f1-d69546_0] Write session: Do CDS request
2025-10-10T14:38:58.058337Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|44549b93-3dadee79-2f76f6f1-d69546_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:58.066987Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|44549b93-3dadee79-2f76f6f1-d69546_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:58.067193Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:58.067220Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2838
2025-10-10T14:38:58.067340Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2838 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:58.067377Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2838 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:58.067384Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2838 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:58.067388Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:58.067949Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2838 sessionId:  describe result for acl check
2025-10-10T14:38:58.067983Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:58.067986Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:58.067988Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:58.067995Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602597484415678:6081] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:58.068624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602597484415678:6081] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:58.071052Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602597484415678:6081] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:58.074501Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602597484415678:6081] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:58.074514Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602597484415678:6081] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:58.074518Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602597484415678:6081] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:58.074528Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2838 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:58.091029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:58.098750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:58.099032Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:58.099045Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:58.099059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:58.099117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:58.099166Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602596702175984:8352]
2025-10-10T14:38:58.099817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:58.100213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:58.100279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:58.100626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:58.100710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:58.100719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:58.100721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:58.100722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:58.100723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:58.100725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:58.100726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:58.100728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:58.100729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:58.100730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:58.100732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:58.100733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:58.100734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:58.100741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:58.100755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:58.100759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:58.100763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:58.100768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:58.100772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:58.100775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:58.100779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:58.100782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:58.100786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:58.100790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:58.100793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:58.100797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:58.100807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:58.100816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:58.100823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:58.100829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:58.100833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:58.100839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:58.100844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:58.100849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:58.100854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:58.100860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:58.100865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:58.100870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:58.100875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:58.100881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:58.100885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:58.100891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:58.100895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:58.100900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:58.100904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:58.100909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:58.100914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:58.100933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:58.100945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:58.100950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:58.100955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:58.100959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:58.101000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:58.104687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:58.105225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:58.105240Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:58.105243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:58.105248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:58.105255Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2837 [2:7559602596702175984:8352]
2025-10-10T14:38:58.105271Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:58.105291Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:58.105295Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:58.105299Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:58.105302Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:58.105323Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:58.105351Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:58.105360Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:58.105419Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:58.105427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:58.105430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:58.105433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:58.105516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:58.105524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:58.105537Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:58.105555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:58.105578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:58.105603Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602596702175979:8352]
2025-10-10T14:38:58.105609Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602596702175979:8352]
2025-10-10T14:38:58.105611Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602596702175979:8352]
2025-10-10T14:38:58.105621Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:58.105637Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:58.105637Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:58.105641Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:58.105643Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:58.105660Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:58.105667Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:58.105680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602597484415660:2438], now have 1 active actors on pipe
2025-10-10T14:38:58.105688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602597484415758:6081], now have 1 active actors on pipe
2025-10-10T14:38:58.105718Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602596702175979:8352]
2025-10-10T14:38:58.105730Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:58.105747Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:58.105973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:58.105984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:58.106019Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2b74cb38-deab6c0a-684148e2-3ffddc4c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:58.106028Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:58.106032Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:58.106035Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:58.106047Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:58.106061Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:58.106076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:58.106345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:58.106357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:58.106380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:58.106948Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|44549b93-3dadee79-2f76f6f1-d69546_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|2b74cb38-deab6c0a-684148e2-3ffddc4c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:58.105766Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2837
2025-10-10T14:38:58.105810Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2837
2025-10-10T14:38:58.106528Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2838 partition: 0 MaxSeqNo: 40 sessionId: src_id|2b74cb38-deab6c0a-684148e2-3ffddc4c_0
2025-10-10T14:38:58.109827Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2b74cb38-deab6c0a-684148e2-3ffddc4c_0] Write session: try to update token
2025-10-10T14:38:58.109846Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2b74cb38-deab6c0a-684148e2-3ffddc4c_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:58.128713Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:58.128734Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:58.128738Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:58.128741Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:58.128752Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602596702175979:8352]
2025-10-10T14:38:58.128758Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602596702175979:8352]
2025-10-10T14:38:58.128762Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602596702175979:8352]
2025-10-10T14:38:58.128820Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:58.128830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:58.128833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:58.128992Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:58.132461Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:58.132479Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:58.132484Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:58.137004Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2838 sessionId: src_id|2b74cb38-deab6c0a-684148e2-3ffddc4c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:58.140246Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:58.161507Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602597484415844:6861]
2025-10-10T14:38:58.162709Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 pipe creation result: OK TabletId: 72075186224037892 Generation: 2837, pipe: [1:7559602597484415844:6861]
2025-10-10T14:38:58.274107Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:58.275378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:58.275406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:58.275459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602597484415844:6861], now have 1 active actors on pipe
2025-10-10T14:38:58.275759Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 36 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602597484415844:6861]
2025-10-10T14:38:58.275802Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:58.275804Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:58.275880Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2838 reason: error at write: Disconnected sessionId: src_id|2b74cb38-deab6c0a-684148e2-3ffddc4c_0
2025-10-10T14:38:58.276090Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2838 sessionId: src_id|2b74cb38-deab6c0a-684148e2-3ffddc4c_0 is DEAD
2025-10-10T14:38:58.275738Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:58.276125Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:58.276319Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b74cb38-deab6c0a-684148e2-3ffddc4c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:58.276331Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b74cb38-deab6c0a-684148e2-3ffddc4c_0] Write session will restart in 0.005611s
2025-10-10T14:38:58.276358Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b74cb38-deab6c0a-684148e2-3ffddc4c_0] Write session: Do CDS request
2025-10-10T14:38:58.276368Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b74cb38-deab6c0a-684148e2-3ffddc4c_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:58.283378Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2b74cb38-deab6c0a-684148e2-3ffddc4c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:58.283396Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:58.283412Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2839
2025-10-10T14:38:58.283676Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2839 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:58.283731Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2839 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:58.283739Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2839 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:58.283743Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:58.284331Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2839 sessionId:  describe result for acl check
2025-10-10T14:38:58.284366Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:58.284375Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:58.284377Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:58.284384Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602597484415860:6074] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:58.284977Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602597484415860:6074] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:58.287472Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602597484415860:6074] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:58.291724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602597484415860:6074] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:58.291741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602597484415860:6074] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:58.291746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602597484415860:6074] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:58.291755Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2839 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:58.299008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:58.303450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:58.303735Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:58.303748Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:58.303760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:58.303821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:58.303886Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602596702176165:8350]
2025-10-10T14:38:58.304544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:58.305002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:58.305076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:58.305775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:58.305878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:58.305887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:58.305889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:58.305890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:58.305892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:58.305893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:58.305895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:58.305896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:58.305897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:58.305898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:58.305899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:58.305901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:58.305902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:58.305910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:58.305925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:58.305929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:58.305934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:58.305938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:58.305942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:58.305946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:58.305951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:58.305955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:58.305959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:58.305964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:58.305969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:58.305973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:58.305982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:58.305991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:58.305999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:58.306004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:58.306009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:58.306015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:58.306020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:58.306025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:58.306031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:58.306037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:58.306041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:58.306047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:58.306052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:58.306058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:58.306063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:58.306069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:58.306075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:58.306088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:58.306092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:58.306097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:58.306106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:58.306112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:58.306117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:58.306122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:58.306127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:58.306132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:58.306176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:58.309487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:58.309858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:58.309871Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:58.309875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:58.309879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:58.309886Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2838 [2:7559602596702176165:8350]
2025-10-10T14:38:58.309903Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:58.309936Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:58.309944Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:58.309948Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:58.309951Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:58.309971Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:58.309979Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:58.309988Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:58.310055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:58.310062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:58.310065Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:58.310068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:58.310142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:58.310150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:58.310162Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:58.310175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:58.310193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:58.310232Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602596702176160:8350]
2025-10-10T14:38:58.310240Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602596702176160:8350]
2025-10-10T14:38:58.310243Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602596702176160:8350]
2025-10-10T14:38:58.310254Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:58.310263Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:58.310267Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:58.310268Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:58.310270Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:58.310289Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:58.310293Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:58.310306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602597484415847:2438], now have 1 active actors on pipe
2025-10-10T14:38:58.310310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602597484415926:6074], now have 1 active actors on pipe
2025-10-10T14:38:58.310342Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602596702176160:8350]
2025-10-10T14:38:58.310354Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:58.310380Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:58.310350Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2838
2025-10-10T14:38:58.310414Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2838
2025-10-10T14:38:58.310615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:58.310627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:58.310664Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|29cead61-39a02255-bc916719-f50a37c2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:58.310674Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:58.310679Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:58.310681Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:58.310694Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:58.310708Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:58.310724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:58.310963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:58.310974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:58.310994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:58.311095Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2839 partition: 0 MaxSeqNo: 40 sessionId: src_id|29cead61-39a02255-bc916719-f50a37c2_0
2025-10-10T14:38:58.311539Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b74cb38-deab6c0a-684148e2-3ffddc4c_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|29cead61-39a02255-bc916719-f50a37c2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:58.314391Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|29cead61-39a02255-bc916719-f50a37c2_0] Write session: try to update token
2025-10-10T14:38:58.314412Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|29cead61-39a02255-bc916719-f50a37c2_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:58.331675Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:58.331696Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:58.331700Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:58.331703Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:58.331713Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602596702176160:8350]
2025-10-10T14:38:58.331717Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602596702176160:8350]
2025-10-10T14:38:58.331721Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602596702176160:8350]
2025-10-10T14:38:58.331765Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:58.331769Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:58.331774Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:58.331774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:58.331783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:58.331785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:58.334611Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2839 sessionId: src_id|29cead61-39a02255-bc916719-f50a37c2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:58.331930Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:58.337417Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:58.375860Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602597484416030:6861]
2025-10-10T14:38:58.376239Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 pipe creation result: OK TabletId: 72075186224037892 Generation: 2838, pipe: [1:7559602597484416030:6861]
2025-10-10T14:38:58.448965Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:58.449979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:58.450007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:58.450066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602597484416030:6861], now have 1 active actors on pipe
2025-10-10T14:38:58.450324Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:58.450918Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|29cead61-39a02255-bc916719-f50a37c2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:38:58.450940Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|29cead61-39a02255-bc916719-f50a37c2_0] Write session will restart in 0.007187s
2025-10-10T14:38:58.450966Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|29cead61-39a02255-bc916719-f50a37c2_0] Write session: Do CDS request
2025-10-10T14:38:58.450972Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|29cead61-39a02255-bc916719-f50a37c2_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:58.450360Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:58.450435Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 37 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602597484416030:6861]
2025-10-10T14:38:58.450469Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:38:58.450566Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2839 reason: status is not ok: tablet will be restarted right now sessionId: src_id|29cead61-39a02255-bc916719-f50a37c2_0
2025-10-10T14:38:58.450772Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2839 sessionId: src_id|29cead61-39a02255-bc916719-f50a37c2_0 is DEAD
2025-10-10T14:38:58.459946Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|29cead61-39a02255-bc916719-f50a37c2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:58.460115Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:58.460131Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2840
2025-10-10T14:38:58.460291Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2840 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:58.460346Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2840 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:58.460358Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2840 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:58.460363Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:58.460873Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2840 sessionId:  describe result for acl check
2025-10-10T14:38:58.460912Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:58.460914Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:58.460917Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:58.460923Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602597484416067:6048] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:58.461537Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602597484416067:6048] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:58.464508Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602597484416067:6048] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:58.467981Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602597484416067:6048] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:58.467998Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602597484416067:6048] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:58.468002Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602597484416067:6048] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:58.468011Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2840 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:58.468464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:58.473119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:58.473411Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:58.473422Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:58.473435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:58.473507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:58.473555Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602596702176345:8348]
2025-10-10T14:38:58.474208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:58.474636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:58.474692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:58.475016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:58.475094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:58.475101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:58.475102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:58.475103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:58.475105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:58.475106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:58.475107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:58.475109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:58.475110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:58.475111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:58.475112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:58.475114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:58.475115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:58.475123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:58.475137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:58.475142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:58.475146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:58.475151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:58.475155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:58.475160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:58.475164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:58.475169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:58.475174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:58.475179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:58.475183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:58.475188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:58.475198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:58.475206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:58.475213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:58.475225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:58.475230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:58.475239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:58.475243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:58.475249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:58.475258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:58.475267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:58.475276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:58.475281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:58.475286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:58.475291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:58.475296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:58.475301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:58.475305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:58.475310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:58.475314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:58.475319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:58.475325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:58.475330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:58.475335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:58.475340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:58.475346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:58.475351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:58.475388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:58.478207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:58.478831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:58.478848Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:58.478851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:58.478855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:58.478861Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2839 [2:7559602596702176345:8348]
2025-10-10T14:38:58.478876Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:58.478893Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:58.478897Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:58.478901Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:58.478903Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:58.478922Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:58.478936Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:58.478946Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:58.479367Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:58.479378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:58.479380Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:58.479384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:58.479458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:58.479466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:58.479480Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:58.479498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:58.479525Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:58.479549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602597484416202:6048], now have 1 active actors on pipe
2025-10-10T14:38:58.479558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602597484416031:2438], now have 1 active actors on pipe
2025-10-10T14:38:58.479567Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602596702176339:8348]
2025-10-10T14:38:58.479569Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602596702176339:8348]
2025-10-10T14:38:58.479572Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602596702176339:8348]
2025-10-10T14:38:58.479589Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:58.479602Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:58.479604Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:58.479606Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:58.479608Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:58.479621Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:58.479624Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:58.479616Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2839
2025-10-10T14:38:58.479616Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2839
2025-10-10T14:38:58.479657Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602596702176339:8348]
2025-10-10T14:38:58.479669Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:58.479676Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:58.479845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:58.479856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:58.479888Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4e05eab9-6b054ffc-69684b51-7b351131_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:58.479903Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:58.479911Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:58.479914Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:58.479927Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:58.479942Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:58.479965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:58.480231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:58.480245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:58.480270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:58.480407Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2840 partition: 0 MaxSeqNo: 40 sessionId: src_id|4e05eab9-6b054ffc-69684b51-7b351131_0
2025-10-10T14:38:58.480835Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|29cead61-39a02255-bc916719-f50a37c2_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|4e05eab9-6b054ffc-69684b51-7b351131_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:58.483910Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4e05eab9-6b054ffc-69684b51-7b351131_0] Write session: try to update token
2025-10-10T14:38:58.483933Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4e05eab9-6b054ffc-69684b51-7b351131_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:58.494648Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:38:58.494671Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:58.494684Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602596702176339:8348]
2025-10-10T14:38:58.494739Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:38:58.494757Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:38:58.494919Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:38:58.495056Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:58.495201Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:58.495350Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:58.495577Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:38:58.495628Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:38:58.503767Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2840 sessionId: src_id|4e05eab9-6b054ffc-69684b51-7b351131_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:58.506495Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:58.506741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:58.506768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:58.506824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:38:58.506910Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:38:58.510775Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:58.510790Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:58.510794Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:58.510796Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:58.510811Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602596702176339:8348]
2025-10-10T14:38:58.510815Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602596702176339:8348]
2025-10-10T14:38:58.510819Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602596702176339:8348]
2025-10-10T14:38:58.510866Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:58.510867Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:58.510874Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:58.510874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:58.510877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:58.510878Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:58.511018Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:58.550617Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602597484416216:6861]
2025-10-10T14:38:58.550935Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 pipe creation result: OK TabletId: 72075186224037892 Generation: 2839, pipe: [1:7559602597484416216:6861]
2025-10-10T14:38:58.628293Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:58.636943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:58.636976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:58.637165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:58.637240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:58.637310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:58.637400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:58.637454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:58.637465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:58.637612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:58.637684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:58.641241Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:58.641251Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:58.641254Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:58.641289Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2840 reason: error at write: Disconnected sessionId: src_id|4e05eab9-6b054ffc-69684b51-7b351131_0
2025-10-10T14:38:58.641301Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 38 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602597484416216:6861]
2025-10-10T14:38:58.637751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:58.637826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:58.637871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:58.637875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:58.637954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:58.638014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:58.638123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:58.638189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:58.638231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:58.638234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:58.638309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:58.638418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:58.638526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:58.638628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:58.638744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:58.638748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:58.638863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:58.638965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:58.639069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:58.639176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:58.639304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:58.639308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:58.639382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:58.639442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:58.639504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:58.639568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:58.639632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:58.639635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:58.639707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:58.639765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:58.641521Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2840 sessionId: src_id|4e05eab9-6b054ffc-69684b51-7b351131_0 is DEAD
2025-10-10T14:38:58.639830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:58.639900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:58.639963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:58.639966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:58.640041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:58.640099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:58.640159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:58.640222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:58.640350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:58.640353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:58.640422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:58.640482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:58.640547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:58.640609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:58.640653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:58.640656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:58.640732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:58.640788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:58.640843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:58.640909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:58.640954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:58.640957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:58.641035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602597484416216:6861], now have 1 active actors on pipe
2025-10-10T14:38:58.641851Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e05eab9-6b054ffc-69684b51-7b351131_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:58.641862Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e05eab9-6b054ffc-69684b51-7b351131_0] Write session will restart in 0.008500s
2025-10-10T14:38:58.641890Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e05eab9-6b054ffc-69684b51-7b351131_0] Write session: Do CDS request
2025-10-10T14:38:58.641898Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e05eab9-6b054ffc-69684b51-7b351131_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:58.642643Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:58.651934Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4e05eab9-6b054ffc-69684b51-7b351131_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:58.652065Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:58.652081Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2841
2025-10-10T14:38:58.652278Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2841 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:58.652325Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2841 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:58.652337Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2841 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:58.652342Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:58.652923Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2841 sessionId:  describe result for acl check
2025-10-10T14:38:58.652962Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:58.652967Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:58.652969Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:58.652975Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602597484416275:6026] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:58.653600Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602597484416275:6026] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:58.656623Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602597484416275:6026] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:58.660292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:58.660653Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602597484416275:6026] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:58.660668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602597484416275:6026] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:58.660672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602597484416275:6026] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:58.660682Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2841 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:58.664943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:58.665580Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:58.665595Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:58.665613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:58.665699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:58.665751Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602596702176539:8331]
2025-10-10T14:38:58.666361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:58.666911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:58.666998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:58.667342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:58.667402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:58.667403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:58.667404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:58.667405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:58.667407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:58.667409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:58.667410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:58.667411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:58.667413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:58.667414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:58.667415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:58.667416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:58.667417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:58.667424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:58.667436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:58.667440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:58.667444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:58.667448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:58.667451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:58.667455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:58.667458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:58.667462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:58.667466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:58.667470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:58.667473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:58.667476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:58.667484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:58.667493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:58.667499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:58.667504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:58.667508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:58.667512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:58.667517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:58.667522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:58.667526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:58.667531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:58.667535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:58.667540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:58.667544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:58.667549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:58.667553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:58.667558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:58.667564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:58.667568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:58.667572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:58.667577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:58.667582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:58.667587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:58.667591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:58.667596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:58.667601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:58.667605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:58.667643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:58.670612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:58.671467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:58.671483Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:58.671486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:58.671490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:58.671498Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2840 [2:7559602596702176539:8331]
2025-10-10T14:38:58.671512Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:58.671535Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:58.671544Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:58.671548Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:58.671551Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:58.671573Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:58.671586Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:58.671595Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:58.671663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:58.671672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:58.671674Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:58.671676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:58.671755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:58.671763Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:58.671779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:58.671794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:58.671816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:58.671845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602597484416230:2438], now have 1 active actors on pipe
2025-10-10T14:38:58.671854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602597484416402:6026], now have 1 active actors on pipe
2025-10-10T14:38:58.671863Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602596702176533:8331]
2025-10-10T14:38:58.671868Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602596702176533:8331]
2025-10-10T14:38:58.671870Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602596702176533:8331]
2025-10-10T14:38:58.671886Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:58.671904Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:58.671924Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:58.671928Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:58.671929Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:58.671931Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:58.671932Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:58.671971Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602596702176533:8331]
2025-10-10T14:38:58.671986Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:58.672028Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:58.672009Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2840
2025-10-10T14:38:58.672069Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2840
2025-10-10T14:38:58.672166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:58.672182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:58.672216Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|baae73c0-6677eb7c-cbc52ef1-bccf6a2b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:58.672235Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:58.672240Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:58.672242Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:58.672256Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:58.672269Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:58.672291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:58.672543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:58.672555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:58.672586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:58.672697Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2841 partition: 0 MaxSeqNo: 40 sessionId: src_id|baae73c0-6677eb7c-cbc52ef1-bccf6a2b_0
2025-10-10T14:38:58.673139Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e05eab9-6b054ffc-69684b51-7b351131_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|baae73c0-6677eb7c-cbc52ef1-bccf6a2b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:58.676142Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|baae73c0-6677eb7c-cbc52ef1-bccf6a2b_0] Write session: try to update token
2025-10-10T14:38:58.676164Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|baae73c0-6677eb7c-cbc52ef1-bccf6a2b_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:58.684326Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:38:58.684348Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:58.684363Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602596702176533:8331]
2025-10-10T14:38:58.684422Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:38:58.684424Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:38:58.684628Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:38:58.684792Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:58.684962Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:58.685112Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:58.685323Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:38:58.685395Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:38:58.693372Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2841 sessionId: src_id|baae73c0-6677eb7c-cbc52ef1-bccf6a2b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:58.696527Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:58.696734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:58.696761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:58.696817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:38:58.696922Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:38:58.703886Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:58.703905Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:58.703908Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:58.703911Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:58.703923Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602596702176533:8331]
2025-10-10T14:38:58.703926Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602596702176533:8331]
2025-10-10T14:38:58.703934Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602596702176533:8331]
2025-10-10T14:38:58.703986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:58.703994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:58.703996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:58.703995Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:58.704002Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:58.704007Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:58.704155Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:58.741472Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602597484416415:6861]
2025-10-10T14:38:58.743912Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 pipe creation result: OK TabletId: 72075186224037892 Generation: 2840, pipe: [1:7559602597484416415:6861]
2025-10-10T14:38:58.831374Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:58.840375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:58.840407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:58.840601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:58.840670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:58.840740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:58.840809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:58.841233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:58.841250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:58.841323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:58.841450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:58.841538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:58.841617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:58.841665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:58.841676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:58.841757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:58.841825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:58.841899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:58.841976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:58.842027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:58.842034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:58.842106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:58.842183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:58.842255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:58.842329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:58.842395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:58.842403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:58.842476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:58.842546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:58.842615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:58.842685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:58.842738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:58.842747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:58.842820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:58.842889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:58.842960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:58.843027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:58.843077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:58.843085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:58.843158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:58.843224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:58.843299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:58.843371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:58.843419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:58.843427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:58.843500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:58.843567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:58.843634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:58.843701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:58.843748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:58.843755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:58.843824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:58.843927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:58.843999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:58.844081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:58.844133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:58.844144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:58.844223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:58.844296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:58.844369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:58.844445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:58.844496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:58.844504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:58.844580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602597484416415:6861], now have 1 active actors on pipe
2025-10-10T14:38:58.844802Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:58.844810Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 39 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602597484416415:6861]
2025-10-10T14:38:58.844840Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:58.844843Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:58.844896Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2841 reason: error at write: Disconnected sessionId: src_id|baae73c0-6677eb7c-cbc52ef1-bccf6a2b_0
2025-10-10T14:38:58.845327Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|baae73c0-6677eb7c-cbc52ef1-bccf6a2b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:58.845360Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|baae73c0-6677eb7c-cbc52ef1-bccf6a2b_0] Write session will restart in 0.008747s
2025-10-10T14:38:58.845388Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|baae73c0-6677eb7c-cbc52ef1-bccf6a2b_0] Write session: Do CDS request
2025-10-10T14:38:58.845406Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|baae73c0-6677eb7c-cbc52ef1-bccf6a2b_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:58.845160Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2841 sessionId: src_id|baae73c0-6677eb7c-cbc52ef1-bccf6a2b_0 is DEAD
2025-10-10T14:38:58.845447Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:58.855929Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|baae73c0-6677eb7c-cbc52ef1-bccf6a2b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:58.856329Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:58.856359Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2842
2025-10-10T14:38:58.856532Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2842 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:58.856583Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2842 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:58.856589Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2842 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:58.856593Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:58.857131Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2842 sessionId:  describe result for acl check
2025-10-10T14:38:58.857162Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:58.857164Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:58.857166Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:58.857173Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602597484416476:6012] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:58.857845Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602597484416476:6012] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:58.862568Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602597484416476:6012] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:58.866235Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602597484416476:6012] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:58.866248Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602597484416476:6012] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:58.866252Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602597484416476:6012] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:58.866261Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2842 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:58.867891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:58.871967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:58.872228Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:58.872239Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:58.872253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:58.872313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:58.872361Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602596702176721:8325]
2025-10-10T14:38:58.873027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:58.873407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:58.873492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:58.873875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:58.873944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:58.873950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:58.873952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:58.873953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:58.873954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:58.873956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:58.873957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:58.873959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:58.873961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:58.873962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:58.873963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:58.873964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:58.873966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:58.873972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:58.873985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:58.873989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:58.873994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:58.873997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:58.874002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:58.874006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:58.874009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:58.874013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:58.874018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:58.874022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:58.874026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:58.874030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:58.874039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:58.874048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:58.874055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:58.874061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:58.874071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:58.874077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:58.874082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:58.874087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:58.874093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:58.874098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:58.874103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:58.874109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:58.874119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:58.874124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:58.874131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:58.874137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:58.874141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:58.874147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:58.874157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:58.874163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:58.874167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:58.874172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:58.874183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:58.874190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:58.874201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:58.874211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:58.874255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:58.878754Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2841
2025-10-10T14:38:58.878798Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2841
2025-10-10T14:38:58.880522Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2842 partition: 0 MaxSeqNo: 40 sessionId: src_id|858bec3b-28afc368-361b9c7c-92dc9bf7_0
2025-10-10T14:38:58.880997Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|baae73c0-6677eb7c-cbc52ef1-bccf6a2b_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|858bec3b-28afc368-361b9c7c-92dc9bf7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:58.876946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:58.877841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:58.877847Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:58.877850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:58.877855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:58.877864Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2841 [2:7559602596702176721:8325]
2025-10-10T14:38:58.877880Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:58.877898Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:58.877903Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:58.877907Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:58.877909Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:58.877928Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:58.877936Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:58.877944Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:58.878007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:58.878010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:58.878012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:58.878015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:58.878093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:58.878096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:58.878112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:58.878140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:58.878160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:58.878182Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602596702176716:8325]
2025-10-10T14:38:58.878184Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602596702176716:8325]
2025-10-10T14:38:58.878187Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602596702176716:8325]
2025-10-10T14:38:58.878197Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:58.878205Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:58.878208Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:58.878210Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:58.878212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602597484416423:2438], now have 1 active actors on pipe
2025-10-10T14:38:58.878219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602597484416594:6012], now have 1 active actors on pipe
2025-10-10T14:38:58.878225Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:58.878242Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:58.878246Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:58.878280Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602596702176716:8325]
2025-10-10T14:38:58.878290Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:58.878304Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:58.878864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:58.878872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:58.878920Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|858bec3b-28afc368-361b9c7c-92dc9bf7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:58.878931Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:58.878936Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:58.878939Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:58.878952Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:58.878978Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:58.878994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:58.880369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:58.880375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:58.880397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:58.884091Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|858bec3b-28afc368-361b9c7c-92dc9bf7_0] Write session: try to update token
2025-10-10T14:38:58.884110Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|858bec3b-28afc368-361b9c7c-92dc9bf7_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:58.902961Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:38:58.902991Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:58.903007Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602596702176716:8325]
2025-10-10T14:38:58.903083Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:38:58.903286Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:38:58.903339Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:38:58.903466Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:58.903631Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:58.903800Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:58.904006Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:38:58.904047Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:38:58.908998Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2842 sessionId: src_id|858bec3b-28afc368-361b9c7c-92dc9bf7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:58.911933Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:58.912581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:58.912607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:58.912673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:38:58.912766Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:38:58.922218Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:58.922240Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:58.922246Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:58.922250Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:58.922263Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602596702176716:8325]
2025-10-10T14:38:58.922271Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602596702176716:8325]
2025-10-10T14:38:58.922280Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602596702176716:8325]
2025-10-10T14:38:58.922335Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:58.922338Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:58.922348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:58.922351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:58.922352Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:58.922361Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:58.922561Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:58.945261Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602597484416611:6861]
2025-10-10T14:38:58.949697Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 pipe creation result: OK TabletId: 72075186224037892 Generation: 2841, pipe: [1:7559602597484416611:6861]
2025-10-10T14:38:59.047689Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:59.056884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:59.056920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:59.057113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:59.057186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:59.057259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:59.057356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:59.057411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:59.057417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:59.057508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:59.057637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:59.057712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:59.057781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:59.057835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:59.057843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:59.057919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:59.057981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:59.058049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:59.058162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:59.058213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:59.058221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:59.058293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:59.058363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:59.058440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:59.058514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:59.058569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:59.058578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:59.058655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:59.058722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:59.058787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:59.058854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:59.058907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:59.058915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:59.058986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:59.059053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:59.059120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:59.059189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:59.059332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:59.059346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:59.059419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:59.059480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:59.059546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:59.059612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:59.059671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:59.059675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:59.059746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:59.059806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:59.059868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:59.060144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:59.060188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:59.060190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:59.060459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:59.060518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:59.060580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:59.060843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:59.060893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:59.060896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:59.061158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:59.061218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:59.061283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:59.061677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:59.061742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:59.061751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:59.061809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602597484416611:6861], now have 1 active actors on pipe
2025-10-10T14:38:59.062433Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 40 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602597484416611:6861]
2025-10-10T14:38:59.062470Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:59.062507Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:59.062512Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:59.062541Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2842 reason: error at write: Disconnected sessionId: src_id|858bec3b-28afc368-361b9c7c-92dc9bf7_0
2025-10-10T14:38:59.063195Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:59.063358Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2842 sessionId: src_id|858bec3b-28afc368-361b9c7c-92dc9bf7_0 is DEAD
2025-10-10T14:38:59.063727Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|858bec3b-28afc368-361b9c7c-92dc9bf7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:59.063738Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|858bec3b-28afc368-361b9c7c-92dc9bf7_0] Write session will restart in 0.009874s
2025-10-10T14:38:59.063766Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|858bec3b-28afc368-361b9c7c-92dc9bf7_0] Write session: Do CDS request
2025-10-10T14:38:59.063771Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|858bec3b-28afc368-361b9c7c-92dc9bf7_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:59.075307Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|858bec3b-28afc368-361b9c7c-92dc9bf7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:59.075519Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:59.075534Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2843
2025-10-10T14:38:59.075708Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2843 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:59.075770Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2843 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:59.075781Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2843 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:59.075787Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:59.076330Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2843 sessionId:  describe result for acl check
2025-10-10T14:38:59.076379Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:59.076402Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:59.076404Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:59.076410Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602601779384004:5968] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:59.077010Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602601779384004:5968] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:59.080499Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602601779384004:5968] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:59.082836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:59.086094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:59.086322Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:59.086334Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:59.086346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:59.086400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:59.086443Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602600997144213:8290]
2025-10-10T14:38:59.087051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:59.087405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:59.087467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:59.087827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:59.087901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:59.087910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:59.087911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:59.087913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:59.087914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:59.087915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:59.087917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:59.087918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:59.087919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:59.087920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:59.087922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:59.087923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:59.087924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:59.087930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:59.087943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:59.087948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:59.087952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:59.087956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:59.087960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:59.087964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:59.087968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:59.087972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:59.087977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:59.087981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:59.087985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:59.087989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:59.087996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:59.088005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:59.088011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:59.088017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:59.088022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:59.088027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:59.088032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:59.088037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:59.088041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:59.088046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:59.088051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:59.088057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:59.088062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:59.088066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:59.088070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:59.088075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:59.088080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:59.088085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:59.088091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:59.088096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:59.088100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:59.088105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:59.088117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:59.088121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:59.088126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:59.088136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:59.088183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:59.086124Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602601779384004:5968] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:59.086140Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602601779384004:5968] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:59.086144Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602601779384004:5968] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:59.086154Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2843 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:59.090749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:59.091309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:59.091314Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:59.091316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:59.091320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:59.091325Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2842 [2:7559602600997144213:8290]
2025-10-10T14:38:59.091338Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:59.091355Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:59.091358Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:59.091360Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:59.091362Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:59.091375Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:59.091381Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:59.091387Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:59.091442Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:59.091443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:59.091444Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:59.091446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:59.091514Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:59.091517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:59.091528Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:59.091538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:59.091554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:59.091575Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602600997144208:8290]
2025-10-10T14:38:59.091578Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602600997144208:8290]
2025-10-10T14:38:59.091580Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602600997144208:8290]
2025-10-10T14:38:59.091593Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:59.091609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602601779383923:2438], now have 1 active actors on pipe
2025-10-10T14:38:59.091612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602601779384097:5968], now have 1 active actors on pipe
2025-10-10T14:38:59.091619Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:59.091620Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:59.091622Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:59.091624Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:59.091635Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:59.091639Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:59.091665Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602600997144208:8290]
2025-10-10T14:38:59.091673Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:59.091683Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:59.092113Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2842
2025-10-10T14:38:59.092149Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2842
2025-10-10T14:38:59.092279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:59.092291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:59.092323Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9a030fba-10ad8e3d-a3001e95-bb75c3be_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:59.092337Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:59.092345Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:59.092347Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:59.092360Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:59.092376Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:59.092395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:59.092623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:59.092631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:59.092648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:59.092760Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2843 partition: 0 MaxSeqNo: 40 sessionId: src_id|9a030fba-10ad8e3d-a3001e95-bb75c3be_0
2025-10-10T14:38:59.093208Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|858bec3b-28afc368-361b9c7c-92dc9bf7_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|9a030fba-10ad8e3d-a3001e95-bb75c3be_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:59.095995Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9a030fba-10ad8e3d-a3001e95-bb75c3be_0] Write session: try to update token
2025-10-10T14:38:59.096014Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9a030fba-10ad8e3d-a3001e95-bb75c3be_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:59.112407Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:59.112429Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:59.112432Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:59.112433Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:59.112446Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602600997144208:8290]
2025-10-10T14:38:59.112450Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602600997144208:8290]
2025-10-10T14:38:59.112452Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602600997144208:8290]
2025-10-10T14:38:59.112480Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:59.112486Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:59.112491Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:59.112496Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:59.112505Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:59.112508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:59.112666Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:59.113277Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2843 sessionId: src_id|9a030fba-10ad8e3d-a3001e95-bb75c3be_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:59.115944Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:59.162843Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602601779384120:6861]
2025-10-10T14:38:59.163176Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 pipe creation result: OK TabletId: 72075186224037892 Generation: 2842, pipe: [1:7559602601779384120:6861]
2025-10-10T14:38:59.230440Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:59.230727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:59.230743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:59.230791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602601779384120:6861], now have 1 active actors on pipe
2025-10-10T14:38:59.231092Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:59.231080Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:59.231087Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:59.231091Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:59.231135Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 41 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602601779384120:6861]
2025-10-10T14:38:59.231159Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2843 reason: error at write: Disconnected sessionId: src_id|9a030fba-10ad8e3d-a3001e95-bb75c3be_0
2025-10-10T14:38:59.231406Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2843 sessionId: src_id|9a030fba-10ad8e3d-a3001e95-bb75c3be_0 is DEAD
2025-10-10T14:38:59.232359Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a030fba-10ad8e3d-a3001e95-bb75c3be_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:59.232369Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a030fba-10ad8e3d-a3001e95-bb75c3be_0] Write session will restart in 0.005070s
2025-10-10T14:38:59.232394Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a030fba-10ad8e3d-a3001e95-bb75c3be_0] Write session: Do CDS request
2025-10-10T14:38:59.232418Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a030fba-10ad8e3d-a3001e95-bb75c3be_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:59.238926Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9a030fba-10ad8e3d-a3001e95-bb75c3be_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:59.239003Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:59.239015Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2844
2025-10-10T14:38:59.239158Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2844 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:59.239194Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2844 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:59.239199Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2844 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:59.239204Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:59.239672Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2844 sessionId:  describe result for acl check
2025-10-10T14:38:59.239708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:59.239714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:59.239716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:59.239722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602601779384138:5949] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:59.240276Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602601779384138:5949] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:59.243866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602601779384138:5949] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:59.247070Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602601779384138:5949] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:59.247085Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602601779384138:5949] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:59.247089Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602601779384138:5949] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:59.247098Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2844 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:59.247717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:59.251994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:59.252264Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:59.252276Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:59.252301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:59.252376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:59.252429Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602600997144425:8261]
2025-10-10T14:38:59.252956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:59.253364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:59.253436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:59.253828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:59.253897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:59.253903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:59.253904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:59.253905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:59.253907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:59.253909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:59.253910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:59.253911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:59.253912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:59.253913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:59.253915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:59.253916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:59.253917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:59.253923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:59.253938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:59.253942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:59.253945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:59.253949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:59.253953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:59.253957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:59.253961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:59.253965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:59.253969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:59.253974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:59.253978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:59.253982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:59.253993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:59.254003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:59.254012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:59.254017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:59.254022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:59.254028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:59.254032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:59.254038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:59.254044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:59.254050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:59.254055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:59.254060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:59.254065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:59.254071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:59.254076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:59.254081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:59.254093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:59.254098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:59.254103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:59.254113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:59.254118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:59.254123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:59.254132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:59.254138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:59.254145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:59.254156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:59.254198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:59.256959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:59.257830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:59.257845Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:59.257847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:59.257851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:59.257858Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2843 [2:7559602600997144425:8261]
2025-10-10T14:38:59.257874Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:59.257896Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:59.257900Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:59.257904Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:59.257906Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:59.257925Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:59.257934Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:59.257942Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:59.258019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:59.258028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:59.258030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:59.258032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:59.258109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:59.258116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:59.258128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:59.258139Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:59.258154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:59.258183Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602600997144420:8261]
2025-10-10T14:38:59.258190Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602600997144420:8261]
2025-10-10T14:38:59.258192Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602600997144420:8261]
2025-10-10T14:38:59.258208Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:59.258223Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:59.258231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602601779384296:5949], now have 1 active actors on pipe
2025-10-10T14:38:59.258233Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:59.258235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602601779384122:2438], now have 1 active actors on pipe
2025-10-10T14:38:59.258236Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:59.258241Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:59.258258Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:59.258267Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:59.258302Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602600997144420:8261]
2025-10-10T14:38:59.258315Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:59.258325Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:59.258428Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2843
2025-10-10T14:38:59.258482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:59.258496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:59.258528Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|88cc28bb-18a91d57-b1d9b22e-2d4f2db_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:59.258541Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:59.258550Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:59.258553Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:59.258551Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2843
2025-10-10T14:38:59.258567Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:59.258585Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:59.258608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:59.258757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:59.258765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:59.258780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:59.258882Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2844 partition: 0 MaxSeqNo: 40 sessionId: src_id|88cc28bb-18a91d57-b1d9b22e-2d4f2db_0
2025-10-10T14:38:59.259320Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a030fba-10ad8e3d-a3001e95-bb75c3be_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|88cc28bb-18a91d57-b1d9b22e-2d4f2db_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:59.262285Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|88cc28bb-18a91d57-b1d9b22e-2d4f2db_0] Write session: try to update token
2025-10-10T14:38:59.262310Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|88cc28bb-18a91d57-b1d9b22e-2d4f2db_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:59.276923Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:38:59.276950Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:59.276963Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602600997144420:8261]
2025-10-10T14:38:59.277017Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:38:59.277025Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:38:59.277222Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:38:59.277434Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:59.277626Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:59.277702Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2844 sessionId: src_id|88cc28bb-18a91d57-b1d9b22e-2d4f2db_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:59.277816Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:59.278054Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:38:59.278106Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:38:59.280476Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:59.280705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:59.280730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:59.280771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:38:59.280869Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:38:59.289972Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:59.289999Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:59.290005Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:59.290007Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:59.290018Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602600997144420:8261]
2025-10-10T14:38:59.290023Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602600997144420:8261]
2025-10-10T14:38:59.290028Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602600997144420:8261]
2025-10-10T14:38:59.290083Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:59.290091Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:59.290094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:59.290097Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:59.290097Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:59.290102Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:59.290239Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:59.331314Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602601779384309:6861]
2025-10-10T14:38:59.331631Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 pipe creation result: OK TabletId: 72075186224037892 Generation: 2843, pipe: [1:7559602601779384309:6861]
2025-10-10T14:38:59.412155Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:59.422631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:59.422663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:59.422848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:59.423112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:59.423186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:59.423261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:59.423726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:59.423742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:59.423982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:59.424048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:59.424157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:59.424241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:59.424294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:59.424311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:59.424391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:59.424457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:59.424525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:59.424642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:59.424778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:59.424788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:59.425049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:59.425313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:59.425501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:59.425614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:59.425666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:59.425675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:59.425751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:59.425820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:59.425891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:59.425955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:59.426014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:59.426028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:59.426099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:59.426159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:59.426224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:59.426290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:59.426354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:59.426357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:59.426431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:59.426493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:59.426602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:59.426667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:59.426726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:59.426729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:59.426802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:59.426877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:59.426944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:59.427002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:59.427054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:59.427057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:59.427124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:59.427181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:59.427248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:59.427316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:59.427372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:59.427374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:59.427439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:59.427493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:59.427556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:59.427613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:59.427663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:59.427665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:59.427742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602601779384309:6861], now have 1 active actors on pipe
2025-10-10T14:38:59.428726Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:59.428761Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:59.428769Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 42 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602601779384309:6861]
2025-10-10T14:38:59.428807Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:59.428809Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:59.429109Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2844 reason: error at write: Disconnected sessionId: src_id|88cc28bb-18a91d57-b1d9b22e-2d4f2db_0
2025-10-10T14:38:59.429342Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2844 sessionId: src_id|88cc28bb-18a91d57-b1d9b22e-2d4f2db_0 is DEAD
2025-10-10T14:38:59.429536Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88cc28bb-18a91d57-b1d9b22e-2d4f2db_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:59.429548Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88cc28bb-18a91d57-b1d9b22e-2d4f2db_0] Write session will restart in 0.005824s
2025-10-10T14:38:59.429580Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88cc28bb-18a91d57-b1d9b22e-2d4f2db_0] Write session: Do CDS request
2025-10-10T14:38:59.429587Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88cc28bb-18a91d57-b1d9b22e-2d4f2db_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:59.437018Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|88cc28bb-18a91d57-b1d9b22e-2d4f2db_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:59.437059Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:59.437076Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2845
2025-10-10T14:38:59.437220Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2845 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:59.437258Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2845 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:59.437265Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2845 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:59.437272Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:59.437741Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2845 sessionId:  describe result for acl check
2025-10-10T14:38:59.437779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:59.437784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:59.437785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:59.437792Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602601779384322:5945] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:59.438329Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602601779384322:5945] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:59.441884Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602601779384322:5945] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:59.446975Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602601779384322:5945] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:59.446994Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602601779384322:5945] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:59.446998Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602601779384322:5945] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:59.447008Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2845 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:59.457992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:59.463862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:59.464146Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:59.464158Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:59.464171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:59.464238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:59.464291Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602600997144610:8255]
2025-10-10T14:38:59.464919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:59.465391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:59.465482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:59.465863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:59.465938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:59.465946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:59.465948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:59.465949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:59.465950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:59.465952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:59.465953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:59.465954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:59.465956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:59.465957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:59.465959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:59.465960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:59.465961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:59.465968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:59.465982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:59.465987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:59.465991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:59.465996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:59.466000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:59.466004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:59.466009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:59.466013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:59.466018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:59.466023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:59.466027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:59.466032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:59.466040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:59.466050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:59.466057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:59.466062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:59.466067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:59.466079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:59.466084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:59.466089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:59.466098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:59.466103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:59.466108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:59.466113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:59.466120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:59.466126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:59.466135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:59.466141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:59.466146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:59.466153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:59.466158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:59.466166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:59.466171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:59.466181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:59.466185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:59.466191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:59.466201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:59.466206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:59.466248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:59.469185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:59.469945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:59.469963Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:59.469966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:59.469970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:59.469977Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2844 [2:7559602600997144610:8255]
2025-10-10T14:38:59.469992Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:59.470015Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:59.470024Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:59.470029Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:59.470031Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:59.470051Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:59.470067Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:59.470075Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:59.470432Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2844
2025-10-10T14:38:59.470469Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2844
2025-10-10T14:38:59.470142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:59.470153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:59.470154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:59.470157Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:59.470235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:59.470238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:59.470251Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:59.470265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:59.470285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:59.470309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602601779384391:5945], now have 1 active actors on pipe
2025-10-10T14:38:59.470313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602601779384312:2438], now have 1 active actors on pipe
2025-10-10T14:38:59.470321Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602600997144605:8255]
2025-10-10T14:38:59.470324Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602600997144605:8255]
2025-10-10T14:38:59.470326Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602600997144605:8255]
2025-10-10T14:38:59.470341Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:59.470354Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:59.470357Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:59.470358Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:59.470361Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:59.470374Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:59.470378Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:59.470419Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602600997144605:8255]
2025-10-10T14:38:59.470427Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:59.470436Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:59.470562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:59.470574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:59.470624Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f59041b3-a32978c0-e9cb546c-6bc01f2a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:59.470638Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:59.470643Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:59.470645Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:59.470658Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:59.470671Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:59.470692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:59.470857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:59.470871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:59.470894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:59.470984Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2845 partition: 0 MaxSeqNo: 40 sessionId: src_id|f59041b3-a32978c0-e9cb546c-6bc01f2a_0
2025-10-10T14:38:59.471393Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88cc28bb-18a91d57-b1d9b22e-2d4f2db_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|f59041b3-a32978c0-e9cb546c-6bc01f2a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:59.474320Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f59041b3-a32978c0-e9cb546c-6bc01f2a_0] Write session: try to update token
2025-10-10T14:38:59.474345Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f59041b3-a32978c0-e9cb546c-6bc01f2a_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:59.490150Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:59.490172Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:59.490175Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:59.490177Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:59.490188Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602600997144605:8255]
2025-10-10T14:38:59.490192Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602600997144605:8255]
2025-10-10T14:38:59.490197Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602600997144605:8255]
2025-10-10T14:38:59.490246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:59.490262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:59.490262Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:59.490265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:59.490270Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:59.490274Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:59.490401Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:59.491615Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2845 sessionId: src_id|f59041b3-a32978c0-e9cb546c-6bc01f2a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:59.494428Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:59.528933Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602601779384501:6861]
2025-10-10T14:38:59.529210Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 pipe creation result: OK TabletId: 72075186224037892 Generation: 2844, pipe: [1:7559602601779384501:6861]
2025-10-10T14:38:59.607599Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:59.608003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:59.608019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:59.608065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602601779384501:6861], now have 1 active actors on pipe
2025-10-10T14:38:59.608276Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:59.608287Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:59.608291Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:59.608296Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:59.608345Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 43 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602601779384501:6861]
2025-10-10T14:38:59.608360Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2845 reason: error at write: Disconnected sessionId: src_id|f59041b3-a32978c0-e9cb546c-6bc01f2a_0
2025-10-10T14:38:59.608582Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2845 sessionId: src_id|f59041b3-a32978c0-e9cb546c-6bc01f2a_0 is DEAD
2025-10-10T14:38:59.608713Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f59041b3-a32978c0-e9cb546c-6bc01f2a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:59.608721Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f59041b3-a32978c0-e9cb546c-6bc01f2a_0] Write session will restart in 0.005855s
2025-10-10T14:38:59.608747Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f59041b3-a32978c0-e9cb546c-6bc01f2a_0] Write session: Do CDS request
2025-10-10T14:38:59.608757Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f59041b3-a32978c0-e9cb546c-6bc01f2a_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:59.615974Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f59041b3-a32978c0-e9cb546c-6bc01f2a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:59.616050Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:59.616064Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2846
2025-10-10T14:38:59.616220Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2846 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:59.616260Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2846 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:59.616266Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2846 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:59.616271Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:59.616761Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2846 sessionId:  describe result for acl check
2025-10-10T14:38:59.616795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:59.616801Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:59.616804Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:59.616810Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602601779384518:5916] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:59.617374Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602601779384518:5916] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:59.620495Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602601779384518:5916] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:59.623781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602601779384518:5916] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:59.623796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602601779384518:5916] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:59.623800Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602601779384518:5916] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:59.623810Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2846 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:59.630021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:59.630537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:59.630898Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:59.630912Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:59.630927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:59.630999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:59.631041Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602600997144808:8236]
2025-10-10T14:38:59.631689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:59.631997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:59.632046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:59.632387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:59.632457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:59.632465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:59.632466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:59.632467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:59.632468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:59.632470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:59.632471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:59.632472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:59.632473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:59.632474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:59.632475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:59.632477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:59.632478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:59.632486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:59.632499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:59.632504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:59.632509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:59.632513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:59.632517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:59.632521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:59.632525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:59.632529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:59.632534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:59.632537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:59.632540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:59.632543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:59.632551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:59.632559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:59.632566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:59.632571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:59.632576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:59.632581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:59.632585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:59.632591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:59.632595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:59.632601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:59.632605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:59.632611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:59.632615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:59.632620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:59.632624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:59.632629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:59.632633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:59.632640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:59.632645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:59.632649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:59.632654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:59.632658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:59.632662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:59.632666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:59.632669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:59.632673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:59.632719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:59.635262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:59.635822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:59.635835Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:59.635838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:59.635843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:59.635850Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2845 [2:7559602600997144808:8236]
2025-10-10T14:38:59.635863Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:59.635882Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:59.635886Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:59.635889Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:59.635891Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:59.635909Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:59.635916Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:59.635936Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:59.636000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:59.636013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:59.636015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:59.636017Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:59.636087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:59.636095Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:59.636107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:59.636125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:59.636143Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:59.636170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602601779384678:5916], now have 1 active actors on pipe
2025-10-10T14:38:59.636181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602601779384503:2438], now have 1 active actors on pipe
2025-10-10T14:38:59.636189Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602600997144803:8236]
2025-10-10T14:38:59.636191Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602600997144803:8236]
2025-10-10T14:38:59.636193Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602600997144803:8236]
2025-10-10T14:38:59.636209Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:59.636222Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:59.636230Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:59.636234Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:59.636236Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:59.636242Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:59.636245Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:59.636271Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602600997144803:8236]
2025-10-10T14:38:59.636282Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:59.636284Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:59.636220Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2845
2025-10-10T14:38:59.636270Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2845
2025-10-10T14:38:59.636396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:59.636411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:59.636456Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a77dd0c8-f0a2cd72-e6f281e-bf7e93ff_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:59.636486Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:59.636495Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:59.636498Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:59.636511Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:59.636529Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:59.636550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:59.636733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:59.636746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:59.636768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:59.636863Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2846 partition: 0 MaxSeqNo: 40 sessionId: src_id|a77dd0c8-f0a2cd72-e6f281e-bf7e93ff_0
2025-10-10T14:38:59.637299Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f59041b3-a32978c0-e9cb546c-6bc01f2a_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|a77dd0c8-f0a2cd72-e6f281e-bf7e93ff_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:59.640164Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a77dd0c8-f0a2cd72-e6f281e-bf7e93ff_0] Write session: try to update token
2025-10-10T14:38:59.640183Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a77dd0c8-f0a2cd72-e6f281e-bf7e93ff_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:59.649090Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:38:59.649112Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:59.649124Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602600997144803:8236]
2025-10-10T14:38:59.649183Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:38:59.649202Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:38:59.649392Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:38:59.649558Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:59.649713Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:59.649864Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:59.650072Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:38:59.650118Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:38:59.655277Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2846 sessionId: src_id|a77dd0c8-f0a2cd72-e6f281e-bf7e93ff_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:59.657978Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:59.658233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:59.658260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:59.658305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:38:59.658388Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:38:59.667883Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:59.667904Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:59.667908Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:59.667910Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:59.667922Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602600997144803:8236]
2025-10-10T14:38:59.667926Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602600997144803:8236]
2025-10-10T14:38:59.667930Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602600997144803:8236]
2025-10-10T14:38:59.667979Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:59.667981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:59.667989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:59.667991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:59.667996Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:59.668000Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:59.668140Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:59.709411Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602601779384705:6861]
2025-10-10T14:38:59.721727Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 pipe creation result: OK TabletId: 72075186224037892 Generation: 2845, pipe: [1:7559602601779384705:6861]
2025-10-10T14:38:59.783859Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:59.792881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:59.792918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:59.793118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:59.793187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:59.793258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:59.793531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:59.793618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:59.793629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:59.793744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:59.793812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:59.793880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:59.793960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:59.794006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:59.794013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:59.794083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:59.794145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:59.794217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:59.794282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:59.794326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:59.794339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:59.794410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:59.794473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:59.794546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:59.794621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:59.797110Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 44 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602601779384705:6861]
2025-10-10T14:38:59.797111Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:59.797157Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:59.797160Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:59.797192Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2846 reason: error at write: Disconnected sessionId: src_id|a77dd0c8-f0a2cd72-e6f281e-bf7e93ff_0
2025-10-10T14:38:59.794674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:59.794687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:59.794760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:59.794843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:59.794906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:59.794971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:59.795017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:59.795025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:59.795121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:59.795182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:59.795249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:59.795319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:59.795385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:59.795391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:59.795464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:59.795531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:59.795604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:59.795673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:59.795739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:59.795764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:59.795841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:59.795905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:59.795976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:59.796042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:59.796089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:59.797592Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a77dd0c8-f0a2cd72-e6f281e-bf7e93ff_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:59.796092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:59.797604Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a77dd0c8-f0a2cd72-e6f281e-bf7e93ff_0] Write session will restart in 0.007943s
2025-10-10T14:38:59.796166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:59.796229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:59.796293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:59.796354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:59.796402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:59.796406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:59.796475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:59.796535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:59.796598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:59.797630Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a77dd0c8-f0a2cd72-e6f281e-bf7e93ff_0] Write session: Do CDS request
2025-10-10T14:38:59.796665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:59.796706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:59.796709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:59.797638Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a77dd0c8-f0a2cd72-e6f281e-bf7e93ff_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:59.796792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602601779384705:6861], now have 1 active actors on pipe
2025-10-10T14:38:59.797510Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2846 sessionId: src_id|a77dd0c8-f0a2cd72-e6f281e-bf7e93ff_0 is DEAD
2025-10-10T14:38:59.798366Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:59.806955Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a77dd0c8-f0a2cd72-e6f281e-bf7e93ff_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:59.807020Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:59.807034Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2847
2025-10-10T14:38:59.807208Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2847 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:59.807256Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2847 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:59.807262Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2847 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:59.807266Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:59.807783Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2847 sessionId:  describe result for acl check
2025-10-10T14:38:59.807832Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:59.807839Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:59.807841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:59.807848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602601779384741:5896] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:59.808429Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602601779384741:5896] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:59.811409Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602601779384741:5896] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:59.814331Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602601779384741:5896] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:59.814341Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602601779384741:5896] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:59.814345Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602601779384741:5896] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:59.814353Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2847 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:59.818810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:59.819373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:59.819584Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:59.819599Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:59.819611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:59.819667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:59.819732Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602600997144995:8247]
2025-10-10T14:38:59.820415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:59.820773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:59.820841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:59.821211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:59.821278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:59.821286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:59.821287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:59.821289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:59.821290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:59.821292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:59.821293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:59.821295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:59.821296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:59.821297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:59.821298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:59.821300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:59.821301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:59.821308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:59.821346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:59.821351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:59.821356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:59.821361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:59.821365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:59.821369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:59.821374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:59.821378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:59.821383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:59.821388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:59.821392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:59.821397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:59.821408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:59.821423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:59.821434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:59.821441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:59.821450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:59.821456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:59.821479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:59.821485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:59.821491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:59.821497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:59.821502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:59.821508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:59.821513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:59.821519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:59.821532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:59.821538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:59.821543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:59.821549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:59.821559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:59.821566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:59.821575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:59.821581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:59.821586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:59.821597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:59.821602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:59.821612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:59.821657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:59.824187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:59.824930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:59.824951Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:59.824954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:59.824959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:59.824965Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2846 [2:7559602600997144995:8247]
2025-10-10T14:38:59.824979Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:59.824998Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:59.825007Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:59.825011Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:59.825013Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:59.825033Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:59.825046Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:59.825054Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:59.825129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:59.825137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:59.825139Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:59.825142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:59.825212Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:59.825220Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:59.825232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:59.825249Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:59.825271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:59.825300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602601779384888:5896], now have 1 active actors on pipe
2025-10-10T14:38:59.825311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602601779384709:2438], now have 1 active actors on pipe
2025-10-10T14:38:59.825319Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602600997144990:8247]
2025-10-10T14:38:59.825322Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602600997144990:8247]
2025-10-10T14:38:59.825324Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602600997144990:8247]
2025-10-10T14:38:59.825383Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:59.825399Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:59.825409Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:59.825414Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:59.825417Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:59.825420Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:59.825431Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:59.825455Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602600997144990:8247]
2025-10-10T14:38:59.825459Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:59.825475Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:59.825495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:59.825500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:59.825555Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|543ede3-22de7d36-f9fde1cc-63a4fda9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:59.825569Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:59.825573Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:59.825575Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:59.825586Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:59.825597Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:59.825625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:59.825817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:59.825826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:59.825842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:59.826368Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a77dd0c8-f0a2cd72-e6f281e-bf7e93ff_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|543ede3-22de7d36-f9fde1cc-63a4fda9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:59.825389Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2846
2025-10-10T14:38:59.825389Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2846
2025-10-10T14:38:59.825967Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2847 partition: 0 MaxSeqNo: 40 sessionId: src_id|543ede3-22de7d36-f9fde1cc-63a4fda9_0
2025-10-10T14:38:59.829486Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|543ede3-22de7d36-f9fde1cc-63a4fda9_0] Write session: try to update token
2025-10-10T14:38:59.829504Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|543ede3-22de7d36-f9fde1cc-63a4fda9_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:59.846393Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:59.846420Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:59.846423Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:59.846425Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:59.846437Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602600997144990:8247]
2025-10-10T14:38:59.846443Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602600997144990:8247]
2025-10-10T14:38:59.846447Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602600997144990:8247]
2025-10-10T14:38:59.846500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:59.846507Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:59.846514Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:59.846518Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:59.846521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:59.846524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:59.846679Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:59.848158Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2847 sessionId: src_id|543ede3-22de7d36-f9fde1cc-63a4fda9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:59.850988Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:59.897067Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602601779384908:6861]
2025-10-10T14:38:59.897913Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 pipe creation result: OK TabletId: 72075186224037892 Generation: 2846, pipe: [1:7559602601779384908:6861]
2025-10-10T14:38:59.979688Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:59.980230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:59.980250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:59.980300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602601779384908:6861], now have 1 active actors on pipe
2025-10-10T14:38:59.980539Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:59.980606Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 45 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602601779384908:6861]
2025-10-10T14:38:59.980627Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:59.980635Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:59.980716Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2847 reason: error at write: Disconnected sessionId: src_id|543ede3-22de7d36-f9fde1cc-63a4fda9_0
2025-10-10T14:38:59.980740Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:59.980943Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2847 sessionId: src_id|543ede3-22de7d36-f9fde1cc-63a4fda9_0 is DEAD
2025-10-10T14:38:59.981104Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|543ede3-22de7d36-f9fde1cc-63a4fda9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:59.981113Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|543ede3-22de7d36-f9fde1cc-63a4fda9_0] Write session will restart in 0.007957s
2025-10-10T14:38:59.981140Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|543ede3-22de7d36-f9fde1cc-63a4fda9_0] Write session: Do CDS request
2025-10-10T14:38:59.981146Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|543ede3-22de7d36-f9fde1cc-63a4fda9_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:59.993878Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|543ede3-22de7d36-f9fde1cc-63a4fda9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:59.994517Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:59.994532Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2848
2025-10-10T14:38:59.997447Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2848 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:59.997512Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2848 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:59.997518Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2848 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:59.997524Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:59.998019Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2848 sessionId:  describe result for acl check
2025-10-10T14:38:59.998056Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:59.998058Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:59.998061Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:59.998067Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602601779384993:5866] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:59.998619Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602601779384993:5866] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:00.007383Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602601779384993:5866] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:00.009755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:00.009945Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602601779384993:5866] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:00.009961Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602601779384993:5866] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:00.009965Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602601779384993:5866] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:00.009985Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2848 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:00.015356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:00.015679Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:00.015696Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:00.015711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:00.015788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:00.015839Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602605292112480:8246]
2025-10-10T14:39:00.016502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:00.016914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:00.016968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:00.017367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:00.017442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:00.017449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:00.017450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:00.017452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:00.017453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:00.017455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:00.017456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:00.017458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:00.017471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:00.017472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:00.017473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:00.017475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:00.017476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:00.017483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:00.017498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:00.017502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:00.017507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:00.017511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:00.017515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:00.017518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:00.017523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:00.017527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:00.017532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:00.017536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:00.017540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:00.017544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:00.017552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:00.017561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:00.017569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:00.017574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:00.017580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:00.017585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:00.017590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:00.017595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:00.017603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:00.017616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:00.017621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:00.017626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:00.017631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:00.017637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:00.017655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:00.017662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:00.017667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:00.017673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:00.017677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:00.017683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:00.017687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:00.017693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:00.017698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:00.017703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:00.017708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:00.017714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:00.017755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:00.020631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:00.021259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:00.021272Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:00.021276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:00.021280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:00.021287Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2847 [2:7559602605292112480:8246]
2025-10-10T14:39:00.021301Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:00.021322Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:00.021347Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:00.021352Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:00.021354Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:00.021374Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:00.021382Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:00.021392Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:00.021479Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:00.021487Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:00.021489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:00.021492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:00.021566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:00.021573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:00.021585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:00.021602Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:00.021622Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:00.021651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602601779384912:2438], now have 1 active actors on pipe
2025-10-10T14:39:00.021660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602606074352384:5866], now have 1 active actors on pipe
2025-10-10T14:39:00.021670Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602605292112474:8246]
2025-10-10T14:39:00.021675Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602605292112474:8246]
2025-10-10T14:39:00.021677Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602605292112474:8246]
2025-10-10T14:39:00.021692Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:00.021708Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:00.021723Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:00.021727Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:00.021761Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602605292112474:8246]
2025-10-10T14:39:00.021772Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:00.021778Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:00.021781Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:00.021783Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:00.021790Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:00.022062Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2847
2025-10-10T14:39:00.022108Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2847
2025-10-10T14:39:00.022277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:00.022292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:00.022335Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|72b302fa-adf177bf-537f9fa5-693d1d76_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:00.022345Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:00.022350Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:00.022354Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:00.022367Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:00.022400Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:00.022416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:00.022675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:00.022702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:00.022720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:00.022821Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2848 partition: 0 MaxSeqNo: 40 sessionId: src_id|72b302fa-adf177bf-537f9fa5-693d1d76_0
2025-10-10T14:39:00.023813Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|543ede3-22de7d36-f9fde1cc-63a4fda9_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|72b302fa-adf177bf-537f9fa5-693d1d76_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:00.026733Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|72b302fa-adf177bf-537f9fa5-693d1d76_0] Write session: try to update token
2025-10-10T14:39:00.026758Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|72b302fa-adf177bf-537f9fa5-693d1d76_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:00.043673Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:00.043696Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:00.043699Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:00.043701Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:00.043712Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602605292112474:8246]
2025-10-10T14:39:00.043717Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602605292112474:8246]
2025-10-10T14:39:00.043725Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602605292112474:8246]
2025-10-10T14:39:00.043780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:00.043788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:00.043791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:00.043807Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2848 sessionId: src_id|72b302fa-adf177bf-537f9fa5-693d1d76_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:00.043937Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:00.043967Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:00.043984Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:00.043989Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:00.046736Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:00.080855Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602606074352397:6861]
2025-10-10T14:39:00.081174Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 pipe creation result: OK TabletId: 72075186224037892 Generation: 2847, pipe: [1:7559602606074352397:6861]
2025-10-10T14:39:00.134478Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:155: [72075186224037893][rt3.dc1--test-topic] TPersQueueReadBalancer::HandleWakeup
2025-10-10T14:39:00.134503Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 16
2025-10-10T14:39:00.168603Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:00.169235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:00.169246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:00.169293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602606074352397:6861], now have 1 active actors on pipe
2025-10-10T14:39:00.169863Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 46 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602606074352397:6861]
2025-10-10T14:39:00.169887Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:00.169899Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 16
2025-10-10T14:39:00.169927Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:00.169947Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:00.169690Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:00.170025Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2848 reason: error at write: Disconnected sessionId: src_id|72b302fa-adf177bf-537f9fa5-693d1d76_0
2025-10-10T14:39:00.170240Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2848 sessionId: src_id|72b302fa-adf177bf-537f9fa5-693d1d76_0 is DEAD
2025-10-10T14:39:00.170500Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72b302fa-adf177bf-537f9fa5-693d1d76_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:00.170510Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72b302fa-adf177bf-537f9fa5-693d1d76_0] Write session will restart in 0.008486s
2025-10-10T14:39:00.170535Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72b302fa-adf177bf-537f9fa5-693d1d76_0] Write session: Do CDS request
2025-10-10T14:39:00.170541Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72b302fa-adf177bf-537f9fa5-693d1d76_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:00.179949Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|72b302fa-adf177bf-537f9fa5-693d1d76_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:00.180011Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:00.180027Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2849
2025-10-10T14:39:00.180195Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2849 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:00.180232Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2849 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:00.180239Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2849 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:00.180244Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:00.180730Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2849 sessionId:  describe result for acl check
2025-10-10T14:39:00.180765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:00.180767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:00.180769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:00.180776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602606074352495:5823] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:00.181414Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602606074352495:5823] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:00.184504Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602606074352495:5823] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:00.186302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:00.190170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:00.190419Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602606074352495:5823] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:00.190444Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602606074352495:5823] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:00.190448Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602606074352495:5823] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:00.190457Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2849 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:00.190407Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:00.190420Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:00.190433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:00.190494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:00.190548Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602605292112707:8211]
2025-10-10T14:39:00.191190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:00.191529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:00.191582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:00.191911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:00.191982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:00.191989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:00.191991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:00.191992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:00.191993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:00.191995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:00.191996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:00.191998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:00.191999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:00.192000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:00.192002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:00.192003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:00.192004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:00.192010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:00.192023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:00.192028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:00.192032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:00.192037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:00.192041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:00.192045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:00.192049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:00.192053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:00.192057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:00.192061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:00.192065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:00.192069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:00.192077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:00.192086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:00.192092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:00.192098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:00.192103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:00.192108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:00.192115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:00.192121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:00.192136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:00.192140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:00.192145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:00.192151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:00.192155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:00.192161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:00.192165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:00.192171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:00.192176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:00.192181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:00.192188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:00.192200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:00.192205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:00.192210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:00.192215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:00.192221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:00.192231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:00.192240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:00.192282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:00.195042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:00.195443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:00.195458Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:00.195461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:00.195465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:00.195472Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2848 [2:7559602605292112707:8211]
2025-10-10T14:39:00.195488Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:00.195509Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:00.195513Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:00.195517Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:00.195520Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:00.195539Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:00.195553Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:00.195563Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:00.195635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:00.195642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:00.195645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:00.195647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:00.195716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:00.195725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:00.195738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:00.195751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:00.195769Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:00.195792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602606074352608:5823], now have 1 active actors on pipe
2025-10-10T14:39:00.195801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602606074352422:2438], now have 1 active actors on pipe
2025-10-10T14:39:00.195809Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602605292112702:8211]
2025-10-10T14:39:00.195811Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602605292112702:8211]
2025-10-10T14:39:00.195813Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602605292112702:8211]
2025-10-10T14:39:00.195826Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:00.195845Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:00.195852Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:00.195855Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:00.195858Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:00.195846Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2848
2025-10-10T14:39:00.195857Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2848
2025-10-10T14:39:00.195866Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:00.195875Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:00.195905Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602605292112702:8211]
2025-10-10T14:39:00.195912Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:00.195915Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:00.195935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:00.195944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:00.196007Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2bb01d30-5fa4d09b-9f6dd14e-5f8b489b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:00.196020Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:00.196025Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:00.196028Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:00.196039Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:00.196055Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:00.196124Z node 2 :PERSQUEUE DEBUG: partition.cpp:1000: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 80296142 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-10-10T14:39:00.196159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:00.196302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:00.196310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:00.196328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:00.196438Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2849 partition: 0 MaxSeqNo: 40 sessionId: src_id|2bb01d30-5fa4d09b-9f6dd14e-5f8b489b_0
2025-10-10T14:39:00.196534Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 9 Generation: 1 StatsReportRound: 20 DataSize: 80296142 UsedReserveSize: 0
2025-10-10T14:39:00.196584Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-10-10T14:39:00.196854Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72b302fa-adf177bf-537f9fa5-693d1d76_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|2bb01d30-5fa4d09b-9f6dd14e-5f8b489b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:00.199773Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2bb01d30-5fa4d09b-9f6dd14e-5f8b489b_0] Write session: try to update token
2025-10-10T14:39:00.199791Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2bb01d30-5fa4d09b-9f6dd14e-5f8b489b_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:00.215991Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2849 sessionId: src_id|2bb01d30-5fa4d09b-9f6dd14e-5f8b489b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:00.218399Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:00.218428Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:00.218432Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:00.218434Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:00.218447Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602605292112702:8211]
2025-10-10T14:39:00.218451Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602605292112702:8211]
2025-10-10T14:39:00.218456Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602605292112702:8211]
2025-10-10T14:39:00.218839Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:00.218512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:00.218515Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:00.218522Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:00.218525Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:00.218531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:00.218534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:00.218700Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:00.269900Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602606074352622:6861]
2025-10-10T14:39:00.270260Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 pipe creation result: OK TabletId: 72075186224037892 Generation: 2848, pipe: [1:7559602606074352622:6861]
2025-10-10T14:39:00.341251Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:00.341650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:00.341669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:00.341717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602606074352622:6861], now have 1 active actors on pipe
2025-10-10T14:39:00.341972Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:00.341952Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:00.341963Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 47 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602606074352622:6861]
2025-10-10T14:39:00.341965Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:00.341986Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:00.342028Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2849 reason: error at write: Disconnected sessionId: src_id|2bb01d30-5fa4d09b-9f6dd14e-5f8b489b_0
2025-10-10T14:39:00.342246Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2849 sessionId: src_id|2bb01d30-5fa4d09b-9f6dd14e-5f8b489b_0 is DEAD
2025-10-10T14:39:00.342436Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2bb01d30-5fa4d09b-9f6dd14e-5f8b489b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:00.342444Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2bb01d30-5fa4d09b-9f6dd14e-5f8b489b_0] Write session will restart in 0.008134s
2025-10-10T14:39:00.342481Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2bb01d30-5fa4d09b-9f6dd14e-5f8b489b_0] Write session: Do CDS request
2025-10-10T14:39:00.342491Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2bb01d30-5fa4d09b-9f6dd14e-5f8b489b_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:00.351975Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2bb01d30-5fa4d09b-9f6dd14e-5f8b489b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:00.352054Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:00.352069Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2850
2025-10-10T14:39:00.352232Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2850 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:00.352277Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2850 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:00.352288Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2850 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:00.352297Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:00.352778Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2850 sessionId:  describe result for acl check
2025-10-10T14:39:00.352819Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:00.352826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:00.352828Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:00.352836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602606074352684:5811] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:00.353553Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602606074352684:5811] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:00.357259Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602606074352684:5811] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:00.358668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:00.362325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:00.362571Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:00.362583Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:00.362596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:00.362609Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602606074352684:5811] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:00.362626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602606074352684:5811] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:00.362630Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602606074352684:5811] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:00.362653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:00.362639Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2850 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:00.362698Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602605292112900:8214]
2025-10-10T14:39:00.363349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:00.363639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:00.363691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:00.364041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:00.364102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:00.364108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:00.364110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:00.364111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:00.364113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:00.364114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:00.364115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:00.364117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:00.364118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:00.364119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:00.364121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:00.364122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:00.364123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:00.364129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:00.364143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:00.364148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:00.364152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:00.364156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:00.364160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:00.364165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:00.364169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:00.364173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:00.364177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:00.364181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:00.364185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:00.364190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:00.364197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:00.364206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:00.364212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:00.364218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:00.364223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:00.364228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:00.364235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:00.364240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:00.364245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:00.364251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:00.364255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:00.364261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:00.364266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:00.364278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:00.364283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:00.364293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:00.364298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:00.364303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:00.364313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:00.364319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:00.364328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:00.364333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:00.364338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:00.364347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:00.364352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:00.364357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:00.364399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:00.366900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:00.367679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:00.367697Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:00.367699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:00.367704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:00.367710Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2849 [2:7559602605292112900:8214]
2025-10-10T14:39:00.367724Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:00.367744Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:00.367752Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:00.367756Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:00.367763Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:00.367780Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:00.367792Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:00.367799Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:00.367862Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:00.367870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:00.367872Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:00.367874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:00.367939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:00.367946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:00.367959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:00.367972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:00.367993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:00.368019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602606074352810:5811], now have 1 active actors on pipe
2025-10-10T14:39:00.368023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602606074352628:2438], now have 1 active actors on pipe
2025-10-10T14:39:00.368030Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602605292112895:8214]
2025-10-10T14:39:00.368032Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602605292112895:8214]
2025-10-10T14:39:00.368034Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602605292112895:8214]
2025-10-10T14:39:00.368048Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:00.368061Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:00.368062Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:00.368065Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:00.368067Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:00.368077Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:00.368080Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:00.368108Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602605292112895:8214]
2025-10-10T14:39:00.368126Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:00.368137Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:00.368101Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2849
2025-10-10T14:39:00.368110Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2849
2025-10-10T14:39:00.368167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:00.368177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:00.368216Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6633de74-b09c606f-f74fa0c8-46318086_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:00.368230Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:00.368235Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:00.368237Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:00.368249Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:00.368261Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:00.368280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:00.368495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:00.368507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:00.368526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:00.368617Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2850 partition: 0 MaxSeqNo: 40 sessionId: src_id|6633de74-b09c606f-f74fa0c8-46318086_0
2025-10-10T14:39:00.369030Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2bb01d30-5fa4d09b-9f6dd14e-5f8b489b_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|6633de74-b09c606f-f74fa0c8-46318086_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:00.371969Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6633de74-b09c606f-f74fa0c8-46318086_0] Write session: try to update token
2025-10-10T14:39:00.371989Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6633de74-b09c606f-f74fa0c8-46318086_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:00.387893Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2850 sessionId: src_id|6633de74-b09c606f-f74fa0c8-46318086_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:00.388267Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:00.388291Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:00.388294Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:00.388297Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:00.388307Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602605292112895:8214]
2025-10-10T14:39:00.388311Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602605292112895:8214]
2025-10-10T14:39:00.388315Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602605292112895:8214]
2025-10-10T14:39:00.388365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:00.388372Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:00.388378Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:00.388382Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:00.388384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:00.388386Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:00.388529Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:00.390578Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:00.442339Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602606074352821:6861]
2025-10-10T14:39:00.442697Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 pipe creation result: OK TabletId: 72075186224037892 Generation: 2849, pipe: [1:7559602606074352821:6861]
2025-10-10T14:39:00.512014Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:00.513064Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 48 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602606074352821:6861]
2025-10-10T14:39:00.513075Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:00.513079Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:00.513109Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:00.513155Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2850 reason: error at write: Disconnected sessionId: src_id|6633de74-b09c606f-f74fa0c8-46318086_0
2025-10-10T14:39:00.513383Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2850 sessionId: src_id|6633de74-b09c606f-f74fa0c8-46318086_0 is DEAD
2025-10-10T14:39:00.513561Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6633de74-b09c606f-f74fa0c8-46318086_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:00.513573Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6633de74-b09c606f-f74fa0c8-46318086_0] Write session will restart in 0.009327s
2025-10-10T14:39:00.513600Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6633de74-b09c606f-f74fa0c8-46318086_0] Write session: Do CDS request
2025-10-10T14:39:00.513606Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6633de74-b09c606f-f74fa0c8-46318086_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:00.512597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:00.512617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:00.512663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602606074352821:6861], now have 1 active actors on pipe
2025-10-10T14:39:00.513156Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:00.523905Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6633de74-b09c606f-f74fa0c8-46318086_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:00.524022Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:00.524038Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2851
2025-10-10T14:39:00.524150Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2851 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:00.524183Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2851 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:00.524188Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2851 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:00.524192Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:00.524713Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2851 sessionId:  describe result for acl check
2025-10-10T14:39:00.524766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:00.524773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:00.524775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:00.524782Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602606074352877:5796] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:00.525370Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602606074352877:5796] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:00.528618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602606074352877:5796] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:00.531747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602606074352877:5796] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:00.531759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602606074352877:5796] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:00.531763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602606074352877:5796] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:00.531773Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2851 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:00.535862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:00.536643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:00.536897Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:00.536912Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:00.536926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:00.537005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:00.537060Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602605292113104:8202]
2025-10-10T14:39:00.537736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:00.538127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:00.538193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:00.538529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:00.538624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:00.538633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:00.538635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:00.538636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:00.538637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:00.538639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:00.538640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:00.538642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:00.538643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:00.538645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:00.538646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:00.538647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:00.538649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:00.538656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:00.538669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:00.538674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:00.538678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:00.538683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:00.538687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:00.538691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:00.538695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:00.538700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:00.538704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:00.538708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:00.538711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:00.538715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:00.538727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:00.538737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:00.538744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:00.538751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:00.538756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:00.538761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:00.538766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:00.538772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:00.538776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:00.538782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:00.538794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:00.538800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:00.538804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:00.538809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:00.538813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:00.538818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:00.538833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:00.538838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:00.538842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:00.538849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:00.538853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:00.538858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:00.538863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:00.538868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:00.538878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:00.538884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:00.538926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:00.541959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:00.542563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:00.542575Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:00.542577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:00.542580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:00.542587Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2850 [2:7559602605292113104:8202]
2025-10-10T14:39:00.542598Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:00.542615Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:00.542620Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:00.542622Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:00.542624Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:00.542638Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:00.542644Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:00.542650Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:00.542719Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:00.542727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:00.542730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:00.542732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:00.542804Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:00.542813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:00.542822Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:00.542828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:00.542839Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:00.542862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602606074352823:2438], now have 1 active actors on pipe
2025-10-10T14:39:00.542866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602606074353006:5796], now have 1 active actors on pipe
2025-10-10T14:39:00.542873Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602605292113099:8202]
2025-10-10T14:39:00.542876Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602605292113099:8202]
2025-10-10T14:39:00.542878Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602605292113099:8202]
2025-10-10T14:39:00.542892Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:00.542906Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:00.542917Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:00.542919Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:00.542943Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602605292113099:8202]
2025-10-10T14:39:00.542951Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:00.542954Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:00.542954Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:00.542956Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:00.542962Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:00.542976Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2850
2025-10-10T14:39:00.542976Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2850
2025-10-10T14:39:00.543079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:00.543088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:00.543121Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cfc27f9c-17c876a-2f591a52-638033ee_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:00.543133Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:00.543142Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:00.543145Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:00.543157Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:00.543173Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:00.543190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:00.543379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:00.543386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:00.543402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:00.543584Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2851 partition: 0 MaxSeqNo: 40 sessionId: src_id|cfc27f9c-17c876a-2f591a52-638033ee_0
2025-10-10T14:39:00.544073Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6633de74-b09c606f-f74fa0c8-46318086_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|cfc27f9c-17c876a-2f591a52-638033ee_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:00.546851Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfc27f9c-17c876a-2f591a52-638033ee_0] Write session: try to update token
2025-10-10T14:39:00.546870Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfc27f9c-17c876a-2f591a52-638033ee_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:00.564802Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2851 sessionId: src_id|cfc27f9c-17c876a-2f591a52-638033ee_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:00.567990Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:00.564931Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:00.564953Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:00.564957Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:00.564959Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:00.564970Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602605292113099:8202]
2025-10-10T14:39:00.564975Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602605292113099:8202]
2025-10-10T14:39:00.564979Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602605292113099:8202]
2025-10-10T14:39:00.565036Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:00.565055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:00.565057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:00.565232Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:00.565248Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:00.565257Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:00.565261Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:00.613420Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602606074353018:6861]
2025-10-10T14:39:00.613746Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 pipe creation result: OK TabletId: 72075186224037892 Generation: 2850, pipe: [1:7559602606074353018:6861]
2025-10-10T14:39:00.682419Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:00.682772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:00.682791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:00.682840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602606074353018:6861], now have 1 active actors on pipe
2025-10-10T14:39:00.683087Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:00.685362Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:00.685390Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:39:00.685426Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 49 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602606074353018:6861]
2025-10-10T14:39:00.685483Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2851 reason: status is not ok: tablet will be restarted right now sessionId: src_id|cfc27f9c-17c876a-2f591a52-638033ee_0
2025-10-10T14:39:00.685697Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2851 sessionId: src_id|cfc27f9c-17c876a-2f591a52-638033ee_0 is DEAD
2025-10-10T14:39:00.685889Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cfc27f9c-17c876a-2f591a52-638033ee_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:39:00.685901Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cfc27f9c-17c876a-2f591a52-638033ee_0] Write session will restart in 0.008513s
2025-10-10T14:39:00.685928Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cfc27f9c-17c876a-2f591a52-638033ee_0] Write session: Do CDS request
2025-10-10T14:39:00.685935Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cfc27f9c-17c876a-2f591a52-638033ee_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:00.695933Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfc27f9c-17c876a-2f591a52-638033ee_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:00.696023Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:00.696038Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2852
2025-10-10T14:39:00.696201Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2852 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:00.696241Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2852 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:00.696265Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2852 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:00.696274Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:00.696765Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2852 sessionId:  describe result for acl check
2025-10-10T14:39:00.696805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:00.696814Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:00.696816Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:00.696822Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602606074353107:5781] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:00.697414Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602606074353107:5781] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:00.701106Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602606074353107:5781] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:00.703969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:00.707816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:00.707921Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602606074353107:5781] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:00.707937Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602606074353107:5781] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:00.707941Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602606074353107:5781] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:00.707951Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2852 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:00.708217Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:00.708232Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:00.708245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:00.708315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:00.708371Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602605292113296:8184]
2025-10-10T14:39:00.709007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:00.709364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:00.709412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:00.709785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:00.709847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:00.709857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:00.709859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:00.709860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:00.709862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:00.709863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:00.709864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:00.709865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:00.709867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:00.709868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:00.709869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:00.709870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:00.709872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:00.709878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:00.709893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:00.709898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:00.709903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:00.709908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:00.709912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:00.709917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:00.709921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:00.709925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:00.709931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:00.709935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:00.709940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:00.709944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:00.709954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:00.709963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:00.709970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:00.709976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:00.709981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:00.709993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:00.709997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:00.710003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:00.710014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:00.710020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:00.710029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:00.710035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:00.710045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:00.710051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:00.710060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:00.710066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:00.710071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:00.710082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:00.710087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:00.710094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:00.710104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:00.710110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:00.710130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:00.710137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:00.710146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:00.710152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:00.710200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:00.712819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:00.713386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:00.713400Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:00.713402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:00.713406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:00.713413Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2851 [2:7559602605292113296:8184]
2025-10-10T14:39:00.713426Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:00.713443Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:00.713469Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:00.713477Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:00.713480Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:00.713497Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:00.713510Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:00.713518Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:00.713578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:00.713584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:00.713588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:00.713591Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:00.713660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:00.713667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:00.713679Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:00.713693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:00.713717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:00.713744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602606074353215:5781], now have 1 active actors on pipe
2025-10-10T14:39:00.713753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602606074353034:2438], now have 1 active actors on pipe
2025-10-10T14:39:00.713761Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602605292113290:8184]
2025-10-10T14:39:00.713763Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602605292113290:8184]
2025-10-10T14:39:00.713765Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602605292113290:8184]
2025-10-10T14:39:00.713780Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:00.713794Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:00.713810Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:00.713815Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:00.713819Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:00.713820Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:00.713825Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:00.713844Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602605292113290:8184]
2025-10-10T14:39:00.713811Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2851
2025-10-10T14:39:00.713848Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:00.713816Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2851
2025-10-10T14:39:00.713850Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:00.713885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:00.713895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:00.713937Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9bcb7c14-ddca5b46-8c3c02-62c90464_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:00.713950Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:00.713953Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:00.713956Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:00.713966Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:00.713976Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:00.713989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:00.714131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:00.714141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:00.714157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:00.714244Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2852 partition: 0 MaxSeqNo: 40 sessionId: src_id|9bcb7c14-ddca5b46-8c3c02-62c90464_0
2025-10-10T14:39:00.714668Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cfc27f9c-17c876a-2f591a52-638033ee_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|9bcb7c14-ddca5b46-8c3c02-62c90464_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:00.717404Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9bcb7c14-ddca5b46-8c3c02-62c90464_0] Write session: try to update token
2025-10-10T14:39:00.717425Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9bcb7c14-ddca5b46-8c3c02-62c90464_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:00.732899Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2852 sessionId: src_id|9bcb7c14-ddca5b46-8c3c02-62c90464_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:00.733742Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:00.733763Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:00.733767Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:00.733769Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:00.733780Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602605292113290:8184]
2025-10-10T14:39:00.733785Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602605292113290:8184]
2025-10-10T14:39:00.733789Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602605292113290:8184]
2025-10-10T14:39:00.733845Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:00.733853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:00.733851Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:00.733856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:00.733860Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:00.733867Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:00.734004Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:00.735711Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:00.785371Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602606074353226:6861]
2025-10-10T14:39:00.785734Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 pipe creation result: OK TabletId: 72075186224037892 Generation: 2851, pipe: [1:7559602606074353226:6861]
2025-10-10T14:39:00.850608Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:00.851223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:00.851234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:00.851285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602606074353226:6861], now have 1 active actors on pipe
2025-10-10T14:39:00.851655Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:00.851525Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 50 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602606074353226:6861]
2025-10-10T14:39:00.852126Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9bcb7c14-ddca5b46-8c3c02-62c90464_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:00.852157Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9bcb7c14-ddca5b46-8c3c02-62c90464_0] Write session will restart in 0.009799s
2025-10-10T14:39:00.851563Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:00.851566Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:00.851644Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2852 reason: error at write: Disconnected sessionId: src_id|9bcb7c14-ddca5b46-8c3c02-62c90464_0
2025-10-10T14:39:00.851860Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:00.852183Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9bcb7c14-ddca5b46-8c3c02-62c90464_0] Write session: Do CDS request
2025-10-10T14:39:00.852189Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9bcb7c14-ddca5b46-8c3c02-62c90464_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:00.851911Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2852 sessionId: src_id|9bcb7c14-ddca5b46-8c3c02-62c90464_0 is DEAD
2025-10-10T14:39:00.863020Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9bcb7c14-ddca5b46-8c3c02-62c90464_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:00.863138Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:00.863156Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2853
2025-10-10T14:39:00.863318Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2853 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:00.863349Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2853 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:00.863355Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2853 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:00.863360Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:00.863860Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2853 sessionId:  describe result for acl check
2025-10-10T14:39:00.863894Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:00.863896Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:00.863898Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:00.863904Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602606074353306:5745] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:00.864522Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602606074353306:5745] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:00.867218Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602606074353306:5745] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:00.873826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602606074353306:5745] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:00.873843Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602606074353306:5745] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:00.873847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602606074353306:5745] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:00.873857Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2853 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:00.874266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:00.874978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:00.875200Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:00.875212Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:00.875225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:00.875292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:00.875336Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602605292113489:8196]
2025-10-10T14:39:00.875976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:00.876312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:00.876364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:00.876704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:00.876771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:00.876781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:00.876783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:00.876784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:00.876785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:00.876787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:00.876788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:00.876789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:00.876790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:00.876791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:00.876792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:00.876794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:00.876795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:00.876801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:00.876814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:00.876818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:00.876822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:00.876826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:00.876831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:00.876835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:00.876839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:00.876842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:00.876849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:00.876853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:00.876857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:00.876862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:00.876870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:00.876879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:00.876887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:00.876893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:00.876899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:00.876906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:00.876910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:00.876916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:00.876921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:00.876926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:00.876931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:00.876944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:00.876949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:00.876954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:00.876957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:00.876962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:00.876967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:00.876972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:00.876976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:00.876981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:00.876988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:00.876994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:00.876999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:00.877005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:00.877011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:00.877016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:00.877058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:00.879621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:00.880370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:00.880388Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:00.880391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:00.880395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:00.880402Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2852 [2:7559602605292113489:8196]
2025-10-10T14:39:00.880417Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:00.880437Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:00.880446Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:00.880449Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:00.880451Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:00.880470Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:00.880483Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:00.880499Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:00.880579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:00.880586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:00.880589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:00.880592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:00.880664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:00.880673Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:00.880685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:00.880699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:00.880720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:00.880748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602606074353233:2438], now have 1 active actors on pipe
2025-10-10T14:39:00.880756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602606074353420:5745], now have 1 active actors on pipe
2025-10-10T14:39:00.880764Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602605292113483:8196]
2025-10-10T14:39:00.880771Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602605292113483:8196]
2025-10-10T14:39:00.880773Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602605292113483:8196]
2025-10-10T14:39:00.880788Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:00.880807Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:00.880830Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:00.880841Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:00.880860Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:00.880871Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:00.880876Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602605292113483:8196]
2025-10-10T14:39:00.880880Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:00.880882Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:00.880846Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2852
2025-10-10T14:39:00.880890Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:00.880857Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2852
2025-10-10T14:39:00.880928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:00.880934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:00.880964Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|61bbeb5b-2a13317-98530103-f89c6647_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:00.880973Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:00.880985Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:00.880988Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:00.881002Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:00.881018Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:00.881036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:00.881233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:00.881244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:00.881269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:00.881396Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2853 partition: 0 MaxSeqNo: 40 sessionId: src_id|61bbeb5b-2a13317-98530103-f89c6647_0
2025-10-10T14:39:00.885456Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9bcb7c14-ddca5b46-8c3c02-62c90464_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|61bbeb5b-2a13317-98530103-f89c6647_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:00.888197Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61bbeb5b-2a13317-98530103-f89c6647_0] Write session: try to update token
2025-10-10T14:39:00.888220Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61bbeb5b-2a13317-98530103-f89c6647_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:00.901533Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:39:00.901555Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:00.901567Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602605292113483:8196]
2025-10-10T14:39:00.901622Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:39:00.901624Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:39:00.901819Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:39:00.901977Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:00.902129Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:00.902286Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:00.902511Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:39:00.902560Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:39:00.903286Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2853 sessionId: src_id|61bbeb5b-2a13317-98530103-f89c6647_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:00.906078Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:00.906283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:00.906304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:00.906342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:39:00.906449Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:39:00.920328Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:00.920353Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:00.920356Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:00.920358Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:00.920369Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602605292113483:8196]
2025-10-10T14:39:00.920372Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602605292113483:8196]
2025-10-10T14:39:00.920375Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602605292113483:8196]
2025-10-10T14:39:00.920427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:00.920433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:00.920435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:00.920435Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:00.920441Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:00.920446Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:00.920584Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:00.953680Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602606074353432:6861]
2025-10-10T14:39:00.954200Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 pipe creation result: OK TabletId: 72075186224037892 Generation: 2852, pipe: [1:7559602606074353432:6861]
2025-10-10T14:39:01.046866Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:01.055579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:01.055613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:01.055793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:01.055865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:01.055939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:01.056008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:01.056059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:01.056069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:01.056142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:01.056210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:01.056279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:01.056357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:01.056404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:01.056413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:01.056484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:01.056553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:01.056624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:01.056695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:01.056745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:01.056757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:01.056824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:01.056890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:01.056956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:01.057024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:01.057068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:01.057076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:01.057146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:01.057210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:01.057273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:01.057362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:01.057411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:01.057419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:01.057505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:01.057571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:01.057640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:01.057706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:01.057757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:01.057761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:01.057828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:01.057885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:01.057958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:01.058024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:01.058070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:01.058079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:01.058148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:01.058209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:01.058271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:01.058343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:01.058388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:01.058395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:01.058461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:01.058524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:01.058637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:01.058699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:01.058743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:01.058751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:01.058819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:01.058881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:01.058944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:01.059012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:01.059354Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:01.059429Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:01.059444Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:01.059491Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2853 reason: error at write: Disconnected sessionId: src_id|61bbeb5b-2a13317-98530103-f89c6647_0
2025-10-10T14:39:01.059588Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 51 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602606074353432:6861]
2025-10-10T14:39:01.059685Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2853 sessionId: src_id|61bbeb5b-2a13317-98530103-f89c6647_0 is DEAD
2025-10-10T14:39:01.059840Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61bbeb5b-2a13317-98530103-f89c6647_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:01.059848Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61bbeb5b-2a13317-98530103-f89c6647_0] Write session will restart in 0.008118s
2025-10-10T14:39:01.059873Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61bbeb5b-2a13317-98530103-f89c6647_0] Write session: Do CDS request
2025-10-10T14:39:01.059881Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61bbeb5b-2a13317-98530103-f89c6647_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:01.059063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:01.059075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:01.059143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602606074353432:6861], now have 1 active actors on pipe
2025-10-10T14:39:01.060416Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:01.068993Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61bbeb5b-2a13317-98530103-f89c6647_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:01.069092Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:01.069109Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2854
2025-10-10T14:39:01.069265Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2854 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:01.069319Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2854 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:01.069344Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2854 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:01.069348Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:01.069836Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2854 sessionId:  describe result for acl check
2025-10-10T14:39:01.069872Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:01.069874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:01.069876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:01.069883Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602610369320746:5734] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:01.070475Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602610369320746:5734] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:01.073514Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602610369320746:5734] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:01.078292Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602610369320746:5734] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:01.078307Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602610369320746:5734] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:01.078311Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602610369320746:5734] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:01.078321Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2854 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:01.080265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:01.084435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:01.084705Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:01.084723Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:01.084736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:01.084804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:01.084857Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602609587080980:8195]
2025-10-10T14:39:01.085530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:01.085959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:01.086028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:01.086378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:01.086465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:01.086474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:01.086476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:01.086477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:01.086479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:01.086480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:01.086482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:01.086483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:01.086485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:01.086486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:01.086487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:01.086488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:01.086490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:01.086497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:01.086513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:01.086518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:01.086522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:01.086526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:01.086531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:01.086535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:01.086539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:01.086543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:01.086547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:01.086552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:01.086556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:01.086561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:01.086570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:01.086587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:01.086599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:01.086605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:01.086611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:01.086617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:01.086622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:01.086627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:01.086638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:01.086644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:01.086653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:01.086659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:01.086669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:01.086675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:01.086680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:01.086686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:01.086692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:01.086698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:01.086709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:01.086715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:01.086720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:01.086726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:01.086735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:01.086742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:01.086751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:01.086757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:01.086802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:01.089363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:01.090194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:01.090213Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:01.090216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:01.090220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:01.090227Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2853 [2:7559602609587080980:8195]
2025-10-10T14:39:01.090241Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:01.090262Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:01.090266Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:01.090269Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:01.090272Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:01.090292Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:01.090307Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:01.090315Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:01.090382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:01.090389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:01.090391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:01.090394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:01.090468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:01.090477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:01.090489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:01.090502Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:01.090519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:01.090543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602610369320913:5734], now have 1 active actors on pipe
2025-10-10T14:39:01.090552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602610369320731:2438], now have 1 active actors on pipe
2025-10-10T14:39:01.090560Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602609587080975:8195]
2025-10-10T14:39:01.090566Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602609587080975:8195]
2025-10-10T14:39:01.090568Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602609587080975:8195]
2025-10-10T14:39:01.090583Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:01.090605Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:01.090608Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:01.090611Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:01.090613Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:01.090625Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:01.090628Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:01.090661Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602609587080975:8195]
2025-10-10T14:39:01.090674Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:01.090679Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:01.090638Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2853
2025-10-10T14:39:01.090641Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2853
2025-10-10T14:39:01.090698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:01.090707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:01.090762Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|be23dc5d-393899fc-395ad3b7-7276ea34_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:01.090774Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:01.090779Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:01.090781Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:01.090792Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:01.090806Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:01.090830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:01.091062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:01.091071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:01.091088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:01.091165Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2854 partition: 0 MaxSeqNo: 40 sessionId: src_id|be23dc5d-393899fc-395ad3b7-7276ea34_0
2025-10-10T14:39:01.091603Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61bbeb5b-2a13317-98530103-f89c6647_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|be23dc5d-393899fc-395ad3b7-7276ea34_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:01.094392Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|be23dc5d-393899fc-395ad3b7-7276ea34_0] Write session: try to update token
2025-10-10T14:39:01.094413Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|be23dc5d-393899fc-395ad3b7-7276ea34_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:01.108800Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2854 sessionId: src_id|be23dc5d-393899fc-395ad3b7-7276ea34_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:01.110099Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:01.110131Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:01.110135Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:01.110136Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:01.110150Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602609587080975:8195]
2025-10-10T14:39:01.110154Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602609587080975:8195]
2025-10-10T14:39:01.110157Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602609587080975:8195]
2025-10-10T14:39:01.110210Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:01.110217Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:01.110224Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:01.110224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:01.110227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:01.110228Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:01.110369Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:01.111536Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:01.159647Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602610369320929:6861]
2025-10-10T14:39:01.159976Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 pipe creation result: OK TabletId: 72075186224037892 Generation: 2853, pipe: [1:7559602610369320929:6861]
2025-10-10T14:39:01.227579Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:01.228215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:01.228232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:01.228277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602610369320929:6861], now have 1 active actors on pipe
2025-10-10T14:39:01.228451Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:01.228495Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:01.228514Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 52 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602610369320929:6861]
2025-10-10T14:39:01.228519Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:01.228537Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:01.228603Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2854 reason: error at write: Disconnected sessionId: src_id|be23dc5d-393899fc-395ad3b7-7276ea34_0
2025-10-10T14:39:01.228841Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2854 sessionId: src_id|be23dc5d-393899fc-395ad3b7-7276ea34_0 is DEAD
2025-10-10T14:39:01.229010Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be23dc5d-393899fc-395ad3b7-7276ea34_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:01.229018Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be23dc5d-393899fc-395ad3b7-7276ea34_0] Write session will restart in 0.006079s
2025-10-10T14:39:01.229045Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be23dc5d-393899fc-395ad3b7-7276ea34_0] Write session: Do CDS request
2025-10-10T14:39:01.229054Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be23dc5d-393899fc-395ad3b7-7276ea34_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:01.236983Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|be23dc5d-393899fc-395ad3b7-7276ea34_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:01.240227Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:01.240242Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2855
2025-10-10T14:39:01.240460Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2855 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:01.240510Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2855 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:01.240521Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2855 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:01.240525Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:01.241033Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2855 sessionId:  describe result for acl check
2025-10-10T14:39:01.241067Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:01.241069Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:01.241070Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:01.241076Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602610369321040:5687] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:01.241724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602610369321040:5687] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:01.244691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602610369321040:5687] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:01.246796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:01.251071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:01.251186Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602610369321040:5687] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:01.251205Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602610369321040:5687] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:01.251208Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602610369321040:5687] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:01.251217Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2855 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:01.251355Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:01.251371Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:01.251386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:01.251466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:01.251519Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602609587081213:8157]
2025-10-10T14:39:01.252133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:01.252490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:01.252540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:01.252857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:01.253282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:01.253294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:01.253295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:01.253297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:01.253298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:01.253300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:01.253301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:01.253302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:01.253303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:01.253304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:01.253306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:01.253307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:01.253309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:01.253318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:01.253345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:01.253350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:01.253354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:01.253357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:01.253361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:01.253365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:01.253369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:01.253373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:01.253377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:01.253381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:01.253385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:01.253388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:01.253399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:01.253409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:01.253418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:01.253423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:01.253427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:01.253433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:01.253454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:01.253459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:01.253463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:01.253469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:01.253475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:01.253479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:01.253487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:01.253500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:01.253505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:01.253516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:01.253521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:01.253526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:01.253536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:01.253541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:01.253545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:01.253555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:01.253559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:01.253563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:01.253567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:01.253572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:01.253612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:01.256297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:01.256635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:01.256649Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:01.256652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:01.256656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:01.256664Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2854 [2:7559602609587081213:8157]
2025-10-10T14:39:01.256678Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:01.256698Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:01.256705Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:01.256709Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:01.256712Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:01.256730Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:01.256743Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:01.256756Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:01.256824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:01.256833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:01.256835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:01.256838Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:01.256908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:01.256916Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:01.256929Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:01.256945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:01.256970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:01.257000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602610369320957:2438], now have 1 active actors on pipe
2025-10-10T14:39:01.257009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602610369321141:5687], now have 1 active actors on pipe
2025-10-10T14:39:01.257017Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602609587081208:8157]
2025-10-10T14:39:01.257023Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602609587081208:8157]
2025-10-10T14:39:01.257025Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602609587081208:8157]
2025-10-10T14:39:01.257041Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:01.257057Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:01.257076Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:01.257081Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:01.257085Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:01.257089Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:01.257091Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:01.257109Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602609587081208:8157]
2025-10-10T14:39:01.257118Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:01.257075Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2854
2025-10-10T14:39:01.257127Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:01.257083Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2854
2025-10-10T14:39:01.257153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:01.257163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:01.257204Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e40c7ca-e902aa35-d15ebd27-f7e9b93_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:01.257217Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:01.257222Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:01.257224Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:01.257235Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:01.257247Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:01.257265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:01.257422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:01.257454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:01.257480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:01.257601Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2855 partition: 0 MaxSeqNo: 40 sessionId: src_id|e40c7ca-e902aa35-d15ebd27-f7e9b93_0
2025-10-10T14:39:01.258023Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be23dc5d-393899fc-395ad3b7-7276ea34_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|e40c7ca-e902aa35-d15ebd27-f7e9b93_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:01.260829Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e40c7ca-e902aa35-d15ebd27-f7e9b93_0] Write session: try to update token
2025-10-10T14:39:01.260849Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e40c7ca-e902aa35-d15ebd27-f7e9b93_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:01.275373Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2855 sessionId: src_id|e40c7ca-e902aa35-d15ebd27-f7e9b93_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:01.277325Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:01.277376Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:01.277380Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:01.277382Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:01.277397Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602609587081208:8157]
2025-10-10T14:39:01.277402Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602609587081208:8157]
2025-10-10T14:39:01.277406Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602609587081208:8157]
2025-10-10T14:39:01.277475Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:01.277477Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:01.277488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:01.277490Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:01.277493Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:01.277498Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:01.277641Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:01.278658Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:01.328604Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602610369321154:6861]
2025-10-10T14:39:01.328923Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 pipe creation result: OK TabletId: 72075186224037892 Generation: 2854, pipe: [1:7559602610369321154:6861]
2025-10-10T14:39:01.392103Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:01.392607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:01.392624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:01.392673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602610369321154:6861], now have 1 active actors on pipe
2025-10-10T14:39:01.392935Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:01.392950Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:01.392949Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:01.392995Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 53 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602610369321154:6861]
2025-10-10T14:39:01.392941Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:01.393074Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2855 reason: error at write: Disconnected sessionId: src_id|e40c7ca-e902aa35-d15ebd27-f7e9b93_0
2025-10-10T14:39:01.393279Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2855 sessionId: src_id|e40c7ca-e902aa35-d15ebd27-f7e9b93_0 is DEAD
2025-10-10T14:39:01.393474Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e40c7ca-e902aa35-d15ebd27-f7e9b93_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:01.393482Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e40c7ca-e902aa35-d15ebd27-f7e9b93_0] Write session will restart in 0.009288s
2025-10-10T14:39:01.393503Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e40c7ca-e902aa35-d15ebd27-f7e9b93_0] Write session: Do CDS request
2025-10-10T14:39:01.393511Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e40c7ca-e902aa35-d15ebd27-f7e9b93_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:01.403929Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e40c7ca-e902aa35-d15ebd27-f7e9b93_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:01.404021Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:01.404036Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2856
2025-10-10T14:39:01.404204Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2856 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:01.404242Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2856 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:01.404254Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2856 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:01.404258Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:01.404761Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2856 sessionId:  describe result for acl check
2025-10-10T14:39:01.404801Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:01.404810Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:01.404812Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:01.404819Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602610369321213:5645] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:01.405416Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602610369321213:5645] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:01.407985Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602610369321213:5645] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:01.411438Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602610369321213:5645] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:01.411451Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602610369321213:5645] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:01.411468Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602610369321213:5645] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:01.411478Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2856 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:01.413457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:01.417714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:01.418154Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:01.418168Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:01.418182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:01.418256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:01.418300Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602609587081409:8167]
2025-10-10T14:39:01.418944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:01.419377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:01.419443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:01.419785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:01.419859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:01.419865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:01.419867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:01.419868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:01.419869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:01.419870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:01.419872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:01.419873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:01.419875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:01.419876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:01.419878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:01.419879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:01.419881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:01.419887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:01.419899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:01.419904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:01.419908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:01.419913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:01.419917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:01.419921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:01.419926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:01.419930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:01.419934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:01.419937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:01.419941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:01.419944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:01.419953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:01.419961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:01.419967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:01.419973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:01.419978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:01.419984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:01.419989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:01.419994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:01.420005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:01.420010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:01.420017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:01.420023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:01.420032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:01.420037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:01.420045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:01.420053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:01.420057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:01.420062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:01.420066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:01.420074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:01.420079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:01.420084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:01.420092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:01.420097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:01.420103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:01.420110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:01.420154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:01.422687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:01.423018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:01.423031Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:01.423034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:01.423039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:01.423046Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2855 [2:7559602609587081409:8167]
2025-10-10T14:39:01.423059Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:01.423078Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:01.423082Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:01.423085Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:01.423088Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:01.423106Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:01.423114Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:01.423128Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:01.423184Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:01.423191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:01.423193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:01.423195Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:01.423280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:01.423289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:01.423301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:01.423313Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:01.423330Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:01.423355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602610369321169:2438], now have 1 active actors on pipe
2025-10-10T14:39:01.423364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602610369321354:5645], now have 1 active actors on pipe
2025-10-10T14:39:01.423372Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602609587081404:8167]
2025-10-10T14:39:01.423374Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602609587081404:8167]
2025-10-10T14:39:01.423376Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602609587081404:8167]
2025-10-10T14:39:01.423393Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:01.423408Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:01.423428Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:01.423430Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:01.423431Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:01.423433Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:01.423434Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:01.423458Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602609587081404:8167]
2025-10-10T14:39:01.423461Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:01.423467Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:01.423425Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2855
2025-10-10T14:39:01.423429Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2855
2025-10-10T14:39:01.423498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:01.423512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:01.423551Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|84917c30-5d0c98f3-39a9a02b-6c5bebda_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:01.423564Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:01.423568Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:01.423571Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:01.423582Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:01.423596Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:01.423620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:01.423775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:01.423784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:01.423799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:01.423884Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2856 partition: 0 MaxSeqNo: 40 sessionId: src_id|84917c30-5d0c98f3-39a9a02b-6c5bebda_0
2025-10-10T14:39:01.424292Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e40c7ca-e902aa35-d15ebd27-f7e9b93_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|84917c30-5d0c98f3-39a9a02b-6c5bebda_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:01.427185Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|84917c30-5d0c98f3-39a9a02b-6c5bebda_0] Write session: try to update token
2025-10-10T14:39:01.427206Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|84917c30-5d0c98f3-39a9a02b-6c5bebda_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:01.443664Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:01.443693Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:01.443697Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:01.443700Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:01.443711Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602609587081404:8167]
2025-10-10T14:39:01.443719Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602609587081404:8167]
2025-10-10T14:39:01.443724Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602609587081404:8167]
2025-10-10T14:39:01.443783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:01.443792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:01.443794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:01.443793Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:01.443800Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:01.443805Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:01.443971Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:01.446691Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2856 sessionId: src_id|84917c30-5d0c98f3-39a9a02b-6c5bebda_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:01.449857Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:01.492939Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602610369321369:6861]
2025-10-10T14:39:01.493232Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 pipe creation result: OK TabletId: 72075186224037892 Generation: 2855, pipe: [1:7559602610369321369:6861]
2025-10-10T14:39:01.563984Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:01.564535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:01.564559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:01.564614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602610369321369:6861], now have 1 active actors on pipe
2025-10-10T14:39:01.564911Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:01.564904Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:01.564918Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:01.564982Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2856 reason: error at write: Disconnected sessionId: src_id|84917c30-5d0c98f3-39a9a02b-6c5bebda_0
2025-10-10T14:39:01.564985Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 54 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602610369321369:6861]
2025-10-10T14:39:01.565004Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:01.565186Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2856 sessionId: src_id|84917c30-5d0c98f3-39a9a02b-6c5bebda_0 is DEAD
2025-10-10T14:39:01.565555Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84917c30-5d0c98f3-39a9a02b-6c5bebda_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:01.565567Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84917c30-5d0c98f3-39a9a02b-6c5bebda_0] Write session will restart in 0.006214s
2025-10-10T14:39:01.565595Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84917c30-5d0c98f3-39a9a02b-6c5bebda_0] Write session: Do CDS request
2025-10-10T14:39:01.565605Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84917c30-5d0c98f3-39a9a02b-6c5bebda_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:01.573029Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|84917c30-5d0c98f3-39a9a02b-6c5bebda_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:01.573619Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:01.573637Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2857
2025-10-10T14:39:01.573936Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2857 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:01.573985Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2857 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:01.573992Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2857 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:01.573996Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:01.574530Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2857 sessionId:  describe result for acl check
2025-10-10T14:39:01.574568Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:01.574576Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:01.574579Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:01.574585Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602610369321386:5621] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:01.575174Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602610369321386:5621] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:01.581215Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602610369321386:5621] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:01.585174Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602610369321386:5621] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:01.585189Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602610369321386:5621] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:01.585193Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602610369321386:5621] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:01.585202Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2857 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:01.592664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:01.593368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:01.593609Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:01.593624Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:01.593639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:01.593708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:01.593755Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602609587081617:8163]
2025-10-10T14:39:01.594427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:01.594782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:01.594833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:01.595171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:01.595240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:01.595247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:01.595248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:01.595249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:01.595251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:01.595252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:01.595253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:01.595254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:01.595256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:01.595257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:01.595258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:01.595259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:01.595261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:01.595267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:01.595279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:01.595283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:01.595288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:01.595291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:01.595295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:01.595300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:01.595304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:01.595308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:01.595312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:01.595316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:01.595320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:01.595324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:01.595332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:01.595341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:01.595350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:01.595356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:01.595361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:01.595367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:01.595372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:01.595378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:01.595383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:01.595394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:01.595399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:01.595404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:01.595409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:01.595414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:01.595419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:01.595424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:01.595431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:01.595441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:01.595445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:01.595451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:01.595459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:01.595465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:01.595469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:01.595474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:01.595483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:01.595489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:01.595530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:01.598480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:01.598811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:01.598828Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:01.598830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:01.598834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:01.598841Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2856 [2:7559602609587081617:8163]
2025-10-10T14:39:01.598855Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:01.598873Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:01.598882Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:01.598886Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:01.598888Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:01.598905Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:01.598916Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:01.598925Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:01.598984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:01.598992Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:01.598994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:01.598997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:01.599068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:01.599079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:01.599090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:01.599102Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:01.599119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:01.599141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602610369321543:5621], now have 1 active actors on pipe
2025-10-10T14:39:01.599145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602610369321370:2438], now have 1 active actors on pipe
2025-10-10T14:39:01.599153Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602609587081612:8163]
2025-10-10T14:39:01.599156Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602609587081612:8163]
2025-10-10T14:39:01.599158Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602609587081612:8163]
2025-10-10T14:39:01.599177Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:01.599191Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:01.599195Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:01.599202Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:01.599204Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:01.599207Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:01.599210Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:01.599235Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602609587081612:8163]
2025-10-10T14:39:01.599242Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:01.599246Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:01.599376Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2856
2025-10-10T14:39:01.599405Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2856
2025-10-10T14:39:01.599458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:01.599469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:01.599504Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fa743803-68022e1c-594e76ce-d22e2c79_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:01.599517Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:01.599522Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:01.599524Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:01.599536Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:01.599548Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:01.599568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:01.599734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:01.599743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:01.599758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:01.599849Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2857 partition: 0 MaxSeqNo: 40 sessionId: src_id|fa743803-68022e1c-594e76ce-d22e2c79_0
2025-10-10T14:39:01.600267Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84917c30-5d0c98f3-39a9a02b-6c5bebda_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|fa743803-68022e1c-594e76ce-d22e2c79_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:01.603067Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fa743803-68022e1c-594e76ce-d22e2c79_0] Write session: try to update token
2025-10-10T14:39:01.603086Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fa743803-68022e1c-594e76ce-d22e2c79_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:01.610842Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:39:01.610864Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:01.610878Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602609587081612:8163]
2025-10-10T14:39:01.610929Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:39:01.610969Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:39:01.611101Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:39:01.611247Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:01.611385Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:01.611531Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:01.611729Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:39:01.611776Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:39:01.617484Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2857 sessionId: src_id|fa743803-68022e1c-594e76ce-d22e2c79_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:01.620217Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:01.620769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:01.620795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:01.620942Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:39:01.620840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:39:01.629617Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:01.629639Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:01.629642Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:01.629645Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:01.629661Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602609587081612:8163]
2025-10-10T14:39:01.629665Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602609587081612:8163]
2025-10-10T14:39:01.629669Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602609587081612:8163]
2025-10-10T14:39:01.629724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:01.629723Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:01.629731Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:01.629732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:01.629734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:01.629736Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:01.629882Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:01.665000Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602610369321584:6861]
2025-10-10T14:39:01.665352Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 pipe creation result: OK TabletId: 72075186224037892 Generation: 2856, pipe: [1:7559602610369321584:6861]
2025-10-10T14:39:01.746543Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:01.755643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:01.755679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:01.755875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:01.755947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:01.756021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:01.756094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:01.756146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:01.756156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:01.756236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:01.756304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:01.756370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:01.756441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:01.756492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:01.756499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:01.756574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:01.756643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:01.756714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:01.756784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:01.756828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:01.756836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:01.756910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:01.756985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:01.757054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:01.757122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:01.757170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:01.757178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:01.757247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:01.757311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:01.757398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:01.757525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:01.757589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:01.757596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:01.757664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:01.757728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:01.757795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:01.757864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:01.757933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:01.757937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:01.758006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:01.758069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:01.759549Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:01.759590Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:01.759595Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:01.759621Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 55 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602610369321584:6861]
2025-10-10T14:39:01.759629Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2857 reason: error at write: Disconnected sessionId: src_id|fa743803-68022e1c-594e76ce-d22e2c79_0
2025-10-10T14:39:01.759893Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2857 sessionId: src_id|fa743803-68022e1c-594e76ce-d22e2c79_0 is DEAD
2025-10-10T14:39:01.759998Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa743803-68022e1c-594e76ce-d22e2c79_0] Counters: { Errors: 0 CurrentSessionLifetimeMs: 159 BytesWritten: 90112070 MessagesWritten: 40 BytesWrittenCompressed: 0 BytesInflightUncompressed: 22528020 BytesInflightCompressed: 0 BytesInflightTotal: 20275218 MessagesInflight: 10 }
2025-10-10T14:39:01.760051Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa743803-68022e1c-594e76ce-d22e2c79_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:01.760056Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa743803-68022e1c-594e76ce-d22e2c79_0] Write session will restart in 0.009242s
2025-10-10T14:39:01.760082Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa743803-68022e1c-594e76ce-d22e2c79_0] Write session: Do CDS request
2025-10-10T14:39:01.760088Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa743803-68022e1c-594e76ce-d22e2c79_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:01.758140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:01.758218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:01.758261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:01.758266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:01.758335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:01.758398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:01.758458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:01.758520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:01.758570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:01.758573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:01.758648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:01.758708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:01.758768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:01.758830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:01.758872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:01.758875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:01.758950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:01.759010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:01.759075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:01.759142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:01.759190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:01.759193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:01.759262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602610369321584:6861], now have 1 active actors on pipe
2025-10-10T14:39:01.760725Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:01.770932Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fa743803-68022e1c-594e76ce-d22e2c79_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:01.771067Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:01.771084Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2858
2025-10-10T14:39:01.773615Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2858 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:01.773668Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2858 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:01.773679Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2858 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:01.773685Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:01.774220Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2858 sessionId:  describe result for acl check
2025-10-10T14:39:01.774257Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:01.774261Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:01.774263Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:01.774270Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602610369321636:5615] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:01.774879Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602610369321636:5615] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:01.778123Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602610369321636:5615] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:01.787028Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602610369321636:5615] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:01.787045Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602610369321636:5615] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:01.787050Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602610369321636:5615] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:01.787060Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2858 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:01.787023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:01.791969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:01.792350Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:01.792373Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:01.792388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:01.792460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:01.792505Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602609587081815:8161]
2025-10-10T14:39:01.793155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:01.793716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:01.793781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:01.794134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:01.794204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:01.794211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:01.794212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:01.794213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:01.794215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:01.794216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:01.794218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:01.794219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:01.794221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:01.794222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:01.794223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:01.794224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:01.794225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:01.794232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:01.794245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:01.794249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:01.794254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:01.794258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:01.794263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:01.794267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:01.794271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:01.794276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:01.794280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:01.794284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:01.794287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:01.794291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:01.794305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:01.794327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:01.794340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:01.794346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:01.794350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:01.794357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:01.794362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:01.794367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:01.794374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:01.794388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:01.794393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:01.794399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:01.794404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:01.794410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:01.794415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:01.794420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:01.794425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:01.794431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:01.794436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:01.794441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:01.794446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:01.794452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:01.794458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:01.794463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:01.794471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:01.794476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:01.794521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:01.797365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:01.798461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:01.798475Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:01.798478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:01.798482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:01.798490Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2857 [2:7559602609587081815:8161]
2025-10-10T14:39:01.798503Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:01.798525Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:01.798533Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:01.798537Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:01.798539Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:01.798558Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:01.798567Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:01.798575Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:01.798649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:01.798657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:01.798659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:01.798662Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:01.798751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:01.798759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:01.798771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:01.798786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:01.798807Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:01.798829Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602609587081808:8161]
2025-10-10T14:39:01.798838Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602609587081808:8161]
2025-10-10T14:39:01.798841Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602609587081808:8161]
2025-10-10T14:39:01.798853Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:01.798859Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:01.798862Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:01.798864Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:01.798869Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:01.798885Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:01.798889Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:01.798902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602610369321774:5615], now have 1 active actors on pipe
2025-10-10T14:39:01.798905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602610369321586:2438], now have 1 active actors on pipe
2025-10-10T14:39:01.798935Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602609587081808:8161]
2025-10-10T14:39:01.798950Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:01.798960Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2857
2025-10-10T14:39:01.798970Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2857
2025-10-10T14:39:01.798975Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:01.799195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:01.799223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:01.799261Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|73985214-5832479a-db5564d7-38313db9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:01.799270Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:01.799275Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:01.799278Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:01.799301Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:01.799316Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:01.799336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:01.799670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:01.799680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:01.799700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:01.799819Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2858 partition: 0 MaxSeqNo: 40 sessionId: src_id|73985214-5832479a-db5564d7-38313db9_0
2025-10-10T14:39:01.801612Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa743803-68022e1c-594e76ce-d22e2c79_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|73985214-5832479a-db5564d7-38313db9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:01.804421Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|73985214-5832479a-db5564d7-38313db9_0] Write session: try to update token
2025-10-10T14:39:01.804441Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|73985214-5832479a-db5564d7-38313db9_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:01.821488Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2858 sessionId: src_id|73985214-5832479a-db5564d7-38313db9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:01.821910Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:01.821932Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:01.821936Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:01.821938Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:01.821949Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602609587081808:8161]
2025-10-10T14:39:01.821953Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602609587081808:8161]
2025-10-10T14:39:01.821957Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602609587081808:8161]
2025-10-10T14:39:01.822011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:01.822027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:01.822034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:01.822174Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:01.822187Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:01.822192Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:01.822197Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:01.824264Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:01.859519Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602610369321795:6861]
2025-10-10T14:39:01.859905Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 pipe creation result: OK TabletId: 72075186224037892 Generation: 2857, pipe: [1:7559602610369321795:6861]
2025-10-10T14:39:01.938737Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:01.939217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:01.939235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:01.939284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602610369321795:6861], now have 1 active actors on pipe
2025-10-10T14:39:01.939535Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:01.939578Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:01.939582Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:01.939593Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 56 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602610369321795:6861]
2025-10-10T14:39:01.939582Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:01.939675Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2858 reason: error at write: Disconnected sessionId: src_id|73985214-5832479a-db5564d7-38313db9_0
2025-10-10T14:39:01.940051Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2858 sessionId: src_id|73985214-5832479a-db5564d7-38313db9_0 is DEAD
2025-10-10T14:39:01.940093Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|73985214-5832479a-db5564d7-38313db9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:01.940105Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|73985214-5832479a-db5564d7-38313db9_0] Write session will restart in 0.009472s
2025-10-10T14:39:01.940131Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|73985214-5832479a-db5564d7-38313db9_0] Write session: Do CDS request
2025-10-10T14:39:01.940137Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|73985214-5832479a-db5564d7-38313db9_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:01.951030Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|73985214-5832479a-db5564d7-38313db9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:01.951147Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:01.951166Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2859
2025-10-10T14:39:01.951419Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2859 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:01.951476Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2859 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:01.951488Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2859 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:01.951493Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:01.953754Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2859 sessionId:  describe result for acl check
2025-10-10T14:39:01.953799Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:01.953801Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:01.953803Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:01.953811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602610369321841:5586] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:01.954444Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602610369321841:5586] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:01.958678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602610369321841:5586] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:01.963117Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602610369321841:5586] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:01.963133Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602610369321841:5586] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:01.963136Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602610369321841:5586] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:01.963147Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2859 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:01.963712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:01.968029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:01.968338Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:01.968351Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:01.968364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:01.968433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:01.968475Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602609587082013:8159]
2025-10-10T14:39:01.969099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:01.969560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:01.969628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:01.970014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:01.970093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:01.970094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:01.970095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:01.970096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:01.970098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:01.970099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:01.970101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:01.970102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:01.970104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:01.970105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:01.970107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:01.970108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:01.970110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:01.970117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:01.970131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:01.970135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:01.970139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:01.970144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:01.970148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:01.970151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:01.970155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:01.970160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:01.970164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:01.970168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:01.970172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:01.970176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:01.970184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:01.970193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:01.970202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:01.970208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:01.970213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:01.970219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:01.970223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:01.970229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:01.970234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:01.970240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:01.970245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:01.970250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:01.970256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:01.970262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:01.970267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:01.970272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:01.970278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:01.970283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:01.970288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:01.970294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:01.970302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:01.970309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:01.970313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:01.970320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:01.970325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:01.970331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:01.970377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:01.975375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:01.976251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:01.976258Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:01.976261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:01.976265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:01.976272Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2858 [2:7559602609587082013:8159]
2025-10-10T14:39:01.976290Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:01.976313Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:01.976318Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:01.976322Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:01.976325Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:01.976344Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:01.977278Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2858
2025-10-10T14:39:01.977310Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2858
2025-10-10T14:39:01.976352Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:01.976360Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:01.976433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:01.976435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:01.976437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:01.976440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:01.976527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:01.976531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:01.976545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:01.976557Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:01.976575Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:01.976597Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602609587082008:8159]
2025-10-10T14:39:01.976600Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602609587082008:8159]
2025-10-10T14:39:01.976602Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602609587082008:8159]
2025-10-10T14:39:01.976616Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:01.976635Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:01.976651Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:01.976654Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:01.976692Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602609587082008:8159]
2025-10-10T14:39:01.976695Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:01.976962Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:01.976964Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:01.976967Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:01.976973Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:01.977446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602610369321990:5586], now have 1 active actors on pipe
2025-10-10T14:39:01.977451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602610369321799:2438], now have 1 active actors on pipe
2025-10-10T14:39:01.977472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:01.977478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:01.977516Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|307561e0-98ff4100-c90fc51c-fc96d9f6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:01.977526Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:01.977531Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:01.977534Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:01.977547Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:01.977562Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:01.977581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:01.978072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:01.978090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:01.978111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:01.978501Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2859 partition: 0 MaxSeqNo: 40 sessionId: src_id|307561e0-98ff4100-c90fc51c-fc96d9f6_0
2025-10-10T14:39:01.979728Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|73985214-5832479a-db5564d7-38313db9_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|307561e0-98ff4100-c90fc51c-fc96d9f6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:01.982562Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|307561e0-98ff4100-c90fc51c-fc96d9f6_0] Write session: try to update token
2025-10-10T14:39:01.982588Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|307561e0-98ff4100-c90fc51c-fc96d9f6_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:02.001204Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2859 sessionId: src_id|307561e0-98ff4100-c90fc51c-fc96d9f6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:02.001446Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:02.001470Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:02.001474Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:02.001476Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:02.001486Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602609587082008:8159]
2025-10-10T14:39:02.001491Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602609587082008:8159]
2025-10-10T14:39:02.001495Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602609587082008:8159]
2025-10-10T14:39:02.003988Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:02.001547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:02.001560Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:02.001563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:02.001566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:02.001577Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:02.001584Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:02.001726Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:02.039781Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602614664289299:6861]
2025-10-10T14:39:02.040103Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 pipe creation result: OK TabletId: 72075186224037892 Generation: 2858, pipe: [1:7559602614664289299:6861]
2025-10-10T14:39:02.118849Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:02.119270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:02.119289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:02.119332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602614664289299:6861], now have 1 active actors on pipe
2025-10-10T14:39:02.119571Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:02.119584Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:02.119585Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:02.119647Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 57 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602614664289299:6861]
2025-10-10T14:39:02.119662Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2859 reason: error at write: Disconnected sessionId: src_id|307561e0-98ff4100-c90fc51c-fc96d9f6_0
2025-10-10T14:39:02.119860Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2859 sessionId: src_id|307561e0-98ff4100-c90fc51c-fc96d9f6_0 is DEAD
2025-10-10T14:39:02.119621Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:02.120053Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|307561e0-98ff4100-c90fc51c-fc96d9f6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:02.120064Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|307561e0-98ff4100-c90fc51c-fc96d9f6_0] Write session will restart in 0.008943s
2025-10-10T14:39:02.120088Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|307561e0-98ff4100-c90fc51c-fc96d9f6_0] Write session: Do CDS request
2025-10-10T14:39:02.120098Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|307561e0-98ff4100-c90fc51c-fc96d9f6_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:02.129985Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|307561e0-98ff4100-c90fc51c-fc96d9f6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:02.130070Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:02.130099Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2860
2025-10-10T14:39:02.130240Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2860 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:02.130285Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2860 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:02.130296Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2860 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:02.130301Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:02.130796Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2860 sessionId:  describe result for acl check
2025-10-10T14:39:02.130846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:02.130852Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:02.130854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:02.130860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602614664289316:5580] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:02.131491Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602614664289316:5580] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:02.135598Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602614664289316:5580] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:02.139230Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602614664289316:5580] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:02.139245Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602614664289316:5580] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:02.139249Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602614664289316:5580] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:02.139261Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2860 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:02.141538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:02.145821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:02.146061Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:02.146073Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:02.146085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:02.146146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:02.146195Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602613882049508:4916]
2025-10-10T14:39:02.146806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:02.147156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:02.147204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:02.147564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:02.147628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:02.147634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:02.147635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:02.147637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:02.147638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:02.147639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:02.147641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:02.147642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:02.147643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:02.147645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:02.147646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:02.147648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:02.147649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:02.147655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:02.147668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:02.147672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:02.147675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:02.147679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:02.147682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:02.147686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:02.147690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:02.147693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:02.147698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:02.147702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:02.147705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:02.147709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:02.147718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:02.147726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:02.147735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:02.147740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:02.147745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:02.147750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:02.147754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:02.147759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:02.147764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:02.147769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:02.147773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:02.147778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:02.147782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:02.147787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:02.147792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:02.147797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:02.147802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:02.147807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:02.147812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:02.147817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:02.147821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:02.147826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:02.147830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:02.147835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:02.147839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:02.147844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:02.147882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:02.150340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:02.151035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:02.151048Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:02.151051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:02.151055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:02.151062Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2859 [2:7559602613882049508:4916]
2025-10-10T14:39:02.151078Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:02.151096Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:02.151100Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:02.151105Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:02.151107Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:02.151126Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:02.151140Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:02.151152Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:02.151213Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:02.151221Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:02.151223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:02.151226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:02.151317Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:02.151325Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:02.151337Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:02.151348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:02.151365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:02.151392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602614664289301:2438], now have 1 active actors on pipe
2025-10-10T14:39:02.151400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602614664289491:5580], now have 1 active actors on pipe
2025-10-10T14:39:02.151407Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602613882049503:4916]
2025-10-10T14:39:02.151410Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602613882049503:4916]
2025-10-10T14:39:02.151413Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602613882049503:4916]
2025-10-10T14:39:02.151427Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:02.151441Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:02.151445Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:02.151447Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:02.151448Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:02.151464Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:02.151472Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:02.151461Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2859
2025-10-10T14:39:02.151489Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2859
2025-10-10T14:39:02.151500Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602613882049503:4916]
2025-10-10T14:39:02.151513Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:02.151520Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:02.151534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:02.151539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:02.151588Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8a071bcc-4a083143-3ad205cb-817ca2c0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:02.151597Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:02.151601Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:02.151603Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:02.151613Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:02.151626Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:02.151647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:02.151800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:02.151808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:02.151824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:02.151923Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2860 partition: 0 MaxSeqNo: 40 sessionId: src_id|8a071bcc-4a083143-3ad205cb-817ca2c0_0
2025-10-10T14:39:02.152354Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|307561e0-98ff4100-c90fc51c-fc96d9f6_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|8a071bcc-4a083143-3ad205cb-817ca2c0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:02.155380Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8a071bcc-4a083143-3ad205cb-817ca2c0_0] Write session: try to update token
2025-10-10T14:39:02.155402Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8a071bcc-4a083143-3ad205cb-817ca2c0_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:02.172168Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:02.172189Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:02.172192Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:02.172194Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:02.172204Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602613882049503:4916]
2025-10-10T14:39:02.172209Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602613882049503:4916]
2025-10-10T14:39:02.172212Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602613882049503:4916]
2025-10-10T14:39:02.172262Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:02.172265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:02.173380Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2860 sessionId: src_id|8a071bcc-4a083143-3ad205cb-817ca2c0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:02.176219Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:02.172270Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:02.172273Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:02.172274Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:02.172275Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:02.172420Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:02.219478Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602614664289505:6861]
2025-10-10T14:39:02.219982Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 pipe creation result: OK TabletId: 72075186224037892 Generation: 2859, pipe: [1:7559602614664289505:6861]
2025-10-10T14:39:02.290002Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:02.290314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:02.290330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:02.290372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602614664289505:6861], now have 1 active actors on pipe
2025-10-10T14:39:02.290556Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:02.290581Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:02.290636Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 58 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602614664289505:6861]
2025-10-10T14:39:02.290656Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:39:02.290767Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2860 reason: status is not ok: tablet will be restarted right now sessionId: src_id|8a071bcc-4a083143-3ad205cb-817ca2c0_0
2025-10-10T14:39:02.290990Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2860 sessionId: src_id|8a071bcc-4a083143-3ad205cb-817ca2c0_0 is DEAD
2025-10-10T14:39:02.291340Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a071bcc-4a083143-3ad205cb-817ca2c0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:39:02.291352Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a071bcc-4a083143-3ad205cb-817ca2c0_0] Write session will restart in 0.007853s
2025-10-10T14:39:02.291377Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a071bcc-4a083143-3ad205cb-817ca2c0_0] Write session: Do CDS request
2025-10-10T14:39:02.291383Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a071bcc-4a083143-3ad205cb-817ca2c0_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:02.301395Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8a071bcc-4a083143-3ad205cb-817ca2c0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:02.301477Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:02.301493Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2861
2025-10-10T14:39:02.301656Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2861 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:02.301709Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2861 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:02.301722Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2861 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:02.301726Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:02.302326Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2861 sessionId:  describe result for acl check
2025-10-10T14:39:02.302361Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:02.302368Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:02.302370Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:02.302377Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602614664289601:5541] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:02.302956Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602614664289601:5541] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:02.306252Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602614664289601:5541] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:02.308748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602614664289601:5541] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:02.308763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602614664289601:5541] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:02.308767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602614664289601:5541] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:02.308776Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2861 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:02.309407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:02.313819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:02.314341Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:02.314357Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:02.314377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:02.314461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:02.314513Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602613882049749:8134]
2025-10-10T14:39:02.315155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:02.315520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:02.315577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:02.315934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:02.316016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:02.316017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:02.316019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:02.316020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:02.316022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:02.316023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:02.316025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:02.316026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:02.316027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:02.316029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:02.316030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:02.316034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:02.316035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:02.316042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:02.316056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:02.316061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:02.316065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:02.316069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:02.316074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:02.316078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:02.316082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:02.316086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:02.316091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:02.316094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:02.316098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:02.316101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:02.316110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:02.316118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:02.316125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:02.316131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:02.316136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:02.316141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:02.316146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:02.316151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:02.316155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:02.316162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:02.316166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:02.316171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:02.316176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:02.316182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:02.316186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:02.316191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:02.316199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:02.316205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:02.316210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:02.316215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:02.316219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:02.316225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:02.316229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:02.316234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:02.316238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:02.316243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:02.316284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:02.319168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:02.319603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:02.319620Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:02.319623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:02.319627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:02.319636Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2860 [2:7559602613882049749:8134]
2025-10-10T14:39:02.319651Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:02.319673Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:02.319677Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:02.319681Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:02.319683Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:02.319702Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:02.319711Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:02.319719Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:02.319799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:02.319813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:02.319816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:02.319819Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:02.320138Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2860
2025-10-10T14:39:02.320141Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2860
2025-10-10T14:39:02.320222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:02.320241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:02.320259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:02.320273Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:02.320293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:02.320327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602614664289722:5541], now have 1 active actors on pipe
2025-10-10T14:39:02.320336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602614664289533:2438], now have 1 active actors on pipe
2025-10-10T14:39:02.320355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:02.320367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:02.320393Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602613882049744:8134]
2025-10-10T14:39:02.320401Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602613882049744:8134]
2025-10-10T14:39:02.320408Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602613882049744:8134]
2025-10-10T14:39:02.320425Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:02.320437Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:02.320446Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:02.320448Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:02.320448Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:02.320467Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:02.320476Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:02.320505Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3c0f270c-2117c012-7fc375c-bd04565c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:02.320520Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:02.320531Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:02.320534Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:02.320547Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:02.320567Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:02.320617Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602613882049744:8134]
2025-10-10T14:39:02.320638Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:02.320653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:02.320681Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:02.320850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:02.320861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:02.320883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:02.320988Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2861 partition: 0 MaxSeqNo: 40 sessionId: src_id|3c0f270c-2117c012-7fc375c-bd04565c_0
2025-10-10T14:39:02.321550Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a071bcc-4a083143-3ad205cb-817ca2c0_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|3c0f270c-2117c012-7fc375c-bd04565c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:02.324454Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3c0f270c-2117c012-7fc375c-bd04565c_0] Write session: try to update token
2025-10-10T14:39:02.324475Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3c0f270c-2117c012-7fc375c-bd04565c_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:02.339665Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2861 sessionId: src_id|3c0f270c-2117c012-7fc375c-bd04565c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:02.342554Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:02.343639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:02.343662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:02.343687Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:02.343691Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:02.343694Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:02.343696Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:02.343705Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602613882049744:8134]
2025-10-10T14:39:02.343711Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602613882049744:8134]
2025-10-10T14:39:02.343715Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602613882049744:8134]
2025-10-10T14:39:02.343777Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:02.343783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:02.343789Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:02.343791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:02.343794Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:02.343794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:02.343955Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:02.391013Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602614664289735:6861]
2025-10-10T14:39:02.391364Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 pipe creation result: OK TabletId: 72075186224037892 Generation: 2860, pipe: [1:7559602614664289735:6861]
2025-10-10T14:39:02.464865Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:02.465322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:39:02.465416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602614664289735:6861], now have 1 active actors on pipe
2025-10-10T14:39:02.466187Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:39:02.466305Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:02.466327Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:02.466412Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2861 reason: error at write: Disconnected sessionId: src_id|3c0f270c-2117c012-7fc375c-bd04565c_0
2025-10-10T14:39:02.466586Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2861 sessionId: src_id|3c0f270c-2117c012-7fc375c-bd04565c_0 is DEAD
2025-10-10T14:39:02.466753Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c0f270c-2117c012-7fc375c-bd04565c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:02.466763Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c0f270c-2117c012-7fc375c-bd04565c_0] Write session will restart in 0.009101s
2025-10-10T14:39:02.466800Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c0f270c-2117c012-7fc375c-bd04565c_0] Write session: Do CDS request
2025-10-10T14:39:02.466806Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c0f270c-2117c012-7fc375c-bd04565c_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:02.466871Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 59 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602614664289735:6861]
2025-10-10T14:39:02.466892Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:02.480380Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3c0f270c-2117c012-7fc375c-bd04565c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:02.483590Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:02.483606Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2862
2025-10-10T14:39:02.484462Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2862 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:02.484506Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2862 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:02.484518Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2862 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:02.484522Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:02.485053Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2862 sessionId:  describe result for acl check
2025-10-10T14:39:02.485095Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:02.485101Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:02.485102Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:02.485109Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602614664289837:5537] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:02.485765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602614664289837:5537] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:02.489179Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602614664289837:5537] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:02.492572Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602614664289837:5537] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:02.492586Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602614664289837:5537] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:02.492591Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602614664289837:5537] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:02.492600Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2862 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:02.493465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:02.498032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:02.498291Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:02.498312Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:02.498326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:02.498394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:02.498435Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602613882049963:8132]
2025-10-10T14:39:02.499027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:02.499399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:02.499451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:02.499775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:02.499847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:02.499855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:02.499856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:02.499857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:02.499858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:02.499860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:02.499861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:02.499862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:02.499863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:02.499864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:02.499865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:02.499867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:02.499868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:02.499875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:02.499888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:02.499891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:02.499896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:02.499900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:02.499903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:02.499907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:02.499910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:02.499917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:02.499920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:02.499924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:02.499928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:02.499931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:02.499939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:02.499947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:02.499954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:02.499959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:02.499963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:02.499969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:02.499973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:02.499979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:02.499996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:02.500005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:02.500009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:02.500014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:02.500023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:02.500028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:02.500032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:02.500040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:02.500045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:02.500050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:02.500058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:02.500063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:02.500066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:02.500071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:02.500075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:02.500084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:02.500088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:02.500093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:02.500134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:02.506034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:02.506719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:02.506733Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:02.506736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:02.506740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:02.506747Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2861 [2:7559602613882049963:8132]
2025-10-10T14:39:02.506765Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:02.506787Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:02.506797Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:02.506801Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:02.506804Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:02.506823Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:02.506838Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:02.506847Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:02.506921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:02.506932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:02.506933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:02.506936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:02.507016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:02.507027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:02.507042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:02.507054Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:02.507071Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:02.507101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602614664289931:5537], now have 1 active actors on pipe
2025-10-10T14:39:02.507110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602614664289737:2438], now have 1 active actors on pipe
2025-10-10T14:39:02.507120Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602613882049958:8132]
2025-10-10T14:39:02.507126Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602613882049958:8132]
2025-10-10T14:39:02.507133Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602613882049958:8132]
2025-10-10T14:39:02.507146Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:02.507166Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:02.507184Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:02.507187Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:02.507191Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:02.507195Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:02.507201Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:02.507232Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602613882049958:8132]
2025-10-10T14:39:02.507244Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:02.507210Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2861
2025-10-10T14:39:02.507248Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2861
2025-10-10T14:39:02.507259Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:02.507282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:02.507287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:02.507327Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4bbc501b-e8e45efc-e7e5bd09-dbcfcbdf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:02.507340Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:02.507345Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:02.507348Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:02.507360Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:02.507371Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:02.507395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:02.507694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:02.507706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:02.507742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:02.507856Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2862 partition: 0 MaxSeqNo: 40 sessionId: src_id|4bbc501b-e8e45efc-e7e5bd09-dbcfcbdf_0
2025-10-10T14:39:02.508259Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c0f270c-2117c012-7fc375c-bd04565c_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|4bbc501b-e8e45efc-e7e5bd09-dbcfcbdf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:02.511084Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4bbc501b-e8e45efc-e7e5bd09-dbcfcbdf_0] Write session: try to update token
2025-10-10T14:39:02.511106Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4bbc501b-e8e45efc-e7e5bd09-dbcfcbdf_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:02.519580Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:39:02.519599Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:02.519611Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602613882049958:8132]
2025-10-10T14:39:02.519664Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:39:02.519667Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:39:02.519894Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:39:02.520044Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:02.520195Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:02.520332Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:02.520531Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:39:02.520582Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:39:02.528324Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2862 sessionId: src_id|4bbc501b-e8e45efc-e7e5bd09-dbcfcbdf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:02.531301Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:02.531533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:02.531555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:02.531599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:39:02.531692Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:39:02.538730Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:02.538749Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:02.538752Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:02.538755Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:02.538767Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602613882049958:8132]
2025-10-10T14:39:02.538771Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602613882049958:8132]
2025-10-10T14:39:02.538774Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602613882049958:8132]
2025-10-10T14:39:02.538828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:02.538831Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:02.538837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:02.538838Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:02.538840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:02.538842Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:02.538999Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:02.563547Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602614664289943:6861]
2025-10-10T14:39:02.563885Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 pipe creation result: OK TabletId: 72075186224037892 Generation: 2861, pipe: [1:7559602614664289943:6861]
2025-10-10T14:39:02.664243Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:02.673938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:02.673971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:02.674173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:02.674244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:02.674315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:02.674391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:02.674445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:02.674456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:02.674541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:02.674612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:02.674684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:02.674766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:02.674820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:02.674831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:02.674921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:02.674988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:02.675058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:02.675130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:02.675185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:02.675193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:02.675272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:02.675696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:02.675774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:02.675843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:02.675891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:02.675899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:02.675970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:02.676036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:02.676104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:02.676169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:02.676222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:02.676229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:02.676302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:02.676367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:02.676434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:02.676501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:02.676549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:02.676557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:02.676629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:02.676693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:02.676766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:02.676837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:02.676883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:02.676890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:02.676962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:02.677030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:02.677104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:02.677177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:02.677234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:02.677241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:02.677310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:02.677397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:02.677484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:02.677553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:02.677601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:02.677609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:02.678387Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:02.678393Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 60 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602614664289943:6861]
2025-10-10T14:39:02.678432Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:02.678435Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:02.678480Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2862 reason: error at write: Disconnected sessionId: src_id|4bbc501b-e8e45efc-e7e5bd09-dbcfcbdf_0
2025-10-10T14:39:02.678710Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2862 sessionId: src_id|4bbc501b-e8e45efc-e7e5bd09-dbcfcbdf_0 is DEAD
2025-10-10T14:39:02.678851Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4bbc501b-e8e45efc-e7e5bd09-dbcfcbdf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:02.678864Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4bbc501b-e8e45efc-e7e5bd09-dbcfcbdf_0] Write session will restart in 0.006733s
2025-10-10T14:39:02.678893Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4bbc501b-e8e45efc-e7e5bd09-dbcfcbdf_0] Write session: Do CDS request
2025-10-10T14:39:02.678899Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4bbc501b-e8e45efc-e7e5bd09-dbcfcbdf_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:02.677685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:02.677760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:02.677860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:02.677928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:02.677992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:02.677995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:02.678072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602614664289943:6861], now have 1 active actors on pipe
2025-10-10T14:39:02.678928Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:02.686936Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4bbc501b-e8e45efc-e7e5bd09-dbcfcbdf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:02.687017Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:02.687039Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2863
2025-10-10T14:39:02.687157Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2863 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:02.687193Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2863 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:02.687203Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2863 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:02.687207Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:02.687690Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2863 sessionId:  describe result for acl check
2025-10-10T14:39:02.687733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:02.687740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:02.687742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:02.687749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602614664289973:5510] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:02.688328Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602614664289973:5510] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:02.693609Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602614664289973:5510] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:02.696976Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602614664289973:5510] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:02.696991Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602614664289973:5510] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:02.696994Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602614664289973:5510] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:02.697002Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2863 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:02.702332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:02.709757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:02.710037Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:02.710050Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:02.710063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:02.710124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:02.710170Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602613882050167:8118]
2025-10-10T14:39:02.710809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:02.711166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:02.711224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:02.711611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:02.711678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:02.711685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:02.711686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:02.711688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:02.711689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:02.711691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:02.711693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:02.711694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:02.711695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:02.711697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:02.711698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:02.711699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:02.711701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:02.711707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:02.711730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:02.711735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:02.711739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:02.711743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:02.711746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:02.711751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:02.711755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:02.711759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:02.711766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:02.711771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:02.711776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:02.711780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:02.711788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:02.711799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:02.711807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:02.711834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:02.711838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:02.711844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:02.711849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:02.711855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:02.711860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:02.711865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:02.711870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:02.711875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:02.711880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:02.711884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:02.711888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:02.711893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:02.711900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:02.711912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:02.711916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:02.711922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:02.711926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:02.711931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:02.711935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:02.711941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:02.711945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:02.711950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:02.711992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:02.714760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:02.715415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:02.715428Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:02.715431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:02.715435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:02.715442Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2862 [2:7559602613882050167:8118]
2025-10-10T14:39:02.715456Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:02.715480Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:02.715492Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:02.715496Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:02.715499Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:02.715521Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:02.715534Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:02.715542Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:02.715612Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:02.715621Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:02.715623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:02.715625Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:02.715699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:02.715707Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:02.715719Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:02.715729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:02.715750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:02.715772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602614664290121:5510], now have 1 active actors on pipe
2025-10-10T14:39:02.715781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602614664289958:2438], now have 1 active actors on pipe
2025-10-10T14:39:02.715789Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602613882050162:8118]
2025-10-10T14:39:02.715793Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602613882050162:8118]
2025-10-10T14:39:02.715795Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602613882050162:8118]
2025-10-10T14:39:02.715808Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:02.715819Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:02.715822Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:02.715824Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:02.715827Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:02.715842Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:02.715850Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:02.715885Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602613882050162:8118]
2025-10-10T14:39:02.715897Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:02.715883Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2862
2025-10-10T14:39:02.715887Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2862
2025-10-10T14:39:02.715927Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:02.716041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:02.716052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:02.716085Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|12bf663f-275d5cc8-2ad47b30-4ff1bf8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:02.716093Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:02.716097Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:02.716100Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:02.716112Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:02.716123Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:02.716139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:02.716283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:02.716292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:02.716310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:02.716427Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2863 partition: 0 MaxSeqNo: 40 sessionId: src_id|12bf663f-275d5cc8-2ad47b30-4ff1bf8_0
2025-10-10T14:39:02.716822Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4bbc501b-e8e45efc-e7e5bd09-dbcfcbdf_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|12bf663f-275d5cc8-2ad47b30-4ff1bf8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:02.719710Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|12bf663f-275d5cc8-2ad47b30-4ff1bf8_0] Write session: try to update token
2025-10-10T14:39:02.719734Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|12bf663f-275d5cc8-2ad47b30-4ff1bf8_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:02.735984Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:02.736000Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:02.736005Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:02.736007Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:02.736024Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602613882050162:8118]
2025-10-10T14:39:02.736029Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602613882050162:8118]
2025-10-10T14:39:02.736032Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602613882050162:8118]
2025-10-10T14:39:02.736090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:02.736105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:02.736107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:02.736173Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:02.736186Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:02.736191Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:02.736269Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:02.736490Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2863 sessionId: src_id|12bf663f-275d5cc8-2ad47b30-4ff1bf8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:02.739570Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:02.778580Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602614664290164:6861]
2025-10-10T14:39:02.778918Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 pipe creation result: OK TabletId: 72075186224037892 Generation: 2862, pipe: [1:7559602614664290164:6861]
2025-10-10T14:39:02.854816Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:02.855279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:02.855292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:02.855335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602614664290164:6861], now have 1 active actors on pipe
2025-10-10T14:39:02.855789Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:02.856133Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|12bf663f-275d5cc8-2ad47b30-4ff1bf8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:02.855701Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:02.856144Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|12bf663f-275d5cc8-2ad47b30-4ff1bf8_0] Write session will restart in 0.005325s
2025-10-10T14:39:02.855714Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:02.855730Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 61 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602614664290164:6861]
2025-10-10T14:39:02.856182Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|12bf663f-275d5cc8-2ad47b30-4ff1bf8_0] Write session: Do CDS request
2025-10-10T14:39:02.855756Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:02.856189Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|12bf663f-275d5cc8-2ad47b30-4ff1bf8_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:02.855777Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2863 reason: error at write: Disconnected sessionId: src_id|12bf663f-275d5cc8-2ad47b30-4ff1bf8_0
2025-10-10T14:39:02.855969Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2863 sessionId: src_id|12bf663f-275d5cc8-2ad47b30-4ff1bf8_0 is DEAD
2025-10-10T14:39:02.862932Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|12bf663f-275d5cc8-2ad47b30-4ff1bf8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:02.863040Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:02.863054Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2864
2025-10-10T14:39:02.863224Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2864 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:02.863271Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2864 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:02.863283Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2864 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:02.863287Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:02.863790Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2864 sessionId:  describe result for acl check
2025-10-10T14:39:02.863832Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:02.863840Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:02.863843Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:02.863848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602614664290187:5501] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:02.864423Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602614664290187:5501] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:02.871064Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602614664290187:5501] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:02.874389Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602614664290187:5501] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:02.874407Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602614664290187:5501] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:02.874411Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602614664290187:5501] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:02.874422Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2864 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:02.877249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:02.881830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:02.882071Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:02.882088Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:02.882100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:02.882159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:02.882210Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602613882050371:8116]
2025-10-10T14:39:02.882714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:02.883091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:02.883140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:02.883506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:02.883574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:02.883581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:02.883582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:02.883583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:02.883584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:02.883585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:02.883587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:02.883588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:02.883590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:02.883591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:02.883593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:02.883594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:02.883595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:02.883602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:02.883616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:02.883620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:02.883623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:02.883627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:02.883631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:02.883635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:02.883639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:02.883644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:02.883648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:02.883652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:02.883657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:02.883661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:02.883668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:02.883677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:02.883686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:02.883693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:02.883698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:02.883703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:02.883708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:02.883714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:02.883724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:02.883730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:02.883734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:02.883739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:02.883749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:02.883754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:02.883759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:02.883765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:02.883771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:02.883781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:02.883787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:02.883792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:02.883801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:02.883807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:02.883811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:02.883818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:02.883822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:02.883827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:02.883870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:02.886652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:02.887447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:02.887459Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:02.887462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:02.887465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:02.887472Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2863 [2:7559602613882050371:8116]
2025-10-10T14:39:02.887485Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:02.887504Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:02.887508Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:02.887512Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:02.887514Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:02.887533Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:02.887541Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:02.887559Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:02.887616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:02.887623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:02.887625Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:02.887628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:02.887700Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:02.887707Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:02.887719Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:02.887735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:02.887756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:02.887864Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2863
2025-10-10T14:39:02.887879Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2863
2025-10-10T14:39:02.887783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602614664290366:5501], now have 1 active actors on pipe
2025-10-10T14:39:02.887795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602614664290171:2438], now have 1 active actors on pipe
2025-10-10T14:39:02.887803Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602613882050366:8116]
2025-10-10T14:39:02.887806Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602613882050366:8116]
2025-10-10T14:39:02.887808Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602613882050366:8116]
2025-10-10T14:39:02.887821Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:02.887833Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:02.887836Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:02.887836Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:02.887839Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:02.887852Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:02.887855Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:02.887880Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602613882050366:8116]
2025-10-10T14:39:02.887883Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:02.887888Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:02.887908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:02.887913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:02.887961Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f6a4191b-c672c958-1256aa75-744657af_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:02.887968Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:02.887973Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:02.887975Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:02.887986Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:02.887997Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:02.888014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:02.888200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:02.888212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:02.888236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:02.888324Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2864 partition: 0 MaxSeqNo: 40 sessionId: src_id|f6a4191b-c672c958-1256aa75-744657af_0
2025-10-10T14:39:02.888719Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|12bf663f-275d5cc8-2ad47b30-4ff1bf8_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|f6a4191b-c672c958-1256aa75-744657af_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:02.891705Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f6a4191b-c672c958-1256aa75-744657af_0] Write session: try to update token
2025-10-10T14:39:02.891728Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f6a4191b-c672c958-1256aa75-744657af_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:02.898876Z :INFO: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] Counters: { Errors: 28 CurrentSessionLifetimeMs: 481652 BytesRead: 33792020 MessagesRead: 15 BytesReadCompressed: 33792020 BytesInflightUncompressed: 2252802 BytesInflightCompressed: 6758406 BytesInflightTotal: 9011208 MessagesInflight: 4 }
2025-10-10T14:39:02.912502Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2864 sessionId: src_id|f6a4191b-c672c958-1256aa75-744657af_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:02.907869Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:02.907889Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:02.907893Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:02.907895Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:02.907906Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602613882050366:8116]
2025-10-10T14:39:02.907911Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602613882050366:8116]
2025-10-10T14:39:02.907917Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602613882050366:8116]
2025-10-10T14:39:02.907977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:02.907986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:02.907989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:02.908006Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:02.908014Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:02.908019Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:02.908155Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:02.915424Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:02.955744Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602614664290382:6861]
2025-10-10T14:39:02.956146Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 pipe creation result: OK TabletId: 72075186224037892 Generation: 2863, pipe: [1:7559602614664290382:6861]
2025-10-10T14:39:03.030929Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:03.031545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:03.031562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:03.031610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602614664290382:6861], now have 1 active actors on pipe
2025-10-10T14:39:03.031903Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 62 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602614664290382:6861]
2025-10-10T14:39:03.031918Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:03.031924Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:03.031936Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:03.032020Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2864 reason: error at write: Disconnected sessionId: src_id|f6a4191b-c672c958-1256aa75-744657af_0
2025-10-10T14:39:03.032242Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2864 sessionId: src_id|f6a4191b-c672c958-1256aa75-744657af_0 is DEAD
2025-10-10T14:39:03.031866Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:03.032402Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f6a4191b-c672c958-1256aa75-744657af_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:03.032409Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f6a4191b-c672c958-1256aa75-744657af_0] Write session will restart in 0.009962s
2025-10-10T14:39:03.032435Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f6a4191b-c672c958-1256aa75-744657af_0] Write session: Do CDS request
2025-10-10T14:39:03.032445Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f6a4191b-c672c958-1256aa75-744657af_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:03.043934Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f6a4191b-c672c958-1256aa75-744657af_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:03.044044Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:03.044069Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2865
2025-10-10T14:39:03.044210Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2865 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:03.044268Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2865 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:03.044279Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2865 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:03.044284Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:03.044727Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2865 sessionId:  describe result for acl check
2025-10-10T14:39:03.044769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:03.044777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:03.044779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:03.044786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602618959257698:5489] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:03.045424Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602618959257698:5489] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:03.048992Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602618959257698:5489] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:03.052242Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602618959257698:5489] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:03.052255Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602618959257698:5489] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:03.052259Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602618959257698:5489] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:03.052268Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2865 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:03.053268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:03.061576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:03.061862Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:03.061874Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:03.061898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:03.061981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:03.062030Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602618177017872:8106]
2025-10-10T14:39:03.062691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:03.063042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:03.063106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:03.063443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:03.063504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:03.063505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:03.063506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:03.063508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:03.063509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:03.063511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:03.063512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:03.063513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:03.063514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:03.063516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:03.063517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:03.063519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:03.063520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:03.063526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:03.063541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:03.063545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:03.063550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:03.063554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:03.063558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:03.063563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:03.063567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:03.063571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:03.063577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:03.063581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:03.063586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:03.063590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:03.063599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:03.063608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:03.063615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:03.063621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:03.063627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:03.063632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:03.063637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:03.063643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:03.063648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:03.063654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:03.063660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:03.063666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:03.063671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:03.063677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:03.063682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:03.063688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:03.063695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:03.063700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:03.063706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:03.063711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:03.063717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:03.063723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:03.063728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:03.063734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:03.063740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:03.063745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:03.063792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:03.066561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:03.067148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:03.067164Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:03.067167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:03.067171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:03.067180Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2864 [2:7559602618177017872:8106]
2025-10-10T14:39:03.067196Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:03.067215Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:03.067219Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:03.067223Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:03.067225Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:03.067245Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:03.067259Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:03.067267Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:03.067342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:03.067349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:03.067351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:03.067354Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:03.067434Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:03.067442Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:03.067454Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:03.067466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:03.067486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:03.067509Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602618177017867:8106]
2025-10-10T14:39:03.067512Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602618177017867:8106]
2025-10-10T14:39:03.067514Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602618177017867:8106]
2025-10-10T14:39:03.067529Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:03.067550Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:03.067572Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:03.067575Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:03.067619Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602618177017867:8106]
2025-10-10T14:39:03.067627Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:03.067652Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:03.067660Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:03.067663Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:03.067672Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:03.067802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602618959257680:2438], now have 1 active actors on pipe
2025-10-10T14:39:03.067812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602618959257876:5489], now have 1 active actors on pipe
2025-10-10T14:39:03.067883Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2864
2025-10-10T14:39:03.067888Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2864
2025-10-10T14:39:03.067946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:03.067960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:03.067998Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d8690e74-d7615e4d-be3d5f3b-cc02661a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:03.068013Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:03.068019Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:03.068022Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:03.068037Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:03.068057Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:03.068080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:03.068281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:03.068289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:03.068303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:03.068416Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2865 partition: 0 MaxSeqNo: 40 sessionId: src_id|d8690e74-d7615e4d-be3d5f3b-cc02661a_0
2025-10-10T14:39:03.068868Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f6a4191b-c672c958-1256aa75-744657af_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|d8690e74-d7615e4d-be3d5f3b-cc02661a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:03.071790Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d8690e74-d7615e4d-be3d5f3b-cc02661a_0] Write session: try to update token
2025-10-10T14:39:03.071811Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d8690e74-d7615e4d-be3d5f3b-cc02661a_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:03.079830Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:39:03.079849Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:03.079861Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602618177017867:8106]
2025-10-10T14:39:03.079916Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:39:03.080107Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:39:03.080261Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:03.080403Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:03.080554Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:03.080762Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:39:03.080798Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:39:03.080945Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:39:03.088441Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2865 sessionId: src_id|d8690e74-d7615e4d-be3d5f3b-cc02661a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:03.091158Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:03.091386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:03.091406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:03.091463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:39:03.091556Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:39:03.099753Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:03.099769Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:03.099773Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:03.099775Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:03.099788Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602618177017867:8106]
2025-10-10T14:39:03.099792Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602618177017867:8106]
2025-10-10T14:39:03.099797Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602618177017867:8106]
2025-10-10T14:39:03.099847Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:03.099853Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:03.099856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:03.099858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:03.099859Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:03.099863Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:03.099996Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:03.132305Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602618959257889:6861]
2025-10-10T14:39:03.132688Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 pipe creation result: OK TabletId: 72075186224037892 Generation: 2864, pipe: [1:7559602618959257889:6861]
2025-10-10T14:39:03.222896Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:03.232156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:03.232189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:03.232391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:03.232463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:03.232540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:03.232613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:03.232665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:03.232676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:03.232759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:03.232830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:03.232908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:03.232983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:03.233035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:03.233045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:03.236105Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:03.236141Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 63 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602618959257889:6861]
2025-10-10T14:39:03.236169Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:03.236175Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:03.236222Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2865 reason: error at write: Disconnected sessionId: src_id|d8690e74-d7615e4d-be3d5f3b-cc02661a_0
2025-10-10T14:39:03.236512Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2865 sessionId: src_id|d8690e74-d7615e4d-be3d5f3b-cc02661a_0 is DEAD
2025-10-10T14:39:03.233124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:03.233201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:03.233264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:03.233349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:03.233395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:03.233398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:03.233517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:03.233584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:03.233647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:03.233713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:03.233758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:03.233762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:03.233833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:03.233898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:03.233961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:03.234023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:03.234070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:03.234073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:03.234144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:03.234204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:03.234265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:03.234331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:03.234378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:03.234381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:03.234459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:03.234524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:03.234602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:03.234670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:03.234718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:03.234721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:03.234799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:03.234865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:03.234931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:03.234997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:03.235042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:03.235045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:03.235122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:03.235185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:03.235256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:03.235329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:03.235374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:03.235378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:03.235454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:03.235522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:03.235615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:03.235685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:03.235730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:03.235733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:03.235829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602618959257889:6861], now have 1 active actors on pipe
2025-10-10T14:39:03.237259Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:03.237574Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8690e74-d7615e4d-be3d5f3b-cc02661a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:03.237587Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8690e74-d7615e4d-be3d5f3b-cc02661a_0] Write session will restart in 0.007088s
2025-10-10T14:39:03.237628Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8690e74-d7615e4d-be3d5f3b-cc02661a_0] Write session: Do CDS request
2025-10-10T14:39:03.237635Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8690e74-d7615e4d-be3d5f3b-cc02661a_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:03.245979Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d8690e74-d7615e4d-be3d5f3b-cc02661a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:03.246908Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:03.246924Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2866
2025-10-10T14:39:03.247039Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2866 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:03.247085Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2866 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:03.247091Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2866 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:03.247095Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:03.247517Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2866 sessionId:  describe result for acl check
2025-10-10T14:39:03.247550Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:03.247552Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:03.247556Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:03.247563Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602618959257905:5492] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:03.248178Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602618959257905:5492] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:03.251426Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602618959257905:5492] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:03.254579Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602618959257905:5492] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:03.254597Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602618959257905:5492] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:03.254601Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602618959257905:5492] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:03.254611Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2866 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:03.262906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:03.263531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:03.263731Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:03.263743Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:03.263756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:03.263814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:03.263864Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602618177018080:8093]
2025-10-10T14:39:03.264482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:03.264794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:03.264841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:03.265195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:03.265253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:03.265260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:03.265261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:03.265263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:03.265264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:03.265266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:03.265267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:03.265269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:03.265270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:03.265272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:03.265273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:03.265275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:03.265276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:03.265283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:03.265297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:03.265302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:03.265307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:03.265312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:03.265316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:03.265321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:03.265325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:03.265347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:03.265352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:03.265356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:03.265359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:03.265363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:03.265372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:03.265381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:03.265387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:03.265392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:03.265397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:03.265412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:03.265417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:03.265422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:03.265428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:03.265433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:03.265438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:03.265452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:03.265458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:03.265464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:03.265469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:03.265474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:03.265481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:03.265492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:03.265497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:03.265503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:03.265508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:03.265513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:03.265518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:03.265524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:03.265528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:03.265542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:03.265580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:03.268035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:03.268688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:03.268703Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:03.268706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:03.268710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:03.268716Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2865 [2:7559602618177018080:8093]
2025-10-10T14:39:03.268729Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:03.268747Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:03.268750Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:03.268754Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:03.268756Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:03.268773Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:03.268786Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:03.268794Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:03.268855Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:03.268863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:03.268865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:03.268867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:03.268935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:03.268942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:03.268953Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:03.268970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:03.268994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:03.269016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602618959258035:5492], now have 1 active actors on pipe
2025-10-10T14:39:03.269028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602618959257892:2438], now have 1 active actors on pipe
2025-10-10T14:39:03.269036Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602618177018075:8093]
2025-10-10T14:39:03.269039Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602618177018075:8093]
2025-10-10T14:39:03.269042Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602618177018075:8093]
2025-10-10T14:39:03.269055Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:03.269068Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:03.269070Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:03.269076Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:03.269078Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:03.269087Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:03.269090Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:03.269087Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2865
2025-10-10T14:39:03.269087Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2865
2025-10-10T14:39:03.269113Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602618177018075:8093]
2025-10-10T14:39:03.269122Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:03.269123Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:03.269139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:03.269144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:03.269193Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1df048b2-5cf911a4-83059ab8-4ee70198_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:03.269207Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:03.269212Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:03.269214Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:03.269227Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:03.269242Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:03.269265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:03.269452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:03.269466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:03.269489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:03.269598Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2866 partition: 0 MaxSeqNo: 40 sessionId: src_id|1df048b2-5cf911a4-83059ab8-4ee70198_0
2025-10-10T14:39:03.269985Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8690e74-d7615e4d-be3d5f3b-cc02661a_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|1df048b2-5cf911a4-83059ab8-4ee70198_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:03.272849Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1df048b2-5cf911a4-83059ab8-4ee70198_0] Write session: try to update token
2025-10-10T14:39:03.272868Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1df048b2-5cf911a4-83059ab8-4ee70198_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:03.287113Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2866 sessionId: src_id|1df048b2-5cf911a4-83059ab8-4ee70198_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:03.290016Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:03.289641Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:03.289660Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:03.289663Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:03.289666Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:03.289680Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602618177018075:8093]
2025-10-10T14:39:03.289684Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602618177018075:8093]
2025-10-10T14:39:03.289687Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602618177018075:8093]
2025-10-10T14:39:03.289743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:03.289748Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:03.289751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:03.289753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:03.289756Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:03.289760Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:03.289902Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:03.336162Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602618959258115:6861]
2025-10-10T14:39:03.336735Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 pipe creation result: OK TabletId: 72075186224037892 Generation: 2865, pipe: [1:7559602618959258115:6861]
2025-10-10T14:39:03.411348Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:03.411903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:03.411921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:03.411972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602618959258115:6861], now have 1 active actors on pipe
2025-10-10T14:39:03.412264Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:03.412277Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:03.412353Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2866 reason: error at write: Disconnected sessionId: src_id|1df048b2-5cf911a4-83059ab8-4ee70198_0
2025-10-10T14:39:03.412407Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:03.412467Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 64 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602618959258115:6861]
2025-10-10T14:39:03.412582Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2866 sessionId: src_id|1df048b2-5cf911a4-83059ab8-4ee70198_0 is DEAD
2025-10-10T14:39:03.412746Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1df048b2-5cf911a4-83059ab8-4ee70198_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:03.412227Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:03.412761Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1df048b2-5cf911a4-83059ab8-4ee70198_0] Write session will restart in 0.005423s
2025-10-10T14:39:03.412785Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1df048b2-5cf911a4-83059ab8-4ee70198_0] Write session: Do CDS request
2025-10-10T14:39:03.412795Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1df048b2-5cf911a4-83059ab8-4ee70198_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:03.419887Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1df048b2-5cf911a4-83059ab8-4ee70198_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:03.419979Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:03.419994Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2867
2025-10-10T14:39:03.420149Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2867 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:03.420189Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2867 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:03.420209Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2867 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:03.420218Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:03.420717Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2867 sessionId:  describe result for acl check
2025-10-10T14:39:03.420753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:03.420760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:03.420762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:03.420768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602618959258136:5455] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:03.421392Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602618959258136:5455] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:03.424883Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602618959258136:5455] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:03.428172Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602618959258136:5455] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:03.428192Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602618959258136:5455] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:03.428209Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602618959258136:5455] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:03.428219Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2867 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:03.442170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:03.448248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:03.448539Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:03.448552Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:03.448568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:03.448643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:03.448698Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602618177018325:8048]
2025-10-10T14:39:03.449384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:03.449824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:03.449884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:03.450256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:03.450319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:03.450320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:03.450322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:03.450324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:03.450325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:03.450326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:03.450328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:03.450330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:03.450331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:03.450333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:03.450334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:03.450335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:03.450337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:03.450344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:03.450359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:03.450363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:03.450368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:03.450372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:03.450377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:03.450381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:03.450386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:03.450390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:03.450394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:03.450398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:03.450402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:03.450407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:03.450415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:03.450425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:03.450432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:03.450438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:03.450444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:03.450450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:03.450454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:03.450460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:03.450466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:03.450472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:03.450478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:03.450501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:03.450507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:03.450513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:03.450518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:03.450525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:03.450530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:03.450536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:03.450542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:03.450548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:03.450554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:03.450560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:03.450566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:03.450573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:03.450578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:03.450583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:03.450630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:03.453618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:03.455474Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2866
2025-10-10T14:39:03.455521Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2866
2025-10-10T14:39:03.454603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:03.454617Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:03.454619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:03.454623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:03.454630Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2866 [2:7559602618177018325:8048]
2025-10-10T14:39:03.454645Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:03.454666Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:03.454669Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:03.454674Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:03.454676Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:03.454695Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:03.454703Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:03.454712Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:03.454776Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:03.454779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:03.454781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:03.454784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:03.454865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:03.454868Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:03.454880Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:03.454892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:03.454909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:03.454931Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602618177018320:8048]
2025-10-10T14:39:03.454933Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602618177018320:8048]
2025-10-10T14:39:03.454935Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602618177018320:8048]
2025-10-10T14:39:03.454956Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:03.454965Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:03.454968Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:03.454971Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:03.454972Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:03.454988Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:03.454991Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:03.455002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602618959258127:2438], now have 1 active actors on pipe
2025-10-10T14:39:03.455006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602618959258173:5455], now have 1 active actors on pipe
2025-10-10T14:39:03.455040Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602618177018320:8048]
2025-10-10T14:39:03.455048Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:03.455071Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:03.455691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:03.455698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:03.455732Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|89a49e15-71468eb8-b18fa0a-e0c8c793_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:03.455743Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:03.455748Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:03.455751Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:03.455763Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:03.455776Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:03.455793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:03.455954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:03.455957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:03.455970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:03.456069Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2867 partition: 0 MaxSeqNo: 40 sessionId: src_id|89a49e15-71468eb8-b18fa0a-e0c8c793_0
2025-10-10T14:39:03.456497Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1df048b2-5cf911a4-83059ab8-4ee70198_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|89a49e15-71468eb8-b18fa0a-e0c8c793_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:03.459532Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|89a49e15-71468eb8-b18fa0a-e0c8c793_0] Write session: try to update token
2025-10-10T14:39:03.459555Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|89a49e15-71468eb8-b18fa0a-e0c8c793_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:03.471783Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:39:03.471800Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:03.471812Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602618177018320:8048]
2025-10-10T14:39:03.471865Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:39:03.471870Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:39:03.472077Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:39:03.472241Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:03.472397Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:03.472564Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:03.472790Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:39:03.472834Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:39:03.478695Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2867 sessionId: src_id|89a49e15-71468eb8-b18fa0a-e0c8c793_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:03.483328Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:03.483629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:03.483652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:03.483704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:39:03.484296Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:39:03.497428Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:03.497444Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:03.497448Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:03.497451Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:03.497463Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602618177018320:8048]
2025-10-10T14:39:03.497467Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602618177018320:8048]
2025-10-10T14:39:03.497470Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602618177018320:8048]
2025-10-10T14:39:03.497518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:03.497525Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:03.497529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:03.497544Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:03.497551Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:03.497555Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:03.497662Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:03.512263Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602618959258339:6861]
2025-10-10T14:39:03.512520Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 pipe creation result: OK TabletId: 72075186224037892 Generation: 2866, pipe: [1:7559602618959258339:6861]
2025-10-10T14:39:03.620877Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:03.629659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:03.629686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:03.629890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:03.629966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:03.630031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:03.630104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:03.630614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:03.630623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:03.630706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:03.630769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:03.630831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:03.630929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:03.630971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:03.630974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:03.631053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:03.631114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:03.631178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:03.631243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:03.631284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:03.631286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:03.631358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:03.631422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:03.631491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:03.631558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:03.631610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:03.631616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:03.631688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:03.631750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:03.631816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:03.631882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:03.631924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:03.631926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:03.632001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:03.632062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:03.632125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:03.632191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:03.632233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:03.632236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:03.632307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:03.632370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:03.632436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:03.632499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:03.632541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:03.632544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:03.632613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:03.632676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:03.632740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:03.632805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:03.632850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:03.632854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:03.632927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:03.632992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:03.633062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:03.633127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:03.633175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:03.633178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:03.633254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:03.633317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:03.634286Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 65 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602618959258339:6861]
2025-10-10T14:39:03.634323Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:03.634370Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:03.634378Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:03.634413Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2867 reason: error at write: Disconnected sessionId: src_id|89a49e15-71468eb8-b18fa0a-e0c8c793_0
2025-10-10T14:39:03.633708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:03.633785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:03.633835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:03.633838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:03.633910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602618959258339:6861], now have 1 active actors on pipe
2025-10-10T14:39:03.634726Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:03.634641Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2867 sessionId: src_id|89a49e15-71468eb8-b18fa0a-e0c8c793_0 is DEAD
2025-10-10T14:39:03.635944Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89a49e15-71468eb8-b18fa0a-e0c8c793_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:03.635956Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89a49e15-71468eb8-b18fa0a-e0c8c793_0] Write session will restart in 0.007276s
2025-10-10T14:39:03.635984Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89a49e15-71468eb8-b18fa0a-e0c8c793_0] Write session: Do CDS request
2025-10-10T14:39:03.635991Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89a49e15-71468eb8-b18fa0a-e0c8c793_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:03.645714Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|89a49e15-71468eb8-b18fa0a-e0c8c793_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:03.645654Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:03.645669Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2868
2025-10-10T14:39:03.646034Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2868 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:03.646061Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2868 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:03.646073Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2868 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:03.646077Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:03.646368Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2868 sessionId:  describe result for acl check
2025-10-10T14:39:03.646393Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:03.646396Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:03.646398Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:03.646401Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602618959258365:5439] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:03.646728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602618959258365:5439] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:03.649232Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602618959258365:5439] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:03.657761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602618959258365:5439] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:03.657781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602618959258365:5439] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:03.657785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602618959258365:5439] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:03.657795Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2868 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:03.669872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:03.674911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:03.675184Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:03.675200Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:03.675214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:03.675275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:03.675330Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602618177018546:8057]
2025-10-10T14:39:03.676010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:03.676434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:03.676483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:03.677363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:03.677460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:03.677466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:03.677468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:03.677470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:03.677471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:03.677472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:03.677474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:03.677475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:03.677477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:03.677478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:03.677480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:03.677481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:03.677483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:03.677492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:03.677508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:03.677513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:03.677518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:03.677522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:03.677527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:03.677531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:03.677535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:03.677540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:03.677546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:03.677551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:03.677555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:03.677559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:03.677569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:03.677579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:03.677586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:03.677592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:03.677597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:03.677604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:03.677609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:03.677615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:03.677623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:03.677630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:03.677635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:03.677641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:03.677646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:03.677652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:03.677659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:03.677670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:03.677676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:03.677691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:03.677696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:03.677702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:03.677708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:03.677714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:03.677719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:03.677725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:03.677731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:03.677737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:03.677783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:03.680473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:03.680793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:03.680811Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:03.680814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:03.680818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:03.680826Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2867 [2:7559602618177018546:8057]
2025-10-10T14:39:03.680839Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:03.680857Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:03.680866Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:03.680869Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:03.680872Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:03.680889Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:03.680901Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:03.680910Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:03.680980Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:03.680987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:03.681004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:03.681012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:03.681084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:03.681092Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:03.681105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:03.681121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:03.681141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:03.681166Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602618177018541:8057]
2025-10-10T14:39:03.681173Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602618177018541:8057]
2025-10-10T14:39:03.681176Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602618177018541:8057]
2025-10-10T14:39:03.681185Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:03.681198Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:03.681201Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:03.681207Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:03.681210Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:03.681219Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:03.681222Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:03.681234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602618959258341:2438], now have 1 active actors on pipe
2025-10-10T14:39:03.681237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602618959258462:5439], now have 1 active actors on pipe
2025-10-10T14:39:03.681260Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602618177018541:8057]
2025-10-10T14:39:03.681268Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:03.681303Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:03.681264Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2867
2025-10-10T14:39:03.681273Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2867
2025-10-10T14:39:03.681443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:03.681456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:03.681488Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a4e4c5e-b5cb231e-f485e1c2-2f10b452_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:03.681502Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:03.681511Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:03.681514Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:03.681527Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:03.681542Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:03.681563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:03.681731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:03.681737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:03.681753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:03.681900Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2868 partition: 0 MaxSeqNo: 40 sessionId: src_id|a4e4c5e-b5cb231e-f485e1c2-2f10b452_0
2025-10-10T14:39:03.682359Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89a49e15-71468eb8-b18fa0a-e0c8c793_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|a4e4c5e-b5cb231e-f485e1c2-2f10b452_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:03.685250Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a4e4c5e-b5cb231e-f485e1c2-2f10b452_0] Write session: try to update token
2025-10-10T14:39:03.685274Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a4e4c5e-b5cb231e-f485e1c2-2f10b452_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:03.702176Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:03.702197Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:03.702202Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:03.702204Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:03.702215Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602618177018541:8057]
2025-10-10T14:39:03.702220Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602618177018541:8057]
2025-10-10T14:39:03.702225Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602618177018541:8057]
2025-10-10T14:39:03.702281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:03.702284Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:03.702290Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:03.702290Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:03.702294Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:03.702295Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:03.702446Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:03.705090Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2868 sessionId: src_id|a4e4c5e-b5cb231e-f485e1c2-2f10b452_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:03.708158Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:03.735478Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602618959258565:6861]
2025-10-10T14:39:03.735837Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 pipe creation result: OK TabletId: 72075186224037892 Generation: 2867, pipe: [1:7559602618959258565:6861]
2025-10-10T14:39:03.821911Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:03.822594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:03.822606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:03.822657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602618959258565:6861], now have 1 active actors on pipe
2025-10-10T14:39:03.823052Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:03.823763Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4e4c5e-b5cb231e-f485e1c2-2f10b452_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:39:03.823775Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4e4c5e-b5cb231e-f485e1c2-2f10b452_0] Write session will restart in 0.007757s
2025-10-10T14:39:03.823802Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4e4c5e-b5cb231e-f485e1c2-2f10b452_0] Write session: Do CDS request
2025-10-10T14:39:03.823809Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4e4c5e-b5cb231e-f485e1c2-2f10b452_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:03.823214Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:03.823280Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 66 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602618959258565:6861]
2025-10-10T14:39:03.823301Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:39:03.823398Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2868 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a4e4c5e-b5cb231e-f485e1c2-2f10b452_0
2025-10-10T14:39:03.823586Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2868 sessionId: src_id|a4e4c5e-b5cb231e-f485e1c2-2f10b452_0 is DEAD
2025-10-10T14:39:03.832911Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a4e4c5e-b5cb231e-f485e1c2-2f10b452_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:03.833031Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:03.833048Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2869
2025-10-10T14:39:03.833252Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2869 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:03.833302Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2869 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:03.833312Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2869 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:03.833316Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:03.833808Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2869 sessionId:  describe result for acl check
2025-10-10T14:39:03.833838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:03.833840Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:03.833842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:03.833851Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602618959258590:5425] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:03.834423Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602618959258590:5425] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:03.837923Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602618959258590:5425] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:03.841627Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602618959258590:5425] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:03.841645Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602618959258590:5425] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:03.841649Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602618959258590:5425] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:03.841658Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2869 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:03.844457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:03.848459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:03.848710Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:03.848727Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:03.848742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:03.848811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:03.848862Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602618177018757:8053]
2025-10-10T14:39:03.849550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:03.849920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:03.849992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:03.850339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:03.850415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:03.850423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:03.850424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:03.850426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:03.850427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:03.850429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:03.850430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:03.850431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:03.850433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:03.850434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:03.850436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:03.850438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:03.850439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:03.850446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:03.850460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:03.850465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:03.850469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:03.850474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:03.850478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:03.850482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:03.850486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:03.850491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:03.850495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:03.850499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:03.850503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:03.850513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:03.850527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:03.850542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:03.850550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:03.850560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:03.850565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:03.850575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:03.850580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:03.850586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:03.850591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:03.850597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:03.850601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:03.850607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:03.850617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:03.850624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:03.850635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:03.850645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:03.850650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:03.850660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:03.850665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:03.850671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:03.850677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:03.850683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:03.850687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:03.850692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:03.850697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:03.850705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:03.850753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:03.853316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:03.854251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:03.854269Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:03.854272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:03.854276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:03.854283Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2868 [2:7559602618177018757:8053]
2025-10-10T14:39:03.854297Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:03.854322Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:03.854331Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:03.854335Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:03.854341Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:03.854361Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:03.854374Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:03.854384Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:03.854456Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:03.854465Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:03.854468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:03.854470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:03.854540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:03.854550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:03.854563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:03.854576Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:03.854610Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:03.854641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602618959258768:5425], now have 1 active actors on pipe
2025-10-10T14:39:03.854649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602618959258572:2438], now have 1 active actors on pipe
2025-10-10T14:39:03.854658Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602618177018751:8053]
2025-10-10T14:39:03.854662Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602618177018751:8053]
2025-10-10T14:39:03.854664Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602618177018751:8053]
2025-10-10T14:39:03.854681Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:03.854702Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:03.854712Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:03.854715Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:03.854719Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:03.854723Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:03.854703Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2868
2025-10-10T14:39:03.854731Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:03.854713Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2868
2025-10-10T14:39:03.854758Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602618177018751:8053]
2025-10-10T14:39:03.854771Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:03.854773Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:03.854793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:03.854799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:03.854852Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e22be787-bef57ffc-98682422-8a531a5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:03.854863Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:03.854867Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:03.854870Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:03.854882Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:03.854895Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:03.854913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:03.855227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:03.855241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:03.855264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:03.855414Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2869 partition: 0 MaxSeqNo: 40 sessionId: src_id|e22be787-bef57ffc-98682422-8a531a5_0
2025-10-10T14:39:03.855811Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4e4c5e-b5cb231e-f485e1c2-2f10b452_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|e22be787-bef57ffc-98682422-8a531a5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:03.858566Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e22be787-bef57ffc-98682422-8a531a5_0] Write session: try to update token
2025-10-10T14:39:03.858584Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e22be787-bef57ffc-98682422-8a531a5_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:03.872858Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2869 sessionId: src_id|e22be787-bef57ffc-98682422-8a531a5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:03.875334Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:03.875353Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:03.875356Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:03.875359Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:03.875369Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602618177018751:8053]
2025-10-10T14:39:03.875374Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602618177018751:8053]
2025-10-10T14:39:03.875378Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602618177018751:8053]
2025-10-10T14:39:03.875431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:03.875439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:03.875441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:03.875596Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:03.875674Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:03.876359Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:03.876373Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:03.876377Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:03.923432Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602618959258789:6861]
2025-10-10T14:39:03.923827Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 pipe creation result: OK TabletId: 72075186224037892 Generation: 2868, pipe: [1:7559602618959258789:6861]
2025-10-10T14:39:03.994043Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:03.994632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:03.994653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:03.994704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602618959258789:6861], now have 1 active actors on pipe
2025-10-10T14:39:03.994928Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:03.994960Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:03.994966Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 67 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602618959258789:6861]
2025-10-10T14:39:03.994975Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:03.995003Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:03.995055Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2869 reason: error at write: Disconnected sessionId: src_id|e22be787-bef57ffc-98682422-8a531a5_0
2025-10-10T14:39:03.995282Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2869 sessionId: src_id|e22be787-bef57ffc-98682422-8a531a5_0 is DEAD
2025-10-10T14:39:03.995450Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e22be787-bef57ffc-98682422-8a531a5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:03.995462Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e22be787-bef57ffc-98682422-8a531a5_0] Write session will restart in 0.006778s
2025-10-10T14:39:03.995489Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e22be787-bef57ffc-98682422-8a531a5_0] Write session: Do CDS request
2025-10-10T14:39:03.995495Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e22be787-bef57ffc-98682422-8a531a5_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:04.003991Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e22be787-bef57ffc-98682422-8a531a5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:04.004071Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:04.004088Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2870
2025-10-10T14:39:04.004294Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2870 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:04.004344Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2870 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:04.004352Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2870 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:04.004357Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:04.004945Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2870 sessionId:  describe result for acl check
2025-10-10T14:39:04.004986Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:04.004990Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:04.004992Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:04.004999Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602623254226107:5402] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:04.005667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602623254226107:5402] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:04.008792Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602623254226107:5402] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:04.014662Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602623254226107:5402] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:04.014678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602623254226107:5402] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:04.014683Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602623254226107:5402] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:04.014693Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2870 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:04.021865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:04.026404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:04.026675Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:04.026681Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:04.026694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:04.026752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:04.026794Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602622471986263:8051]
2025-10-10T14:39:04.027473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:04.028632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:04.028707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:04.029074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:04.029161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:04.029169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:04.029170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:04.029172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:04.029173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:04.029175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:04.029176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:04.029178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:04.029180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:04.029181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:04.029182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:04.029184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:04.029185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:04.029192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:04.029208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:04.029212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:04.029217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:04.029222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:04.029226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:04.029230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:04.029235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:04.029239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:04.029244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:04.029249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:04.029253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:04.029257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:04.029267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:04.029277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:04.029284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:04.029290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:04.029299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:04.029310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:04.029315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:04.029320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:04.029345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:04.029350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:04.029357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:04.029368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:04.029372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:04.029377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:04.029382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:04.029387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:04.029408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:04.029413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:04.029418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:04.029425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:04.029434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:04.029439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:04.029443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:04.029449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:04.029453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:04.029459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:04.029498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:04.032653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:04.033551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:04.033568Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:04.033571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:04.033577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:04.033585Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2869 [2:7559602622471986263:8051]
2025-10-10T14:39:04.033603Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:04.033628Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:04.033631Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:04.033635Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:04.033638Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:04.033663Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:04.033671Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:04.033680Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:04.033771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:04.033780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:04.033782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:04.033785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:04.033870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:04.033874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:04.033887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:04.033907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:04.033929Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:04.033956Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602622471986258:8051]
2025-10-10T14:39:04.033959Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602622471986258:8051]
2025-10-10T14:39:04.033961Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602622471986258:8051]
2025-10-10T14:39:04.033980Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:04.034004Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:04.034024Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:04.034032Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:04.034082Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602622471986258:8051]
2025-10-10T14:39:04.034090Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:04.034093Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:04.034097Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:04.034100Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:04.034112Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:04.034353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602618959258791:2438], now have 1 active actors on pipe
2025-10-10T14:39:04.034367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602623254226213:5402], now have 1 active actors on pipe
2025-10-10T14:39:04.034429Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2869
2025-10-10T14:39:04.034488Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2869
2025-10-10T14:39:04.034781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:04.034795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:04.034828Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d4529b39-4249b220-407c0c87-3a526b1e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:04.034852Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:04.034863Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:04.034866Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:04.034882Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:04.034902Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:04.034926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:04.035156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:04.035167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:04.035186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:04.035327Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2870 partition: 0 MaxSeqNo: 40 sessionId: src_id|d4529b39-4249b220-407c0c87-3a526b1e_0
2025-10-10T14:39:04.037490Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e22be787-bef57ffc-98682422-8a531a5_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|d4529b39-4249b220-407c0c87-3a526b1e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:04.040517Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4529b39-4249b220-407c0c87-3a526b1e_0] Write session: try to update token
2025-10-10T14:39:04.040541Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4529b39-4249b220-407c0c87-3a526b1e_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:04.059351Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:04.059373Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:04.059377Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:04.059380Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:04.059391Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602622471986258:8051]
2025-10-10T14:39:04.059397Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602622471986258:8051]
2025-10-10T14:39:04.059401Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602622471986258:8051]
2025-10-10T14:39:04.059456Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:04.059468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:04.059471Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:04.059645Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:04.061471Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:04.061483Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:04.061490Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:04.075701Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2870 sessionId: src_id|d4529b39-4249b220-407c0c87-3a526b1e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:04.078507Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:04.094951Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602623254226301:6861]
2025-10-10T14:39:04.095380Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 pipe creation result: OK TabletId: 72075186224037892 Generation: 2869, pipe: [1:7559602623254226301:6861]
2025-10-10T14:39:04.180636Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:04.181380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:04.181415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:04.181443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602623254226301:6861], now have 1 active actors on pipe
2025-10-10T14:39:04.181985Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:04.183116Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4529b39-4249b220-407c0c87-3a526b1e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:04.183132Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4529b39-4249b220-407c0c87-3a526b1e_0] Write session will restart in 0.007594s
2025-10-10T14:39:04.183160Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4529b39-4249b220-407c0c87-3a526b1e_0] Write session: Do CDS request
2025-10-10T14:39:04.183168Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4529b39-4249b220-407c0c87-3a526b1e_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:04.182181Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 68 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602623254226301:6861]
2025-10-10T14:39:04.182207Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:04.182243Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:04.182246Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:04.182311Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2870 reason: error at write: Disconnected sessionId: src_id|d4529b39-4249b220-407c0c87-3a526b1e_0
2025-10-10T14:39:04.182519Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2870 sessionId: src_id|d4529b39-4249b220-407c0c87-3a526b1e_0 is DEAD
2025-10-10T14:39:04.192015Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4529b39-4249b220-407c0c87-3a526b1e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:04.192141Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:04.192158Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2871
2025-10-10T14:39:04.192349Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2871 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:04.192387Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2871 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:04.192395Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2871 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:04.192399Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:04.193052Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2871 sessionId:  describe result for acl check
2025-10-10T14:39:04.193095Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:04.193097Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:04.193099Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:04.193106Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602623254226319:5403] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:04.193746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602623254226319:5403] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:04.203868Z :ERROR: [/Root] OnFederationDiscovery: Got error. Status: CLIENT_DEADLINE_EXCEEDED. Description: [ { <main>: Error: GRpc error: (4): Deadline Exceeded } { <main>: Error: Grpc error response on endpoint localhost:7170 } ]
2025-10-10T14:39:04.210635Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602623254226319:5403] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:04.214253Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602623254226319:5403] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:04.214267Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602623254226319:5403] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:04.214271Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602623254226319:5403] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:04.214281Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2871 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:04.223856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:04.228772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:04.229094Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:04.229111Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:04.229125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:04.229206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:04.229275Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602622471986476:8044]
2025-10-10T14:39:04.229902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:04.230401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:04.230495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:04.230893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:04.230957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:04.230964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:04.230965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:04.230967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:04.230969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:04.230970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:04.230972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:04.230973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:04.230974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:04.230976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:04.230977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:04.230978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:04.230980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:04.230987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:04.231001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:04.231006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:04.231010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:04.231015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:04.231019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:04.231024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:04.231028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:04.231033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:04.231037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:04.231042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:04.231046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:04.231050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:04.231060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:04.231071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:04.231079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:04.231085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:04.231090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:04.231096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:04.231105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:04.231111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:04.231117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:04.231127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:04.231132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:04.231137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:04.231147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:04.231152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:04.231161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:04.231167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:04.231172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:04.231182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:04.231187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:04.231193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:04.231198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:04.231204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:04.231213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:04.231219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:04.231228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:04.231232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:04.231277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:04.234196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:04.234650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:04.234666Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:04.234668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:04.234671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:04.234678Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2870 [2:7559602622471986476:8044]
2025-10-10T14:39:04.234695Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:04.234716Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:04.234720Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:04.234724Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:04.234727Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:04.234749Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:04.234764Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:04.234778Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:04.234850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:04.234858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:04.234861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:04.234864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:04.234952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:04.234960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:04.234974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:04.234993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:04.235009Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:04.235035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602623254226304:2438], now have 1 active actors on pipe
2025-10-10T14:39:04.235044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602623254226385:5403], now have 1 active actors on pipe
2025-10-10T14:39:04.235052Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602622471986469:8044]
2025-10-10T14:39:04.235059Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602622471986469:8044]
2025-10-10T14:39:04.235062Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602622471986469:8044]
2025-10-10T14:39:04.235076Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:04.235091Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:04.235095Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:04.235097Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:04.235081Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2870
2025-10-10T14:39:04.235119Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2870
2025-10-10T14:39:04.235658Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:04.235690Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:04.235695Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:04.235752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:04.235763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:04.235786Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602622471986469:8044]
2025-10-10T14:39:04.235800Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:04.235831Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:04.235841Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|36bd0958-16ba3bf6-44f3f55f-422c8f7d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:04.235851Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:04.235856Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:04.235859Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:04.235877Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:04.235895Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:04.235928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:04.236129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:04.236138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:04.236156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:04.236276Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2871 partition: 0 MaxSeqNo: 40 sessionId: src_id|36bd0958-16ba3bf6-44f3f55f-422c8f7d_0
2025-10-10T14:39:04.237147Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4529b39-4249b220-407c0c87-3a526b1e_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|36bd0958-16ba3bf6-44f3f55f-422c8f7d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:04.239966Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|36bd0958-16ba3bf6-44f3f55f-422c8f7d_0] Write session: try to update token
2025-10-10T14:39:04.239986Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|36bd0958-16ba3bf6-44f3f55f-422c8f7d_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:04.254158Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2871 sessionId: src_id|36bd0958-16ba3bf6-44f3f55f-422c8f7d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:04.256973Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:04.257226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:04.257252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:04.257297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:39:04.259413Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:04.259435Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:04.259440Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:04.259442Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:04.259453Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602622471986469:8044]
2025-10-10T14:39:04.259462Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602622471986469:8044]
2025-10-10T14:39:04.259466Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602622471986469:8044]
2025-10-10T14:39:04.259520Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:04.257411Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:39:04.259535Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:04.259542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:04.259689Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:04.261461Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:04.261468Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:04.261476Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:04.282322Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602623254226518:6861]
2025-10-10T14:39:04.282631Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 pipe creation result: OK TabletId: 72075186224037892 Generation: 2870, pipe: [1:7559602623254226518:6861]
2025-10-10T14:39:04.379179Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:04.388740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:04.388772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:04.388958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:04.389025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:04.389097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:04.389169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:04.389220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:04.389225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:04.389303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:04.389408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:04.389485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:04.389550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:04.389594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:04.389598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:04.389676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:04.389737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:04.389798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:04.389867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:04.389910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:04.389912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:04.390007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:04.390068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:04.390131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:04.390191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:04.390233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:04.390236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:04.390307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:04.390368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:04.390435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:04.390498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:04.390542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:04.390545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:04.390616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:04.390684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:04.390751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:04.390813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:04.390916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:04.390920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:04.390991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:04.391045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:04.391116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:04.391187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:04.391237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:04.391240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:04.391321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:04.391388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:04.391458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:04.391536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:04.391652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:04.391655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:04.391757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:04.391820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:04.391890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:04.391960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:04.392022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:04.392025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:04.392098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:04.392168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:04.392245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:04.392319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:04.392372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:04.392375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:04.392437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602623254226518:6861], now have 1 active actors on pipe
2025-10-10T14:39:04.393084Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|36bd0958-16ba3bf6-44f3f55f-422c8f7d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:04.393118Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|36bd0958-16ba3bf6-44f3f55f-422c8f7d_0] Write session will restart in 0.005954s
2025-10-10T14:39:04.392623Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 69 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602623254226518:6861]
2025-10-10T14:39:04.392626Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:04.392674Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:04.392676Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:04.392704Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2871 reason: error at write: Disconnected sessionId: src_id|36bd0958-16ba3bf6-44f3f55f-422c8f7d_0
2025-10-10T14:39:04.393146Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|36bd0958-16ba3bf6-44f3f55f-422c8f7d_0] Write session: Do CDS request
2025-10-10T14:39:04.392924Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2871 sessionId: src_id|36bd0958-16ba3bf6-44f3f55f-422c8f7d_0 is DEAD
2025-10-10T14:39:04.393153Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|36bd0958-16ba3bf6-44f3f55f-422c8f7d_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:04.393997Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:04.399972Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|36bd0958-16ba3bf6-44f3f55f-422c8f7d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:04.400078Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:04.400093Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2872
2025-10-10T14:39:04.400246Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2872 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:04.400307Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2872 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:04.400318Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2872 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:04.400322Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:04.400810Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2872 sessionId:  describe result for acl check
2025-10-10T14:39:04.400848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:04.400850Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:04.400852Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:04.400869Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602623254226563:5354] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:04.401497Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602623254226563:5354] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:04.404386Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602623254226563:5354] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:04.411444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:04.409944Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602623254226563:5354] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:04.409960Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602623254226563:5354] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:04.409964Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602623254226563:5354] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:04.409973Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2872 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:04.416210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:04.416465Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:04.416479Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:04.416491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:04.416545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:04.416597Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602622471986726:8019]
2025-10-10T14:39:04.417233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:04.417641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:04.417695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:04.418051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:04.418154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:04.418162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:04.418164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:04.418165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:04.418167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:04.418168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:04.418170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:04.418171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:04.418172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:04.418174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:04.418176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:04.418178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:04.418178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:04.418186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:04.418199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:04.418203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:04.418208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:04.418211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:04.418215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:04.418219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:04.418222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:04.418225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:04.418230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:04.418233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:04.418237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:04.418241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:04.418250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:04.418260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:04.418267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:04.418272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:04.418279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:04.418285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:04.418289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:04.418295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:04.418301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:04.418305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:04.418311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:04.418317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:04.418322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:04.418331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:04.418336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:04.418341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:04.418347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:04.418352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:04.418357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:04.418362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:04.418367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:04.418373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:04.418377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:04.418382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:04.418387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:04.418405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:04.418451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:04.421166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:04.421952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:04.421971Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:04.421974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:04.421978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:04.421985Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2871 [2:7559602622471986726:8019]
2025-10-10T14:39:04.422001Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:04.422021Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:04.422025Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:04.422029Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:04.422031Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:04.422050Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:04.422059Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:04.422068Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:04.422132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:04.422139Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:04.422142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:04.422145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:04.422233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:04.422241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:04.422255Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:04.422273Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:04.422293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:04.422318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602623254226547:2438], now have 1 active actors on pipe
2025-10-10T14:39:04.422322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602623254226746:5354], now have 1 active actors on pipe
2025-10-10T14:39:04.422330Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602622471986721:8019]
2025-10-10T14:39:04.422332Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602622471986721:8019]
2025-10-10T14:39:04.422335Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602622471986721:8019]
2025-10-10T14:39:04.422349Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:04.422366Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:04.422384Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:04.422387Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:04.422390Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:04.422394Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:04.422396Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:04.422426Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602622471986721:8019]
2025-10-10T14:39:04.422434Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:04.422599Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:04.422756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:04.422772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:04.422808Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|545c785-3f8e986b-87381ae2-8225de9f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:04.422825Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:04.422830Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:04.422833Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:04.422849Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:04.422864Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:04.422883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:04.423087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:04.423096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:04.423115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:04.423597Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|36bd0958-16ba3bf6-44f3f55f-422c8f7d_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|545c785-3f8e986b-87381ae2-8225de9f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:04.422414Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2871
2025-10-10T14:39:04.422470Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2871
2025-10-10T14:39:04.423212Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2872 partition: 0 MaxSeqNo: 40 sessionId: src_id|545c785-3f8e986b-87381ae2-8225de9f_0
2025-10-10T14:39:04.426487Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|545c785-3f8e986b-87381ae2-8225de9f_0] Write session: try to update token
2025-10-10T14:39:04.426505Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|545c785-3f8e986b-87381ae2-8225de9f_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:04.441925Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2872 sessionId: src_id|545c785-3f8e986b-87381ae2-8225de9f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:04.444035Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:04.444058Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:04.444061Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:04.444063Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:04.444074Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602622471986721:8019]
2025-10-10T14:39:04.444079Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602622471986721:8019]
2025-10-10T14:39:04.444083Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602622471986721:8019]
2025-10-10T14:39:04.444138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:04.444155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:04.444157Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:04.444161Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:04.444173Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:04.444177Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:04.444311Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:04.444818Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:04.492771Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602623254226761:6861]
2025-10-10T14:39:04.493124Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 pipe creation result: OK TabletId: 72075186224037892 Generation: 2871, pipe: [1:7559602623254226761:6861]
2025-10-10T14:39:04.560556Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:04.561202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:04.561221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:04.561274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602623254226761:6861], now have 1 active actors on pipe
2025-10-10T14:39:04.561609Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:04.561625Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:04.561689Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2872 reason: error at write: Disconnected sessionId: src_id|545c785-3f8e986b-87381ae2-8225de9f_0
2025-10-10T14:39:04.561587Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:04.561911Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2872 sessionId: src_id|545c785-3f8e986b-87381ae2-8225de9f_0 is DEAD
2025-10-10T14:39:04.562064Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 70 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602623254226761:6861]
2025-10-10T14:39:04.562087Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:04.562321Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|545c785-3f8e986b-87381ae2-8225de9f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:04.562346Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|545c785-3f8e986b-87381ae2-8225de9f_0] Write session will restart in 0.008565s
2025-10-10T14:39:04.562370Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|545c785-3f8e986b-87381ae2-8225de9f_0] Write session: Do CDS request
2025-10-10T14:39:04.562380Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|545c785-3f8e986b-87381ae2-8225de9f_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:04.572438Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|545c785-3f8e986b-87381ae2-8225de9f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:04.572626Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:04.572644Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2873
2025-10-10T14:39:04.572807Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2873 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:04.572862Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2873 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:04.572878Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2873 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:04.572883Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:04.573903Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2873 sessionId:  describe result for acl check
2025-10-10T14:39:04.573948Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:04.573950Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:04.573952Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:04.573958Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602623254226798:5340] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:04.574561Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602623254226798:5340] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:04.580138Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602623254226798:5340] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:04.586360Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602623254226798:5340] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:04.586378Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602623254226798:5340] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:04.586382Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602623254226798:5340] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:04.586392Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2873 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:04.586452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:04.594408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:04.594687Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:04.594701Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:04.594713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:04.594773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:04.594820Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602622471986952:7983]
2025-10-10T14:39:04.595469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:04.595944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:04.596040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:04.596417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:04.596507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:04.596514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:04.596515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:04.596517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:04.596518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:04.596521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:04.596523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:04.596524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:04.596526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:04.596527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:04.596533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:04.596534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:04.596535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:04.596541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:04.596555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:04.596558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:04.596562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:04.596566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:04.596569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:04.596573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:04.596576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:04.596579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:04.596584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:04.596587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:04.596590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:04.596593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:04.596603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:04.596611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:04.596618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:04.596625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:04.596634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:04.596640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:04.596645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:04.596650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:04.596655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:04.596660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:04.596665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:04.596672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:04.596677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:04.596682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:04.596687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:04.596693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:04.596698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:04.596704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:04.596709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:04.596724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:04.596728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:04.596733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:04.596737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:04.596755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:04.596760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:04.596765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:04.596801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:04.606505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:04.606839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:04.606850Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:04.606853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:04.606857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:04.606864Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2872 [2:7559602622471986952:7983]
2025-10-10T14:39:04.606881Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:04.606912Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:04.606922Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:04.606925Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:04.606928Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:04.606946Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:04.606955Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:04.606963Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:04.607028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:04.607036Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:04.607038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:04.607041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:04.607117Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:04.607124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:04.607135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:04.607150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:04.607170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:04.607196Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602622471986945:7983]
2025-10-10T14:39:04.607202Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602622471986945:7983]
2025-10-10T14:39:04.607204Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602622471986945:7983]
2025-10-10T14:39:04.607218Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:04.607233Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:04.607255Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:04.607259Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:04.607274Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:04.607279Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:04.607281Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:04.607298Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602622471986945:7983]
2025-10-10T14:39:04.607305Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:04.607370Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:04.607664Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2872
2025-10-10T14:39:04.607677Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2872
2025-10-10T14:39:04.607687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602623254226970:5340], now have 1 active actors on pipe
2025-10-10T14:39:04.607697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602623254226765:2438], now have 1 active actors on pipe
2025-10-10T14:39:04.607775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:04.607791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:04.607831Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|45258409-96e332ac-88b937ff-3c38ec4d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:04.607848Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:04.607857Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:04.607860Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:04.607874Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:04.607893Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:04.607916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:04.608127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:04.608139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:04.608160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:04.608263Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2873 partition: 0 MaxSeqNo: 40 sessionId: src_id|45258409-96e332ac-88b937ff-3c38ec4d_0
2025-10-10T14:39:04.608689Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|545c785-3f8e986b-87381ae2-8225de9f_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|45258409-96e332ac-88b937ff-3c38ec4d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:04.611476Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|45258409-96e332ac-88b937ff-3c38ec4d_0] Write session: try to update token
2025-10-10T14:39:04.611496Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|45258409-96e332ac-88b937ff-3c38ec4d_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:04.627904Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2873 sessionId: src_id|45258409-96e332ac-88b937ff-3c38ec4d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:04.630302Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:04.630318Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:04.630322Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:04.630323Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:04.630336Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602622471986945:7983]
2025-10-10T14:39:04.630342Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602622471986945:7983]
2025-10-10T14:39:04.630345Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602622471986945:7983]
2025-10-10T14:39:04.630397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:04.630405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:04.630407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:04.630572Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:04.631263Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:04.631451Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:04.631490Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:04.631496Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:04.662238Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602623254226997:6861]
2025-10-10T14:39:04.663513Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 pipe creation result: OK TabletId: 72075186224037892 Generation: 2872, pipe: [1:7559602623254226997:6861]
2025-10-10T14:39:04.748959Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:04.750146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:04.750168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:04.750218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602623254226997:6861], now have 1 active actors on pipe
2025-10-10T14:39:04.750541Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:04.750959Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 71 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602623254226997:6861]
2025-10-10T14:39:04.750967Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:39:04.750990Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:04.751044Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2873 reason: status is not ok: tablet will be restarted right now sessionId: src_id|45258409-96e332ac-88b937ff-3c38ec4d_0
2025-10-10T14:39:04.751241Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2873 sessionId: src_id|45258409-96e332ac-88b937ff-3c38ec4d_0 is DEAD
2025-10-10T14:39:04.755147Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45258409-96e332ac-88b937ff-3c38ec4d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:39:04.755161Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45258409-96e332ac-88b937ff-3c38ec4d_0] Write session will restart in 0.005341s
2025-10-10T14:39:04.755190Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45258409-96e332ac-88b937ff-3c38ec4d_0] Write session: Do CDS request
2025-10-10T14:39:04.755196Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45258409-96e332ac-88b937ff-3c38ec4d_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:04.761952Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|45258409-96e332ac-88b937ff-3c38ec4d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:04.762350Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:04.762367Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2874
2025-10-10T14:39:04.762496Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2874 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:04.762533Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2874 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:04.762542Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2874 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:04.762546Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:04.763540Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2874 sessionId:  describe result for acl check
2025-10-10T14:39:04.763581Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:04.763583Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:04.763585Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:04.763592Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602623254227024:5328] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:04.764171Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602623254227024:5328] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:04.767447Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602623254227024:5328] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:04.772420Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602623254227024:5328] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:04.772436Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602623254227024:5328] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:04.772440Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602623254227024:5328] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:04.772449Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2874 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:04.780936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:04.785443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:04.785722Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:04.785728Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:04.785740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:04.785798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:04.785841Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602622471987166:7974]
2025-10-10T14:39:04.786523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:04.788659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:04.788725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:04.789093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:04.789149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:04.789151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:04.789152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:04.789153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:04.789154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:04.789156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:04.789158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:04.789159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:04.789161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:04.789162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:04.789164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:04.789165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:04.789166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:04.789174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:04.789189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:04.789194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:04.789198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:04.789203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:04.789208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:04.789212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:04.789216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:04.789221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:04.789241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:04.789245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:04.789250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:04.789254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:04.789264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:04.789275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:04.789283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:04.789290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:04.789296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:04.789302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:04.789313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:04.789318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:04.789324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:04.789344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:04.789349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:04.789355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:04.789361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:04.789367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:04.789373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:04.789393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:04.789399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:04.789405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:04.789411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:04.789417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:04.789424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:04.789430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:04.789437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:04.789442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:04.789447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:04.789453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:04.789501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:04.792619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:04.793233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:04.793246Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:04.793248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:04.793252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:04.793258Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2873 [2:7559602622471987166:7974]
2025-10-10T14:39:04.793280Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:04.793304Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:04.793307Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:04.793311Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:04.793314Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:04.793347Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:04.793355Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:04.793364Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:04.793445Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:04.793447Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:04.793449Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:04.793451Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:04.793533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:04.793536Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:04.793550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:04.793560Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:04.793575Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:04.793598Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602622471987160:7974]
2025-10-10T14:39:04.793600Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602622471987160:7974]
2025-10-10T14:39:04.793603Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602622471987160:7974]
2025-10-10T14:39:04.793618Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:04.793633Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:04.793648Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:04.793652Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:04.793681Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602622471987160:7974]
2025-10-10T14:39:04.793683Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:04.793980Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:04.793993Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:04.793996Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:04.794011Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:04.794038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602623254227168:5328], now have 1 active actors on pipe
2025-10-10T14:39:04.794118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602623254226999:2438], now have 1 active actors on pipe
2025-10-10T14:39:04.794208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:04.794219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:04.794118Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2873
2025-10-10T14:39:04.794257Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e1e7ccb7-1f889dd4-4186525-69eb8e75_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:04.794166Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2873
2025-10-10T14:39:04.794272Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:04.794282Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:04.794285Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:04.794310Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:04.794328Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:04.794349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:04.794528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:04.794542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:04.794566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:04.794684Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2874 partition: 0 MaxSeqNo: 40 sessionId: src_id|e1e7ccb7-1f889dd4-4186525-69eb8e75_0
2025-10-10T14:39:04.795110Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45258409-96e332ac-88b937ff-3c38ec4d_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|e1e7ccb7-1f889dd4-4186525-69eb8e75_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:04.797882Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e1e7ccb7-1f889dd4-4186525-69eb8e75_0] Write session: try to update token
2025-10-10T14:39:04.797903Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e1e7ccb7-1f889dd4-4186525-69eb8e75_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:04.806957Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:39:04.806977Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:04.806988Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602622471987160:7974]
2025-10-10T14:39:04.807042Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:39:04.807223Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:39:04.807371Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:04.807517Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:04.807654Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:04.807854Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:39:04.807898Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:39:04.809451Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:39:04.815486Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2874 sessionId: src_id|e1e7ccb7-1f889dd4-4186525-69eb8e75_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:04.818228Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:04.820959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:04.820983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:04.821024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:39:04.821177Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:39:04.826043Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:04.826067Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:04.826070Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:04.826073Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:04.826083Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602622471987160:7974]
2025-10-10T14:39:04.826087Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602622471987160:7974]
2025-10-10T14:39:04.826091Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602622471987160:7974]
2025-10-10T14:39:04.826140Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:04.826144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:04.826153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:04.826155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:04.826165Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:04.826169Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:04.826300Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:04.851179Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602623254227222:6861]
2025-10-10T14:39:04.851503Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 pipe creation result: OK TabletId: 72075186224037892 Generation: 2873, pipe: [1:7559602623254227222:6861]
2025-10-10T14:39:04.944192Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:04.953853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:04.953890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:04.954105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:04.954178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:04.954252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:04.954322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:04.954372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:04.954381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:04.954457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:04.954529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:04.954600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:04.954667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:04.954713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:04.954722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:04.954803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:04.954885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:04.954966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:04.955039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:04.955083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:04.955086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:04.955170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:04.955233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:04.955303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:04.955371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:04.955412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:04.955418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:04.955495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:04.955557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:04.955624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:04.955699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:04.955817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:04.955821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:04.955899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:04.955965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:04.956036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:04.956104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:04.956154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:04.956157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:04.956241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:04.956311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:04.956388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:04.956457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:04.956508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:04.956511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:04.956590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:04.956651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:04.956729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:04.956799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:04.956852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:04.956855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:04.956939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:04.957007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:04.957080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:04.957171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:04.957221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:04.957224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:04.957302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:04.957642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:04.957735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:04.957816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:04.957876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:04.957885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:04.957974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602623254227222:6861], now have 1 active actors on pipe
2025-10-10T14:39:04.959847Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:04.960754Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1e7ccb7-1f889dd4-4186525-69eb8e75_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:04.960770Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1e7ccb7-1f889dd4-4186525-69eb8e75_0] Write session will restart in 0.007117s
2025-10-10T14:39:04.960797Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1e7ccb7-1f889dd4-4186525-69eb8e75_0] Write session: Do CDS request
2025-10-10T14:39:04.960804Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1e7ccb7-1f889dd4-4186525-69eb8e75_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:04.960030Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:04.960098Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:04.960101Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:04.960137Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2874 reason: error at write: Disconnected sessionId: src_id|e1e7ccb7-1f889dd4-4186525-69eb8e75_0
2025-10-10T14:39:04.960374Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2874 sessionId: src_id|e1e7ccb7-1f889dd4-4186525-69eb8e75_0 is DEAD
2025-10-10T14:39:04.960406Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 72 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602623254227222:6861]
2025-10-10T14:39:04.969001Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e1e7ccb7-1f889dd4-4186525-69eb8e75_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:04.969306Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:04.969322Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2875
2025-10-10T14:39:04.973638Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2875 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:04.973699Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2875 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:04.973706Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2875 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:04.973713Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:04.974531Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2875 sessionId:  describe result for acl check
2025-10-10T14:39:04.974574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:04.974576Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:04.974578Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:04.974585Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602623254227241:5321] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:04.975191Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602623254227241:5321] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:04.978906Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602623254227241:5321] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:04.981967Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602623254227241:5321] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:04.981984Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602623254227241:5321] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:04.981988Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602623254227241:5321] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:04.981997Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2875 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:04.997234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:05.002670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:05.002988Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:05.003015Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:05.003037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:05.003128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:05.003178Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602626766954678:7971]
2025-10-10T14:39:05.003814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:05.004318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:05.004382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:05.004741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:05.004814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:05.004816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:05.004817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:05.004819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:05.004820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:05.004822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:05.004823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:05.004824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:05.004826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:05.004827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:05.004828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:05.004829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:05.004831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:05.004838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:05.004852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:05.004856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:05.004861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:05.004865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:05.004869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:05.004873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:05.004878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:05.004882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:05.004887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:05.004891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:05.004895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:05.004899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:05.004908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:05.004917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:05.004924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:05.004930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:05.004935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:05.004940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:05.004945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:05.004949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:05.004952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:05.004955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:05.004959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:05.004964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:05.004969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:05.004975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:05.004980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:05.004985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:05.004990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:05.004995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:05.005002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:05.005007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:05.005012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:05.005017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:05.005022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:05.005027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:05.005032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:05.005038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:05.005080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:05.008139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:05.008785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:05.008798Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:05.008801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:05.008805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:05.008813Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2874 [2:7559602626766954678:7971]
2025-10-10T14:39:05.008829Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:05.008850Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:05.008859Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:05.008862Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:05.008865Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:05.008883Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:05.008891Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:05.008900Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:05.008970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:05.008978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:05.008980Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:05.008983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:05.009056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:05.009066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:05.009079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:05.009091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:05.009108Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:05.009136Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602622471987377:7971]
2025-10-10T14:39:05.009144Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602622471987377:7971]
2025-10-10T14:39:05.009146Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602622471987377:7971]
2025-10-10T14:39:05.009166Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:05.009182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602623254227230:2438], now have 1 active actors on pipe
2025-10-10T14:39:05.009184Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:05.009187Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:05.009189Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:05.009191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602623254227282:5321], now have 1 active actors on pipe
2025-10-10T14:39:05.009201Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:05.009218Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:05.009221Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:05.009256Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602622471987377:7971]
2025-10-10T14:39:05.009270Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:05.009285Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:05.009256Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2874
2025-10-10T14:39:05.009280Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2874
2025-10-10T14:39:05.009567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:05.009581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:05.009627Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dbfd47d3-bfec5a0e-14557c87-d1332ac4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:05.009636Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:05.009641Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:05.009644Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:05.009658Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:05.009673Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:05.009696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:05.013584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:05.013605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:05.013641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:05.013815Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2875 partition: 0 MaxSeqNo: 40 sessionId: src_id|dbfd47d3-bfec5a0e-14557c87-d1332ac4_0
2025-10-10T14:39:05.017670Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1e7ccb7-1f889dd4-4186525-69eb8e75_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|dbfd47d3-bfec5a0e-14557c87-d1332ac4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:05.020559Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dbfd47d3-bfec5a0e-14557c87-d1332ac4_0] Write session: try to update token
2025-10-10T14:39:05.020589Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dbfd47d3-bfec5a0e-14557c87-d1332ac4_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:05.030571Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:05.030591Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:05.030599Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:05.030601Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:05.030610Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602622471987377:7971]
2025-10-10T14:39:05.030615Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602622471987377:7971]
2025-10-10T14:39:05.030622Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602622471987377:7971]
2025-10-10T14:39:05.030679Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:05.030683Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:05.030686Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:05.030689Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:05.030692Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:05.030699Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:05.030830Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:05.045090Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2875 sessionId: src_id|dbfd47d3-bfec5a0e-14557c87-d1332ac4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:05.047751Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:05.060599Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602627549194742:6861]
2025-10-10T14:39:05.060967Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 pipe creation result: OK TabletId: 72075186224037892 Generation: 2874, pipe: [1:7559602627549194742:6861]
2025-10-10T14:39:05.158869Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:05.159570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:05.159583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:05.159632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602627549194742:6861], now have 1 active actors on pipe
2025-10-10T14:39:05.159891Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:05.160010Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 73 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602627549194742:6861]
2025-10-10T14:39:05.160043Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:05.160084Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:05.160086Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:05.160160Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2875 reason: error at write: Disconnected sessionId: src_id|dbfd47d3-bfec5a0e-14557c87-d1332ac4_0
2025-10-10T14:39:05.160372Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2875 sessionId: src_id|dbfd47d3-bfec5a0e-14557c87-d1332ac4_0 is DEAD
2025-10-10T14:39:05.165617Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dbfd47d3-bfec5a0e-14557c87-d1332ac4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:05.165633Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dbfd47d3-bfec5a0e-14557c87-d1332ac4_0] Write session will restart in 0.007017s
2025-10-10T14:39:05.165659Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dbfd47d3-bfec5a0e-14557c87-d1332ac4_0] Write session: Do CDS request
2025-10-10T14:39:05.165669Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dbfd47d3-bfec5a0e-14557c87-d1332ac4_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:05.173909Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dbfd47d3-bfec5a0e-14557c87-d1332ac4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:05.175022Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:05.175040Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2876
2025-10-10T14:39:05.175237Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2876 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:05.175281Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2876 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:05.175287Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2876 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:05.175292Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:05.175845Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2876 sessionId:  describe result for acl check
2025-10-10T14:39:05.175878Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:05.175880Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:05.175881Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:05.175889Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602627549194871:5295] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:05.176509Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602627549194871:5295] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:05.179656Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602627549194871:5295] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:05.181738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:05.182564Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602627549194871:5295] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:05.182581Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602627549194871:5295] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:05.182585Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602627549194871:5295] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:05.182596Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2876 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:05.186931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:05.187224Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:05.187236Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:05.187250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:05.187315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:05.187375Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602626766954895:7963]
2025-10-10T14:39:05.188020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:05.188424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:05.188479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:05.188832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:05.188904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:05.188911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:05.188913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:05.188915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:05.188917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:05.188918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:05.188920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:05.188921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:05.188923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:05.188924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:05.188926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:05.188927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:05.188928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:05.188936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:05.188950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:05.188954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:05.188958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:05.188962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:05.188966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:05.188970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:05.188973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:05.188977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:05.188985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:05.188990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:05.188994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:05.188998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:05.189008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:05.189018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:05.189025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:05.189031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:05.189037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:05.189043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:05.189048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:05.189054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:05.189060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:05.189066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:05.189071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:05.189077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:05.189082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:05.189088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:05.189092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:05.189103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:05.189108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:05.189114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:05.189119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:05.189124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:05.189130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:05.189135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:05.189140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:05.189145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:05.189150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:05.189156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:05.189215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:05.192613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:05.192994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:05.193009Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:05.193012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:05.193017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:05.193025Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2875 [2:7559602626766954895:7963]
2025-10-10T14:39:05.193040Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:05.193060Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:05.193068Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:05.193073Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:05.193075Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:05.193096Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:05.193114Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:05.193126Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:05.193197Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:05.193205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:05.193207Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:05.193210Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:05.193304Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:05.193312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:05.193324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:05.193353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:05.193387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:05.193417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602627549194745:2438], now have 1 active actors on pipe
2025-10-10T14:39:05.193427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602627549194952:5295], now have 1 active actors on pipe
2025-10-10T14:39:05.193435Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602626766954889:7963]
2025-10-10T14:39:05.193437Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602626766954889:7963]
2025-10-10T14:39:05.193439Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602626766954889:7963]
2025-10-10T14:39:05.193454Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:05.193430Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2875
2025-10-10T14:39:05.193468Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:05.193474Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:05.193478Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:05.193480Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:05.193491Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:05.193495Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:05.193489Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2875
2025-10-10T14:39:05.193535Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602626766954889:7963]
2025-10-10T14:39:05.193548Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:05.193578Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:05.193725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:05.193739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:05.193784Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|475881de-a36c8455-b72694f-dcc7b18f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:05.193800Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:05.193805Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:05.193808Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:05.193823Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:05.193835Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:05.193854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:05.194148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:05.194162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:05.194188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:05.194308Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2876 partition: 0 MaxSeqNo: 40 sessionId: src_id|475881de-a36c8455-b72694f-dcc7b18f_0
2025-10-10T14:39:05.194732Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dbfd47d3-bfec5a0e-14557c87-d1332ac4_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|475881de-a36c8455-b72694f-dcc7b18f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:05.197577Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|475881de-a36c8455-b72694f-dcc7b18f_0] Write session: try to update token
2025-10-10T14:39:05.197601Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|475881de-a36c8455-b72694f-dcc7b18f_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:05.212360Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2876 sessionId: src_id|475881de-a36c8455-b72694f-dcc7b18f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:05.214056Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:05.214086Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:05.214090Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:05.214091Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:05.214101Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602626766954889:7963]
2025-10-10T14:39:05.214106Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602626766954889:7963]
2025-10-10T14:39:05.214109Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602626766954889:7963]
2025-10-10T14:39:05.214161Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:05.214168Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:05.214176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:05.214176Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:05.214178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:05.214181Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:05.214322Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:05.215180Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:05.260257Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602627549194964:6861]
2025-10-10T14:39:05.260697Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 pipe creation result: OK TabletId: 72075186224037892 Generation: 2875, pipe: [1:7559602627549194964:6861]
2025-10-10T14:39:05.329712Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:05.330344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:05.330363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:05.330411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602627549194964:6861], now have 1 active actors on pipe
2025-10-10T14:39:05.330796Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:05.330865Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 74 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602627549194964:6861]
2025-10-10T14:39:05.330886Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:05.330891Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:05.330637Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:05.330960Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2876 reason: error at write: Disconnected sessionId: src_id|475881de-a36c8455-b72694f-dcc7b18f_0
2025-10-10T14:39:05.331167Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2876 sessionId: src_id|475881de-a36c8455-b72694f-dcc7b18f_0 is DEAD
2025-10-10T14:39:05.331362Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|475881de-a36c8455-b72694f-dcc7b18f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:05.331377Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|475881de-a36c8455-b72694f-dcc7b18f_0] Write session will restart in 0.007920s
2025-10-10T14:39:05.331407Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|475881de-a36c8455-b72694f-dcc7b18f_0] Write session: Do CDS request
2025-10-10T14:39:05.331414Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|475881de-a36c8455-b72694f-dcc7b18f_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:05.341020Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|475881de-a36c8455-b72694f-dcc7b18f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:05.341080Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:05.341096Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2877
2025-10-10T14:39:05.341288Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2877 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:05.341359Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2877 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:05.341383Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2877 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:05.341389Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:05.341955Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2877 sessionId:  describe result for acl check
2025-10-10T14:39:05.341995Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:05.342001Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:05.342003Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:05.342011Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602627549195021:5285] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:05.342648Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602627549195021:5285] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:05.347064Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602627549195021:5285] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:05.350847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602627549195021:5285] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:05.350864Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602627549195021:5285] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:05.350869Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602627549195021:5285] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:05.350880Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2877 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:05.357078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:05.358198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:05.358432Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:05.358443Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:05.358455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:05.358521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:05.358570Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602626766955114:7956]
2025-10-10T14:39:05.359242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:05.359604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:05.359654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:05.360054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:05.360112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:05.360118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:05.360119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:05.360120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:05.360122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:05.360123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:05.360125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:05.360126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:05.360127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:05.360128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:05.360129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:05.360130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:05.360132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:05.360137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:05.360151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:05.360155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:05.360159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:05.360163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:05.360167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:05.360170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:05.360174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:05.360179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:05.360183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:05.360187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:05.360191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:05.360194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:05.360203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:05.360212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:05.360218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:05.360224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:05.360228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:05.360233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:05.360238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:05.360243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:05.360248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:05.360254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:05.360258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:05.360263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:05.360268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:05.360273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:05.360277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:05.360282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:05.360286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:05.360293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:05.360302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:05.360307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:05.360312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:05.360316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:05.360327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:05.360333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:05.360338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:05.360347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:05.360403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:05.363266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:05.364205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:05.364219Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:05.364222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:05.364226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:05.364233Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2876 [2:7559602626766955114:7956]
2025-10-10T14:39:05.364248Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:05.364268Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:05.364282Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:05.364294Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:05.364296Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:05.364316Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:05.364324Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:05.364332Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:05.364411Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:05.364418Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:05.364420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:05.364423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:05.364504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:05.364513Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:05.364527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:05.364538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:05.364559Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:05.364591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602627549195171:5285], now have 1 active actors on pipe
2025-10-10T14:39:05.364605Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602626766955109:7956]
2025-10-10T14:39:05.364612Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602626766955109:7956]
2025-10-10T14:39:05.364615Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602626766955109:7956]
2025-10-10T14:39:05.364630Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:05.364645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602627549194966:2438], now have 1 active actors on pipe
2025-10-10T14:39:05.364653Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:05.364658Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:05.364658Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:05.364660Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:05.364673Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:05.364676Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:05.364712Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602626766955109:7956]
2025-10-10T14:39:05.364720Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:05.364680Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2876
2025-10-10T14:39:05.364727Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:05.364685Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2876
2025-10-10T14:39:05.364763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:05.364772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:05.364806Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|666eaf9d-4b066a39-e14fda46-229c4098_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:05.364817Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:05.364822Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:05.364824Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:05.364838Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:05.364850Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:05.364868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:05.365085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:05.365097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:05.365126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:05.365224Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2877 partition: 0 MaxSeqNo: 40 sessionId: src_id|666eaf9d-4b066a39-e14fda46-229c4098_0
2025-10-10T14:39:05.365704Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|475881de-a36c8455-b72694f-dcc7b18f_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|666eaf9d-4b066a39-e14fda46-229c4098_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:05.368728Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|666eaf9d-4b066a39-e14fda46-229c4098_0] Write session: try to update token
2025-10-10T14:39:05.368751Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|666eaf9d-4b066a39-e14fda46-229c4098_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:05.376888Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:39:05.376903Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:05.376914Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602626766955109:7956]
2025-10-10T14:39:05.376964Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:39:05.376968Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:39:05.377141Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:39:05.377302Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:05.377496Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:05.377644Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:05.377838Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:39:05.377885Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:39:05.388193Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2877 sessionId: src_id|666eaf9d-4b066a39-e14fda46-229c4098_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:05.391089Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:05.391625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:05.391649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:05.391699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:39:05.391825Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:39:05.395705Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:05.395723Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:05.395727Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:05.395729Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:05.395742Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602626766955109:7956]
2025-10-10T14:39:05.395746Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602626766955109:7956]
2025-10-10T14:39:05.395750Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602626766955109:7956]
2025-10-10T14:39:05.395795Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:05.395800Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:05.395802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:05.395804Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:05.395810Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:05.395813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:05.395958Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:05.431208Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602627549195198:6861]
2025-10-10T14:39:05.431544Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 pipe creation result: OK TabletId: 72075186224037892 Generation: 2876, pipe: [1:7559602627549195198:6861]
2025-10-10T14:39:05.511798Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:05.521303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:05.521417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:05.521623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:05.521696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:05.521768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:05.521832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:05.521877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:05.521882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:05.521960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:05.522025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:05.522088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:05.522159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:05.522212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:05.522216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:05.522293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:05.522355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:05.522422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:05.522484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:05.522528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:05.522531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:05.522612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:05.522679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:05.522748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:05.522830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:05.522874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:05.522877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:05.522956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:05.523019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:05.523094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:05.523166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:05.523215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:05.523219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:05.523298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:05.523362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:05.523428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:05.523496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:05.523543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:05.523546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:05.523621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:05.523686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:05.523756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:05.523831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:05.523875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:05.523878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:05.523960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:05.524025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:05.524093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:05.524163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:05.524211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:05.524214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:05.524286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:05.524345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:05.524410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:05.524476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:05.524524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:05.524526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:05.524602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:05.524663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:05.524729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:05.524792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:05.524835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:05.524839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:05.524946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602627549195198:6861], now have 1 active actors on pipe
2025-10-10T14:39:05.525723Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:05.527184Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|666eaf9d-4b066a39-e14fda46-229c4098_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:39:05.527199Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|666eaf9d-4b066a39-e14fda46-229c4098_0] Write session will restart in 0.009199s
2025-10-10T14:39:05.527226Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|666eaf9d-4b066a39-e14fda46-229c4098_0] Write session: Do CDS request
2025-10-10T14:39:05.527242Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|666eaf9d-4b066a39-e14fda46-229c4098_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:05.526708Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 75 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602627549195198:6861]
2025-10-10T14:39:05.526744Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:39:05.526792Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2877 reason: status is not ok: tablet will be restarted right now sessionId: src_id|666eaf9d-4b066a39-e14fda46-229c4098_0
2025-10-10T14:39:05.526996Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2877 sessionId: src_id|666eaf9d-4b066a39-e14fda46-229c4098_0 is DEAD
2025-10-10T14:39:05.527167Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:05.537914Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|666eaf9d-4b066a39-e14fda46-229c4098_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:05.538322Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:05.538339Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2878
2025-10-10T14:39:05.538499Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2878 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:05.538531Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2878 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:05.538552Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2878 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:05.538558Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:05.539070Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2878 sessionId:  describe result for acl check
2025-10-10T14:39:05.539104Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:05.539107Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:05.539109Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:05.539115Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602627549195220:5236] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:05.539729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602627549195220:5236] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:05.544215Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602627549195220:5236] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:05.552052Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602627549195220:5236] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:05.552069Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602627549195220:5236] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:05.552073Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602627549195220:5236] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:05.552084Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2878 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:05.560695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:05.564711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:05.564984Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:05.564997Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:05.565011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:05.565083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:05.565132Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602626766955382:7904]
2025-10-10T14:39:05.565859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:05.566250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:05.566325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:05.566698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:05.566788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:05.566795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:05.566797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:05.566798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:05.566799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:05.566801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:05.566802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:05.566804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:05.566805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:05.566806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:05.566807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:05.566809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:05.566810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:05.566817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:05.566831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:05.566835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:05.566839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:05.566844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:05.566848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:05.566852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:05.566856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:05.566860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:05.566865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:05.566869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:05.566873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:05.566877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:05.566888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:05.566898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:05.566905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:05.566909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:05.566914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:05.566918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:05.566922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:05.566927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:05.566932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:05.566938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:05.566942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:05.566947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:05.566951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:05.566956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:05.566960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:05.566965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:05.566970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:05.566975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:05.566979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:05.566984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:05.566998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:05.567003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:05.567008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:05.567015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:05.567023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:05.567028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:05.567070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:05.570027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:05.571083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:05.571090Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:05.571094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:05.571098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:05.571105Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2877 [2:7559602626766955382:7904]
2025-10-10T14:39:05.571122Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:05.571154Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:05.571159Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:05.571162Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:05.571165Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:05.571185Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:05.571193Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:05.571201Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:05.571274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:05.571276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:05.571278Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:05.571282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:05.571358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:05.571362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:05.571375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:05.571387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:05.571405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:05.571428Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602626766955377:7904]
2025-10-10T14:39:05.571430Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602626766955377:7904]
2025-10-10T14:39:05.571433Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602626766955377:7904]
2025-10-10T14:39:05.571448Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:05.571463Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:05.571479Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:05.571483Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:05.571522Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602626766955377:7904]
2025-10-10T14:39:05.571527Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:05.571827Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:05.571831Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:05.571832Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:05.571839Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:05.572199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602627549195346:5236], now have 1 active actors on pipe
2025-10-10T14:39:05.572213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602627549195212:2438], now have 1 active actors on pipe
2025-10-10T14:39:05.572239Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2877
2025-10-10T14:39:05.572277Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2877
2025-10-10T14:39:05.572353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:05.572365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:05.572404Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c329494c-18fdc0a7-8893b902-cf24c1aa_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:05.572414Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:05.572419Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:05.572422Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:05.572435Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:05.572448Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:05.572469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:05.572765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:05.572771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:05.572789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:05.572900Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2878 partition: 0 MaxSeqNo: 40 sessionId: src_id|c329494c-18fdc0a7-8893b902-cf24c1aa_0
2025-10-10T14:39:05.573324Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|666eaf9d-4b066a39-e14fda46-229c4098_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|c329494c-18fdc0a7-8893b902-cf24c1aa_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:05.576114Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c329494c-18fdc0a7-8893b902-cf24c1aa_0] Write session: try to update token
2025-10-10T14:39:05.576136Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c329494c-18fdc0a7-8893b902-cf24c1aa_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:05.592517Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:05.592535Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:05.592539Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:05.592541Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:05.592552Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602626766955377:7904]
2025-10-10T14:39:05.592556Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602626766955377:7904]
2025-10-10T14:39:05.592561Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602626766955377:7904]
2025-10-10T14:39:05.592612Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:05.592615Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:05.592620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:05.592622Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:05.592634Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:05.592639Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:05.592767Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:05.596988Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2878 sessionId: src_id|c329494c-18fdc0a7-8893b902-cf24c1aa_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:05.599726Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:05.625797Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602627549195433:6861]
2025-10-10T14:39:05.626163Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 pipe creation result: OK TabletId: 72075186224037892 Generation: 2877, pipe: [1:7559602627549195433:6861]
2025-10-10T14:39:05.709183Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:05.709828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:05.709847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:05.709897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602627549195433:6861], now have 1 active actors on pipe
2025-10-10T14:39:05.710117Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:05.710164Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:05.710177Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:05.710251Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2878 reason: error at write: Disconnected sessionId: src_id|c329494c-18fdc0a7-8893b902-cf24c1aa_0
2025-10-10T14:39:05.710471Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2878 sessionId: src_id|c329494c-18fdc0a7-8893b902-cf24c1aa_0 is DEAD
2025-10-10T14:39:05.710551Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:05.710594Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 76 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602627549195433:6861]
2025-10-10T14:39:05.713596Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c329494c-18fdc0a7-8893b902-cf24c1aa_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:05.713609Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c329494c-18fdc0a7-8893b902-cf24c1aa_0] Write session will restart in 0.006397s
2025-10-10T14:39:05.713634Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c329494c-18fdc0a7-8893b902-cf24c1aa_0] Write session: Do CDS request
2025-10-10T14:39:05.713658Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c329494c-18fdc0a7-8893b902-cf24c1aa_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:05.720917Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c329494c-18fdc0a7-8893b902-cf24c1aa_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:05.721030Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:05.721057Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2879
2025-10-10T14:39:05.721481Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2879 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:05.721528Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2879 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:05.721550Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2879 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:05.721554Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:05.722042Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2879 sessionId:  describe result for acl check
2025-10-10T14:39:05.722084Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:05.722086Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:05.722087Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:05.722096Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602627549195463:5229] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:05.722668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602627549195463:5229] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:05.727446Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602627549195463:5229] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:05.734176Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602627549195463:5229] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:05.734194Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602627549195463:5229] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:05.734198Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602627549195463:5229] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:05.734207Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2879 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:05.736386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:05.740761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:05.741017Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:05.741029Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:05.741040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:05.741100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:05.741147Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602626766955601:7884]
2025-10-10T14:39:05.741825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:05.742249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:05.742319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:05.742698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:05.742760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:05.742766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:05.742768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:05.742769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:05.742770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:05.742772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:05.742773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:05.742774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:05.742776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:05.742778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:05.742779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:05.742780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:05.742782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:05.742789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:05.742803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:05.742808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:05.742812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:05.742817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:05.742822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:05.742826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:05.742830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:05.742834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:05.742840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:05.742844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:05.742849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:05.742854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:05.742870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:05.742883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:05.742894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:05.742899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:05.742904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:05.742910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:05.742916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:05.742926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:05.742932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:05.742941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:05.742947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:05.742956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:05.742961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:05.742971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:05.742976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:05.742986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:05.742991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:05.743001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:05.743007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:05.743016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:05.743022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:05.743031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:05.743036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:05.743045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:05.743051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:05.743061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:05.743113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:05.746020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:05.746777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:05.746789Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:05.746791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:05.746795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:05.746802Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2878 [2:7559602626766955601:7884]
2025-10-10T14:39:05.746820Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:05.746842Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:05.746846Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:05.746849Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:05.746852Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:05.746871Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:05.746887Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:05.746897Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:05.746962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:05.746969Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:05.746971Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:05.746974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:05.747043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:05.747050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:05.747062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:05.747075Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:05.747095Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:05.747120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602627549195448:2438], now have 1 active actors on pipe
2025-10-10T14:39:05.747128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602627549195656:5229], now have 1 active actors on pipe
2025-10-10T14:39:05.747136Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602626766955596:7884]
2025-10-10T14:39:05.747139Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602626766955596:7884]
2025-10-10T14:39:05.747141Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602626766955596:7884]
2025-10-10T14:39:05.747159Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:05.747175Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:05.747193Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:05.747199Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:05.747202Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:05.747203Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:05.747206Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:05.747236Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602626766955596:7884]
2025-10-10T14:39:05.747247Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:05.747254Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:05.747270Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2878
2025-10-10T14:39:05.747304Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2878
2025-10-10T14:39:05.747462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:05.747473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:05.747509Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|395dff2e-f6a0f56f-96bfa3bb-9d0201b2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:05.747523Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:05.747531Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:05.747534Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:05.747547Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:05.747560Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:05.747580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:05.748317Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c329494c-18fdc0a7-8893b902-cf24c1aa_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|395dff2e-f6a0f56f-96bfa3bb-9d0201b2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:05.747815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:05.747823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:05.747838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:05.751159Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|395dff2e-f6a0f56f-96bfa3bb-9d0201b2_0] Write session: try to update token
2025-10-10T14:39:05.751184Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|395dff2e-f6a0f56f-96bfa3bb-9d0201b2_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:05.747925Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2879 partition: 0 MaxSeqNo: 40 sessionId: src_id|395dff2e-f6a0f56f-96bfa3bb-9d0201b2_0
2025-10-10T14:39:05.760208Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:39:05.760224Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:05.760237Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602626766955596:7884]
2025-10-10T14:39:05.760291Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:39:05.760305Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:39:05.761230Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:39:05.761433Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:05.761583Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:05.761730Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:05.761925Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:39:05.761980Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:39:05.766050Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2879 sessionId: src_id|395dff2e-f6a0f56f-96bfa3bb-9d0201b2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:05.768978Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:05.769487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:05.769511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:05.769556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:39:05.769654Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:39:05.778624Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:05.778641Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:05.778645Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:05.778647Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:05.778657Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602626766955596:7884]
2025-10-10T14:39:05.778662Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602626766955596:7884]
2025-10-10T14:39:05.778666Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602626766955596:7884]
2025-10-10T14:39:05.778707Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:05.778711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:05.778714Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:05.778718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:05.778719Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:05.778720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:05.778859Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:05.810639Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602627549195672:6861]
2025-10-10T14:39:05.811005Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 pipe creation result: OK TabletId: 72075186224037892 Generation: 2878, pipe: [1:7559602627549195672:6861]
2025-10-10T14:39:05.896374Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:05.906201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:05.906233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:05.906435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:05.906506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:05.906574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:05.906644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:05.906693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:05.906706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:05.906782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:05.906849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:05.906920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:05.906995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:05.907050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:05.907053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:05.907122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:05.907179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:05.907240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:05.907302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:05.907344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:05.907346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:05.907422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:05.907483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:05.907545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:05.907602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:05.907644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:05.907648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:05.907713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:05.907770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:05.907829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:05.907891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:05.907931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:05.907934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:05.908002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:05.908063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:05.908122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:05.908185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:05.908225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:05.908227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:05.908295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:05.908360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:05.908423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:05.908487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:05.908533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:05.908539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:05.908610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:05.908673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:05.908731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:05.908791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:05.908983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:05.908987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:05.909060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:05.909117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:05.909177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:05.909235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:05.909298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:05.909301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:05.909603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:05.909670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:05.909739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:05.909807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:05.909857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:05.909864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:05.909932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602627549195672:6861], now have 1 active actors on pipe
2025-10-10T14:39:05.910203Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 77 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602627549195672:6861]
2025-10-10T14:39:05.910225Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:05.910229Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:05.910243Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:05.910675Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|395dff2e-f6a0f56f-96bfa3bb-9d0201b2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:05.910686Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|395dff2e-f6a0f56f-96bfa3bb-9d0201b2_0] Write session will restart in 0.006548s
2025-10-10T14:39:05.910712Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|395dff2e-f6a0f56f-96bfa3bb-9d0201b2_0] Write session: Do CDS request
2025-10-10T14:39:05.910730Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|395dff2e-f6a0f56f-96bfa3bb-9d0201b2_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:05.910285Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2879 reason: error at write: Disconnected sessionId: src_id|395dff2e-f6a0f56f-96bfa3bb-9d0201b2_0
2025-10-10T14:39:05.910510Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2879 sessionId: src_id|395dff2e-f6a0f56f-96bfa3bb-9d0201b2_0 is DEAD
2025-10-10T14:39:05.911228Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:05.918893Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|395dff2e-f6a0f56f-96bfa3bb-9d0201b2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:05.919137Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:05.919156Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2880
2025-10-10T14:39:05.919313Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2880 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:05.919363Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2880 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:05.919374Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2880 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:05.919379Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:05.919945Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2880 sessionId:  describe result for acl check
2025-10-10T14:39:05.919984Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:05.919986Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:05.919987Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:05.919994Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602627549195698:5210] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:05.920624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602627549195698:5210] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:05.924111Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602627549195698:5210] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:05.928053Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602627549195698:5210] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:05.928072Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602627549195698:5210] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:05.928076Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602627549195698:5210] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:05.928084Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2880 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:05.937638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:05.943916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:05.944206Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:05.944223Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:05.944238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:05.944308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:05.944362Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602626766955821:7888]
2025-10-10T14:39:05.945040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:05.945428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:05.945583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:05.945950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:05.946030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:05.946037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:05.946039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:05.946040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:05.946042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:05.946043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:05.946045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:05.946046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:05.946048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:05.946049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:05.946050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:05.946052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:05.946053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:05.946062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:05.946076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:05.946081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:05.946086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:05.946090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:05.946096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:05.946100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:05.946105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:05.946109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:05.946115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:05.946120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:05.946125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:05.946129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:05.946138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:05.946148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:05.946156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:05.946162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:05.946168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:05.946175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:05.946200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:05.946207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:05.946213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:05.946221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:05.946226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:05.946232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:05.946238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:05.946245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:05.946249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:05.946255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:05.946262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:05.946269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:05.946274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:05.946280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:05.946292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:05.946298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:05.946302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:05.946308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:05.946314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:05.946320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:05.946367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:05.949155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:05.949945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:05.949963Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:05.949967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:05.949972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:05.949979Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2879 [2:7559602626766955821:7888]
2025-10-10T14:39:05.949993Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:05.950014Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:05.950018Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:05.950023Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:05.950026Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:05.950046Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:05.950055Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:05.950064Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:05.950136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:05.950139Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:05.950141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:05.950145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:05.950228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:05.950237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:05.950254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:05.951822Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2879
2025-10-10T14:39:05.951866Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2879
2025-10-10T14:39:05.950267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:05.950284Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:05.950323Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602626766955816:7888]
2025-10-10T14:39:05.950326Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602626766955816:7888]
2025-10-10T14:39:05.950329Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602626766955816:7888]
2025-10-10T14:39:05.950339Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:05.950350Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:05.950354Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:05.950356Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:05.950358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602627549195683:2438], now have 1 active actors on pipe
2025-10-10T14:39:05.950366Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:05.950384Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:05.950388Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:05.950396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602627549195778:5210], now have 1 active actors on pipe
2025-10-10T14:39:05.950435Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602626766955816:7888]
2025-10-10T14:39:05.950443Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:05.950650Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:05.952614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:05.952646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:05.952689Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|727856df-c89cee8d-7853451f-6876eb81_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:05.952707Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:05.952714Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:05.952717Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:05.952732Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:05.952756Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:05.952778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:05.953046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:05.953060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:05.953085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:05.953243Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2880 partition: 0 MaxSeqNo: 40 sessionId: src_id|727856df-c89cee8d-7853451f-6876eb81_0
2025-10-10T14:39:05.957522Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|395dff2e-f6a0f56f-96bfa3bb-9d0201b2_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|727856df-c89cee8d-7853451f-6876eb81_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:05.960771Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|727856df-c89cee8d-7853451f-6876eb81_0] Write session: try to update token
2025-10-10T14:39:05.960796Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|727856df-c89cee8d-7853451f-6876eb81_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:05.978293Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:05.978312Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:05.978316Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:05.978318Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:05.978330Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602626766955816:7888]
2025-10-10T14:39:05.978335Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602626766955816:7888]
2025-10-10T14:39:05.978339Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602626766955816:7888]
2025-10-10T14:39:05.978392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:05.978400Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:05.978402Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:05.978401Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:05.978408Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:05.978415Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:05.978542Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:05.982291Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2880 sessionId: src_id|727856df-c89cee8d-7853451f-6876eb81_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:05.984992Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:06.010341Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602631844163203:6861]
2025-10-10T14:39:06.010693Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 pipe creation result: OK TabletId: 72075186224037892 Generation: 2879, pipe: [1:7559602631844163203:6861]
2025-10-10T14:39:06.102884Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:06.103659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:06.103679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:06.103725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602631844163203:6861], now have 1 active actors on pipe
2025-10-10T14:39:06.103982Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:06.103983Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:06.103997Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 78 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602631844163203:6861]
2025-10-10T14:39:06.104025Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:06.104042Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:06.104113Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2880 reason: error at write: Disconnected sessionId: src_id|727856df-c89cee8d-7853451f-6876eb81_0
2025-10-10T14:39:06.104325Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2880 sessionId: src_id|727856df-c89cee8d-7853451f-6876eb81_0 is DEAD
2025-10-10T14:39:06.104482Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|727856df-c89cee8d-7853451f-6876eb81_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:06.104495Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|727856df-c89cee8d-7853451f-6876eb81_0] Write session will restart in 0.006775s
2025-10-10T14:39:06.104521Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|727856df-c89cee8d-7853451f-6876eb81_0] Write session: Do CDS request
2025-10-10T14:39:06.104539Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|727856df-c89cee8d-7853451f-6876eb81_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:06.112931Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|727856df-c89cee8d-7853451f-6876eb81_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:06.113048Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:06.113069Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2881
2025-10-10T14:39:06.113225Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2881 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:06.113262Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2881 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:06.113270Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2881 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:06.113279Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:06.113806Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2881 sessionId:  describe result for acl check
2025-10-10T14:39:06.113848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:06.113855Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:06.113857Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:06.113864Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602631844163232:5199] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:06.114504Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602631844163232:5199] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:06.117716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602631844163232:5199] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:06.121789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602631844163232:5199] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:06.121803Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602631844163232:5199] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:06.121807Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602631844163232:5199] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:06.121816Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2881 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:06.128140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:06.128833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:06.129036Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:06.129051Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:06.129062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:06.129108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:06.129152Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602631061923338:7879]
2025-10-10T14:39:06.129829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:06.130285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:06.130338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:06.130674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:06.130737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:06.130746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:06.130748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:06.130750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:06.130751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:06.130752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:06.130753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:06.130755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:06.130757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:06.130758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:06.130759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:06.130761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:06.130762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:06.130768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:06.130781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:06.130785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:06.130788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:06.130792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:06.130797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:06.130800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:06.130804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:06.130808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:06.130812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:06.130815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:06.130820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:06.130823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:06.130832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:06.130842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:06.130851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:06.130856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:06.130861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:06.130871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:06.130876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:06.130881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:06.130886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:06.130891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:06.130896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:06.130906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:06.130911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:06.130922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:06.130934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:06.130940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:06.130945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:06.130951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:06.130956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:06.130962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:06.130967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:06.130972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:06.130976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:06.130981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:06.130988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:06.130998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:06.131036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:06.133815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:06.134185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:06.134205Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:06.134207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:06.134212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:06.134222Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2880 [2:7559602631061923338:7879]
2025-10-10T14:39:06.134238Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:06.134259Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:06.134270Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:06.134275Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:06.134278Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:06.134296Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:06.134303Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:06.134312Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:06.134390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:06.134398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:06.134400Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:06.134403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:06.134473Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:06.134481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:06.134492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:06.134502Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:06.134517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:06.134545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602631844163205:2438], now have 1 active actors on pipe
2025-10-10T14:39:06.134554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602631844163416:5199], now have 1 active actors on pipe
2025-10-10T14:39:06.134561Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602631061923333:7879]
2025-10-10T14:39:06.134564Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602631061923333:7879]
2025-10-10T14:39:06.134566Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602631061923333:7879]
2025-10-10T14:39:06.134581Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:06.134595Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:06.134598Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:06.134600Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:06.134600Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:06.134616Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2880
2025-10-10T14:39:06.134635Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2880
2025-10-10T14:39:06.134616Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:06.134628Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:06.134667Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602631061923333:7879]
2025-10-10T14:39:06.134674Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:06.134688Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:06.134690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:06.134695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:06.134745Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e3ab218a-33045d7d-b73866a0-6644d21a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:06.134757Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:06.134761Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:06.134764Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:06.134776Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:06.134790Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:06.134818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:06.134987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:06.134997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:06.135011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:06.135128Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2881 partition: 0 MaxSeqNo: 40 sessionId: src_id|e3ab218a-33045d7d-b73866a0-6644d21a_0
2025-10-10T14:39:06.135599Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|727856df-c89cee8d-7853451f-6876eb81_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|e3ab218a-33045d7d-b73866a0-6644d21a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:06.138381Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e3ab218a-33045d7d-b73866a0-6644d21a_0] Write session: try to update token
2025-10-10T14:39:06.138405Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e3ab218a-33045d7d-b73866a0-6644d21a_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:06.152926Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2881 sessionId: src_id|e3ab218a-33045d7d-b73866a0-6644d21a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:06.155078Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:06.155097Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:06.155102Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:06.155103Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:06.155112Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602631061923333:7879]
2025-10-10T14:39:06.155116Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602631061923333:7879]
2025-10-10T14:39:06.155120Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602631061923333:7879]
2025-10-10T14:39:06.155175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:06.155177Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:06.155184Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:06.155187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:06.155191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:06.155191Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:06.155375Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:06.155683Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:06.203838Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602631844163430:6861]
2025-10-10T14:39:06.204207Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 pipe creation result: OK TabletId: 72075186224037892 Generation: 2880, pipe: [1:7559602631844163430:6861]
2025-10-10T14:39:06.290314Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:06.290637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:06.290653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:06.290702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602631844163430:6861], now have 1 active actors on pipe
2025-10-10T14:39:06.290920Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:06.291332Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:06.291345Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 79 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602631844163430:6861]
2025-10-10T14:39:06.291348Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:06.291378Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:06.291428Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2881 reason: error at write: Disconnected sessionId: src_id|e3ab218a-33045d7d-b73866a0-6644d21a_0
2025-10-10T14:39:06.291645Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2881 sessionId: src_id|e3ab218a-33045d7d-b73866a0-6644d21a_0 is DEAD
2025-10-10T14:39:06.291834Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e3ab218a-33045d7d-b73866a0-6644d21a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:06.291859Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e3ab218a-33045d7d-b73866a0-6644d21a_0] Write session will restart in 0.006456s
2025-10-10T14:39:06.291884Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e3ab218a-33045d7d-b73866a0-6644d21a_0] Write session: Do CDS request
2025-10-10T14:39:06.291894Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e3ab218a-33045d7d-b73866a0-6644d21a_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:06.300134Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e3ab218a-33045d7d-b73866a0-6644d21a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:06.300075Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:06.300091Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2882
2025-10-10T14:39:06.300403Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2882 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:06.300444Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2882 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:06.300451Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2882 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:06.300455Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:06.300901Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2882 sessionId:  describe result for acl check
2025-10-10T14:39:06.300931Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:06.300935Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:06.300938Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:06.300943Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602631844163443:5169] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:06.301574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602631844163443:5169] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:06.303920Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602631844163443:5169] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:06.309831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602631844163443:5169] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:06.309848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602631844163443:5169] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:06.309852Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602631844163443:5169] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:06.309862Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2882 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:06.319344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:06.323660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:06.323967Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:06.323978Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:06.323992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:06.324054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:06.324104Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602631061923563:7871]
2025-10-10T14:39:06.324820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:06.325308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:06.325404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:06.325949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:06.326050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:06.326052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:06.326053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:06.326055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:06.326056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:06.326058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:06.326059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:06.326060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:06.326062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:06.326063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:06.326065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:06.326066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:06.326067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:06.326075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:06.326088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:06.326092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:06.326096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:06.326101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:06.326106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:06.326110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:06.326114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:06.326118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:06.326122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:06.326126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:06.326130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:06.326134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:06.326144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:06.326163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:06.326171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:06.326177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:06.326183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:06.326189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:06.326194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:06.326200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:06.326205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:06.326211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:06.326215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:06.326220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:06.326228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:06.326233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:06.326240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:06.326245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:06.326250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:06.326256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:06.326261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:06.326267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:06.326272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:06.326277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:06.326282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:06.326288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:06.326293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:06.326298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:06.326340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:06.334625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:06.335627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:06.335651Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:06.335654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:06.335658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:06.335666Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2881 [2:7559602631061923563:7871]
2025-10-10T14:39:06.335682Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:06.335705Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:06.335715Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:06.335719Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:06.335721Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:06.335741Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:06.335756Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:06.335768Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:06.335839Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:06.335847Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:06.335849Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:06.335852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:06.335934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:06.335942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:06.335956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:06.335973Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:06.335988Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:06.336015Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602631061923558:7871]
2025-10-10T14:39:06.336022Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602631061923558:7871]
2025-10-10T14:39:06.336024Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602631061923558:7871]
2025-10-10T14:39:06.336043Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:06.336065Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:06.336085Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:06.336093Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:06.336139Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602631061923558:7871]
2025-10-10T14:39:06.336143Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:06.336149Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:06.336152Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:06.336153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602631844163548:5169], now have 1 active actors on pipe
2025-10-10T14:39:06.336155Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:06.336157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602631844163432:2438], now have 1 active actors on pipe
2025-10-10T14:39:06.336163Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:06.336280Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2881
2025-10-10T14:39:06.336289Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2881
2025-10-10T14:39:06.336474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:06.336488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:06.336526Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6b293dc9-ffa06155-ca990b1d-9bbe65e1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:06.336535Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:06.336539Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:06.336541Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:06.336554Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:06.336567Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:06.336586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:06.336806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:06.336810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:06.336826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:06.336948Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2882 partition: 0 MaxSeqNo: 40 sessionId: src_id|6b293dc9-ffa06155-ca990b1d-9bbe65e1_0
2025-10-10T14:39:06.337452Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e3ab218a-33045d7d-b73866a0-6644d21a_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|6b293dc9-ffa06155-ca990b1d-9bbe65e1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:06.340455Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6b293dc9-ffa06155-ca990b1d-9bbe65e1_0] Write session: try to update token
2025-10-10T14:39:06.340481Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6b293dc9-ffa06155-ca990b1d-9bbe65e1_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:06.356520Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:06.356550Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:06.356554Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:06.356556Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:06.356568Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602631061923558:7871]
2025-10-10T14:39:06.356573Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602631061923558:7871]
2025-10-10T14:39:06.356578Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602631061923558:7871]
2025-10-10T14:39:06.356634Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:06.356650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:06.356649Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:06.356653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:06.356656Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:06.356661Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:06.356821Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:06.358451Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2882 sessionId: src_id|6b293dc9-ffa06155-ca990b1d-9bbe65e1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:06.361279Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:06.391790Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602631844163661:6861]
2025-10-10T14:39:06.392072Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 pipe creation result: OK TabletId: 72075186224037892 Generation: 2881, pipe: [1:7559602631844163661:6861]
2025-10-10T14:39:06.481548Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:06.482063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:06.482082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:06.482128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602631844163661:6861], now have 1 active actors on pipe
2025-10-10T14:39:06.482332Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:06.483581Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:39:06.483730Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2882 reason: status is not ok: tablet will be restarted right now sessionId: src_id|6b293dc9-ffa06155-ca990b1d-9bbe65e1_0
2025-10-10T14:39:06.483947Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2882 sessionId: src_id|6b293dc9-ffa06155-ca990b1d-9bbe65e1_0 is DEAD
2025-10-10T14:39:06.484089Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:06.484125Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 80 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602631844163661:6861]
2025-10-10T14:39:06.485625Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b293dc9-ffa06155-ca990b1d-9bbe65e1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:39:06.485638Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b293dc9-ffa06155-ca990b1d-9bbe65e1_0] Write session will restart in 0.005669s
2025-10-10T14:39:06.485663Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b293dc9-ffa06155-ca990b1d-9bbe65e1_0] Write session: Do CDS request
2025-10-10T14:39:06.485670Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b293dc9-ffa06155-ca990b1d-9bbe65e1_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:06.496070Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6b293dc9-ffa06155-ca990b1d-9bbe65e1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:06.497696Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:06.497713Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2883
2025-10-10T14:39:06.497938Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2883 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:06.497968Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2883 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:06.497973Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2883 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:06.497978Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:06.498519Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2883 sessionId:  describe result for acl check
2025-10-10T14:39:06.498551Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:06.498553Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:06.498555Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:06.498562Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602631844163686:5137] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:06.499162Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602631844163686:5137] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:06.501930Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602631844163686:5137] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:06.505299Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602631844163686:5137] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:06.505313Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602631844163686:5137] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:06.505317Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602631844163686:5137] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:06.505327Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2883 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:06.526589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:06.532963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:06.533384Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:06.533397Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:06.533414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:06.533517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:06.533568Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602631061923836:7848]
2025-10-10T14:39:06.534291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:06.534737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:06.534785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:06.535185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:06.535248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:06.535249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:06.535250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:06.535252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:06.535253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:06.535254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:06.535255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:06.535257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:06.535258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:06.535260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:06.535261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:06.535262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:06.535263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:06.535271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:06.535284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:06.535289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:06.535293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:06.535297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:06.535301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:06.535305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:06.535309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:06.535313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:06.535317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:06.535321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:06.535325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:06.535329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:06.535338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:06.535346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:06.535353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:06.535359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:06.535364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:06.535370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:06.535375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:06.535380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:06.535386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:06.535391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:06.535396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:06.535402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:06.535407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:06.535413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:06.535418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:06.535422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:06.535431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:06.535437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:06.535442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:06.535447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:06.535452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:06.535457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:06.535462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:06.535468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:06.535472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:06.535479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:06.535521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:06.540434Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2882
2025-10-10T14:39:06.540479Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2882
2025-10-10T14:39:06.541269Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2883 partition: 0 MaxSeqNo: 40 sessionId: src_id|c2828c95-80321eb2-ed6a887b-60582b9d_0
2025-10-10T14:39:06.538922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:06.539585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:06.539589Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:06.539592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:06.539596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:06.539603Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2882 [2:7559602631061923836:7848]
2025-10-10T14:39:06.539618Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:06.539639Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:06.539643Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:06.539647Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:06.539650Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:06.539667Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:06.539675Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:06.539683Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:06.539760Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:06.539763Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:06.539765Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:06.539768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:06.539841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:06.539844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:06.539857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:06.539870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:06.539888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:06.539911Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602631061923830:7848]
2025-10-10T14:39:06.539914Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602631061923830:7848]
2025-10-10T14:39:06.539916Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602631061923830:7848]
2025-10-10T14:39:06.539929Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:06.539945Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:06.539961Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:06.539964Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:06.539997Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602631061923830:7848]
2025-10-10T14:39:06.540000Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:06.540081Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:06.540083Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:06.540085Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:06.540092Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:06.540690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602631844163721:5137], now have 1 active actors on pipe
2025-10-10T14:39:06.540696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602631844163677:2438], now have 1 active actors on pipe
2025-10-10T14:39:06.540714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:06.540721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:06.540758Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c2828c95-80321eb2-ed6a887b-60582b9d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:06.540768Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:06.540773Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:06.540776Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:06.540789Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:06.540804Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:06.540824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:06.541068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:06.541074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:06.541095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:06.545550Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b293dc9-ffa06155-ca990b1d-9bbe65e1_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|c2828c95-80321eb2-ed6a887b-60582b9d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:06.548356Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c2828c95-80321eb2-ed6a887b-60582b9d_0] Write session: try to update token
2025-10-10T14:39:06.548379Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c2828c95-80321eb2-ed6a887b-60582b9d_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:06.563169Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:06.563188Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:06.563191Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:06.563194Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:06.563204Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602631061923830:7848]
2025-10-10T14:39:06.563209Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602631061923830:7848]
2025-10-10T14:39:06.563213Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602631061923830:7848]
2025-10-10T14:39:06.563265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:06.563273Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:06.563276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:06.563292Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:06.563304Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:06.563310Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:06.563417Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:06.566415Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2883 sessionId: src_id|c2828c95-80321eb2-ed6a887b-60582b9d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:06.568985Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:06.581198Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602631844163914:6861]
2025-10-10T14:39:06.584340Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 pipe creation result: OK TabletId: 72075186224037892 Generation: 2882, pipe: [1:7559602631844163914:6861]
2025-10-10T14:39:06.685538Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:06.685952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:06.685967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:06.686015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602631844163914:6861], now have 1 active actors on pipe
2025-10-10T14:39:06.686249Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:06.686277Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:06.686287Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 81 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602631844163914:6861]
2025-10-10T14:39:06.686292Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:06.686322Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:06.686359Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2883 reason: error at write: Disconnected sessionId: src_id|c2828c95-80321eb2-ed6a887b-60582b9d_0
2025-10-10T14:39:06.686572Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2883 sessionId: src_id|c2828c95-80321eb2-ed6a887b-60582b9d_0 is DEAD
2025-10-10T14:39:06.686740Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c2828c95-80321eb2-ed6a887b-60582b9d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:06.686762Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c2828c95-80321eb2-ed6a887b-60582b9d_0] Write session will restart in 0.007365s
2025-10-10T14:39:06.686786Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c2828c95-80321eb2-ed6a887b-60582b9d_0] Write session: Do CDS request
2025-10-10T14:39:06.686796Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c2828c95-80321eb2-ed6a887b-60582b9d_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:06.694911Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c2828c95-80321eb2-ed6a887b-60582b9d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:06.694994Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:06.695008Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2884
2025-10-10T14:39:06.695136Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2884 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:06.695172Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2884 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:06.695196Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2884 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:06.695205Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:06.695711Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2884 sessionId:  describe result for acl check
2025-10-10T14:39:06.695747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:06.695753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:06.695755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:06.695761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602631844163950:5097] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:06.696338Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602631844163950:5097] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:06.699539Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602631844163950:5097] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:06.702837Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602631844163950:5097] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:06.702848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602631844163950:5097] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:06.702852Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602631844163950:5097] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:06.702862Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2884 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:06.705801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:06.710027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:06.710271Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:06.710283Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:06.710296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:06.710357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:06.710404Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602631061924059:7837]
2025-10-10T14:39:06.711009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:06.711357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:06.711411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:06.711737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:06.711824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:06.711834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:06.711835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:06.711837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:06.711838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:06.711839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:06.711840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:06.711841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:06.711842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:06.711844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:06.711845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:06.711846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:06.711847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:06.711853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:06.711867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:06.711871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:06.711876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:06.711879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:06.711883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:06.711888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:06.711892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:06.711895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:06.711903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:06.711907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:06.711911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:06.711914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:06.711923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:06.711932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:06.711945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:06.711951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:06.711961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:06.711966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:06.711971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:06.711976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:06.711981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:06.711987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:06.711991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:06.711997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:06.712002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:06.712012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:06.712017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:06.712023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:06.712032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:06.712038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:06.712047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:06.712052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:06.712057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:06.712063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:06.712068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:06.712078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:06.712082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:06.712091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:06.712133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:06.714539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:06.715342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:06.715353Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:06.715355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:06.715358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:06.715363Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2883 [2:7559602631061924059:7837]
2025-10-10T14:39:06.715373Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:06.715389Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:06.715391Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:06.715393Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:06.715395Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:06.715408Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:06.715414Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:06.715420Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:06.715472Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:06.715480Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:06.715482Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:06.715485Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:06.715541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:06.715547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:06.715554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:06.715560Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:06.715576Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:06.715599Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602631061924054:7837]
2025-10-10T14:39:06.715606Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602631061924054:7837]
2025-10-10T14:39:06.715608Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602631061924054:7837]
2025-10-10T14:39:06.715622Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:06.715636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602631844164122:5097], now have 1 active actors on pipe
2025-10-10T14:39:06.715635Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:06.715639Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:06.715641Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:06.715644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602631844163929:2438], now have 1 active actors on pipe
2025-10-10T14:39:06.715651Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:06.715661Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:06.715663Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:06.715681Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602631061924054:7837]
2025-10-10T14:39:06.715689Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:06.715716Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:06.715701Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2883
2025-10-10T14:39:06.715715Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2883
2025-10-10T14:39:06.715770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:06.715778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:06.715803Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|81cf7d99-5ee6f967-d33c1f0a-9b649cb3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:06.715812Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:06.715815Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:06.715817Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:06.715827Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:06.715837Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:06.715855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:06.716019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:06.716026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:06.716043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:06.716138Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2884 partition: 0 MaxSeqNo: 40 sessionId: src_id|81cf7d99-5ee6f967-d33c1f0a-9b649cb3_0
2025-10-10T14:39:06.716588Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c2828c95-80321eb2-ed6a887b-60582b9d_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|81cf7d99-5ee6f967-d33c1f0a-9b649cb3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:06.719433Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|81cf7d99-5ee6f967-d33c1f0a-9b649cb3_0] Write session: try to update token
2025-10-10T14:39:06.719455Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|81cf7d99-5ee6f967-d33c1f0a-9b649cb3_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:06.727458Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:39:06.727482Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:06.727493Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602631061924054:7837]
2025-10-10T14:39:06.727544Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:39:06.727561Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:39:06.727750Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:39:06.727902Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:06.728048Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:06.728184Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:06.729231Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:39:06.729294Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:39:06.734131Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2884 sessionId: src_id|81cf7d99-5ee6f967-d33c1f0a-9b649cb3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:06.736820Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:06.737073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:06.737114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:06.737173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:39:06.737282Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:39:06.745873Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:06.745894Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:06.745898Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:06.745900Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:06.745913Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602631061924054:7837]
2025-10-10T14:39:06.745918Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602631061924054:7837]
2025-10-10T14:39:06.745922Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602631061924054:7837]
2025-10-10T14:39:06.745975Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:06.745978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:06.745987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:06.745990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:06.745994Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:06.745997Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:06.746141Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:06.786514Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602631844164156:6861]
2025-10-10T14:39:06.786880Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 pipe creation result: OK TabletId: 72075186224037892 Generation: 2883, pipe: [1:7559602631844164156:6861]
2025-10-10T14:39:06.861870Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:06.870677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:06.870709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:06.870898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:06.870971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:06.871039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:06.871108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:06.871156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:06.871167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:06.871240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:06.871305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:06.871377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:06.871451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:06.871497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:06.871509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:06.871579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:06.871643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:06.871714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:06.871782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:06.871831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:06.871839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:06.871911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:06.871980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:06.872047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:06.872121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:06.872169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:06.872177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:06.872244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:06.872309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:06.872375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:06.872452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:06.872500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:06.872508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:06.872796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:06.872867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:06.872940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:06.873013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:06.873062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:06.873070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:06.873143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:06.873613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:06.873689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:06.873756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:06.873802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:06.873809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:06.873880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:06.873941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:06.874008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:06.874074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:06.874121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:06.874129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:06.874204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:06.874267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:06.874334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:06.874401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:06.874447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:06.874454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:06.874526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:06.874591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:06.874665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:06.874738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:06.874927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:06.874938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:06.875011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602631844164156:6861], now have 1 active actors on pipe
2025-10-10T14:39:06.875318Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:06.875328Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 82 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602631844164156:6861]
2025-10-10T14:39:06.875332Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:06.875375Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2884 reason: error at write: Disconnected sessionId: src_id|81cf7d99-5ee6f967-d33c1f0a-9b649cb3_0
2025-10-10T14:39:06.875387Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:06.875621Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2884 sessionId: src_id|81cf7d99-5ee6f967-d33c1f0a-9b649cb3_0 is DEAD
2025-10-10T14:39:06.875796Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|81cf7d99-5ee6f967-d33c1f0a-9b649cb3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:06.875807Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|81cf7d99-5ee6f967-d33c1f0a-9b649cb3_0] Write session will restart in 0.008979s
2025-10-10T14:39:06.875834Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|81cf7d99-5ee6f967-d33c1f0a-9b649cb3_0] Write session: Do CDS request
2025-10-10T14:39:06.875840Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|81cf7d99-5ee6f967-d33c1f0a-9b649cb3_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:06.876379Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:06.885978Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|81cf7d99-5ee6f967-d33c1f0a-9b649cb3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:06.886091Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:06.886105Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2885
2025-10-10T14:39:06.886251Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2885 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:06.886289Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2885 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:06.886299Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2885 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:06.886303Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:06.886763Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2885 sessionId:  describe result for acl check
2025-10-10T14:39:06.886803Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:06.886812Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:06.886814Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:06.886823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602631844164199:5084] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:06.887441Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602631844164199:5084] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:06.891000Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602631844164199:5084] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:06.894562Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602631844164199:5084] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:06.894578Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602631844164199:5084] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:06.894582Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602631844164199:5084] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:06.894594Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2885 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:06.902540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:06.903259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:06.903482Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:06.903495Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:06.903509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:06.903569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:06.903621Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602631061924283:7829]
2025-10-10T14:39:06.904284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:06.904637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:06.904693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:06.905083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:06.905145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:06.905151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:06.905152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:06.905154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:06.905155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:06.905156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:06.905158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:06.905159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:06.905161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:06.905162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:06.905163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:06.905165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:06.905166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:06.905173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:06.905186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:06.905191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:06.905195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:06.905200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:06.905203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:06.905208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:06.905212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:06.905217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:06.905222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:06.905227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:06.905231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:06.905236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:06.905245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:06.905254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:06.905262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:06.905272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:06.905278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:06.905287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:06.905292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:06.905302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:06.905306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:06.905311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:06.905315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:06.905321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:06.905327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:06.905357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:06.905365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:06.905371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:06.905376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:06.905380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:06.905386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:06.905391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:06.905399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:06.905404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:06.905409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:06.905415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:06.905420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:06.905426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:06.905475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:06.908001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:06.908595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:06.908610Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:06.908612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:06.908616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:06.908623Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2884 [2:7559602631061924283:7829]
2025-10-10T14:39:06.908636Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:06.908653Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:06.908661Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:06.908664Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:06.908667Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:06.908685Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:06.908697Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:06.908705Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:06.908775Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:06.908781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:06.908784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:06.908787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:06.908859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:06.908870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:06.908883Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:06.908896Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:06.908916Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:06.908937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602631844164380:5084], now have 1 active actors on pipe
2025-10-10T14:39:06.908946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602631844164164:2438], now have 1 active actors on pipe
2025-10-10T14:39:06.908954Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602631061924278:7829]
2025-10-10T14:39:06.908957Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602631061924278:7829]
2025-10-10T14:39:06.908959Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602631061924278:7829]
2025-10-10T14:39:06.908974Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:06.908993Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:06.909003Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:06.909006Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:06.909009Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:06.909014Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:06.909018Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:06.908999Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2884
2025-10-10T14:39:06.909041Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602631061924278:7829]
2025-10-10T14:39:06.908999Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2884
2025-10-10T14:39:06.909049Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:06.909051Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:06.909076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:06.909086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:06.909129Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|692213e-e021b7ca-949c71b-3058306_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:06.909141Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:06.909146Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:06.909149Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:06.909160Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:06.909174Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:06.909195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:06.909326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:06.909359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:06.909375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:06.909554Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2885 partition: 0 MaxSeqNo: 40 sessionId: src_id|692213e-e021b7ca-949c71b-3058306_0
2025-10-10T14:39:06.913455Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|81cf7d99-5ee6f967-d33c1f0a-9b649cb3_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|692213e-e021b7ca-949c71b-3058306_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:06.916173Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|692213e-e021b7ca-949c71b-3058306_0] Write session: try to update token
2025-10-10T14:39:06.916197Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|692213e-e021b7ca-949c71b-3058306_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:06.932544Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2885 sessionId: src_id|692213e-e021b7ca-949c71b-3058306_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:06.933853Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:06.933877Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:06.933880Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:06.933882Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:06.933892Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602631061924278:7829]
2025-10-10T14:39:06.933896Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602631061924278:7829]
2025-10-10T14:39:06.933903Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602631061924278:7829]
2025-10-10T14:39:06.933954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:06.933968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:06.933971Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:06.934125Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:06.934207Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:06.934224Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:06.934228Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:06.935212Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:06.975474Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602631844164395:6861]
2025-10-10T14:39:06.975979Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 pipe creation result: OK TabletId: 72075186224037892 Generation: 2884, pipe: [1:7559602631844164395:6861]
2025-10-10T14:39:07.055618Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:07.056377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:07.056389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:07.056439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602631844164395:6861], now have 1 active actors on pipe
2025-10-10T14:39:07.056862Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:07.056883Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:07.056743Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:07.057415Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|692213e-e021b7ca-949c71b-3058306_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:07.057428Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|692213e-e021b7ca-949c71b-3058306_0] Write session will restart in 0.009668s
2025-10-10T14:39:07.057455Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|692213e-e021b7ca-949c71b-3058306_0] Write session: Do CDS request
2025-10-10T14:39:07.057462Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|692213e-e021b7ca-949c71b-3058306_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:07.056953Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2885 reason: error at write: Disconnected sessionId: src_id|692213e-e021b7ca-949c71b-3058306_0
2025-10-10T14:39:07.057172Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2885 sessionId: src_id|692213e-e021b7ca-949c71b-3058306_0 is DEAD
2025-10-10T14:39:07.057317Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:07.057393Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 83 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602631844164395:6861]
2025-10-10T14:39:07.067904Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|692213e-e021b7ca-949c71b-3058306_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:07.067987Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:07.068012Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2886
2025-10-10T14:39:07.068240Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2886 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:07.068291Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2886 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:07.068302Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2886 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:07.068306Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:07.068816Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2886 sessionId:  describe result for acl check
2025-10-10T14:39:07.068853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:07.068859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:07.068866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:07.068872Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602636139131728:5059] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:07.069423Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602636139131728:5059] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:07.071950Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602636139131728:5059] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:07.078698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602636139131728:5059] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:07.078713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602636139131728:5059] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:07.078716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602636139131728:5059] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:07.078726Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2886 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:07.083383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:07.087735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:07.088047Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:07.088058Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:07.088073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:07.088141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:07.088199Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602635356891804:7833]
2025-10-10T14:39:07.088848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:07.089248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:07.089301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:07.089723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:07.089789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:07.089796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:07.089797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:07.089799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:07.089800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:07.089801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:07.089803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:07.089805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:07.089807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:07.089808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:07.089810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:07.089811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:07.089812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:07.089818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:07.089832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:07.089836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:07.089841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:07.089845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:07.089849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:07.089853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:07.089858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:07.089862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:07.089866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:07.089870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:07.089874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:07.089878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:07.089886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:07.089895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:07.089902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:07.089907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:07.089910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:07.089914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:07.089916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:07.089920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:07.089924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:07.089927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:07.089930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:07.089933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:07.089936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:07.089939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:07.089942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:07.089945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:07.089948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:07.089953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:07.089958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:07.089963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:07.089968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:07.089974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:07.089979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:07.089983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:07.089987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:07.089993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:07.090031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:07.092651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:07.092961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:07.092974Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:07.092977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:07.092981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:07.092988Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2885 [2:7559602635356891804:7833]
2025-10-10T14:39:07.093001Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:07.093025Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:07.093033Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:07.093036Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:07.093039Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:07.093057Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:07.093069Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:07.093083Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:07.093152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:07.093160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:07.093162Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:07.093165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:07.093241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:07.093248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:07.093260Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:07.093418Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2885
2025-10-10T14:39:07.093423Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2885
2025-10-10T14:39:07.093285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:07.093310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:07.093358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602636139131694:2438], now have 1 active actors on pipe
2025-10-10T14:39:07.093362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602636139131885:5059], now have 1 active actors on pipe
2025-10-10T14:39:07.093371Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602635356891799:7833]
2025-10-10T14:39:07.093373Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602635356891799:7833]
2025-10-10T14:39:07.093375Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602635356891799:7833]
2025-10-10T14:39:07.093392Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:07.093416Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:07.093418Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:07.093422Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:07.093424Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:07.093433Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:07.093436Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:07.093463Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602635356891799:7833]
2025-10-10T14:39:07.093467Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:07.093468Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:07.093489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:07.093495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:07.093544Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e55dbc40-6cff1491-d7280909-464a0e84_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:07.093552Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:07.093556Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:07.093559Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:07.093571Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:07.093582Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:07.093600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:07.094036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:07.094060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:07.094084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:07.094193Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2886 partition: 0 MaxSeqNo: 40 sessionId: src_id|e55dbc40-6cff1491-d7280909-464a0e84_0
2025-10-10T14:39:07.094626Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|692213e-e021b7ca-949c71b-3058306_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|e55dbc40-6cff1491-d7280909-464a0e84_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:07.097430Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e55dbc40-6cff1491-d7280909-464a0e84_0] Write session: try to update token
2025-10-10T14:39:07.097447Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e55dbc40-6cff1491-d7280909-464a0e84_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:07.113577Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:07.113599Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:07.113602Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:07.113605Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:07.113616Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602635356891799:7833]
2025-10-10T14:39:07.113620Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602635356891799:7833]
2025-10-10T14:39:07.113625Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602635356891799:7833]
2025-10-10T14:39:07.113681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:07.113690Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:07.113696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:07.113696Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:07.113698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:07.113701Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:07.113839Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:07.124339Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2886 sessionId: src_id|e55dbc40-6cff1491-d7280909-464a0e84_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:07.127496Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:07.157740Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602636139131924:6861]
2025-10-10T14:39:07.158098Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 pipe creation result: OK TabletId: 72075186224037892 Generation: 2885, pipe: [1:7559602636139131924:6861]
2025-10-10T14:39:07.232135Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:07.233006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:07.233027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:07.233051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602636139131924:6861], now have 1 active actors on pipe
2025-10-10T14:39:07.233261Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:07.233377Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 84 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602636139131924:6861]
2025-10-10T14:39:07.233394Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:07.233426Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:39:07.233517Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2886 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e55dbc40-6cff1491-d7280909-464a0e84_0
2025-10-10T14:39:07.233709Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2886 sessionId: src_id|e55dbc40-6cff1491-d7280909-464a0e84_0 is DEAD
2025-10-10T14:39:07.233900Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e55dbc40-6cff1491-d7280909-464a0e84_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:39:07.233911Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e55dbc40-6cff1491-d7280909-464a0e84_0] Write session will restart in 0.005545s
2025-10-10T14:39:07.233938Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e55dbc40-6cff1491-d7280909-464a0e84_0] Write session: Do CDS request
2025-10-10T14:39:07.233944Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e55dbc40-6cff1491-d7280909-464a0e84_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:07.241288Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e55dbc40-6cff1491-d7280909-464a0e84_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:07.241403Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:07.241428Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2887
2025-10-10T14:39:07.241562Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2887 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:07.241593Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2887 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:07.241600Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2887 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:07.241605Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:07.242124Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2887 sessionId:  describe result for acl check
2025-10-10T14:39:07.242161Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:07.242168Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:07.242170Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:07.242176Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602636139131941:5038] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:07.242770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602636139131941:5038] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:07.246162Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602636139131941:5038] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:07.250733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602636139131941:5038] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:07.250749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602636139131941:5038] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:07.250753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602636139131941:5038] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:07.250763Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2887 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:07.262357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:07.278599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:07.278917Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:07.278923Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:07.278938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:07.279012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:07.279058Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602635356892032:7823]
2025-10-10T14:39:07.279743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:07.280884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:07.280967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:07.281375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:07.281466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:07.281468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:07.281470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:07.281471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:07.281472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:07.281474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:07.281475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:07.281477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:07.281478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:07.281480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:07.281481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:07.281482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:07.281484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:07.281492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:07.281507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:07.281512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:07.281517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:07.281521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:07.281539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:07.281544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:07.281548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:07.281552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:07.281560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:07.281563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:07.281567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:07.281571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:07.281583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:07.281602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:07.281609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:07.281615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:07.281620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:07.281626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:07.281632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:07.281638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:07.281643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:07.281649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:07.281654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:07.281660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:07.281665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:07.281671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:07.281676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:07.281681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:07.281686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:07.281691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:07.281696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:07.281703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:07.281708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:07.281714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:07.281718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:07.281724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:07.281729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:07.281735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:07.281784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:07.285053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:07.285555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:07.285570Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:07.285573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:07.285578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:07.285585Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2886 [2:7559602635356892032:7823]
2025-10-10T14:39:07.285600Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:07.285716Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:07.285728Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:07.285731Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:07.285734Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:07.285753Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:07.285766Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:07.285780Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:07.285852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:07.285859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:07.285861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:07.285864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:07.285938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:07.285946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:07.285958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:07.285973Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:07.285992Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:07.286019Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602635356892027:7823]
2025-10-10T14:39:07.286026Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602635356892027:7823]
2025-10-10T14:39:07.286028Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602635356892027:7823]
2025-10-10T14:39:07.286043Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:07.286064Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:07.286084Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:07.286092Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:07.286125Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602635356892027:7823]
2025-10-10T14:39:07.286133Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:07.286841Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:07.286853Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:07.286855Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:07.286871Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:07.287263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602636139132100:5038], now have 1 active actors on pipe
2025-10-10T14:39:07.287275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602636139131925:2438], now have 1 active actors on pipe
2025-10-10T14:39:07.287349Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2886
2025-10-10T14:39:07.287384Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2886
2025-10-10T14:39:07.287556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:07.287568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:07.287608Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|79072f02-1a796bec-74ea43e2-f362929c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:07.287624Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:07.287638Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:07.287646Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:07.287659Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:07.287675Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:07.287696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:07.288201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:07.288210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:07.288227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:07.288359Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2887 partition: 0 MaxSeqNo: 40 sessionId: src_id|79072f02-1a796bec-74ea43e2-f362929c_0
2025-10-10T14:39:07.288817Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e55dbc40-6cff1491-d7280909-464a0e84_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|79072f02-1a796bec-74ea43e2-f362929c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:07.291843Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79072f02-1a796bec-74ea43e2-f362929c_0] Write session: try to update token
2025-10-10T14:39:07.291865Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79072f02-1a796bec-74ea43e2-f362929c_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:07.307657Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2887 sessionId: src_id|79072f02-1a796bec-74ea43e2-f362929c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:07.310489Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:07.312152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:07.312177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:07.312221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:39:07.317185Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:07.317211Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:07.317215Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:07.317217Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:07.317232Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602635356892027:7823]
2025-10-10T14:39:07.317237Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602635356892027:7823]
2025-10-10T14:39:07.317241Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602635356892027:7823]
2025-10-10T14:39:07.317301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:07.317308Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:07.317315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:07.317318Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:07.317319Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:07.317323Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:07.312360Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:39:07.317518Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:07.333302Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602636139132157:6861]
2025-10-10T14:39:07.333771Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 pipe creation result: OK TabletId: 72075186224037892 Generation: 2886, pipe: [1:7559602636139132157:6861]
2025-10-10T14:39:07.439933Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:07.440539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602636139132157:6861], now have 1 active actors on pipe
2025-10-10T14:39:07.449300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:07.449375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:07.449583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:07.449663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:07.449738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:07.449813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:07.449868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:07.449881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:07.449960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:07.450111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:07.450188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:07.450268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:07.450328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:07.450334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:07.450413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:07.450490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:07.450573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:07.450646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:07.450695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:07.450703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:07.450775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:07.450841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:07.450911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:07.450976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:07.451028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:07.451038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:07.451112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:07.451173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:07.451239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:07.451325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:07.451374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:07.451382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:07.451464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:07.451530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:07.451600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:07.451668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:07.451718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:07.451726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:07.451802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:07.451875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:07.451947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:07.452021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:07.452071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:07.452080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:07.452152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:07.452214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:07.452279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:07.452344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:07.452407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:07.452415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:07.452486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:07.452557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:07.452627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:07.452701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:07.452753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:07.452763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:07.452923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:07.452993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:07.453065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:07.453138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:07.453192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:07.453202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:07.455057Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:07.457424Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:39:07.457428Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 85 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602636139132157:6861]
2025-10-10T14:39:07.457453Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:07.457490Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2887 reason: status is not ok: tablet will be restarted right now sessionId: src_id|79072f02-1a796bec-74ea43e2-f362929c_0
2025-10-10T14:39:07.457726Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2887 sessionId: src_id|79072f02-1a796bec-74ea43e2-f362929c_0 is DEAD
2025-10-10T14:39:07.457882Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79072f02-1a796bec-74ea43e2-f362929c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:39:07.457895Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79072f02-1a796bec-74ea43e2-f362929c_0] Write session will restart in 0.007395s
2025-10-10T14:39:07.457932Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79072f02-1a796bec-74ea43e2-f362929c_0] Write session: Do CDS request
2025-10-10T14:39:07.457939Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79072f02-1a796bec-74ea43e2-f362929c_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:07.466954Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79072f02-1a796bec-74ea43e2-f362929c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:07.467106Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:07.467122Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2888
2025-10-10T14:39:07.467262Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2888 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:07.467306Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2888 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:07.467317Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2888 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:07.467322Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:07.467893Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2888 sessionId:  describe result for acl check
2025-10-10T14:39:07.467941Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:07.467948Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:07.467951Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:07.467957Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602636139132214:5040] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:07.468555Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602636139132214:5040] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:07.473162Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602636139132214:5040] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:07.481558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:07.486140Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602636139132214:5040] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:07.486157Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602636139132214:5040] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:07.486160Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602636139132214:5040] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:07.486179Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2888 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:07.485847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:07.486109Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:07.486114Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:07.486126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:07.486181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:07.486225Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602635356892259:7819]
2025-10-10T14:39:07.486867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:07.487172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:07.487221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:07.487942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:07.488021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:07.488026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:07.488028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:07.488029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:07.488030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:07.488031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:07.488033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:07.488034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:07.488035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:07.488037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:07.488038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:07.488039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:07.488040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:07.488047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:07.488059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:07.488063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:07.488067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:07.488071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:07.488088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:07.488092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:07.488095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:07.488099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:07.488103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:07.488107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:07.488111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:07.488115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:07.488123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:07.488132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:07.488138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:07.488143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:07.488148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:07.488153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:07.488158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:07.488163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:07.488168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:07.488172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:07.488188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:07.488194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:07.488199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:07.488204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:07.488209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:07.488214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:07.488219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:07.488227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:07.488232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:07.488241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:07.488246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:07.488251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:07.488260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:07.488265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:07.488270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:07.488275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:07.488319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:07.490977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:07.491314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:07.491329Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:07.491331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:07.491336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:07.491343Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2887 [2:7559602635356892259:7819]
2025-10-10T14:39:07.491357Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:07.491376Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:07.491380Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:07.491383Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:07.491386Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:07.491405Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:07.491425Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:07.491438Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:07.491498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:07.491506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:07.491508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:07.491511Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:07.491585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:07.491592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:07.491603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:07.491619Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:07.491640Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:07.491667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602636139132377:5040], now have 1 active actors on pipe
2025-10-10T14:39:07.491675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602636139132162:2438], now have 1 active actors on pipe
2025-10-10T14:39:07.491682Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602635356892254:7819]
2025-10-10T14:39:07.491689Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602635356892254:7819]
2025-10-10T14:39:07.491691Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602635356892254:7819]
2025-10-10T14:39:07.491707Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:07.491725Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:07.491724Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:07.491728Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:07.491730Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:07.491742Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:07.491746Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:07.491761Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2887
2025-10-10T14:39:07.491804Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2887
2025-10-10T14:39:07.491772Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602635356892254:7819]
2025-10-10T14:39:07.491783Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:07.491786Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:07.491814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:07.491819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:07.491858Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8a0a3f56-36765968-8c7839c7-1e3db13e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:07.491866Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:07.491871Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:07.491873Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:07.491884Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:07.491894Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:07.491918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:07.492117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:07.492126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:07.492142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:07.492228Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2888 partition: 0 MaxSeqNo: 40 sessionId: src_id|8a0a3f56-36765968-8c7839c7-1e3db13e_0
2025-10-10T14:39:07.492718Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79072f02-1a796bec-74ea43e2-f362929c_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|8a0a3f56-36765968-8c7839c7-1e3db13e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:07.495576Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8a0a3f56-36765968-8c7839c7-1e3db13e_0] Write session: try to update token
2025-10-10T14:39:07.495598Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8a0a3f56-36765968-8c7839c7-1e3db13e_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:07.512996Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2888 sessionId: src_id|8a0a3f56-36765968-8c7839c7-1e3db13e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:07.514952Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:07.514981Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:07.514984Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:07.514986Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:07.514996Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602635356892254:7819]
2025-10-10T14:39:07.515000Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602635356892254:7819]
2025-10-10T14:39:07.515006Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602635356892254:7819]
2025-10-10T14:39:07.515075Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:07.515097Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:07.515107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:07.515301Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:07.516072Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:07.516359Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:07.516373Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:07.516377Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:07.557844Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602636139132402:6861]
2025-10-10T14:39:07.565678Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 pipe creation result: OK TabletId: 72075186224037892 Generation: 2887, pipe: [1:7559602636139132402:6861]
2025-10-10T14:39:07.638817Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:07.639110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:07.639126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:07.639172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602636139132402:6861], now have 1 active actors on pipe
2025-10-10T14:39:07.639397Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:07.639437Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 86 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602636139132402:6861]
2025-10-10T14:39:07.639451Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:07.639454Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:07.639555Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2888 reason: error at write: Disconnected sessionId: src_id|8a0a3f56-36765968-8c7839c7-1e3db13e_0
2025-10-10T14:39:07.639659Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:07.639791Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2888 sessionId: src_id|8a0a3f56-36765968-8c7839c7-1e3db13e_0 is DEAD
2025-10-10T14:39:07.639943Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a0a3f56-36765968-8c7839c7-1e3db13e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:07.639956Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a0a3f56-36765968-8c7839c7-1e3db13e_0] Write session will restart in 0.008696s
2025-10-10T14:39:07.639992Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a0a3f56-36765968-8c7839c7-1e3db13e_0] Write session: Do CDS request
2025-10-10T14:39:07.640002Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a0a3f56-36765968-8c7839c7-1e3db13e_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:07.649933Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8a0a3f56-36765968-8c7839c7-1e3db13e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:07.650038Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:07.650065Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2889
2025-10-10T14:39:07.650218Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2889 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:07.650255Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2889 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:07.650267Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2889 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:07.650271Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:07.650761Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2889 sessionId:  describe result for acl check
2025-10-10T14:39:07.650799Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:07.650806Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:07.650808Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:07.650815Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602636139132448:4988] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:07.651372Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602636139132448:4988] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:07.655051Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602636139132448:4988] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:07.658731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602636139132448:4988] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:07.658747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602636139132448:4988] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:07.658751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602636139132448:4988] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:07.658760Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2889 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:07.665084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:07.665804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:07.666504Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:07.666517Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:07.666533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:07.666620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:07.666671Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602635356892539:7780]
2025-10-10T14:39:07.667324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:07.667681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:07.667731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:07.668074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:07.668136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:07.668143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:07.668144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:07.668155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:07.668157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:07.668158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:07.668159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:07.668161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:07.668162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:07.668164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:07.668166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:07.668167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:07.668168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:07.668175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:07.668189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:07.668193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:07.668198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:07.668201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:07.668206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:07.668210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:07.668215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:07.668219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:07.668225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:07.668229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:07.668233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:07.668238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:07.668248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:07.668258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:07.668264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:07.668270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:07.668275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:07.668281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:07.668290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:07.668295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:07.668310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:07.668319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:07.668325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:07.668335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:07.668340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:07.668346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:07.668355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:07.668361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:07.668365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:07.668371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:07.668385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:07.668391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:07.668396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:07.668401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:07.668407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:07.668412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:07.668417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:07.668422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:07.668468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:07.671255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:07.671963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:07.671977Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:07.671978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:07.671981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:07.671987Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2888 [2:7559602635356892539:7780]
2025-10-10T14:39:07.671997Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:07.672012Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:07.672015Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:07.672019Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:07.672021Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:07.672041Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:07.672048Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:07.672055Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:07.672107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:07.672113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:07.672115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:07.672116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:07.672195Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:07.672204Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:07.672212Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:07.672219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:07.672229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:07.672248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602636139132415:2438], now have 1 active actors on pipe
2025-10-10T14:39:07.672251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602636139132635:4988], now have 1 active actors on pipe
2025-10-10T14:39:07.672257Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602635356892534:7780]
2025-10-10T14:39:07.672259Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602635356892534:7780]
2025-10-10T14:39:07.672261Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602635356892534:7780]
2025-10-10T14:39:07.672275Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:07.672290Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:07.672308Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:07.672310Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:07.672315Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:07.672316Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:07.672318Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:07.672349Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602635356892534:7780]
2025-10-10T14:39:07.672351Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:07.672368Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:07.672342Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2888
2025-10-10T14:39:07.672361Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2888
2025-10-10T14:39:07.672398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:07.672407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:07.672439Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d91dee68-76d2e2f1-c7664e02-66f68506_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:07.672452Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:07.672461Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:07.672463Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:07.672475Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:07.672485Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:07.672515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:07.672651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:07.672659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:07.672674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:07.672765Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2889 partition: 0 MaxSeqNo: 40 sessionId: src_id|d91dee68-76d2e2f1-c7664e02-66f68506_0
2025-10-10T14:39:07.673201Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a0a3f56-36765968-8c7839c7-1e3db13e_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|d91dee68-76d2e2f1-c7664e02-66f68506_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:07.676169Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d91dee68-76d2e2f1-c7664e02-66f68506_0] Write session: try to update token
2025-10-10T14:39:07.676190Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d91dee68-76d2e2f1-c7664e02-66f68506_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:07.691520Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:39:07.691545Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:07.691559Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602635356892534:7780]
2025-10-10T14:39:07.691622Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:39:07.691826Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:39:07.691995Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:07.692156Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:07.692306Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:07.692533Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:39:07.692585Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:39:07.692675Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:39:07.694492Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2889 sessionId: src_id|d91dee68-76d2e2f1-c7664e02-66f68506_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:07.697759Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:07.698028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:07.698055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:07.698116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:39:07.698232Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:39:07.708283Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:07.708307Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:07.708310Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:07.708313Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:07.708326Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602635356892534:7780]
2025-10-10T14:39:07.708331Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602635356892534:7780]
2025-10-10T14:39:07.708336Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602635356892534:7780]
2025-10-10T14:39:07.708390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:07.708398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:07.708401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:07.708409Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:07.708416Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:07.708420Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:07.708554Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:07.739877Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602636139132660:6861]
2025-10-10T14:39:07.740136Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 pipe creation result: OK TabletId: 72075186224037892 Generation: 2888, pipe: [1:7559602636139132660:6861]
2025-10-10T14:39:07.829825Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:07.839015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:07.839049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:07.839249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:07.839316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:07.839391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:07.839459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:07.839514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:07.839519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:07.839589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:07.839653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:07.839718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:07.839783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:07.839831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:07.839834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:07.839907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:07.839965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:07.840032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:07.840095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:07.840141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:07.840144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:07.840223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:07.840287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:07.840352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:07.840425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:07.840472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:07.840475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:07.840553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:07.840625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:07.840695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:07.840768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:07.840813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:07.840817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:07.840902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:07.840965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:07.841036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:07.841102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:07.841148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:07.841151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:07.841224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:07.841286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:07.841574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:07.841656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:07.841707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:07.841714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:07.841788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:07.841856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:07.841925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:07.841991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:07.843775Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d91dee68-76d2e2f1-c7664e02-66f68506_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:07.843789Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d91dee68-76d2e2f1-c7664e02-66f68506_0] Write session will restart in 0.007265s
2025-10-10T14:39:07.843817Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d91dee68-76d2e2f1-c7664e02-66f68506_0] Write session: Do CDS request
2025-10-10T14:39:07.843825Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d91dee68-76d2e2f1-c7664e02-66f68506_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:07.843262Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 87 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602636139132660:6861]
2025-10-10T14:39:07.843294Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:07.843335Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:07.843338Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:07.843365Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2889 reason: error at write: Disconnected sessionId: src_id|d91dee68-76d2e2f1-c7664e02-66f68506_0
2025-10-10T14:39:07.843581Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2889 sessionId: src_id|d91dee68-76d2e2f1-c7664e02-66f68506_0 is DEAD
2025-10-10T14:39:07.842050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:07.842061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:07.842151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:07.842225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:07.842304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:07.842377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:07.842424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:07.842427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:07.842527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:07.842594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:07.842682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:07.842752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:07.842799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:07.842802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:07.842883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602636139132660:6861], now have 1 active actors on pipe
2025-10-10T14:39:07.844619Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:07.851970Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d91dee68-76d2e2f1-c7664e02-66f68506_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:07.856071Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:07.856092Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2890
2025-10-10T14:39:07.856266Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2890 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:07.856299Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2890 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:07.856306Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2890 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:07.856313Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:07.856739Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2890 sessionId:  describe result for acl check
2025-10-10T14:39:07.856771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:07.856774Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:07.856776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:07.856783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602636139132686:4966] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:07.857317Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602636139132686:4966] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:07.862892Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602636139132686:4966] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:07.867688Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602636139132686:4966] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:07.867704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602636139132686:4966] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:07.867708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602636139132686:4966] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:07.867719Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2890 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:07.884206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:07.884990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:07.885216Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:07.885231Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:07.885244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:07.885304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:07.885384Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602635356892770:7779]
2025-10-10T14:39:07.886073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:07.886419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:07.886471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:07.886811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:07.886878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:07.886886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:07.886888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:07.886889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:07.886891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:07.886892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:07.886893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:07.886895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:07.886896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:07.886898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:07.886899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:07.886900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:07.886901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:07.886908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:07.886922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:07.886925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:07.886930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:07.886933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:07.886937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:07.886941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:07.886944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:07.886948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:07.886952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:07.886955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:07.886959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:07.886962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:07.886973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:07.886983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:07.886991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:07.886997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:07.887002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:07.887007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:07.887012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:07.887021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:07.887031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:07.887037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:07.887041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:07.887051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:07.887056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:07.887061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:07.887070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:07.887074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:07.887082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:07.887093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:07.887097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:07.887102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:07.887106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:07.887111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:07.887116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:07.887122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:07.887134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:07.887140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:07.887177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:07.890271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:07.891279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:07.891293Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:07.891296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:07.891300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:07.891308Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2889 [2:7559602635356892770:7779]
2025-10-10T14:39:07.891321Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:07.891341Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:07.891349Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:07.891353Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:07.891357Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:07.891381Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:07.891393Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:07.891402Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:07.891474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:07.891482Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:07.891484Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:07.891487Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:07.891561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:07.891568Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:07.891580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:07.891593Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:07.891616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:07.891644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602636139132671:2438], now have 1 active actors on pipe
2025-10-10T14:39:07.891654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602636139132784:4966], now have 1 active actors on pipe
2025-10-10T14:39:07.891662Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602635356892765:7779]
2025-10-10T14:39:07.891671Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602635356892765:7779]
2025-10-10T14:39:07.891673Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602635356892765:7779]
2025-10-10T14:39:07.891687Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:07.891702Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:07.891702Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:07.891706Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:07.891709Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:07.891718Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:07.891721Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:07.891755Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602635356892765:7779]
2025-10-10T14:39:07.891767Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:07.891755Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2889
2025-10-10T14:39:07.891769Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2889
2025-10-10T14:39:07.891785Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:07.891838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:07.891848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:07.891878Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5adce1ba-1043d56e-aa861e1f-6e7c1210_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:07.891890Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:07.891899Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:07.891902Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:07.891915Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:07.891930Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:07.891946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:07.892176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:07.892185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:07.892202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:07.892319Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2890 partition: 0 MaxSeqNo: 40 sessionId: src_id|5adce1ba-1043d56e-aa861e1f-6e7c1210_0
2025-10-10T14:39:07.892700Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d91dee68-76d2e2f1-c7664e02-66f68506_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|5adce1ba-1043d56e-aa861e1f-6e7c1210_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:07.895605Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5adce1ba-1043d56e-aa861e1f-6e7c1210_0] Write session: try to update token
2025-10-10T14:39:07.895627Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5adce1ba-1043d56e-aa861e1f-6e7c1210_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:07.904267Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:39:07.904290Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:07.904305Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602635356892765:7779]
2025-10-10T14:39:07.904357Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:39:07.904536Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:39:07.904691Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:07.904837Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:07.904979Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:07.905180Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:39:07.905231Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:39:07.905368Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:39:07.910532Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2890 sessionId: src_id|5adce1ba-1043d56e-aa861e1f-6e7c1210_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:07.913312Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:07.913589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:07.913616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:07.913673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:39:07.913766Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:39:07.923897Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:07.923928Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:07.923931Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:07.923934Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:07.923945Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602635356892765:7779]
2025-10-10T14:39:07.923951Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602635356892765:7779]
2025-10-10T14:39:07.923956Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602635356892765:7779]
2025-10-10T14:39:07.924011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:07.924011Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:07.924019Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:07.924025Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:07.924027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:07.924030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:07.924202Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:07.943634Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602636139132907:6861]
2025-10-10T14:39:07.943988Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 pipe creation result: OK TabletId: 72075186224037892 Generation: 2889, pipe: [1:7559602636139132907:6861]
2025-10-10T14:39:08.056030Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:08.065101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:08.065136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:08.065370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:08.065448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:08.065524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:08.065600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:08.065662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:08.065672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:08.065749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:08.065816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:08.065886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:08.065963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:08.066010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:08.066021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:08.066094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:08.066158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:08.066223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:08.066290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:08.066345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:08.066354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:08.066426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:08.066496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:08.066567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:08.066637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:08.066769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:08.066777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:08.066846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:08.066913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:08.066979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:08.067063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:08.067115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:08.067125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:08.067249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:08.067318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:08.067389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:08.067449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:08.067492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:08.067499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:08.067570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:08.067640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:08.067708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:08.067774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:08.067830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:08.067838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:08.067916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:08.067983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:08.068049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:08.068119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:08.068168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:08.068177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:08.068248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:08.068317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:08.068389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:08.068455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:08.068503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:08.068511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:08.068581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:08.068646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:08.068715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:08.068787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:08.068834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:08.068842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:08.068916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602636139132907:6861], now have 1 active actors on pipe
2025-10-10T14:39:08.069197Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 88 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602636139132907:6861]
2025-10-10T14:39:08.069198Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:08.069235Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:08.069238Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:08.069268Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2890 reason: error at write: Disconnected sessionId: src_id|5adce1ba-1043d56e-aa861e1f-6e7c1210_0
2025-10-10T14:39:08.069544Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2890 sessionId: src_id|5adce1ba-1043d56e-aa861e1f-6e7c1210_0 is DEAD
2025-10-10T14:39:08.069672Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5adce1ba-1043d56e-aa861e1f-6e7c1210_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:08.069681Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5adce1ba-1043d56e-aa861e1f-6e7c1210_0] Write session will restart in 0.006126s
2025-10-10T14:39:08.069710Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5adce1ba-1043d56e-aa861e1f-6e7c1210_0] Write session: Do CDS request
2025-10-10T14:39:08.069717Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5adce1ba-1043d56e-aa861e1f-6e7c1210_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:08.070261Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:08.076945Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5adce1ba-1043d56e-aa861e1f-6e7c1210_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:08.077026Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:08.077042Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2891
2025-10-10T14:39:08.077193Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2891 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:08.077229Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2891 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:08.077238Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2891 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:08.077243Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:08.077756Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2891 sessionId:  describe result for acl check
2025-10-10T14:39:08.077794Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:08.077800Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:08.077802Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:08.077809Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602640434100221:4957] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:08.078372Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602640434100221:4957] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:08.082301Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602640434100221:4957] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:08.086212Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602640434100221:4957] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:08.086231Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602640434100221:4957] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:08.086235Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602640434100221:4957] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:08.086246Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2891 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:08.089674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:08.093952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:08.094184Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:08.094196Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:08.094208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:08.094262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:08.094308Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602639651860298:7773]
2025-10-10T14:39:08.094928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:08.095267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:08.095325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:08.095716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:08.095781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:08.095787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:08.095788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:08.095789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:08.095791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:08.095792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:08.095793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:08.095795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:08.095796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:08.095797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:08.095799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:08.095800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:08.095801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:08.095808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:08.095822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:08.095826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:08.095839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:08.095844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:08.095849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:08.095853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:08.095857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:08.095860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:08.095865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:08.095869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:08.095873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:08.095877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:08.095885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:08.095898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:08.095905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:08.095911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:08.095916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:08.095921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:08.095925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:08.095931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:08.095936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:08.095941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:08.095951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:08.095957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:08.095962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:08.095968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:08.095972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:08.095977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:08.095983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:08.095988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:08.095997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:08.096004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:08.096015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:08.096020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:08.096024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:08.096029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:08.096034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:08.096047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:08.096092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:08.098582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:08.099318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:08.099330Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:08.099332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:08.099337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:08.099344Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2890 [2:7559602639651860298:7773]
2025-10-10T14:39:08.099358Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:08.099375Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:08.099379Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:08.099382Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:08.099385Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:08.099403Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:08.099415Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:08.099423Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:08.099497Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:08.099504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:08.099506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:08.099509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:08.099585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:08.099593Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:08.099604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:08.099621Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:08.099642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:08.099667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602640434100206:2438], now have 1 active actors on pipe
2025-10-10T14:39:08.099676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602640434100426:4957], now have 1 active actors on pipe
2025-10-10T14:39:08.099683Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602639651860293:7773]
2025-10-10T14:39:08.099690Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602639651860293:7773]
2025-10-10T14:39:08.099693Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602639651860293:7773]
2025-10-10T14:39:08.099708Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:08.099723Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:08.099744Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:08.099722Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2890
2025-10-10T14:39:08.099749Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:08.099750Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2890
2025-10-10T14:39:08.099752Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:08.099753Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:08.099756Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:08.099779Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602639651860293:7773]
2025-10-10T14:39:08.099784Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:08.099785Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:08.099805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:08.099811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:08.099864Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d376ccc4-853a5df0-aa37ee7e-2e8ea5f6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:08.099877Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:08.099881Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:08.099884Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:08.099895Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:08.099911Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:08.099938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:08.100109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:08.100119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:08.100137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:08.100223Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2891 partition: 0 MaxSeqNo: 40 sessionId: src_id|d376ccc4-853a5df0-aa37ee7e-2e8ea5f6_0
2025-10-10T14:39:08.100635Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5adce1ba-1043d56e-aa861e1f-6e7c1210_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|d376ccc4-853a5df0-aa37ee7e-2e8ea5f6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:08.103493Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d376ccc4-853a5df0-aa37ee7e-2e8ea5f6_0] Write session: try to update token
2025-10-10T14:39:08.103518Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d376ccc4-853a5df0-aa37ee7e-2e8ea5f6_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:08.120491Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:08.120517Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:08.120521Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:08.120523Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:08.120535Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602639651860293:7773]
2025-10-10T14:39:08.120540Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602639651860293:7773]
2025-10-10T14:39:08.120544Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602639651860293:7773]
2025-10-10T14:39:08.120597Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:08.120607Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:08.120614Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:08.120615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:08.120618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:08.120618Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:08.120762Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:08.123499Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2891 sessionId: src_id|d376ccc4-853a5df0-aa37ee7e-2e8ea5f6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:08.126586Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:08.169528Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602640434100441:6861]
2025-10-10T14:39:08.173644Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 pipe creation result: OK TabletId: 72075186224037892 Generation: 2890, pipe: [1:7559602640434100441:6861]
2025-10-10T14:39:08.247653Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:08.248352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:08.248364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:08.248411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602640434100441:6861], now have 1 active actors on pipe
2025-10-10T14:39:08.248992Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 89 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602640434100441:6861]
2025-10-10T14:39:08.249018Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:08.249062Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:08.249065Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:08.249124Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2891 reason: error at write: Disconnected sessionId: src_id|d376ccc4-853a5df0-aa37ee7e-2e8ea5f6_0
2025-10-10T14:39:08.249352Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2891 sessionId: src_id|d376ccc4-853a5df0-aa37ee7e-2e8ea5f6_0 is DEAD
2025-10-10T14:39:08.249470Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:08.250849Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d376ccc4-853a5df0-aa37ee7e-2e8ea5f6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:08.250860Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d376ccc4-853a5df0-aa37ee7e-2e8ea5f6_0] Write session will restart in 0.007136s
2025-10-10T14:39:08.250886Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d376ccc4-853a5df0-aa37ee7e-2e8ea5f6_0] Write session: Do CDS request
2025-10-10T14:39:08.250894Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d376ccc4-853a5df0-aa37ee7e-2e8ea5f6_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:08.259005Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d376ccc4-853a5df0-aa37ee7e-2e8ea5f6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:08.259272Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:08.259287Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2892
2025-10-10T14:39:08.259389Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2892 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:08.259420Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2892 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:08.259427Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2892 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:08.259441Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:08.260279Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2892 sessionId:  describe result for acl check
2025-10-10T14:39:08.260325Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:08.260327Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:08.260329Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:08.260336Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602640434100477:4940] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:08.260965Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602640434100477:4940] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:08.268425Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602640434100477:4940] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:08.275830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602640434100477:4940] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:08.275847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602640434100477:4940] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:08.275852Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602640434100477:4940] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:08.275863Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2892 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:08.277377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:08.282276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:08.282710Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:08.282728Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:08.282743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:08.282823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:08.282874Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602639651860532:7774]
2025-10-10T14:39:08.283540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:08.283847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:08.283912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:08.284278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:08.284365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:08.284374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:08.284375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:08.284376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:08.284378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:08.284379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:08.284380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:08.284382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:08.284383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:08.284385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:08.284386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:08.284387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:08.284389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:08.284396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:08.284410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:08.284414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:08.284418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:08.284421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:08.284425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:08.284429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:08.284434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:08.284438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:08.284442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:08.284446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:08.284450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:08.284454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:08.284462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:08.284471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:08.284479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:08.284485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:08.284492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:08.284498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:08.284503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:08.284509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:08.284514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:08.284519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:08.284523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:08.284529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:08.284534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:08.284539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:08.284544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:08.284549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:08.284565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:08.284571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:08.284576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:08.284581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:08.284605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:08.284611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:08.284616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:08.284621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:08.284627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:08.284632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:08.284673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:08.288565Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2891
2025-10-10T14:39:08.288630Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2891
2025-10-10T14:39:08.287225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:08.288101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:08.288106Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:08.288108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:08.288113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:08.288119Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2891 [2:7559602639651860532:7774]
2025-10-10T14:39:08.288134Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:08.288154Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:08.288158Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:08.288163Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:08.288165Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:08.288184Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:08.288192Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:08.288201Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:08.288266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:08.289381Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2892 partition: 0 MaxSeqNo: 40 sessionId: src_id|f40db7f4-2c008740-bb498e11-4c221fa5_0
2025-10-10T14:39:08.288269Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:08.288271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:08.288274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:08.288355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:08.288358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:08.288371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:08.288385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:08.288404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:08.288426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602640434100442:2438], now have 1 active actors on pipe
2025-10-10T14:39:08.288430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602640434100665:4940], now have 1 active actors on pipe
2025-10-10T14:39:08.288439Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602639651860527:7774]
2025-10-10T14:39:08.288441Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602639651860527:7774]
2025-10-10T14:39:08.288444Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602639651860527:7774]
2025-10-10T14:39:08.288462Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:08.288477Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:08.288495Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:08.288498Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:08.288504Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:08.288507Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:08.288509Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:08.288531Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602639651860527:7774]
2025-10-10T14:39:08.288534Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:08.288536Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:08.288784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:08.288791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:08.288826Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f40db7f4-2c008740-bb498e11-4c221fa5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:08.288835Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:08.288839Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:08.288842Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:08.288856Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:08.288869Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:08.288884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:08.289189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:08.289193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:08.289226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:08.289959Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d376ccc4-853a5df0-aa37ee7e-2e8ea5f6_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|f40db7f4-2c008740-bb498e11-4c221fa5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:08.292737Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f40db7f4-2c008740-bb498e11-4c221fa5_0] Write session: try to update token
2025-10-10T14:39:08.292756Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f40db7f4-2c008740-bb498e11-4c221fa5_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:08.311351Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:08.311375Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:08.311379Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:08.311382Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:08.311392Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602639651860527:7774]
2025-10-10T14:39:08.311398Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602639651860527:7774]
2025-10-10T14:39:08.311402Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602639651860527:7774]
2025-10-10T14:39:08.311456Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:08.311465Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:08.311467Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:08.311615Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:08.313499Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:08.313517Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:08.313522Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:08.316943Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2892 sessionId: src_id|f40db7f4-2c008740-bb498e11-4c221fa5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:08.319914Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:08.346116Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602640434100679:6861]
2025-10-10T14:39:08.347017Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 pipe creation result: OK TabletId: 72075186224037892 Generation: 2891, pipe: [1:7559602640434100679:6861]
2025-10-10T14:39:08.438874Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:08.439540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:08.439552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:08.439604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602640434100679:6861], now have 1 active actors on pipe
2025-10-10T14:39:08.439869Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:08.441431Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f40db7f4-2c008740-bb498e11-4c221fa5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:39:08.441446Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f40db7f4-2c008740-bb498e11-4c221fa5_0] Write session will restart in 0.006797s
2025-10-10T14:39:08.440452Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 90 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602640434100679:6861]
2025-10-10T14:39:08.440481Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:08.440522Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:39:08.440591Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2892 reason: status is not ok: tablet will be restarted right now sessionId: src_id|f40db7f4-2c008740-bb498e11-4c221fa5_0
2025-10-10T14:39:08.440796Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2892 sessionId: src_id|f40db7f4-2c008740-bb498e11-4c221fa5_0 is DEAD
2025-10-10T14:39:08.441474Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f40db7f4-2c008740-bb498e11-4c221fa5_0] Write session: Do CDS request
2025-10-10T14:39:08.441481Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f40db7f4-2c008740-bb498e11-4c221fa5_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:08.449883Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f40db7f4-2c008740-bb498e11-4c221fa5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:08.450286Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:08.450300Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2893
2025-10-10T14:39:08.450430Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2893 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:08.450465Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2893 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:08.450472Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2893 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:08.450477Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:08.450928Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2893 sessionId:  describe result for acl check
2025-10-10T14:39:08.450964Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:08.450966Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:08.450967Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:08.450975Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602640434100696:4916] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:08.451622Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602640434100696:4916] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:08.459451Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602640434100696:4916] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:08.463987Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602640434100696:4916] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:08.464002Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602640434100696:4916] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:08.464006Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602640434100696:4916] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:08.464016Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2893 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:08.507136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:08.513573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:08.513853Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:08.513859Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:08.513873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:08.513937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:08.513983Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602639651860777:7767]
2025-10-10T14:39:08.514678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:08.515323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:08.515380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:08.515656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:08.515701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:08.515708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:08.515709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:08.515710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:08.515711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:08.515711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:08.515712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:08.515713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:08.515714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:08.515715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:08.515716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:08.515717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:08.515718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:08.515723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:08.515732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:08.515746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:08.515749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:08.515751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:08.515754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:08.515756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:08.515758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:08.515761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:08.515764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:08.515766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:08.515768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:08.515771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:08.515777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:08.515784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:08.515789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:08.515793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:08.515796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:08.515800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:08.515803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:08.515808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:08.515811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:08.515815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:08.515818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:08.515822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:08.515825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:08.515829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:08.515832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:08.515835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:08.515839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:08.515843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:08.515846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:08.515849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:08.515853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:08.515856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:08.515859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:08.515862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:08.515870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:08.515875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:08.515913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:08.522346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:08.523317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:08.523338Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:08.523341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:08.523345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:08.523353Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2892 [2:7559602639651860777:7767]
2025-10-10T14:39:08.523370Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:08.523392Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:08.523403Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:08.523407Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:08.523410Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:08.523431Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:08.523444Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:08.523456Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:08.523528Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:08.523537Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:08.523540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:08.523543Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:08.523618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:08.523630Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:08.523643Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:08.523656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:08.523674Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:08.523698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602640434100681:2438], now have 1 active actors on pipe
2025-10-10T14:39:08.523703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602640434100733:4916], now have 1 active actors on pipe
2025-10-10T14:39:08.523711Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602639651860762:7767]
2025-10-10T14:39:08.523714Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602639651860762:7767]
2025-10-10T14:39:08.523717Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602639651860762:7767]
2025-10-10T14:39:08.523736Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:08.523754Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:08.523762Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:08.523766Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:08.523769Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:08.523770Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:08.523774Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:08.523817Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602639651860762:7767]
2025-10-10T14:39:08.523832Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:08.523838Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:08.524192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:08.524201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:08.524238Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1f35257b-394151b3-22968c32-faede634_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:08.524251Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:08.524256Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:08.524260Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:08.524273Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:08.524287Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:08.524304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:08.524898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:08.524916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:08.524943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:08.523927Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2892
2025-10-10T14:39:08.523977Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2892
2025-10-10T14:39:08.525025Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2893 partition: 0 MaxSeqNo: 40 sessionId: src_id|1f35257b-394151b3-22968c32-faede634_0
2025-10-10T14:39:08.525477Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f40db7f4-2c008740-bb498e11-4c221fa5_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|1f35257b-394151b3-22968c32-faede634_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:08.528435Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1f35257b-394151b3-22968c32-faede634_0] Write session: try to update token
2025-10-10T14:39:08.528460Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1f35257b-394151b3-22968c32-faede634_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:08.540652Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602640434100915:6861]
2025-10-10T14:39:08.540960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602640434100915:6861], now have 1 active actors on pipe
2025-10-10T14:39:08.543303Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 pipe creation result: OK TabletId: 72075186224037892 Generation: 2892, pipe: [1:7559602640434100915:6861]
2025-10-10T14:39:08.544679Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2893 sessionId: src_id|1f35257b-394151b3-22968c32-faede634_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:08.547398Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:08.547422Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:08.547426Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:08.547428Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:08.547439Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602639651860762:7767]
2025-10-10T14:39:08.547444Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602639651860762:7767]
2025-10-10T14:39:08.547448Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602639651860762:7767]
2025-10-10T14:39:08.547503Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:08.547512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:08.547515Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:08.547531Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:08.547539Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:08.547544Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:08.547439Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:08.547686Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:08.668153Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:08.668724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:08.668745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:08.669032Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:08.669117Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 91 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602640434100915:6861]
2025-10-10T14:39:08.669123Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:08.669147Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:39:08.669237Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2893 reason: status is not ok: tablet will be restarted right now sessionId: src_id|1f35257b-394151b3-22968c32-faede634_0
2025-10-10T14:39:08.669480Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2893 sessionId: src_id|1f35257b-394151b3-22968c32-faede634_0 is DEAD
2025-10-10T14:39:08.669658Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f35257b-394151b3-22968c32-faede634_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:39:08.669670Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f35257b-394151b3-22968c32-faede634_0] Write session will restart in 0.008417s
2025-10-10T14:39:08.669696Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f35257b-394151b3-22968c32-faede634_0] Write session: Do CDS request
2025-10-10T14:39:08.669703Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f35257b-394151b3-22968c32-faede634_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:08.678939Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1f35257b-394151b3-22968c32-faede634_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:08.679005Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:08.679019Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2894
2025-10-10T14:39:08.679180Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2894 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:08.679244Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2894 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:08.679255Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2894 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:08.679260Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:08.679819Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2894 sessionId:  describe result for acl check
2025-10-10T14:39:08.679857Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:08.679866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:08.679868Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:08.679874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602640434100984:4892] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:08.680420Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602640434100984:4892] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:08.683853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602640434100984:4892] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:08.686887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602640434100984:4892] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:08.686902Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602640434100984:4892] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:08.686905Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602640434100984:4892] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:08.686914Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2894 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:08.695243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:08.695944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:08.696169Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:08.696182Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:08.696195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:08.696260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:08.696314Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602639651861050:7727]
2025-10-10T14:39:08.697003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:08.697417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:08.697494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:08.697886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:08.697960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:08.697966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:08.697967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:08.697969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:08.697970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:08.697971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:08.697973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:08.697974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:08.697975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:08.697976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:08.697977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:08.697978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:08.697980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:08.697985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:08.698000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:08.698004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:08.698009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:08.698013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:08.698017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:08.698022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:08.698026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:08.698030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:08.698035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:08.698039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:08.698043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:08.698048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:08.698055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:08.698065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:08.698072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:08.698078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:08.698082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:08.698087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:08.698091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:08.698099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:08.698104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:08.698113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:08.698118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:08.698127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:08.698133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:08.698139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:08.698145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:08.698150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:08.698155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:08.698161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:08.698166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:08.698172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:08.698177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:08.698183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:08.698187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:08.698193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:08.698198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:08.698203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:08.698246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:08.700856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:08.701666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:08.701679Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:08.701682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:08.701687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:08.701695Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2893 [2:7559602639651861050:7727]
2025-10-10T14:39:08.701708Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:08.701730Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:08.701738Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:08.701742Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:08.701744Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:08.701762Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:08.701776Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:08.701788Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:08.701861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:08.701871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:08.701873Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:08.701875Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:08.701950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:08.701960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:08.701971Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:08.701983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:08.701999Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:08.702027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602640434100959:2438], now have 1 active actors on pipe
2025-10-10T14:39:08.702041Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602639651861045:7727]
2025-10-10T14:39:08.702049Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602639651861045:7727]
2025-10-10T14:39:08.702051Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602639651861045:7727]
2025-10-10T14:39:08.702061Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:08.702050Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2893
2025-10-10T14:39:08.702071Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:08.702076Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:08.702099Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2893
2025-10-10T14:39:08.702082Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:08.702085Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:08.702090Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:08.702094Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:08.702100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602640434101163:4892], now have 1 active actors on pipe
2025-10-10T14:39:08.702127Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602639651861045:7727]
2025-10-10T14:39:08.702130Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:08.702133Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:08.702155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:08.702169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:08.702226Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|478500ee-3fa81ac1-8015c937-6715df55_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:08.702239Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:08.702247Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:08.702250Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:08.702261Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:08.702277Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:08.702298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:08.702468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:08.702478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:08.702493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:08.702568Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2894 partition: 0 MaxSeqNo: 40 sessionId: src_id|478500ee-3fa81ac1-8015c937-6715df55_0
2025-10-10T14:39:08.702996Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f35257b-394151b3-22968c32-faede634_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|478500ee-3fa81ac1-8015c937-6715df55_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:08.705858Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|478500ee-3fa81ac1-8015c937-6715df55_0] Write session: try to update token
2025-10-10T14:39:08.705876Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|478500ee-3fa81ac1-8015c937-6715df55_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:08.721234Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2894 sessionId: src_id|478500ee-3fa81ac1-8015c937-6715df55_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:08.721779Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:08.721800Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:08.721803Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:08.721805Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:08.721816Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602639651861045:7727]
2025-10-10T14:39:08.721820Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602639651861045:7727]
2025-10-10T14:39:08.721823Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602639651861045:7727]
2025-10-10T14:39:08.721873Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:08.721881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:08.721880Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:08.721883Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:08.721887Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:08.721891Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:08.722024Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:08.724046Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:08.769487Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602640434101193:6861]
2025-10-10T14:39:08.769874Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 pipe creation result: OK TabletId: 72075186224037892 Generation: 2893, pipe: [1:7559602640434101193:6861]
2025-10-10T14:39:08.839065Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:08.839755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:08.839773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:08.839821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602640434101193:6861], now have 1 active actors on pipe
2025-10-10T14:39:08.840057Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:08.840433Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 92 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602640434101193:6861]
2025-10-10T14:39:08.840471Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:39:08.840541Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2894 reason: status is not ok: tablet will be restarted right now sessionId: src_id|478500ee-3fa81ac1-8015c937-6715df55_0
2025-10-10T14:39:08.840759Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2894 sessionId: src_id|478500ee-3fa81ac1-8015c937-6715df55_0 is DEAD
2025-10-10T14:39:08.840938Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|478500ee-3fa81ac1-8015c937-6715df55_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:39:08.840947Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|478500ee-3fa81ac1-8015c937-6715df55_0] Write session will restart in 0.009005s
2025-10-10T14:39:08.840984Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|478500ee-3fa81ac1-8015c937-6715df55_0] Write session: Do CDS request
2025-10-10T14:39:08.840992Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|478500ee-3fa81ac1-8015c937-6715df55_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:08.840892Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:08.850956Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|478500ee-3fa81ac1-8015c937-6715df55_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:08.851031Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:08.851046Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2895
2025-10-10T14:39:08.851204Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2895 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:08.851266Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2895 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:08.851277Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2895 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:08.851282Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:08.851786Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2895 sessionId:  describe result for acl check
2025-10-10T14:39:08.851822Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:08.851829Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:08.851831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:08.851838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602640434101216:4866] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:08.852367Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602640434101216:4866] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:08.854999Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602640434101216:4866] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:08.858962Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602640434101216:4866] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:08.858979Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602640434101216:4866] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:08.858983Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602640434101216:4866] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:08.859004Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2895 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:08.865939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:08.870774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:08.871062Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:08.871075Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:08.871089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:08.871158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:08.871623Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602639651861285:7726]
2025-10-10T14:39:08.872279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:08.872651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:08.872707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:08.873056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:08.873133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:08.873143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:08.873144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:08.873146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:08.873147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:08.873149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:08.873150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:08.873151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:08.873153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:08.873154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:08.873156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:08.873157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:08.873158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:08.873165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:08.873180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:08.873185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:08.873190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:08.873194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:08.873199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:08.873204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:08.873208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:08.873212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:08.873217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:08.873222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:08.873227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:08.873231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:08.873240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:08.873249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:08.873256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:08.873262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:08.873268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:08.873273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:08.873278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:08.873285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:08.873289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:08.873297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:08.873301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:08.873307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:08.873328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:08.873354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:08.873359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:08.873365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:08.873370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:08.873376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:08.873382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:08.873388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:08.873399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:08.873405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:08.873410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:08.873416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:08.873424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:08.873434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:08.873475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:08.876152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:08.876536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:08.876551Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:08.876554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:08.876558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:08.876564Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2894 [2:7559602639651861285:7726]
2025-10-10T14:39:08.876578Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:08.876597Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:08.876605Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:08.876609Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:08.876612Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:08.876629Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:08.876641Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:08.876654Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:08.876720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:08.876733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:08.876735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:08.876737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:08.876809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:08.876817Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:08.876831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:08.876847Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:08.876882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:08.876910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602640434101326:4866], now have 1 active actors on pipe
2025-10-10T14:39:08.876922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602640434101203:2438], now have 1 active actors on pipe
2025-10-10T14:39:08.876930Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602639651861280:7726]
2025-10-10T14:39:08.876933Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602639651861280:7726]
2025-10-10T14:39:08.876936Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602639651861280:7726]
2025-10-10T14:39:08.876953Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:08.876948Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2894
2025-10-10T14:39:08.876949Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2894
2025-10-10T14:39:08.876968Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:08.876986Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:08.876995Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:08.877021Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602639651861280:7726]
2025-10-10T14:39:08.877032Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:08.877062Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:08.877069Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:08.877072Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:08.877079Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:08.877168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:08.877180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:08.877213Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e57d80af-7f23c88b-60bba1f5-dca7e695_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:08.877227Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:08.877232Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:08.877234Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:08.877247Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:08.877260Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:08.877275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:08.877478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:08.877491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:08.877513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:08.877639Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2895 partition: 0 MaxSeqNo: 40 sessionId: src_id|e57d80af-7f23c88b-60bba1f5-dca7e695_0
2025-10-10T14:39:08.878062Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|478500ee-3fa81ac1-8015c937-6715df55_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|e57d80af-7f23c88b-60bba1f5-dca7e695_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:08.880822Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e57d80af-7f23c88b-60bba1f5-dca7e695_0] Write session: try to update token
2025-10-10T14:39:08.880839Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e57d80af-7f23c88b-60bba1f5-dca7e695_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:08.897676Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2895 sessionId: src_id|e57d80af-7f23c88b-60bba1f5-dca7e695_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:08.897991Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:08.898008Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:08.898011Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:08.898013Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:08.898021Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602639651861280:7726]
2025-10-10T14:39:08.898025Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602639651861280:7726]
2025-10-10T14:39:08.898028Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602639651861280:7726]
2025-10-10T14:39:08.898087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:08.898098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:08.898101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:08.898252Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:08.900466Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:08.900617Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:08.900635Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:08.900650Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:08.940369Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602640434101444:6861]
2025-10-10T14:39:08.940694Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 pipe creation result: OK TabletId: 72075186224037892 Generation: 2894, pipe: [1:7559602640434101444:6861]
2025-10-10T14:39:09.015856Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:09.016425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:09.016441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:09.016487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602640434101444:6861], now have 1 active actors on pipe
2025-10-10T14:39:09.016779Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:09.016784Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 93 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602640434101444:6861]
2025-10-10T14:39:09.016807Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:09.016811Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:09.016886Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2895 reason: error at write: Disconnected sessionId: src_id|e57d80af-7f23c88b-60bba1f5-dca7e695_0
2025-10-10T14:39:09.017116Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2895 sessionId: src_id|e57d80af-7f23c88b-60bba1f5-dca7e695_0 is DEAD
2025-10-10T14:39:09.017268Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e57d80af-7f23c88b-60bba1f5-dca7e695_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:09.017280Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e57d80af-7f23c88b-60bba1f5-dca7e695_0] Write session will restart in 0.009928s
2025-10-10T14:39:09.016725Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:09.017317Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e57d80af-7f23c88b-60bba1f5-dca7e695_0] Write session: Do CDS request
2025-10-10T14:39:09.017323Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e57d80af-7f23c88b-60bba1f5-dca7e695_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:09.028957Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e57d80af-7f23c88b-60bba1f5-dca7e695_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:09.029034Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:09.029049Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2896
2025-10-10T14:39:09.029177Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2896 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:09.029217Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2896 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:09.029232Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2896 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:09.029241Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:09.029772Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2896 sessionId:  describe result for acl check
2025-10-10T14:39:09.029817Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:09.029824Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:09.029826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:09.029832Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602644729068768:4851] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:09.030433Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602644729068768:4851] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:09.034638Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602644729068768:4851] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:09.037934Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602644729068768:4851] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:09.037949Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602644729068768:4851] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:09.037953Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602644729068768:4851] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:09.037962Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2896 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:09.046746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:09.047572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:09.047783Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:09.047791Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:09.047801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:09.047847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:09.047893Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602643946828817:7725]
2025-10-10T14:39:09.048373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:09.048779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:09.048830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:09.049084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:09.049126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:09.049131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:09.049131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:09.049132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:09.049134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:09.049135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:09.049136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:09.049137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:09.049138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:09.049138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:09.049139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:09.049140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:09.049140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:09.049145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:09.049154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:09.049157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:09.049159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:09.049161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:09.049164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:09.049166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:09.049168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:09.049170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:09.049174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:09.049176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:09.049179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:09.049181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:09.049188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:09.049193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:09.049198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:09.049201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:09.049204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:09.049208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:09.049211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:09.049214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:09.049217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:09.049221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:09.049224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:09.049227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:09.049230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:09.049233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:09.049236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:09.049239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:09.049242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:09.049246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:09.049248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:09.049252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:09.049255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:09.049258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:09.049262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:09.049265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:09.049268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:09.049271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:09.049320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:09.051977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:09.052965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:09.052978Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:09.052981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:09.052986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:09.052994Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2895 [2:7559602643946828817:7725]
2025-10-10T14:39:09.053020Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:09.053045Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:09.053055Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:09.053059Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:09.053062Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:09.053081Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:09.053089Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:09.053097Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:09.053173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:09.053180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:09.053182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:09.053185Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:09.053257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:09.053266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:09.053278Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:09.053294Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:09.053326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:09.053370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602644729068939:4851], now have 1 active actors on pipe
2025-10-10T14:39:09.053374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602644729068742:2438], now have 1 active actors on pipe
2025-10-10T14:39:09.053382Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602643946828812:7725]
2025-10-10T14:39:09.053384Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602643946828812:7725]
2025-10-10T14:39:09.053387Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602643946828812:7725]
2025-10-10T14:39:09.053404Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:09.053424Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:09.053445Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:09.053440Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2895
2025-10-10T14:39:09.053452Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:09.053449Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2895
2025-10-10T14:39:09.053481Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602643946828812:7725]
2025-10-10T14:39:09.053484Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:09.053555Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:09.053562Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:09.053565Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:09.053572Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:09.053710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:09.053740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:09.053777Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b112acb9-73547044-a3086b59-671913c9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:09.053786Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:09.053790Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:09.053793Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:09.053808Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:09.053825Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:09.053854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:09.054193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:09.054207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:09.054233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:09.054341Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2896 partition: 0 MaxSeqNo: 40 sessionId: src_id|b112acb9-73547044-a3086b59-671913c9_0
2025-10-10T14:39:09.054782Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e57d80af-7f23c88b-60bba1f5-dca7e695_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|b112acb9-73547044-a3086b59-671913c9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:09.057606Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b112acb9-73547044-a3086b59-671913c9_0] Write session: try to update token
2025-10-10T14:39:09.057624Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b112acb9-73547044-a3086b59-671913c9_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:09.074729Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:09.074749Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:09.074752Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:09.074755Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:09.074767Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602643946828812:7725]
2025-10-10T14:39:09.074772Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602643946828812:7725]
2025-10-10T14:39:09.074777Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602643946828812:7725]
2025-10-10T14:39:09.074830Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:09.074833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:09.074838Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:09.074842Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:09.074843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:09.074846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:09.075004Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:09.077129Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2896 sessionId: src_id|b112acb9-73547044-a3086b59-671913c9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:09.079944Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:09.117416Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602644729068982:6861]
2025-10-10T14:39:09.129425Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 pipe creation result: OK TabletId: 72075186224037892 Generation: 2895, pipe: [1:7559602644729068982:6861]
2025-10-10T14:39:09.200982Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:09.201278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:09.201293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:09.201437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602644729068982:6861], now have 1 active actors on pipe
2025-10-10T14:39:09.201889Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:09.201848Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:09.201876Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:09.201898Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:09.201946Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 94 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602644729068982:6861]
2025-10-10T14:39:09.201959Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2896 reason: error at write: Disconnected sessionId: src_id|b112acb9-73547044-a3086b59-671913c9_0
2025-10-10T14:39:09.202182Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2896 sessionId: src_id|b112acb9-73547044-a3086b59-671913c9_0 is DEAD
2025-10-10T14:39:09.202378Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b112acb9-73547044-a3086b59-671913c9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:09.202392Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b112acb9-73547044-a3086b59-671913c9_0] Write session will restart in 0.009280s
2025-10-10T14:39:09.202417Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b112acb9-73547044-a3086b59-671913c9_0] Write session: Do CDS request
2025-10-10T14:39:09.202428Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b112acb9-73547044-a3086b59-671913c9_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:09.213029Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b112acb9-73547044-a3086b59-671913c9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:09.213005Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:09.213022Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2897
2025-10-10T14:39:09.213375Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2897 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:09.213435Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2897 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:09.213447Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2897 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:09.213452Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:09.213955Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2897 sessionId:  describe result for acl check
2025-10-10T14:39:09.213992Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:09.213994Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:09.213997Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:09.214005Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602644729069026:4833] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:09.214629Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602644729069026:4833] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:09.218887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602644729069026:4833] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:09.223302Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602644729069026:4833] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:09.223328Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602644729069026:4833] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:09.223332Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602644729069026:4833] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:09.223341Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2897 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:09.228168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:09.232658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:09.232938Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:09.232950Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:09.232962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:09.233019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:09.233064Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602643946829056:7722]
2025-10-10T14:39:09.233806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:09.234177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:09.234223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:09.234576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:09.234654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:09.234659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:09.234660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:09.234662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:09.234663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:09.234664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:09.234665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:09.234666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:09.234668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:09.234669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:09.234670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:09.234671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:09.234673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:09.234678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:09.234692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:09.234696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:09.234699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:09.234703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:09.234707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:09.234710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:09.234713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:09.234717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:09.234722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:09.234726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:09.234730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:09.234733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:09.234743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:09.234752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:09.234758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:09.234764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:09.234768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:09.234773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:09.234778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:09.234783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:09.234787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:09.234793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:09.234797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:09.234802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:09.234806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:09.234811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:09.234815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:09.234821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:09.234825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:09.234830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:09.234834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:09.234840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:09.234850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:09.234855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:09.234859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:09.234868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:09.234872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:09.234878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:09.234918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:09.237566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:09.237983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:09.237993Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:09.237996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:09.238000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:09.238007Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2896 [2:7559602643946829056:7722]
2025-10-10T14:39:09.238020Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:09.238040Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:09.238043Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:09.238047Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:09.238050Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:09.238068Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:09.238077Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:09.238086Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:09.238160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:09.238173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:09.238175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:09.238178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:09.238261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:09.238270Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:09.238284Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:09.238301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:09.238324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:09.238360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602644729069187:4833], now have 1 active actors on pipe
2025-10-10T14:39:09.238371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602644729068985:2438], now have 1 active actors on pipe
2025-10-10T14:39:09.238379Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602643946829049:7722]
2025-10-10T14:39:09.238382Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602643946829049:7722]
2025-10-10T14:39:09.238385Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602643946829049:7722]
2025-10-10T14:39:09.238404Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:09.238424Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:09.238450Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:09.238461Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:09.238453Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2896
2025-10-10T14:39:09.238487Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2896
2025-10-10T14:39:09.238491Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602643946829049:7722]
2025-10-10T14:39:09.238501Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:09.238519Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:09.238523Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:09.238525Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:09.238533Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:09.238676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:09.238698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:09.238733Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|77021d8d-aacab63d-3fa22c5f-680cec00_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:09.238749Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:09.238754Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:09.238757Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:09.238771Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:09.238785Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:09.238802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:09.239358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:09.239375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:09.239405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:09.239538Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2897 partition: 0 MaxSeqNo: 40 sessionId: src_id|77021d8d-aacab63d-3fa22c5f-680cec00_0
2025-10-10T14:39:09.240017Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b112acb9-73547044-a3086b59-671913c9_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|77021d8d-aacab63d-3fa22c5f-680cec00_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:09.242969Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|77021d8d-aacab63d-3fa22c5f-680cec00_0] Write session: try to update token
2025-10-10T14:39:09.242991Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|77021d8d-aacab63d-3fa22c5f-680cec00_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:09.258749Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2897 sessionId: src_id|77021d8d-aacab63d-3fa22c5f-680cec00_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:09.259198Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:09.259218Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:09.259222Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:09.259224Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:09.259234Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602643946829049:7722]
2025-10-10T14:39:09.259237Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602643946829049:7722]
2025-10-10T14:39:09.259241Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602643946829049:7722]
2025-10-10T14:39:09.259293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:09.259303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:09.259305Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:09.259334Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:09.259341Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:09.259346Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:09.259459Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:09.262142Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:09.302041Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602644729069225:6861]
2025-10-10T14:39:09.302402Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 pipe creation result: OK TabletId: 72075186224037892 Generation: 2896, pipe: [1:7559602644729069225:6861]
2025-10-10T14:39:09.377454Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:09.377975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:09.377994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:09.378044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602644729069225:6861], now have 1 active actors on pipe
2025-10-10T14:39:09.378261Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:09.378334Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:09.378337Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:09.378342Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:09.378404Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 95 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602644729069225:6861]
2025-10-10T14:39:09.378413Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2897 reason: error at write: Disconnected sessionId: src_id|77021d8d-aacab63d-3fa22c5f-680cec00_0
2025-10-10T14:39:09.378648Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2897 sessionId: src_id|77021d8d-aacab63d-3fa22c5f-680cec00_0 is DEAD
2025-10-10T14:39:09.378815Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77021d8d-aacab63d-3fa22c5f-680cec00_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:09.378827Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77021d8d-aacab63d-3fa22c5f-680cec00_0] Write session will restart in 0.006948s
2025-10-10T14:39:09.378853Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77021d8d-aacab63d-3fa22c5f-680cec00_0] Write session: Do CDS request
2025-10-10T14:39:09.378863Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77021d8d-aacab63d-3fa22c5f-680cec00_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:09.386974Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|77021d8d-aacab63d-3fa22c5f-680cec00_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:09.387036Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:09.387051Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2898
2025-10-10T14:39:09.387191Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2898 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:09.387228Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2898 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:09.387238Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2898 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:09.387243Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:09.387769Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2898 sessionId:  describe result for acl check
2025-10-10T14:39:09.387805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:09.387812Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:09.387815Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:09.387823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602644729069243:4816] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:09.388461Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602644729069243:4816] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:09.390684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602644729069243:4816] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:09.394291Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602644729069243:4816] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:09.394308Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602644729069243:4816] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:09.394312Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602644729069243:4816] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:09.394321Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2898 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:09.402150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:09.402993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:09.403232Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:09.403237Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:09.403250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:09.403308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:09.403350Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602643946829294:7719]
2025-10-10T14:39:09.404024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:09.407613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:09.407695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:09.408111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:09.408182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:09.408189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:09.408190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:09.408192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:09.408193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:09.408194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:09.408196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:09.408198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:09.408199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:09.408200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:09.408202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:09.408203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:09.408206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:09.408214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:09.408230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:09.408235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:09.408239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:09.408244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:09.408249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:09.408253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:09.408258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:09.408262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:09.408267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:09.408272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:09.408277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:09.408281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:09.408291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:09.408300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:09.408308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:09.408314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:09.408321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:09.408327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:09.408332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:09.408348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:09.408354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:09.408360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:09.408365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:09.408372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:09.408377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:09.408383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:09.408405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:09.408416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:09.408424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:09.408430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:09.408436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:09.408446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:09.408451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:09.408458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:09.408463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:09.408470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:09.408481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:09.408488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:09.408539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:09.411222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:09.411970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:09.411982Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:09.411985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:09.411989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:09.411998Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2897 [2:7559602643946829294:7719]
2025-10-10T14:39:09.412012Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:09.412032Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:09.412045Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:09.412049Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:09.412052Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:09.412071Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:09.412084Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:09.412098Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:09.412175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:09.412183Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:09.412185Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:09.412188Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:09.412268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:09.412277Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:09.412291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:09.412309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:09.412333Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:09.412363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602644729069227:2438], now have 1 active actors on pipe
2025-10-10T14:39:09.412372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602644729069338:4816], now have 1 active actors on pipe
2025-10-10T14:39:09.412380Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602643946829289:7719]
2025-10-10T14:39:09.412388Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602643946829289:7719]
2025-10-10T14:39:09.412390Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602643946829289:7719]
2025-10-10T14:39:09.412406Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:09.412422Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:09.412440Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:09.412445Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:09.412447Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:09.412448Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:09.412449Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:09.412490Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602643946829289:7719]
2025-10-10T14:39:09.412505Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:09.412520Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:09.412396Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2897
2025-10-10T14:39:09.412447Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2897
2025-10-10T14:39:09.412648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:09.412659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:09.412691Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3c15b9e5-d57131c1-93878563-40220581_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:09.412703Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:09.412708Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:09.412715Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:09.412729Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:09.412745Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:09.412777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:09.413006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:09.413025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:09.413041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:09.413187Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2898 partition: 0 MaxSeqNo: 40 sessionId: src_id|3c15b9e5-d57131c1-93878563-40220581_0
2025-10-10T14:39:09.413651Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77021d8d-aacab63d-3fa22c5f-680cec00_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|3c15b9e5-d57131c1-93878563-40220581_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:09.416602Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3c15b9e5-d57131c1-93878563-40220581_0] Write session: try to update token
2025-10-10T14:39:09.416620Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3c15b9e5-d57131c1-93878563-40220581_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:09.432921Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:09.432945Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:09.432949Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:09.432951Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:09.432965Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602643946829289:7719]
2025-10-10T14:39:09.432970Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602643946829289:7719]
2025-10-10T14:39:09.432974Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602643946829289:7719]
2025-10-10T14:39:09.433029Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:09.433031Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:09.433045Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:09.433048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:09.433050Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:09.433056Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:09.433209Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:09.436296Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2898 sessionId: src_id|3c15b9e5-d57131c1-93878563-40220581_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:09.439066Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:09.478620Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602644729069469:6861]
2025-10-10T14:39:09.478999Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 pipe creation result: OK TabletId: 72075186224037892 Generation: 2897, pipe: [1:7559602644729069469:6861]
2025-10-10T14:39:09.571210Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:09.571862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:09.571881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:09.571930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602644729069469:6861], now have 1 active actors on pipe
2025-10-10T14:39:09.572193Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:09.572348Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 96 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602644729069469:6861]
2025-10-10T14:39:09.572377Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:09.572426Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:39:09.572508Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2898 reason: status is not ok: tablet will be restarted right now sessionId: src_id|3c15b9e5-d57131c1-93878563-40220581_0
2025-10-10T14:39:09.572712Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2898 sessionId: src_id|3c15b9e5-d57131c1-93878563-40220581_0 is DEAD
2025-10-10T14:39:09.572886Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c15b9e5-d57131c1-93878563-40220581_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:39:09.572910Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c15b9e5-d57131c1-93878563-40220581_0] Write session will restart in 0.005367s
2025-10-10T14:39:09.572938Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c15b9e5-d57131c1-93878563-40220581_0] Write session: Do CDS request
2025-10-10T14:39:09.572945Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c15b9e5-d57131c1-93878563-40220581_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:09.579967Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3c15b9e5-d57131c1-93878563-40220581_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:09.580083Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:09.580099Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2899
2025-10-10T14:39:09.580254Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2899 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:09.580293Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2899 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:09.580299Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2899 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:09.580304Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:09.580775Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2899 sessionId:  describe result for acl check
2025-10-10T14:39:09.580825Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:09.580832Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:09.580834Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:09.580840Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602644729069487:4232] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:09.581495Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602644729069487:4232] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:09.585436Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602644729069487:4232] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:09.589451Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602644729069487:4232] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:09.589465Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602644729069487:4232] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:09.589469Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602644729069487:4232] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:09.589478Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2899 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:09.594588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:09.599606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:09.599873Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:09.599884Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:09.599898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:09.599956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:09.600004Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602643946829546:7709]
2025-10-10T14:39:09.600686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:09.601083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:09.601128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:09.601491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:09.601550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:09.601558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:09.601560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:09.601561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:09.601563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:09.601564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:09.601566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:09.601567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:09.601569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:09.601570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:09.601572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:09.601573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:09.601574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:09.601581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:09.601595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:09.601600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:09.601605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:09.601610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:09.601615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:09.601620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:09.601624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:09.601629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:09.601634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:09.601639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:09.601644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:09.601649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:09.601659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:09.601668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:09.601675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:09.601682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:09.601687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:09.601694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:09.601699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:09.601705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:09.601711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:09.601717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:09.601722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:09.601728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:09.601734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:09.601740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:09.601745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:09.601752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:09.601758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:09.601765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:09.601769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:09.601781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:09.601786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:09.601792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:09.601802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:09.601809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:09.601818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:09.601833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:09.601894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:09.604648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:09.605797Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2898
2025-10-10T14:39:09.605812Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2898
2025-10-10T14:39:09.605412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:09.605427Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:09.605430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:09.605434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:09.605441Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2898 [2:7559602643946829546:7709]
2025-10-10T14:39:09.605456Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:09.605475Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:09.605479Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:09.605483Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:09.605485Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:09.605503Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:09.605512Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:09.605520Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:09.605583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:09.605586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:09.605588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:09.605591Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:09.605667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:09.605670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:09.605682Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:09.605696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:09.605716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:09.605740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602644729069472:2438], now have 1 active actors on pipe
2025-10-10T14:39:09.605744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602644729069622:4232], now have 1 active actors on pipe
2025-10-10T14:39:09.605752Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602643946829541:7709]
2025-10-10T14:39:09.605755Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602643946829541:7709]
2025-10-10T14:39:09.605757Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602643946829541:7709]
2025-10-10T14:39:09.605772Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:09.605784Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:09.605786Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:09.605787Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:09.605789Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:09.605805Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:09.605808Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:09.605837Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602643946829541:7709]
2025-10-10T14:39:09.605840Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:09.605842Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:09.605862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:09.605867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:09.605921Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7c9d0a9a-d689fdd3-ffc1914a-cf3f5fb9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:09.605929Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:09.605934Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:09.605937Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:09.605949Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:09.605959Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:09.605976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:09.606144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:09.606151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:09.606189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:09.606391Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2899 partition: 0 MaxSeqNo: 40 sessionId: src_id|7c9d0a9a-d689fdd3-ffc1914a-cf3f5fb9_0
2025-10-10T14:39:09.606786Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c15b9e5-d57131c1-93878563-40220581_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|7c9d0a9a-d689fdd3-ffc1914a-cf3f5fb9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:09.609640Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7c9d0a9a-d689fdd3-ffc1914a-cf3f5fb9_0] Write session: try to update token
2025-10-10T14:39:09.609659Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7c9d0a9a-d689fdd3-ffc1914a-cf3f5fb9_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:09.626785Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:09.626802Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:09.626806Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:09.626808Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:09.626818Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602643946829541:7709]
2025-10-10T14:39:09.626826Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602643946829541:7709]
2025-10-10T14:39:09.626830Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602643946829541:7709]
2025-10-10T14:39:09.626881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:09.626888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:09.626889Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:09.626891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:09.626896Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:09.626901Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:09.627022Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:09.633236Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2899 sessionId: src_id|7c9d0a9a-d689fdd3-ffc1914a-cf3f5fb9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:09.636248Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:09.672755Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602644729069735:6861]
2025-10-10T14:39:09.677412Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 pipe creation result: OK TabletId: 72075186224037892 Generation: 2898, pipe: [1:7559602644729069735:6861]
2025-10-10T14:39:09.746326Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:09.747065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:09.747081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:09.747131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602644729069735:6861], now have 1 active actors on pipe
2025-10-10T14:39:09.747443Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:09.748267Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c9d0a9a-d689fdd3-ffc1914a-cf3f5fb9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:09.748281Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c9d0a9a-d689fdd3-ffc1914a-cf3f5fb9_0] Write session will restart in 0.007847s
2025-10-10T14:39:09.748308Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c9d0a9a-d689fdd3-ffc1914a-cf3f5fb9_0] Write session: Do CDS request
2025-10-10T14:39:09.748314Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c9d0a9a-d689fdd3-ffc1914a-cf3f5fb9_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:09.747755Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:09.747806Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 97 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602644729069735:6861]
2025-10-10T14:39:09.747826Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:09.747829Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:09.747882Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2899 reason: error at write: Disconnected sessionId: src_id|7c9d0a9a-d689fdd3-ffc1914a-cf3f5fb9_0
2025-10-10T14:39:09.748119Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2899 sessionId: src_id|7c9d0a9a-d689fdd3-ffc1914a-cf3f5fb9_0 is DEAD
2025-10-10T14:39:09.757969Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7c9d0a9a-d689fdd3-ffc1914a-cf3f5fb9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:09.759093Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:09.759108Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2900
2025-10-10T14:39:09.759286Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2900 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:09.759320Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2900 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:09.759327Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2900 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:09.759331Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:09.759802Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2900 sessionId:  describe result for acl check
2025-10-10T14:39:09.759850Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:09.759857Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:09.759859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:09.759866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602644729069783:4767] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:09.760459Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602644729069783:4767] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:09.763554Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602644729069783:4767] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:09.767548Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602644729069783:4767] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:09.767569Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602644729069783:4767] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:09.767574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602644729069783:4767] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:09.767584Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2900 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:09.775646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:09.776473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:09.776728Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:09.776741Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:09.776754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:09.776815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:09.776870Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602643946829824:7684]
2025-10-10T14:39:09.777596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:09.781455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:09.781539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:09.781996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:09.782070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:09.782077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:09.782078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:09.782079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:09.782081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:09.782083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:09.782085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:09.782086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:09.782088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:09.782089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:09.782091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:09.782092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:09.782093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:09.782101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:09.782116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:09.782120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:09.782126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:09.782130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:09.782134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:09.782138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:09.782142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:09.782147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:09.782151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:09.782156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:09.782160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:09.782164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:09.782174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:09.782185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:09.782195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:09.782202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:09.782209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:09.782215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:09.782219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:09.782225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:09.782230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:09.782236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:09.782240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:09.782248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:09.782253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:09.782259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:09.782264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:09.782269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:09.782275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:09.782281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:09.782286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:09.782291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:09.782296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:09.782301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:09.782307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:09.782316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:09.782321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:09.782327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:09.782374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:09.785871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:09.786273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:09.786289Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:09.786294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:09.786299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:09.786307Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2899 [2:7559602643946829824:7684]
2025-10-10T14:39:09.786325Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:09.786349Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:09.786352Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:09.786357Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:09.786360Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:09.786379Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:09.786394Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:09.786403Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:09.786475Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:09.786484Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:09.786488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:09.786491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:09.786747Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2899
2025-10-10T14:39:09.786757Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2899
2025-10-10T14:39:09.787074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:09.787084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:09.787100Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:09.787111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:09.787130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:09.787156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602644729069754:2438], now have 1 active actors on pipe
2025-10-10T14:39:09.787166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602644729069956:4767], now have 1 active actors on pipe
2025-10-10T14:39:09.787183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:09.787193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:09.787219Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602643946829819:7684]
2025-10-10T14:39:09.787227Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602643946829819:7684]
2025-10-10T14:39:09.787229Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602643946829819:7684]
2025-10-10T14:39:09.787245Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:09.787263Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:09.787267Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:09.787272Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:09.787274Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:09.787286Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:09.787293Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:09.787322Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1c5045f5-3b759cce-f611f21c-930c17b5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:09.787335Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:09.787341Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:09.787348Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:09.787361Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:09.787378Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:09.787431Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602643946829819:7684]
2025-10-10T14:39:09.787443Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:09.787458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:09.787466Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:09.788209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:09.788225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:09.788262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:09.788397Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2900 partition: 0 MaxSeqNo: 40 sessionId: src_id|1c5045f5-3b759cce-f611f21c-930c17b5_0
2025-10-10T14:39:09.788850Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c9d0a9a-d689fdd3-ffc1914a-cf3f5fb9_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|1c5045f5-3b759cce-f611f21c-930c17b5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:09.791641Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1c5045f5-3b759cce-f611f21c-930c17b5_0] Write session: try to update token
2025-10-10T14:39:09.791664Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1c5045f5-3b759cce-f611f21c-930c17b5_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:09.799683Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:39:09.799703Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:09.799717Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602643946829819:7684]
2025-10-10T14:39:09.799773Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:39:09.799773Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:39:09.799958Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:39:09.800101Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:09.800243Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:09.800382Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:09.800577Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:39:09.800616Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:39:09.818916Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:09.818936Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:09.818939Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:09.818942Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:09.818953Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602643946829819:7684]
2025-10-10T14:39:09.818962Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602643946829819:7684]
2025-10-10T14:39:09.818966Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602643946829819:7684]
2025-10-10T14:39:09.819019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:09.819030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:09.819032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:09.819077Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:09.819104Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:09.819108Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:09.819249Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:09.817274Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2900 sessionId: src_id|1c5045f5-3b759cce-f611f21c-930c17b5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:09.820110Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:09.847766Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602644729070003:6861]
2025-10-10T14:39:09.848100Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 pipe creation result: OK TabletId: 72075186224037892 Generation: 2899, pipe: [1:7559602644729070003:6861]
2025-10-10T14:39:09.941749Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:09.942279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:09.942297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:09.942335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602644729070003:6861], now have 1 active actors on pipe
2025-10-10T14:39:09.942597Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:09.942603Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 98 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602644729070003:6861]
2025-10-10T14:39:09.942629Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:09.942632Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:09.942698Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2900 reason: error at write: Disconnected sessionId: src_id|1c5045f5-3b759cce-f611f21c-930c17b5_0
2025-10-10T14:39:09.942751Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:09.942893Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2900 sessionId: src_id|1c5045f5-3b759cce-f611f21c-930c17b5_0 is DEAD
2025-10-10T14:39:09.943057Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c5045f5-3b759cce-f611f21c-930c17b5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:09.943068Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c5045f5-3b759cce-f611f21c-930c17b5_0] Write session will restart in 0.005670s
2025-10-10T14:39:09.943098Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c5045f5-3b759cce-f611f21c-930c17b5_0] Write session: Do CDS request
2025-10-10T14:39:09.943107Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c5045f5-3b759cce-f611f21c-930c17b5_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:09.949878Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1c5045f5-3b759cce-f611f21c-930c17b5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:09.950038Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:09.950055Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2901
2025-10-10T14:39:09.951627Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2901 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:09.951684Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2901 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:09.951691Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2901 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:09.951697Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:09.953061Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2901 sessionId:  describe result for acl check
2025-10-10T14:39:09.953106Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:09.953109Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:09.953111Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:09.953119Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602644729070026:4747] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:09.953793Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602644729070026:4747] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:09.962381Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602644729070026:4747] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:09.967033Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602644729070026:4747] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:09.967049Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602644729070026:4747] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:09.967053Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602644729070026:4747] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:09.967062Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2901 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:09.972385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:09.976560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:09.976835Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:09.976846Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:09.976861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:09.976944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:09.976991Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602643946830065:7679]
2025-10-10T14:39:09.977736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:09.978161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:09.978221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:09.978526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:09.978576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:09.978582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:09.978584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:09.978585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:09.978586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:09.978587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:09.978588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:09.978590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:09.978591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:09.978592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:09.978594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:09.978596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:09.978597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:09.978605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:09.978615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:09.978617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:09.978620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:09.978622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:09.978624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:09.978626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:09.978628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:09.978630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:09.978633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:09.978635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:09.978637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:09.978639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:09.978646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:09.978652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:09.978657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:09.978661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:09.978664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:09.978668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:09.978671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:09.978674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:09.978677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:09.978680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:09.978683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:09.978687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:09.978690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:09.978693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:09.978696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:09.978700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:09.978703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:09.978706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:09.978709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:09.978713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:09.978716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:09.978719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:09.978722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:09.978726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:09.978729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:09.978733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:09.978757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:09.981288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:09.981970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:09.981982Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:09.981985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:09.982000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:09.982006Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2900 [2:7559602643946830065:7679]
2025-10-10T14:39:09.982021Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:09.982045Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:09.982049Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:09.982053Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:09.982056Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:09.982073Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:09.982080Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:09.982094Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:09.982155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:09.982161Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:09.982163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:09.982166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:09.982246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:09.982254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:09.982265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:09.982279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:09.982296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:09.982323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602644729070008:2438], now have 1 active actors on pipe
2025-10-10T14:39:09.982331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602644729070170:4747], now have 1 active actors on pipe
2025-10-10T14:39:09.982339Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602643946830060:7679]
2025-10-10T14:39:09.982342Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602643946830060:7679]
2025-10-10T14:39:09.982344Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602643946830060:7679]
2025-10-10T14:39:09.982355Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:09.982368Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:09.982369Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:09.982378Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:09.982383Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:09.982385Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:09.982389Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:09.982419Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602643946830060:7679]
2025-10-10T14:39:09.982417Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2900
2025-10-10T14:39:09.982420Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2900
2025-10-10T14:39:09.982432Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:09.982440Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:09.982470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:09.982475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:09.982506Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a814ffad-4ee6a6a3-877a329b-29fc1004_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:09.982524Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:09.982532Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:09.982534Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:09.982548Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:09.982558Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:09.982576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:09.982714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:09.982723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:09.982739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:09.982817Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2901 partition: 0 MaxSeqNo: 40 sessionId: src_id|a814ffad-4ee6a6a3-877a329b-29fc1004_0
2025-10-10T14:39:09.983214Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c5045f5-3b759cce-f611f21c-930c17b5_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|a814ffad-4ee6a6a3-877a329b-29fc1004_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:09.986008Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a814ffad-4ee6a6a3-877a329b-29fc1004_0] Write session: try to update token
2025-10-10T14:39:09.986031Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a814ffad-4ee6a6a3-877a329b-29fc1004_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:10.002467Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:10.002486Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:10.002489Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:10.002492Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:10.002503Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602643946830060:7679]
2025-10-10T14:39:10.002508Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602643946830060:7679]
2025-10-10T14:39:10.002513Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602643946830060:7679]
2025-10-10T14:39:10.002568Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:10.002574Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:10.002577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:10.002579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:10.002585Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:10.002590Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:10.002737Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:10.003708Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2901 sessionId: src_id|a814ffad-4ee6a6a3-877a329b-29fc1004_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:10.006500Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:10.042856Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602649024037549:6861]
2025-10-10T14:39:10.043204Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 pipe creation result: OK TabletId: 72075186224037892 Generation: 2900, pipe: [1:7559602649024037549:6861]
2025-10-10T14:39:10.119237Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:10.119759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:10.119773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:10.119815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602649024037549:6861], now have 1 active actors on pipe
2025-10-10T14:39:10.120029Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:10.120066Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 99 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602649024037549:6861]
2025-10-10T14:39:10.120083Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:10.120086Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:10.120088Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1661: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 closed with error: reason# too much attempts to restart pipe
2025-10-10T14:39:10.120155Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2901 reason: error at write: Disconnected sessionId: src_id|a814ffad-4ee6a6a3-877a329b-29fc1004_0
2025-10-10T14:39:10.120177Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:10.120226Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2901 sessionId: src_id|a814ffad-4ee6a6a3-877a329b-29fc1004_0 is DEAD
2025-10-10T14:39:10.120331Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 29 consumer shared/user session shared/user_1_29_2309620461212798167_v1 is DEAD
2025-10-10T14:39:10.120497Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559602567419638383:6883] disconnected; active server actors: 1
2025-10-10T14:39:10.120507Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559602567419638383:6883] client user disconnected session shared/user_1_29_2309620461212798167_v1
2025-10-10T14:39:10.120508Z :ERROR: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] Got error. Status: UNAVAILABLE. Description: <main>: Error: too much attempts to restart pipe, code: 500027 
2025-10-10T14:39:10.120580Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a814ffad-4ee6a6a3-877a329b-29fc1004_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:10.120589Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a814ffad-4ee6a6a3-877a329b-29fc1004_0] Write session will restart in 0.008347s
2025-10-10T14:39:10.120624Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a814ffad-4ee6a6a3-877a329b-29fc1004_0] Write session: Do CDS request
2025-10-10T14:39:10.120628Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a814ffad-4ee6a6a3-877a329b-29fc1004_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:10.120701Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-10T14:39:10.120709Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-10T14:39:10.120721Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] Reconnecting session to cluster  in 0.005880s
2025-10-10T14:39:10.127817Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] Successfully connected. Initializing session
2025-10-10T14:39:10.128034Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-10T14:39:10.128046Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 30
2025-10-10T14:39:10.128232Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 30 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-10T14:39:10.128296Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 read init: from# ipv6:[::1]:37328, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-10T14:39:10.128383Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 auth for : user
2025-10-10T14:39:10.128592Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 Handle describe topics response
2025-10-10T14:39:10.128626Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 auth is DEAD
2025-10-10T14:39:10.128632Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 auth ok: topics# 1, initDone# 0
2025-10-10T14:39:10.128895Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 register session: topic# rt3.dc1--test-topic
2025-10-10T14:39:10.129012Z :INFO: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] Got InitResponse. ReadSessionId: shared/user_1_30_7993540039997143720_v1
2025-10-10T14:39:10.129002Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559602649024037567:4734] connected; active server actors: 1
2025-10-10T14:39:10.129018Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7559602649024037567:4734] session shared/user_1_30_7993540039997143720_v1
2025-10-10T14:39:10.129029Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-10-10T14:39:10.129042Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-10-10T14:39:10.129050Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_30_7993540039997143720_v1" (Sender=[1:7559602649024037564:4734], Pipe=[1:7559602649024037567:4734], Partitions=[], ActiveFamilyCount=0)
2025-10-10T14:39:10.129055Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-10T14:39:10.129067Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-10-10T14:39:10.129076Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_30_7993540039997143720_v1" (Sender=[1:7559602649024037564:4734], Pipe=[1:7559602649024037567:4734], Partitions=[], ActiveFamilyCount=0)
2025-10-10T14:39:10.129087Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_30_7993540039997143720_v1" sender [1:7559602649024037564:4734] lock partition 0 for ReadingSession "shared/user_1_30_7993540039997143720_v1" (Sender=[1:7559602649024037564:4734], Pipe=[1:7559602649024037567:4734], Partitions=[], ActiveFamilyCount=1) generation 1 step 30
2025-10-10T14:39:10.129100Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-10-10T14:39:10.129110Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000040s
2025-10-10T14:39:10.129432Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 30 Session: "shared/user_1_30_7993540039997143720_v1" ClientId: "user" PipeClient { RawX1: 7559602649024037567 RawX2: 4503603922342526 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-10T14:39:10.129463Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-10T14:39:10.129760Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a814ffad-4ee6a6a3-877a329b-29fc1004_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:10.129827Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:10.129838Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2902
2025-10-10T14:39:10.129990Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2902 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:10.130026Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2902 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:10.130033Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2902 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:10.130037Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:10.130850Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2902 sessionId:  describe result for acl check
2025-10-10T14:39:10.130883Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:10.130894Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:10.130896Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:10.130906Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602649024037583:4711] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:10.131626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602649024037583:4711] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:10.137065Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602649024037583:4711] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:10.140639Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602649024037583:4711] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:10.140656Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602649024037583:4711] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:10.140664Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602649024037583:4711] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:10.140674Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2902 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:10.143125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:10.153802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:10.154123Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:10.154145Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:10.154161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:10.154245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:10.154300Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602648241797604:7676]
2025-10-10T14:39:10.154976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:10.155424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:10.155509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:10.155908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:10.155994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:10.156002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:10.156004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:10.156005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:10.156008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:10.156010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:10.156012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:10.156014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:10.156016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:10.156017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:10.156019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:10.156020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:10.156022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:10.156030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:10.156046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:10.156050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:10.156054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:10.156058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:10.156064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:10.156068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:10.156073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:10.156077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:10.156081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:10.156085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:10.156090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:10.156094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:10.156103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:10.156113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:10.156134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:10.156146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:10.156151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:10.156158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:10.156165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:10.156172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:10.156182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:10.156193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:10.156198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:10.156203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:10.156209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:10.156218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:10.156223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:10.156229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:10.156234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:10.156240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:10.156245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:10.156253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:10.156258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:10.156265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:10.156272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:10.156280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:10.156286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:10.156292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:10.156344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:10.159830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:10.160198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:10.160216Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:10.160220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:10.160224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:10.160232Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2901 [2:7559602648241797604:7676]
2025-10-10T14:39:10.160247Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:10.160268Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:10.160281Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:10.160286Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:10.160288Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:10.160307Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:10.160321Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:10.160330Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:10.160398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:10.160407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:10.160409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:10.160412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:10.160487Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:10.160496Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:10.160510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:10.160525Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:10.160550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:10.160579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602649024037551:2438], now have 1 active actors on pipe
2025-10-10T14:39:10.160588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602649024037570:4699], now have 1 active actors on pipe
2025-10-10T14:39:10.160592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602649024037789:4711], now have 1 active actors on pipe
2025-10-10T14:39:10.160600Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602648241797599:7676]
2025-10-10T14:39:10.160603Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602648241797599:7676]
2025-10-10T14:39:10.160606Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602648241797599:7676]
2025-10-10T14:39:10.160621Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:10.160637Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:10.160641Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:10.160643Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:10.160648Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:10.160661Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:10.160665Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:10.160645Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2901
2025-10-10T14:39:10.160661Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 2901, pipe: [1:7559602649024037570:4699]
2025-10-10T14:39:10.160695Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2901
2025-10-10T14:39:10.160698Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602648241797599:7676]
2025-10-10T14:39:10.160708Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:10.160710Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:10.160729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:10.160741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:10.160756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_30_7993540039997143720_v1 on pipe: [1:7559602649024037570:4699]
2025-10-10T14:39:10.160801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:10.160808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:10.160833Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:10.160845Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:10.160848Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:10.161355Z node 2 :PERSQUEUE DEBUG: partition.cpp:3747: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_30_7993540039997143720_v1
2025-10-10T14:39:10.161370Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:10.161420Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9bfb5340-40db9018-9b0eeb03-8991f8b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:10.161434Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:39:10.161455Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:39:10.161607Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_30_7993540039997143720_v1:1 with generation 2901
2025-10-10T14:39:10.166100Z node 2 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:39:10.166154Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:39:10.166168Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:10.166177Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:10.166180Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:10.166199Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:10.166224Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:10.166239Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-10T14:39:10.166262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-10T14:39:10.166283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:10.166441Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 40 WriteTimestampMS: 1760106661000 SizeLag: 17206678 WriteTimestampEstimateMS: 1760107150159 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-10T14:39:10.166476Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 40 readOffset 0 committedOffset 0
2025-10-10T14:39:10.166517Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 sending to client partition status
2025-10-10T14:39:10.166547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:10.166564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:10.166596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:10.166725Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2902 partition: 0 MaxSeqNo: 40 sessionId: src_id|9bfb5340-40db9018-9b0eeb03-8991f8b_0
2025-10-10T14:39:10.169535Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a814ffad-4ee6a6a3-877a329b-29fc1004_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|9bfb5340-40db9018-9b0eeb03-8991f8b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:10.172579Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9bfb5340-40db9018-9b0eeb03-8991f8b_0] Write session: try to update token
2025-10-10T14:39:10.172605Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9bfb5340-40db9018-9b0eeb03-8991f8b_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:10.183758Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:10.183779Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:10.183783Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:10.183785Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:10.183797Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602648241797599:7676]
2025-10-10T14:39:10.183801Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602648241797599:7676]
2025-10-10T14:39:10.183808Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602648241797599:7676]
2025-10-10T14:39:10.183870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:10.183878Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:10.183877Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:10.183880Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:10.183885Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:10.183890Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:10.184038Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:10.197339Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2902 sessionId: src_id|9bfb5340-40db9018-9b0eeb03-8991f8b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:10.200099Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:10.306191Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:10.306786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:10.306801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:10.307018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_30_7993540039997143720_v1
2025-10-10T14:39:10.307039Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:10.307060Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:10.307073Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_30_7993540039997143720_v1
2025-10-10T14:39:10.307095Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 0 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602649024037570:4699]
2025-10-10T14:39:10.307113Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:39:10.307198Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2902 reason: status is not ok: tablet will be restarted right now sessionId: src_id|9bfb5340-40db9018-9b0eeb03-8991f8b_0
2025-10-10T14:39:10.307436Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2902 sessionId: src_id|9bfb5340-40db9018-9b0eeb03-8991f8b_0 is DEAD
2025-10-10T14:39:10.307807Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9bfb5340-40db9018-9b0eeb03-8991f8b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:39:10.307816Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9bfb5340-40db9018-9b0eeb03-8991f8b_0] Write session will restart in 0.009603s
2025-10-10T14:39:10.307844Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9bfb5340-40db9018-9b0eeb03-8991f8b_0] Write session: Do CDS request
2025-10-10T14:39:10.307854Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9bfb5340-40db9018-9b0eeb03-8991f8b_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:10.318946Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9bfb5340-40db9018-9b0eeb03-8991f8b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:10.319055Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:10.319070Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2903
2025-10-10T14:39:10.319258Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2903 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:10.319297Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2903 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:10.319308Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2903 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:10.319312Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:10.319860Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2903 sessionId:  describe result for acl check
2025-10-10T14:39:10.319904Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:10.319912Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:10.319915Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:10.319922Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602649024037868:4708] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:10.320566Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602649024037868:4708] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:10.323684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602649024037868:4708] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:10.328764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:10.328848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602649024037868:4708] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:10.328863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602649024037868:4708] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:10.328868Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602649024037868:4708] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:10.328877Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2903 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:10.333780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:10.334101Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:10.334114Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:10.334127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:10.334199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:10.334251Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602648241797851:7670]
2025-10-10T14:39:10.334909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:10.335293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:10.335370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:10.335765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:10.335836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:10.335838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:10.335839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:10.335841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:10.335842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:10.335844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:10.335845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:10.335846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:10.335848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:10.335849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:10.335850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:10.335852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:10.335853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:10.335859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:10.335873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:10.335878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:10.335882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:10.335887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:10.335891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:10.335895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:10.335900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:10.335904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:10.335909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:10.335913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:10.335917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:10.335921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:10.335930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:10.335941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:10.335949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:10.335955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:10.335963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:10.335969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:10.335975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:10.335981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:10.335986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:10.335992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:10.335996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:10.336002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:10.336007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:10.336013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:10.336017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:10.336023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:10.336031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:10.336036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:10.336042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:10.336048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:10.336053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:10.336058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:10.336063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:10.336068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:10.336074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:10.336079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:10.336135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:10.339319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:10.339867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:10.339878Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:10.339881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:10.339885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:10.339893Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2902 [2:7559602648241797851:7670]
2025-10-10T14:39:10.339907Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:10.339928Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:10.339932Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:10.339936Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:10.339938Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:10.339957Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:10.339970Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:10.339978Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:10.340043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:10.340050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:10.340052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:10.340055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:10.340130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:10.340138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:10.340150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:10.340163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:10.340180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:10.340208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602649024038040:4708], now have 1 active actors on pipe
2025-10-10T14:39:10.340216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602649024037806:2438], now have 1 active actors on pipe
2025-10-10T14:39:10.340224Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602648241797845:7670]
2025-10-10T14:39:10.340227Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602648241797845:7670]
2025-10-10T14:39:10.340229Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602648241797845:7670]
2025-10-10T14:39:10.340243Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:10.340262Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:10.340261Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:10.340266Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:10.340268Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:10.340284Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:10.340287Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:10.340323Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602648241797845:7670]
2025-10-10T14:39:10.340295Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2902
2025-10-10T14:39:10.340331Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:10.340296Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2902
2025-10-10T14:39:10.340342Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:10.340373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:10.340383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:10.340420Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|26ff5523-4e74dc4f-797b688f-b1ef36d5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:10.340434Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:10.340442Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:10.340445Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:10.340456Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:10.340471Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:10.340490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:10.340626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:10.340633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:10.340648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:10.340735Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2903 partition: 0 MaxSeqNo: 40 sessionId: src_id|26ff5523-4e74dc4f-797b688f-b1ef36d5_0
2025-10-10T14:39:10.341207Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9bfb5340-40db9018-9b0eeb03-8991f8b_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|26ff5523-4e74dc4f-797b688f-b1ef36d5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:10.344257Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|26ff5523-4e74dc4f-797b688f-b1ef36d5_0] Write session: try to update token
2025-10-10T14:39:10.344278Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|26ff5523-4e74dc4f-797b688f-b1ef36d5_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:10.359835Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2903 sessionId: src_id|26ff5523-4e74dc4f-797b688f-b1ef36d5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:10.361406Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:10.361427Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:10.361430Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:10.361433Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:10.361445Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602648241797845:7670]
2025-10-10T14:39:10.361450Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602648241797845:7670]
2025-10-10T14:39:10.361454Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602648241797845:7670]
2025-10-10T14:39:10.361508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:10.361522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:10.361527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:10.361689Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:10.362898Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:10.363114Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:10.363127Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:10.363131Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:10.407335Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602649024038053:4699]
2025-10-10T14:39:10.407662Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 pipe creation result: OK TabletId: 72075186224037892 Generation: 2902, pipe: [1:7559602649024038053:4699]
2025-10-10T14:39:10.478538Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:10.479395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:10.479415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:10.479467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602649024038053:4699], now have 1 active actors on pipe
2025-10-10T14:39:10.479694Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:10.479731Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:10.479744Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 1 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602649024038053:4699]
2025-10-10T14:39:10.479745Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:10.479767Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:10.479823Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2903 reason: error at write: Disconnected sessionId: src_id|26ff5523-4e74dc4f-797b688f-b1ef36d5_0
2025-10-10T14:39:10.480041Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2903 sessionId: src_id|26ff5523-4e74dc4f-797b688f-b1ef36d5_0 is DEAD
2025-10-10T14:39:10.480230Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|26ff5523-4e74dc4f-797b688f-b1ef36d5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:10.480241Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|26ff5523-4e74dc4f-797b688f-b1ef36d5_0] Write session will restart in 0.008572s
2025-10-10T14:39:10.480266Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|26ff5523-4e74dc4f-797b688f-b1ef36d5_0] Write session: Do CDS request
2025-10-10T14:39:10.480275Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|26ff5523-4e74dc4f-797b688f-b1ef36d5_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:10.489985Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|26ff5523-4e74dc4f-797b688f-b1ef36d5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:10.490016Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:10.490033Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2904
2025-10-10T14:39:10.490253Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2904 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:10.490298Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2904 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:10.490309Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2904 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:10.490313Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:10.490917Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2904 sessionId:  describe result for acl check
2025-10-10T14:39:10.490969Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:10.490975Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:10.490977Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:10.490984Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602649024038091:4691] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:10.491593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602649024038091:4691] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:10.494543Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602649024038091:4691] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:10.498256Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602649024038091:4691] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:10.498271Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602649024038091:4691] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:10.498274Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602649024038091:4691] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:10.498282Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2904 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:10.501162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:10.505760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:10.506006Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:10.506018Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:10.506052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:10.506117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:10.506159Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602648241798095:7659]
2025-10-10T14:39:10.506777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:10.507170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:10.507217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:10.507541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:10.507599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:10.507605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:10.507607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:10.507608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:10.507609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:10.507610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:10.507612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:10.507613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:10.507614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:10.507616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:10.507617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:10.507618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:10.507620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:10.507626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:10.507640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:10.507644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:10.507648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:10.507653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:10.507656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:10.507661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:10.507665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:10.507669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:10.507673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:10.507677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:10.507681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:10.507685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:10.507692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:10.507701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:10.507708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:10.507714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:10.507719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:10.507730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:10.507734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:10.507740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:10.507750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:10.507755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:10.507760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:10.507766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:10.507771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:10.507778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:10.507787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:10.507793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:10.507804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:10.507815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:10.507819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:10.507824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:10.507829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:10.507834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:10.507838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:10.507844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:10.507855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:10.507861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:10.507909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:10.510413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:10.511012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:10.511026Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:10.511029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:10.511033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:10.511040Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2903 [2:7559602648241798095:7659]
2025-10-10T14:39:10.511054Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:10.511076Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:10.511084Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:10.511088Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:10.511091Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:10.511108Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:10.511120Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:10.511129Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:10.511192Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:10.511199Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:10.511201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:10.511203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:10.511271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:10.511281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:10.511293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:10.511307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:10.511326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:10.511352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602649024038054:2438], now have 1 active actors on pipe
2025-10-10T14:39:10.511361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602649024038288:4691], now have 1 active actors on pipe
2025-10-10T14:39:10.511368Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602648241798090:7659]
2025-10-10T14:39:10.511376Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602648241798090:7659]
2025-10-10T14:39:10.511378Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602648241798090:7659]
2025-10-10T14:39:10.511392Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:10.511410Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:10.511409Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:10.511413Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:10.511415Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:10.511405Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2903
2025-10-10T14:39:10.511432Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:10.511435Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:10.511413Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2903
2025-10-10T14:39:10.511470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:10.511479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:10.511494Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602648241798090:7659]
2025-10-10T14:39:10.511506Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:10.511516Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:10.511540Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9bc740ba-f76b3f1-366f222a-89cc4312_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:10.511556Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:10.511561Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:10.511565Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:10.511576Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:10.511586Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:10.511610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:10.511750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:10.511758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:10.511772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:10.511881Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2904 partition: 0 MaxSeqNo: 40 sessionId: src_id|9bc740ba-f76b3f1-366f222a-89cc4312_0
2025-10-10T14:39:10.512301Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|26ff5523-4e74dc4f-797b688f-b1ef36d5_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|9bc740ba-f76b3f1-366f222a-89cc4312_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:10.514932Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9bc740ba-f76b3f1-366f222a-89cc4312_0] Write session: try to update token
2025-10-10T14:39:10.514950Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9bc740ba-f76b3f1-366f222a-89cc4312_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:10.529924Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2904 sessionId: src_id|9bc740ba-f76b3f1-366f222a-89cc4312_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:10.532753Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:10.533058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:10.533083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:10.533109Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:10.533113Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:10.533116Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:10.533118Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:10.533126Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602648241798090:7659]
2025-10-10T14:39:10.533131Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602648241798090:7659]
2025-10-10T14:39:10.533134Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602648241798090:7659]
2025-10-10T14:39:10.533192Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:10.533200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:10.533204Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:10.533208Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:10.533208Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:10.533210Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:10.533382Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:10.579912Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602649024038303:4699]
2025-10-10T14:39:10.580332Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 pipe creation result: OK TabletId: 72075186224037892 Generation: 2903, pipe: [1:7559602649024038303:4699]
2025-10-10T14:39:10.656780Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:10.657271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:39:10.657361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602649024038303:4699], now have 1 active actors on pipe
2025-10-10T14:39:10.657446Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:39:10.657516Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:10.657548Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:10.657556Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:10.657585Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 2 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602649024038303:4699]
2025-10-10T14:39:10.657650Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2904 reason: error at write: Disconnected sessionId: src_id|9bc740ba-f76b3f1-366f222a-89cc4312_0
2025-10-10T14:39:10.657846Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2904 sessionId: src_id|9bc740ba-f76b3f1-366f222a-89cc4312_0 is DEAD
2025-10-10T14:39:10.657992Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9bc740ba-f76b3f1-366f222a-89cc4312_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:10.658002Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9bc740ba-f76b3f1-366f222a-89cc4312_0] Write session will restart in 0.008881s
2025-10-10T14:39:10.658027Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9bc740ba-f76b3f1-366f222a-89cc4312_0] Write session: Do CDS request
2025-10-10T14:39:10.658033Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9bc740ba-f76b3f1-366f222a-89cc4312_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:10.668014Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9bc740ba-f76b3f1-366f222a-89cc4312_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:10.668075Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:10.668091Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2905
2025-10-10T14:39:10.668301Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2905 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:10.668340Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2905 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:10.668346Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2905 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:10.668350Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:10.668907Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2905 sessionId:  describe result for acl check
2025-10-10T14:39:10.668998Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:10.669005Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:10.669008Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:10.669014Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602649024038334:4671] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:10.669706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602649024038334:4671] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:10.673525Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602649024038334:4671] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:10.677206Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602649024038334:4671] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:10.677221Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602649024038334:4671] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:10.677225Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602649024038334:4671] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:10.677235Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2905 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:10.685072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:10.685743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:10.685937Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:10.685949Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:10.685961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:10.686017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:10.686060Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602648241798352:7661]
2025-10-10T14:39:10.686698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:10.687066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:10.687113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:10.687430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:10.687492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:10.687503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:10.687504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:10.687505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:10.687506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:10.687507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:10.687508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:10.687510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:10.687511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:10.687512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:10.687513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:10.687514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:10.687515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:10.687521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:10.687534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:10.687538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:10.687542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:10.687546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:10.687550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:10.687553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:10.687557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:10.687561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:10.687565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:10.687568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:10.687572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:10.687576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:10.687586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:10.687594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:10.687600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:10.687604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:10.687609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:10.687613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:10.687618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:10.687623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:10.687628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:10.687633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:10.687637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:10.687642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:10.687646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:10.687651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:10.687655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:10.687659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:10.687664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:10.687669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:10.687672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:10.687677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:10.687683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:10.687687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:10.687693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:10.687701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:10.687705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:10.687710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:10.687743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:10.690250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:10.690600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:10.690614Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:10.690616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:10.690619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:10.690626Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2904 [2:7559602648241798352:7661]
2025-10-10T14:39:10.690639Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:10.690658Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:10.690661Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:10.690665Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:10.690667Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:10.690683Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:10.690693Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:10.690700Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:10.690757Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:10.690765Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:10.690767Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:10.690770Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:10.690943Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2904
2025-10-10T14:39:10.690962Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2904
2025-10-10T14:39:10.691186Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:10.691196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:10.691207Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:10.691219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:10.691233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:10.691260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602649024038304:2438], now have 1 active actors on pipe
2025-10-10T14:39:10.691269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602649024038531:4671], now have 1 active actors on pipe
2025-10-10T14:39:10.691287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:10.691296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:10.691314Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602648241798347:7661]
2025-10-10T14:39:10.691321Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602648241798347:7661]
2025-10-10T14:39:10.691323Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602648241798347:7661]
2025-10-10T14:39:10.691336Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:10.691351Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:10.691359Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:10.691364Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:10.691366Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:10.691371Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:10.691374Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:10.691394Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a9c0eb38-bcf69adb-885ddb2-a28226da_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:10.691407Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:10.691415Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:10.691418Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:10.691430Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:10.691442Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:10.691472Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602648241798347:7661]
2025-10-10T14:39:10.691489Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:10.691501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:10.691507Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:10.691696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:10.691709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:10.691734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:10.691832Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2905 partition: 0 MaxSeqNo: 40 sessionId: src_id|a9c0eb38-bcf69adb-885ddb2-a28226da_0
2025-10-10T14:39:10.692264Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9bc740ba-f76b3f1-366f222a-89cc4312_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|a9c0eb38-bcf69adb-885ddb2-a28226da_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:10.695152Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a9c0eb38-bcf69adb-885ddb2-a28226da_0] Write session: try to update token
2025-10-10T14:39:10.695173Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a9c0eb38-bcf69adb-885ddb2-a28226da_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:10.711314Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2905 sessionId: src_id|a9c0eb38-bcf69adb-885ddb2-a28226da_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:10.711674Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:10.711697Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:10.711700Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:10.711702Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:10.711712Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602648241798347:7661]
2025-10-10T14:39:10.711717Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602648241798347:7661]
2025-10-10T14:39:10.711722Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602648241798347:7661]
2025-10-10T14:39:10.711776Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:10.711774Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:10.711781Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:10.711787Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:10.711788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:10.711791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:10.711937Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:10.714205Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:10.757580Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602649024038590:4699]
2025-10-10T14:39:10.757916Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 pipe creation result: OK TabletId: 72075186224037892 Generation: 2904, pipe: [1:7559602649024038590:4699]
2025-10-10T14:39:10.832807Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:10.833233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:10.833253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:10.833344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602649024038590:4699], now have 1 active actors on pipe
2025-10-10T14:39:10.833556Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:10.833561Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:10.833568Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 3 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602649024038590:4699]
2025-10-10T14:39:10.833606Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:10.833609Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:10.833674Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2905 reason: error at write: Disconnected sessionId: src_id|a9c0eb38-bcf69adb-885ddb2-a28226da_0
2025-10-10T14:39:10.833871Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2905 sessionId: src_id|a9c0eb38-bcf69adb-885ddb2-a28226da_0 is DEAD
2025-10-10T14:39:10.834054Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9c0eb38-bcf69adb-885ddb2-a28226da_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:10.834066Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9c0eb38-bcf69adb-885ddb2-a28226da_0] Write session will restart in 0.006855s
2025-10-10T14:39:10.834091Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9c0eb38-bcf69adb-885ddb2-a28226da_0] Write session: Do CDS request
2025-10-10T14:39:10.834100Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9c0eb38-bcf69adb-885ddb2-a28226da_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:10.841933Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a9c0eb38-bcf69adb-885ddb2-a28226da_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:10.842025Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:10.842041Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2906
2025-10-10T14:39:10.842162Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2906 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:10.842199Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2906 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:10.842209Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2906 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:10.842218Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:10.842970Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2906 sessionId:  describe result for acl check
2025-10-10T14:39:10.843022Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:10.843029Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:10.843032Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:10.843040Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602649024038622:4627] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:10.843642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602649024038622:4627] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:10.846891Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602649024038622:4627] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:10.850482Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602649024038622:4627] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:10.850504Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602649024038622:4627] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:10.850508Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602649024038622:4627] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:10.850518Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2906 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:10.858884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:10.859493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:10.859866Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:10.859883Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:10.859898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:10.859964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:10.860013Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602648241798635:7638]
2025-10-10T14:39:10.860657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:10.860959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:10.861010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:10.861404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:10.861483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:10.861491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:10.861493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:10.861494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:10.861496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:10.861497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:10.861499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:10.861501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:10.861502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:10.861503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:10.861505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:10.861506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:10.861508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:10.861514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:10.861529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:10.861534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:10.861539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:10.861542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:10.861546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:10.861551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:10.861555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:10.861560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:10.861564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:10.861569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:10.861573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:10.861578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:10.861587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:10.861597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:10.861610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:10.861616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:10.861626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:10.861633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:10.861638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:10.861644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:10.861651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:10.861662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:10.861667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:10.861678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:10.861684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:10.861690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:10.861699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:10.861704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:10.861709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:10.861716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:10.861726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:10.861732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:10.861743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:10.861748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:10.861759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:10.861765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:10.861773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:10.861778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:10.861828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:10.864247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:10.864891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:10.864902Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:10.864904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:10.864907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:10.864912Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2905 [2:7559602648241798635:7638]
2025-10-10T14:39:10.864924Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:10.864937Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:10.864939Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:10.864941Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:10.864942Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:10.864955Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:10.864960Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:10.864968Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:10.865037Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:10.865043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:10.865044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:10.865045Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:10.865098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:10.865103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:10.865111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:10.865118Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:10.865128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:10.865151Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602648241798630:7638]
2025-10-10T14:39:10.865159Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602648241798630:7638]
2025-10-10T14:39:10.865162Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602648241798630:7638]
2025-10-10T14:39:10.865173Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:10.865184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602649024038832:4627], now have 1 active actors on pipe
2025-10-10T14:39:10.865185Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:10.865188Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:10.865190Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:10.865195Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:10.865205Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:10.865208Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:10.865213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602649024038596:2438], now have 1 active actors on pipe
2025-10-10T14:39:10.865230Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602648241798630:7638]
2025-10-10T14:39:10.865240Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:10.865231Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2905
2025-10-10T14:39:10.865259Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:10.865273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:10.865245Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2905
2025-10-10T14:39:10.865290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:10.865318Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f06b66ce-1cdf9000-f73090fa-b9e3687a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:10.865347Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:10.865356Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:10.865358Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:10.865368Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:10.865382Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:10.865393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:10.865548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:10.865565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:10.865590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:10.865728Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2906 partition: 0 MaxSeqNo: 40 sessionId: src_id|f06b66ce-1cdf9000-f73090fa-b9e3687a_0
2025-10-10T14:39:10.866135Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9c0eb38-bcf69adb-885ddb2-a28226da_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|f06b66ce-1cdf9000-f73090fa-b9e3687a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:10.868831Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f06b66ce-1cdf9000-f73090fa-b9e3687a_0] Write session: try to update token
2025-10-10T14:39:10.868851Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f06b66ce-1cdf9000-f73090fa-b9e3687a_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:10.883276Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2906 sessionId: src_id|f06b66ce-1cdf9000-f73090fa-b9e3687a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:10.885198Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:39:10.885220Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:10.885232Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602648241798630:7638]
2025-10-10T14:39:10.885302Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:39:10.885317Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:39:10.885521Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:39:10.886029Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:10.885675Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:10.885827Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:10.885966Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:10.886162Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:39:10.886219Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:39:10.886260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:10.886269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:10.886299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:39:10.886372Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:39:10.895040Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:10.895063Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:10.895066Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:10.895068Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:10.895079Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602648241798630:7638]
2025-10-10T14:39:10.895083Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602648241798630:7638]
2025-10-10T14:39:10.895087Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602648241798630:7638]
2025-10-10T14:39:10.895134Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:10.895141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:10.895141Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:10.895149Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:10.895149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:10.895154Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:10.895289Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:10.933701Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602649024038850:4699]
2025-10-10T14:39:10.933992Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 pipe creation result: OK TabletId: 72075186224037892 Generation: 2905, pipe: [1:7559602649024038850:4699]
2025-10-10T14:39:11.015606Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:11.024489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:11.024528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:11.024788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:11.024938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:11.025037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:11.025116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:11.025158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:11.025163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:11.025243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:11.025402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:11.025482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:11.025563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:11.025616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:11.025624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:11.025704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:11.025793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:11.025863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:11.025946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:11.026000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:11.026009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:11.026087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:11.026169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:11.026243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:11.026310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:11.026357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:11.026364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:11.026442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:11.026514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:11.026588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:11.026665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:11.026718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:11.026730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:11.026805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:11.026875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:11.026945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:11.027017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:11.027072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:11.027081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:11.027154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:11.027222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:11.027298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:11.027372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:11.027420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:11.027427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:11.027501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:11.027568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:11.027637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:11.027703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:11.027753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:11.027761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:11.027833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:11.027900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:11.027967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:11.028034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:11.028083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:11.028090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:11.028161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:11.028225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:11.028297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:11.028365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:11.028417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:11.028423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:11.028486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602649024038850:4699], now have 1 active actors on pipe
2025-10-10T14:39:11.028679Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 4 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602649024038850:4699]
2025-10-10T14:39:11.028696Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:11.028700Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:11.028710Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:11.028733Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2906 reason: error at write: Disconnected sessionId: src_id|f06b66ce-1cdf9000-f73090fa-b9e3687a_0
2025-10-10T14:39:11.028981Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2906 sessionId: src_id|f06b66ce-1cdf9000-f73090fa-b9e3687a_0 is DEAD
2025-10-10T14:39:11.029139Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f06b66ce-1cdf9000-f73090fa-b9e3687a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:11.029151Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f06b66ce-1cdf9000-f73090fa-b9e3687a_0] Write session will restart in 0.009467s
2025-10-10T14:39:11.029179Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f06b66ce-1cdf9000-f73090fa-b9e3687a_0] Write session: Do CDS request
2025-10-10T14:39:11.029185Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f06b66ce-1cdf9000-f73090fa-b9e3687a_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:11.029689Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:11.040005Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f06b66ce-1cdf9000-f73090fa-b9e3687a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:11.040061Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:11.040077Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2907
2025-10-10T14:39:11.040252Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2907 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:11.040286Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2907 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:11.040298Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2907 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:11.040302Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:11.040927Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2907 sessionId:  describe result for acl check
2025-10-10T14:39:11.040966Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:11.040973Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:11.040978Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:11.040985Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602653319006214:4613] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:11.041642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602653319006214:4613] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:11.045701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602653319006214:4613] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:11.048703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602653319006214:4613] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:11.048719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602653319006214:4613] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:11.048723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602653319006214:4613] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:11.048732Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2907 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:11.054865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:11.055616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:11.055882Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:11.055900Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:11.055915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:11.055981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:11.056032Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602652536766178:7632]
2025-10-10T14:39:11.056734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:11.057097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:11.057162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:11.057562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:11.057653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:11.057664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:11.057665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:11.057666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:11.057668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:11.057669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:11.057670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:11.057672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:11.057674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:11.057675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:11.057676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:11.057677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:11.057679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:11.057686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:11.057701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:11.057706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:11.057710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:11.057714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:11.057719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:11.057723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:11.057727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:11.057731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:11.057736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:11.057740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:11.057744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:11.057748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:11.057758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:11.057769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:11.057777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:11.057783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:11.057790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:11.057796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:11.057807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:11.057814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:11.057821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:11.057832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:11.057837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:11.057847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:11.057852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:11.057862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:11.057868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:11.057873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:11.057883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:11.057889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:11.057895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:11.057901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:11.057906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:11.057911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:11.057917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:11.057926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:11.057931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:11.057941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:11.057984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:11.060575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:11.060902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:11.060917Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:11.060920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:11.060925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:11.060932Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2906 [2:7559602652536766178:7632]
2025-10-10T14:39:11.060946Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:11.060968Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:11.060976Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:11.060980Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:11.060982Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:11.061002Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:11.061014Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:11.061023Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:11.061090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:11.061098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:11.061100Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:11.061103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:11.061171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:11.061180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:11.061193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:11.061204Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:11.061223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:11.061250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602653319006149:2438], now have 1 active actors on pipe
2025-10-10T14:39:11.061259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602653319006385:4613], now have 1 active actors on pipe
2025-10-10T14:39:11.061268Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602652536766173:7632]
2025-10-10T14:39:11.061287Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602652536766173:7632]
2025-10-10T14:39:11.061290Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602652536766173:7632]
2025-10-10T14:39:11.061306Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:11.061326Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:11.061346Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2906
2025-10-10T14:39:11.061344Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:11.061349Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:11.061353Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2906
2025-10-10T14:39:11.061351Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:11.061371Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:11.061376Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:11.061418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:11.061423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:11.061445Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602652536766173:7632]
2025-10-10T14:39:11.061458Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:11.061464Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:11.061493Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2e649f46-20fec2c9-42361f00-11234d1e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:11.061506Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:11.061510Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:11.061517Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:11.061529Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:11.061547Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:11.061571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:11.061721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:11.061736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:11.061761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:11.061871Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2907 partition: 0 MaxSeqNo: 40 sessionId: src_id|2e649f46-20fec2c9-42361f00-11234d1e_0
2025-10-10T14:39:11.062250Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f06b66ce-1cdf9000-f73090fa-b9e3687a_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|2e649f46-20fec2c9-42361f00-11234d1e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:11.064940Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2e649f46-20fec2c9-42361f00-11234d1e_0] Write session: try to update token
2025-10-10T14:39:11.064957Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2e649f46-20fec2c9-42361f00-11234d1e_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:11.079159Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2907 sessionId: src_id|2e649f46-20fec2c9-42361f00-11234d1e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:11.081551Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:11.081569Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:11.081572Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:11.081574Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:11.081584Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602652536766173:7632]
2025-10-10T14:39:11.081589Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602652536766173:7632]
2025-10-10T14:39:11.081596Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602652536766173:7632]
2025-10-10T14:39:11.081648Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:11.081657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:11.081660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:11.081658Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:11.081666Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:11.081671Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:11.081829Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:11.082003Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:11.128775Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602653319006399:4699]
2025-10-10T14:39:11.129106Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 pipe creation result: OK TabletId: 72075186224037892 Generation: 2906, pipe: [1:7559602653319006399:4699]
2025-10-10T14:39:11.199754Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:11.200310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:11.200332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:11.200381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602653319006399:4699], now have 1 active actors on pipe
2025-10-10T14:39:11.200614Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:11.200642Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:11.200647Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 5 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602653319006399:4699]
2025-10-10T14:39:11.200672Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:39:11.200762Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2907 reason: status is not ok: tablet will be restarted right now sessionId: src_id|2e649f46-20fec2c9-42361f00-11234d1e_0
2025-10-10T14:39:11.200962Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2907 sessionId: src_id|2e649f46-20fec2c9-42361f00-11234d1e_0 is DEAD
2025-10-10T14:39:11.201131Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e649f46-20fec2c9-42361f00-11234d1e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:39:11.201143Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e649f46-20fec2c9-42361f00-11234d1e_0] Write session will restart in 0.008074s
2025-10-10T14:39:11.201169Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e649f46-20fec2c9-42361f00-11234d1e_0] Write session: Do CDS request
2025-10-10T14:39:11.201175Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e649f46-20fec2c9-42361f00-11234d1e_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:11.210927Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2e649f46-20fec2c9-42361f00-11234d1e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:11.211023Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:11.211048Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2908
2025-10-10T14:39:11.211179Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2908 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:11.211218Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2908 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:11.211225Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2908 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:11.211228Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:11.211932Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2908 sessionId:  describe result for acl check
2025-10-10T14:39:11.211976Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:11.211984Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:11.211986Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:11.211992Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602653319006438:4612] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:11.212560Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602653319006438:4612] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:11.217150Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602653319006438:4612] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:11.220136Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602653319006438:4612] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:11.220152Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602653319006438:4612] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:11.220164Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602653319006438:4612] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:11.220174Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2908 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:11.222571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:11.227555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:11.227831Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:11.227841Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:11.227854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:11.227911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:11.227963Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602652536766425:7636]
2025-10-10T14:39:11.228662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:11.229048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:11.229111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:11.229507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:11.229588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:11.229594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:11.229596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:11.229597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:11.229598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:11.229599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:11.229601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:11.229602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:11.229603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:11.229604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:11.229606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:11.229607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:11.229608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:11.229614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:11.229628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:11.229633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:11.229638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:11.229642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:11.229646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:11.229651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:11.229655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:11.229659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:11.229664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:11.229669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:11.229673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:11.229678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:11.229686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:11.229695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:11.229704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:11.229710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:11.229715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:11.229728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:11.229734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:11.229739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:11.229745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:11.229751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:11.229755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:11.229761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:11.229766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:11.229771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:11.229776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:11.229782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:11.229787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:11.229793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:11.229797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:11.229803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:11.229807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:11.229823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:11.229828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:11.229839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:11.229844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:11.229853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:11.229911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:11.232465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:11.233474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:11.233487Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:11.233489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:11.233493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:11.233500Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2907 [2:7559602652536766425:7636]
2025-10-10T14:39:11.233514Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:11.233532Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:11.233535Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:11.233538Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:11.233540Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:11.233559Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:11.233568Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:11.233581Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:11.233648Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:11.233655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:11.233657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:11.233660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:11.233730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:11.233738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:11.233751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:11.233767Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:11.233785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:11.233813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602653319006639:4612], now have 1 active actors on pipe
2025-10-10T14:39:11.233823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602653319006401:2438], now have 1 active actors on pipe
2025-10-10T14:39:11.233831Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602652536766420:7636]
2025-10-10T14:39:11.233833Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602652536766420:7636]
2025-10-10T14:39:11.233835Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602652536766420:7636]
2025-10-10T14:39:11.233850Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:11.233863Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:11.233878Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:11.233877Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:11.233882Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:11.233882Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:11.233885Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:11.233908Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602652536766420:7636]
2025-10-10T14:39:11.233917Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:11.233915Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2907
2025-10-10T14:39:11.233953Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:11.233936Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2907
2025-10-10T14:39:11.233956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:11.233962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:11.234001Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cca6bdcf-6bbde930-75e92d71-3cfda2ee_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:11.234014Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:11.234018Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:11.234020Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:11.234034Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:11.234049Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:11.234070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:11.234206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:11.234214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:11.234230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:11.234316Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2908 partition: 0 MaxSeqNo: 40 sessionId: src_id|cca6bdcf-6bbde930-75e92d71-3cfda2ee_0
2025-10-10T14:39:11.234742Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e649f46-20fec2c9-42361f00-11234d1e_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|cca6bdcf-6bbde930-75e92d71-3cfda2ee_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:11.237774Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cca6bdcf-6bbde930-75e92d71-3cfda2ee_0] Write session: try to update token
2025-10-10T14:39:11.237792Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cca6bdcf-6bbde930-75e92d71-3cfda2ee_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:11.246010Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:39:11.246030Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:11.246044Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602652536766420:7636]
2025-10-10T14:39:11.246093Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:39:11.246098Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:39:11.246272Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:39:11.246417Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:11.246557Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:11.246698Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:11.246890Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:39:11.246935Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:39:11.252813Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2908 sessionId: src_id|cca6bdcf-6bbde930-75e92d71-3cfda2ee_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:11.255825Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:11.256085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:11.256119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:11.256166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:39:11.256263Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:39:11.264643Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:11.264662Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:11.264665Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:11.264666Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:11.264675Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602652536766420:7636]
2025-10-10T14:39:11.264679Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602652536766420:7636]
2025-10-10T14:39:11.264681Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602652536766420:7636]
2025-10-10T14:39:11.264729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:11.264737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:11.264739Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:11.264749Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:11.264756Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:11.264761Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:11.264870Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:11.300848Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602653319006653:4699]
2025-10-10T14:39:11.301152Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 pipe creation result: OK TabletId: 72075186224037892 Generation: 2907, pipe: [1:7559602653319006653:4699]
2025-10-10T14:39:11.381590Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:11.390067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:11.390093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:11.390281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:11.390358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:11.390429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:11.390494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:11.390860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:11.390884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:11.390965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:11.391032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:11.391105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:11.391355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:11.391400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:11.391408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:11.391491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:11.391555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:11.391623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:11.391688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:11.391734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:11.391745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:11.391836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:11.391902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:11.391968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:11.392036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:11.392079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:11.392086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:11.392152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:11.392213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:11.392276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:11.392341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:11.392391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:11.392399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:11.392468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:11.392530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:11.392590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:11.392653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:11.392718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:11.392726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:11.392806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:11.392877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:11.392952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:11.393020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:11.393247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:11.393255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:11.393364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:11.393430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:11.393517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:11.393594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:11.393634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:11.393642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:11.393709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:11.393791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:11.393856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:11.393922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:11.393972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:11.393983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:11.394046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:11.394106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:11.394173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:11.394237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:11.394280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:11.394287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:11.394359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602653319006653:4699], now have 1 active actors on pipe
2025-10-10T14:39:11.394632Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:11.394645Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:11.394681Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:11.394689Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2908 reason: error at write: Disconnected sessionId: src_id|cca6bdcf-6bbde930-75e92d71-3cfda2ee_0
2025-10-10T14:39:11.394734Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 6 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602653319006653:4699]
2025-10-10T14:39:11.394753Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:11.395003Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2908 sessionId: src_id|cca6bdcf-6bbde930-75e92d71-3cfda2ee_0 is DEAD
2025-10-10T14:39:11.395116Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cca6bdcf-6bbde930-75e92d71-3cfda2ee_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:11.395129Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cca6bdcf-6bbde930-75e92d71-3cfda2ee_0] Write session will restart in 0.006587s
2025-10-10T14:39:11.395155Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cca6bdcf-6bbde930-75e92d71-3cfda2ee_0] Write session: Do CDS request
2025-10-10T14:39:11.395161Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cca6bdcf-6bbde930-75e92d71-3cfda2ee_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:11.402918Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cca6bdcf-6bbde930-75e92d71-3cfda2ee_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:11.403025Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:11.403042Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2909
2025-10-10T14:39:11.403189Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2909 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:11.403230Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2909 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:11.403244Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2909 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:11.403247Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:11.403759Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2909 sessionId:  describe result for acl check
2025-10-10T14:39:11.403800Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:11.403807Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:11.403809Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:11.403816Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602653319006674:4579] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:11.404435Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602653319006674:4579] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:11.408082Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602653319006674:4579] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:11.411864Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602653319006674:4579] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:11.411880Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602653319006674:4579] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:11.411884Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602653319006674:4579] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:11.411895Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2909 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:11.423649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:11.424359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:11.424899Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:11.424926Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:11.424942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:11.425020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:11.425073Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602652536766675:7628]
2025-10-10T14:39:11.425724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:11.426039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:11.426085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:11.426409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:11.426476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:11.426483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:11.426484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:11.426485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:11.426487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:11.426488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:11.426489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:11.426491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:11.426492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:11.426494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:11.426495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:11.426496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:11.426497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:11.426504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:11.426517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:11.426521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:11.426524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:11.426527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:11.426531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:11.426534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:11.426538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:11.426541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:11.426545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:11.426548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:11.426552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:11.426555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:11.426564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:11.426573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:11.426580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:11.426586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:11.426595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:11.426601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:11.426606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:11.426611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:11.426616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:11.426621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:11.426626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:11.426630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:11.426636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:11.426641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:11.426645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:11.426651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:11.426658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:11.426662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:11.426668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:11.426673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:11.426677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:11.426682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:11.426687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:11.426692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:11.426696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:11.426701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:11.426739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:11.429459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:11.429792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:11.429805Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:11.429808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:11.429811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:11.429819Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2908 [2:7559602652536766675:7628]
2025-10-10T14:39:11.429848Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:11.429873Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:11.429882Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:11.429886Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:11.429888Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:11.429907Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:11.429915Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:11.429925Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:11.429987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:11.429995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:11.429997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:11.430000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:11.430069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:11.430076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:11.430087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:11.430097Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:11.430113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:11.430143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602653319006803:4579], now have 1 active actors on pipe
2025-10-10T14:39:11.430152Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602652536766670:7628]
2025-10-10T14:39:11.430154Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602652536766670:7628]
2025-10-10T14:39:11.430156Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602652536766670:7628]
2025-10-10T14:39:11.430170Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:11.430179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602653319006659:2438], now have 1 active actors on pipe
2025-10-10T14:39:11.430185Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:11.430188Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:11.430189Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:11.430191Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:11.430203Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:11.430207Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:11.430234Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602652536766670:7628]
2025-10-10T14:39:11.430241Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:11.430248Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:11.430287Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2908
2025-10-10T14:39:11.430328Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2908
2025-10-10T14:39:11.430373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:11.430382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:11.430418Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|71794899-ba7e9b35-3c047b4f-b805f051_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:11.430426Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:11.430429Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:11.430432Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:11.430443Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:11.430455Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:11.430472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:11.430672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:11.430677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:11.430691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:11.430802Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2909 partition: 0 MaxSeqNo: 40 sessionId: src_id|71794899-ba7e9b35-3c047b4f-b805f051_0
2025-10-10T14:39:11.431280Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cca6bdcf-6bbde930-75e92d71-3cfda2ee_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|71794899-ba7e9b35-3c047b4f-b805f051_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:11.434237Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|71794899-ba7e9b35-3c047b4f-b805f051_0] Write session: try to update token
2025-10-10T14:39:11.434259Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|71794899-ba7e9b35-3c047b4f-b805f051_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:11.451271Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:11.451294Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:11.451298Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:11.451300Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:11.451313Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602652536766670:7628]
2025-10-10T14:39:11.451319Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602652536766670:7628]
2025-10-10T14:39:11.451322Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602652536766670:7628]
2025-10-10T14:39:11.451375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:11.451385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:11.451388Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:11.451387Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:11.451395Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:11.451400Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:11.451472Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2909 sessionId: src_id|71794899-ba7e9b35-3c047b4f-b805f051_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:11.451568Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:11.454459Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:11.496320Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602653319006911:4699]
2025-10-10T14:39:11.496704Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 pipe creation result: OK TabletId: 72075186224037892 Generation: 2908, pipe: [1:7559602653319006911:4699]
2025-10-10T14:39:11.568194Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:11.568736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:11.568753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:11.568801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602653319006911:4699], now have 1 active actors on pipe
2025-10-10T14:39:11.569175Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:11.569092Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 7 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602653319006911:4699]
2025-10-10T14:39:11.569094Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:11.569098Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:11.569130Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:11.569176Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2909 reason: error at write: Disconnected sessionId: src_id|71794899-ba7e9b35-3c047b4f-b805f051_0
2025-10-10T14:39:11.569569Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71794899-ba7e9b35-3c047b4f-b805f051_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:11.569579Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71794899-ba7e9b35-3c047b4f-b805f051_0] Write session will restart in 0.005042s
2025-10-10T14:39:11.569607Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71794899-ba7e9b35-3c047b4f-b805f051_0] Write session: Do CDS request
2025-10-10T14:39:11.569613Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71794899-ba7e9b35-3c047b4f-b805f051_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:11.569408Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2909 sessionId: src_id|71794899-ba7e9b35-3c047b4f-b805f051_0 is DEAD
2025-10-10T14:39:11.575997Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|71794899-ba7e9b35-3c047b4f-b805f051_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:11.576087Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:11.576102Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2910
2025-10-10T14:39:11.576477Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2910 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:11.576535Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2910 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:11.576550Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2910 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:11.576559Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:11.577034Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2910 sessionId:  describe result for acl check
2025-10-10T14:39:11.577068Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:11.577070Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:11.577074Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:11.577081Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602653319006929:4555] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:11.577669Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602653319006929:4555] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:11.580932Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602653319006929:4555] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:11.585155Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602653319006929:4555] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:11.585171Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602653319006929:4555] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:11.585176Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602653319006929:4555] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:11.585185Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2910 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:11.592361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:11.596920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:11.597189Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:11.597224Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:11.597239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:11.597324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:11.597723Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602652536766936:7624]
2025-10-10T14:39:11.598331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:11.598762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:11.598854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:11.599238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:11.599305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:11.599311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:11.599312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:11.599313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:11.599315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:11.599316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:11.599317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:11.599319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:11.599320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:11.599322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:11.599323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:11.599324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:11.599326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:11.599332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:11.599346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:11.599351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:11.599355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:11.599359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:11.599364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:11.599367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:11.599371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:11.599376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:11.599381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:11.599385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:11.599389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:11.599392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:11.599402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:11.599411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:11.599418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:11.599423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:11.599428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:11.599434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:11.599438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:11.599444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:11.599449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:11.599454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:11.599459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:11.599465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:11.599470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:11.599475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:11.599480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:11.599485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:11.599490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:11.599496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:11.599502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:11.599509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:11.599524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:11.599530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:11.599535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:11.599539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:11.599544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:11.599548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:11.599586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:11.602273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:11.602612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:11.602624Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:11.602627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:11.602631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:11.602638Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2909 [2:7559602652536766936:7624]
2025-10-10T14:39:11.602653Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:11.602672Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:11.602681Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:11.602686Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:11.602688Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:11.602706Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:11.602721Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:11.602730Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:11.602793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:11.602802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:11.602805Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:11.602808Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:11.602885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:11.602895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:11.602907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:11.602924Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:11.602943Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:11.602971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602653319006913:2438], now have 1 active actors on pipe
2025-10-10T14:39:11.602979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602653319007045:4555], now have 1 active actors on pipe
2025-10-10T14:39:11.602987Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602652536766931:7624]
2025-10-10T14:39:11.602995Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602652536766931:7624]
2025-10-10T14:39:11.602997Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602652536766931:7624]
2025-10-10T14:39:11.603013Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:11.603023Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2909
2025-10-10T14:39:11.603054Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2909
2025-10-10T14:39:11.603033Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:11.603054Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:11.603053Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:11.603057Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:11.603058Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:11.603060Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:11.603092Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602652536766931:7624]
2025-10-10T14:39:11.603095Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:11.603107Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:11.603111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:11.603116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:11.603170Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|375f60c2-3abaf75b-3cac3dfe-14a57b58_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:11.603183Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:11.603188Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:11.603195Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:11.603206Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:11.603219Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:11.603235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:11.603400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:11.603425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:11.603450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:11.603566Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2910 partition: 0 MaxSeqNo: 40 sessionId: src_id|375f60c2-3abaf75b-3cac3dfe-14a57b58_0
2025-10-10T14:39:11.604008Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71794899-ba7e9b35-3c047b4f-b805f051_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|375f60c2-3abaf75b-3cac3dfe-14a57b58_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:11.606758Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|375f60c2-3abaf75b-3cac3dfe-14a57b58_0] Write session: try to update token
2025-10-10T14:39:11.606775Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|375f60c2-3abaf75b-3cac3dfe-14a57b58_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:11.622569Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2910 sessionId: src_id|375f60c2-3abaf75b-3cac3dfe-14a57b58_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:11.624120Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:11.624141Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:11.624145Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:11.624146Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:11.624157Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602652536766931:7624]
2025-10-10T14:39:11.624162Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602652536766931:7624]
2025-10-10T14:39:11.624166Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602652536766931:7624]
2025-10-10T14:39:11.624221Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:11.624230Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:11.624232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:11.624234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:11.624245Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:11.624249Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:11.625255Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:11.624398Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:11.669777Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602653319007167:4699]
2025-10-10T14:39:11.670276Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 pipe creation result: OK TabletId: 72075186224037892 Generation: 2909, pipe: [1:7559602653319007167:4699]
2025-10-10T14:39:11.747716Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:11.748135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:11.748156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:11.748207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602653319007167:4699], now have 1 active actors on pipe
2025-10-10T14:39:11.748447Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:11.748485Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 8 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602653319007167:4699]
2025-10-10T14:39:11.748518Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:11.748521Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:11.748600Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2910 reason: error at write: Disconnected sessionId: src_id|375f60c2-3abaf75b-3cac3dfe-14a57b58_0
2025-10-10T14:39:11.748838Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2910 sessionId: src_id|375f60c2-3abaf75b-3cac3dfe-14a57b58_0 is DEAD
2025-10-10T14:39:11.749044Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|375f60c2-3abaf75b-3cac3dfe-14a57b58_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:11.749050Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|375f60c2-3abaf75b-3cac3dfe-14a57b58_0] Write session will restart in 0.005998s
2025-10-10T14:39:11.749069Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|375f60c2-3abaf75b-3cac3dfe-14a57b58_0] Write session: Do CDS request
2025-10-10T14:39:11.749074Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|375f60c2-3abaf75b-3cac3dfe-14a57b58_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:11.749059Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:11.755898Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|375f60c2-3abaf75b-3cac3dfe-14a57b58_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:11.756013Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:11.756028Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2911
2025-10-10T14:39:11.756300Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2911 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:11.756347Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2911 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:11.756358Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2911 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:11.756362Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:11.756871Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2911 sessionId:  describe result for acl check
2025-10-10T14:39:11.756907Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:11.756909Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:11.756911Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:11.756917Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602653319007210:4503] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:11.757586Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602653319007210:4503] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:11.761700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602653319007210:4503] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:11.766697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602653319007210:4503] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:11.766716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602653319007210:4503] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:11.766719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602653319007210:4503] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:11.766730Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2911 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:11.786318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:11.791561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:11.791867Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:11.791878Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:11.791892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:11.791966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:11.792015Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602652536767199:7601]
2025-10-10T14:39:11.792649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:11.793434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:11.793500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:11.793849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:11.793922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:11.793924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:11.793925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:11.793926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:11.793927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:11.793928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:11.793930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:11.793931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:11.793932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:11.793933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:11.793935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:11.793936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:11.793939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:11.793945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:11.793958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:11.793962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:11.793966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:11.793969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:11.793973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:11.793977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:11.793980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:11.793984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:11.793988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:11.793992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:11.793996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:11.794000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:11.794008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:11.794017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:11.794022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:11.794029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:11.794034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:11.794039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:11.794045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:11.794050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:11.794054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:11.794059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:11.794063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:11.794068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:11.794073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:11.794077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:11.794081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:11.794086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:11.794090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:11.794097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:11.794101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:11.794106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:11.794110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:11.794115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:11.794119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:11.794123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:11.794127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:11.794132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:11.794178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:11.798660Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2910
2025-10-10T14:39:11.798718Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2910
2025-10-10T14:39:11.797756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:11.798174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:11.798182Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:11.798184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:11.798189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:11.798198Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2910 [2:7559602652536767199:7601]
2025-10-10T14:39:11.798211Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:11.798229Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:11.798233Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:11.798237Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:11.798239Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:11.798258Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:11.798266Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:11.798274Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:11.798354Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:11.798356Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:11.798358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:11.798360Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:11.798432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:11.798436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:11.798448Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:11.798460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:11.798477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:11.798501Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602652536767194:7601]
2025-10-10T14:39:11.798504Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602652536767194:7601]
2025-10-10T14:39:11.798506Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602652536767194:7601]
2025-10-10T14:39:11.798516Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:11.798527Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:11.798531Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:11.798533Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:11.798533Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:11.798551Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:11.798554Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:11.798567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602653319007309:4503], now have 1 active actors on pipe
2025-10-10T14:39:11.798571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602653319007186:2438], now have 1 active actors on pipe
2025-10-10T14:39:11.798603Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602652536767194:7601]
2025-10-10T14:39:11.798613Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:11.800469Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:11.801944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:11.801969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:11.802009Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8b553d80-4dadd232-1f0c2670-4685e1b3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:11.802031Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:11.802037Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:11.802039Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:11.802054Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:11.802073Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:11.802095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:11.804703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:11.804732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:11.804771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:11.804959Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2911 partition: 0 MaxSeqNo: 40 sessionId: src_id|8b553d80-4dadd232-1f0c2670-4685e1b3_0
2025-10-10T14:39:11.805410Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|375f60c2-3abaf75b-3cac3dfe-14a57b58_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|8b553d80-4dadd232-1f0c2670-4685e1b3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:11.808342Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8b553d80-4dadd232-1f0c2670-4685e1b3_0] Write session: try to update token
2025-10-10T14:39:11.808366Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8b553d80-4dadd232-1f0c2670-4685e1b3_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:11.822439Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:11.822456Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:11.822460Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:11.822462Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:11.822472Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602652536767194:7601]
2025-10-10T14:39:11.822477Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602652536767194:7601]
2025-10-10T14:39:11.822481Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602652536767194:7601]
2025-10-10T14:39:11.822530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:11.822538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:11.822541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:11.822550Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:11.822557Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:11.822563Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:11.822681Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:11.825888Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2911 sessionId: src_id|8b553d80-4dadd232-1f0c2670-4685e1b3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:11.828543Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:11.848653Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602653319007466:4699]
2025-10-10T14:39:11.849042Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 pipe creation result: OK TabletId: 72075186224037892 Generation: 2910, pipe: [1:7559602653319007466:4699]
2025-10-10T14:39:11.938078Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:11.938562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:11.938576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:11.938623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602653319007466:4699], now have 1 active actors on pipe
2025-10-10T14:39:11.938864Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:11.938888Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 9 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602653319007466:4699]
2025-10-10T14:39:11.938915Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:39:11.939005Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2911 reason: status is not ok: tablet will be restarted right now sessionId: src_id|8b553d80-4dadd232-1f0c2670-4685e1b3_0
2025-10-10T14:39:11.939207Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2911 sessionId: src_id|8b553d80-4dadd232-1f0c2670-4685e1b3_0 is DEAD
2025-10-10T14:39:11.938845Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:11.939362Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b553d80-4dadd232-1f0c2670-4685e1b3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:39:11.939372Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b553d80-4dadd232-1f0c2670-4685e1b3_0] Write session will restart in 0.009767s
2025-10-10T14:39:11.939397Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b553d80-4dadd232-1f0c2670-4685e1b3_0] Write session: Do CDS request
2025-10-10T14:39:11.939402Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b553d80-4dadd232-1f0c2670-4685e1b3_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:11.951622Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8b553d80-4dadd232-1f0c2670-4685e1b3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:11.951736Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:11.951753Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2912
2025-10-10T14:39:11.951951Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2912 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:11.951992Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2912 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:11.952009Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2912 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:11.952013Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:11.952595Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2912 sessionId:  describe result for acl check
2025-10-10T14:39:11.952639Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:11.952642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:11.952646Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:11.952653Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602653319007499:4465] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:11.953408Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602653319007499:4465] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:11.956456Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602653319007499:4465] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:11.960132Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602653319007499:4465] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:11.960150Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602653319007499:4465] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:11.960154Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602653319007499:4465] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:11.960164Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2912 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:11.966603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:11.971565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:11.972287Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:11.972306Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:11.972326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:11.972416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:11.972468Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602652536767477:7605]
2025-10-10T14:39:11.973107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:11.973512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:11.973574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:11.973949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:11.974025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:11.974032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:11.974033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:11.974035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:11.974036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:11.974038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:11.974040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:11.974041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:11.974042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:11.974043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:11.974044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:11.974045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:11.974047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:11.974054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:11.974069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:11.974074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:11.974079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:11.974084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:11.974088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:11.974092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:11.974097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:11.974101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:11.974106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:11.974111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:11.974116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:11.974120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:11.974129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:11.974139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:11.974146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:11.974153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:11.974159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:11.974166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:11.974172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:11.974178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:11.974184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:11.974196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:11.974203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:11.974214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:11.974222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:11.974232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:11.974237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:11.974248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:11.974259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:11.974265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:11.974274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:11.974280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:11.974286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:11.974291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:11.974300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:11.974307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:11.974316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:11.974321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:11.974384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:11.977046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:11.977927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:11.977940Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:11.977942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:11.977946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:11.977953Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2911 [2:7559602652536767477:7605]
2025-10-10T14:39:11.977966Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:11.977986Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:11.977995Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:11.977999Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:11.978001Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:11.978020Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:11.978029Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:11.978036Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:11.978102Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:11.978110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:11.978112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:11.978115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:11.978188Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:11.978199Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:11.978213Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:11.978225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:11.978242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:11.978270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602653319007471:2438], now have 1 active actors on pipe
2025-10-10T14:39:11.978280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602653319007641:4465], now have 1 active actors on pipe
2025-10-10T14:39:11.978288Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602652536767472:7605]
2025-10-10T14:39:11.978291Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602652536767472:7605]
2025-10-10T14:39:11.978293Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602652536767472:7605]
2025-10-10T14:39:11.978306Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:11.978320Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:11.978327Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:11.978329Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:11.978331Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:11.978345Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:11.978353Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:11.978378Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602652536767472:7605]
2025-10-10T14:39:11.978394Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:11.978399Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:11.978416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:11.978422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:11.978480Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cfe804eb-b31b8d0c-78cc40c0-279238a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:11.978489Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:11.978494Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:11.978496Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:11.978509Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:11.978521Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:11.978539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:11.978707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:11.978717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:11.978735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:11.979254Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b553d80-4dadd232-1f0c2670-4685e1b3_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|cfe804eb-b31b8d0c-78cc40c0-279238a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:11.978319Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2911
2025-10-10T14:39:11.978321Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2911
2025-10-10T14:39:11.978844Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2912 partition: 0 MaxSeqNo: 40 sessionId: src_id|cfe804eb-b31b8d0c-78cc40c0-279238a_0
2025-10-10T14:39:11.982004Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfe804eb-b31b8d0c-78cc40c0-279238a_0] Write session: try to update token
2025-10-10T14:39:11.982023Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfe804eb-b31b8d0c-78cc40c0-279238a_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:11.997750Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2912 sessionId: src_id|cfe804eb-b31b8d0c-78cc40c0-279238a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:12.000346Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:12.000369Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:12.000373Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:12.000376Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:12.000389Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602652536767472:7605]
2025-10-10T14:39:12.000393Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602652536767472:7605]
2025-10-10T14:39:12.000397Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602652536767472:7605]
2025-10-10T14:39:12.000454Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:12.000456Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:12.000466Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:12.000470Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:12.000476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:12.000479Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:12.000644Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:12.001578Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:12.039137Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602657613975023:4699]
2025-10-10T14:39:12.042135Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 pipe creation result: OK TabletId: 72075186224037892 Generation: 2911, pipe: [1:7559602657613975023:4699]
2025-10-10T14:39:12.115913Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:12.116235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:12.116251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:12.116302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602657613975023:4699], now have 1 active actors on pipe
2025-10-10T14:39:12.116550Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:12.116537Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:12.116552Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:12.116556Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:12.116609Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 10 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602657613975023:4699]
2025-10-10T14:39:12.116624Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2912 reason: error at write: Disconnected sessionId: src_id|cfe804eb-b31b8d0c-78cc40c0-279238a_0
2025-10-10T14:39:12.116830Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2912 sessionId: src_id|cfe804eb-b31b8d0c-78cc40c0-279238a_0 is DEAD
2025-10-10T14:39:12.117173Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cfe804eb-b31b8d0c-78cc40c0-279238a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:12.117186Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cfe804eb-b31b8d0c-78cc40c0-279238a_0] Write session will restart in 0.009556s
2025-10-10T14:39:12.117212Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cfe804eb-b31b8d0c-78cc40c0-279238a_0] Write session: Do CDS request
2025-10-10T14:39:12.117222Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cfe804eb-b31b8d0c-78cc40c0-279238a_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:12.128003Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfe804eb-b31b8d0c-78cc40c0-279238a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:12.128028Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:12.128045Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2913
2025-10-10T14:39:12.128278Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2913 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:12.128316Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2913 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:12.128322Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2913 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:12.128326Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:12.128834Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2913 sessionId:  describe result for acl check
2025-10-10T14:39:12.128878Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:12.128885Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:12.128887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:12.128894Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602657613975067:4460] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:12.129547Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602657613975067:4460] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:12.132730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602657613975067:4460] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:12.136649Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602657613975067:4460] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:12.136669Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602657613975067:4460] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:12.136673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602657613975067:4460] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:12.136682Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2913 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:12.146081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:12.146814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:12.147049Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:12.147061Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:12.147074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:12.147130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:12.147178Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602656831735026:7596]
2025-10-10T14:39:12.147861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:12.148243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:12.148291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:12.148608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:12.148668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:12.148676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:12.148677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:12.148679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:12.148680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:12.148681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:12.148683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:12.148684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:12.148685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:12.148687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:12.148688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:12.148689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:12.148691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:12.148698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:12.148712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:12.148716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:12.148721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:12.148725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:12.148729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:12.148734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:12.148738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:12.148742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:12.148747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:12.148751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:12.148755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:12.148759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:12.148768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:12.148777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:12.148784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:12.148790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:12.148795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:12.148800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:12.148806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:12.148812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:12.148818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:12.148824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:12.148829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:12.148835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:12.148840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:12.148846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:12.148850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:12.148857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:12.148866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:12.148871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:12.148876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:12.148882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:12.148887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:12.148894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:12.148899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:12.148905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:12.148916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:12.148921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:12.148964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:12.151656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:12.152748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:12.152762Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:12.152765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:12.152769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:12.152777Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2912 [2:7559602656831735026:7596]
2025-10-10T14:39:12.152792Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:12.152813Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:12.152817Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:12.152822Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:12.152824Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:12.152845Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:12.152861Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:12.152870Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:12.152958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:12.152966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:12.152969Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:12.152971Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:12.153047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:12.153055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:12.153067Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:12.153084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:12.153107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:12.153140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602657613975230:4460], now have 1 active actors on pipe
2025-10-10T14:39:12.153148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602657613975024:2438], now have 1 active actors on pipe
2025-10-10T14:39:12.153157Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602656831735021:7596]
2025-10-10T14:39:12.153160Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602656831735021:7596]
2025-10-10T14:39:12.153163Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602656831735021:7596]
2025-10-10T14:39:12.153179Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:12.153203Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:12.153202Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:12.153207Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:12.153209Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:12.153224Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:12.153229Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:12.153198Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2912
2025-10-10T14:39:12.153209Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2912
2025-10-10T14:39:12.153283Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602656831735021:7596]
2025-10-10T14:39:12.153296Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:12.153302Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:12.153400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:12.153411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:12.153447Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|abbed269-8b8bc2f2-98d39689-f2579f96_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:12.153460Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:12.153467Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:12.153469Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:12.153481Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:12.153498Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:12.153521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:12.153726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:12.153746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:12.153764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:12.153885Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2913 partition: 0 MaxSeqNo: 40 sessionId: src_id|abbed269-8b8bc2f2-98d39689-f2579f96_0
2025-10-10T14:39:12.154373Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cfe804eb-b31b8d0c-78cc40c0-279238a_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|abbed269-8b8bc2f2-98d39689-f2579f96_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:12.157372Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|abbed269-8b8bc2f2-98d39689-f2579f96_0] Write session: try to update token
2025-10-10T14:39:12.157392Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|abbed269-8b8bc2f2-98d39689-f2579f96_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:12.173272Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:39:12.173300Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:12.173314Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602656831735021:7596]
2025-10-10T14:39:12.173405Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:39:12.173438Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:39:12.173673Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:39:12.173864Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:12.174027Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:12.174206Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:12.174429Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:39:12.174576Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:39:12.177180Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2913 sessionId: src_id|abbed269-8b8bc2f2-98d39689-f2579f96_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:12.180225Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:12.180448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:12.180495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:12.180539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:39:12.180624Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:39:12.185899Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:12.185923Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:12.185926Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:12.185928Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:12.185940Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602656831735021:7596]
2025-10-10T14:39:12.185945Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602656831735021:7596]
2025-10-10T14:39:12.185948Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602656831735021:7596]
2025-10-10T14:39:12.186001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:12.186003Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:12.186010Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:12.186014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:12.186015Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:12.186018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:12.186166Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:12.216789Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602657613975282:4699]
2025-10-10T14:39:12.217095Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 pipe creation result: OK TabletId: 72075186224037892 Generation: 2912, pipe: [1:7559602657613975282:4699]
2025-10-10T14:39:12.303941Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:12.313851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:12.313888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:12.314086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:12.314147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:12.314212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:12.314276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:12.314857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:12.314863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:12.314945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:12.315007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:12.315078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:12.315152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:12.315202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:12.315205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:12.315281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:12.315348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:12.315418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:12.315484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:12.315528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:12.315530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:12.315605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:12.315668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:12.315732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:12.315796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:12.315858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:12.315861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:12.315938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:12.316001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:12.316067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:12.316132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:12.316177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:12.316180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:12.316256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:12.316320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:12.316387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:12.316453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:12.316498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:12.316503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:12.316586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:12.316647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:12.316718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:12.316784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:12.316830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:12.316833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:12.316913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:12.316975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:12.317039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:12.317112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:12.317157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:12.317160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:12.317235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:12.317315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:12.317642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:12.317730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:12.317780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:12.317793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:12.317875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:12.317945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:12.318020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:12.318085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:12.318132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:12.318135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:12.318235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602657613975282:4699], now have 1 active actors on pipe
2025-10-10T14:39:12.318935Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:12.318942Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:12.318947Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:12.318984Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2913 reason: error at write: Disconnected sessionId: src_id|abbed269-8b8bc2f2-98d39689-f2579f96_0
2025-10-10T14:39:12.319005Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 11 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602657613975282:4699]
2025-10-10T14:39:12.319310Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2913 sessionId: src_id|abbed269-8b8bc2f2-98d39689-f2579f96_0 is DEAD
2025-10-10T14:39:12.319431Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|abbed269-8b8bc2f2-98d39689-f2579f96_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:12.319453Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|abbed269-8b8bc2f2-98d39689-f2579f96_0] Write session will restart in 0.008681s
2025-10-10T14:39:12.319488Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|abbed269-8b8bc2f2-98d39689-f2579f96_0] Write session: Do CDS request
2025-10-10T14:39:12.319496Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|abbed269-8b8bc2f2-98d39689-f2579f96_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:12.318922Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:12.329982Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|abbed269-8b8bc2f2-98d39689-f2579f96_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:12.330041Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:12.330057Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2914
2025-10-10T14:39:12.330230Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2914 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:12.330287Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2914 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:12.330298Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2914 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:12.330303Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:12.330862Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2914 sessionId:  describe result for acl check
2025-10-10T14:39:12.330918Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:12.330921Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:12.330923Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:12.330930Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602657613975316:4453] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:12.331537Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602657613975316:4453] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:12.335292Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602657613975316:4453] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:12.339071Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602657613975316:4453] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:12.339087Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602657613975316:4453] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:12.339091Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602657613975316:4453] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:12.339100Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2914 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:12.349590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:12.350441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:12.350696Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:12.350709Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:12.350722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:12.350784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:12.350838Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602656831735282:7591]
2025-10-10T14:39:12.351544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:12.351982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:12.352042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:12.352413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:12.352489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:12.352497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:12.352498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:12.352500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:12.352502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:12.352503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:12.352505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:12.352507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:12.352508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:12.352510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:12.352511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:12.352513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:12.352514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:12.352523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:12.352537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:12.352542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:12.352546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:12.352551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:12.352556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:12.352561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:12.352566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:12.352571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:12.352576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:12.352580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:12.352585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:12.352588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:12.352598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:12.352608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:12.352615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:12.352622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:12.352627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:12.352633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:12.352641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:12.352647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:12.352652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:12.352657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:12.352662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:12.352668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:12.352673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:12.352679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:12.352685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:12.352691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:12.352696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:12.352703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:12.352708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:12.352714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:12.352720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:12.352727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:12.352740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:12.352746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:12.352752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:12.352763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:12.352806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:12.355588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:12.356427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:12.356448Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:12.356451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:12.356456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:12.356466Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2913 [2:7559602656831735282:7591]
2025-10-10T14:39:12.356480Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:12.356502Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:12.356512Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:12.356517Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:12.356520Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:12.356538Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:12.356555Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:12.356564Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:12.356633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:12.356643Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:12.356646Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:12.356648Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:12.356726Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:12.356735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:12.356749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:12.356762Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:12.356785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:12.356814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602657613975468:4453], now have 1 active actors on pipe
2025-10-10T14:39:12.356822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602657613975284:2438], now have 1 active actors on pipe
2025-10-10T14:39:12.356830Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602656831735277:7591]
2025-10-10T14:39:12.356837Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602656831735277:7591]
2025-10-10T14:39:12.356839Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602656831735277:7591]
2025-10-10T14:39:12.356853Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:12.356868Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:12.356872Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:12.356873Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:12.356875Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:12.356892Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:12.356901Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:12.356876Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2913
2025-10-10T14:39:12.356878Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2913
2025-10-10T14:39:12.356945Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602656831735277:7591]
2025-10-10T14:39:12.356957Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:12.356963Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:12.356973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:12.356983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:12.357045Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f1e13220-fad64d44-ffc94c5d-ee4237a0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:12.357059Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:12.357064Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:12.357067Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:12.357080Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:12.357091Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:12.357116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:12.357290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:12.357299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:12.357318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:12.357883Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|abbed269-8b8bc2f2-98d39689-f2579f96_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|f1e13220-fad64d44-ffc94c5d-ee4237a0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:12.357414Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2914 partition: 0 MaxSeqNo: 40 sessionId: src_id|f1e13220-fad64d44-ffc94c5d-ee4237a0_0
2025-10-10T14:39:12.360782Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f1e13220-fad64d44-ffc94c5d-ee4237a0_0] Write session: try to update token
2025-10-10T14:39:12.360800Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f1e13220-fad64d44-ffc94c5d-ee4237a0_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:12.377376Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:12.377393Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:12.377398Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:12.377401Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:12.377413Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602656831735277:7591]
2025-10-10T14:39:12.377418Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602656831735277:7591]
2025-10-10T14:39:12.377423Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602656831735277:7591]
2025-10-10T14:39:12.377478Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:12.377484Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:12.377487Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:12.377489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:12.377493Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:12.377497Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:12.377502Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2914 sessionId: src_id|f1e13220-fad64d44-ffc94c5d-ee4237a0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:12.380724Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:12.377643Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:12.421417Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602657613975542:4699]
2025-10-10T14:39:12.421845Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 pipe creation result: OK TabletId: 72075186224037892 Generation: 2913, pipe: [1:7559602657613975542:4699]
2025-10-10T14:39:12.494380Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:12.495483Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 12 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602657613975542:4699]
2025-10-10T14:39:12.495514Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:12.495549Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:12.495555Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:12.495616Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2914 reason: error at write: Disconnected sessionId: src_id|f1e13220-fad64d44-ffc94c5d-ee4237a0_0
2025-10-10T14:39:12.495849Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2914 sessionId: src_id|f1e13220-fad64d44-ffc94c5d-ee4237a0_0 is DEAD
2025-10-10T14:39:12.496021Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1e13220-fad64d44-ffc94c5d-ee4237a0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:12.496047Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1e13220-fad64d44-ffc94c5d-ee4237a0_0] Write session will restart in 0.005280s
2025-10-10T14:39:12.496075Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1e13220-fad64d44-ffc94c5d-ee4237a0_0] Write session: Do CDS request
2025-10-10T14:39:12.496081Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1e13220-fad64d44-ffc94c5d-ee4237a0_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:12.495122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:12.495142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:12.495215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602657613975542:4699], now have 1 active actors on pipe
2025-10-10T14:39:12.495729Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:12.502907Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f1e13220-fad64d44-ffc94c5d-ee4237a0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:12.502994Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:12.503008Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2915
2025-10-10T14:39:12.503159Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2915 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:12.503197Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2915 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:12.503208Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2915 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:12.503212Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:12.503664Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2915 sessionId:  describe result for acl check
2025-10-10T14:39:12.503697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:12.503703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:12.503705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:12.503711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602657613975559:4421] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:12.504269Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602657613975559:4421] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:12.507111Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602657613975559:4421] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:12.511211Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602657613975559:4421] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:12.511224Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602657613975559:4421] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:12.511228Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602657613975559:4421] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:12.511240Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2915 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:12.520846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:12.521383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:12.521573Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:12.521582Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:12.521591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:12.521630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:12.521664Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602656831735537:7578]
2025-10-10T14:39:12.522076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:12.522369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:12.522404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:12.522648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:12.522691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:12.522695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:12.522696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:12.522696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:12.522697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:12.522698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:12.522699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:12.522699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:12.522700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:12.522701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:12.522702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:12.522703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:12.522704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:12.522707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:12.522715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:12.522718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:12.522720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:12.522722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:12.522725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:12.522727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:12.522730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:12.522732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:12.522734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:12.522736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:12.522739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:12.522741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:12.522746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:12.522752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:12.522757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:12.522760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:12.522764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:12.522767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:12.522769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:12.522773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:12.522776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:12.522779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:12.522781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:12.522784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:12.522787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:12.522790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:12.522793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:12.522796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:12.522799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:12.522802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:12.522806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:12.522809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:12.522811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:12.522814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:12.522817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:12.522820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:12.522823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:12.522826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:12.522850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:12.525227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:12.525892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:12.525904Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:12.525908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:12.525912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:12.525918Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2914 [2:7559602656831735537:7578]
2025-10-10T14:39:12.525931Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:12.525949Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:12.525956Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:12.525959Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:12.525962Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:12.525980Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:12.526002Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:12.526014Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:12.526072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:12.526078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:12.526080Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:12.526083Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:12.526150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:12.526156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:12.526168Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:12.526184Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:12.526206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:12.526231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602657613975714:4421], now have 1 active actors on pipe
2025-10-10T14:39:12.526238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602657613975543:2438], now have 1 active actors on pipe
2025-10-10T14:39:12.526246Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602656831735532:7578]
2025-10-10T14:39:12.526253Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602656831735532:7578]
2025-10-10T14:39:12.526255Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602656831735532:7578]
2025-10-10T14:39:12.526270Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:12.526285Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:12.526287Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:12.526290Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:12.526292Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:12.526307Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:12.526310Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:12.526341Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602656831735532:7578]
2025-10-10T14:39:12.526349Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:12.526352Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:12.526315Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2914
2025-10-10T14:39:12.526319Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2914
2025-10-10T14:39:12.526380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:12.526395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:12.526434Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a2b29fa3-d6fab3b-6eb6e762-d29ac579_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:12.526448Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:12.526455Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:12.526458Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:12.526470Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:12.526485Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:12.526516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:12.526636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:12.526649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:12.526674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:12.526823Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2915 partition: 0 MaxSeqNo: 40 sessionId: src_id|a2b29fa3-d6fab3b-6eb6e762-d29ac579_0
2025-10-10T14:39:12.527279Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1e13220-fad64d44-ffc94c5d-ee4237a0_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|a2b29fa3-d6fab3b-6eb6e762-d29ac579_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:12.530329Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a2b29fa3-d6fab3b-6eb6e762-d29ac579_0] Write session: try to update token
2025-10-10T14:39:12.530349Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a2b29fa3-d6fab3b-6eb6e762-d29ac579_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:12.546383Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2915 sessionId: src_id|a2b29fa3-d6fab3b-6eb6e762-d29ac579_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:12.547628Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:12.547654Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:12.547658Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:12.547660Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:12.547672Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602656831735532:7578]
2025-10-10T14:39:12.547677Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602656831735532:7578]
2025-10-10T14:39:12.547682Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602656831735532:7578]
2025-10-10T14:39:12.547729Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:12.547746Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:12.547755Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:12.547756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:12.547759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:12.547763Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:12.547965Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:12.549692Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:12.595678Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602657613975803:4699]
2025-10-10T14:39:12.596027Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 pipe creation result: OK TabletId: 72075186224037892 Generation: 2914, pipe: [1:7559602657613975803:4699]
2025-10-10T14:39:12.663860Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:12.664476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:12.664494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:12.664547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602657613975803:4699], now have 1 active actors on pipe
2025-10-10T14:39:12.664792Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:12.664804Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:12.664837Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:12.664870Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2915 reason: error at write: Disconnected sessionId: src_id|a2b29fa3-d6fab3b-6eb6e762-d29ac579_0
2025-10-10T14:39:12.665135Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 13 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602657613975803:4699]
2025-10-10T14:39:12.665163Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:12.665163Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2915 sessionId: src_id|a2b29fa3-d6fab3b-6eb6e762-d29ac579_0 is DEAD
2025-10-10T14:39:12.665291Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2b29fa3-d6fab3b-6eb6e762-d29ac579_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:12.665303Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2b29fa3-d6fab3b-6eb6e762-d29ac579_0] Write session will restart in 0.009394s
2025-10-10T14:39:12.665344Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2b29fa3-d6fab3b-6eb6e762-d29ac579_0] Write session: Do CDS request
2025-10-10T14:39:12.665355Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2b29fa3-d6fab3b-6eb6e762-d29ac579_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:12.675902Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a2b29fa3-d6fab3b-6eb6e762-d29ac579_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:12.676004Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:12.676020Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2916
2025-10-10T14:39:12.676168Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2916 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:12.676206Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2916 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:12.676217Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2916 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:12.676221Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:12.676700Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2916 sessionId:  describe result for acl check
2025-10-10T14:39:12.676740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:12.676746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:12.676748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:12.676755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602657613975846:4417] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:12.677410Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602657613975846:4417] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:12.680440Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602657613975846:4417] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:12.683557Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602657613975846:4417] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:12.683571Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602657613975846:4417] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:12.683575Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602657613975846:4417] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:12.683585Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2916 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:12.691580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:12.692223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:12.692446Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:12.692459Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:12.692474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:12.692531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:12.692581Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602656831735805:7567]
2025-10-10T14:39:12.693217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:12.693543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:12.693587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:12.693919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:12.693989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:12.693994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:12.693996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:12.693997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:12.693998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:12.693999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:12.694001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:12.694002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:12.694003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:12.694004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:12.694005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:12.694007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:12.694008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:12.694014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:12.694028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:12.694032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:12.694036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:12.694040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:12.694044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:12.694048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:12.694052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:12.694055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:12.694062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:12.694066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:12.694069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:12.694073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:12.694081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:12.694090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:12.694097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:12.694103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:12.694108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:12.694113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:12.694117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:12.694123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:12.694131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:12.694138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:12.694142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:12.694147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:12.694153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:12.694158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:12.694163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:12.694167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:12.694173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:12.694178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:12.694182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:12.694186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:12.694190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:12.694196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:12.694200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:12.694205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:12.694209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:12.694214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:12.694253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:12.696720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:12.697036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:12.697049Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:12.697052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:12.697057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:12.697065Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2915 [2:7559602656831735805:7567]
2025-10-10T14:39:12.697078Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:12.697102Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:12.697110Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:12.697113Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:12.697116Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:12.697134Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:12.697150Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:12.697174Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:12.697238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:12.697257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:12.697260Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:12.697263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:12.697352Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:12.697361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:12.697375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:12.697392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:12.697416Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:12.697444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602657613975804:2438], now have 1 active actors on pipe
2025-10-10T14:39:12.697454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602657613976029:4417], now have 1 active actors on pipe
2025-10-10T14:39:12.697461Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602656831735800:7567]
2025-10-10T14:39:12.697468Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602656831735800:7567]
2025-10-10T14:39:12.697472Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602656831735800:7567]
2025-10-10T14:39:12.697491Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:12.697509Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:12.697514Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:12.697518Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:12.697523Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:12.697530Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:12.697533Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:12.697504Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2915
2025-10-10T14:39:12.697559Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2915
2025-10-10T14:39:12.697558Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602656831735800:7567]
2025-10-10T14:39:12.697568Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:12.697580Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:12.697606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:12.697616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:12.697647Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a9b3aba0-cb8ffdc8-5a56b292-cb5a653_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:12.697661Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:12.697669Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:12.697672Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:12.697683Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:12.697698Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:12.697713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:12.697899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:12.697907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:12.697921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:12.698039Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2916 partition: 0 MaxSeqNo: 40 sessionId: src_id|a9b3aba0-cb8ffdc8-5a56b292-cb5a653_0
2025-10-10T14:39:12.698471Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2b29fa3-d6fab3b-6eb6e762-d29ac579_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|a9b3aba0-cb8ffdc8-5a56b292-cb5a653_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:12.701289Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a9b3aba0-cb8ffdc8-5a56b292-cb5a653_0] Write session: try to update token
2025-10-10T14:39:12.701307Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a9b3aba0-cb8ffdc8-5a56b292-cb5a653_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:12.715510Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2916 sessionId: src_id|a9b3aba0-cb8ffdc8-5a56b292-cb5a653_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:12.717738Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:12.717759Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:12.717764Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:12.717766Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:12.717777Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602656831735800:7567]
2025-10-10T14:39:12.717782Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602656831735800:7567]
2025-10-10T14:39:12.717786Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602656831735800:7567]
2025-10-10T14:39:12.717836Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:12.717843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:12.717853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:12.717856Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:12.717856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:12.717860Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:12.718021Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:12.718644Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:12.765146Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602657613976077:4699]
2025-10-10T14:39:12.765539Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 pipe creation result: OK TabletId: 72075186224037892 Generation: 2915, pipe: [1:7559602657613976077:4699]
2025-10-10T14:39:12.841762Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:12.842366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:12.842386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:12.842433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602657613976077:4699], now have 1 active actors on pipe
2025-10-10T14:39:12.842663Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:12.842684Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:12.842697Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:12.842755Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2916 reason: error at write: Disconnected sessionId: src_id|a9b3aba0-cb8ffdc8-5a56b292-cb5a653_0
2025-10-10T14:39:12.842983Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2916 sessionId: src_id|a9b3aba0-cb8ffdc8-5a56b292-cb5a653_0 is DEAD
2025-10-10T14:39:12.843150Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9b3aba0-cb8ffdc8-5a56b292-cb5a653_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:12.843163Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9b3aba0-cb8ffdc8-5a56b292-cb5a653_0] Write session will restart in 0.008886s
2025-10-10T14:39:12.843160Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:12.843188Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9b3aba0-cb8ffdc8-5a56b292-cb5a653_0] Write session: Do CDS request
2025-10-10T14:39:12.843195Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9b3aba0-cb8ffdc8-5a56b292-cb5a653_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:12.843208Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 14 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602657613976077:4699]
2025-10-10T14:39:12.852980Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a9b3aba0-cb8ffdc8-5a56b292-cb5a653_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:12.853071Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:12.853084Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2917
2025-10-10T14:39:12.853235Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2917 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:12.853293Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2917 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:12.853304Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2917 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:12.853309Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:12.853834Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2917 sessionId:  describe result for acl check
2025-10-10T14:39:12.853869Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:12.853877Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:12.853879Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:12.853886Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602657613976124:4366] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:12.854437Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602657613976124:4366] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:12.857924Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602657613976124:4366] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:12.861125Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602657613976124:4366] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:12.861140Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602657613976124:4366] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:12.861144Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602657613976124:4366] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:12.861152Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2917 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:12.870618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:12.871390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:12.871640Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:12.871653Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:12.871666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:12.871726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:12.871773Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602656831736076:7554]
2025-10-10T14:39:12.872422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:12.872917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:12.873014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:12.873459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:12.873537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:12.873543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:12.873544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:12.873545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:12.873546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:12.873548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:12.873549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:12.873550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:12.873552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:12.873553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:12.873554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:12.873555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:12.873557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:12.873563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:12.873575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:12.873579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:12.873584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:12.873588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:12.873592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:12.873596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:12.873600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:12.873604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:12.873610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:12.873614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:12.873618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:12.873622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:12.873630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:12.873638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:12.873644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:12.873652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:12.873656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:12.873660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:12.873663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:12.873668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:12.873673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:12.873677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:12.873681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:12.873686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:12.873698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:12.873702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:12.873706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:12.873725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:12.873732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:12.873742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:12.873746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:12.873751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:12.873755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:12.873764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:12.873769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:12.873774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:12.873782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:12.873787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:12.873831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:12.876442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:12.877065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:12.877080Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:12.877082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:12.877086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:12.877093Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2916 [2:7559602656831736076:7554]
2025-10-10T14:39:12.877108Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:12.877130Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:12.877142Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:12.877147Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:12.877150Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:12.877168Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:12.877183Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:12.877191Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:12.877271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:12.877282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:12.877284Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:12.877286Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:12.877375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:12.877383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:12.877395Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:12.877410Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:12.877432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:12.877457Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602656831736071:7554]
2025-10-10T14:39:12.877464Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602656831736071:7554]
2025-10-10T14:39:12.877466Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602656831736071:7554]
2025-10-10T14:39:12.877481Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:12.877500Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:12.877520Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:12.877523Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:12.877529Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:12.877547Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:12.877551Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602656831736071:7554]
2025-10-10T14:39:12.877553Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:12.877556Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:12.877563Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:12.877744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602657613976097:2438], now have 1 active actors on pipe
2025-10-10T14:39:12.877754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602657613976278:4366], now have 1 active actors on pipe
2025-10-10T14:39:12.877876Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2916
2025-10-10T14:39:12.877919Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2916
2025-10-10T14:39:12.878028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:12.878042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:12.878076Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3a0d363f-134d7190-fa73a22b-5d1e4c9e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:12.878086Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:12.878091Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:12.878093Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:12.878106Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:12.878138Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:12.878153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:12.878377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:12.878396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:12.878414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:12.878539Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2917 partition: 0 MaxSeqNo: 40 sessionId: src_id|3a0d363f-134d7190-fa73a22b-5d1e4c9e_0
2025-10-10T14:39:12.878968Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9b3aba0-cb8ffdc8-5a56b292-cb5a653_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|3a0d363f-134d7190-fa73a22b-5d1e4c9e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:12.881827Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3a0d363f-134d7190-fa73a22b-5d1e4c9e_0] Write session: try to update token
2025-10-10T14:39:12.881866Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3a0d363f-134d7190-fa73a22b-5d1e4c9e_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:12.897384Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2917 sessionId: src_id|3a0d363f-134d7190-fa73a22b-5d1e4c9e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:12.897461Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:12.897478Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:12.897482Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:12.897484Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:12.897496Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602656831736071:7554]
2025-10-10T14:39:12.897504Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602656831736071:7554]
2025-10-10T14:39:12.897510Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602656831736071:7554]
2025-10-10T14:39:12.897566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:12.897568Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:12.897576Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:12.897580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:12.897580Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:12.897583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:12.897752Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:12.900390Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:12.943326Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602657613976372:4699]
2025-10-10T14:39:12.943618Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 pipe creation result: OK TabletId: 72075186224037892 Generation: 2916, pipe: [1:7559602657613976372:4699]
2025-10-10T14:39:13.016970Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:13.017508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:13.017526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:13.017572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602657613976372:4699], now have 1 active actors on pipe
2025-10-10T14:39:13.017776Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:13.017794Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 15 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602657613976372:4699]
2025-10-10T14:39:13.017810Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:13.017839Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:39:13.017918Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2917 reason: status is not ok: tablet will be restarted right now sessionId: src_id|3a0d363f-134d7190-fa73a22b-5d1e4c9e_0
2025-10-10T14:39:13.018375Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a0d363f-134d7190-fa73a22b-5d1e4c9e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:39:13.018357Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2917 sessionId: src_id|3a0d363f-134d7190-fa73a22b-5d1e4c9e_0 is DEAD
2025-10-10T14:39:13.018391Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a0d363f-134d7190-fa73a22b-5d1e4c9e_0] Write session will restart in 0.007625s
2025-10-10T14:39:13.018449Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a0d363f-134d7190-fa73a22b-5d1e4c9e_0] Write session: Do CDS request
2025-10-10T14:39:13.018468Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a0d363f-134d7190-fa73a22b-5d1e4c9e_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:13.027014Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3a0d363f-134d7190-fa73a22b-5d1e4c9e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:13.027171Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:13.027187Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2918
2025-10-10T14:39:13.027368Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2918 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:13.027411Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2918 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:13.027422Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2918 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:13.027428Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:13.027973Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2918 sessionId:  describe result for acl check
2025-10-10T14:39:13.028014Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:13.028020Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:13.028022Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:13.028029Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602661908943697:4349] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:13.028607Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602661908943697:4349] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:13.032476Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602661908943697:4349] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:13.036245Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602661908943697:4349] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:13.036262Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602661908943697:4349] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:13.036266Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602661908943697:4349] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:13.036276Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2918 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:13.040337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:13.045381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:13.045666Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:13.045680Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:13.045695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:13.045765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:13.045813Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602661126703655:7543]
2025-10-10T14:39:13.046436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:13.046846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:13.046911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:13.047243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:13.047337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:13.047344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:13.047345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:13.047346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:13.047348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:13.047349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:13.047350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:13.047351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:13.047352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:13.047354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:13.047355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:13.047356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:13.047357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:13.047363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:13.047378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:13.047382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:13.047387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:13.047391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:13.047395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:13.047399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:13.047404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:13.047407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:13.047411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:13.047415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:13.047419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:13.047423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:13.047433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:13.047442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:13.047450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:13.047457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:13.047467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:13.047472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:13.047476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:13.047487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:13.047492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:13.047498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:13.047507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:13.047513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:13.047522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:13.047528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:13.047536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:13.047541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:13.047547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:13.047555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:13.047561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:13.047567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:13.047571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:13.047577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:13.047583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:13.047593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:13.047598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:13.047619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:13.047665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:13.050305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:13.050632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:13.050644Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:13.050646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:13.050651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:13.050657Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2917 [2:7559602661126703655:7543]
2025-10-10T14:39:13.050670Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:13.050690Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:13.050692Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:13.050695Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:13.050697Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:13.050712Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:13.050718Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:13.050726Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:13.050790Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:13.050802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:13.050805Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:13.050807Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:13.051029Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2917
2025-10-10T14:39:13.051049Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2917
2025-10-10T14:39:13.051284Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:13.051293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:13.051306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:13.051317Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:13.051333Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:13.051363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602661908943874:4349], now have 1 active actors on pipe
2025-10-10T14:39:13.051372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602661908943670:2438], now have 1 active actors on pipe
2025-10-10T14:39:13.051389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:13.051400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:13.051427Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602661126703650:7543]
2025-10-10T14:39:13.051434Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602661126703650:7543]
2025-10-10T14:39:13.051436Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602661126703650:7543]
2025-10-10T14:39:13.051452Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:13.051472Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:13.051473Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:13.051477Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:13.051479Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:13.051493Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:13.051497Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:13.051516Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bccb2c84-298ac8c0-ccd0480a-c182f748_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:13.051528Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:13.051537Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:13.051539Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:13.051552Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:13.051568Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:13.051605Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602661126703650:7543]
2025-10-10T14:39:13.051616Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:13.051624Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:13.051634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:13.051807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:13.051816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:13.051832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:13.051951Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2918 partition: 0 MaxSeqNo: 40 sessionId: src_id|bccb2c84-298ac8c0-ccd0480a-c182f748_0
2025-10-10T14:39:13.052390Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a0d363f-134d7190-fa73a22b-5d1e4c9e_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|bccb2c84-298ac8c0-ccd0480a-c182f748_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:13.055505Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bccb2c84-298ac8c0-ccd0480a-c182f748_0] Write session: try to update token
2025-10-10T14:39:13.055528Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bccb2c84-298ac8c0-ccd0480a-c182f748_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:13.069734Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:39:13.069753Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:13.069766Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602661126703650:7543]
2025-10-10T14:39:13.069822Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:39:13.069824Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:39:13.070005Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:39:13.070153Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:13.070296Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:13.070430Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:13.070623Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:39:13.070665Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:39:13.070742Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2918 sessionId: src_id|bccb2c84-298ac8c0-ccd0480a-c182f748_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:13.073556Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:13.073793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:13.073825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:13.073866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:39:13.073970Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:39:13.083786Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:13.083810Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:13.083814Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:13.083816Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:13.083829Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602661126703650:7543]
2025-10-10T14:39:13.083834Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602661126703650:7543]
2025-10-10T14:39:13.083838Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602661126703650:7543]
2025-10-10T14:39:13.083894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:13.083898Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:13.083902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:13.083905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:13.083906Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:13.083910Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:13.084051Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:13.117932Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602661908943932:4699]
2025-10-10T14:39:13.118217Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 pipe creation result: OK TabletId: 72075186224037892 Generation: 2917, pipe: [1:7559602661908943932:4699]
2025-10-10T14:39:13.202770Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:13.211246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:13.211276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:13.211476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:13.211546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:13.211624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:13.211704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:13.211760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:13.211770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:13.211845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:13.211922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:13.211995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:13.212071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:13.212120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:13.212127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:13.212203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:13.212270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:13.212335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:13.212407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:13.212456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:13.212465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:13.212542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:13.212629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:13.212707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:13.212782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:13.212832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:13.212839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:13.212914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:13.212985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:13.213055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:13.213130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:13.213182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:13.213190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:13.213278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:13.213357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:13.213420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:13.213494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:13.213544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:13.213551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:13.213629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:13.213699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:13.213777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:13.213844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:13.213893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:13.213900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:13.213974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:13.214043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:13.214114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:13.214185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:13.214233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:13.214240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:13.214308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:13.214369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:13.214437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:13.214508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:13.214556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:13.214563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:13.214633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:13.214698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:13.214769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:13.214839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:13.214888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:13.214898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:13.214972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602661908943932:4699], now have 1 active actors on pipe
2025-10-10T14:39:13.215236Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:13.215307Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 16 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602661908943932:4699]
2025-10-10T14:39:13.215621Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:13.215631Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:13.215675Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2918 reason: error at write: Disconnected sessionId: src_id|bccb2c84-298ac8c0-ccd0480a-c182f748_0
2025-10-10T14:39:13.215881Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2918 sessionId: src_id|bccb2c84-298ac8c0-ccd0480a-c182f748_0 is DEAD
2025-10-10T14:39:13.216022Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bccb2c84-298ac8c0-ccd0480a-c182f748_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:13.216032Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bccb2c84-298ac8c0-ccd0480a-c182f748_0] Write session will restart in 0.008132s
2025-10-10T14:39:13.216059Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bccb2c84-298ac8c0-ccd0480a-c182f748_0] Write session: Do CDS request
2025-10-10T14:39:13.216065Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bccb2c84-298ac8c0-ccd0480a-c182f748_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:13.216248Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:13.226885Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bccb2c84-298ac8c0-ccd0480a-c182f748_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:13.227237Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:13.227254Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2919
2025-10-10T14:39:13.227395Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2919 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:13.227433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2919 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:13.227444Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2919 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:13.227449Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:13.228125Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2919 sessionId:  describe result for acl check
2025-10-10T14:39:13.228177Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:13.228183Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:13.228187Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:13.228193Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602661908943981:4340] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:13.228806Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602661908943981:4340] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:13.232319Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602661908943981:4340] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:13.235630Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602661908943981:4340] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:13.235645Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602661908943981:4340] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:13.235649Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602661908943981:4340] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:13.235659Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2919 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:13.240609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:13.245990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:13.246266Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:13.246279Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:13.246293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:13.246357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:13.246404Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602661126703917:7537]
2025-10-10T14:39:13.247098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:13.247520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:13.247603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:13.247986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:13.248066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:13.248085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:13.248087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:13.248088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:13.248089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:13.248091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:13.248092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:13.248094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:13.248095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:13.248096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:13.248098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:13.248100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:13.248101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:13.248109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:13.248124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:13.248128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:13.248133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:13.248137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:13.248141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:13.248145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:13.248149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:13.248153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:13.248159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:13.248163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:13.248167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:13.248171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:13.248181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:13.248190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:13.248197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:13.248203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:13.248208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:13.248213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:13.248217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:13.248234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:13.248240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:13.248245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:13.248250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:13.248266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:13.248273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:13.248279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:13.248285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:13.248289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:13.248294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:13.248302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:13.248306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:13.248311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:13.248319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:13.248325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:13.248330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:13.248335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:13.248340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:13.248345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:13.248387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:13.251262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:13.252152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:13.252164Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:13.252165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:13.252169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:13.252177Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2918 [2:7559602661126703917:7537]
2025-10-10T14:39:13.252190Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:13.252212Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:13.252215Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:13.252219Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:13.252221Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:13.252240Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:13.252254Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:13.252268Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:13.252332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:13.252341Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:13.252343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:13.252346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:13.252423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:13.252430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:13.252441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:13.252452Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:13.252543Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2918
2025-10-10T14:39:13.252467Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:13.252497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602661908943935:2438], now have 1 active actors on pipe
2025-10-10T14:39:13.252505Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602661126703912:7537]
2025-10-10T14:39:13.252507Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602661126703912:7537]
2025-10-10T14:39:13.252509Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602661126703912:7537]
2025-10-10T14:39:13.252523Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:13.252527Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:13.252530Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:13.252532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602661908944138:4340], now have 1 active actors on pipe
2025-10-10T14:39:13.252533Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:13.252543Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:13.252559Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:13.252562Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:13.252607Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2918
2025-10-10T14:39:13.252598Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602661126703912:7537]
2025-10-10T14:39:13.252601Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:13.252604Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:13.252634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:13.252639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:13.252673Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7e065a63-572b4a6b-be04375c-c2fdfc1f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:13.252681Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:13.252686Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:13.252688Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:13.252702Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:13.252713Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:13.252728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:13.253603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:13.253615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:13.253636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:13.253764Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2919 partition: 0 MaxSeqNo: 40 sessionId: src_id|7e065a63-572b4a6b-be04375c-c2fdfc1f_0
2025-10-10T14:39:13.254162Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bccb2c84-298ac8c0-ccd0480a-c182f748_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|7e065a63-572b4a6b-be04375c-c2fdfc1f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:13.257070Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7e065a63-572b4a6b-be04375c-c2fdfc1f_0] Write session: try to update token
2025-10-10T14:39:13.257091Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7e065a63-572b4a6b-be04375c-c2fdfc1f_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:13.272408Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2919 sessionId: src_id|7e065a63-572b4a6b-be04375c-c2fdfc1f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:13.275319Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:13.272858Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:13.272879Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:13.272883Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:13.272886Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:13.272897Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602661126703912:7537]
2025-10-10T14:39:13.272905Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602661126703912:7537]
2025-10-10T14:39:13.272910Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602661126703912:7537]
2025-10-10T14:39:13.272967Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:13.272969Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:13.272974Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:13.272977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:13.272979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:13.272983Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:13.273126Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:13.315560Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602661908944197:4699]
2025-10-10T14:39:13.315885Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 pipe creation result: OK TabletId: 72075186224037892 Generation: 2918, pipe: [1:7559602661908944197:4699]
2025-10-10T14:39:13.398302Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:13.398840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:13.398856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:13.398904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602661908944197:4699], now have 1 active actors on pipe
2025-10-10T14:39:13.399150Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:13.399164Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:13.399242Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2919 reason: error at write: Disconnected sessionId: src_id|7e065a63-572b4a6b-be04375c-c2fdfc1f_0
2025-10-10T14:39:13.399464Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2919 sessionId: src_id|7e065a63-572b4a6b-be04375c-c2fdfc1f_0 is DEAD
2025-10-10T14:39:13.399658Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e065a63-572b4a6b-be04375c-c2fdfc1f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:13.399667Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e065a63-572b4a6b-be04375c-c2fdfc1f_0] Write session will restart in 0.008957s
2025-10-10T14:39:13.399693Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e065a63-572b4a6b-be04375c-c2fdfc1f_0] Write session: Do CDS request
2025-10-10T14:39:13.399700Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e065a63-572b4a6b-be04375c-c2fdfc1f_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:13.399630Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 17 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602661908944197:4699]
2025-10-10T14:39:13.399662Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:13.399947Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:13.409959Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7e065a63-572b4a6b-be04375c-c2fdfc1f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:13.410082Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:13.410106Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2920
2025-10-10T14:39:13.410289Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2920 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:13.410336Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2920 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:13.410348Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2920 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:13.410353Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:13.410887Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2920 sessionId:  describe result for acl check
2025-10-10T14:39:13.410925Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:13.410933Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:13.410936Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:13.410953Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602661908944232:4336] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:13.411703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602661908944232:4336] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:13.414612Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602661908944232:4336] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:13.418276Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602661908944232:4336] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:13.418290Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602661908944232:4336] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:13.418294Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602661908944232:4336] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:13.418302Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2920 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:13.424307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:13.429265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:13.429552Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:13.429566Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:13.429579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:13.429652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:13.429714Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602661126704177:7533]
2025-10-10T14:39:13.430412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:13.430755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:13.430806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:13.431146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:13.431214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:13.431223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:13.431224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:13.431226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:13.431227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:13.431229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:13.431230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:13.431233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:13.431234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:13.431235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:13.431237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:13.431239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:13.431240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:13.431247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:13.431262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:13.431267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:13.431272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:13.431277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:13.431282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:13.431286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:13.431291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:13.431296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:13.431301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:13.431306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:13.431311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:13.431315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:13.431325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:13.431334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:13.431341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:13.431348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:13.431354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:13.431360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:13.431366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:13.431373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:13.431379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:13.431385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:13.431390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:13.431396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:13.431401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:13.431406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:13.431411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:13.431417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:13.431422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:13.431427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:13.431432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:13.431438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:13.431451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:13.431457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:13.431467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:13.431473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:13.431478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:13.431484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:13.431532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:13.434190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:13.435073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:13.435087Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:13.435089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:13.435093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:13.435104Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2919 [2:7559602661126704177:7533]
2025-10-10T14:39:13.435120Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:13.435142Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:13.435152Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:13.435156Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:13.435158Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:13.435179Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:13.435196Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:13.435209Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:13.435280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:13.435292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:13.435294Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:13.435297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:13.435379Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:13.435390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:13.435404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:13.435419Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:13.435439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:13.435463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602661908944364:4336], now have 1 active actors on pipe
2025-10-10T14:39:13.435468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602661908944200:2438], now have 1 active actors on pipe
2025-10-10T14:39:13.435476Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602661126704172:7533]
2025-10-10T14:39:13.435479Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602661126704172:7533]
2025-10-10T14:39:13.435481Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602661126704172:7533]
2025-10-10T14:39:13.435496Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:13.435513Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:13.435512Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:13.435516Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:13.435518Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:13.435531Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:13.435535Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:13.435585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:13.435591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:13.435610Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602661126704172:7533]
2025-10-10T14:39:13.435619Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:13.435632Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:13.435657Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ab227331-635a9ef2-2b0d2fff-d751c48e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:13.435664Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:13.435670Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:13.435673Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:13.435685Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:13.435697Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:13.435726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:13.435933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:13.435947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:13.435988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:13.436532Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e065a63-572b4a6b-be04375c-c2fdfc1f_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|ab227331-635a9ef2-2b0d2fff-d751c48e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:13.435512Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2919
2025-10-10T14:39:13.435524Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2919
2025-10-10T14:39:13.436094Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2920 partition: 0 MaxSeqNo: 40 sessionId: src_id|ab227331-635a9ef2-2b0d2fff-d751c48e_0
2025-10-10T14:39:13.439386Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ab227331-635a9ef2-2b0d2fff-d751c48e_0] Write session: try to update token
2025-10-10T14:39:13.439406Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ab227331-635a9ef2-2b0d2fff-d751c48e_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:13.457795Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:13.457816Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:13.457820Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:13.457822Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:13.457833Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602661126704172:7533]
2025-10-10T14:39:13.457837Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602661126704172:7533]
2025-10-10T14:39:13.457840Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602661126704172:7533]
2025-10-10T14:39:13.460424Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2920 sessionId: src_id|ab227331-635a9ef2-2b0d2fff-d751c48e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:13.457899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:13.457899Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:13.457906Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:13.457910Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:13.457915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:13.457918Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:13.458070Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:13.463107Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:13.499933Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602661908944463:4699]
2025-10-10T14:39:13.500339Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 pipe creation result: OK TabletId: 72075186224037892 Generation: 2919, pipe: [1:7559602661908944463:4699]
2025-10-10T14:39:13.575810Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:13.576803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:13.576826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:13.576885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602661908944463:4699], now have 1 active actors on pipe
2025-10-10T14:39:13.577123Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:13.577273Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:13.577349Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 18 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602661908944463:4699]
2025-10-10T14:39:13.577685Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:39:13.577785Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2920 reason: status is not ok: tablet will be restarted right now sessionId: src_id|ab227331-635a9ef2-2b0d2fff-d751c48e_0
2025-10-10T14:39:13.578038Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2920 sessionId: src_id|ab227331-635a9ef2-2b0d2fff-d751c48e_0 is DEAD
2025-10-10T14:39:13.578198Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab227331-635a9ef2-2b0d2fff-d751c48e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:39:13.578210Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab227331-635a9ef2-2b0d2fff-d751c48e_0] Write session will restart in 0.009295s
2025-10-10T14:39:13.578243Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab227331-635a9ef2-2b0d2fff-d751c48e_0] Write session: Do CDS request
2025-10-10T14:39:13.578249Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab227331-635a9ef2-2b0d2fff-d751c48e_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:13.589005Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ab227331-635a9ef2-2b0d2fff-d751c48e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:13.589088Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:13.589105Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2921
2025-10-10T14:39:13.589301Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2921 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:13.589378Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2921 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:13.589390Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2921 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:13.589395Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:13.589969Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2921 sessionId:  describe result for acl check
2025-10-10T14:39:13.590010Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:13.590016Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:13.590018Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:13.590025Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602661908944524:4313] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:13.590623Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602661908944524:4313] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:13.594015Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602661908944524:4313] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:13.596982Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602661908944524:4313] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:13.596996Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602661908944524:4313] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:13.596999Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602661908944524:4313] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:13.597008Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2921 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:13.599692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:13.604352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:13.604606Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:13.604618Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:13.604630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:13.604685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:13.604729Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602661126704450:7530]
2025-10-10T14:39:13.605447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:13.605774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:13.605821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:13.606171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:13.606237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:13.606244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:13.606245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:13.606246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:13.606248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:13.606249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:13.606250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:13.606252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:13.606253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:13.606254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:13.606256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:13.606257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:13.606259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:13.606265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:13.606280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:13.606284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:13.606289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:13.606294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:13.606299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:13.606303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:13.606308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:13.606312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:13.606318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:13.606323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:13.606327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:13.606332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:13.606339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:13.606354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:13.606365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:13.606373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:13.606382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:13.606389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:13.606398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:13.606405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:13.606414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:13.606420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:13.606429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:13.606436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:13.606441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:13.606451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:13.606456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:13.606462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:13.606467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:13.606474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:13.606478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:13.606485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:13.606494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:13.606500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:13.606508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:13.606514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:13.606519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:13.606525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:13.606570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:13.608973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:13.609751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:13.609763Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:13.609766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:13.609770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:13.609776Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2920 [2:7559602661126704450:7530]
2025-10-10T14:39:13.609788Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:13.609805Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:13.609812Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:13.609816Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:13.609818Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:13.609835Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:13.609848Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:13.609855Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:13.609911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:13.609920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:13.609923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:13.609926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:13.609998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:13.610005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:13.610018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:13.610036Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:13.610056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:13.610083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602661908944465:2438], now have 1 active actors on pipe
2025-10-10T14:39:13.610095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602661908944714:4313], now have 1 active actors on pipe
2025-10-10T14:39:13.610105Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602661126704445:7530]
2025-10-10T14:39:13.610108Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602661126704445:7530]
2025-10-10T14:39:13.610110Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602661126704445:7530]
2025-10-10T14:39:13.610124Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:13.610138Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:13.610138Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:13.610142Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:13.610131Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2920
2025-10-10T14:39:13.610144Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:13.610134Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2920
2025-10-10T14:39:13.610156Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:13.610160Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:13.610199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:13.610210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:13.610225Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602661126704445:7530]
2025-10-10T14:39:13.610238Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:13.610259Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:13.610273Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6d50f1a-5997f5c9-576144b-3f46e68d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:13.610282Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:13.610290Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:13.610293Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:13.610304Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:13.610314Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:13.610342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:13.610496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:13.610504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:13.610519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:13.610595Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2921 partition: 0 MaxSeqNo: 40 sessionId: src_id|6d50f1a-5997f5c9-576144b-3f46e68d_0
2025-10-10T14:39:13.611026Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab227331-635a9ef2-2b0d2fff-d751c48e_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|6d50f1a-5997f5c9-576144b-3f46e68d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:13.614000Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6d50f1a-5997f5c9-576144b-3f46e68d_0] Write session: try to update token
2025-10-10T14:39:13.614017Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6d50f1a-5997f5c9-576144b-3f46e68d_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:13.628534Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2921 sessionId: src_id|6d50f1a-5997f5c9-576144b-3f46e68d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:13.629837Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:13.629860Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:13.629864Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:13.629866Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:13.629877Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602661126704445:7530]
2025-10-10T14:39:13.629882Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602661126704445:7530]
2025-10-10T14:39:13.629887Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602661126704445:7530]
2025-10-10T14:39:13.629949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:13.629960Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:13.629965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:13.629967Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:13.629968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:13.629972Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:13.630181Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:13.631696Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:13.677500Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602661908944731:4699]
2025-10-10T14:39:13.677873Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 pipe creation result: OK TabletId: 72075186224037892 Generation: 2920, pipe: [1:7559602661908944731:4699]
2025-10-10T14:39:13.745143Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:13.745809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:13.745842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:13.745898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602661908944731:4699], now have 1 active actors on pipe
2025-10-10T14:39:13.746103Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:13.746220Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:13.746230Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 19 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602661908944731:4699]
2025-10-10T14:39:13.746253Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:13.746256Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:13.746332Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2921 reason: error at write: Disconnected sessionId: src_id|6d50f1a-5997f5c9-576144b-3f46e68d_0
2025-10-10T14:39:13.746570Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2921 sessionId: src_id|6d50f1a-5997f5c9-576144b-3f46e68d_0 is DEAD
2025-10-10T14:39:13.746768Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d50f1a-5997f5c9-576144b-3f46e68d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:13.746777Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d50f1a-5997f5c9-576144b-3f46e68d_0] Write session will restart in 0.007909s
2025-10-10T14:39:13.746814Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d50f1a-5997f5c9-576144b-3f46e68d_0] Write session: Do CDS request
2025-10-10T14:39:13.746820Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d50f1a-5997f5c9-576144b-3f46e68d_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:13.755955Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6d50f1a-5997f5c9-576144b-3f46e68d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:13.756047Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:13.756062Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2922
2025-10-10T14:39:13.756251Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2922 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:13.756285Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2922 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:13.756291Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2922 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:13.756295Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:13.756791Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2922 sessionId:  describe result for acl check
2025-10-10T14:39:13.756826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:13.756835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:13.756837Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:13.756843Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602661908944771:4296] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:13.757459Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602661908944771:4296] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:13.760650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602661908944771:4296] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:13.764838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602661908944771:4296] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:13.764855Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602661908944771:4296] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:13.764859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602661908944771:4296] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:13.764871Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2922 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:13.768823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:13.773190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:13.773485Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:13.773498Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:13.773514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:13.773582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:13.773630Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602661126704712:7529]
2025-10-10T14:39:13.774297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:13.774613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:13.774659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:13.774985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:13.775042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:13.775048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:13.775049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:13.775050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:13.775052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:13.775053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:13.775055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:13.775056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:13.775057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:13.775059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:13.775060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:13.775061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:13.775063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:13.775069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:13.775084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:13.775088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:13.775093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:13.775098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:13.775103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:13.775108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:13.775112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:13.775117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:13.775122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:13.775126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:13.775131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:13.775135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:13.775144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:13.775158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:13.775169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:13.775176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:13.775185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:13.775191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:13.775201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:13.775208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:13.775226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:13.775236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:13.775241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:13.775248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:13.775257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:13.775263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:13.775268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:13.775281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:13.775286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:13.775293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:13.775297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:13.775305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:13.775314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:13.775320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:13.775328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:13.775334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:13.775344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:13.775349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:13.775398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:13.777935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:13.778338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:13.778351Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:13.778354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:13.778358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:13.778366Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2921 [2:7559602661126704712:7529]
2025-10-10T14:39:13.778381Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:13.778399Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:13.778408Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:13.778412Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:13.778415Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:13.778433Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:13.778459Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:13.778472Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:13.778537Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:13.778545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:13.778547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:13.778550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:13.778624Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:13.778632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:13.778644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:13.778661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:13.778686Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:13.778713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602661908944967:4296], now have 1 active actors on pipe
2025-10-10T14:39:13.778722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602661908944744:2438], now have 1 active actors on pipe
2025-10-10T14:39:13.778730Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602661126704707:7529]
2025-10-10T14:39:13.778733Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602661126704707:7529]
2025-10-10T14:39:13.778735Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602661126704707:7529]
2025-10-10T14:39:13.778749Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:13.778770Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:13.778771Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:13.778775Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:13.778777Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:13.778792Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:13.778796Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:13.778755Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2921
2025-10-10T14:39:13.778767Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2921
2025-10-10T14:39:13.778841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:13.778850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:13.778866Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602661126704707:7529]
2025-10-10T14:39:13.778878Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:13.778884Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:13.778913Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6c50a5-f82ded22-c454a25a-dd1f8d95_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:13.778924Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:13.778928Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:13.778931Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:13.778943Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:13.778957Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:13.779538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:13.779730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:13.779745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:13.779764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:13.779857Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2922 partition: 0 MaxSeqNo: 40 sessionId: src_id|6c50a5-f82ded22-c454a25a-dd1f8d95_0
2025-10-10T14:39:13.780286Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d50f1a-5997f5c9-576144b-3f46e68d_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|6c50a5-f82ded22-c454a25a-dd1f8d95_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:13.783279Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6c50a5-f82ded22-c454a25a-dd1f8d95_0] Write session: try to update token
2025-10-10T14:39:13.783298Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6c50a5-f82ded22-c454a25a-dd1f8d95_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:13.798478Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:13.798499Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:13.798502Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:13.798504Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:13.798514Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602661126704707:7529]
2025-10-10T14:39:13.798519Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602661126704707:7529]
2025-10-10T14:39:13.798526Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602661126704707:7529]
2025-10-10T14:39:13.798580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:13.798588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:13.798588Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:13.798596Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:13.798596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:13.798600Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:13.798740Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:13.799175Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2922 sessionId: src_id|6c50a5-f82ded22-c454a25a-dd1f8d95_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:13.801854Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:13.846483Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602661908945017:4699]
2025-10-10T14:39:13.846794Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 pipe creation result: OK TabletId: 72075186224037892 Generation: 2921, pipe: [1:7559602661908945017:4699]
2025-10-10T14:39:13.917625Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:13.918172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:13.918194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:13.918242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602661908945017:4699], now have 1 active actors on pipe
2025-10-10T14:39:13.918442Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:13.918556Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 20 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602661908945017:4699]
2025-10-10T14:39:13.918592Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:39:13.918675Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2922 reason: status is not ok: tablet will be restarted right now sessionId: src_id|6c50a5-f82ded22-c454a25a-dd1f8d95_0
2025-10-10T14:39:13.918909Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2922 sessionId: src_id|6c50a5-f82ded22-c454a25a-dd1f8d95_0 is DEAD
2025-10-10T14:39:13.919083Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:13.919112Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c50a5-f82ded22-c454a25a-dd1f8d95_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:39:13.919132Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c50a5-f82ded22-c454a25a-dd1f8d95_0] Write session will restart in 0.009151s
2025-10-10T14:39:13.919158Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c50a5-f82ded22-c454a25a-dd1f8d95_0] Write session: Do CDS request
2025-10-10T14:39:13.919164Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c50a5-f82ded22-c454a25a-dd1f8d95_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:13.929918Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6c50a5-f82ded22-c454a25a-dd1f8d95_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:13.929986Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:13.930011Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2923
2025-10-10T14:39:13.930197Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2923 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:13.930242Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2923 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:13.930256Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2923 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:13.930260Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:13.930713Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2923 sessionId:  describe result for acl check
2025-10-10T14:39:13.930747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:13.930753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:13.930755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:13.930762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602661908945082:4251] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:13.931337Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602661908945082:4251] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:13.936417Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602661908945082:4251] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:13.941202Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602661908945082:4251] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:13.941216Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602661908945082:4251] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:13.941220Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602661908945082:4251] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:13.941242Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2923 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:13.945734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:13.952561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:13.952831Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:13.952849Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:13.952864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:13.952932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:13.952983Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602661126705013:7522]
2025-10-10T14:39:13.953607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:13.954075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:13.954149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:13.954528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:13.954588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:13.954595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:13.954596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:13.954598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:13.954600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:13.954601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:13.954603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:13.954604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:13.954606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:13.954607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:13.954609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:13.954610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:13.954611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:13.954619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:13.954633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:13.954637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:13.954642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:13.954646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:13.954650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:13.954655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:13.954659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:13.954663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:13.954668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:13.954673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:13.954677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:13.954681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:13.954690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:13.954699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:13.954706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:13.954712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:13.954720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:13.954726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:13.954730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:13.954736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:13.954741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:13.954747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:13.954759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:13.954765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:13.954770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:13.954776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:13.954781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:13.954791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:13.954796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:13.954804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:13.954814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:13.954819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:13.954829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:13.954835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:13.954841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:13.954851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:13.954857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:13.954866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:13.954911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:13.957779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:13.958102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:13.958114Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:13.958117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:13.958121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:13.958129Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2922 [2:7559602661126705013:7522]
2025-10-10T14:39:13.958144Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:13.958170Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:13.958178Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:13.958182Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:13.958184Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:13.958218Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:13.958230Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:13.958243Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:13.958321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:13.958328Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:13.958330Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:13.958333Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:13.958407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:13.958414Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:13.958426Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:13.958439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:13.958461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:13.958489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602661908945034:2438], now have 1 active actors on pipe
2025-10-10T14:39:13.958498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602661908945237:4251], now have 1 active actors on pipe
2025-10-10T14:39:13.958506Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602661126705008:7522]
2025-10-10T14:39:13.958513Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602661126705008:7522]
2025-10-10T14:39:13.958515Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602661126705008:7522]
2025-10-10T14:39:13.958539Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:13.958548Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:13.958551Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:13.958553Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:13.958558Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:13.958574Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:13.958579Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:13.958614Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602661126705008:7522]
2025-10-10T14:39:13.958622Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:13.958630Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:13.958611Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2922
2025-10-10T14:39:13.958674Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2922
2025-10-10T14:39:13.959115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:13.959126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:13.959162Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2c7b9673-1d443f41-b413f41c-7a03b8fb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:13.959178Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:13.959187Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:13.959190Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:13.959542Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2923 partition: 0 MaxSeqNo: 40 sessionId: src_id|2c7b9673-1d443f41-b413f41c-7a03b8fb_0
2025-10-10T14:39:13.959990Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c50a5-f82ded22-c454a25a-dd1f8d95_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|2c7b9673-1d443f41-b413f41c-7a03b8fb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:13.962920Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2c7b9673-1d443f41-b413f41c-7a03b8fb_0] Write session: try to update token
2025-10-10T14:39:13.962940Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2c7b9673-1d443f41-b413f41c-7a03b8fb_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:13.959204Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:13.959222Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:13.959238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:13.959423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:13.959427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:13.959445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:13.979990Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:13.980014Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:13.980017Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:13.980020Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:13.980033Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602661126705008:7522]
2025-10-10T14:39:13.980038Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602661126705008:7522]
2025-10-10T14:39:13.980043Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602661126705008:7522]
2025-10-10T14:39:13.980099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:13.980113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:13.980115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:13.980254Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:13.981286Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2923 sessionId: src_id|2c7b9673-1d443f41-b413f41c-7a03b8fb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:13.981421Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:13.981437Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:13.981442Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:13.983964Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:14.018516Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602666203912610:4699]
2025-10-10T14:39:14.018918Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 pipe creation result: OK TabletId: 72075186224037892 Generation: 2922, pipe: [1:7559602666203912610:4699]
2025-10-10T14:39:14.092982Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:14.093554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:14.093572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:14.093617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602666203912610:4699], now have 1 active actors on pipe
2025-10-10T14:39:14.093852Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:14.093863Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:14.093867Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:14.093898Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 21 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602666203912610:4699]
2025-10-10T14:39:14.093932Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2923 reason: error at write: Disconnected sessionId: src_id|2c7b9673-1d443f41-b413f41c-7a03b8fb_0
2025-10-10T14:39:14.094166Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2923 sessionId: src_id|2c7b9673-1d443f41-b413f41c-7a03b8fb_0 is DEAD
2025-10-10T14:39:14.093838Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:14.094316Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c7b9673-1d443f41-b413f41c-7a03b8fb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:14.094339Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c7b9673-1d443f41-b413f41c-7a03b8fb_0] Write session will restart in 0.008849s
2025-10-10T14:39:14.094363Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c7b9673-1d443f41-b413f41c-7a03b8fb_0] Write session: Do CDS request
2025-10-10T14:39:14.094371Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c7b9673-1d443f41-b413f41c-7a03b8fb_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:14.104928Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2c7b9673-1d443f41-b413f41c-7a03b8fb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:14.105122Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:14.105138Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2924
2025-10-10T14:39:14.105282Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2924 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:14.105318Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2924 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:14.105357Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2924 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:14.105367Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:14.105819Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2924 sessionId:  describe result for acl check
2025-10-10T14:39:14.105851Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:14.105853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:14.105860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:14.105867Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602666203912688:4231] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:14.106428Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602666203912688:4231] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:14.109502Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602666203912688:4231] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:14.112398Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602666203912688:4231] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:14.112412Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602666203912688:4231] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:14.112416Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602666203912688:4231] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:14.112425Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2924 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:14.119423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:14.120029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:14.120294Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:14.120315Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:14.120329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:14.120390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:14.120947Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602665421672573:7504]
2025-10-10T14:39:14.121612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:14.121979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:14.122037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:14.122377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:14.122451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:14.122458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:14.122459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:14.122461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:14.122462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:14.122464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:14.122465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:14.122466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:14.122468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:14.122469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:14.122471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:14.122472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:14.122474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:14.122481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:14.122496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:14.122500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:14.122505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:14.122509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:14.122513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:14.122518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:14.122522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:14.122526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:14.122531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:14.122536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:14.122540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:14.122544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:14.122553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:14.122563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:14.122571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:14.122577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:14.122583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:14.122589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:14.122594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:14.122600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:14.122605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:14.122612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:14.122616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:14.122621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:14.122627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:14.122633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:14.122637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:14.122644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:14.122649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:14.122655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:14.122660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:14.122666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:14.122672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:14.122677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:14.122689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:14.122695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:14.122703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:14.122709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:14.122756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:14.125291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:14.126038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:14.126055Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:14.126058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:14.126062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:14.126068Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2923 [2:7559602665421672573:7504]
2025-10-10T14:39:14.126085Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:14.126108Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:14.126123Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:14.126127Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:14.126129Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:14.126147Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:14.126155Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:14.126164Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:14.126228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:14.126238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:14.126239Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:14.126242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:14.126311Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:14.126320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:14.126332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:14.126348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:14.126366Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:14.126396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602666203912865:4231], now have 1 active actors on pipe
2025-10-10T14:39:14.126400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602666203912611:2438], now have 1 active actors on pipe
2025-10-10T14:39:14.126408Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602665421672568:7504]
2025-10-10T14:39:14.126410Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602665421672568:7504]
2025-10-10T14:39:14.126426Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2923
2025-10-10T14:39:14.126442Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2923
2025-10-10T14:39:14.126413Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602665421672568:7504]
2025-10-10T14:39:14.126428Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:14.126442Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:14.126458Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:14.126460Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:14.126461Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:14.126463Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:14.126464Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:14.126500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:14.126506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:14.126529Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602665421672568:7504]
2025-10-10T14:39:14.126544Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:14.126570Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:14.126579Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cfdbeb77-a52ee16-319a738-57b5d52d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:14.126588Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:14.126595Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:14.126597Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:14.126610Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:14.126626Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:14.126669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:14.126852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:14.126866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:14.126886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:14.126988Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2924 partition: 0 MaxSeqNo: 40 sessionId: src_id|cfdbeb77-a52ee16-319a738-57b5d52d_0
2025-10-10T14:39:14.127414Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c7b9673-1d443f41-b413f41c-7a03b8fb_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|cfdbeb77-a52ee16-319a738-57b5d52d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:14.130600Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfdbeb77-a52ee16-319a738-57b5d52d_0] Write session: try to update token
2025-10-10T14:39:14.130620Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfdbeb77-a52ee16-319a738-57b5d52d_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:14.146093Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:14.146116Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:14.146120Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:14.146122Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:14.146133Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602665421672568:7504]
2025-10-10T14:39:14.146138Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602665421672568:7504]
2025-10-10T14:39:14.146142Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602665421672568:7504]
2025-10-10T14:39:14.146195Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:14.146197Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:14.146206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:14.146208Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:14.146209Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:14.146213Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:14.146362Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:14.146702Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2924 sessionId: src_id|cfdbeb77-a52ee16-319a738-57b5d52d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:14.149435Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:14.194123Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602666203912880:4699]
2025-10-10T14:39:14.194412Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 pipe creation result: OK TabletId: 72075186224037892 Generation: 2923, pipe: [1:7559602666203912880:4699]
2025-10-10T14:39:14.260143Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:14.260566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:14.260583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:14.260633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602666203912880:4699], now have 1 active actors on pipe
2025-10-10T14:39:14.260865Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:14.260944Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:14.260952Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 22 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602666203912880:4699]
2025-10-10T14:39:14.260962Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:14.260974Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:14.261443Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cfdbeb77-a52ee16-319a738-57b5d52d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:14.261458Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cfdbeb77-a52ee16-319a738-57b5d52d_0] Write session will restart in 0.005737s
2025-10-10T14:39:14.261484Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cfdbeb77-a52ee16-319a738-57b5d52d_0] Write session: Do CDS request
2025-10-10T14:39:14.261041Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2924 reason: error at write: Disconnected sessionId: src_id|cfdbeb77-a52ee16-319a738-57b5d52d_0
2025-10-10T14:39:14.261491Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cfdbeb77-a52ee16-319a738-57b5d52d_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:14.261285Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2924 sessionId: src_id|cfdbeb77-a52ee16-319a738-57b5d52d_0 is DEAD
2025-10-10T14:39:14.268953Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfdbeb77-a52ee16-319a738-57b5d52d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:14.269107Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:14.269122Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2925
2025-10-10T14:39:14.269290Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2925 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:14.269328Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2925 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:14.269350Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2925 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:14.269355Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:14.269823Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2925 sessionId:  describe result for acl check
2025-10-10T14:39:14.269858Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:14.269865Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:14.269867Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:14.269873Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602666203912897:4217] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:14.270424Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602666203912897:4217] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:14.272912Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602666203912897:4217] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:14.276238Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602666203912897:4217] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:14.276250Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602666203912897:4217] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:14.276254Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602666203912897:4217] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:14.276263Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2925 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:14.287458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:14.288090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:14.288288Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:14.288298Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:14.288308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:14.288347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:14.288390Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602665421672840:7502]
2025-10-10T14:39:14.288873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:14.289183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:14.289236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:14.289520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:14.289565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:14.289570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:14.289571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:14.289572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:14.289573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:14.289573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:14.289574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:14.289575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:14.289576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:14.289577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:14.289577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:14.289578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:14.289579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:14.289583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:14.289593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:14.289596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:14.289598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:14.289601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:14.289603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:14.289606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:14.289608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:14.289610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:14.289613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:14.289616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:14.289618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:14.289621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:14.289627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:14.289632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:14.289637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:14.289641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:14.289645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:14.289649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:14.289652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:14.289656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:14.289658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:14.289661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:14.289664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:14.289668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:14.289671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:14.289674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:14.289677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:14.289680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:14.289684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:14.289687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:14.289690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:14.289693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:14.289696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:14.289700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:14.289702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:14.289706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:14.289709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:14.289712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:14.289736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:14.292197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:14.292619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:14.292630Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:14.292633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:14.292637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:14.292645Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2924 [2:7559602665421672840:7502]
2025-10-10T14:39:14.292658Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:14.292677Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:14.292680Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:14.292684Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:14.292686Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:14.292705Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:14.292713Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:14.292724Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:14.292792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:14.292800Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:14.292802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:14.292805Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:14.292879Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:14.292889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:14.292900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:14.292911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:14.292927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:14.292949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602666203912881:2438], now have 1 active actors on pipe
2025-10-10T14:39:14.292958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602666203913029:4217], now have 1 active actors on pipe
2025-10-10T14:39:14.292966Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602665421672835:7502]
2025-10-10T14:39:14.292968Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602665421672835:7502]
2025-10-10T14:39:14.292971Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602665421672835:7502]
2025-10-10T14:39:14.292987Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:14.292999Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:14.293005Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:14.293008Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:14.293010Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:14.293020Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:14.293024Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:14.293031Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2924
2025-10-10T14:39:14.293037Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2924
2025-10-10T14:39:14.293053Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602665421672835:7502]
2025-10-10T14:39:14.293063Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:14.293068Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:14.293092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:14.293098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:14.293137Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|69a59432-ee5617c8-995e9259-3951f51a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:14.293150Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:14.293159Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:14.293161Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:14.293172Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:14.293184Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:14.293203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:14.293364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:14.293372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:14.293401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:14.293504Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2925 partition: 0 MaxSeqNo: 40 sessionId: src_id|69a59432-ee5617c8-995e9259-3951f51a_0
2025-10-10T14:39:14.293961Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cfdbeb77-a52ee16-319a738-57b5d52d_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|69a59432-ee5617c8-995e9259-3951f51a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:14.296913Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|69a59432-ee5617c8-995e9259-3951f51a_0] Write session: try to update token
2025-10-10T14:39:14.296933Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|69a59432-ee5617c8-995e9259-3951f51a_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:14.313564Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:14.313581Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:14.313584Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:14.313586Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:14.313597Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602665421672835:7502]
2025-10-10T14:39:14.313601Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602665421672835:7502]
2025-10-10T14:39:14.313606Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602665421672835:7502]
2025-10-10T14:39:14.313658Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:14.313666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:14.313668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:14.313709Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:14.313724Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:14.313728Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:14.313809Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:14.314329Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2925 sessionId: src_id|69a59432-ee5617c8-995e9259-3951f51a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:14.317084Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:14.361040Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602666203913150:4699]
2025-10-10T14:39:14.361430Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 pipe creation result: OK TabletId: 72075186224037892 Generation: 2924, pipe: [1:7559602666203913150:4699]
2025-10-10T14:39:14.431354Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:14.432283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:14.432301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:14.432357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602666203913150:4699], now have 1 active actors on pipe
2025-10-10T14:39:14.432609Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:14.432621Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 23 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602666203913150:4699]
2025-10-10T14:39:14.432630Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:14.432660Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:14.432663Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:14.432736Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2925 reason: error at write: Disconnected sessionId: src_id|69a59432-ee5617c8-995e9259-3951f51a_0
2025-10-10T14:39:14.432972Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2925 sessionId: src_id|69a59432-ee5617c8-995e9259-3951f51a_0 is DEAD
2025-10-10T14:39:14.433121Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|69a59432-ee5617c8-995e9259-3951f51a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:14.433134Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|69a59432-ee5617c8-995e9259-3951f51a_0] Write session will restart in 0.006942s
2025-10-10T14:39:14.433162Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|69a59432-ee5617c8-995e9259-3951f51a_0] Write session: Do CDS request
2025-10-10T14:39:14.433171Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|69a59432-ee5617c8-995e9259-3951f51a_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:14.440992Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|69a59432-ee5617c8-995e9259-3951f51a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:14.441900Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:14.441914Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2926
2025-10-10T14:39:14.442031Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2926 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:14.442068Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2926 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:14.442079Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2926 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:14.442083Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:14.442544Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2926 sessionId:  describe result for acl check
2025-10-10T14:39:14.442581Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:14.442587Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:14.442589Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:14.442596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602666203913168:4204] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:14.443175Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602666203913168:4204] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:14.448166Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602666203913168:4204] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:14.451902Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602666203913168:4204] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:14.451919Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602666203913168:4204] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:14.451922Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602666203913168:4204] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:14.451932Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2926 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:14.458867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:14.463633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:14.463890Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:14.463903Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:14.463917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:14.463994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:14.464041Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602665421673106:7501]
2025-10-10T14:39:14.464663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:14.465023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:14.465084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:14.465437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:14.465511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:14.465517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:14.465518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:14.465520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:14.465521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:14.465523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:14.465524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:14.465525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:14.465527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:14.465528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:14.465529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:14.465531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:14.465532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:14.465538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:14.465551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:14.465555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:14.465558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:14.465562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:14.465566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:14.465570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:14.465573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:14.465577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:14.465581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:14.465584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:14.465588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:14.465591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:14.465600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:14.465608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:14.465615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:14.465620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:14.465624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:14.465628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:14.465650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:14.465656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:14.465666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:14.465671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:14.465677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:14.465686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:14.465691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:14.465695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:14.465698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:14.465703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:14.465711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:14.465716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:14.465719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:14.465724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:14.465728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:14.465737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:14.465741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:14.465746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:14.465752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:14.465761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:14.465800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:14.468425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:14.469252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:14.469267Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:14.469269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:14.469272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:14.469279Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2925 [2:7559602665421673106:7501]
2025-10-10T14:39:14.469292Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:14.469311Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:14.469314Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:14.469318Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:14.469321Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:14.469356Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:14.469369Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:14.469382Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:14.469460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:14.469466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:14.469468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:14.469471Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:14.469541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:14.469550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:14.469561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:14.469571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:14.469585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:14.469607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602666203913151:2438], now have 1 active actors on pipe
2025-10-10T14:39:14.469614Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602665421673101:7501]
2025-10-10T14:39:14.469623Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602665421673101:7501]
2025-10-10T14:39:14.469624Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602665421673101:7501]
2025-10-10T14:39:14.469641Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:14.469654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602666203913312:4204], now have 1 active actors on pipe
2025-10-10T14:39:14.469662Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:14.469661Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:14.469665Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:14.469667Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:14.469677Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:14.469680Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:14.469702Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602665421673101:7501]
2025-10-10T14:39:14.469710Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2925
2025-10-10T14:39:14.469737Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2925
2025-10-10T14:39:14.469717Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:14.469742Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:14.469775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:14.469779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:14.469810Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|eda26091-72b6a58d-e2f7e6f0-f237942a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:14.469818Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:14.469822Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:14.469825Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:14.469836Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:14.469847Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:14.469859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:14.470013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:14.470023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:14.470039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:14.470163Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2926 partition: 0 MaxSeqNo: 40 sessionId: src_id|eda26091-72b6a58d-e2f7e6f0-f237942a_0
2025-10-10T14:39:14.470608Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|69a59432-ee5617c8-995e9259-3951f51a_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|eda26091-72b6a58d-e2f7e6f0-f237942a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:14.473368Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eda26091-72b6a58d-e2f7e6f0-f237942a_0] Write session: try to update token
2025-10-10T14:39:14.473386Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eda26091-72b6a58d-e2f7e6f0-f237942a_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:14.488472Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2926 sessionId: src_id|eda26091-72b6a58d-e2f7e6f0-f237942a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:14.490112Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:14.490131Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:14.490134Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:14.490137Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:14.490148Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602665421673101:7501]
2025-10-10T14:39:14.490153Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602665421673101:7501]
2025-10-10T14:39:14.490157Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602665421673101:7501]
2025-10-10T14:39:14.490207Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:14.490221Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:14.490223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:14.490278Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:14.490301Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:14.490306Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:14.490367Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:14.491269Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:14.532549Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602666203913423:4699]
2025-10-10T14:39:14.532765Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 pipe creation result: OK TabletId: 72075186224037892 Generation: 2925, pipe: [1:7559602666203913423:4699]
2025-10-10T14:39:14.603685Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:14.604168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:14.604182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:14.604249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602666203913423:4699], now have 1 active actors on pipe
2025-10-10T14:39:14.604488Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:14.605303Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:14.605317Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:14.605391Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:14.605404Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2926 reason: error at write: Disconnected sessionId: src_id|eda26091-72b6a58d-e2f7e6f0-f237942a_0
2025-10-10T14:39:14.605443Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 24 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602666203913423:4699]
2025-10-10T14:39:14.605653Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2926 sessionId: src_id|eda26091-72b6a58d-e2f7e6f0-f237942a_0 is DEAD
2025-10-10T14:39:14.609443Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eda26091-72b6a58d-e2f7e6f0-f237942a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:14.609458Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eda26091-72b6a58d-e2f7e6f0-f237942a_0] Write session will restart in 0.009709s
2025-10-10T14:39:14.609484Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eda26091-72b6a58d-e2f7e6f0-f237942a_0] Write session: Do CDS request
2025-10-10T14:39:14.609493Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eda26091-72b6a58d-e2f7e6f0-f237942a_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:14.620971Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eda26091-72b6a58d-e2f7e6f0-f237942a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:14.621022Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:14.621038Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2927
2025-10-10T14:39:14.621242Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2927 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:14.621293Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2927 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:14.621307Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2927 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:14.621311Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:14.621844Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2927 sessionId:  describe result for acl check
2025-10-10T14:39:14.621887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:14.621896Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:14.621898Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:14.621904Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602666203913535:4191] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:14.622483Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602666203913535:4191] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:14.625589Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602666203913535:4191] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:14.627950Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602666203913535:4191] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:14.627964Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602666203913535:4191] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:14.627968Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602666203913535:4191] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:14.627977Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2927 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:14.634575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:14.635167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:14.635364Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:14.635376Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:14.635388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:14.635438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:14.635485Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602665421673386:7493]
2025-10-10T14:39:14.636180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:14.636485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:14.636527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:14.636867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:14.636921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:14.636927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:14.636929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:14.636930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:14.636932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:14.636933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:14.636935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:14.636937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:14.636938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:14.636939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:14.636941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:14.636942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:14.636943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:14.636950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:14.636965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:14.636970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:14.636975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:14.636979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:14.636984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:14.636988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:14.636993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:14.636997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:14.637003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:14.637007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:14.637011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:14.637016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:14.637023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:14.637033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:14.637040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:14.637051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:14.637056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:14.637062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:14.637071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:14.637077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:14.637083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:14.637089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:14.637096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:14.637101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:14.637106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:14.637116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:14.637120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:14.637126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:14.637136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:14.637142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:14.637152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:14.637172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:14.637182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:14.637187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:14.637194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:14.637200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:14.637208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:14.637226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:14.637274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:14.639877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:14.640614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:14.640631Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:14.640633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:14.640638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:14.640645Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2926 [2:7559602665421673386:7493]
2025-10-10T14:39:14.640662Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:14.640683Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:14.640691Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:14.640695Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:14.640697Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:14.640715Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:14.640723Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:14.640732Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:14.640806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:14.640816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:14.640819Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:14.640821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:14.640898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:14.640906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:14.640920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:14.640939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:14.640962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:14.640991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602666203913687:4191], now have 1 active actors on pipe
2025-10-10T14:39:14.641000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602666203913427:2438], now have 1 active actors on pipe
2025-10-10T14:39:14.641008Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602665421673381:7493]
2025-10-10T14:39:14.641016Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602665421673381:7493]
2025-10-10T14:39:14.641019Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602665421673381:7493]
2025-10-10T14:39:14.641034Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:14.641052Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:14.641053Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:14.641056Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:14.641058Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:14.641032Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2926
2025-10-10T14:39:14.641066Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2926
2025-10-10T14:39:14.641073Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:14.641082Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:14.641135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:14.641146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:14.641162Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602665421673381:7493]
2025-10-10T14:39:14.641175Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:14.641182Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:14.641229Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|efbb9084-df7a63b2-3c5f7012-384826ec_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:14.641242Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:14.641249Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:14.641252Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:14.641264Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:14.641276Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:14.641306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:14.641543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:14.641554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:14.641576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:14.641694Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2927 partition: 0 MaxSeqNo: 40 sessionId: src_id|efbb9084-df7a63b2-3c5f7012-384826ec_0
2025-10-10T14:39:14.642145Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eda26091-72b6a58d-e2f7e6f0-f237942a_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|efbb9084-df7a63b2-3c5f7012-384826ec_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:14.644968Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|efbb9084-df7a63b2-3c5f7012-384826ec_0] Write session: try to update token
2025-10-10T14:39:14.644994Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|efbb9084-df7a63b2-3c5f7012-384826ec_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:14.661467Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2927 sessionId: src_id|efbb9084-df7a63b2-3c5f7012-384826ec_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:14.661493Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:14.661510Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:14.661514Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:14.661516Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:14.661526Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602665421673381:7493]
2025-10-10T14:39:14.661531Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602665421673381:7493]
2025-10-10T14:39:14.661536Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602665421673381:7493]
2025-10-10T14:39:14.661589Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:14.661592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:14.661595Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:14.661599Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:14.661601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:14.661604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:14.661757Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:14.664211Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:14.705582Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602666203913715:4699]
2025-10-10T14:39:14.705811Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 pipe creation result: OK TabletId: 72075186224037892 Generation: 2926, pipe: [1:7559602666203913715:4699]
2025-10-10T14:39:14.780275Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:14.780775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:14.780797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:14.780846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602666203913715:4699], now have 1 active actors on pipe
2025-10-10T14:39:14.781085Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:14.781141Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:14.781160Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:14.781250Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2927 reason: error at write: Disconnected sessionId: src_id|efbb9084-df7a63b2-3c5f7012-384826ec_0
2025-10-10T14:39:14.781347Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 25 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602666203913715:4699]
2025-10-10T14:39:14.781379Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:14.781467Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2927 sessionId: src_id|efbb9084-df7a63b2-3c5f7012-384826ec_0 is DEAD
2025-10-10T14:39:14.782021Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|efbb9084-df7a63b2-3c5f7012-384826ec_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:14.782030Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|efbb9084-df7a63b2-3c5f7012-384826ec_0] Write session will restart in 0.006217s
2025-10-10T14:39:14.782054Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|efbb9084-df7a63b2-3c5f7012-384826ec_0] Write session: Do CDS request
2025-10-10T14:39:14.782064Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|efbb9084-df7a63b2-3c5f7012-384826ec_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:14.789947Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|efbb9084-df7a63b2-3c5f7012-384826ec_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:14.790046Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:14.790072Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2928
2025-10-10T14:39:14.790189Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2928 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:14.790225Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2928 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:14.790235Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2928 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:14.790239Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:14.790749Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2928 sessionId:  describe result for acl check
2025-10-10T14:39:14.790788Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:14.790794Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:14.790796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:14.790802Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602666203913735:4161] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:14.791389Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602666203913735:4161] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:14.794027Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602666203913735:4161] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:14.798304Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602666203913735:4161] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:14.798322Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602666203913735:4161] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:14.798326Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602666203913735:4161] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:14.798336Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2928 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:14.805591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:14.815044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:14.815349Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:14.815364Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:14.815378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:14.815449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:14.815505Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602665421673655:7497]
2025-10-10T14:39:14.816160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:14.816618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:14.816682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:14.817033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:14.817137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:14.817145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:14.817146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:14.817147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:14.817149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:14.817150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:14.817152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:14.817153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:14.817155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:14.817157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:14.817159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:14.817160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:14.817161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:14.817168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:14.817184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:14.817189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:14.817193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:14.817198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:14.817203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:14.817207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:14.817226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:14.817230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:14.817235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:14.817239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:14.817244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:14.817248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:14.817257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:14.817269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:14.817277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:14.817284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:14.817290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:14.817303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:14.817308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:14.817313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:14.817319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:14.817325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:14.817356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:14.817361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:14.817366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:14.817371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:14.817375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:14.817380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:14.817385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:14.817397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:14.817406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:14.817412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:14.817416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:14.817428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:14.817432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:14.817442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:14.817450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:14.817461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:14.817501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:14.820192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:14.820941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:14.820955Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:14.820958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:14.820962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:14.820968Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2927 [2:7559602665421673655:7497]
2025-10-10T14:39:14.820983Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:14.821006Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:14.821016Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:14.821021Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:14.821023Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:14.821042Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:14.821052Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:14.821060Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:14.821120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:14.821130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:14.821132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:14.821134Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:14.821226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:14.821233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:14.821246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:14.821259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:14.821279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:14.821300Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602665421673650:7497]
2025-10-10T14:39:14.821303Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602665421673650:7497]
2025-10-10T14:39:14.821305Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602665421673650:7497]
2025-10-10T14:39:14.821314Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:14.821458Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2927
2025-10-10T14:39:14.821505Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2927
2025-10-10T14:39:14.821345Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:14.821347Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:14.821356Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:14.821358Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:14.821363Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:14.821367Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:14.821379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602666203913716:2438], now have 1 active actors on pipe
2025-10-10T14:39:14.821383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602666203913878:4161], now have 1 active actors on pipe
2025-10-10T14:39:14.821407Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602665421673650:7497]
2025-10-10T14:39:14.821417Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:14.821606Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:14.821633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:14.821640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:14.821673Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3ea18fbb-9df1619c-4fd8c0a5-cf2fd809_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:14.821683Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:14.821688Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:14.821691Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:14.821704Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:14.821718Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:14.821732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:14.823063Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2928 partition: 0 MaxSeqNo: 40 sessionId: src_id|3ea18fbb-9df1619c-4fd8c0a5-cf2fd809_0
2025-10-10T14:39:14.823464Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|efbb9084-df7a63b2-3c5f7012-384826ec_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|3ea18fbb-9df1619c-4fd8c0a5-cf2fd809_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:14.822870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:14.822884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:14.822907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:14.826153Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3ea18fbb-9df1619c-4fd8c0a5-cf2fd809_0] Write session: try to update token
2025-10-10T14:39:14.826170Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3ea18fbb-9df1619c-4fd8c0a5-cf2fd809_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:14.841448Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2928 sessionId: src_id|3ea18fbb-9df1619c-4fd8c0a5-cf2fd809_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:14.844641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:14.844669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:14.844695Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:14.844698Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:14.844702Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:14.844350Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:14.844705Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:14.844714Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602665421673650:7497]
2025-10-10T14:39:14.844719Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602665421673650:7497]
2025-10-10T14:39:14.844723Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602665421673650:7497]
2025-10-10T14:39:14.844770Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:14.844785Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:14.844786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:14.844790Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:14.844795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:14.844797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:14.844947Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:14.881755Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602666203914000:4699]
2025-10-10T14:39:14.882121Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 pipe creation result: OK TabletId: 72075186224037892 Generation: 2927, pipe: [1:7559602666203914000:4699]
2025-10-10T14:39:14.966315Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:14.966808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:39:14.966869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602666203914000:4699], now have 1 active actors on pipe
2025-10-10T14:39:14.969477Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:14.969544Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 26 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602666203914000:4699]
2025-10-10T14:39:14.969575Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:39:14.969652Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:14.969660Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:14.969754Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2928 reason: error at write: Disconnected sessionId: src_id|3ea18fbb-9df1619c-4fd8c0a5-cf2fd809_0
2025-10-10T14:39:14.969942Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2928 sessionId: src_id|3ea18fbb-9df1619c-4fd8c0a5-cf2fd809_0 is DEAD
2025-10-10T14:39:14.970291Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ea18fbb-9df1619c-4fd8c0a5-cf2fd809_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:14.970320Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ea18fbb-9df1619c-4fd8c0a5-cf2fd809_0] Write session will restart in 0.008546s
2025-10-10T14:39:14.970345Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ea18fbb-9df1619c-4fd8c0a5-cf2fd809_0] Write session: Do CDS request
2025-10-10T14:39:14.970352Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ea18fbb-9df1619c-4fd8c0a5-cf2fd809_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:14.985849Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3ea18fbb-9df1619c-4fd8c0a5-cf2fd809_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:14.989514Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:14.989530Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2929
2025-10-10T14:39:14.989736Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2929 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:14.989771Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2929 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:14.989776Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2929 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:14.989781Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:14.990199Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2929 sessionId:  describe result for acl check
2025-10-10T14:39:14.990233Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:14.990235Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:14.990237Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:14.990245Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602666203914227:4120] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:14.990997Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602666203914227:4120] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:14.993889Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602666203914227:4120] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:15.002598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:15.002344Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602666203914227:4120] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:15.002363Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602666203914227:4120] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:15.002368Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602666203914227:4120] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:15.002378Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2929 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:15.003525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:15.003966Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:15.003973Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:15.003990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:15.004062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:15.004104Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602669716641258:7479]
2025-10-10T14:39:15.004730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:15.005115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:15.005171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:15.005593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:15.005678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:15.005680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:15.005681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:15.005682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:15.005684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:15.005685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:15.005687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:15.005688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:15.005690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:15.005691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:15.005692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:15.005694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:15.005695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:15.005703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:15.005718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:15.005724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:15.005728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:15.005733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:15.005737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:15.005742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:15.005747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:15.005751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:15.005755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:15.005760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:15.005764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:15.005769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:15.005777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:15.005786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:15.005793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:15.005799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:15.005808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:15.005835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:15.005845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:15.005851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:15.005856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:15.005862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:15.005867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:15.005872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:15.005877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:15.005882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:15.005887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:15.005892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:15.005897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:15.005903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:15.005908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:15.005913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:15.005918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:15.005923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:15.005928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:15.005934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:15.005938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:15.005944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:15.005984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:15.008849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:15.009570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:15.009586Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:15.009589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:15.009594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:15.009601Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2928 [2:7559602669716641258:7479]
2025-10-10T14:39:15.009616Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:15.009635Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:15.009639Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:15.009644Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:15.009646Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:15.009666Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:15.009674Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:15.009681Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:15.009746Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:15.009755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:15.009757Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:15.009759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:15.009835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:15.009844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:15.009857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:15.009953Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2928
2025-10-10T14:39:15.009986Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2928
2025-10-10T14:39:15.009876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:15.009904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:15.009926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602670498881578:4120], now have 1 active actors on pipe
2025-10-10T14:39:15.009932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602666203914020:2438], now have 1 active actors on pipe
2025-10-10T14:39:15.009940Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602669716641252:7479]
2025-10-10T14:39:15.009942Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602669716641252:7479]
2025-10-10T14:39:15.009944Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602669716641252:7479]
2025-10-10T14:39:15.009953Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:15.009963Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:15.009967Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:15.009968Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:15.009969Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:15.009986Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:15.009990Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:15.010010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:15.010016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:15.010052Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602669716641252:7479]
2025-10-10T14:39:15.010063Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:15.010068Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:15.010088Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|75390766-4a39d559-b8e75a1f-5a326ce0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:15.010098Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:15.010103Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:15.010106Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:15.010117Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:15.010129Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:15.010172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:15.010480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:15.010494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:15.010515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:15.011046Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ea18fbb-9df1619c-4fd8c0a5-cf2fd809_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|75390766-4a39d559-b8e75a1f-5a326ce0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:15.013897Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|75390766-4a39d559-b8e75a1f-5a326ce0_0] Write session: try to update token
2025-10-10T14:39:15.013916Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|75390766-4a39d559-b8e75a1f-5a326ce0_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:15.010610Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2929 partition: 0 MaxSeqNo: 40 sessionId: src_id|75390766-4a39d559-b8e75a1f-5a326ce0_0
2025-10-10T14:39:15.030364Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:15.030387Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:15.030391Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:15.030393Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:15.030402Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602669716641252:7479]
2025-10-10T14:39:15.030407Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602669716641252:7479]
2025-10-10T14:39:15.030412Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602669716641252:7479]
2025-10-10T14:39:15.030463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:15.030476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:15.030479Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:15.030635Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:15.028568Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2929 sessionId: src_id|75390766-4a39d559-b8e75a1f-5a326ce0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:15.031405Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:15.031640Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:15.031654Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:15.031659Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:15.069611Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602670498881591:4699]
2025-10-10T14:39:15.069919Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 pipe creation result: OK TabletId: 72075186224037892 Generation: 2928, pipe: [1:7559602670498881591:4699]
2025-10-10T14:39:15.147330Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:15.147860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:15.147878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:15.147926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602670498881591:4699], now have 1 active actors on pipe
2025-10-10T14:39:15.148203Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:15.148213Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 27 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602670498881591:4699]
2025-10-10T14:39:15.148238Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:39:15.148332Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2929 reason: status is not ok: tablet will be restarted right now sessionId: src_id|75390766-4a39d559-b8e75a1f-5a326ce0_0
2025-10-10T14:39:15.148145Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:15.148549Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2929 sessionId: src_id|75390766-4a39d559-b8e75a1f-5a326ce0_0 is DEAD
2025-10-10T14:39:15.148733Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75390766-4a39d559-b8e75a1f-5a326ce0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:39:15.148746Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75390766-4a39d559-b8e75a1f-5a326ce0_0] Write session will restart in 0.009175s
2025-10-10T14:39:15.148782Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75390766-4a39d559-b8e75a1f-5a326ce0_0] Write session: Do CDS request
2025-10-10T14:39:15.148788Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75390766-4a39d559-b8e75a1f-5a326ce0_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:15.158937Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|75390766-4a39d559-b8e75a1f-5a326ce0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:15.159033Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:15.159050Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2930
2025-10-10T14:39:15.159164Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2930 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:15.159200Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2930 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:15.159213Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2930 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:15.159220Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:15.159757Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2930 sessionId:  describe result for acl check
2025-10-10T14:39:15.159792Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:15.159802Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:15.159804Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:15.159811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602670498881636:4102] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:15.160396Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602670498881636:4102] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:15.163671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602670498881636:4102] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:15.168576Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602670498881636:4102] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:15.168592Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602670498881636:4102] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:15.168596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602670498881636:4102] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:15.168607Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2930 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:15.179710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:15.180963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:15.181186Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:15.181202Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:15.181229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:15.181288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:15.181355Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602669716641527:7454]
2025-10-10T14:39:15.182001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:15.182386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:15.182438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:15.182795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:15.182861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:15.182867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:15.182869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:15.182870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:15.182871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:15.182872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:15.182874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:15.182875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:15.182877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:15.182878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:15.182880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:15.182881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:15.182883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:15.182889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:15.182902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:15.182906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:15.182909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:15.182913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:15.182916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:15.182920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:15.182924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:15.182928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:15.182933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:15.182937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:15.182941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:15.182945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:15.182954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:15.182962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:15.182969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:15.182975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:15.182979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:15.182985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:15.182989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:15.182995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:15.183002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:15.183008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:15.183014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:15.183020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:15.183024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:15.183030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:15.183034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:15.183039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:15.183046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:15.183051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:15.183055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:15.183060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:15.183064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:15.183069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:15.183074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:15.183079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:15.183084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:15.183090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:15.183130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:15.186400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:15.187113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:15.187133Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:15.187135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:15.187140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:15.187147Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2929 [2:7559602669716641527:7454]
2025-10-10T14:39:15.187163Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:15.187183Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:15.187187Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:15.187191Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:15.187193Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:15.187212Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:15.187227Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:15.187241Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:15.187312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:15.187321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:15.187324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:15.187326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:15.187401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:15.187412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:15.187426Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:15.187439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:15.187455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:15.187485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602670498881597:2438], now have 1 active actors on pipe
2025-10-10T14:39:15.187494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602670498881798:4102], now have 1 active actors on pipe
2025-10-10T14:39:15.187502Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602669716641522:7454]
2025-10-10T14:39:15.187505Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602669716641522:7454]
2025-10-10T14:39:15.187507Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602669716641522:7454]
2025-10-10T14:39:15.187519Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:15.187535Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:15.187540Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:15.187546Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:15.187548Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:15.187558Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:15.187561Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:15.187565Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2929
2025-10-10T14:39:15.187575Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2929
2025-10-10T14:39:15.187599Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602669716641522:7454]
2025-10-10T14:39:15.187608Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:15.187611Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:15.187641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:15.187652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:15.187697Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7a19735a-da72d8a9-7fccf6cc-23a8e046_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:15.187711Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:15.187716Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:15.187718Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:15.187732Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:15.187748Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:15.187769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:15.187948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:15.187957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:15.187974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:15.188082Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2930 partition: 0 MaxSeqNo: 40 sessionId: src_id|7a19735a-da72d8a9-7fccf6cc-23a8e046_0
2025-10-10T14:39:15.188469Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75390766-4a39d559-b8e75a1f-5a326ce0_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|7a19735a-da72d8a9-7fccf6cc-23a8e046_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:15.191314Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7a19735a-da72d8a9-7fccf6cc-23a8e046_0] Write session: try to update token
2025-10-10T14:39:15.191338Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7a19735a-da72d8a9-7fccf6cc-23a8e046_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:15.208298Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:15.208321Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:15.208325Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:15.208328Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:15.208341Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602669716641522:7454]
2025-10-10T14:39:15.208346Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602669716641522:7454]
2025-10-10T14:39:15.208350Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602669716641522:7454]
2025-10-10T14:39:15.208405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:15.208414Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:15.208418Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:15.208424Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:15.208424Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:15.208428Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:15.208571Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:15.212807Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2930 sessionId: src_id|7a19735a-da72d8a9-7fccf6cc-23a8e046_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:15.215603Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:15.248339Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602670498881870:4699]
2025-10-10T14:39:15.248627Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 pipe creation result: OK TabletId: 72075186224037892 Generation: 2929, pipe: [1:7559602670498881870:4699]
2025-10-10T14:39:15.319533Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:15.320066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:15.320081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:15.320124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602670498881870:4699], now have 1 active actors on pipe
2025-10-10T14:39:15.320303Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:15.320378Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 28 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602670498881870:4699]
2025-10-10T14:39:15.320379Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:15.320417Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:39:15.320497Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2930 reason: status is not ok: tablet will be restarted right now sessionId: src_id|7a19735a-da72d8a9-7fccf6cc-23a8e046_0
2025-10-10T14:39:15.320717Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2930 sessionId: src_id|7a19735a-da72d8a9-7fccf6cc-23a8e046_0 is DEAD
2025-10-10T14:39:15.320882Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7a19735a-da72d8a9-7fccf6cc-23a8e046_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:39:15.320892Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7a19735a-da72d8a9-7fccf6cc-23a8e046_0] Write session will restart in 0.006663s
2025-10-10T14:39:15.320918Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7a19735a-da72d8a9-7fccf6cc-23a8e046_0] Write session: Do CDS request
2025-10-10T14:39:15.320925Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7a19735a-da72d8a9-7fccf6cc-23a8e046_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:15.329005Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7a19735a-da72d8a9-7fccf6cc-23a8e046_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:15.329058Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:15.329077Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2931
2025-10-10T14:39:15.329269Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2931 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:15.329307Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2931 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:15.329318Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2931 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:15.329322Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:15.329867Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2931 sessionId:  describe result for acl check
2025-10-10T14:39:15.329902Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:15.329910Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:15.329912Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:15.329918Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602670498881888:4080] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:15.330485Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602670498881888:4080] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:15.334397Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602670498881888:4080] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:15.338378Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602670498881888:4080] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:15.338394Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602670498881888:4080] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:15.338398Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602670498881888:4080] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:15.338408Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2931 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:15.344825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:15.350150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:15.350431Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:15.350446Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:15.350458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:15.350522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:15.350570Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602669716641799:7442]
2025-10-10T14:39:15.351226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:15.351627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:15.351692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:15.352039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:15.352109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:15.352116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:15.352118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:15.352119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:15.352120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:15.352122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:15.352123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:15.352125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:15.352126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:15.352127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:15.352128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:15.352130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:15.352131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:15.352138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:15.352151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:15.352155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:15.352159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:15.352162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:15.352166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:15.352170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:15.352174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:15.352177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:15.352181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:15.352185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:15.352189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:15.352192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:15.352203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:15.352211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:15.352217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:15.352223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:15.352227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:15.352233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:15.352237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:15.352243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:15.352248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:15.352252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:15.352256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:15.352262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:15.352266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:15.352271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:15.352276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:15.352281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:15.352285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:15.352292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:15.352296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:15.352300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:15.352304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:15.352309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:15.352313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:15.352318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:15.352324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:15.352328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:15.352363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:15.355135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:15.356441Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2930
2025-10-10T14:39:15.355967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:15.355972Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:15.355974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:15.355979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:15.355987Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2930 [2:7559602669716641799:7442]
2025-10-10T14:39:15.356001Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:15.356512Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2930
2025-10-10T14:39:15.356023Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:15.356026Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:15.356030Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:15.356033Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:15.356050Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:15.356059Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:15.356067Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:15.356133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:15.356135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:15.356137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:15.356140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:15.356214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:15.356218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:15.356231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:15.356243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:15.356261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:15.356284Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602669716641794:7442]
2025-10-10T14:39:15.356287Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602669716641794:7442]
2025-10-10T14:39:15.356289Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602669716641794:7442]
2025-10-10T14:39:15.356300Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:15.356311Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:15.356315Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:15.356316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602670498882034:4080], now have 1 active actors on pipe
2025-10-10T14:39:15.356316Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:15.356320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602670498881872:2438], now have 1 active actors on pipe
2025-10-10T14:39:15.356329Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:15.356347Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:15.356351Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:15.356397Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602669716641794:7442]
2025-10-10T14:39:15.356406Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:15.356412Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:15.356593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:15.356601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:15.356638Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d3ec3d82-42689ed-69c41cf3-408dbc88_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:15.356648Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:15.356656Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:15.356659Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:15.356674Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:15.356692Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:15.356723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:15.356908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:15.356918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:15.356934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:15.357197Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2931 partition: 0 MaxSeqNo: 40 sessionId: src_id|d3ec3d82-42689ed-69c41cf3-408dbc88_0
2025-10-10T14:39:15.357704Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7a19735a-da72d8a9-7fccf6cc-23a8e046_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|d3ec3d82-42689ed-69c41cf3-408dbc88_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:15.360556Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d3ec3d82-42689ed-69c41cf3-408dbc88_0] Write session: try to update token
2025-10-10T14:39:15.360576Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d3ec3d82-42689ed-69c41cf3-408dbc88_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:15.375755Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:39:15.375776Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:15.375789Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602669716641794:7442]
2025-10-10T14:39:15.375860Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:39:15.375861Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:39:15.376054Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:39:15.376227Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:15.376398Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:15.376548Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:15.376757Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:39:15.376751Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2931 sessionId: src_id|d3ec3d82-42689ed-69c41cf3-408dbc88_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:15.376810Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:39:15.379721Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:15.379976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:15.379998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:15.380050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:39:15.380156Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:39:15.387444Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:15.387466Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:15.387470Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:15.387473Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:15.387486Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602669716641794:7442]
2025-10-10T14:39:15.387491Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602669716641794:7442]
2025-10-10T14:39:15.387496Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602669716641794:7442]
2025-10-10T14:39:15.387549Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:15.387554Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:15.387557Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:15.387559Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:15.387562Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:15.387568Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:15.387713Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:15.420754Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602670498882147:4699]
2025-10-10T14:39:15.421230Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 pipe creation result: OK TabletId: 72075186224037892 Generation: 2930, pipe: [1:7559602670498882147:4699]
2025-10-10T14:39:15.509491Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:15.519179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:15.519205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:15.519387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:15.519455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:15.519524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:15.519589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:15.520149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:15.520165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:15.520246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:15.520315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:15.520384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:15.520454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:15.520502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:15.520509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:15.520586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:15.520655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:15.520720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:15.520788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:15.520834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:15.520842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:15.520919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:15.520986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:15.521056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:15.521124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:15.521170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:15.521177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:15.521256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:15.521318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:15.521397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:15.521462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:15.521509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:15.521514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:15.521582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:15.521646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:15.521710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:15.521778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:15.521823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:15.521839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:15.521907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:15.521970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:15.522036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:15.522098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:15.522340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:15.522349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:15.522414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:15.522476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:15.522542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:15.522607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:15.522649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:15.522656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:15.522721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:15.522785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:15.522849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:15.522914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:15.522960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:15.522967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:15.523032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:15.523090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:15.523154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:15.523217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:15.523262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:15.523269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:15.523333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602670498882147:4699], now have 1 active actors on pipe
2025-10-10T14:39:15.523633Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:15.523645Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:15.523648Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:15.523683Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2931 reason: error at write: Disconnected sessionId: src_id|d3ec3d82-42689ed-69c41cf3-408dbc88_0
2025-10-10T14:39:15.523697Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 29 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602670498882147:4699]
2025-10-10T14:39:15.523765Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:15.523961Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2931 sessionId: src_id|d3ec3d82-42689ed-69c41cf3-408dbc88_0 is DEAD
2025-10-10T14:39:15.524076Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d3ec3d82-42689ed-69c41cf3-408dbc88_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:15.524086Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d3ec3d82-42689ed-69c41cf3-408dbc88_0] Write session will restart in 0.005160s
2025-10-10T14:39:15.524124Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d3ec3d82-42689ed-69c41cf3-408dbc88_0] Write session: Do CDS request
2025-10-10T14:39:15.524130Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d3ec3d82-42689ed-69c41cf3-408dbc88_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:15.530936Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d3ec3d82-42689ed-69c41cf3-408dbc88_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:15.531065Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:15.531079Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2932
2025-10-10T14:39:15.531213Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2932 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:15.531259Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2932 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:15.531265Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2932 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:15.531269Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:15.531737Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2932 sessionId:  describe result for acl check
2025-10-10T14:39:15.531773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:15.531776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:15.531777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:15.531784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602670498882163:4066] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:15.532275Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602670498882163:4066] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:15.535357Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602670498882163:4066] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:15.538832Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602670498882163:4066] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:15.538857Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602670498882163:4066] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:15.538861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602670498882163:4066] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:15.538870Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2932 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:15.547336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:15.552256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:15.552776Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:15.552789Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:15.552803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:15.552883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:15.552930Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602669716642083:7435]
2025-10-10T14:39:15.553623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:15.553953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:15.553997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:15.554324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:15.554381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:15.554391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:15.554392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:15.554393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:15.554395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:15.554396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:15.554398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:15.554399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:15.554400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:15.554402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:15.554403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:15.554404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:15.554406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:15.554412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:15.554426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:15.554430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:15.554435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:15.554439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:15.554443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:15.554447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:15.554451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:15.554455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:15.554459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:15.554463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:15.554467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:15.554471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:15.554480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:15.554489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:15.554495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:15.554501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:15.554505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:15.554512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:15.554517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:15.554522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:15.554526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:15.554532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:15.554536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:15.554541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:15.554546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:15.554552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:15.554556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:15.554562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:15.554566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:15.554572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:15.554576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:15.554581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:15.554586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:15.554591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:15.554595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:15.554601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:15.554605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:15.554611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:15.554651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:15.557283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:15.557648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:15.557678Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:15.557681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:15.557685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:15.557692Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2931 [2:7559602669716642083:7435]
2025-10-10T14:39:15.557707Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:15.557727Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:15.557735Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:15.557739Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:15.557741Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:15.557759Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:15.557771Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:15.557779Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:15.557839Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:15.557846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:15.557848Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:15.557851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:15.557916Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:15.557925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:15.557939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:15.557951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:15.557970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:15.558011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602670498882150:2438], now have 1 active actors on pipe
2025-10-10T14:39:15.558020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602670498882269:4066], now have 1 active actors on pipe
2025-10-10T14:39:15.558028Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602669716642078:7435]
2025-10-10T14:39:15.558030Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602669716642078:7435]
2025-10-10T14:39:15.558032Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602669716642078:7435]
2025-10-10T14:39:15.558046Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:15.558067Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:15.558051Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2931
2025-10-10T14:39:15.558067Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2931
2025-10-10T14:39:15.558069Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:15.558073Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:15.558075Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:15.558090Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:15.558095Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:15.558122Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602669716642078:7435]
2025-10-10T14:39:15.558126Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:15.558129Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:15.558146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:15.558151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:15.558558Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9c83f186-dd8fa3b-6fc1b288-7bb2f0bb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:15.558575Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:15.558579Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:15.558582Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:15.558596Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:15.558613Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:15.558643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:15.558809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:15.558817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:15.558835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:15.558921Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2932 partition: 0 MaxSeqNo: 40 sessionId: src_id|9c83f186-dd8fa3b-6fc1b288-7bb2f0bb_0
2025-10-10T14:39:15.559343Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d3ec3d82-42689ed-69c41cf3-408dbc88_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|9c83f186-dd8fa3b-6fc1b288-7bb2f0bb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:15.562552Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9c83f186-dd8fa3b-6fc1b288-7bb2f0bb_0] Write session: try to update token
2025-10-10T14:39:15.562570Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9c83f186-dd8fa3b-6fc1b288-7bb2f0bb_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:15.578299Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:15.578337Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:15.578341Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:15.578344Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:15.578358Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602669716642078:7435]
2025-10-10T14:39:15.578365Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602669716642078:7435]
2025-10-10T14:39:15.578369Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602669716642078:7435]
2025-10-10T14:39:15.578425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:15.578427Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:15.578435Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:15.578439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:15.578440Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:15.578442Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:15.578680Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:15.581858Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2932 sessionId: src_id|9c83f186-dd8fa3b-6fc1b288-7bb2f0bb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:15.584729Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:15.623667Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602670498882425:4699]
2025-10-10T14:39:15.623998Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 pipe creation result: OK TabletId: 72075186224037892 Generation: 2931, pipe: [1:7559602670498882425:4699]
2025-10-10T14:39:15.696381Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:15.696811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:15.696829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:15.696874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602670498882425:4699], now have 1 active actors on pipe
2025-10-10T14:39:15.697093Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:15.697158Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 30 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602670498882425:4699]
2025-10-10T14:39:15.697210Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:15.697263Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:39:15.697378Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2932 reason: status is not ok: tablet will be restarted right now sessionId: src_id|9c83f186-dd8fa3b-6fc1b288-7bb2f0bb_0
2025-10-10T14:39:15.697582Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2932 sessionId: src_id|9c83f186-dd8fa3b-6fc1b288-7bb2f0bb_0 is DEAD
2025-10-10T14:39:15.697751Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c83f186-dd8fa3b-6fc1b288-7bb2f0bb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:39:15.697762Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c83f186-dd8fa3b-6fc1b288-7bb2f0bb_0] Write session will restart in 0.008112s
2025-10-10T14:39:15.697786Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c83f186-dd8fa3b-6fc1b288-7bb2f0bb_0] Write session: Do CDS request
2025-10-10T14:39:15.697792Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c83f186-dd8fa3b-6fc1b288-7bb2f0bb_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:15.706975Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9c83f186-dd8fa3b-6fc1b288-7bb2f0bb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:15.707115Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:15.707145Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2933
2025-10-10T14:39:15.707292Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2933 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:15.707328Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2933 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:15.707339Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2933 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:15.707343Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:15.707813Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2933 sessionId:  describe result for acl check
2025-10-10T14:39:15.707858Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:15.707865Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:15.707867Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:15.707873Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602670498882466:4052] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:15.708410Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602670498882466:4052] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:15.711436Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602670498882466:4052] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:15.714697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602670498882466:4052] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:15.714711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602670498882466:4052] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:15.714715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602670498882466:4052] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:15.714723Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2933 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:15.725039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:15.725898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:15.726408Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:15.726426Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:15.726445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:15.726522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:15.726569Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602669716642355:7429]
2025-10-10T14:39:15.727227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:15.727560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:15.727622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:15.727960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:15.728036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:15.728044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:15.728045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:15.728047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:15.728048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:15.728050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:15.728051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:15.728052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:15.728053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:15.728055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:15.728056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:15.728057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:15.728061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:15.728069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:15.728082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:15.728087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:15.728091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:15.728095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:15.728099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:15.728103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:15.728108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:15.728112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:15.728116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:15.728121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:15.728125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:15.728129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:15.728139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:15.728150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:15.728162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:15.728168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:15.728178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:15.728184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:15.728189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:15.728200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:15.728210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:15.728220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:15.728226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:15.728236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:15.728241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:15.728251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:15.728256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:15.728261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:15.728266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:15.728272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:15.728281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:15.728287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:15.728297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:15.728302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:15.728312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:15.728317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:15.728326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:15.728332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:15.728380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:15.730966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:15.731323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:15.731342Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:15.731345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:15.731350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:15.731357Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2932 [2:7559602669716642355:7429]
2025-10-10T14:39:15.731371Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:15.731390Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:15.731394Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:15.731398Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:15.731401Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:15.731420Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:15.731428Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:15.731436Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:15.731504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:15.731515Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:15.731517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:15.731519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:15.731592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:15.731600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:15.731613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:15.731628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:15.731651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:15.731678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602670498882630:4052], now have 1 active actors on pipe
2025-10-10T14:39:15.731688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602670498882427:2438], now have 1 active actors on pipe
2025-10-10T14:39:15.731697Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602669716642350:7429]
2025-10-10T14:39:15.731702Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602669716642350:7429]
2025-10-10T14:39:15.731704Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602669716642350:7429]
2025-10-10T14:39:15.731717Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:15.731732Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:15.731732Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:15.731736Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:15.731738Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:15.731747Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:15.731751Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:15.731751Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2932
2025-10-10T14:39:15.731759Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2932
2025-10-10T14:39:15.731780Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602669716642350:7429]
2025-10-10T14:39:15.731789Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:15.731791Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:15.731813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:15.731817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:15.731876Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|68af8cd1-846a7c9d-cfb92af2-f72439c6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:15.731887Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:15.731897Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:15.731899Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:15.731911Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:15.731927Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:15.731945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:15.732087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:15.732098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:15.732117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:15.732187Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2933 partition: 0 MaxSeqNo: 40 sessionId: src_id|68af8cd1-846a7c9d-cfb92af2-f72439c6_0
2025-10-10T14:39:15.732621Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c83f186-dd8fa3b-6fc1b288-7bb2f0bb_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|68af8cd1-846a7c9d-cfb92af2-f72439c6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:15.735428Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|68af8cd1-846a7c9d-cfb92af2-f72439c6_0] Write session: try to update token
2025-10-10T14:39:15.735444Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|68af8cd1-846a7c9d-cfb92af2-f72439c6_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:15.754747Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2933 sessionId: src_id|68af8cd1-846a7c9d-cfb92af2-f72439c6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:15.755988Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:15.756013Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:15.756017Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:15.756020Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:15.756029Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602669716642350:7429]
2025-10-10T14:39:15.756034Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602669716642350:7429]
2025-10-10T14:39:15.756039Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602669716642350:7429]
2025-10-10T14:39:15.756087Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:15.756092Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:15.756093Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:15.756098Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:15.756101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:15.756104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:15.756263Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:15.757430Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:15.797231Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602670498882716:4699]
2025-10-10T14:39:15.797547Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 pipe creation result: OK TabletId: 72075186224037892 Generation: 2932, pipe: [1:7559602670498882716:4699]
2025-10-10T14:39:15.878744Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:15.879352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:15.879371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:15.879420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602670498882716:4699], now have 1 active actors on pipe
2025-10-10T14:39:15.879665Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:15.879676Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 31 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602670498882716:4699]
2025-10-10T14:39:15.879689Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:15.879694Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:15.879709Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:15.879763Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2933 reason: error at write: Disconnected sessionId: src_id|68af8cd1-846a7c9d-cfb92af2-f72439c6_0
2025-10-10T14:39:15.880013Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2933 sessionId: src_id|68af8cd1-846a7c9d-cfb92af2-f72439c6_0 is DEAD
2025-10-10T14:39:15.880169Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68af8cd1-846a7c9d-cfb92af2-f72439c6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:15.880178Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68af8cd1-846a7c9d-cfb92af2-f72439c6_0] Write session will restart in 0.009125s
2025-10-10T14:39:15.880205Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68af8cd1-846a7c9d-cfb92af2-f72439c6_0] Write session: Do CDS request
2025-10-10T14:39:15.880215Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68af8cd1-846a7c9d-cfb92af2-f72439c6_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:15.891158Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|68af8cd1-846a7c9d-cfb92af2-f72439c6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:15.891195Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:15.891219Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2934
2025-10-10T14:39:15.891433Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2934 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:15.891490Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2934 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:15.891501Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2934 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:15.891505Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:15.891996Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2934 sessionId:  describe result for acl check
2025-10-10T14:39:15.892035Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:15.892043Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:15.892045Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:15.892051Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602670498882773:4041] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:15.892629Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602670498882773:4041] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:15.895724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602670498882773:4041] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:15.899320Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602670498882773:4041] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:15.899346Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602670498882773:4041] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:15.899350Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602670498882773:4041] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:15.899360Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2934 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:15.908923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:15.909518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:15.909736Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:15.909750Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:15.909761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:15.909810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:15.909863Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602669716642628:7425]
2025-10-10T14:39:15.910528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:15.910860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:15.910920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:15.911247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:15.911304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:15.911312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:15.911313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:15.911314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:15.911315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:15.911317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:15.911318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:15.911319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:15.911321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:15.911322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:15.911323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:15.911324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:15.911325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:15.911332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:15.911345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:15.911351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:15.911355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:15.911360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:15.911364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:15.911368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:15.911371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:15.911376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:15.911381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:15.911385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:15.911390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:15.911394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:15.911403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:15.911412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:15.911418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:15.911424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:15.911428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:15.911434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:15.911438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:15.911444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:15.911449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:15.911454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:15.911460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:15.911466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:15.911471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:15.911477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:15.911483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:15.911489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:15.911497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:15.911504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:15.911513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:15.911520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:15.911529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:15.911534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:15.911542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:15.911548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:15.911557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:15.911563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:15.911613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:15.914282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:15.914938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:15.914969Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:15.914976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:15.914980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:15.914987Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2933 [2:7559602669716642628:7425]
2025-10-10T14:39:15.915000Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:15.915018Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:15.915022Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:15.915025Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:15.915027Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:15.915044Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:15.915056Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:15.915068Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:15.915127Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:15.915134Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:15.915136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:15.915139Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:15.915221Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:15.915230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:15.915243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:15.915254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:15.915271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:15.915300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602670498882946:4041], now have 1 active actors on pipe
2025-10-10T14:39:15.915304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602670498882724:2438], now have 1 active actors on pipe
2025-10-10T14:39:15.915312Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602669716642623:7425]
2025-10-10T14:39:15.915315Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602669716642623:7425]
2025-10-10T14:39:15.915317Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602669716642623:7425]
2025-10-10T14:39:15.915332Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:15.915347Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:15.915351Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:15.915355Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:15.915357Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:15.915370Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:15.915373Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:15.915400Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602669716642623:7425]
2025-10-10T14:39:15.915414Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:15.915423Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:15.915400Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2933
2025-10-10T14:39:15.915450Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2933
2025-10-10T14:39:15.915604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:15.915618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:15.915666Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3dc98773-f581c606-fe656709-c7c96f83_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:15.915694Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:15.915705Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:15.915709Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:15.915724Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:15.915739Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:15.915755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:15.915947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:15.915959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:15.915977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:15.916090Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2934 partition: 0 MaxSeqNo: 40 sessionId: src_id|3dc98773-f581c606-fe656709-c7c96f83_0
2025-10-10T14:39:15.916528Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68af8cd1-846a7c9d-cfb92af2-f72439c6_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|3dc98773-f581c606-fe656709-c7c96f83_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:15.919548Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3dc98773-f581c606-fe656709-c7c96f83_0] Write session: try to update token
2025-10-10T14:39:15.919584Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3dc98773-f581c606-fe656709-c7c96f83_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:15.934842Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2934 sessionId: src_id|3dc98773-f581c606-fe656709-c7c96f83_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:15.937552Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:15.939467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:15.939493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:15.939518Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:39:15.939522Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:15.939532Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602669716642623:7425]
2025-10-10T14:39:15.939599Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:39:15.939603Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:39:15.939782Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:39:15.939958Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:15.940095Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:15.940223Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:15.940422Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:39:15.940458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:39:15.940478Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:39:15.940561Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:39:15.951411Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:15.951433Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:15.951437Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:15.951439Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:15.951450Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602669716642623:7425]
2025-10-10T14:39:15.951455Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602669716642623:7425]
2025-10-10T14:39:15.951460Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602669716642623:7425]
2025-10-10T14:39:15.951488Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:15.951494Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:15.951500Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:15.951509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:15.951518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:15.951521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:15.951660Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:15.979983Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602670498883005:4699]
2025-10-10T14:39:15.980276Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 pipe creation result: OK TabletId: 72075186224037892 Generation: 2933, pipe: [1:7559602670498883005:4699]
2025-10-10T14:39:16.070475Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:16.079372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:16.079408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:16.079611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:16.079684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:16.079750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:16.079816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:16.079869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:16.079879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:16.079954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:16.080018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:16.080089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:16.080155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:16.080201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:16.080208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:16.080274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:16.080335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:16.080416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:16.080480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:16.080522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:16.080529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:16.080600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:16.080667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:16.080733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:16.080797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:16.080841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:16.080849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:16.080914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:16.080992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:16.081057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:16.081123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:16.081177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:16.081185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:16.081263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:16.081319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:16.081400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:16.081470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:16.081513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:16.081520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:16.081589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:16.081655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:16.081723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:16.081790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:16.081831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:16.081841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:16.081911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:16.081973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:16.082036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:16.082101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:16.082151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:16.082159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:16.082228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:16.082292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:16.082364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:16.082431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:16.082477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:16.082485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:16.082554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:16.082617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:16.082683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:16.082749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:16.082798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:16.082806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:16.082875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602670498883005:4699], now have 1 active actors on pipe
2025-10-10T14:39:16.083118Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 32 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602670498883005:4699]
2025-10-10T14:39:16.083159Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:16.083162Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:16.083163Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:16.083198Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2934 reason: error at write: Disconnected sessionId: src_id|3dc98773-f581c606-fe656709-c7c96f83_0
2025-10-10T14:39:16.083629Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3dc98773-f581c606-fe656709-c7c96f83_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:16.083640Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3dc98773-f581c606-fe656709-c7c96f83_0] Write session will restart in 0.008100s
2025-10-10T14:39:16.083667Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3dc98773-f581c606-fe656709-c7c96f83_0] Write session: Do CDS request
2025-10-10T14:39:16.083673Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3dc98773-f581c606-fe656709-c7c96f83_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:16.083853Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2934 sessionId: src_id|3dc98773-f581c606-fe656709-c7c96f83_0 is DEAD
2025-10-10T14:39:16.084144Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:16.093027Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3dc98773-f581c606-fe656709-c7c96f83_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:16.093119Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:16.093135Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2935
2025-10-10T14:39:16.093310Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2935 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:16.093368Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2935 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:16.093379Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2935 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:16.093384Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:16.094079Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2935 sessionId:  describe result for acl check
2025-10-10T14:39:16.094119Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:16.094127Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:16.094129Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:16.094137Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602674793850353:4002] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:16.094743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602674793850353:4002] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:16.098199Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602674793850353:4002] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:16.102888Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602674793850353:4002] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:16.102910Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602674793850353:4002] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:16.102915Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602674793850353:4002] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:16.102925Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2935 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:16.115040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:16.115894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:16.116114Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:16.116126Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:16.116138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:16.116196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:16.116244Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602674011610237:7402]
2025-10-10T14:39:16.116920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:16.117317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:16.117388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:16.117743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:16.117806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:16.117813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:16.117814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:16.117816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:16.117817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:16.117818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:16.117820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:16.117821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:16.117822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:16.117824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:16.117825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:16.117826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:16.117827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:16.117834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:16.117849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:16.117853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:16.117857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:16.117861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:16.117864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:16.117867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:16.117871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:16.117875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:16.117879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:16.117883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:16.117887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:16.117891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:16.117900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:16.117909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:16.117916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:16.117922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:16.117927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:16.117932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:16.117936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:16.117940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:16.117945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:16.117951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:16.117955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:16.117961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:16.117966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:16.117972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:16.117977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:16.117987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:16.117992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:16.117997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:16.118002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:16.118007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:16.118012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:16.118018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:16.118022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:16.118028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:16.118032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:16.118044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:16.118081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:16.121117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:16.121864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:16.121880Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:16.121882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:16.121886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:16.121894Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2934 [2:7559602674011610237:7402]
2025-10-10T14:39:16.121908Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:16.121930Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:16.121938Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:16.121942Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:16.121944Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:16.121966Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:16.121981Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:16.121990Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:16.122059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:16.122066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:16.122069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:16.122072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:16.122148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:16.122156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:16.122170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:16.122188Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:16.122210Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:16.122237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602674793850520:4002], now have 1 active actors on pipe
2025-10-10T14:39:16.122245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602674793850329:2438], now have 1 active actors on pipe
2025-10-10T14:39:16.122253Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602674011610232:7402]
2025-10-10T14:39:16.122256Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602674011610232:7402]
2025-10-10T14:39:16.122258Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602674011610232:7402]
2025-10-10T14:39:16.122273Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:16.122288Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:16.122295Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:16.122309Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:16.122299Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:16.122318Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:16.122318Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:16.122293Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2934
2025-10-10T14:39:16.122316Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2934
2025-10-10T14:39:16.122354Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602674011610232:7402]
2025-10-10T14:39:16.122362Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:16.122373Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:16.122405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:16.122417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:16.122450Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|591580-68d1e478-ea4cbffd-bcfed012_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:16.122462Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:16.122467Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:16.122470Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:16.122481Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:16.122506Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:16.122521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:16.122673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:16.122683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:16.122699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:16.122822Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2935 partition: 0 MaxSeqNo: 40 sessionId: src_id|591580-68d1e478-ea4cbffd-bcfed012_0
2025-10-10T14:39:16.123296Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3dc98773-f581c606-fe656709-c7c96f83_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|591580-68d1e478-ea4cbffd-bcfed012_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:16.126027Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|591580-68d1e478-ea4cbffd-bcfed012_0] Write session: try to update token
2025-10-10T14:39:16.126048Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|591580-68d1e478-ea4cbffd-bcfed012_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:16.134795Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:39:16.134820Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:16.134833Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602674011610232:7402]
2025-10-10T14:39:16.134890Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:39:16.134890Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:39:16.135122Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:39:16.135314Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:16.135494Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:16.135676Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:16.135925Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:39:16.135984Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:39:16.143937Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2935 sessionId: src_id|591580-68d1e478-ea4cbffd-bcfed012_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:16.147267Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:16.147701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:16.147734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:16.147781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:39:16.147872Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:39:16.154876Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:16.154896Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:16.154900Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:16.154902Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:16.154914Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602674011610232:7402]
2025-10-10T14:39:16.154918Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602674011610232:7402]
2025-10-10T14:39:16.154921Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602674011610232:7402]
2025-10-10T14:39:16.154977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:16.154980Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:16.154986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:16.154987Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:16.154989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:16.154992Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:16.155130Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:16.183257Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602674793850605:4699]
2025-10-10T14:39:16.183555Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 pipe creation result: OK TabletId: 72075186224037892 Generation: 2934, pipe: [1:7559602674793850605:4699]
2025-10-10T14:39:16.267755Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:16.276882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:16.276921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:16.277125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:16.277204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:16.277274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:16.277364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:16.277699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:16.277714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:16.277787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:16.277858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:16.277930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:16.277999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:16.278050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:16.278057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:16.278132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:16.278200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:16.278273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:16.278340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:16.278385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:16.278393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:16.278464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:16.278538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:16.278611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:16.278690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:16.278741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:16.278750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:16.278819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:16.278879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:16.278949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:16.279019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:16.279072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:16.279084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:16.279158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:16.279225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:16.279295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:16.279369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:16.279416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:16.279424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:16.279503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:16.279578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:16.279670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:16.279737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:16.279785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:16.279793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:16.279870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:16.279942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:16.280005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:16.280074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:16.280121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:16.280125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:16.280199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:16.280269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:16.280338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:16.280408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:16.280454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:16.280463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:16.280534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:16.280598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:16.280665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:16.280733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:16.280780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:16.280792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:16.280863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602674793850605:4699], now have 1 active actors on pipe
2025-10-10T14:39:16.281078Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:16.281093Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:16.281098Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:16.281129Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2935 reason: error at write: Disconnected sessionId: src_id|591580-68d1e478-ea4cbffd-bcfed012_0
2025-10-10T14:39:16.281148Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 33 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602674793850605:4699]
2025-10-10T14:39:16.281416Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2935 sessionId: src_id|591580-68d1e478-ea4cbffd-bcfed012_0 is DEAD
2025-10-10T14:39:16.281566Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|591580-68d1e478-ea4cbffd-bcfed012_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:16.281576Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|591580-68d1e478-ea4cbffd-bcfed012_0] Write session will restart in 0.008169s
2025-10-10T14:39:16.281603Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|591580-68d1e478-ea4cbffd-bcfed012_0] Write session: Do CDS request
2025-10-10T14:39:16.281610Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|591580-68d1e478-ea4cbffd-bcfed012_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:16.281811Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:16.291011Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|591580-68d1e478-ea4cbffd-bcfed012_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:16.291576Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:16.291593Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2936
2025-10-10T14:39:16.291838Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2936 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:16.291886Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2936 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:16.291896Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2936 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:16.291901Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:16.292427Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2936 sessionId:  describe result for acl check
2025-10-10T14:39:16.292467Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:16.292469Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:16.292471Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:16.292479Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602674793850632:3989] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:16.293072Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602674793850632:3989] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:16.298775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602674793850632:3989] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:16.302600Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602674793850632:3989] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:16.302618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602674793850632:3989] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:16.302623Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602674793850632:3989] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:16.302633Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2936 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:16.307933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:16.312581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:16.313205Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:16.313222Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:16.313240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:16.313328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:16.313395Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602674011610515:7395]
2025-10-10T14:39:16.314105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:16.314463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:16.314515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:16.314867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:16.314941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:16.314953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:16.314955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:16.314956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:16.314957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:16.314959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:16.314960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:16.314961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:16.314962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:16.314964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:16.314965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:16.314966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:16.314968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:16.314975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:16.314989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:16.314993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:16.314998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:16.315002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:16.315006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:16.315011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:16.315015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:16.315019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:16.315024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:16.315028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:16.315033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:16.315037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:16.315047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:16.315056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:16.315069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:16.315076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:16.315085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:16.315096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:16.315106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:16.315112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:16.315116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:16.315126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:16.315135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:16.315146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:16.315158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:16.315168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:16.315177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:16.315188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:16.315197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:16.315208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:16.315217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:16.315227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:16.315236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:16.315246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:16.315255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:16.315265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:16.315274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:16.315284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:16.315327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:16.317844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:16.318197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:16.318208Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:16.318212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:16.318216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:16.318222Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2935 [2:7559602674011610515:7395]
2025-10-10T14:39:16.318251Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:16.318270Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:16.318278Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:16.318282Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:16.318284Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:16.318302Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:16.318315Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:16.318324Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:16.318390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:16.318397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:16.318400Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:16.318412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:16.318489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:16.318496Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:16.318510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:16.318527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:16.318547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:16.318575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602674793850607:2438], now have 1 active actors on pipe
2025-10-10T14:39:16.318583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602674793850798:3989], now have 1 active actors on pipe
2025-10-10T14:39:16.318592Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602674011610510:7395]
2025-10-10T14:39:16.318595Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602674011610510:7395]
2025-10-10T14:39:16.318597Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602674011610510:7395]
2025-10-10T14:39:16.318611Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:16.318625Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:16.318628Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:16.318628Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:16.318638Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:16.318646Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:16.318649Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:16.318645Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2935
2025-10-10T14:39:16.318685Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2935
2025-10-10T14:39:16.318678Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602674011610510:7395]
2025-10-10T14:39:16.318692Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:16.318719Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:16.318779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:16.318785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:16.318817Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f74eb87-19bb20d0-73669083-ddf3ec49_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:16.318829Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:16.318836Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:16.318839Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:16.318852Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:16.318868Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:16.318886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:16.319061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:16.319074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:16.319098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:16.319208Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2936 partition: 0 MaxSeqNo: 40 sessionId: src_id|f74eb87-19bb20d0-73669083-ddf3ec49_0
2025-10-10T14:39:16.319680Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|591580-68d1e478-ea4cbffd-bcfed012_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|f74eb87-19bb20d0-73669083-ddf3ec49_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:16.322803Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f74eb87-19bb20d0-73669083-ddf3ec49_0] Write session: try to update token
2025-10-10T14:39:16.322824Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f74eb87-19bb20d0-73669083-ddf3ec49_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:16.330785Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:39:16.330806Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:16.330817Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602674011610510:7395]
2025-10-10T14:39:16.330864Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:39:16.330884Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:39:16.331076Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:39:16.331227Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:16.331391Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:16.331569Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:16.331787Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:39:16.331839Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:39:16.341345Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2936 sessionId: src_id|f74eb87-19bb20d0-73669083-ddf3ec49_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:16.344597Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:16.344821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:16.344846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:16.344890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:39:16.344996Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:39:16.349403Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:16.349427Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:16.349430Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:16.349433Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:16.349446Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602674011610510:7395]
2025-10-10T14:39:16.349450Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602674011610510:7395]
2025-10-10T14:39:16.349455Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602674011610510:7395]
2025-10-10T14:39:16.349508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:16.349517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:16.349516Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:16.349520Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:16.349523Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:16.349528Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:16.349662Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:16.381366Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602674793850890:4699]
2025-10-10T14:39:16.381655Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 pipe creation result: OK TabletId: 72075186224037892 Generation: 2935, pipe: [1:7559602674793850890:4699]
2025-10-10T14:39:16.470946Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:16.479584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:16.479618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:16.479801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:16.479866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:16.479931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:16.479995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:16.480039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:16.480051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:16.480119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:16.480179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:16.480240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:16.480306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:16.480351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:16.480359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:16.480425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:16.480495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:16.480563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:16.480628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:16.480673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:16.480676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:16.480745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:16.480866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:16.480941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:16.481015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:16.481059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:16.481070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:16.481139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:16.481215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:16.481279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:16.481356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:16.481400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:16.481404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:16.481468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:16.481531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:16.481594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:16.481661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:16.481706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:16.481714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:16.481779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:16.481838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:16.481901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:16.481963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:16.482011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:16.482020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:16.482083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:16.482143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:16.482206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:16.482273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:16.482317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:16.482325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:16.482386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:16.482443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:16.482505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:16.482569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:16.482619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:16.482627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:16.482690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:16.482750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:16.482812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:16.482873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:16.483025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:16.483033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:16.483111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602674793850890:4699], now have 1 active actors on pipe
2025-10-10T14:39:16.483859Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f74eb87-19bb20d0-73669083-ddf3ec49_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:16.483881Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f74eb87-19bb20d0-73669083-ddf3ec49_0] Write session will restart in 0.007846s
2025-10-10T14:39:16.483347Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:16.483352Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 34 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602674793850890:4699]
2025-10-10T14:39:16.483361Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:16.483376Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:16.483394Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2936 reason: error at write: Disconnected sessionId: src_id|f74eb87-19bb20d0-73669083-ddf3ec49_0
2025-10-10T14:39:16.483907Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f74eb87-19bb20d0-73669083-ddf3ec49_0] Write session: Do CDS request
2025-10-10T14:39:16.483683Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2936 sessionId: src_id|f74eb87-19bb20d0-73669083-ddf3ec49_0 is DEAD
2025-10-10T14:39:16.483915Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f74eb87-19bb20d0-73669083-ddf3ec49_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:16.484303Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:16.492912Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f74eb87-19bb20d0-73669083-ddf3ec49_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:16.493014Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:16.493038Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2937
2025-10-10T14:39:16.493164Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2937 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:16.493210Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2937 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:16.493232Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2937 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:16.493236Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:16.494006Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2937 sessionId:  describe result for acl check
2025-10-10T14:39:16.494042Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:16.494049Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:16.494053Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:16.494059Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602674793850917:3958] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:16.494668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602674793850917:3958] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:16.499448Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602674793850917:3958] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:16.502933Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602674793850917:3958] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:16.502947Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602674793850917:3958] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:16.502951Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602674793850917:3958] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:16.502960Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2937 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:16.508187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:16.512686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:16.512941Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:16.512955Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:16.512979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:16.513041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:16.513085Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602674011610792:7394]
2025-10-10T14:39:16.513696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:16.514027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:16.514070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:16.514375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:16.514433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:16.514439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:16.514441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:16.514442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:16.514443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:16.514445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:16.514446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:16.514448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:16.514449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:16.514449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:16.514451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:16.514452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:16.514453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:16.514458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:16.514472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:16.514476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:16.514479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:16.514483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:16.514487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:16.514490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:16.514494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:16.514497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:16.514501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:16.514504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:16.514508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:16.514523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:16.514533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:16.514541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:16.514548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:16.514553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:16.514557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:16.514564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:16.514568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:16.514578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:16.514583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:16.514587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:16.514591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:16.514601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:16.514605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:16.514610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:16.514614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:16.514618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:16.514624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:16.514629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:16.514633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:16.514638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:16.514642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:16.514647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:16.514651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:16.514661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:16.514666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:16.514670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:16.514710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:16.517242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:16.517577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:16.517590Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:16.517593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:16.517596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:16.517603Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2936 [2:7559602674011610792:7394]
2025-10-10T14:39:16.517617Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:16.517636Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:16.517643Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:16.517647Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:16.517650Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:16.517667Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:16.517680Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:16.517688Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:16.517767Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:16.517775Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:16.517777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:16.517780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:16.517863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:16.517871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:16.517883Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:16.517900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:16.517923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:16.517947Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602674011610787:7394]
2025-10-10T14:39:16.517954Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602674011610787:7394]
2025-10-10T14:39:16.517956Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602674011610787:7394]
2025-10-10T14:39:16.517970Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:16.517985Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:16.517991Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:16.517996Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:16.517998Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:16.518007Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:16.518011Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:16.518034Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602674011610787:7394]
2025-10-10T14:39:16.518042Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:16.518110Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:16.518198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602674793850893:2438], now have 1 active actors on pipe
2025-10-10T14:39:16.518211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602674793851094:3958], now have 1 active actors on pipe
2025-10-10T14:39:16.518269Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2936
2025-10-10T14:39:16.518269Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2936
2025-10-10T14:39:16.518346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:16.518358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:16.518390Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|267765b7-6d7590cf-df03e48b-88a628ce_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:16.518404Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:16.518413Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:16.518416Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:16.518430Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:16.518447Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:16.518466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:16.518639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:16.518649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:16.518665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:16.518806Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2937 partition: 0 MaxSeqNo: 40 sessionId: src_id|267765b7-6d7590cf-df03e48b-88a628ce_0
2025-10-10T14:39:16.519242Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f74eb87-19bb20d0-73669083-ddf3ec49_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|267765b7-6d7590cf-df03e48b-88a628ce_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:16.521930Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|267765b7-6d7590cf-df03e48b-88a628ce_0] Write session: try to update token
2025-10-10T14:39:16.521947Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|267765b7-6d7590cf-df03e48b-88a628ce_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:16.536404Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2937 sessionId: src_id|267765b7-6d7590cf-df03e48b-88a628ce_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:16.537720Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:16.537737Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:16.537740Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:16.537741Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:16.537749Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602674011610787:7394]
2025-10-10T14:39:16.537751Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602674011610787:7394]
2025-10-10T14:39:16.537753Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602674011610787:7394]
2025-10-10T14:39:16.537797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:16.537810Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:16.537814Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:16.537926Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:16.537944Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:16.537950Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:16.537960Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:16.539028Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:16.583649Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602674793851173:4699]
2025-10-10T14:39:16.583923Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 pipe creation result: OK TabletId: 72075186224037892 Generation: 2936, pipe: [1:7559602674793851173:4699]
2025-10-10T14:39:16.655139Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:16.655700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:16.655719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:16.655768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602674793851173:4699], now have 1 active actors on pipe
2025-10-10T14:39:16.655990Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:16.656004Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:16.656027Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:16.656031Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:16.656077Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 35 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602674793851173:4699]
2025-10-10T14:39:16.656109Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2937 reason: error at write: Disconnected sessionId: src_id|267765b7-6d7590cf-df03e48b-88a628ce_0
2025-10-10T14:39:16.656341Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2937 sessionId: src_id|267765b7-6d7590cf-df03e48b-88a628ce_0 is DEAD
2025-10-10T14:39:16.656511Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|267765b7-6d7590cf-df03e48b-88a628ce_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:16.656524Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|267765b7-6d7590cf-df03e48b-88a628ce_0] Write session will restart in 0.006285s
2025-10-10T14:39:16.656549Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|267765b7-6d7590cf-df03e48b-88a628ce_0] Write session: Do CDS request
2025-10-10T14:39:16.656559Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|267765b7-6d7590cf-df03e48b-88a628ce_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:16.663929Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|267765b7-6d7590cf-df03e48b-88a628ce_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:16.664029Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:16.664043Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2938
2025-10-10T14:39:16.664157Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2938 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:16.664191Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2938 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:16.664202Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2938 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:16.664206Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:16.664678Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2938 sessionId:  describe result for acl check
2025-10-10T14:39:16.664722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:16.664730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:16.664732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:16.664739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602674793851191:3936] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:16.665416Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602674793851191:3936] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:16.668665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602674793851191:3936] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:16.672972Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602674793851191:3936] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:16.672989Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602674793851191:3936] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:16.672993Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602674793851191:3936] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:16.673003Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2938 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:16.683988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:16.684586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:16.684812Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:16.684823Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:16.684835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:16.684892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:16.684944Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602674011611082:7391]
2025-10-10T14:39:16.685698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:16.686067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:16.686125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:16.686502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:16.686567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:16.686575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:16.686576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:16.686578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:16.686579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:16.686581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:16.686582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:16.686583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:16.686585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:16.686586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:16.686587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:16.686589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:16.686591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:16.686597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:16.686611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:16.686616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:16.686620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:16.686624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:16.686628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:16.686632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:16.686636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:16.686639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:16.686644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:16.686647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:16.686652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:16.686656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:16.686668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:16.686682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:16.686693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:16.686703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:16.686714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:16.686723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:16.686731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:16.686739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:16.686749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:16.686759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:16.686764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:16.686770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:16.686774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:16.686784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:16.686788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:16.686793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:16.686798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:16.686803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:16.686812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:16.686817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:16.686825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:16.686830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:16.686839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:16.686845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:16.686855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:16.686864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:16.686907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:16.689450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:16.689781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:16.689797Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:16.689800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:16.689804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:16.689810Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2937 [2:7559602674011611082:7391]
2025-10-10T14:39:16.689824Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:16.689847Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:16.689856Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:16.689860Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:16.689863Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:16.689883Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:16.689892Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:16.689900Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:16.689965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:16.689974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:16.689976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:16.689979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:16.690063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:16.690071Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:16.690086Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:16.690098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:16.690123Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:16.690148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602674793851175:2438], now have 1 active actors on pipe
2025-10-10T14:39:16.690156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602674793851349:3936], now have 1 active actors on pipe
2025-10-10T14:39:16.690164Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602674011611077:7391]
2025-10-10T14:39:16.690167Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602674011611077:7391]
2025-10-10T14:39:16.690169Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602674011611077:7391]
2025-10-10T14:39:16.690180Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:16.690195Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:16.690201Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:16.690206Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:16.690208Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:16.690219Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:16.690223Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:16.690199Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2937
2025-10-10T14:39:16.690210Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2937
2025-10-10T14:39:16.690252Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602674011611077:7391]
2025-10-10T14:39:16.690269Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:16.690275Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:16.690704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:16.690720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:16.690783Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|99c6f37d-445b7e19-3e82f019-328cae34_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:16.690796Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:16.690806Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:16.690808Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:16.690820Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:16.690832Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:16.690851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:16.691024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:16.691033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:16.691052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:16.691134Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2938 partition: 0 MaxSeqNo: 40 sessionId: src_id|99c6f37d-445b7e19-3e82f019-328cae34_0
2025-10-10T14:39:16.691569Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|267765b7-6d7590cf-df03e48b-88a628ce_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|99c6f37d-445b7e19-3e82f019-328cae34_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:16.694226Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|99c6f37d-445b7e19-3e82f019-328cae34_0] Write session: try to update token
2025-10-10T14:39:16.694245Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|99c6f37d-445b7e19-3e82f019-328cae34_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:16.707998Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2938 sessionId: src_id|99c6f37d-445b7e19-3e82f019-328cae34_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:16.710666Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:16.711013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:16.711041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:16.711117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:39:16.711271Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:39:16.712959Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:16.712981Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:16.712984Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:16.712986Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:16.712996Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602674011611077:7391]
2025-10-10T14:39:16.713000Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602674011611077:7391]
2025-10-10T14:39:16.713004Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602674011611077:7391]
2025-10-10T14:39:16.713046Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:16.713053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:16.713060Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:16.713061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:16.713063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:16.713064Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:16.713220Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:16.756156Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602674793851469:4699]
2025-10-10T14:39:16.756461Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 pipe creation result: OK TabletId: 72075186224037892 Generation: 2937, pipe: [1:7559602674793851469:4699]
2025-10-10T14:39:16.833056Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:16.842824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:16.842859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:16.843055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:16.843127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:16.843201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:16.843273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:16.843323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:16.843334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:16.843407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:16.843482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:16.843551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:16.843621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:16.843669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:16.843677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:16.843749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:16.843815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:16.843886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:16.843954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:16.844001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:16.844009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:16.844080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:16.844147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:16.844229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:16.844299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:16.844351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:16.844359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:16.844426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:16.844488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:16.844553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:16.844622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:16.844670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:16.844682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:16.844754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:16.844818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:16.844896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:16.845005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:16.845070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:16.845081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:16.845199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:16.845307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:16.845441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:16.845553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:16.845615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:16.845623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:16.845698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:16.845765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:16.845830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:16.845898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:16.845958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:16.845969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:16.846041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:16.846106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:16.846176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:16.846242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:16.846291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:16.846299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:16.846367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:16.846432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:16.846499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:16.846578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:16.846628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:16.846631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:16.846955Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:16.846981Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:16.846985Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:16.847021Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 36 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602674793851469:4699]
2025-10-10T14:39:16.847026Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2938 reason: error at write: Disconnected sessionId: src_id|99c6f37d-445b7e19-3e82f019-328cae34_0
2025-10-10T14:39:16.847278Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2938 sessionId: src_id|99c6f37d-445b7e19-3e82f019-328cae34_0 is DEAD
2025-10-10T14:39:16.847447Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99c6f37d-445b7e19-3e82f019-328cae34_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:16.847459Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99c6f37d-445b7e19-3e82f019-328cae34_0] Write session will restart in 0.007852s
2025-10-10T14:39:16.847498Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99c6f37d-445b7e19-3e82f019-328cae34_0] Write session: Do CDS request
2025-10-10T14:39:16.847506Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99c6f37d-445b7e19-3e82f019-328cae34_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:16.846699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602674793851469:4699], now have 1 active actors on pipe
2025-10-10T14:39:16.848280Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:16.857008Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|99c6f37d-445b7e19-3e82f019-328cae34_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:16.857123Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:16.857141Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2939
2025-10-10T14:39:16.857274Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2939 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:16.857321Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2939 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:16.857352Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2939 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:16.857357Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:16.857804Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2939 sessionId:  describe result for acl check
2025-10-10T14:39:16.857839Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:16.857848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:16.857850Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:16.857857Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602674793851501:3904] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:16.858439Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602674793851501:3904] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:16.862277Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602674793851501:3904] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:16.866254Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602674793851501:3904] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:16.866270Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602674793851501:3904] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:16.866274Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602674793851501:3904] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:16.866283Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2939 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:16.871865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:16.876273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:16.876604Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:16.876617Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:16.876629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:16.876691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:16.876736Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602674011611361:7389]
2025-10-10T14:39:16.877437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:16.877723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:16.877764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:16.878113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:16.878179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:16.878186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:16.878187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:16.878188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:16.878189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:16.878191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:16.878192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:16.878193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:16.878195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:16.878196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:16.878197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:16.878198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:16.878200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:16.878205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:16.878219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:16.878223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:16.878227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:16.878232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:16.878236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:16.878240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:16.878244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:16.878247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:16.878252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:16.878256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:16.878261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:16.878265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:16.878275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:16.878284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:16.878290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:16.878295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:16.878300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:16.878305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:16.878309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:16.878314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:16.878319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:16.878324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:16.878328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:16.878333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:16.878338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:16.878343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:16.878348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:16.878354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:16.878359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:16.878371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:16.878375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:16.878381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:16.878386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:16.878393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:16.878398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:16.878408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:16.878413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:16.878418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:16.878463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:16.880871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:16.881780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:16.881794Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:16.881796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:16.881801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:16.881807Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2938 [2:7559602674011611361:7389]
2025-10-10T14:39:16.881821Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:16.881840Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:16.881843Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:16.881848Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:16.881850Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:16.881867Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:16.881875Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:16.881883Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:16.881946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:16.881956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:16.881958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:16.881961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:16.882028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:16.882035Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:16.882047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:16.882065Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:16.882088Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:16.882118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602674793851477:2438], now have 1 active actors on pipe
2025-10-10T14:39:16.882122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602674793851662:3904], now have 1 active actors on pipe
2025-10-10T14:39:16.882130Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602674011611356:7389]
2025-10-10T14:39:16.882132Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602674011611356:7389]
2025-10-10T14:39:16.882135Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602674011611356:7389]
2025-10-10T14:39:16.882152Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:16.882172Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:16.882187Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:16.882193Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:16.882197Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:16.882200Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:16.882202Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:16.882223Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602674011611356:7389]
2025-10-10T14:39:16.882227Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:16.882204Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2938
2025-10-10T14:39:16.882232Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:16.882205Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2938
2025-10-10T14:39:16.882266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:16.882277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:16.882310Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|368bba41-b7d56239-2530564c-731dfb6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:16.882322Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:16.882326Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:16.882329Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:16.882341Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:16.882356Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:16.882374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:16.882544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:16.882553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:16.882569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:16.882667Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2939 partition: 0 MaxSeqNo: 40 sessionId: src_id|368bba41-b7d56239-2530564c-731dfb6_0
2025-10-10T14:39:16.883126Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99c6f37d-445b7e19-3e82f019-328cae34_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|368bba41-b7d56239-2530564c-731dfb6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:16.886113Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|368bba41-b7d56239-2530564c-731dfb6_0] Write session: try to update token
2025-10-10T14:39:16.886132Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|368bba41-b7d56239-2530564c-731dfb6_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:16.901214Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:39:16.901234Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:16.901246Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602674011611356:7389]
2025-10-10T14:39:16.901298Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:39:16.901305Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:39:16.901507Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:39:16.901615Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2939 sessionId: src_id|368bba41-b7d56239-2530564c-731dfb6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:16.901651Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:16.901814Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:16.901974Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:16.902180Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:39:16.902222Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:39:16.904420Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:16.904692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:16.904726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:16.904766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:39:16.904867Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:39:16.913310Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:16.913348Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:16.913352Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:16.913355Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:16.913365Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602674011611356:7389]
2025-10-10T14:39:16.913369Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602674011611356:7389]
2025-10-10T14:39:16.913374Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602674011611356:7389]
2025-10-10T14:39:16.913424Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:16.913423Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:16.913429Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:16.913433Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:16.913436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:16.913439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:16.913581Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:16.947166Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602674793851762:4699]
2025-10-10T14:39:16.947505Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 pipe creation result: OK TabletId: 72075186224037892 Generation: 2938, pipe: [1:7559602674793851762:4699]
2025-10-10T14:39:17.031515Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:17.040879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:17.040914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:17.041099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:17.041169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:17.041261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:17.041363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:17.041414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:17.041423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:17.041503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:17.041572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:17.041642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:17.041726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:17.041785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:17.041793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:17.041873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:17.041939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:17.042013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:17.042087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:17.042137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:17.042145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:17.042228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:17.042307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:17.042376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:17.042447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:17.042497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:17.042506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:17.042575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:17.042644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:17.042712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:17.042783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:17.042834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:17.042841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:17.042914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:17.042982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:17.043052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:17.043130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:17.043180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:17.043186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:17.043259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:17.043327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:17.043401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:17.043470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:17.043520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:17.043532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:17.043603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:17.043668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:17.043740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:17.043808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:17.043855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:17.043861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:17.043932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:17.043993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:17.044065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:17.044137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:17.044189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:17.044200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:17.044273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:17.044339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:17.044405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:17.044477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:17.044524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:17.044530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:17.044595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602674793851762:4699], now have 1 active actors on pipe
2025-10-10T14:39:17.044833Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:17.044855Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:17.044860Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:17.044907Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2939 reason: error at write: Disconnected sessionId: src_id|368bba41-b7d56239-2530564c-731dfb6_0
2025-10-10T14:39:17.044907Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 37 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602674793851762:4699]
2025-10-10T14:39:17.045161Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2939 sessionId: src_id|368bba41-b7d56239-2530564c-731dfb6_0 is DEAD
2025-10-10T14:39:17.045314Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|368bba41-b7d56239-2530564c-731dfb6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:17.045351Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|368bba41-b7d56239-2530564c-731dfb6_0] Write session will restart in 0.006797s
2025-10-10T14:39:17.045383Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|368bba41-b7d56239-2530564c-731dfb6_0] Write session: Do CDS request
2025-10-10T14:39:17.045390Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|368bba41-b7d56239-2530564c-731dfb6_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:17.045941Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:17.053947Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|368bba41-b7d56239-2530564c-731dfb6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:17.054044Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:17.054065Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2940
2025-10-10T14:39:17.054218Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2940 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:17.054258Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2940 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:17.054269Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2940 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:17.054273Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:17.054759Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2940 sessionId:  describe result for acl check
2025-10-10T14:39:17.054802Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:17.054809Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:17.054812Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:17.054819Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602679088819076:3887] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:17.055774Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602679088819076:3887] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:17.059548Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602679088819076:3887] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:17.063447Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602679088819076:3887] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:17.063461Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602679088819076:3887] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:17.063464Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602679088819076:3887] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:17.063473Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2940 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:17.075548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:17.076315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:17.076755Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:17.076767Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:17.076779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:17.076845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:17.076878Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602678306578953:7387]
2025-10-10T14:39:17.077515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:17.077846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:17.077901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:17.078228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:17.078301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:17.078308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:17.078310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:17.078310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:17.078312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:17.078313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:17.078314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:17.078315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:17.078317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:17.078318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:17.078319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:17.078320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:17.078321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:17.078326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:17.078338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:17.078344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:17.078348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:17.078352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:17.078356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:17.078360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:17.078364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:17.078368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:17.078373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:17.078377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:17.078381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:17.078385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:17.078392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:17.078401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:17.078407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:17.078412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:17.078416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:17.078421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:17.078425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:17.078430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:17.078435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:17.078439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:17.078444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:17.078450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:17.078455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:17.078459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:17.078486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:17.078500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:17.078506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:17.078511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:17.078516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:17.078521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:17.078528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:17.078533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:17.078537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:17.078541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:17.078545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:17.078550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:17.078589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:17.081246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:17.082300Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2939
2025-10-10T14:39:17.082334Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2939
2025-10-10T14:39:17.081829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:17.081843Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:17.081845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:17.081849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:17.081856Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2939 [2:7559602678306578953:7387]
2025-10-10T14:39:17.081870Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:17.081890Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:17.081894Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:17.081898Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:17.081900Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:17.081919Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:17.081927Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:17.081936Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:17.082010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:17.082013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:17.082017Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:17.082020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:17.082095Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:17.082098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:17.082109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:17.082120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:17.082136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:17.082158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602679088819238:3887], now have 1 active actors on pipe
2025-10-10T14:39:17.082162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602679088819061:2438], now have 1 active actors on pipe
2025-10-10T14:39:17.082170Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602678306578948:7387]
2025-10-10T14:39:17.082173Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602678306578948:7387]
2025-10-10T14:39:17.082175Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602678306578948:7387]
2025-10-10T14:39:17.082187Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:17.082201Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:17.082212Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:17.082216Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:17.082218Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:17.082219Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:17.082223Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:17.082246Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602678306578948:7387]
2025-10-10T14:39:17.082254Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:17.082270Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:17.082564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:17.082578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:17.082612Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|51d9f2a6-b78787ba-8777daec-cf25837d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:17.082621Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:17.082626Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:17.082628Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:17.082641Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:17.082657Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:17.082679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:17.082942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:17.082958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:17.082985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:17.083094Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2940 partition: 0 MaxSeqNo: 40 sessionId: src_id|51d9f2a6-b78787ba-8777daec-cf25837d_0
2025-10-10T14:39:17.083582Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|368bba41-b7d56239-2530564c-731dfb6_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|51d9f2a6-b78787ba-8777daec-cf25837d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:17.086433Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|51d9f2a6-b78787ba-8777daec-cf25837d_0] Write session: try to update token
2025-10-10T14:39:17.086452Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|51d9f2a6-b78787ba-8777daec-cf25837d_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:17.104167Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2940 sessionId: src_id|51d9f2a6-b78787ba-8777daec-cf25837d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:17.105235Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:17.105253Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:17.105255Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:17.105259Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:17.105267Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602678306578948:7387]
2025-10-10T14:39:17.105269Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602678306578948:7387]
2025-10-10T14:39:17.105271Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602678306578948:7387]
2025-10-10T14:39:17.105316Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:17.105320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:17.105323Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:17.105327Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:17.105346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:17.105348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:17.105503Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:17.107094Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:17.144853Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602679088819369:4699]
2025-10-10T14:39:17.145138Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 pipe creation result: OK TabletId: 72075186224037892 Generation: 2939, pipe: [1:7559602679088819369:4699]
2025-10-10T14:39:17.228064Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:17.228545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:17.228565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:17.228630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602679088819369:4699], now have 1 active actors on pipe
2025-10-10T14:39:17.228888Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:17.228850Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:17.228850Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:17.228855Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:17.228916Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 38 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602679088819369:4699]
2025-10-10T14:39:17.228919Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2940 reason: error at write: Disconnected sessionId: src_id|51d9f2a6-b78787ba-8777daec-cf25837d_0
2025-10-10T14:39:17.229148Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2940 sessionId: src_id|51d9f2a6-b78787ba-8777daec-cf25837d_0 is DEAD
2025-10-10T14:39:17.229607Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51d9f2a6-b78787ba-8777daec-cf25837d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:17.229620Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51d9f2a6-b78787ba-8777daec-cf25837d_0] Write session will restart in 0.005813s
2025-10-10T14:39:17.229647Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51d9f2a6-b78787ba-8777daec-cf25837d_0] Write session: Do CDS request
2025-10-10T14:39:17.229653Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51d9f2a6-b78787ba-8777daec-cf25837d_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:17.236949Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|51d9f2a6-b78787ba-8777daec-cf25837d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:17.237108Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:17.237124Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2941
2025-10-10T14:39:17.237297Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2941 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:17.237354Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2941 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:17.237365Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2941 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:17.237370Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:17.237878Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2941 sessionId:  describe result for acl check
2025-10-10T14:39:17.238051Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:17.238059Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:17.238061Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:17.238076Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602679088819386:3844] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:17.238705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602679088819386:3844] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:17.241462Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602679088819386:3844] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:17.245557Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602679088819386:3844] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:17.245584Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602679088819386:3844] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:17.245588Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602679088819386:3844] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:17.245598Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2941 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:17.254387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:17.258396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:17.258656Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:17.258672Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:17.258697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:17.258761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:17.258807Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602678306579261:7354]
2025-10-10T14:39:17.259477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:17.259822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:17.259874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:17.260224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:17.260290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:17.260298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:17.260299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:17.260300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:17.260301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:17.260302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:17.260304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:17.260305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:17.260306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:17.260307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:17.260309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:17.260310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:17.260311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:17.260317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:17.260331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:17.260335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:17.260338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:17.260342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:17.260346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:17.260350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:17.260354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:17.260358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:17.260362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:17.260367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:17.260370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:17.260374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:17.260381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:17.260390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:17.260397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:17.260403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:17.260408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:17.260414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:17.260419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:17.260425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:17.260430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:17.260436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:17.260441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:17.260447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:17.260452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:17.260458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:17.260463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:17.260469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:17.260474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:17.260480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:17.260485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:17.260491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:17.260496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:17.260502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:17.260506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:17.260511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:17.260516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:17.260521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:17.260565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:17.263079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:17.263613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:17.263628Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:17.263631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:17.263634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:17.263642Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2940 [2:7559602678306579261:7354]
2025-10-10T14:39:17.263656Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:17.263674Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:17.263683Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:17.263686Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:17.263689Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:17.263721Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:17.263738Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:17.263747Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:17.263815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:17.263821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:17.263823Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:17.263826Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:17.263898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:17.263906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:17.263918Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:17.263930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:17.263948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:17.263975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602679088819371:2438], now have 1 active actors on pipe
2025-10-10T14:39:17.263994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602679088819510:3844], now have 1 active actors on pipe
2025-10-10T14:39:17.264004Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602678306579256:7354]
2025-10-10T14:39:17.264006Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602678306579256:7354]
2025-10-10T14:39:17.264008Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602678306579256:7354]
2025-10-10T14:39:17.264023Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:17.264033Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2940
2025-10-10T14:39:17.264038Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:17.264048Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2940
2025-10-10T14:39:17.264041Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:17.264050Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:17.264052Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:17.264060Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:17.264064Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:17.264088Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602678306579256:7354]
2025-10-10T14:39:17.264092Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:17.264095Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:17.264115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:17.264128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:17.264180Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|843f759a-b51ae16b-6e4442a7-aaa8eab6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:17.264193Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:17.264198Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:17.264206Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:17.264219Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:17.264238Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:17.264264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:17.264402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:17.264410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:17.264426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:17.264554Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2941 partition: 0 MaxSeqNo: 40 sessionId: src_id|843f759a-b51ae16b-6e4442a7-aaa8eab6_0
2025-10-10T14:39:17.265029Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51d9f2a6-b78787ba-8777daec-cf25837d_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|843f759a-b51ae16b-6e4442a7-aaa8eab6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:17.267875Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|843f759a-b51ae16b-6e4442a7-aaa8eab6_0] Write session: try to update token
2025-10-10T14:39:17.267892Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|843f759a-b51ae16b-6e4442a7-aaa8eab6_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:17.285919Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2941 sessionId: src_id|843f759a-b51ae16b-6e4442a7-aaa8eab6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:17.288642Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:17.287892Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:17.287916Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:17.287921Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:17.287923Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:17.287934Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602678306579256:7354]
2025-10-10T14:39:17.287938Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602678306579256:7354]
2025-10-10T14:39:17.287943Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602678306579256:7354]
2025-10-10T14:39:17.287997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:17.288005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:17.288008Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:17.288193Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:17.288777Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:17.288783Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:17.288788Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:17.329153Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602679088819656:4699]
2025-10-10T14:39:17.329729Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 pipe creation result: OK TabletId: 72075186224037892 Generation: 2940, pipe: [1:7559602679088819656:4699]
2025-10-10T14:39:17.407851Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:17.408804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:17.408820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:17.408865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602679088819656:4699], now have 1 active actors on pipe
2025-10-10T14:39:17.409097Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:17.412586Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|843f759a-b51ae16b-6e4442a7-aaa8eab6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:39:17.412609Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|843f759a-b51ae16b-6e4442a7-aaa8eab6_0] Write session will restart in 0.007604s
2025-10-10T14:39:17.412637Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|843f759a-b51ae16b-6e4442a7-aaa8eab6_0] Write session: Do CDS request
2025-10-10T14:39:17.412643Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|843f759a-b51ae16b-6e4442a7-aaa8eab6_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:17.412081Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:39:17.412177Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2941 reason: status is not ok: tablet will be restarted right now sessionId: src_id|843f759a-b51ae16b-6e4442a7-aaa8eab6_0
2025-10-10T14:39:17.412437Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2941 sessionId: src_id|843f759a-b51ae16b-6e4442a7-aaa8eab6_0 is DEAD
2025-10-10T14:39:17.412674Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:17.412714Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 39 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602679088819656:4699]
2025-10-10T14:39:17.422115Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|843f759a-b51ae16b-6e4442a7-aaa8eab6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:17.422553Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:17.422569Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2942
2025-10-10T14:39:17.423063Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2942 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:17.423106Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2942 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:17.423113Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2942 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:17.423123Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:17.423775Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2942 sessionId:  describe result for acl check
2025-10-10T14:39:17.423815Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:17.423824Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:17.423826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:17.423833Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602679088819706:3833] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:17.424445Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602679088819706:3833] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:17.430454Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602679088819706:3833] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:17.435999Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602679088819706:3833] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:17.436018Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602679088819706:3833] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:17.436021Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602679088819706:3833] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:17.436031Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2942 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:17.441276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:17.447401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:17.447687Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:17.447699Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:17.447711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:17.447770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:17.447818Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602678306579543:7363]
2025-10-10T14:39:17.448504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:17.448971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:17.449028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:17.449397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:17.449469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:17.449477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:17.449478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:17.449479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:17.449481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:17.449482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:17.449484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:17.449486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:17.449487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:17.449488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:17.449489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:17.449491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:17.449492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:17.449499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:17.449513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:17.449517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:17.449521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:17.449526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:17.449531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:17.449534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:17.449538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:17.449542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:17.449546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:17.449550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:17.449554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:17.449558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:17.449569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:17.449578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:17.449584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:17.449590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:17.449595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:17.449600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:17.449605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:17.449611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:17.449623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:17.449629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:17.449638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:17.449643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:17.449654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:17.449660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:17.449669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:17.449675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:17.449680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:17.449685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:17.449689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:17.449694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:17.449699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:17.449710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:17.449715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:17.449726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:17.449735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:17.449741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:17.449780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:17.453110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:17.453522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:17.453539Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:17.453541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:17.453545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:17.453552Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2941 [2:7559602678306579543:7363]
2025-10-10T14:39:17.453568Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:17.453589Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:17.453599Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:17.453604Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:17.453606Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:17.453625Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:17.453634Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:17.453644Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:17.453721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:17.453729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:17.453731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:17.453735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:17.454016Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2941
2025-10-10T14:39:17.454033Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2941
2025-10-10T14:39:17.454460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:17.454474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:17.454488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:17.454501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:17.454523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:17.454556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602679088819926:3833], now have 1 active actors on pipe
2025-10-10T14:39:17.454565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602679088819661:2438], now have 1 active actors on pipe
2025-10-10T14:39:17.454582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:17.454592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:17.454617Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602678306579538:7363]
2025-10-10T14:39:17.454624Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602678306579538:7363]
2025-10-10T14:39:17.454627Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602678306579538:7363]
2025-10-10T14:39:17.454642Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:17.454662Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:17.454663Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:17.454673Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:17.454675Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:17.454682Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:17.454686Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:17.454708Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5d1823d5-cd3f6cdf-2a1f9376-c09882f3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:17.454722Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:17.454731Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:17.454733Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:17.454746Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:17.454766Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:17.454820Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602678306579538:7363]
2025-10-10T14:39:17.454836Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:17.454842Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:17.454857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:17.455081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:17.455093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:17.455115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:17.455225Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2942 partition: 0 MaxSeqNo: 40 sessionId: src_id|5d1823d5-cd3f6cdf-2a1f9376-c09882f3_0
2025-10-10T14:39:17.455663Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|843f759a-b51ae16b-6e4442a7-aaa8eab6_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|5d1823d5-cd3f6cdf-2a1f9376-c09882f3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:17.458803Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5d1823d5-cd3f6cdf-2a1f9376-c09882f3_0] Write session: try to update token
2025-10-10T14:39:17.458825Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5d1823d5-cd3f6cdf-2a1f9376-c09882f3_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:17.470952Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:39:17.470978Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:17.470991Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602678306579538:7363]
2025-10-10T14:39:17.471047Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:39:17.471241Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:39:17.471394Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:17.471423Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:39:17.471544Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:17.471690Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:17.471890Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:39:17.471938Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:39:17.479715Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2942 sessionId: src_id|5d1823d5-cd3f6cdf-2a1f9376-c09882f3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:17.482719Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:17.483075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:17.483102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:17.483146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:39:17.483269Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:39:17.490572Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:17.490595Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:17.490600Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:17.490602Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:17.490613Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602678306579538:7363]
2025-10-10T14:39:17.490617Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602678306579538:7363]
2025-10-10T14:39:17.490622Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602678306579538:7363]
2025-10-10T14:39:17.490675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:17.490685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:17.490693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:17.490692Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:17.490702Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:17.490711Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:17.490833Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:17.512910Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602679088819942:4699]
2025-10-10T14:39:17.513315Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 pipe creation result: OK TabletId: 72075186224037892 Generation: 2941, pipe: [1:7559602679088819942:4699]
2025-10-10T14:39:17.611956Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:17.620911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:17.620946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:17.621132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:17.621210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:17.621276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:17.621360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:17.621406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:17.621416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:17.621494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:17.621558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:17.621625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:17.621700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:17.621746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:17.621754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:17.621825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:17.621894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:17.621966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:17.622039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:17.622085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:17.622092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:17.622174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:17.622253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:17.622316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:17.622385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:17.622530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:17.622539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:17.622612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:17.622676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:17.622748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:17.622820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:17.622867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:17.622874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:17.622943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:17.623011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:17.623072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:17.623136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:17.623183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:17.623191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:17.623271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:17.623341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:17.623418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:17.623484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:17.623626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:17.623636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:17.623712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:17.623778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:17.623847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:17.623913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:17.623958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:17.623966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:17.624039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:17.624101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:17.624168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:17.624236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:17.624372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:17.624383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:17.624452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:17.624514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:17.624582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:17.624647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:17.624690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:17.624696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:17.624760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602679088819942:4699], now have 1 active actors on pipe
2025-10-10T14:39:17.625527Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d1823d5-cd3f6cdf-2a1f9376-c09882f3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:17.625544Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d1823d5-cd3f6cdf-2a1f9376-c09882f3_0] Write session will restart in 0.008069s
2025-10-10T14:39:17.625065Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:17.625571Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d1823d5-cd3f6cdf-2a1f9376-c09882f3_0] Write session: Do CDS request
2025-10-10T14:39:17.625076Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 40 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602679088819942:4699]
2025-10-10T14:39:17.625592Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d1823d5-cd3f6cdf-2a1f9376-c09882f3_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:17.625080Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:17.625121Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:17.625125Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2942 reason: error at write: Disconnected sessionId: src_id|5d1823d5-cd3f6cdf-2a1f9376-c09882f3_0
2025-10-10T14:39:17.625378Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2942 sessionId: src_id|5d1823d5-cd3f6cdf-2a1f9376-c09882f3_0 is DEAD
2025-10-10T14:39:17.625966Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:17.634965Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5d1823d5-cd3f6cdf-2a1f9376-c09882f3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:17.635061Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:17.635079Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2943
2025-10-10T14:39:17.635199Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2943 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:17.635254Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2943 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:17.635267Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2943 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:17.635272Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:17.635827Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2943 sessionId:  describe result for acl check
2025-10-10T14:39:17.635872Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:17.635874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:17.635876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:17.635881Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602679088819959:3813] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:17.636501Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602679088819959:3813] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:17.640802Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602679088819959:3813] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:17.645221Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602679088819959:3813] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:17.645242Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602679088819959:3813] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:17.645246Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602679088819959:3813] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:17.645255Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2943 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:17.659686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:17.660561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:17.660841Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:17.660853Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:17.660867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:17.660937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:17.660988Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602678306579838:7355]
2025-10-10T14:39:17.661688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:17.662160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:17.662276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:17.662666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:17.662754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:17.662762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:17.662763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:17.662764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:17.662765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:17.662767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:17.662768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:17.662770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:17.662772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:17.662773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:17.662775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:17.662776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:17.662777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:17.662784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:17.662799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:17.662803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:17.662807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:17.662812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:17.662817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:17.662821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:17.662825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:17.662830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:17.662834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:17.662838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:17.662843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:17.662847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:17.662858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:17.662867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:17.662878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:17.662889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:17.662894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:17.662899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:17.662909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:17.662915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:17.662926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:17.662931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:17.662936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:17.662941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:17.662952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:17.662959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:17.662977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:17.662988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:17.662997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:17.663008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:17.663013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:17.663019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:17.663029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:17.663035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:17.663039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:17.663049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:17.663054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:17.663064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:17.663107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:17.665939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:17.666767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:17.666780Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:17.666784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:17.666788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:17.666795Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2942 [2:7559602678306579838:7355]
2025-10-10T14:39:17.666808Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:17.666828Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:17.666837Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:17.666841Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:17.666844Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:17.666864Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:17.666872Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:17.666882Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:17.666947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:17.666956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:17.666958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:17.666961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:17.667039Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:17.667047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:17.667061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:17.667073Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:17.667094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:17.667122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602679088819944:2438], now have 1 active actors on pipe
2025-10-10T14:39:17.667132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602679088820110:3813], now have 1 active actors on pipe
2025-10-10T14:39:17.667140Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602678306579833:7355]
2025-10-10T14:39:17.667143Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602678306579833:7355]
2025-10-10T14:39:17.667146Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602678306579833:7355]
2025-10-10T14:39:17.667158Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:17.667177Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:17.667177Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:17.667181Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:17.667183Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:17.667198Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:17.667202Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:17.667236Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602678306579833:7355]
2025-10-10T14:39:17.667245Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:17.667246Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:17.667198Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2942
2025-10-10T14:39:17.667274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:17.667281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:17.667322Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ab724fb4-a77d4da1-b39630b9-11768dc0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:17.667335Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:17.667339Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:17.667341Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:17.667353Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:17.667364Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:17.667388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:17.667455Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2942
2025-10-10T14:39:17.667510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:17.667518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:17.667535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:17.667674Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2943 partition: 0 MaxSeqNo: 40 sessionId: src_id|ab724fb4-a77d4da1-b39630b9-11768dc0_0
2025-10-10T14:39:17.668167Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d1823d5-cd3f6cdf-2a1f9376-c09882f3_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|ab724fb4-a77d4da1-b39630b9-11768dc0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:17.671099Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ab724fb4-a77d4da1-b39630b9-11768dc0_0] Write session: try to update token
2025-10-10T14:39:17.671121Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ab724fb4-a77d4da1-b39630b9-11768dc0_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:17.686549Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2943 sessionId: src_id|ab724fb4-a77d4da1-b39630b9-11768dc0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:17.688901Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:17.688929Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:17.688933Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:17.688935Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:17.688946Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602678306579833:7355]
2025-10-10T14:39:17.688953Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602678306579833:7355]
2025-10-10T14:39:17.688963Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602678306579833:7355]
2025-10-10T14:39:17.689021Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:17.689032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:17.689039Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:17.689041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:17.689043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:17.689044Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:17.689251Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:17.690147Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:17.725440Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602679088820243:4699]
2025-10-10T14:39:17.725804Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 pipe creation result: OK TabletId: 72075186224037892 Generation: 2942, pipe: [1:7559602679088820243:4699]
2025-10-10T14:39:17.807269Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:17.808083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:17.808105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:17.808151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602679088820243:4699], now have 1 active actors on pipe
2025-10-10T14:39:17.808416Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:17.808440Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:17.808502Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:39:17.808617Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2943 reason: status is not ok: tablet will be restarted right now sessionId: src_id|ab724fb4-a77d4da1-b39630b9-11768dc0_0
2025-10-10T14:39:17.808704Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 41 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602679088820243:4699]
2025-10-10T14:39:17.808931Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2943 sessionId: src_id|ab724fb4-a77d4da1-b39630b9-11768dc0_0 is DEAD
2025-10-10T14:39:17.809058Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab724fb4-a77d4da1-b39630b9-11768dc0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:39:17.809071Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab724fb4-a77d4da1-b39630b9-11768dc0_0] Write session will restart in 0.005387s
2025-10-10T14:39:17.809099Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab724fb4-a77d4da1-b39630b9-11768dc0_0] Write session: Do CDS request
2025-10-10T14:39:17.809105Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab724fb4-a77d4da1-b39630b9-11768dc0_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:17.815928Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ab724fb4-a77d4da1-b39630b9-11768dc0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:17.816026Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:17.816050Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2944
2025-10-10T14:39:17.816188Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2944 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:17.816227Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2944 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:17.816238Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2944 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:17.816242Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:17.816738Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2944 sessionId:  describe result for acl check
2025-10-10T14:39:17.816786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:17.816793Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:17.816795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:17.816801Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602679088820263:3798] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:17.817410Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602679088820263:3798] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:17.820074Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602679088820263:3798] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:17.823911Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602679088820263:3798] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:17.823927Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602679088820263:3798] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:17.823931Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602679088820263:3798] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:17.823942Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2944 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:17.833477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:17.839012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:17.839309Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:17.839330Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:17.839347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:17.839428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:17.839487Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602678306580122:7359]
2025-10-10T14:39:17.840172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:17.840575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:17.840662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:17.841042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:17.841136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:17.841150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:17.841151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:17.841153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:17.841154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:17.841156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:17.841157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:17.841170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:17.841171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:17.841172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:17.841174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:17.841175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:17.841176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:17.841184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:17.841199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:17.841204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:17.841209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:17.841213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:17.841218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:17.841223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:17.841227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:17.841231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:17.841237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:17.841241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:17.841246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:17.841251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:17.841271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:17.841299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:17.841316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:17.841352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:17.841368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:17.841386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:17.841400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:17.841420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:17.841436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:17.841443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:17.841448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:17.841454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:17.841461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:17.841467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:17.841474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:17.841480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:17.841485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:17.841491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:17.841506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:17.841513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:17.841524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:17.841531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:17.841541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:17.841547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:17.841552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:17.841557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:17.841601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:17.844569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:17.844926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:17.844940Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:17.844942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:17.844947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:17.844955Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2943 [2:7559602678306580122:7359]
2025-10-10T14:39:17.844971Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:17.844992Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:17.845000Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:17.845004Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:17.845007Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:17.845027Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:17.845039Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:17.845052Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:17.845122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:17.845130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:17.845132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:17.845135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:17.845369Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:17.845379Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:17.845394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:17.845376Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2943
2025-10-10T14:39:17.845378Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2943
2025-10-10T14:39:17.845414Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:17.845442Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:17.845468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602679088820364:3798], now have 1 active actors on pipe
2025-10-10T14:39:17.845478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602679088820248:2438], now have 1 active actors on pipe
2025-10-10T14:39:17.845500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:17.845511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:17.845532Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602678306580117:7359]
2025-10-10T14:39:17.845539Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602678306580117:7359]
2025-10-10T14:39:17.845542Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602678306580117:7359]
2025-10-10T14:39:17.845557Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:17.845573Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:17.845578Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:17.845582Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:17.845584Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:17.845596Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:17.845605Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:17.845628Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|58cd509a-eda39690-49aa7489-500bec28_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:17.845641Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:17.845646Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:17.845649Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:17.845661Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:17.845678Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:17.845721Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602678306580117:7359]
2025-10-10T14:39:17.845734Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:17.845743Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:17.845753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:17.845928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:17.845941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:17.845959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:17.846050Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2944 partition: 0 MaxSeqNo: 40 sessionId: src_id|58cd509a-eda39690-49aa7489-500bec28_0
2025-10-10T14:39:17.846486Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab724fb4-a77d4da1-b39630b9-11768dc0_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|58cd509a-eda39690-49aa7489-500bec28_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:17.849243Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|58cd509a-eda39690-49aa7489-500bec28_0] Write session: try to update token
2025-10-10T14:39:17.849266Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|58cd509a-eda39690-49aa7489-500bec28_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:17.857940Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:39:17.857961Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:17.857973Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602678306580117:7359]
2025-10-10T14:39:17.858029Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:39:17.858030Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:39:17.858232Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:39:17.858389Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:17.858536Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:17.858681Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:17.858919Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:39:17.858970Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:39:17.864452Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2944 sessionId: src_id|58cd509a-eda39690-49aa7489-500bec28_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:17.867087Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:17.867359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:17.867385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:17.867429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:39:17.867541Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:39:17.876528Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:17.876551Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:17.876554Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:17.876556Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:17.876569Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602678306580117:7359]
2025-10-10T14:39:17.876573Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602678306580117:7359]
2025-10-10T14:39:17.876577Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602678306580117:7359]
2025-10-10T14:39:17.876623Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:17.876628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:17.876630Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:17.876636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:17.876639Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:17.876648Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:17.876771Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:17.908687Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602679088820543:4699]
2025-10-10T14:39:17.909117Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 pipe creation result: OK TabletId: 72075186224037892 Generation: 2943, pipe: [1:7559602679088820543:4699]
2025-10-10T14:39:17.996969Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:18.006261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:18.006303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:18.006511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:18.006595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:18.006679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:18.006765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:18.006820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:18.006830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:18.006910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:18.006978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:18.007051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:18.007126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:18.007175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:18.007184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:18.007260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:18.007330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:18.007396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:18.007460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:18.007509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:18.007516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:18.007595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:18.007673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:18.007748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:18.007827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:18.007882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:18.007889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:18.007960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:18.008030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:18.008098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:18.008166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:18.008213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:18.008221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:18.008297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:18.008370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:18.008439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:18.008513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:18.008566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:18.008576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:18.008652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:18.008720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:18.008791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:18.008859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:18.008908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:18.008916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:18.008990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:18.009057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:18.009124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:18.009202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:18.009252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:18.009261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:18.009371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:18.009440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:18.009516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:18.009587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:18.009636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:18.009644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:18.009715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:18.009779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:18.009854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:18.009924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:18.009972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:18.009979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:18.010051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602679088820543:4699], now have 1 active actors on pipe
2025-10-10T14:39:18.010324Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:18.010342Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:18.010346Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:18.010385Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2944 reason: error at write: Disconnected sessionId: src_id|58cd509a-eda39690-49aa7489-500bec28_0
2025-10-10T14:39:18.010400Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 42 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602679088820543:4699]
2025-10-10T14:39:18.010651Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2944 sessionId: src_id|58cd509a-eda39690-49aa7489-500bec28_0 is DEAD
2025-10-10T14:39:18.010869Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58cd509a-eda39690-49aa7489-500bec28_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:18.010881Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58cd509a-eda39690-49aa7489-500bec28_0] Write session will restart in 0.009847s
2025-10-10T14:39:18.010910Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58cd509a-eda39690-49aa7489-500bec28_0] Write session: Do CDS request
2025-10-10T14:39:18.010916Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58cd509a-eda39690-49aa7489-500bec28_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:18.011514Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:18.021975Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|58cd509a-eda39690-49aa7489-500bec28_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:18.022036Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:18.022055Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2945
2025-10-10T14:39:18.022198Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2945 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:18.022250Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2945 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:18.022260Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2945 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:18.022265Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:18.023156Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2945 sessionId:  describe result for acl check
2025-10-10T14:39:18.023194Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:18.023200Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:18.023204Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:18.023211Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602683383787869:3792] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:18.023823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602683383787869:3792] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:18.028144Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602683383787869:3792] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:18.033174Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602683383787869:3792] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:18.033191Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602683383787869:3792] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:18.033195Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602683383787869:3792] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:18.033206Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2945 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:18.039692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:18.046434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:18.047374Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:18.047391Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:18.047407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:18.047479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:18.047536Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602682601547703:7357]
2025-10-10T14:39:18.048251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:18.048657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:18.048725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:18.049092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:18.049187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:18.049194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:18.049196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:18.049197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:18.049199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:18.049200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:18.049202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:18.049203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:18.049205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:18.049206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:18.049217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:18.049218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:18.049221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:18.049226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:18.049238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:18.049242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:18.049246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:18.049250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:18.049255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:18.049259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:18.049263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:18.049267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:18.049271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:18.049284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:18.049288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:18.049297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:18.049306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:18.049319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:18.049347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:18.049353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:18.049357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:18.049362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:18.049370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:18.049376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:18.049381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:18.049387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:18.049403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:18.049413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:18.049419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:18.049428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:18.049433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:18.049443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:18.049447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:18.049453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:18.049458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:18.049463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:18.049468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:18.049474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:18.049484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:18.049489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:18.049494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:18.049502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:18.049553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:18.052469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:18.052925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:18.052951Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:18.052954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:18.052959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:18.052966Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2944 [2:7559602682601547703:7357]
2025-10-10T14:39:18.052980Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:18.053004Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:18.053012Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:18.053015Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:18.053018Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:18.053033Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:18.053045Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:18.053052Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:18.053115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:18.053123Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:18.053125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:18.053128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:18.053215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:18.053224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:18.053237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:18.053252Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:18.053272Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:18.053297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602683383788045:3792], now have 1 active actors on pipe
2025-10-10T14:39:18.053305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602683383787844:2438], now have 1 active actors on pipe
2025-10-10T14:39:18.053313Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602682601547698:7357]
2025-10-10T14:39:18.053315Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602682601547698:7357]
2025-10-10T14:39:18.053318Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602682601547698:7357]
2025-10-10T14:39:18.053351Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:18.053364Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:18.053369Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:18.053371Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:18.053371Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:18.053387Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:18.053390Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:18.053427Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602682601547698:7357]
2025-10-10T14:39:18.053436Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:18.053447Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:18.053426Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2944
2025-10-10T14:39:18.053429Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2944
2025-10-10T14:39:18.053477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:18.053486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:18.053518Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ebb5059e-fcfccd48-b0d04bf6-a6a3ee9a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:18.053531Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:18.053535Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:18.053538Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:18.053549Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:18.053560Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:18.053575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:18.053743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:18.053752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:18.053768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:18.053928Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2945 partition: 0 MaxSeqNo: 40 sessionId: src_id|ebb5059e-fcfccd48-b0d04bf6-a6a3ee9a_0
2025-10-10T14:39:18.054358Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58cd509a-eda39690-49aa7489-500bec28_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|ebb5059e-fcfccd48-b0d04bf6-a6a3ee9a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:18.057405Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ebb5059e-fcfccd48-b0d04bf6-a6a3ee9a_0] Write session: try to update token
2025-10-10T14:39:18.057427Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ebb5059e-fcfccd48-b0d04bf6-a6a3ee9a_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:18.075421Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:18.075451Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:18.075455Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:18.075458Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:18.075470Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602682601547698:7357]
2025-10-10T14:39:18.075475Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602682601547698:7357]
2025-10-10T14:39:18.075481Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602682601547698:7357]
2025-10-10T14:39:18.075538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:18.075547Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:18.075553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:18.075556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:18.075557Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:18.075562Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:18.075740Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:18.076675Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2945 sessionId: src_id|ebb5059e-fcfccd48-b0d04bf6-a6a3ee9a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:18.079544Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:18.110425Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602683383788129:4699]
2025-10-10T14:39:18.110808Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 pipe creation result: OK TabletId: 72075186224037892 Generation: 2944, pipe: [1:7559602683383788129:4699]
2025-10-10T14:39:18.199265Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:18.199976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:18.199991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:18.200045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602683383788129:4699], now have 1 active actors on pipe
2025-10-10T14:39:18.200304Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:18.200365Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:18.200371Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 43 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602683383788129:4699]
2025-10-10T14:39:18.200388Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:18.200398Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:18.200495Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2945 reason: error at write: Disconnected sessionId: src_id|ebb5059e-fcfccd48-b0d04bf6-a6a3ee9a_0
2025-10-10T14:39:18.200691Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2945 sessionId: src_id|ebb5059e-fcfccd48-b0d04bf6-a6a3ee9a_0 is DEAD
2025-10-10T14:39:18.200923Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ebb5059e-fcfccd48-b0d04bf6-a6a3ee9a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:18.200935Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ebb5059e-fcfccd48-b0d04bf6-a6a3ee9a_0] Write session will restart in 0.006854s
2025-10-10T14:39:18.200963Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ebb5059e-fcfccd48-b0d04bf6-a6a3ee9a_0] Write session: Do CDS request
2025-10-10T14:39:18.200974Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ebb5059e-fcfccd48-b0d04bf6-a6a3ee9a_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:18.208989Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ebb5059e-fcfccd48-b0d04bf6-a6a3ee9a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:18.209094Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:18.209111Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2946
2025-10-10T14:39:18.209997Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2946 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:18.210057Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2946 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:18.210070Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2946 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:18.210075Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:18.210595Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2946 sessionId:  describe result for acl check
2025-10-10T14:39:18.210639Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:18.210641Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:18.210643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:18.210649Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602683383788178:3753] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:18.211307Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602683383788178:3753] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:18.213846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602683383788178:3753] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:18.218384Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602683383788178:3753] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:18.218399Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602683383788178:3753] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:18.218403Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602683383788178:3753] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:18.218412Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2946 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:18.234341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:18.234965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:18.235172Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:18.235185Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:18.235195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:18.235243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:18.235300Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602682601548031:7328]
2025-10-10T14:39:18.236044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:18.236356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:18.236413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:18.236761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:18.236843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:18.236850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:18.236852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:18.236853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:18.236855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:18.236856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:18.236858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:18.236859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:18.236860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:18.236862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:18.236863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:18.236865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:18.236866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:18.236873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:18.236886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:18.236891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:18.236896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:18.236900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:18.236904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:18.236909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:18.236914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:18.236918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:18.236923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:18.236927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:18.236932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:18.236936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:18.236944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:18.236953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:18.236960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:18.236967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:18.236972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:18.236978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:18.236987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:18.236992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:18.237000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:18.237006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:18.237013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:18.237019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:18.237024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:18.237035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:18.237040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:18.237051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:18.237059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:18.237068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:18.237074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:18.237080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:18.237089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:18.237095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:18.237103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:18.237108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:18.237131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:18.237141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:18.237201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:18.239689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:18.240981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:18.241005Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:18.241008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:18.241013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:18.241020Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2945 [2:7559602682601548031:7328]
2025-10-10T14:39:18.241039Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:18.241062Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:18.241066Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:18.241070Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:18.241072Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:18.241092Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:18.241101Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:18.241116Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:18.241218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:18.241226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:18.241228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:18.241231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:18.241313Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:18.241324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:18.241356Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:18.241366Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:18.241382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:18.241412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602683383788289:3753], now have 1 active actors on pipe
2025-10-10T14:39:18.241424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602683383788159:2438], now have 1 active actors on pipe
2025-10-10T14:39:18.241432Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602682601548026:7328]
2025-10-10T14:39:18.241438Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602682601548026:7328]
2025-10-10T14:39:18.241440Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602682601548026:7328]
2025-10-10T14:39:18.241458Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:18.241475Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:18.241479Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:18.241479Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:18.241482Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:18.241495Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:18.241498Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:18.241500Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2945
2025-10-10T14:39:18.241535Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602682601548026:7328]
2025-10-10T14:39:18.241545Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:18.241549Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:18.241812Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2945
2025-10-10T14:39:18.241861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:18.241874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:18.241908Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|98324a89-592095ad-c1b74880-84d35e3f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:18.241924Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:18.241929Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:18.241932Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:18.241944Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:18.241956Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:18.241974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:18.242188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:18.242200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:18.242216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:18.242310Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2946 partition: 0 MaxSeqNo: 40 sessionId: src_id|98324a89-592095ad-c1b74880-84d35e3f_0
2025-10-10T14:39:18.242761Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ebb5059e-fcfccd48-b0d04bf6-a6a3ee9a_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|98324a89-592095ad-c1b74880-84d35e3f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:18.245622Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|98324a89-592095ad-c1b74880-84d35e3f_0] Write session: try to update token
2025-10-10T14:39:18.245641Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|98324a89-592095ad-c1b74880-84d35e3f_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:18.253888Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:39:18.253907Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:18.253920Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602682601548026:7328]
2025-10-10T14:39:18.253976Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:39:18.253985Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:39:18.254261Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:39:18.254492Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:18.254723Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:18.254947Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:18.255207Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:39:18.255258Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:39:18.260224Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2946 sessionId: src_id|98324a89-592095ad-c1b74880-84d35e3f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:18.262891Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:18.263319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:18.263343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:18.263378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:39:18.263474Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:39:18.272440Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:18.272461Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:18.272464Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:18.272465Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:18.272474Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602682601548026:7328]
2025-10-10T14:39:18.272478Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602682601548026:7328]
2025-10-10T14:39:18.272481Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602682601548026:7328]
2025-10-10T14:39:18.272524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:18.272535Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:18.272536Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:18.272545Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:18.272553Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:18.272559Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:18.272667Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:18.300369Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602683383788445:4699]
2025-10-10T14:39:18.300635Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 pipe creation result: OK TabletId: 72075186224037892 Generation: 2945, pipe: [1:7559602683383788445:4699]
2025-10-10T14:39:18.387605Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:18.396420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:18.396454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:18.396642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:18.396720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:18.396797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:18.396875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:18.397293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:18.397312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:18.397427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:18.397509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:18.397585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:18.397662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:18.397710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:18.397718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:18.397798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:18.397870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:18.397940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:18.398012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:18.398061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:18.398070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:18.398139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:18.398211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:18.398279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:18.398349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:18.398400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:18.398408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:18.398474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:18.398543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:18.398616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:18.398683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:18.398728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:18.398736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:18.398808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:18.398874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:18.398946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:18.399019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:18.399067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:18.399075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:18.399145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:18.399211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:18.399288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:18.399381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:18.399430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:18.399440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:18.399514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:18.399582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:18.399651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:18.399725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:18.399772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:18.399779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:18.399846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:18.399905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:18.399964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:18.400026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:18.400075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:18.400083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:18.400147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:18.400212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:18.400279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:18.400346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:18.400390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:18.400398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:18.400470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602683383788445:4699], now have 1 active actors on pipe
2025-10-10T14:39:18.400666Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:18.400677Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 44 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602683383788445:4699]
2025-10-10T14:39:18.400716Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:18.400719Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:18.400760Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2946 reason: error at write: Disconnected sessionId: src_id|98324a89-592095ad-c1b74880-84d35e3f_0
2025-10-10T14:39:18.401054Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2946 sessionId: src_id|98324a89-592095ad-c1b74880-84d35e3f_0 is DEAD
2025-10-10T14:39:18.401181Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98324a89-592095ad-c1b74880-84d35e3f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:18.401195Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98324a89-592095ad-c1b74880-84d35e3f_0] Write session will restart in 0.009154s
2025-10-10T14:39:18.401234Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98324a89-592095ad-c1b74880-84d35e3f_0] Write session: Do CDS request
2025-10-10T14:39:18.401241Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98324a89-592095ad-c1b74880-84d35e3f_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:18.401220Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:18.411964Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|98324a89-592095ad-c1b74880-84d35e3f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:18.412032Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:18.412060Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2947
2025-10-10T14:39:18.412276Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2947 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:18.412336Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2947 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:18.412343Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2947 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:18.412347Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:18.412889Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2947 sessionId:  describe result for acl check
2025-10-10T14:39:18.412928Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:18.412930Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:18.412933Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:18.412939Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602683383788488:3741] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:18.413572Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602683383788488:3741] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:18.417646Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602683383788488:3741] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:18.422916Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602683383788488:3741] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:18.422935Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602683383788488:3741] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:18.422939Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602683383788488:3741] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:18.422949Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2947 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:18.428199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:18.433440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:18.434227Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:18.434248Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:18.434269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:18.434371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:18.434423Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602682601548318:7330]
2025-10-10T14:39:18.435103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:18.435609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:18.435694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:18.436096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:18.436181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:18.436188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:18.436190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:18.436191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:18.436193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:18.436195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:18.436196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:18.436198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:18.436199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:18.436200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:18.436202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:18.436203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:18.436205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:18.436213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:18.436227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:18.436231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:18.436249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:18.436253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:18.436258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:18.436262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:18.436265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:18.436269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:18.436274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:18.436278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:18.436283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:18.436287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:18.436296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:18.436306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:18.436314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:18.436320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:18.436324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:18.436330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:18.436335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:18.436341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:18.436346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:18.436352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:18.436357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:18.436363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:18.436368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:18.436373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:18.436392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:18.436407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:18.436411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:18.436417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:18.436422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:18.436429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:18.436433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:18.436439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:18.436444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:18.436450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:18.436454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:18.436460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:18.436508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:18.439485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:18.439863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:18.439878Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:18.439881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:18.439885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:18.439895Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2946 [2:7559602682601548318:7330]
2025-10-10T14:39:18.439909Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:18.439930Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:18.439937Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:18.439941Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:18.439943Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:18.439964Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:18.439972Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:18.439983Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:18.440070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:18.440077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:18.440080Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:18.440083Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:18.440166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:18.440175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:18.440187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:18.440203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:18.440234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:18.440264Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602682601548313:7330]
2025-10-10T14:39:18.440271Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602682601548313:7330]
2025-10-10T14:39:18.440274Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602682601548313:7330]
2025-10-10T14:39:18.440284Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:18.440297Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:18.440299Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:18.440315Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:18.440319Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:18.440327Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:18.440331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602683383788448:2438], now have 1 active actors on pipe
2025-10-10T14:39:18.440335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602683383788656:3741], now have 1 active actors on pipe
2025-10-10T14:39:18.440337Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:18.440367Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602682601548313:7330]
2025-10-10T14:39:18.440382Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:18.440404Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:18.445963Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2946
2025-10-10T14:39:18.445967Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2946
2025-10-10T14:39:18.446115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:18.446139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:18.446184Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a05efb23-75be3e38-1c6f81c6-3d8bd0b5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:18.446203Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:18.446216Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:18.446219Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:18.446237Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:18.446260Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:18.446306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:18.446626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:18.446638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:18.446658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:18.446900Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2947 partition: 0 MaxSeqNo: 40 sessionId: src_id|a05efb23-75be3e38-1c6f81c6-3d8bd0b5_0
2025-10-10T14:39:18.447369Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98324a89-592095ad-c1b74880-84d35e3f_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|a05efb23-75be3e38-1c6f81c6-3d8bd0b5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:18.450263Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a05efb23-75be3e38-1c6f81c6-3d8bd0b5_0] Write session: try to update token
2025-10-10T14:39:18.450284Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a05efb23-75be3e38-1c6f81c6-3d8bd0b5_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:18.465589Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2947 sessionId: src_id|a05efb23-75be3e38-1c6f81c6-3d8bd0b5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:18.467478Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:18.467499Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:18.467502Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:18.467505Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:18.467516Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602682601548313:7330]
2025-10-10T14:39:18.467521Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602682601548313:7330]
2025-10-10T14:39:18.467525Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602682601548313:7330]
2025-10-10T14:39:18.467577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:18.467585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:18.467588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:18.467602Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:18.467639Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:18.467646Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:18.467725Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:18.468307Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:18.501655Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602683383788739:4699]
2025-10-10T14:39:18.502055Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 pipe creation result: OK TabletId: 72075186224037892 Generation: 2946, pipe: [1:7559602683383788739:4699]
2025-10-10T14:39:18.581698Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:18.582612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:18.582628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:18.582674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602683383788739:4699], now have 1 active actors on pipe
2025-10-10T14:39:18.582884Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:18.582910Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 45 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602683383788739:4699]
2025-10-10T14:39:18.582941Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:18.582945Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:39:18.583045Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2947 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a05efb23-75be3e38-1c6f81c6-3d8bd0b5_0
2025-10-10T14:39:18.583259Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2947 sessionId: src_id|a05efb23-75be3e38-1c6f81c6-3d8bd0b5_0 is DEAD
2025-10-10T14:39:18.583453Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a05efb23-75be3e38-1c6f81c6-3d8bd0b5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:39:18.583464Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a05efb23-75be3e38-1c6f81c6-3d8bd0b5_0] Write session will restart in 0.007273s
2025-10-10T14:39:18.583500Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a05efb23-75be3e38-1c6f81c6-3d8bd0b5_0] Write session: Do CDS request
2025-10-10T14:39:18.583506Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a05efb23-75be3e38-1c6f81c6-3d8bd0b5_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:18.591896Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a05efb23-75be3e38-1c6f81c6-3d8bd0b5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:18.591983Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:18.591999Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2948
2025-10-10T14:39:18.592124Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2948 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:18.592169Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2948 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:18.592179Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2948 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:18.592183Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:18.592619Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2948 sessionId:  describe result for acl check
2025-10-10T14:39:18.592654Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:18.592658Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:18.592659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:18.592665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602683383788765:3724] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:18.593167Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602683383788765:3724] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:18.595748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602683383788765:3724] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:18.599655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602683383788765:3724] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:18.599669Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602683383788765:3724] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:18.599672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602683383788765:3724] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:18.599681Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2948 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:18.609738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:18.610352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:18.610586Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:18.610597Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:18.610609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:18.610668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:18.610719Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602682601548618:7321]
2025-10-10T14:39:18.611335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:18.611634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:18.611680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:18.611965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:18.612022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:18.612029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:18.612030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:18.612031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:18.612032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:18.612033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:18.612034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:18.612035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:18.612036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:18.612037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:18.612039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:18.612039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:18.612040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:18.612045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:18.612060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:18.612064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:18.612068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:18.612072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:18.612076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:18.612079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:18.612083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:18.612087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:18.612091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:18.612095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:18.612098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:18.612100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:18.612107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:18.612113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:18.612117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:18.612121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:18.612124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:18.612127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:18.612130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:18.612133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:18.612136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:18.612139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:18.612142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:18.612145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:18.612148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:18.612151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:18.612154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:18.612157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:18.612160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:18.612162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:18.612165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:18.612168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:18.612170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:18.612173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:18.612175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:18.612178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:18.612181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:18.612184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:18.612206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:18.614510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:18.614933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:18.614943Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:18.614945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:18.614949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:18.614956Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2947 [2:7559602682601548618:7321]
2025-10-10T14:39:18.614969Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:18.614998Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:18.615006Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:18.615009Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:18.615011Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:18.615028Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:18.615040Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:18.615050Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:18.615107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:18.615114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:18.615116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:18.615118Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:18.615181Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:18.615188Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:18.615199Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:18.615209Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:18.615230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:18.615257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602683383788914:3724], now have 1 active actors on pipe
2025-10-10T14:39:18.615265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602683383788741:2438], now have 1 active actors on pipe
2025-10-10T14:39:18.615272Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602682601548613:7321]
2025-10-10T14:39:18.615274Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602682601548613:7321]
2025-10-10T14:39:18.615277Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602682601548613:7321]
2025-10-10T14:39:18.615290Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:18.615309Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:18.615311Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:18.615314Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:18.615316Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:18.615329Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:18.615333Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:18.615355Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602682601548613:7321]
2025-10-10T14:39:18.615362Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:18.615347Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2947
2025-10-10T14:39:18.615372Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:18.615348Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2947
2025-10-10T14:39:18.615393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:18.615403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:18.615438Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f6f1f7-c88b6c35-2d61c9e5-b797839d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:18.615449Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:18.615453Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:18.615458Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:18.615468Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:18.615483Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:18.615500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:18.615725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:18.615734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:18.615751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:18.615858Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2948 partition: 0 MaxSeqNo: 40 sessionId: src_id|f6f1f7-c88b6c35-2d61c9e5-b797839d_0
2025-10-10T14:39:18.616281Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a05efb23-75be3e38-1c6f81c6-3d8bd0b5_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|f6f1f7-c88b6c35-2d61c9e5-b797839d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:18.618987Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f6f1f7-c88b6c35-2d61c9e5-b797839d_0] Write session: try to update token
2025-10-10T14:39:18.619004Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f6f1f7-c88b6c35-2d61c9e5-b797839d_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:18.633653Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2948 sessionId: src_id|f6f1f7-c88b6c35-2d61c9e5-b797839d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:18.634275Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:18.634296Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:18.634299Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:18.634302Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:18.634312Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602682601548613:7321]
2025-10-10T14:39:18.634316Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602682601548613:7321]
2025-10-10T14:39:18.634321Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602682601548613:7321]
2025-10-10T14:39:18.634366Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:18.634372Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:18.634373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:18.634375Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:18.634382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:18.634384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:18.634523Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:18.636472Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:18.682865Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602683383789033:4699]
2025-10-10T14:39:18.683187Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 pipe creation result: OK TabletId: 72075186224037892 Generation: 2947, pipe: [1:7559602683383789033:4699]
2025-10-10T14:39:18.755541Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:18.756523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:18.756541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:18.756589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602683383789033:4699], now have 1 active actors on pipe
2025-10-10T14:39:18.756810Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:18.756849Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:18.756866Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:18.756943Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2948 reason: error at write: Disconnected sessionId: src_id|f6f1f7-c88b6c35-2d61c9e5-b797839d_0
2025-10-10T14:39:18.756985Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:18.757059Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 46 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602683383789033:4699]
2025-10-10T14:39:18.757215Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2948 sessionId: src_id|f6f1f7-c88b6c35-2d61c9e5-b797839d_0 is DEAD
2025-10-10T14:39:18.757413Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f6f1f7-c88b6c35-2d61c9e5-b797839d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:18.757425Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f6f1f7-c88b6c35-2d61c9e5-b797839d_0] Write session will restart in 0.006768s
2025-10-10T14:39:18.757462Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f6f1f7-c88b6c35-2d61c9e5-b797839d_0] Write session: Do CDS request
2025-10-10T14:39:18.757469Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f6f1f7-c88b6c35-2d61c9e5-b797839d_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:18.766055Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f6f1f7-c88b6c35-2d61c9e5-b797839d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:18.766231Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:18.766250Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2949
2025-10-10T14:39:18.766389Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2949 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:18.766426Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2949 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:18.766433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2949 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:18.766437Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:18.766960Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2949 sessionId:  describe result for acl check
2025-10-10T14:39:18.766999Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:18.767005Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:18.767007Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:18.767014Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602683383789065:3719] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:18.767623Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602683383789065:3719] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:18.771553Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602683383789065:3719] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:18.775183Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602683383789065:3719] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:18.775198Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602683383789065:3719] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:18.775202Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602683383789065:3719] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:18.775212Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2949 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:18.781190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:18.785813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:18.786042Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:18.786054Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:18.786065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:18.786135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:18.786182Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602682601548907:7314]
2025-10-10T14:39:18.786807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:18.787096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:18.787139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:18.787455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:18.787512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:18.787518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:18.787520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:18.787521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:18.787522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:18.787524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:18.787525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:18.787526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:18.787527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:18.787529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:18.787530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:18.787531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:18.787532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:18.787538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:18.787550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:18.787553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:18.787557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:18.787560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:18.787563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:18.787566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:18.787570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:18.787573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:18.787577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:18.787581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:18.787585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:18.787589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:18.787598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:18.787607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:18.787613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:18.787619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:18.787624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:18.787629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:18.787634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:18.787639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:18.787644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:18.787649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:18.787654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:18.787659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:18.787664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:18.787669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:18.787673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:18.787678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:18.787683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:18.787688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:18.787693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:18.787698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:18.787703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:18.787708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:18.787713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:18.787719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:18.787724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:18.787728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:18.787770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:18.790238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:18.790547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:18.790561Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:18.790563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:18.790568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:18.790574Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2948 [2:7559602682601548907:7314]
2025-10-10T14:39:18.790586Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:18.790605Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:18.790615Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:18.790618Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:18.790621Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:18.790638Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:18.790646Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:18.790655Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:18.790718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:18.790724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:18.790726Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:18.790729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:18.790796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:18.790805Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:18.790816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:18.790829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:18.790852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:18.790878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602683383789046:2438], now have 1 active actors on pipe
2025-10-10T14:39:18.790883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602683383789224:3719], now have 1 active actors on pipe
2025-10-10T14:39:18.790891Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602682601548902:7314]
2025-10-10T14:39:18.790898Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602682601548902:7314]
2025-10-10T14:39:18.790901Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602682601548902:7314]
2025-10-10T14:39:18.790915Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:18.790930Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:18.790929Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:18.790932Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:18.790934Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:18.790951Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:18.790955Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:18.790937Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2948
2025-10-10T14:39:18.790952Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2948
2025-10-10T14:39:18.790976Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602682601548902:7314]
2025-10-10T14:39:18.790984Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:18.790985Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:18.791012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:18.791021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:18.791495Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ee22e9f-a02e6dcb-976402fe-36f2cb9a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:18.791511Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:18.791515Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:18.791517Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:18.791529Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:18.791540Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:18.791570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:18.791780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:18.791789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:18.791806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:18.791915Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2949 partition: 0 MaxSeqNo: 40 sessionId: src_id|ee22e9f-a02e6dcb-976402fe-36f2cb9a_0
2025-10-10T14:39:18.792348Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f6f1f7-c88b6c35-2d61c9e5-b797839d_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|ee22e9f-a02e6dcb-976402fe-36f2cb9a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:18.795060Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ee22e9f-a02e6dcb-976402fe-36f2cb9a_0] Write session: try to update token
2025-10-10T14:39:18.795078Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ee22e9f-a02e6dcb-976402fe-36f2cb9a_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:18.809850Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2949 sessionId: src_id|ee22e9f-a02e6dcb-976402fe-36f2cb9a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:18.812511Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:18.812736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:18.812762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:18.812815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:39:18.812907Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:39:18.816042Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:18.816064Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:18.816068Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:18.816070Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:18.816081Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602682601548902:7314]
2025-10-10T14:39:18.816087Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602682601548902:7314]
2025-10-10T14:39:18.816092Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602682601548902:7314]
2025-10-10T14:39:18.816145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:18.816154Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:18.816160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:18.816161Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:18.816163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:18.816165Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:18.816371Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:18.857439Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602683383789345:4699]
2025-10-10T14:39:18.857732Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 pipe creation result: OK TabletId: 72075186224037892 Generation: 2948, pipe: [1:7559602683383789345:4699]
2025-10-10T14:39:18.933567Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:18.942166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:18.942195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:18.942377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:18.942446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:18.942520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:18.942601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:18.942655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:18.942664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:18.942743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:18.942813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:18.942882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:18.942952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:18.943000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:18.943008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:18.943075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:18.943141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:18.943206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:18.943273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:18.943322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:18.943331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:18.943403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:18.943470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:18.943538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:18.943604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:18.943647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:18.943654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:18.943725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:18.943790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:18.943852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:18.943916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:18.943964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:18.943972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:18.944043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:18.944105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:18.944174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:18.944241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:18.944288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:18.944298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:18.944368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:18.944434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:18.944508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:18.944575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:18.944621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:18.944628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:18.944705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:18.944770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:18.944837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:18.944904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:18.944947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:18.944955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:18.945028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:18.945093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:18.945168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:18.945238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:18.945286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:18.945294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:18.945385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:18.945450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:18.945518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:18.945590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:18.945636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:18.945643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:18.945710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602683383789345:4699], now have 1 active actors on pipe
2025-10-10T14:39:18.945969Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:18.946000Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:18.946006Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:18.946036Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 47 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602683383789345:4699]
2025-10-10T14:39:18.946048Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2949 reason: error at write: Disconnected sessionId: src_id|ee22e9f-a02e6dcb-976402fe-36f2cb9a_0
2025-10-10T14:39:18.946287Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2949 sessionId: src_id|ee22e9f-a02e6dcb-976402fe-36f2cb9a_0 is DEAD
2025-10-10T14:39:18.946436Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ee22e9f-a02e6dcb-976402fe-36f2cb9a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:18.946449Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ee22e9f-a02e6dcb-976402fe-36f2cb9a_0] Write session will restart in 0.006321s
2025-10-10T14:39:18.946487Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ee22e9f-a02e6dcb-976402fe-36f2cb9a_0] Write session: Do CDS request
2025-10-10T14:39:18.946493Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ee22e9f-a02e6dcb-976402fe-36f2cb9a_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:18.946973Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:18.954413Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ee22e9f-a02e6dcb-976402fe-36f2cb9a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:18.954476Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:18.954493Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2950
2025-10-10T14:39:18.954684Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2950 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:18.954737Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2950 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:18.954748Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2950 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:18.954752Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:18.955235Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2950 sessionId:  describe result for acl check
2025-10-10T14:39:18.955273Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:18.955281Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:18.955292Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:18.955299Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602683383789368:3676] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:18.955875Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602683383789368:3676] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:18.959223Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602683383789368:3676] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:18.964338Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602683383789368:3676] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:18.964358Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602683383789368:3676] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:18.964362Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602683383789368:3676] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:18.964374Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2950 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:18.976770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:18.977373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:18.977568Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:18.977579Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:18.977591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:18.977638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:18.977685Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602682601549197:7304]
2025-10-10T14:39:18.978354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:18.978674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:18.978727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:18.979061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:18.979123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:18.979129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:18.979130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:18.979132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:18.979133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:18.979135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:18.979136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:18.979137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:18.979139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:18.979141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:18.979142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:18.979143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:18.979145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:18.979151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:18.979165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:18.979170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:18.979175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:18.979180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:18.979185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:18.979189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:18.979193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:18.979198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:18.979203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:18.979208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:18.979212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:18.979217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:18.979225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:18.979234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:18.979246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:18.979253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:18.979262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:18.979269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:18.979278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:18.979284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:18.979290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:18.979296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:18.979300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:18.979306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:18.979313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:18.979324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:18.979328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:18.979334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:18.979343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:18.979350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:18.979359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:18.979365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:18.979379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:18.979390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:18.979396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:18.979405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:18.979410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:18.979421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:18.979464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:18.982000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:18.982776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:18.982792Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:18.982795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:18.982799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:18.982805Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2949 [2:7559602682601549197:7304]
2025-10-10T14:39:18.982818Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:18.982836Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:18.982844Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:18.982847Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:18.982850Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:18.982868Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:18.982875Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:18.982888Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:18.982949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:18.982960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:18.982961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:18.982964Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:18.983040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:18.983048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:18.983061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:18.983074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:18.983094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:18.983120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602683383789479:3676], now have 1 active actors on pipe
2025-10-10T14:39:18.983129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602683383789350:2438], now have 1 active actors on pipe
2025-10-10T14:39:18.983137Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602682601549192:7304]
2025-10-10T14:39:18.983139Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602682601549192:7304]
2025-10-10T14:39:18.983142Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602682601549192:7304]
2025-10-10T14:39:18.983155Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:18.983168Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:18.983171Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:18.983173Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:18.983175Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:18.983192Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:18.983195Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:18.983188Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2949
2025-10-10T14:39:18.983192Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2949
2025-10-10T14:39:18.983217Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602682601549192:7304]
2025-10-10T14:39:18.983228Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:18.983230Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:18.983246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:18.983252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:18.983306Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|64237159-edb2296b-985c379-41890e16_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:18.983319Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:18.983324Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:18.983331Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:18.983342Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:18.983354Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:18.983376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:18.983550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:18.983558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:18.983572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:18.983677Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2950 partition: 0 MaxSeqNo: 40 sessionId: src_id|64237159-edb2296b-985c379-41890e16_0
2025-10-10T14:39:18.984077Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ee22e9f-a02e6dcb-976402fe-36f2cb9a_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|64237159-edb2296b-985c379-41890e16_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:18.986860Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|64237159-edb2296b-985c379-41890e16_0] Write session: try to update token
2025-10-10T14:39:18.986880Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|64237159-edb2296b-985c379-41890e16_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:19.001680Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2950 sessionId: src_id|64237159-edb2296b-985c379-41890e16_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:19.003080Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:19.003100Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:19.003103Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:19.003105Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:19.003115Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602682601549192:7304]
2025-10-10T14:39:19.003119Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602682601549192:7304]
2025-10-10T14:39:19.003123Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602682601549192:7304]
2025-10-10T14:39:19.003172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:19.003173Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:19.003179Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:19.003180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:19.003183Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:19.003183Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:19.003322Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:19.004415Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:19.046375Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602687678756940:4699]
2025-10-10T14:39:19.046696Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 pipe creation result: OK TabletId: 72075186224037892 Generation: 2949, pipe: [1:7559602687678756940:4699]
2025-10-10T14:39:19.117775Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:19.118382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:19.118400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:19.118445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602687678756940:4699], now have 1 active actors on pipe
2025-10-10T14:39:19.118663Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:19.118731Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:19.118756Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:19.118831Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2950 reason: error at write: Disconnected sessionId: src_id|64237159-edb2296b-985c379-41890e16_0
2025-10-10T14:39:19.118937Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:19.118994Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 48 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602687678756940:4699]
2025-10-10T14:39:19.119064Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2950 sessionId: src_id|64237159-edb2296b-985c379-41890e16_0 is DEAD
2025-10-10T14:39:19.119244Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64237159-edb2296b-985c379-41890e16_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:19.119253Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64237159-edb2296b-985c379-41890e16_0] Write session will restart in 0.009655s
2025-10-10T14:39:19.119277Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64237159-edb2296b-985c379-41890e16_0] Write session: Do CDS request
2025-10-10T14:39:19.119288Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64237159-edb2296b-985c379-41890e16_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:19.129989Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|64237159-edb2296b-985c379-41890e16_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:19.130043Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:19.130078Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2951
2025-10-10T14:39:19.130264Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2951 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:19.130304Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2951 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:19.130335Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2951 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:19.130339Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:19.130919Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2951 sessionId:  describe result for acl check
2025-10-10T14:39:19.130964Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:19.130971Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:19.130973Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:19.130980Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602687678756986:3680] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:19.131607Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602687678756986:3680] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:19.135478Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602687678756986:3680] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:19.142573Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602687678756986:3680] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:19.142592Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602687678756986:3680] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:19.142596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602687678756986:3680] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:19.142608Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2951 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:19.143165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:19.148428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:19.148735Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:19.148749Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:19.148764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:19.148839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:19.148890Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602686896516784:7296]
2025-10-10T14:39:19.149594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:19.150033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:19.150117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:19.150495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:19.150572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:19.150580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:19.150582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:19.150583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:19.150585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:19.150586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:19.150588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:19.150590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:19.150591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:19.150593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:19.150594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:19.150596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:19.150598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:19.150605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:19.150621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:19.150626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:19.150631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:19.150636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:19.150640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:19.150645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:19.150650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:19.150655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:19.150660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:19.150665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:19.150670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:19.150674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:19.150684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:19.150694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:19.150701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:19.150708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:19.150713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:19.150729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:19.150734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:19.150739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:19.150745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:19.150751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:19.150756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:19.150767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:19.150773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:19.150779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:19.150789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:19.150795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:19.150800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:19.150806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:19.150810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:19.150817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:19.150828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:19.150835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:19.150844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:19.150850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:19.150861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:19.150871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:19.150921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:19.153740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:19.154077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:19.154091Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:19.154094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:19.154099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:19.154106Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2950 [2:7559602686896516784:7296]
2025-10-10T14:39:19.154132Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:19.154152Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:19.154155Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:19.154159Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:19.154161Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:19.154180Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:19.154193Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:19.154206Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:19.154276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:19.154283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:19.154286Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:19.154289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:19.154366Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:19.154377Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:19.154391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:19.154415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:19.154437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:19.154465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602687678756942:2438], now have 1 active actors on pipe
2025-10-10T14:39:19.154474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602687678757225:3680], now have 1 active actors on pipe
2025-10-10T14:39:19.154482Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602686896516779:7296]
2025-10-10T14:39:19.154495Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602686896516779:7296]
2025-10-10T14:39:19.154497Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602686896516779:7296]
2025-10-10T14:39:19.154512Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:19.154527Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:19.154531Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:19.154540Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:19.154543Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:19.154546Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:19.154549Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:19.154527Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2950
2025-10-10T14:39:19.154576Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602686896516779:7296]
2025-10-10T14:39:19.154579Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:19.154552Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2950
2025-10-10T14:39:19.154600Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:19.155241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:19.155261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:19.155309Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e853d65e-a1245d62-9fd20313-d5e358ff_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:19.155323Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:19.155333Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:19.155336Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:19.155351Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:19.155369Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:19.155390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:19.155584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:19.155593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:19.155607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:19.155722Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2951 partition: 0 MaxSeqNo: 40 sessionId: src_id|e853d65e-a1245d62-9fd20313-d5e358ff_0
2025-10-10T14:39:19.156220Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64237159-edb2296b-985c379-41890e16_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|e853d65e-a1245d62-9fd20313-d5e358ff_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:19.159103Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e853d65e-a1245d62-9fd20313-d5e358ff_0] Write session: try to update token
2025-10-10T14:39:19.159122Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e853d65e-a1245d62-9fd20313-d5e358ff_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:19.175556Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2951 sessionId: src_id|e853d65e-a1245d62-9fd20313-d5e358ff_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:19.176565Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:19.176592Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:19.176596Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:19.176598Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:19.176607Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602686896516779:7296]
2025-10-10T14:39:19.176611Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602686896516779:7296]
2025-10-10T14:39:19.176615Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602686896516779:7296]
2025-10-10T14:39:19.176666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:19.176674Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:19.176680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:19.176680Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:19.176682Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:19.176684Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:19.176824Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:19.178360Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:19.219381Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602687678757250:4699]
2025-10-10T14:39:19.219700Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 pipe creation result: OK TabletId: 72075186224037892 Generation: 2950, pipe: [1:7559602687678757250:4699]
2025-10-10T14:39:19.295989Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:19.296405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:19.296423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:19.296472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602687678757250:4699], now have 1 active actors on pipe
2025-10-10T14:39:19.297311Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e853d65e-a1245d62-9fd20313-d5e358ff_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:39:19.297325Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e853d65e-a1245d62-9fd20313-d5e358ff_0] Write session will restart in 0.005484s
2025-10-10T14:39:19.296718Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:19.297365Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e853d65e-a1245d62-9fd20313-d5e358ff_0] Write session: Do CDS request
2025-10-10T14:39:19.297395Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e853d65e-a1245d62-9fd20313-d5e358ff_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:19.296729Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:19.296800Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:39:19.296895Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2951 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e853d65e-a1245d62-9fd20313-d5e358ff_0
2025-10-10T14:39:19.297060Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 49 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602687678757250:4699]
2025-10-10T14:39:19.297130Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2951 sessionId: src_id|e853d65e-a1245d62-9fd20313-d5e358ff_0 is DEAD
2025-10-10T14:39:19.303920Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e853d65e-a1245d62-9fd20313-d5e358ff_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:19.304315Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:19.304331Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2952
2025-10-10T14:39:19.304460Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2952 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:19.304497Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2952 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:19.304508Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2952 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:19.304512Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:19.304926Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2952 sessionId:  describe result for acl check
2025-10-10T14:39:19.304962Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:19.304968Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:19.304970Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:19.304976Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602687678757278:3642] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:19.305608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602687678757278:3642] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:19.308935Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602687678757278:3642] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:19.313543Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602687678757278:3642] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:19.313562Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602687678757278:3642] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:19.313566Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602687678757278:3642] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:19.313577Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2952 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:19.324619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:19.330244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:19.330526Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:19.330551Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:19.330564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:19.330623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:19.330672Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602686896517116:7274]
2025-10-10T14:39:19.331402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:19.331808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:19.331854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:19.332199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:19.332258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:19.332265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:19.332266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:19.332268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:19.332269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:19.332271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:19.332273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:19.332274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:19.332276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:19.332278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:19.332280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:19.332281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:19.332283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:19.332289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:19.332304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:19.332310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:19.332314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:19.332319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:19.332324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:19.332329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:19.332333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:19.332338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:19.332343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:19.332348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:19.332353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:19.332358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:19.332366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:19.332376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:19.332384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:19.332390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:19.332396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:19.332403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:19.332408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:19.332414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:19.332429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:19.332435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:19.332441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:19.332447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:19.332455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:19.332461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:19.332466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:19.332473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:19.332478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:19.332484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:19.332489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:19.332496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:19.332501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:19.332508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:19.332513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:19.332519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:19.332524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:19.332530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:19.332590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:19.336885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:19.337387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:19.337406Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:19.337409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:19.337413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:19.337420Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2951 [2:7559602686896517116:7274]
2025-10-10T14:39:19.337435Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:19.337459Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:19.337463Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:19.337466Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:19.337469Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:19.337489Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:19.337503Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:19.337517Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:19.337595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:19.337606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:19.337608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:19.337611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:19.337693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:19.337703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:19.337717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:19.337730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:19.337755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:19.337785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602687678757262:2438], now have 1 active actors on pipe
2025-10-10T14:39:19.337799Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602686896517111:7274]
2025-10-10T14:39:19.337801Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602686896517111:7274]
2025-10-10T14:39:19.337804Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602686896517111:7274]
2025-10-10T14:39:19.337820Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:19.337833Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:19.337836Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:19.337837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602687678757390:3642], now have 1 active actors on pipe
2025-10-10T14:39:19.337838Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:19.337847Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:19.337868Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:19.337879Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:19.337866Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2951
2025-10-10T14:39:19.337930Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602686896517111:7274]
2025-10-10T14:39:19.337931Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2951
2025-10-10T14:39:19.337945Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:19.337954Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:19.338173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:19.338186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:19.338219Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3721ef6a-ed00b598-9220c43e-6d585c96_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:19.338234Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:19.338245Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:19.338247Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:19.338259Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:19.338273Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:19.338290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:19.338480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:19.338488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:19.338505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:19.338644Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2952 partition: 0 MaxSeqNo: 40 sessionId: src_id|3721ef6a-ed00b598-9220c43e-6d585c96_0
2025-10-10T14:39:19.339092Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e853d65e-a1245d62-9fd20313-d5e358ff_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|3721ef6a-ed00b598-9220c43e-6d585c96_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:19.341895Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3721ef6a-ed00b598-9220c43e-6d585c96_0] Write session: try to update token
2025-10-10T14:39:19.341915Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3721ef6a-ed00b598-9220c43e-6d585c96_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:19.358215Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2952 sessionId: src_id|3721ef6a-ed00b598-9220c43e-6d585c96_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:19.359138Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:19.359164Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:19.359168Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:19.359171Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:19.359180Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602686896517111:7274]
2025-10-10T14:39:19.359185Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602686896517111:7274]
2025-10-10T14:39:19.359191Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602686896517111:7274]
2025-10-10T14:39:19.359246Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:19.359250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:19.359257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:19.359260Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:19.359262Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:19.359267Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:19.359407Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:19.360927Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:19.396553Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602687678757559:4699]
2025-10-10T14:39:19.396757Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 pipe creation result: OK TabletId: 72075186224037892 Generation: 2951, pipe: [1:7559602687678757559:4699]
2025-10-10T14:39:19.479483Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:19.479795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:19.479814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:19.479862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602687678757559:4699], now have 1 active actors on pipe
2025-10-10T14:39:19.480142Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:19.480164Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 50 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602687678757559:4699]
2025-10-10T14:39:19.480172Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:19.480177Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:19.480196Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:19.480246Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2952 reason: error at write: Disconnected sessionId: src_id|3721ef6a-ed00b598-9220c43e-6d585c96_0
2025-10-10T14:39:19.480494Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2952 sessionId: src_id|3721ef6a-ed00b598-9220c43e-6d585c96_0 is DEAD
2025-10-10T14:39:19.480627Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3721ef6a-ed00b598-9220c43e-6d585c96_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:19.480641Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3721ef6a-ed00b598-9220c43e-6d585c96_0] Write session will restart in 0.007085s
2025-10-10T14:39:19.480668Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3721ef6a-ed00b598-9220c43e-6d585c96_0] Write session: Do CDS request
2025-10-10T14:39:19.480681Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3721ef6a-ed00b598-9220c43e-6d585c96_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:19.488969Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3721ef6a-ed00b598-9220c43e-6d585c96_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:19.489096Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:19.489113Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2953
2025-10-10T14:39:19.489227Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2953 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:19.489258Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2953 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:19.489264Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2953 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:19.489268Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:19.489804Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2953 sessionId:  describe result for acl check
2025-10-10T14:39:19.489837Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:19.489839Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:19.489844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:19.489855Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602687678757580:3631] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:19.490430Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602687678757580:3631] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:19.497949Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602687678757580:3631] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:19.505818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:19.509808Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602687678757580:3631] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:19.509829Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602687678757580:3631] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:19.509834Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602687678757580:3631] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:19.509844Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2953 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:19.510738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:19.511015Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:19.511029Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:19.511043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:19.511107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:19.511161Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602686896517408:7273]
2025-10-10T14:39:19.511789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:19.512131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:19.512201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:19.512539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:19.512615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:19.512622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:19.512623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:19.512625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:19.512626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:19.512628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:19.512629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:19.512631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:19.512632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:19.512633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:19.512635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:19.512636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:19.512638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:19.512644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:19.512659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:19.512664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:19.512669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:19.512674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:19.512679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:19.512683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:19.512688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:19.512693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:19.512698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:19.512702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:19.512707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:19.512712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:19.512720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:19.512737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:19.512749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:19.512760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:19.512765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:19.512772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:19.512777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:19.512783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:19.512789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:19.512795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:19.512810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:19.512816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:19.512821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:19.512827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:19.512833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:19.512838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:19.512844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:19.512850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:19.512855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:19.512861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:19.512866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:19.512872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:19.512882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:19.512888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:19.512893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:19.512904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:19.512950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:19.515518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:19.515994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:19.516013Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:19.516015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:19.516020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:19.516027Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2952 [2:7559602686896517408:7273]
2025-10-10T14:39:19.516041Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:19.516060Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:19.516069Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:19.516073Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:19.516076Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:19.516094Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:19.516102Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:19.516115Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:19.516181Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:19.516191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:19.516193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:19.516197Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:19.516290Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:19.516301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:19.516314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:19.516328Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:19.516348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:19.516372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602687678757562:2438], now have 1 active actors on pipe
2025-10-10T14:39:19.516376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602687678757847:3631], now have 1 active actors on pipe
2025-10-10T14:39:19.516385Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602686896517402:7273]
2025-10-10T14:39:19.516387Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602686896517402:7273]
2025-10-10T14:39:19.516390Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602686896517402:7273]
2025-10-10T14:39:19.516407Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:19.516419Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:19.516423Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:19.516424Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:19.516425Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:19.516443Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:19.516446Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:19.516476Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602686896517402:7273]
2025-10-10T14:39:19.516486Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:19.516488Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:19.516459Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2952
2025-10-10T14:39:19.516479Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2952
2025-10-10T14:39:19.516508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:19.516518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:19.516577Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b1b7b76-392cecde-e96fe80a-b49b6d0d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:19.516592Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:19.516596Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:19.516600Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:19.516612Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:19.516624Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:19.516644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:19.516868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:19.516883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:19.516910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:19.517074Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2953 partition: 0 MaxSeqNo: 40 sessionId: src_id|b1b7b76-392cecde-e96fe80a-b49b6d0d_0
2025-10-10T14:39:19.517576Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3721ef6a-ed00b598-9220c43e-6d585c96_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|b1b7b76-392cecde-e96fe80a-b49b6d0d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:19.520885Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b1b7b76-392cecde-e96fe80a-b49b6d0d_0] Write session: try to update token
2025-10-10T14:39:19.520905Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b1b7b76-392cecde-e96fe80a-b49b6d0d_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:19.538390Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:19.538413Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:19.538417Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:19.538419Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:19.538430Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602686896517402:7273]
2025-10-10T14:39:19.538435Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602686896517402:7273]
2025-10-10T14:39:19.538439Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602686896517402:7273]
2025-10-10T14:39:19.538491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:19.538495Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:19.538500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:19.538502Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:19.538503Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:19.538508Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:19.538644Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:19.539330Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2953 sessionId: src_id|b1b7b76-392cecde-e96fe80a-b49b6d0d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:19.542444Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:19.580383Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602687678757858:4699]
2025-10-10T14:39:19.580715Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 pipe creation result: OK TabletId: 72075186224037892 Generation: 2952, pipe: [1:7559602687678757858:4699]
2025-10-10T14:39:19.655900Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:19.656196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:19.656212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:19.656259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602687678757858:4699], now have 1 active actors on pipe
2025-10-10T14:39:19.656675Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:19.656555Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:19.656594Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:19.656599Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:19.656619Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 51 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602687678757858:4699]
2025-10-10T14:39:19.656664Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2953 reason: error at write: Disconnected sessionId: src_id|b1b7b76-392cecde-e96fe80a-b49b6d0d_0
2025-10-10T14:39:19.656877Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2953 sessionId: src_id|b1b7b76-392cecde-e96fe80a-b49b6d0d_0 is DEAD
2025-10-10T14:39:19.657548Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1b7b76-392cecde-e96fe80a-b49b6d0d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:19.657560Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1b7b76-392cecde-e96fe80a-b49b6d0d_0] Write session will restart in 0.008506s
2025-10-10T14:39:19.657586Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1b7b76-392cecde-e96fe80a-b49b6d0d_0] Write session: Do CDS request
2025-10-10T14:39:19.657595Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1b7b76-392cecde-e96fe80a-b49b6d0d_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:19.666951Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b1b7b76-392cecde-e96fe80a-b49b6d0d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:19.667123Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:19.667146Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2954
2025-10-10T14:39:19.667306Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2954 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:19.667360Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2954 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:19.667373Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2954 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:19.667378Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:19.667856Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2954 sessionId:  describe result for acl check
2025-10-10T14:39:19.667900Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:19.667902Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:19.667904Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:19.667911Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602687678757891:3621] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:19.668567Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602687678757891:3621] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:19.672307Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602687678757891:3621] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:19.678480Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602687678757891:3621] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:19.678502Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602687678757891:3621] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:19.678507Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602687678757891:3621] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:19.678516Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2954 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:19.686749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:19.691957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:19.692204Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:19.692219Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:19.692233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:19.692297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:19.692356Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602686896517713:7263]
2025-10-10T14:39:19.693030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:19.693415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:19.693458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:19.693778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:19.693844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:19.693853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:19.693854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:19.693855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:19.693857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:19.693858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:19.693859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:19.693860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:19.693862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:19.693863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:19.693864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:19.693865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:19.693867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:19.693872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:19.693885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:19.693890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:19.693894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:19.693898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:19.693902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:19.693906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:19.693910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:19.693914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:19.693919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:19.693924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:19.693928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:19.693932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:19.693940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:19.693949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:19.693956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:19.693961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:19.693966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:19.693971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:19.693976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:19.693981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:19.693986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:19.693991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:19.693997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:19.694002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:19.694007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:19.694012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:19.694017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:19.694022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:19.694027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:19.694032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:19.694045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:19.694051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:19.694056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:19.694061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:19.694066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:19.694071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:19.694075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:19.694080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:19.694116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:19.696566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:19.697355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:19.697366Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:19.697368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:19.697372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:19.697379Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2953 [2:7559602686896517713:7263]
2025-10-10T14:39:19.697391Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:19.697410Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:19.697413Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:19.697418Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:19.697431Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:19.697448Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:19.697463Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:19.697475Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:19.697541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:19.697551Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:19.697553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:19.697555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:19.697626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:19.697634Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:19.697645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:19.697657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:19.697673Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:19.697695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602687678758013:3621], now have 1 active actors on pipe
2025-10-10T14:39:19.697699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602687678757860:2438], now have 1 active actors on pipe
2025-10-10T14:39:19.697706Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602686896517708:7263]
2025-10-10T14:39:19.697709Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602686896517708:7263]
2025-10-10T14:39:19.697710Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602686896517708:7263]
2025-10-10T14:39:19.697724Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:19.697739Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:19.697746Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:19.697751Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:19.697753Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:19.697761Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:19.697765Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:19.697787Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602686896517708:7263]
2025-10-10T14:39:19.697794Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:19.697801Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:19.697790Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2953
2025-10-10T14:39:19.697825Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2953
2025-10-10T14:39:19.697865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:19.697875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:19.697904Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7ca3c9fb-51f7f254-f334301e-18a72e24_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:19.697915Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:19.697919Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:19.697922Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:19.697937Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:19.697947Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:19.697965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:19.698160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:19.698182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:19.698207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:19.698390Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2954 partition: 0 MaxSeqNo: 40 sessionId: src_id|7ca3c9fb-51f7f254-f334301e-18a72e24_0
2025-10-10T14:39:19.698843Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1b7b76-392cecde-e96fe80a-b49b6d0d_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|7ca3c9fb-51f7f254-f334301e-18a72e24_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:19.701517Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7ca3c9fb-51f7f254-f334301e-18a72e24_0] Write session: try to update token
2025-10-10T14:39:19.701536Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7ca3c9fb-51f7f254-f334301e-18a72e24_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:19.709824Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:39:19.709849Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:19.709861Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602686896517708:7263]
2025-10-10T14:39:19.709906Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:39:19.709910Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:39:19.710094Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:39:19.710243Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:19.710391Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:19.710537Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:19.710748Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:39:19.710809Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:39:19.715901Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2954 sessionId: src_id|7ca3c9fb-51f7f254-f334301e-18a72e24_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:19.718522Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:19.718744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:19.718771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:19.718812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:39:19.718945Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:39:19.728556Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:19.728582Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:19.728586Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:19.728588Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:19.728599Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602686896517708:7263]
2025-10-10T14:39:19.728604Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602686896517708:7263]
2025-10-10T14:39:19.728608Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602686896517708:7263]
2025-10-10T14:39:19.728660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:19.728668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:19.728671Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:19.728672Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:19.728680Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:19.728684Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:19.728809Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:19.757012Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602687678758170:4699]
2025-10-10T14:39:19.757326Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 pipe creation result: OK TabletId: 72075186224037892 Generation: 2953, pipe: [1:7559602687678758170:4699]
2025-10-10T14:39:19.850788Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:19.859803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:19.859837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:19.860023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:19.860097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:19.860161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:19.860231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:19.860869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:19.860884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:19.860959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:19.861028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:19.861098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:19.861186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:19.861237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:19.861244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:19.861322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:19.861404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:19.861469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:19.861542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:19.861588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:19.861596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:19.861668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:19.861904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:19.861967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:19.862031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:19.862083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:19.862091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:19.862157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:19.862218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:19.862284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:19.862364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:19.862423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:19.862430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:19.862499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:19.862560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:19.862623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:19.862687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:19.862734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:19.862742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:19.862807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:19.862872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:19.862937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:19.862999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:19.863047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:19.863055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:19.863120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:19.863184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:19.863248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:19.863311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:19.863356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:19.863359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:19.863425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:19.863486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:19.863554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:19.863619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:19.863674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:19.863682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:19.863747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:19.863810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:19.863881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:19.863945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:19.863988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:19.863996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:19.864071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602687678758170:4699], now have 1 active actors on pipe
2025-10-10T14:39:19.864299Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:19.864311Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 52 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602687678758170:4699]
2025-10-10T14:39:19.864347Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:19.864350Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:19.864397Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2954 reason: error at write: Disconnected sessionId: src_id|7ca3c9fb-51f7f254-f334301e-18a72e24_0
2025-10-10T14:39:19.864542Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:19.864642Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2954 sessionId: src_id|7ca3c9fb-51f7f254-f334301e-18a72e24_0 is DEAD
2025-10-10T14:39:19.864827Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ca3c9fb-51f7f254-f334301e-18a72e24_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:19.864839Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ca3c9fb-51f7f254-f334301e-18a72e24_0] Write session will restart in 0.006596s
2025-10-10T14:39:19.864865Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ca3c9fb-51f7f254-f334301e-18a72e24_0] Write session: Do CDS request
2025-10-10T14:39:19.864872Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ca3c9fb-51f7f254-f334301e-18a72e24_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:19.872984Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7ca3c9fb-51f7f254-f334301e-18a72e24_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:19.873091Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:19.873108Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2955
2025-10-10T14:39:19.873267Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2955 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:19.873305Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2955 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:19.873316Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2955 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:19.873320Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:19.873861Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2955 sessionId:  describe result for acl check
2025-10-10T14:39:19.873896Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:19.873904Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:19.873906Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:19.873913Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602687678758198:3590] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:19.874495Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602687678758198:3590] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:19.878293Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602687678758198:3590] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:19.884181Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602687678758198:3590] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:19.884199Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602687678758198:3590] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:19.884203Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602687678758198:3590] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:19.884213Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2955 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:19.889570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:19.894733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:19.895041Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:19.895055Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:19.895069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:19.895158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:19.895207Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602686896518007:7261]
2025-10-10T14:39:19.895862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:19.896311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:19.896373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:19.896766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:19.896861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:19.896872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:19.896874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:19.896875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:19.896877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:19.896878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:19.896880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:19.896881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:19.896883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:19.896884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:19.896886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:19.896887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:19.896888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:19.896896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:19.896911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:19.896915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:19.896920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:19.896924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:19.896929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:19.896933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:19.896938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:19.896942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:19.896947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:19.896951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:19.896955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:19.896959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:19.896970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:19.896980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:19.896989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:19.896995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:19.897026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:19.897034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:19.897039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:19.897044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:19.897051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:19.897063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:19.897069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:19.897074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:19.897080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:19.897087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:19.897099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:19.897106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:19.897116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:19.897122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:19.897145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:19.897155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:19.897165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:19.897171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:19.897176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:19.897186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:19.897191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:19.897199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:19.897245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:19.900389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:19.901574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:19.901591Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:19.901594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:19.901599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:19.901612Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2954 [2:7559602686896518007:7261]
2025-10-10T14:39:19.901628Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:19.901651Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:19.901654Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:19.901658Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:19.901661Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:19.901681Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:19.901689Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:19.901698Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:19.901775Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:19.901786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:19.901789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:19.901792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:19.901878Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:19.901889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:19.901905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:19.901917Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:19.901936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:19.901967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602687678758402:3590], now have 1 active actors on pipe
2025-10-10T14:39:19.901976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602687678758181:2438], now have 1 active actors on pipe
2025-10-10T14:39:19.901986Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602686896518002:7261]
2025-10-10T14:39:19.901989Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602686896518002:7261]
2025-10-10T14:39:19.901991Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602686896518002:7261]
2025-10-10T14:39:19.902013Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:19.902034Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:19.902053Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:19.902063Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:19.902074Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:19.902078Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:19.902081Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:19.902103Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602686896518002:7261]
2025-10-10T14:39:19.902107Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:19.902128Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:19.902280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:19.902293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:19.902328Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e3e7f430-e110a8cc-7f560b6a-1290d487_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:19.902353Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:19.902358Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:19.902361Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:19.902374Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:19.902388Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:19.902414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:19.902605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:19.902613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:19.902628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:19.903184Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ca3c9fb-51f7f254-f334301e-18a72e24_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|e3e7f430-e110a8cc-7f560b6a-1290d487_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:19.902050Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2954
2025-10-10T14:39:19.902061Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2954
2025-10-10T14:39:19.902718Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2955 partition: 0 MaxSeqNo: 40 sessionId: src_id|e3e7f430-e110a8cc-7f560b6a-1290d487_0
2025-10-10T14:39:19.906057Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e3e7f430-e110a8cc-7f560b6a-1290d487_0] Write session: try to update token
2025-10-10T14:39:19.906078Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e3e7f430-e110a8cc-7f560b6a-1290d487_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:19.921099Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2955 sessionId: src_id|e3e7f430-e110a8cc-7f560b6a-1290d487_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:19.923347Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:19.923368Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:19.923371Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:19.923373Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:19.923384Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602686896518002:7261]
2025-10-10T14:39:19.923390Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602686896518002:7261]
2025-10-10T14:39:19.923394Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602686896518002:7261]
2025-10-10T14:39:19.923450Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:19.923453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:19.923459Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:19.923462Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:19.923464Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:19.923465Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:19.923626Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:19.924006Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:19.964411Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602687678758482:4699]
2025-10-10T14:39:19.964712Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 pipe creation result: OK TabletId: 72075186224037892 Generation: 2954, pipe: [1:7559602687678758482:4699]
2025-10-10T14:39:20.044708Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:20.045363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:20.045384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:20.045438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602687678758482:4699], now have 1 active actors on pipe
2025-10-10T14:39:20.045759Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:20.045773Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:20.045841Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2955 reason: error at write: Disconnected sessionId: src_id|e3e7f430-e110a8cc-7f560b6a-1290d487_0
2025-10-10T14:39:20.045719Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:20.046112Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2955 sessionId: src_id|e3e7f430-e110a8cc-7f560b6a-1290d487_0 is DEAD
2025-10-10T14:39:20.046191Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 53 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602687678758482:4699]
2025-10-10T14:39:20.046227Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:20.046320Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e3e7f430-e110a8cc-7f560b6a-1290d487_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:20.046332Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e3e7f430-e110a8cc-7f560b6a-1290d487_0] Write session will restart in 0.009129s
2025-10-10T14:39:20.046360Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e3e7f430-e110a8cc-7f560b6a-1290d487_0] Write session: Do CDS request
2025-10-10T14:39:20.046368Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e3e7f430-e110a8cc-7f560b6a-1290d487_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:20.056973Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e3e7f430-e110a8cc-7f560b6a-1290d487_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:20.057671Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:20.057691Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2956
2025-10-10T14:39:20.057931Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2956 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:20.057980Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2956 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:20.057992Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2956 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:20.057997Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:20.058487Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2956 sessionId:  describe result for acl check
2025-10-10T14:39:20.058526Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:20.058537Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:20.058541Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:20.058553Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602691973725806:3575] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:20.059166Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602691973725806:3575] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:20.071993Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602691973725806:3575] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:20.078504Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602691973725806:3575] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:20.078524Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602691973725806:3575] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:20.078528Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602691973725806:3575] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:20.078539Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2956 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:20.089886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:20.094810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:20.095413Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:20.095426Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:20.095441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:20.095510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:20.095556Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602691191485599:7243]
2025-10-10T14:39:20.096273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:20.096731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:20.096801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:20.097180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:20.097248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:20.097256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:20.097257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:20.097258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:20.097260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:20.097261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:20.097262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:20.097263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:20.097265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:20.097266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:20.097267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:20.097268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:20.097269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:20.097277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:20.097290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:20.097294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:20.097298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:20.097302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:20.097306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:20.097310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:20.097314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:20.097317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:20.097322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:20.097326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:20.097345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:20.097350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:20.097359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:20.097368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:20.097374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:20.097380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:20.097384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:20.097390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:20.097394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:20.097401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:20.097407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:20.097412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:20.097417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:20.097423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:20.097428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:20.097433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:20.097444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:20.097449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:20.097454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:20.097463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:20.097467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:20.097473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:20.097478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:20.097483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:20.097487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:20.097491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:20.097496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:20.097505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:20.097544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:20.100620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:20.100919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:20.100932Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:20.100934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:20.100939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:20.100945Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2955 [2:7559602691191485599:7243]
2025-10-10T14:39:20.100957Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:20.100977Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:20.100980Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:20.100984Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:20.100986Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:20.101003Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:20.101012Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:20.101020Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:20.101084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:20.101092Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:20.101094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:20.101097Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:20.101180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:20.101189Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:20.101202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:20.101214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:20.101238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:20.101265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602691973725781:2438], now have 1 active actors on pipe
2025-10-10T14:39:20.101273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602691973725993:3575], now have 1 active actors on pipe
2025-10-10T14:39:20.101283Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602691191485594:7243]
2025-10-10T14:39:20.101285Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602691191485594:7243]
2025-10-10T14:39:20.101288Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602691191485594:7243]
2025-10-10T14:39:20.101305Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:20.101325Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:20.101362Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:20.101370Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:20.101371Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:20.101373Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:20.101375Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:20.101398Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602691191485594:7243]
2025-10-10T14:39:20.101410Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:20.101416Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:20.105428Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2955
2025-10-10T14:39:20.105428Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2955
2025-10-10T14:39:20.105612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:20.105631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:20.105675Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|85c26f21-8c83d961-a302babb-af8d7c01_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:20.105693Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:20.105699Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:20.105702Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:20.105718Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:20.105739Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:20.105761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:20.109546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:20.109564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:20.109614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:20.109745Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2956 partition: 0 MaxSeqNo: 40 sessionId: src_id|85c26f21-8c83d961-a302babb-af8d7c01_0
2025-10-10T14:39:20.110206Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e3e7f430-e110a8cc-7f560b6a-1290d487_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|85c26f21-8c83d961-a302babb-af8d7c01_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:20.112996Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85c26f21-8c83d961-a302babb-af8d7c01_0] Write session: try to update token
2025-10-10T14:39:20.113015Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85c26f21-8c83d961-a302babb-af8d7c01_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:20.115275Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:39:20.115292Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:20.115302Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602691191485594:7243]
2025-10-10T14:39:20.115352Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:39:20.115517Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:39:20.115657Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:20.115791Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:20.115926Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:20.116109Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:39:20.116141Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:39:20.116330Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:39:20.135025Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:20.135048Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:20.135053Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:20.135055Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:20.135068Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602691191485594:7243]
2025-10-10T14:39:20.135073Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602691191485594:7243]
2025-10-10T14:39:20.135078Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602691191485594:7243]
2025-10-10T14:39:20.135137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:20.135152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:20.135159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:20.135297Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:20.137492Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:20.137514Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:20.137519Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:20.141189Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2956 sessionId: src_id|85c26f21-8c83d961-a302babb-af8d7c01_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:20.143934Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:20.146128Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602691973726081:4699]
2025-10-10T14:39:20.146913Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 pipe creation result: OK TabletId: 72075186224037892 Generation: 2955, pipe: [1:7559602691973726081:4699]
2025-10-10T14:39:20.269737Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:20.270214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:20.270234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:20.270260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602691973726081:4699], now have 1 active actors on pipe
2025-10-10T14:39:20.270511Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 54 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602691973726081:4699]
2025-10-10T14:39:20.270555Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:20.270618Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:20.270628Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:20.270711Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:20.271093Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85c26f21-8c83d961-a302babb-af8d7c01_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:20.271104Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85c26f21-8c83d961-a302babb-af8d7c01_0] Write session will restart in 0.009559s
2025-10-10T14:39:20.270687Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2956 reason: error at write: Disconnected sessionId: src_id|85c26f21-8c83d961-a302babb-af8d7c01_0
2025-10-10T14:39:20.270913Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2956 sessionId: src_id|85c26f21-8c83d961-a302babb-af8d7c01_0 is DEAD
2025-10-10T14:39:20.271142Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85c26f21-8c83d961-a302babb-af8d7c01_0] Write session: Do CDS request
2025-10-10T14:39:20.271153Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85c26f21-8c83d961-a302babb-af8d7c01_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:20.281979Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85c26f21-8c83d961-a302babb-af8d7c01_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:20.282075Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:20.282091Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2957
2025-10-10T14:39:20.282240Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2957 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:20.282286Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2957 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:20.282297Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2957 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:20.282301Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:20.282829Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2957 sessionId:  describe result for acl check
2025-10-10T14:39:20.282865Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:20.282867Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:20.282869Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:20.282875Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602691973726134:3545] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:20.283427Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602691973726134:3545] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:20.286584Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602691973726134:3545] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:20.290616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602691973726134:3545] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:20.290632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602691973726134:3545] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:20.290636Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602691973726134:3545] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:20.290649Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2957 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:20.301586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:20.302248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:20.302450Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:20.302462Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:20.302474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:20.302527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:20.302579Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602691191485936:7233]
2025-10-10T14:39:20.303308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:20.303644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:20.303688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:20.304049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:20.304106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:20.304114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:20.304116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:20.304117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:20.304119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:20.304120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:20.304122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:20.304123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:20.304125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:20.304126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:20.304128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:20.304129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:20.304130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:20.304137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:20.304152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:20.304158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:20.304162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:20.304167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:20.304172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:20.304177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:20.304182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:20.304187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:20.304192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:20.304196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:20.304202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:20.304206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:20.304216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:20.304226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:20.304232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:20.304241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:20.304251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:20.304257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:20.304279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:20.304290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:20.304297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:20.304303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:20.304308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:20.304314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:20.304319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:20.304325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:20.304336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:20.304342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:20.304347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:20.304357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:20.304362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:20.304372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:20.304377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:20.304387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:20.304392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:20.304402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:20.304407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:20.304412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:20.304457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:20.307315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:20.308184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:20.308200Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:20.308202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:20.308207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:20.308214Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2956 [2:7559602691191485936:7233]
2025-10-10T14:39:20.308230Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:20.308250Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:20.308253Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:20.308257Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:20.308259Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:20.308278Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:20.308286Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:20.308295Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:20.308358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:20.308365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:20.308367Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:20.308370Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:20.308443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:20.308451Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:20.308463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:20.308474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:20.308492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:20.308521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602691973726306:3545], now have 1 active actors on pipe
2025-10-10T14:39:20.308530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602691973726096:2438], now have 1 active actors on pipe
2025-10-10T14:39:20.308539Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602691191485931:7233]
2025-10-10T14:39:20.308545Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602691191485931:7233]
2025-10-10T14:39:20.308548Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602691191485931:7233]
2025-10-10T14:39:20.308561Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:20.308577Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:20.308579Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:20.308582Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:20.308585Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:20.308599Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:20.308602Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:20.308594Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2956
2025-10-10T14:39:20.308594Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2956
2025-10-10T14:39:20.308638Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602691191485931:7233]
2025-10-10T14:39:20.308645Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:20.308647Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:20.308676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:20.308686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:20.308726Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1a24ec24-f007c054-f02da8e1-2e535da3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:20.308738Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:20.308744Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:20.308751Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:20.308762Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:20.308776Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:20.308798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:20.308922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:20.308929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:20.308942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:20.309026Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2957 partition: 0 MaxSeqNo: 40 sessionId: src_id|1a24ec24-f007c054-f02da8e1-2e535da3_0
2025-10-10T14:39:20.309534Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85c26f21-8c83d961-a302babb-af8d7c01_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|1a24ec24-f007c054-f02da8e1-2e535da3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:20.312408Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1a24ec24-f007c054-f02da8e1-2e535da3_0] Write session: try to update token
2025-10-10T14:39:20.312429Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1a24ec24-f007c054-f02da8e1-2e535da3_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:20.328377Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2957 sessionId: src_id|1a24ec24-f007c054-f02da8e1-2e535da3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:20.328510Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:20.328529Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:20.328533Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:20.328534Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:20.328544Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602691191485931:7233]
2025-10-10T14:39:20.328549Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602691191485931:7233]
2025-10-10T14:39:20.328552Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602691191485931:7233]
2025-10-10T14:39:20.328608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:20.328622Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:20.328624Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:20.328623Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:20.328630Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:20.328635Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:20.328781Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:20.331107Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:20.370900Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602691973726408:4699]
2025-10-10T14:39:20.371214Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 pipe creation result: OK TabletId: 72075186224037892 Generation: 2956, pipe: [1:7559602691973726408:4699]
2025-10-10T14:39:20.444780Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:20.445562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:20.445579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:20.445629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602691973726408:4699], now have 1 active actors on pipe
2025-10-10T14:39:20.445882Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 55 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602691973726408:4699]
2025-10-10T14:39:20.445924Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:20.446007Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:20.446310Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:39:20.446403Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2957 reason: status is not ok: tablet will be restarted right now sessionId: src_id|1a24ec24-f007c054-f02da8e1-2e535da3_0
2025-10-10T14:39:20.446644Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2957 sessionId: src_id|1a24ec24-f007c054-f02da8e1-2e535da3_0 is DEAD
2025-10-10T14:39:20.446804Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a24ec24-f007c054-f02da8e1-2e535da3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:39:20.446813Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a24ec24-f007c054-f02da8e1-2e535da3_0] Write session will restart in 0.008244s
2025-10-10T14:39:20.446839Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a24ec24-f007c054-f02da8e1-2e535da3_0] Write session: Do CDS request
2025-10-10T14:39:20.446845Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a24ec24-f007c054-f02da8e1-2e535da3_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:20.455977Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1a24ec24-f007c054-f02da8e1-2e535da3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:20.456055Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:20.456072Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2958
2025-10-10T14:39:20.456239Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2958 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:20.456288Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2958 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:20.456300Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2958 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:20.456305Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:20.456918Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2958 sessionId:  describe result for acl check
2025-10-10T14:39:20.456978Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:20.456986Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:20.456988Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:20.456996Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602691973726434:3517] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:20.457643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602691973726434:3517] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:20.460973Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602691973726434:3517] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:20.465153Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602691973726434:3517] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:20.465170Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602691973726434:3517] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:20.465173Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602691973726434:3517] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:20.465183Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2958 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:20.472490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:20.477657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:20.477962Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:20.477981Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:20.477996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:20.478077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:20.478133Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602691191486234:7223]
2025-10-10T14:39:20.478829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:20.479196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:20.479273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:20.479654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:20.479721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:20.479728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:20.479729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:20.479730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:20.479732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:20.479733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:20.479735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:20.479737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:20.479738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:20.479739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:20.479740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:20.479742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:20.479744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:20.479760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:20.479775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:20.479779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:20.479784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:20.479789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:20.479793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:20.479797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:20.479801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:20.479806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:20.479810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:20.479815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:20.479819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:20.479823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:20.479831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:20.479841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:20.479848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:20.479854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:20.479863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:20.479875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:20.479880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:20.479885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:20.479890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:20.479897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:20.479901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:20.479907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:20.479914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:20.479920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:20.479929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:20.479935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:20.479945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:20.479952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:20.479957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:20.479963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:20.479968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:20.479973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:20.479978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:20.479983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:20.479988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:20.479994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:20.480040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:20.482764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:20.483593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:20.483604Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:20.483606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:20.483611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:20.483618Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2957 [2:7559602691191486234:7223]
2025-10-10T14:39:20.483632Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:20.483653Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:20.483656Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:20.483660Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:20.483663Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:20.483681Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:20.483694Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:20.483708Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:20.483775Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:20.483782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:20.483785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:20.483788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:20.483859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:20.483867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:20.483879Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:20.483894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:20.483915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:20.483946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602691973726409:2438], now have 1 active actors on pipe
2025-10-10T14:39:20.483954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602691973726590:3517], now have 1 active actors on pipe
2025-10-10T14:39:20.483962Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602691191486229:7223]
2025-10-10T14:39:20.483965Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602691191486229:7223]
2025-10-10T14:39:20.483967Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602691191486229:7223]
2025-10-10T14:39:20.483978Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:20.483992Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:20.483999Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:20.484002Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:20.484007Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:20.484014Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:20.484018Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:20.484050Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602691191486229:7223]
2025-10-10T14:39:20.484064Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:20.484041Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2957
2025-10-10T14:39:20.484045Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2957
2025-10-10T14:39:20.484099Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:20.484299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:20.484310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:20.484344Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e27bf22-472b452e-d0c867c1-75e7bfd6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:20.484359Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:20.484364Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:20.484367Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:20.484380Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:20.484393Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:20.484414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:20.484686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:20.484694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:20.484713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:20.484820Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2958 partition: 0 MaxSeqNo: 40 sessionId: src_id|e27bf22-472b452e-d0c867c1-75e7bfd6_0
2025-10-10T14:39:20.485274Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a24ec24-f007c054-f02da8e1-2e535da3_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|e27bf22-472b452e-d0c867c1-75e7bfd6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:20.488155Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e27bf22-472b452e-d0c867c1-75e7bfd6_0] Write session: try to update token
2025-10-10T14:39:20.488177Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e27bf22-472b452e-d0c867c1-75e7bfd6_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:20.496421Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:39:20.496438Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:20.496458Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602691191486229:7223]
2025-10-10T14:39:20.496509Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:39:20.496584Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:39:20.496693Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:39:20.496848Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:20.497026Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:20.497247Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:20.497493Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:39:20.497537Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:39:20.504127Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2958 sessionId: src_id|e27bf22-472b452e-d0c867c1-75e7bfd6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:20.506917Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:20.507481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:20.507504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:20.507551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:39:20.507637Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:39:20.515172Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:20.515191Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:20.515195Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:20.515197Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:20.515210Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602691191486229:7223]
2025-10-10T14:39:20.515215Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602691191486229:7223]
2025-10-10T14:39:20.515219Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602691191486229:7223]
2025-10-10T14:39:20.515272Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:20.515282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:20.515285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:20.515440Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:20.517418Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:20.517433Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:20.517437Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:20.546014Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602691973726712:4699]
2025-10-10T14:39:20.546286Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 pipe creation result: OK TabletId: 72075186224037892 Generation: 2957, pipe: [1:7559602691973726712:4699]
2025-10-10T14:39:20.632858Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:20.640937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:20.640967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:20.641149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:20.641207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:20.641273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:20.641352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:20.641402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:20.641411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:20.641479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:20.641545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:20.641621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:20.641693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:20.641741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:20.641751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:20.641820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:20.641879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:20.641936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:20.642000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:20.642048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:20.642057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:20.642128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:20.642198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:20.642262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:20.642327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:20.642373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:20.642380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:20.642448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:20.642507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:20.642569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:20.642635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:20.642678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:20.642685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:20.642753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:20.642812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:20.642876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:20.642944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:20.642988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:20.642993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:20.643054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:20.643108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:20.643180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:20.643249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:20.643298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:20.643304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:20.643371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:20.643437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:20.643508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:20.643575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:20.643620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:20.643626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:20.643685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:20.643741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:20.643802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:20.643862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:20.643915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:20.643922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:20.643986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:20.644043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:20.644109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:20.644181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:20.644226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:20.644233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:20.644290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602691973726712:4699], now have 1 active actors on pipe
2025-10-10T14:39:20.644508Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:20.644509Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 56 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602691973726712:4699]
2025-10-10T14:39:20.644555Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:20.644561Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:20.644593Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2958 reason: error at write: Disconnected sessionId: src_id|e27bf22-472b452e-d0c867c1-75e7bfd6_0
2025-10-10T14:39:20.644847Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2958 sessionId: src_id|e27bf22-472b452e-d0c867c1-75e7bfd6_0 is DEAD
2025-10-10T14:39:20.645049Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e27bf22-472b452e-d0c867c1-75e7bfd6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:20.645063Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e27bf22-472b452e-d0c867c1-75e7bfd6_0] Write session will restart in 0.006584s
2025-10-10T14:39:20.645091Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e27bf22-472b452e-d0c867c1-75e7bfd6_0] Write session: Do CDS request
2025-10-10T14:39:20.645097Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e27bf22-472b452e-d0c867c1-75e7bfd6_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:20.645528Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:20.652986Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e27bf22-472b452e-d0c867c1-75e7bfd6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:20.653384Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:20.653402Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2959
2025-10-10T14:39:20.653541Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2959 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:20.653578Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2959 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:20.653590Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2959 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:20.653594Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:20.654098Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2959 sessionId:  describe result for acl check
2025-10-10T14:39:20.654148Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:20.654155Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:20.654157Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:20.654163Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602691973726734:3512] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:20.654745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602691973726734:3512] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:20.658829Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602691973726734:3512] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:20.662596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602691973726734:3512] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:20.662627Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602691973726734:3512] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:20.662632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602691973726734:3512] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:20.662641Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2959 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:20.668372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:20.674038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:20.674336Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:20.674351Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:20.674366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:20.674438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:20.674483Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602691191486545:7217]
2025-10-10T14:39:20.675137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:20.675544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:20.675611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:20.675946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:20.676013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:20.676018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:20.676020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:20.676021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:20.676022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:20.676024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:20.676025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:20.676026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:20.676028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:20.676029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:20.676030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:20.676031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:20.676033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:20.676039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:20.676052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:20.676056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:20.676059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:20.676063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:20.676066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:20.676070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:20.676074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:20.676077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:20.676081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:20.676085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:20.676088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:20.676092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:20.676100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:20.676108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:20.676117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:20.676122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:20.676126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:20.676131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:20.676135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:20.676140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:20.676145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:20.676150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:20.676154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:20.676158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:20.676162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:20.676167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:20.676172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:20.676177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:20.676181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:20.676186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:20.676191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:20.676196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:20.676199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:20.676206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:20.676209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:20.676214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:20.676219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:20.676228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:20.676268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:20.678840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:20.679818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:20.679832Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:20.679835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:20.679839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:20.679845Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2958 [2:7559602691191486545:7217]
2025-10-10T14:39:20.679860Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:20.679879Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:20.679887Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:20.679891Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:20.679893Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:20.679912Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:20.679924Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:20.679933Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:20.680009Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:20.680016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:20.680019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:20.680022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:20.680090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:20.680097Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:20.680109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:20.680122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:20.680140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:20.680163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602691973726905:3512], now have 1 active actors on pipe
2025-10-10T14:39:20.680171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602691973726714:2438], now have 1 active actors on pipe
2025-10-10T14:39:20.680179Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602691191486540:7217]
2025-10-10T14:39:20.680183Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602691191486540:7217]
2025-10-10T14:39:20.680185Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602691191486540:7217]
2025-10-10T14:39:20.680199Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:20.680212Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:20.680215Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:20.680218Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:20.680219Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:20.680235Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:20.680239Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:20.680252Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2958
2025-10-10T14:39:20.680268Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602691191486540:7217]
2025-10-10T14:39:20.680252Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2958
2025-10-10T14:39:20.680280Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:20.680284Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:20.680309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:20.680314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:20.680353Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5fb0a45f-307deb39-c428be39-18cd2ef3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:20.680367Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:20.680371Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:20.680374Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:20.680385Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:20.680395Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:20.680418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:20.680592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:20.680600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:20.680614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:20.680749Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2959 partition: 0 MaxSeqNo: 40 sessionId: src_id|5fb0a45f-307deb39-c428be39-18cd2ef3_0
2025-10-10T14:39:20.681176Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e27bf22-472b452e-d0c867c1-75e7bfd6_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|5fb0a45f-307deb39-c428be39-18cd2ef3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:20.683929Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5fb0a45f-307deb39-c428be39-18cd2ef3_0] Write session: try to update token
2025-10-10T14:39:20.683952Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5fb0a45f-307deb39-c428be39-18cd2ef3_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:20.698478Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2959 sessionId: src_id|5fb0a45f-307deb39-c428be39-18cd2ef3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:20.700023Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:20.700048Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:20.700051Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:20.700054Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:20.700064Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602691191486540:7217]
2025-10-10T14:39:20.700069Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602691191486540:7217]
2025-10-10T14:39:20.700074Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602691191486540:7217]
2025-10-10T14:39:20.700133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:20.700136Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:20.700143Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:20.700147Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:20.700149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:20.700152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:20.700317Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:20.701430Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:20.744674Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602691973727029:4699]
2025-10-10T14:39:20.744986Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 pipe creation result: OK TabletId: 72075186224037892 Generation: 2958, pipe: [1:7559602691973727029:4699]
2025-10-10T14:39:20.822558Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:20.823242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:20.823261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:20.823309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602691973727029:4699], now have 1 active actors on pipe
2025-10-10T14:39:20.823540Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:20.823542Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 57 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602691973727029:4699]
2025-10-10T14:39:20.823579Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:20.823582Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:20.823658Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2959 reason: error at write: Disconnected sessionId: src_id|5fb0a45f-307deb39-c428be39-18cd2ef3_0
2025-10-10T14:39:20.823535Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:20.823913Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2959 sessionId: src_id|5fb0a45f-307deb39-c428be39-18cd2ef3_0 is DEAD
2025-10-10T14:39:20.824074Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5fb0a45f-307deb39-c428be39-18cd2ef3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:20.824084Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5fb0a45f-307deb39-c428be39-18cd2ef3_0] Write session will restart in 0.008928s
2025-10-10T14:39:20.824110Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5fb0a45f-307deb39-c428be39-18cd2ef3_0] Write session: Do CDS request
2025-10-10T14:39:20.824118Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5fb0a45f-307deb39-c428be39-18cd2ef3_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:20.833936Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5fb0a45f-307deb39-c428be39-18cd2ef3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:20.834051Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:20.834066Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2960
2025-10-10T14:39:20.834218Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2960 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:20.834258Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2960 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:20.834269Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2960 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:20.834273Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:20.834703Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2960 sessionId:  describe result for acl check
2025-10-10T14:39:20.834745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:20.834753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:20.834756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:20.834763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602691973727077:3481] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:20.835370Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602691973727077:3481] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:20.838443Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602691973727077:3481] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:20.842043Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602691973727077:3481] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:20.842057Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602691973727077:3481] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:20.842061Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602691973727077:3481] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:20.842070Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2960 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:20.852525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:20.853149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:20.853411Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:20.853425Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:20.853438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:20.853498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:20.853545Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602691191486845:7221]
2025-10-10T14:39:20.854238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:20.854613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:20.854666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:20.855016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:20.855076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:20.855082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:20.855083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:20.855085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:20.855086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:20.855087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:20.855089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:20.855090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:20.855091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:20.855093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:20.855095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:20.855096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:20.855097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:20.855102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:20.855117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:20.855122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:20.855127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:20.855131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:20.855136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:20.855140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:20.855145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:20.855149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:20.855154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:20.855158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:20.855163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:20.855166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:20.855174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:20.855184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:20.855190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:20.855196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:20.855200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:20.855206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:20.855211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:20.855217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:20.855223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:20.855229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:20.855238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:20.855244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:20.855253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:20.855259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:20.855264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:20.855269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:20.855280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:20.855286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:20.855291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:20.855296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:20.855301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:20.855307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:20.855311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:20.855317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:20.855322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:20.855327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:20.855370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:20.857982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:20.858422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:20.858438Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:20.858441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:20.858445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:20.858452Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2959 [2:7559602691191486845:7221]
2025-10-10T14:39:20.858467Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:20.858487Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:20.858494Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:20.858497Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:20.858499Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:20.858518Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:20.858533Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:20.858542Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:20.858611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:20.858617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:20.858619Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:20.858621Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:20.858697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:20.858706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:20.858720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:20.858735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:20.858763Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:20.858787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602691973727235:3481], now have 1 active actors on pipe
2025-10-10T14:39:20.858797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602691973727036:2438], now have 1 active actors on pipe
2025-10-10T14:39:20.858805Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602691191486840:7221]
2025-10-10T14:39:20.858808Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602691191486840:7221]
2025-10-10T14:39:20.858810Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602691191486840:7221]
2025-10-10T14:39:20.858830Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:20.858850Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:20.858858Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:20.858861Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:20.858863Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:20.858897Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:20.858856Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2959
2025-10-10T14:39:20.858906Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:20.858853Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2959
2025-10-10T14:39:20.858942Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602691191486840:7221]
2025-10-10T14:39:20.858954Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:20.858961Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:20.858978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:20.858988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:20.859043Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|71b04b25-88d569b-bbe93c0f-eea23ff3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:20.859057Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:20.859061Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:20.859064Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:20.859076Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:20.859092Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:20.859118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:20.859300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:20.859310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:20.859329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:20.859438Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2960 partition: 0 MaxSeqNo: 40 sessionId: src_id|71b04b25-88d569b-bbe93c0f-eea23ff3_0
2025-10-10T14:39:20.859921Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5fb0a45f-307deb39-c428be39-18cd2ef3_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|71b04b25-88d569b-bbe93c0f-eea23ff3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:20.862932Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|71b04b25-88d569b-bbe93c0f-eea23ff3_0] Write session: try to update token
2025-10-10T14:39:20.862953Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|71b04b25-88d569b-bbe93c0f-eea23ff3_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:20.879562Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2960 sessionId: src_id|71b04b25-88d569b-bbe93c0f-eea23ff3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:20.878625Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:20.878649Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:20.878653Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:20.878655Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:20.878666Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602691191486840:7221]
2025-10-10T14:39:20.878672Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602691191486840:7221]
2025-10-10T14:39:20.878676Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602691191486840:7221]
2025-10-10T14:39:20.878737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:20.878745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:20.878747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:20.878746Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:20.878753Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:20.878760Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:20.878889Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:20.882423Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:20.923873Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602691973727345:4699]
2025-10-10T14:39:20.924981Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 pipe creation result: OK TabletId: 72075186224037892 Generation: 2959, pipe: [1:7559602691973727345:4699]
2025-10-10T14:39:21.000728Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:21.001065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:21.001088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:21.001153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602691973727345:4699], now have 1 active actors on pipe
2025-10-10T14:39:21.001407Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:21.001445Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:21.001460Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:21.001468Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:21.001519Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 58 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602691973727345:4699]
2025-10-10T14:39:21.001526Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2960 reason: error at write: Disconnected sessionId: src_id|71b04b25-88d569b-bbe93c0f-eea23ff3_0
2025-10-10T14:39:21.001742Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2960 sessionId: src_id|71b04b25-88d569b-bbe93c0f-eea23ff3_0 is DEAD
2025-10-10T14:39:21.001865Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71b04b25-88d569b-bbe93c0f-eea23ff3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:21.001874Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71b04b25-88d569b-bbe93c0f-eea23ff3_0] Write session will restart in 0.009047s
2025-10-10T14:39:21.001910Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71b04b25-88d569b-bbe93c0f-eea23ff3_0] Write session: Do CDS request
2025-10-10T14:39:21.001919Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71b04b25-88d569b-bbe93c0f-eea23ff3_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:21.011925Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|71b04b25-88d569b-bbe93c0f-eea23ff3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:21.012004Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:21.012020Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2961
2025-10-10T14:39:21.012170Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2961 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:21.012208Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2961 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:21.012219Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2961 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:21.012223Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:21.012677Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2961 sessionId:  describe result for acl check
2025-10-10T14:39:21.012714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:21.012721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:21.012724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:21.012730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602696268694673:3468] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:21.013318Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602696268694673:3468] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:21.016977Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602696268694673:3468] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:21.019947Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602696268694673:3468] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:21.019962Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602696268694673:3468] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:21.019966Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602696268694673:3468] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:21.019975Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2961 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:21.026702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:21.032069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:21.032619Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:21.032630Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:21.032645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:21.032713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:21.032749Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602695486454442:7219]
2025-10-10T14:39:21.033206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:21.033602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:21.033674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:21.033965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:21.034016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:21.034020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:21.034021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:21.034022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:21.034023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:21.034024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:21.034025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:21.034026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:21.034026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:21.034027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:21.034028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:21.034029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:21.034029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:21.034034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:21.034043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:21.034046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:21.034059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:21.034061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:21.034063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:21.034066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:21.034068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:21.034070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:21.034073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:21.034076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:21.034080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:21.034084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:21.034092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:21.034100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:21.034107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:21.034114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:21.034118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:21.034124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:21.034128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:21.034141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:21.034146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:21.034153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:21.034156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:21.034162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:21.034167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:21.034172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:21.034177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:21.034182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:21.034187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:21.034192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:21.034194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:21.034197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:21.034200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:21.034203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:21.034206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:21.034209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:21.034212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:21.034215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:21.034252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:21.036771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:21.037161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:21.037174Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:21.037177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:21.037180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:21.037187Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2960 [2:7559602695486454442:7219]
2025-10-10T14:39:21.037199Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:21.037214Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:21.037216Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:21.037219Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:21.037220Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:21.037235Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:21.037248Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:21.037256Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:21.037319Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:21.037325Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:21.037327Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:21.037344Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:21.037422Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:21.037430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:21.037443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:21.037454Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:21.037470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:21.037572Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2960
2025-10-10T14:39:21.037497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602696268694643:2438], now have 1 active actors on pipe
2025-10-10T14:39:21.037505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602696268694830:3468], now have 1 active actors on pipe
2025-10-10T14:39:21.037587Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2960
2025-10-10T14:39:21.037513Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602695486454437:7219]
2025-10-10T14:39:21.037516Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602695486454437:7219]
2025-10-10T14:39:21.037520Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602695486454437:7219]
2025-10-10T14:39:21.037534Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:21.037549Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:21.037552Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:21.037555Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:21.037558Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:21.037564Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:21.037567Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:21.037594Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602695486454437:7219]
2025-10-10T14:39:21.037598Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:21.037600Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:21.037629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:21.037635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:21.037673Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2ceec993-848433a7-e35cac88-492e1eb0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:21.037682Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:21.037686Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:21.037689Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:21.037700Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:21.037711Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:21.037735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:21.037869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:21.037882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:21.037898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:21.038013Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2961 partition: 0 MaxSeqNo: 40 sessionId: src_id|2ceec993-848433a7-e35cac88-492e1eb0_0
2025-10-10T14:39:21.038454Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71b04b25-88d569b-bbe93c0f-eea23ff3_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|2ceec993-848433a7-e35cac88-492e1eb0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:21.041397Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2ceec993-848433a7-e35cac88-492e1eb0_0] Write session: try to update token
2025-10-10T14:39:21.041418Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2ceec993-848433a7-e35cac88-492e1eb0_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:21.057787Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:21.057810Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:21.057814Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:21.057817Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:21.057830Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602695486454437:7219]
2025-10-10T14:39:21.057837Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602695486454437:7219]
2025-10-10T14:39:21.057842Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602695486454437:7219]
2025-10-10T14:39:21.057903Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:21.057904Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:21.057911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:21.057912Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:21.057915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:21.057930Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:21.058592Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2961 sessionId: src_id|2ceec993-848433a7-e35cac88-492e1eb0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:21.058097Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:21.061521Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:21.101729Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602696268694957:4699]
2025-10-10T14:39:21.102059Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 pipe creation result: OK TabletId: 72075186224037892 Generation: 2960, pipe: [1:7559602696268694957:4699]
2025-10-10T14:39:21.176391Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:21.177289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:21.177304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:21.177365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602696268694957:4699], now have 1 active actors on pipe
2025-10-10T14:39:21.177552Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:21.177604Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:21.177639Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 59 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602696268694957:4699]
2025-10-10T14:39:21.177659Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:39:21.177741Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2961 reason: status is not ok: tablet will be restarted right now sessionId: src_id|2ceec993-848433a7-e35cac88-492e1eb0_0
2025-10-10T14:39:21.177983Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2961 sessionId: src_id|2ceec993-848433a7-e35cac88-492e1eb0_0 is DEAD
2025-10-10T14:39:21.178191Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ceec993-848433a7-e35cac88-492e1eb0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:39:21.178205Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ceec993-848433a7-e35cac88-492e1eb0_0] Write session will restart in 0.006991s
2025-10-10T14:39:21.178232Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ceec993-848433a7-e35cac88-492e1eb0_0] Write session: Do CDS request
2025-10-10T14:39:21.178249Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ceec993-848433a7-e35cac88-492e1eb0_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:21.186932Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2ceec993-848433a7-e35cac88-492e1eb0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:21.187066Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:21.187086Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2962
2025-10-10T14:39:21.187225Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2962 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:21.187281Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2962 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:21.187294Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2962 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:21.187299Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:21.187784Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2962 sessionId:  describe result for acl check
2025-10-10T14:39:21.187836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:21.187845Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:21.187847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:21.187853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602696268694979:3453] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:21.188450Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602696268694979:3453] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:21.191540Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602696268694979:3453] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:21.195664Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602696268694979:3453] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:21.195679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602696268694979:3453] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:21.195683Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602696268694979:3453] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:21.195692Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2962 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:21.207831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:21.208402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:21.208622Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:21.208636Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:21.208651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:21.208709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:21.208760Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602695486454744:7206]
2025-10-10T14:39:21.209396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:21.209714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:21.209764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:21.210094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:21.210153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:21.210159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:21.210160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:21.210162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:21.210163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:21.210164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:21.210165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:21.210166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:21.210167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:21.210169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:21.210170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:21.210171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:21.210173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:21.210178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:21.210193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:21.210197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:21.210200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:21.210204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:21.210208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:21.210211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:21.210214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:21.210218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:21.210222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:21.210225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:21.210229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:21.210232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:21.210240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:21.210248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:21.210255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:21.210261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:21.210265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:21.210270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:21.210274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:21.210279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:21.210283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:21.210288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:21.210291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:21.210296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:21.210301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:21.210306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:21.210311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:21.210316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:21.210321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:21.210325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:21.210331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:21.210335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:21.210347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:21.210351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:21.210355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:21.210364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:21.210369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:21.210373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:21.210417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:21.212738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:21.213587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:21.213596Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:21.213598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:21.213602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:21.213607Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2961 [2:7559602695486454744:7206]
2025-10-10T14:39:21.213616Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:21.213633Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:21.213636Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:21.213640Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:21.213643Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:21.213659Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:21.213682Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:21.213691Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:21.213749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:21.213758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:21.213760Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:21.213762Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:21.213825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:21.213832Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:21.213840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:21.213846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:21.213856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:21.213873Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602695486454739:7206]
2025-10-10T14:39:21.213881Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602695486454739:7206]
2025-10-10T14:39:21.213883Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602695486454739:7206]
2025-10-10T14:39:21.213893Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:21.213903Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:21.213907Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:21.213909Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:21.213916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602696268694958:2438], now have 1 active actors on pipe
2025-10-10T14:39:21.213923Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:21.213938Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:21.213946Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:21.213951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602696268695113:3453], now have 1 active actors on pipe
2025-10-10T14:39:21.213973Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602695486454739:7206]
2025-10-10T14:39:21.213981Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:21.213992Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:21.214000Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2961
2025-10-10T14:39:21.214012Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2961
2025-10-10T14:39:21.214093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:21.214104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:21.214133Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e8d2f229-972cc129-2c7148c7-dae1b3e8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:21.214146Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:21.214150Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:21.214153Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:21.214166Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:21.214177Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:21.214191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:21.214347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:21.214355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:21.214369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:21.214444Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2962 partition: 0 MaxSeqNo: 40 sessionId: src_id|e8d2f229-972cc129-2c7148c7-dae1b3e8_0
2025-10-10T14:39:21.214870Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ceec993-848433a7-e35cac88-492e1eb0_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|e8d2f229-972cc129-2c7148c7-dae1b3e8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:21.217630Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e8d2f229-972cc129-2c7148c7-dae1b3e8_0] Write session: try to update token
2025-10-10T14:39:21.217648Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e8d2f229-972cc129-2c7148c7-dae1b3e8_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:21.233381Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2962 sessionId: src_id|e8d2f229-972cc129-2c7148c7-dae1b3e8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:21.233513Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:21.233529Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:21.233533Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:21.233535Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:21.233546Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602695486454739:7206]
2025-10-10T14:39:21.233551Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602695486454739:7206]
2025-10-10T14:39:21.233557Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602695486454739:7206]
2025-10-10T14:39:21.233609Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:21.233610Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:21.233618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:21.233620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:21.233622Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:21.233625Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:21.233781Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:21.236297Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:21.277638Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602696268695265:4699]
2025-10-10T14:39:21.277917Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 pipe creation result: OK TabletId: 72075186224037892 Generation: 2961, pipe: [1:7559602696268695265:4699]
2025-10-10T14:39:21.353781Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:21.354218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:21.354235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:21.354510Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:21.354518Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 60 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602696268695265:4699]
2025-10-10T14:39:21.354537Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:21.354539Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:21.354597Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2962 reason: error at write: Disconnected sessionId: src_id|e8d2f229-972cc129-2c7148c7-dae1b3e8_0
2025-10-10T14:39:21.354831Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2962 sessionId: src_id|e8d2f229-972cc129-2c7148c7-dae1b3e8_0 is DEAD
2025-10-10T14:39:21.354281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602696268695265:4699], now have 1 active actors on pipe
2025-10-10T14:39:21.354479Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:21.355047Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e8d2f229-972cc129-2c7148c7-dae1b3e8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:21.355059Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e8d2f229-972cc129-2c7148c7-dae1b3e8_0] Write session will restart in 0.005390s
2025-10-10T14:39:21.355085Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e8d2f229-972cc129-2c7148c7-dae1b3e8_0] Write session: Do CDS request
2025-10-10T14:39:21.355096Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e8d2f229-972cc129-2c7148c7-dae1b3e8_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:21.361936Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e8d2f229-972cc129-2c7148c7-dae1b3e8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:21.361978Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:21.361993Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2963
2025-10-10T14:39:21.362209Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2963 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:21.362258Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2963 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:21.362269Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2963 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:21.362274Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:21.362770Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2963 sessionId:  describe result for acl check
2025-10-10T14:39:21.362806Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:21.362813Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:21.362815Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:21.362821Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602696268695307:3395] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:21.363374Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602696268695307:3395] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:21.366596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602696268695307:3395] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:21.372827Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602696268695307:3395] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:21.372847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602696268695307:3395] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:21.372851Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602696268695307:3395] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:21.372860Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2963 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:21.380452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:21.386240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:21.386519Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:21.386531Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:21.386544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:21.386624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:21.386670Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602695486455087:7191]
2025-10-10T14:39:21.387334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:21.387692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:21.387740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:21.388080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:21.388166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:21.388173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:21.388174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:21.388176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:21.388177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:21.388178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:21.388180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:21.388181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:21.388182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:21.388183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:21.388185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:21.388186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:21.388187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:21.388194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:21.388207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:21.388211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:21.388215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:21.388219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:21.388223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:21.388227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:21.388231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:21.388234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:21.388239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:21.388243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:21.388246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:21.388250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:21.388259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:21.388269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:21.388276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:21.388282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:21.388287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:21.388295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:21.388302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:21.388309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:21.388314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:21.388319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:21.388331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:21.388336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:21.388342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:21.388346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:21.388356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:21.388362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:21.388370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:21.388379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:21.388384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:21.388389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:21.388399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:21.388404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:21.388408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:21.388413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:21.388417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:21.388426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:21.388467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:21.391113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:21.391775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:21.391788Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:21.391791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:21.391795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:21.391801Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2962 [2:7559602695486455087:7191]
2025-10-10T14:39:21.391815Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:21.391832Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:21.391836Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:21.391839Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:21.391841Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:21.391859Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:21.391867Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:21.391877Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:21.391937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:21.391945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:21.391947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:21.391950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:21.392020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:21.392028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:21.392040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:21.392057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:21.392080Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:21.392106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602696268695435:3395], now have 1 active actors on pipe
2025-10-10T14:39:21.392114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602696268695294:2438], now have 1 active actors on pipe
2025-10-10T14:39:21.392122Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602695486455082:7191]
2025-10-10T14:39:21.392125Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602695486455082:7191]
2025-10-10T14:39:21.392127Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602695486455082:7191]
2025-10-10T14:39:21.392143Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:21.392158Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:21.392177Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:21.392179Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:21.392184Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:21.392186Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:21.392186Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:21.392210Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602695486455082:7191]
2025-10-10T14:39:21.392219Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:21.392229Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:21.392199Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2962
2025-10-10T14:39:21.392356Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2962
2025-10-10T14:39:21.392421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:21.392432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:21.392463Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2ec906d2-a1124a83-de1e9ff2-dfee91e0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:21.392475Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:21.392479Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:21.392483Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:21.392494Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:21.392505Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:21.392524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:21.392706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:21.392714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:21.392730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:21.392851Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2963 partition: 0 MaxSeqNo: 40 sessionId: src_id|2ec906d2-a1124a83-de1e9ff2-dfee91e0_0
2025-10-10T14:39:21.393315Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e8d2f229-972cc129-2c7148c7-dae1b3e8_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|2ec906d2-a1124a83-de1e9ff2-dfee91e0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:21.396205Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2ec906d2-a1124a83-de1e9ff2-dfee91e0_0] Write session: try to update token
2025-10-10T14:39:21.396229Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2ec906d2-a1124a83-de1e9ff2-dfee91e0_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:21.404089Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:39:21.404111Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:21.404126Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602695486455082:7191]
2025-10-10T14:39:21.404183Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:39:21.404373Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:39:21.404539Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:21.404687Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:21.404843Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:21.404873Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:39:21.405072Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:39:21.405128Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:39:21.412000Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2963 sessionId: src_id|2ec906d2-a1124a83-de1e9ff2-dfee91e0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:21.414791Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:21.415010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:21.415033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:21.415075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:39:21.415161Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:39:21.422847Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:21.422862Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:21.422866Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:21.422868Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:21.422880Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602695486455082:7191]
2025-10-10T14:39:21.422885Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602695486455082:7191]
2025-10-10T14:39:21.422890Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602695486455082:7191]
2025-10-10T14:39:21.422948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:21.422956Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:21.422960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:21.422963Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:21.422963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:21.422967Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:21.423113Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:21.454825Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602696268695600:4699]
2025-10-10T14:39:21.455172Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 pipe creation result: OK TabletId: 72075186224037892 Generation: 2962, pipe: [1:7559602696268695600:4699]
2025-10-10T14:39:21.540498Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:21.549521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:21.549544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:21.549709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:21.549780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:21.549849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:21.549922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:21.549979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:21.549990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:21.550061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:21.550128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:21.550196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:21.550272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:21.550435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:21.550447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:21.550522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:21.550590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:21.550666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:21.550742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:21.550788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:21.550795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:21.550865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:21.550939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:21.551010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:21.551079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:21.551126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:21.551134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:21.551206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:21.551273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:21.551338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:21.551406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:21.551457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:21.551466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:21.551548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:21.551615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:21.551686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:21.551763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:21.551816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:21.551825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:21.551895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:21.551962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:21.552032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:21.552100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:21.552142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:21.552145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:21.552216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:21.552286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:21.552347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:21.552414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:21.552945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:21.552953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:21.553016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:21.553078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:21.553155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:21.553224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:21.553270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:21.553278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:21.553362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:21.553425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:21.553491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:21.553555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:21.553603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:21.553615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:21.553680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602696268695600:4699], now have 1 active actors on pipe
2025-10-10T14:39:21.553880Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 61 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602696268695600:4699]
2025-10-10T14:39:21.553899Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:21.553903Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:21.553911Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:21.553949Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2963 reason: error at write: Disconnected sessionId: src_id|2ec906d2-a1124a83-de1e9ff2-dfee91e0_0
2025-10-10T14:39:21.554210Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2963 sessionId: src_id|2ec906d2-a1124a83-de1e9ff2-dfee91e0_0 is DEAD
2025-10-10T14:39:21.554300Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:21.554365Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ec906d2-a1124a83-de1e9ff2-dfee91e0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:21.554376Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ec906d2-a1124a83-de1e9ff2-dfee91e0_0] Write session will restart in 0.009939s
2025-10-10T14:39:21.554402Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ec906d2-a1124a83-de1e9ff2-dfee91e0_0] Write session: Do CDS request
2025-10-10T14:39:21.554410Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ec906d2-a1124a83-de1e9ff2-dfee91e0_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:21.566048Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2ec906d2-a1124a83-de1e9ff2-dfee91e0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:21.566141Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:21.566158Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2964
2025-10-10T14:39:21.566347Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2964 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:21.566410Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2964 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:21.566422Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2964 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:21.566427Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:21.567296Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2964 sessionId:  describe result for acl check
2025-10-10T14:39:21.567336Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:21.567339Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:21.567340Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:21.567348Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602696268695651:3389] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:21.567960Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602696268695651:3389] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:21.572663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602696268695651:3389] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:21.576181Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602696268695651:3389] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:21.576196Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602696268695651:3389] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:21.576200Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602696268695651:3389] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:21.576221Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2964 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:21.586695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:21.587340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:21.587588Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:21.587599Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:21.587610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:21.587669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:21.588002Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602695486455404:7182]
2025-10-10T14:39:21.588673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:21.589023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:21.589083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:21.589485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:21.589545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:21.589551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:21.589553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:21.589554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:21.589556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:21.589558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:21.589559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:21.589561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:21.589563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:21.589564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:21.589566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:21.589567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:21.589569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:21.589576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:21.589591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:21.589597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:21.589602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:21.589606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:21.589611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:21.589616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:21.589620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:21.589625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:21.589630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:21.589635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:21.589640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:21.589645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:21.589653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:21.589662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:21.589672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:21.589679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:21.589689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:21.589696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:21.589706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:21.589712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:21.589722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:21.589728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:21.589734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:21.589740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:21.589745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:21.589757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:21.589762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:21.589773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:21.589778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:21.589789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:21.589794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:21.589804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:21.589810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:21.589820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:21.589825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:21.589836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:21.589840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:21.589846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:21.589896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:21.592454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:21.592822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:21.592844Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:21.592847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:21.592851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:21.592858Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2963 [2:7559602695486455404:7182]
2025-10-10T14:39:21.592871Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:21.592892Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:21.592900Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:21.592904Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:21.592906Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:21.592924Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:21.592936Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:21.592950Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:21.593015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:21.593023Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:21.593025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:21.593028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:21.593129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:21.593136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:21.593148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:21.593163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:21.593182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:21.593211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602696268695603:2438], now have 1 active actors on pipe
2025-10-10T14:39:21.593220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602696268695819:3389], now have 1 active actors on pipe
2025-10-10T14:39:21.593229Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602695486455399:7182]
2025-10-10T14:39:21.593231Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602695486455399:7182]
2025-10-10T14:39:21.593233Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602695486455399:7182]
2025-10-10T14:39:21.593248Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:21.593262Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:21.593263Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:21.593265Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:21.593268Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:21.593279Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:21.593238Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2963
2025-10-10T14:39:21.593282Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:21.593234Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2963
2025-10-10T14:39:21.593349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:21.593359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:21.593375Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602695486455399:7182]
2025-10-10T14:39:21.593387Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:21.593400Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:21.593427Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f0f3b34c-11a303fd-f3110215-f53346b4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:21.593440Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:21.593449Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:21.593451Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:21.593463Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:21.593477Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:21.593506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:21.593617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:21.593625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:21.593642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:21.593733Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2964 partition: 0 MaxSeqNo: 40 sessionId: src_id|f0f3b34c-11a303fd-f3110215-f53346b4_0
2025-10-10T14:39:21.594180Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ec906d2-a1124a83-de1e9ff2-dfee91e0_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|f0f3b34c-11a303fd-f3110215-f53346b4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:21.597082Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f0f3b34c-11a303fd-f3110215-f53346b4_0] Write session: try to update token
2025-10-10T14:39:21.597117Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f0f3b34c-11a303fd-f3110215-f53346b4_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:21.611948Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2964 sessionId: src_id|f0f3b34c-11a303fd-f3110215-f53346b4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:21.612839Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:21.612860Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:21.612863Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:21.612866Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:21.612876Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602695486455399:7182]
2025-10-10T14:39:21.612882Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602695486455399:7182]
2025-10-10T14:39:21.612886Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602695486455399:7182]
2025-10-10T14:39:21.612931Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:21.612936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:21.612944Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:21.612944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:21.612947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:21.612949Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:21.613122Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:21.614773Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:21.653994Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602696268695910:4699]
2025-10-10T14:39:21.654372Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 pipe creation result: OK TabletId: 72075186224037892 Generation: 2963, pipe: [1:7559602696268695910:4699]
2025-10-10T14:39:21.728575Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:21.729464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:21.729484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:21.729532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602696268695910:4699], now have 1 active actors on pipe
2025-10-10T14:39:21.729769Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:21.729751Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:21.729757Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:21.729770Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:21.729826Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 62 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602696268695910:4699]
2025-10-10T14:39:21.729867Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2964 reason: error at write: Disconnected sessionId: src_id|f0f3b34c-11a303fd-f3110215-f53346b4_0
2025-10-10T14:39:21.730124Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2964 sessionId: src_id|f0f3b34c-11a303fd-f3110215-f53346b4_0 is DEAD
2025-10-10T14:39:21.730346Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f0f3b34c-11a303fd-f3110215-f53346b4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:21.730360Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f0f3b34c-11a303fd-f3110215-f53346b4_0] Write session will restart in 0.006037s
2025-10-10T14:39:21.730387Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f0f3b34c-11a303fd-f3110215-f53346b4_0] Write session: Do CDS request
2025-10-10T14:39:21.730394Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f0f3b34c-11a303fd-f3110215-f53346b4_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:21.737946Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f0f3b34c-11a303fd-f3110215-f53346b4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:21.738026Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:21.738043Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2965
2025-10-10T14:39:21.738257Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2965 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:21.738298Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2965 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:21.738304Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2965 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:21.738309Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:21.738747Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2965 sessionId:  describe result for acl check
2025-10-10T14:39:21.738791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:21.738799Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:21.738801Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:21.738807Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602696268695940:3359] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:21.739417Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602696268695940:3359] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:21.742383Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602696268695940:3359] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:21.747049Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602696268695940:3359] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:21.747068Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602696268695940:3359] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:21.747071Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602696268695940:3359] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:21.747081Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2965 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:21.756289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:21.761844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:21.762117Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:21.762130Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:21.762143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:21.762199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:21.762520Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602695486455718:7180]
2025-10-10T14:39:21.763248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:21.763559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:21.763620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:21.763987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:21.764042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:21.764049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:21.764050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:21.764051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:21.764053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:21.764054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:21.764056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:21.764057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:21.764059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:21.764060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:21.764062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:21.764063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:21.764064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:21.764070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:21.764085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:21.764090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:21.764094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:21.764099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:21.764103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:21.764107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:21.764112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:21.764116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:21.764121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:21.764125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:21.764129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:21.764133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:21.764141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:21.764150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:21.764157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:21.764162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:21.764172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:21.764178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:21.764185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:21.764190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:21.764196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:21.764201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:21.764205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:21.764211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:21.764216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:21.764222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:21.764229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:21.764234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:21.764242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:21.764252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:21.764258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:21.764264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:21.764268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:21.764273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:21.764278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:21.764283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:21.764292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:21.764297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:21.764338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:21.767027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:21.767378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:21.767395Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:21.767398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:21.767402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:21.767410Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2964 [2:7559602695486455718:7180]
2025-10-10T14:39:21.767427Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:21.767449Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:21.767455Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:21.767459Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:21.767461Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:21.767482Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:21.767503Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:21.767515Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:21.767580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:21.767589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:21.767592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:21.767595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:21.767677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:21.767685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:21.767698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:21.767718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:21.767737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:21.767764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602696268696065:3359], now have 1 active actors on pipe
2025-10-10T14:39:21.767773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602696268695924:2438], now have 1 active actors on pipe
2025-10-10T14:39:21.767783Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602695486455709:7180]
2025-10-10T14:39:21.767786Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602695486455709:7180]
2025-10-10T14:39:21.767788Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602695486455709:7180]
2025-10-10T14:39:21.767803Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:21.767821Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:21.767844Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:21.767853Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:21.767889Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602695486455709:7180]
2025-10-10T14:39:21.767853Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2964
2025-10-10T14:39:21.767898Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:21.767856Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2964
2025-10-10T14:39:21.767920Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:21.767932Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:21.767934Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:21.767944Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:21.767998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:21.768009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:21.768047Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|56a2d33d-1611838-8cd25b99-52adeb53_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:21.768060Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:21.768065Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:21.768068Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:21.768083Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:21.768099Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:21.768121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:21.768362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:21.768372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:21.768391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:21.768538Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2965 partition: 0 MaxSeqNo: 40 sessionId: src_id|56a2d33d-1611838-8cd25b99-52adeb53_0
2025-10-10T14:39:21.769063Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f0f3b34c-11a303fd-f3110215-f53346b4_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|56a2d33d-1611838-8cd25b99-52adeb53_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:21.772005Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|56a2d33d-1611838-8cd25b99-52adeb53_0] Write session: try to update token
2025-10-10T14:39:21.772026Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|56a2d33d-1611838-8cd25b99-52adeb53_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:21.786296Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:39:21.786316Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:21.786327Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602695486455709:7180]
2025-10-10T14:39:21.786379Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:39:21.786385Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:39:21.786588Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:39:21.786738Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:21.786881Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:21.787024Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:21.787217Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:39:21.787262Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:39:21.787728Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2965 sessionId: src_id|56a2d33d-1611838-8cd25b99-52adeb53_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:21.790441Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:21.790703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:21.790723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:21.790763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:39:21.790958Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:39:21.799585Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:21.799605Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:21.799609Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:21.799611Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:21.799622Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602695486455709:7180]
2025-10-10T14:39:21.799627Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602695486455709:7180]
2025-10-10T14:39:21.799631Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602695486455709:7180]
2025-10-10T14:39:21.799680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:21.799688Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:21.799691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:21.799696Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:21.799704Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:21.799714Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:21.799835Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:21.830089Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602696268696238:4699]
2025-10-10T14:39:21.830600Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 pipe creation result: OK TabletId: 72075186224037892 Generation: 2964, pipe: [1:7559602696268696238:4699]
2025-10-10T14:39:21.919755Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:21.929167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:21.929201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:21.929430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:21.929516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:21.929600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:21.929684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:21.930381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:21.930402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:21.930487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:21.930564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:21.930634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:21.930707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:21.930762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:21.930776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:21.930862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:21.930940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:21.931022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:21.931099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:21.931155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:21.931165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:21.931246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:21.931321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:21.931395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:21.931491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:21.931553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:21.931561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:21.931636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:21.931707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:21.931778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:21.931852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:21.931907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:21.931915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:21.932003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:21.932077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:21.932148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:21.932221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:21.932272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:21.932282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:21.932357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:21.932430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:21.932510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:21.932590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:21.932644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:21.932651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:21.932721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:21.932791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:21.932863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:21.932938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:21.932988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:21.932995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:21.933070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:21.933154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:21.933222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:21.933298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:21.933368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:21.933378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:21.933454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:21.933522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:21.933600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:21.933678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:21.933733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:21.933742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:21.933810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602696268696238:4699], now have 1 active actors on pipe
2025-10-10T14:39:21.934110Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:21.934174Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:21.934183Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:21.934216Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2965 reason: error at write: Disconnected sessionId: src_id|56a2d33d-1611838-8cd25b99-52adeb53_0
2025-10-10T14:39:21.934420Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:21.934466Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2965 sessionId: src_id|56a2d33d-1611838-8cd25b99-52adeb53_0 is DEAD
2025-10-10T14:39:21.934690Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 63 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602696268696238:4699]
2025-10-10T14:39:21.937567Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56a2d33d-1611838-8cd25b99-52adeb53_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:21.937580Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56a2d33d-1611838-8cd25b99-52adeb53_0] Write session will restart in 0.007178s
2025-10-10T14:39:21.937621Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56a2d33d-1611838-8cd25b99-52adeb53_0] Write session: Do CDS request
2025-10-10T14:39:21.937628Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56a2d33d-1611838-8cd25b99-52adeb53_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:21.945923Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|56a2d33d-1611838-8cd25b99-52adeb53_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:21.946039Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:21.946057Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2966
2025-10-10T14:39:21.946211Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2966 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:21.946252Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2966 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:21.946266Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2966 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:21.946270Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:21.946346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:21.946729Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2966 sessionId:  describe result for acl check
2025-10-10T14:39:21.946782Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:21.946789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:21.946793Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:21.946800Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602696268696267:3350] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:21.947369Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602696268696267:3350] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:21.949791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602696268696267:3350] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:21.951993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:21.952250Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:21.952263Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:21.952277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:21.952923Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602696268696267:3350] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:21.952939Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602696268696267:3350] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:21.952942Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602696268696267:3350] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:21.952952Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2966 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:21.952342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:21.952389Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602695486455776:7160]
2025-10-10T14:39:21.953079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:21.953585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:21.953655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:21.954020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:21.954080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:21.954087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:21.954088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:21.954089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:21.954091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:21.954093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:21.954094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:21.954096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:21.954099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:21.954101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:21.954103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:21.954104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:21.954106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:21.954112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:21.954126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:21.954131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:21.954136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:21.954141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:21.954145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:21.954150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:21.954155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:21.954159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:21.954165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:21.954169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:21.954174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:21.954179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:21.954188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:21.954203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:21.954215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:21.954221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:21.954226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:21.954237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:21.954243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:21.954250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:21.954260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:21.954266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:21.954271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:21.954277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:21.954282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:21.954288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:21.954294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:21.954299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:21.954309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:21.954315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:21.954320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:21.954326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:21.954331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:21.954337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:21.954342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:21.954348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:21.954354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:21.954364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:21.954410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:21.957241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:21.957606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:21.957625Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:21.957628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:21.957633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:21.957641Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2965 [2:7559602695486455776:7160]
2025-10-10T14:39:21.957656Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:21.957698Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:21.957706Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:21.957710Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:21.957713Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:21.957733Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:21.957742Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:21.957750Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:21.957834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:21.957842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:21.957844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:21.957846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:21.957929Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:21.957938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:21.957951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:21.957966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:21.957986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:21.958013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602696268696296:3350], now have 1 active actors on pipe
2025-10-10T14:39:21.958023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602696268696247:2438], now have 1 active actors on pipe
2025-10-10T14:39:21.958031Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602695486455771:7160]
2025-10-10T14:39:21.958034Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602695486455771:7160]
2025-10-10T14:39:21.958036Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602695486455771:7160]
2025-10-10T14:39:21.958054Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:21.958070Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:21.958083Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2965
2025-10-10T14:39:21.958100Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2965
2025-10-10T14:39:21.958078Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:21.958088Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:21.958092Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:21.958099Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:21.958101Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:21.958131Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602695486455771:7160]
2025-10-10T14:39:21.958134Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:21.958137Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:21.958166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:21.958171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:21.958214Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d739533c-8e7ff36-f63fe2b-292bdb8d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:21.958222Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:21.958226Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:21.958228Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:21.958242Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:21.958256Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:21.958274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:21.958751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:21.958772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:21.958804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:21.958912Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2966 partition: 0 MaxSeqNo: 40 sessionId: src_id|d739533c-8e7ff36-f63fe2b-292bdb8d_0
2025-10-10T14:39:21.959393Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56a2d33d-1611838-8cd25b99-52adeb53_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|d739533c-8e7ff36-f63fe2b-292bdb8d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:21.962471Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d739533c-8e7ff36-f63fe2b-292bdb8d_0] Write session: try to update token
2025-10-10T14:39:21.962494Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d739533c-8e7ff36-f63fe2b-292bdb8d_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:21.978267Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:21.978287Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:21.978292Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:21.978294Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:21.978304Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602695486455771:7160]
2025-10-10T14:39:21.978309Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602695486455771:7160]
2025-10-10T14:39:21.978313Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602695486455771:7160]
2025-10-10T14:39:21.978366Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:21.978373Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:21.978379Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:21.978381Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:21.978382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:21.978385Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:21.978531Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:21.979907Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2966 sessionId: src_id|d739533c-8e7ff36-f63fe2b-292bdb8d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:21.982838Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:22.034397Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602700563663605:4699]
2025-10-10T14:39:22.034748Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 pipe creation result: OK TabletId: 72075186224037892 Generation: 2965, pipe: [1:7559602700563663605:4699]
2025-10-10T14:39:22.101282Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:22.101835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:22.101852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:22.101898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602700563663605:4699], now have 1 active actors on pipe
2025-10-10T14:39:22.102197Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:22.102230Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:22.102247Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:22.102255Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 64 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602700563663605:4699]
2025-10-10T14:39:22.102286Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:22.102334Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2966 reason: error at write: Disconnected sessionId: src_id|d739533c-8e7ff36-f63fe2b-292bdb8d_0
2025-10-10T14:39:22.102565Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2966 sessionId: src_id|d739533c-8e7ff36-f63fe2b-292bdb8d_0 is DEAD
2025-10-10T14:39:22.102716Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d739533c-8e7ff36-f63fe2b-292bdb8d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:22.102725Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d739533c-8e7ff36-f63fe2b-292bdb8d_0] Write session will restart in 0.007290s
2025-10-10T14:39:22.102770Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d739533c-8e7ff36-f63fe2b-292bdb8d_0] Write session: Do CDS request
2025-10-10T14:39:22.102780Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d739533c-8e7ff36-f63fe2b-292bdb8d_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:22.111017Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d739533c-8e7ff36-f63fe2b-292bdb8d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:22.111096Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:22.111116Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2967
2025-10-10T14:39:22.111276Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2967 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:22.111314Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2967 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:22.111325Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2967 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:22.111329Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:22.111808Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2967 sessionId:  describe result for acl check
2025-10-10T14:39:22.111842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:22.111849Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:22.111851Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:22.111857Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602700563663623:3329] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:22.112435Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602700563663623:3329] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:22.114129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:22.114863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602700563663623:3329] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:22.114943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:22.115140Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:22.115156Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:22.115169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:22.115228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:22.115274Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602699781423130:7173]
2025-10-10T14:39:22.115900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:22.119512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:22.119585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:22.119851Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602700563663623:3329] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:22.119867Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602700563663623:3329] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:22.119871Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602700563663623:3329] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:22.119880Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2967 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:22.119976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:22.120038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:22.120044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:22.120046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:22.120047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:22.120050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:22.120051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:22.120052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:22.120054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:22.120055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:22.120056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:22.120057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:22.120058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:22.120059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:22.120066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:22.120080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:22.120084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:22.120087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:22.120092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:22.120096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:22.120101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:22.120105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:22.120108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:22.120112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:22.120116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:22.120120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:22.120124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:22.120132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:22.120141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:22.120148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:22.120154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:22.120159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:22.120165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:22.120169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:22.120175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:22.120188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:22.120196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:22.120200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:22.120206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:22.120211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:22.120216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:22.120225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:22.120231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:22.120236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:22.120241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:22.120245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:22.120255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:22.120260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:22.120265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:22.120274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:22.120279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:22.120283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:22.120288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:22.120327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:22.122930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:22.123853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:22.123867Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:22.123869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:22.123873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:22.123881Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2966 [2:7559602699781423130:7173]
2025-10-10T14:39:22.123897Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:22.123919Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:22.123922Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:22.123926Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:22.123928Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:22.123948Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:22.123956Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:22.123964Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:22.124031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:22.124038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:22.124040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:22.124043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:22.124118Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:22.124127Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:22.124140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:22.124158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:22.124180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:22.124209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602700563663606:2438], now have 1 active actors on pipe
2025-10-10T14:39:22.124219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602700563663658:3329], now have 1 active actors on pipe
2025-10-10T14:39:22.124226Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602699781423125:7173]
2025-10-10T14:39:22.124229Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602699781423125:7173]
2025-10-10T14:39:22.124231Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602699781423125:7173]
2025-10-10T14:39:22.124245Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:22.124259Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:22.124259Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:22.124262Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:22.124264Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:22.124276Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:22.124279Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:22.124314Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602699781423125:7173]
2025-10-10T14:39:22.124328Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:22.124335Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:22.124310Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2966
2025-10-10T14:39:22.124311Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2966
2025-10-10T14:39:22.124373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:22.124382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:22.124417Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b0836424-974ab30c-f69ad962-77601057_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:22.124430Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:22.124434Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:22.124436Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:22.124451Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:22.124462Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:22.124481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:22.124649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:22.124656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:22.124671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:22.124764Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2967 partition: 0 MaxSeqNo: 40 sessionId: src_id|b0836424-974ab30c-f69ad962-77601057_0
2025-10-10T14:39:22.125202Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d739533c-8e7ff36-f63fe2b-292bdb8d_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|b0836424-974ab30c-f69ad962-77601057_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:22.128062Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b0836424-974ab30c-f69ad962-77601057_0] Write session: try to update token
2025-10-10T14:39:22.128082Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b0836424-974ab30c-f69ad962-77601057_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:22.143267Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2967 sessionId: src_id|b0836424-974ab30c-f69ad962-77601057_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:22.144553Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:22.144573Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:22.144577Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:22.144579Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:22.144589Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602699781423125:7173]
2025-10-10T14:39:22.144594Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602699781423125:7173]
2025-10-10T14:39:22.144598Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602699781423125:7173]
2025-10-10T14:39:22.144651Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:22.144656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:22.144665Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:22.144665Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:22.144667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:22.144670Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:22.144839Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:22.146147Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:22.202359Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602700563663668:4699]
2025-10-10T14:39:22.202656Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 pipe creation result: OK TabletId: 72075186224037892 Generation: 2966, pipe: [1:7559602700563663668:4699]
2025-10-10T14:39:22.263980Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:22.264274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:22.264290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:22.264337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602700563663668:4699], now have 1 active actors on pipe
2025-10-10T14:39:22.264564Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:22.264612Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:22.264630Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 65 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602700563663668:4699]
2025-10-10T14:39:22.264655Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:22.264658Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:22.264754Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2967 reason: error at write: Disconnected sessionId: src_id|b0836424-974ab30c-f69ad962-77601057_0
2025-10-10T14:39:22.264989Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2967 sessionId: src_id|b0836424-974ab30c-f69ad962-77601057_0 is DEAD
2025-10-10T14:39:22.265180Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0836424-974ab30c-f69ad962-77601057_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:22.265190Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0836424-974ab30c-f69ad962-77601057_0] Write session will restart in 0.006615s
2025-10-10T14:39:22.265216Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0836424-974ab30c-f69ad962-77601057_0] Write session: Do CDS request
2025-10-10T14:39:22.265223Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0836424-974ab30c-f69ad962-77601057_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:22.272942Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b0836424-974ab30c-f69ad962-77601057_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:22.273042Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:22.273060Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2968
2025-10-10T14:39:22.273242Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2968 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:22.273295Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2968 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:22.273307Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2968 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:22.273311Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:22.273833Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2968 sessionId:  describe result for acl check
2025-10-10T14:39:22.273872Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:22.273882Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:22.273884Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:22.273890Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602700563663687:3310] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:22.274510Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602700563663687:3310] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:22.276535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:22.276631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602700563663687:3310] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:22.281774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:22.282018Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:22.282032Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:22.282045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:22.282105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:22.282150Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602699781423191:7161]
2025-10-10T14:39:22.282175Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602700563663687:3310] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:22.282190Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602700563663687:3310] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:22.282194Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602700563663687:3310] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:22.282204Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2968 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:22.282817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:22.283116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:22.283170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:22.283525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:22.283590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:22.283596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:22.283597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:22.283598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:22.283600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:22.283601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:22.283603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:22.283604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:22.283606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:22.283607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:22.283608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:22.283611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:22.283613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:22.283620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:22.283633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:22.283637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:22.283641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:22.283646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:22.283650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:22.283655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:22.283659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:22.283663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:22.283668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:22.283672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:22.283677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:22.283681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:22.283689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:22.283712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:22.283727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:22.283733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:22.283737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:22.283743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:22.283747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:22.283753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:22.283758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:22.283763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:22.283766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:22.283771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:22.283775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:22.283781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:22.283785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:22.283790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:22.283798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:22.283809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:22.283813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:22.283817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:22.283821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:22.283825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:22.283829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:22.283834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:22.283839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:22.283848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:22.283887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:22.286375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:22.287169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:22.287182Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:22.287185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:22.287189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:22.287195Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2967 [2:7559602699781423191:7161]
2025-10-10T14:39:22.287208Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:22.287226Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:22.287236Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:22.287240Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:22.287242Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:22.287258Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:22.287266Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:22.287274Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:22.287336Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:22.287344Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:22.287346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:22.287348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:22.287419Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:22.287427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:22.287441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:22.287459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:22.287484Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:22.287510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602700563663669:2438], now have 1 active actors on pipe
2025-10-10T14:39:22.287519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602700563663719:3310], now have 1 active actors on pipe
2025-10-10T14:39:22.287527Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602699781423185:7161]
2025-10-10T14:39:22.287530Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602699781423185:7161]
2025-10-10T14:39:22.287532Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602699781423185:7161]
2025-10-10T14:39:22.287547Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:22.287564Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:22.287564Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:22.287571Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:22.287573Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:22.287583Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:22.287586Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:22.287585Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2967
2025-10-10T14:39:22.287610Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602699781423185:7161]
2025-10-10T14:39:22.287619Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:22.287629Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:22.287634Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2967
2025-10-10T14:39:22.287749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:22.287777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:22.287821Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f3425b2c-1e365e8c-d1e32814-58ff05db_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:22.287836Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:22.287841Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:22.287849Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:22.287862Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:22.287880Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:22.287900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:22.288100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:22.288113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:22.288137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:22.288243Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2968 partition: 0 MaxSeqNo: 40 sessionId: src_id|f3425b2c-1e365e8c-d1e32814-58ff05db_0
2025-10-10T14:39:22.288694Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0836424-974ab30c-f69ad962-77601057_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|f3425b2c-1e365e8c-d1e32814-58ff05db_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:22.291583Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f3425b2c-1e365e8c-d1e32814-58ff05db_0] Write session: try to update token
2025-10-10T14:39:22.291604Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f3425b2c-1e365e8c-d1e32814-58ff05db_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:22.299227Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:39:22.299246Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:22.299260Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602699781423185:7161]
2025-10-10T14:39:22.299313Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:39:22.299344Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:39:22.299486Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:39:22.299623Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:22.299756Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:22.299884Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:22.300194Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:39:22.300243Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:39:22.308478Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2968 sessionId: src_id|f3425b2c-1e365e8c-d1e32814-58ff05db_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:22.311413Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:22.311896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:22.311921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:22.311974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:39:22.312079Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:39:22.317569Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:22.317590Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:22.317593Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:22.317596Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:22.317606Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602699781423185:7161]
2025-10-10T14:39:22.317611Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602699781423185:7161]
2025-10-10T14:39:22.317616Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602699781423185:7161]
2025-10-10T14:39:22.317667Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:22.317670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:22.317678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:22.317682Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:22.317681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:22.317686Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:22.317831Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:22.364621Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602700563663745:4699]
2025-10-10T14:39:22.364990Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 pipe creation result: OK TabletId: 72075186224037892 Generation: 2967, pipe: [1:7559602700563663745:4699]
2025-10-10T14:39:22.435574Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:22.445858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:22.445890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:22.446082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:22.446149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:22.446223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:22.446301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:22.446548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:22.446557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:22.446637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:22.446704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:22.446776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:22.446864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:22.446924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:22.446930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:22.447006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:22.447075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:22.447149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:22.447219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:22.447272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:22.447277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:22.447362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:22.447432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:22.447503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:22.447575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:22.447631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:22.447641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:22.447729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:22.447797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:22.447869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:22.447949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:22.448008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:22.448015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:22.448093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:22.448164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:22.448241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:22.448322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:22.448384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:22.448391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:22.448478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:22.448555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:22.448636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:22.448713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:22.448781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:22.448787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:22.448873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:22.448945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:22.449026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:22.449114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:22.449172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:22.449178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:22.449264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:22.449353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:22.449435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:22.449516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:22.449577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:22.449587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:22.449675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:22.449745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:22.449826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:22.449905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:22.449965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:22.449971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:22.450048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602700563663745:4699], now have 1 active actors on pipe
2025-10-10T14:39:22.450968Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3425b2c-1e365e8c-d1e32814-58ff05db_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:22.450988Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3425b2c-1e365e8c-d1e32814-58ff05db_0] Write session will restart in 0.009011s
2025-10-10T14:39:22.451015Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3425b2c-1e365e8c-d1e32814-58ff05db_0] Write session: Do CDS request
2025-10-10T14:39:22.451021Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3425b2c-1e365e8c-d1e32814-58ff05db_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:22.451315Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:22.450387Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 66 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602700563663745:4699]
2025-10-10T14:39:22.450437Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:22.450467Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:22.450471Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:22.450507Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2968 reason: error at write: Disconnected sessionId: src_id|f3425b2c-1e365e8c-d1e32814-58ff05db_0
2025-10-10T14:39:22.450764Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2968 sessionId: src_id|f3425b2c-1e365e8c-d1e32814-58ff05db_0 is DEAD
2025-10-10T14:39:22.460940Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f3425b2c-1e365e8c-d1e32814-58ff05db_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:22.461126Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:22.461145Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2969
2025-10-10T14:39:22.461281Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2969 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:22.461317Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2969 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:22.461328Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2969 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:22.461351Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:22.462319Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2969 sessionId:  describe result for acl check
2025-10-10T14:39:22.462363Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:22.462370Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:22.462371Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:22.462378Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602700563663782:3259] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:22.462984Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602700563663782:3259] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:22.463180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:22.465667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602700563663782:3259] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:22.468563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:22.468798Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602700563663782:3259] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:22.468826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602700563663782:3259] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:22.468830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602700563663782:3259] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:22.468838Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2969 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:22.468850Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:22.468866Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:22.468879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:22.468947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:22.469000Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602699781423290:7144]
2025-10-10T14:39:22.469696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:22.470068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:22.470128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:22.470912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:22.470996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:22.471003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:22.471007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:22.471008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:22.471010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:22.471011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:22.471013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:22.471014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:22.471015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:22.471016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:22.471018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:22.471019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:22.471020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:22.471027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:22.471040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:22.471045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:22.471049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:22.471052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:22.471056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:22.471059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:22.471063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:22.471067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:22.471084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:22.471088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:22.471092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:22.471097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:22.471106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:22.471114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:22.471131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:22.471136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:22.471141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:22.471146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:22.471152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:22.471159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:22.471163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:22.471168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:22.471172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:22.471177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:22.471183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:22.471188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:22.471192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:22.471196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:22.471201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:22.471214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:22.471218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:22.471224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:22.471230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:22.471235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:22.471240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:22.471245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:22.471249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:22.471254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:22.471293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:22.474100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:22.474758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:22.474772Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:22.474774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:22.474777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:22.474784Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2968 [2:7559602699781423290:7144]
2025-10-10T14:39:22.474799Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:22.474817Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:22.474821Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:22.474824Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:22.474827Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:22.474847Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:22.474863Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:22.474876Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:22.474935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:22.474944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:22.474945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:22.474948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:22.475019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:22.475030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:22.475041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:22.475053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:22.475071Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:22.475091Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602699781423285:7144]
2025-10-10T14:39:22.475100Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602699781423285:7144]
2025-10-10T14:39:22.475102Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602699781423285:7144]
2025-10-10T14:39:22.475113Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:22.475124Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:22.475128Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:22.475128Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:22.475130Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:22.475143Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:22.475147Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:22.475158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602700563663808:3259], now have 1 active actors on pipe
2025-10-10T14:39:22.475161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602700563663760:2438], now have 1 active actors on pipe
2025-10-10T14:39:22.475183Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602699781423285:7144]
2025-10-10T14:39:22.475196Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:22.475207Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:22.475214Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2968
2025-10-10T14:39:22.475261Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2968
2025-10-10T14:39:22.475420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:22.475435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:22.475470Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2e269eec-29ed991a-756efcc5-892020ce_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:22.475478Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:22.475482Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:22.475484Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:22.475496Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:22.475509Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:22.475526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:22.475734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:22.475744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:22.475762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:22.475862Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2969 partition: 0 MaxSeqNo: 40 sessionId: src_id|2e269eec-29ed991a-756efcc5-892020ce_0
2025-10-10T14:39:22.476317Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3425b2c-1e365e8c-d1e32814-58ff05db_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|2e269eec-29ed991a-756efcc5-892020ce_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:22.488658Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2e269eec-29ed991a-756efcc5-892020ce_0] Write session: try to update token
2025-10-10T14:39:22.488685Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2e269eec-29ed991a-756efcc5-892020ce_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:22.498502Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:22.498526Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:22.498529Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:22.498531Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:22.498542Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602699781423285:7144]
2025-10-10T14:39:22.498547Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602699781423285:7144]
2025-10-10T14:39:22.498552Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602699781423285:7144]
2025-10-10T14:39:22.498610Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:22.498624Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:22.498627Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:22.498772Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:22.501399Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:22.501407Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:22.501412Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:22.511420Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2969 sessionId: src_id|2e269eec-29ed991a-756efcc5-892020ce_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:22.514007Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:22.550558Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602700563663821:4699]
2025-10-10T14:39:22.550851Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 pipe creation result: OK TabletId: 72075186224037892 Generation: 2968, pipe: [1:7559602700563663821:4699]
2025-10-10T14:39:22.621164Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:22.621509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:22.621527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:22.621553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602700563663821:4699], now have 1 active actors on pipe
2025-10-10T14:39:22.621851Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:22.622326Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e269eec-29ed991a-756efcc5-892020ce_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:22.622339Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e269eec-29ed991a-756efcc5-892020ce_0] Write session will restart in 0.009257s
2025-10-10T14:39:22.622370Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e269eec-29ed991a-756efcc5-892020ce_0] Write session: Do CDS request
2025-10-10T14:39:22.622377Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e269eec-29ed991a-756efcc5-892020ce_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:22.621848Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:22.621874Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:22.621943Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2969 reason: error at write: Disconnected sessionId: src_id|2e269eec-29ed991a-756efcc5-892020ce_0
2025-10-10T14:39:22.622151Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2969 sessionId: src_id|2e269eec-29ed991a-756efcc5-892020ce_0 is DEAD
2025-10-10T14:39:22.622192Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:22.622252Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 67 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602700563663821:4699]
2025-10-10T14:39:22.632975Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2e269eec-29ed991a-756efcc5-892020ce_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:22.633067Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:22.633102Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2970
2025-10-10T14:39:22.633297Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2970 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:22.633354Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2970 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:22.633366Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2970 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:22.633374Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:22.633530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:22.633876Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2970 sessionId:  describe result for acl check
2025-10-10T14:39:22.633915Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:22.633923Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:22.633925Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:22.633932Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602700563663846:3233] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:22.634532Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602700563663846:3233] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:22.639066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:22.639346Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:22.639359Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:22.639372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:22.639451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:22.639502Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602699781423363:7140]
2025-10-10T14:39:22.639905Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602700563663846:3233] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:22.640173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:22.640504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:22.640574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:22.640929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:22.640995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:22.641003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:22.641004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:22.641006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:22.641007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:22.641009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:22.641010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:22.641012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:22.641013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:22.641014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:22.641015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:22.641017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:22.641018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:22.641024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:22.641038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:22.641045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:22.641050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:22.641054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:22.641058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:22.641062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:22.641066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:22.641070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:22.641075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:22.641079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:22.641099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:22.641103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:22.641112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:22.641126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:22.641142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:22.641148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:22.641160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:22.641166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:22.641171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:22.641177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:22.641182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:22.641188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:22.641193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:22.641199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:22.641204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:22.641210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:22.641215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:22.641220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:22.641225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:22.641232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:22.641237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:22.641249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:22.641254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:22.641260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:22.641264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:22.641269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:22.641274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:22.641279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:22.641345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:22.643832Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602700563663846:3233] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:22.643850Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602700563663846:3233] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:22.643854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602700563663846:3233] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:22.643864Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2970 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:22.643887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:22.644775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:22.644791Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:22.644794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:22.644799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:22.644806Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2969 [2:7559602699781423363:7140]
2025-10-10T14:39:22.644819Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:22.644840Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:22.644844Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:22.644847Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:22.644852Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:22.644869Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:22.644881Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:22.644889Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:22.644955Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:22.644962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:22.644965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:22.644968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:22.645035Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:22.645045Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:22.645057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:22.645068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:22.645098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:22.645121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602700563663823:2438], now have 1 active actors on pipe
2025-10-10T14:39:22.645128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602700563663880:3233], now have 1 active actors on pipe
2025-10-10T14:39:22.645137Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602699781423357:7140]
2025-10-10T14:39:22.645142Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602699781423357:7140]
2025-10-10T14:39:22.645144Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602699781423357:7140]
2025-10-10T14:39:22.645159Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:22.645179Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:22.645197Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:22.645205Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:22.645232Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602699781423357:7140]
2025-10-10T14:39:22.645232Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:22.645235Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:22.645238Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:22.645240Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:22.645246Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:22.645225Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2969
2025-10-10T14:39:22.645228Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2969
2025-10-10T14:39:22.645395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:22.645408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:22.645462Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c66854dd-22b79b76-ded6f398-9dd55793_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:22.645477Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:22.645481Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:22.645484Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:22.645496Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:22.645508Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:22.645524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:22.645718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:22.645727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:22.645744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:22.645842Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2970 partition: 0 MaxSeqNo: 40 sessionId: src_id|c66854dd-22b79b76-ded6f398-9dd55793_0
2025-10-10T14:39:22.646299Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e269eec-29ed991a-756efcc5-892020ce_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|c66854dd-22b79b76-ded6f398-9dd55793_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:22.649114Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c66854dd-22b79b76-ded6f398-9dd55793_0] Write session: try to update token
2025-10-10T14:39:22.649142Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c66854dd-22b79b76-ded6f398-9dd55793_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:22.665926Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2970 sessionId: src_id|c66854dd-22b79b76-ded6f398-9dd55793_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:22.666198Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:22.666217Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:22.666220Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:22.666223Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:22.666236Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602699781423357:7140]
2025-10-10T14:39:22.666242Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602699781423357:7140]
2025-10-10T14:39:22.666245Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602699781423357:7140]
2025-10-10T14:39:22.666298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:22.666309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:22.666311Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:22.666355Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:22.666370Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:22.666375Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:22.666455Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:22.668846Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:22.722028Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602700563663888:4699]
2025-10-10T14:39:22.722352Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 pipe creation result: OK TabletId: 72075186224037892 Generation: 2969, pipe: [1:7559602700563663888:4699]
2025-10-10T14:39:22.785855Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:22.786402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:22.786416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:22.786461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602700563663888:4699], now have 1 active actors on pipe
2025-10-10T14:39:22.786686Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:22.786720Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 68 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602700563663888:4699]
2025-10-10T14:39:22.786726Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:22.786774Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:22.786778Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:22.786855Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2970 reason: error at write: Disconnected sessionId: src_id|c66854dd-22b79b76-ded6f398-9dd55793_0
2025-10-10T14:39:22.787075Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2970 sessionId: src_id|c66854dd-22b79b76-ded6f398-9dd55793_0 is DEAD
2025-10-10T14:39:22.787234Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c66854dd-22b79b76-ded6f398-9dd55793_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:22.787246Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c66854dd-22b79b76-ded6f398-9dd55793_0] Write session will restart in 0.007113s
2025-10-10T14:39:22.787272Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c66854dd-22b79b76-ded6f398-9dd55793_0] Write session: Do CDS request
2025-10-10T14:39:22.787281Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c66854dd-22b79b76-ded6f398-9dd55793_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:22.795896Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c66854dd-22b79b76-ded6f398-9dd55793_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:22.796024Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:22.796042Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2971
2025-10-10T14:39:22.796153Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2971 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:22.796202Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2971 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:22.796213Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2971 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:22.796217Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:22.796665Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2971 sessionId:  describe result for acl check
2025-10-10T14:39:22.796702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:22.796704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:22.796706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:22.796713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602700563663922:3221] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:22.797303Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602700563663922:3221] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:22.799267Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602700563663922:3221] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:22.803696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:22.803829Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602700563663922:3221] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:22.803849Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602700563663922:3221] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:22.803853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602700563663922:3221] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:22.803862Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2971 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:22.804254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:22.804483Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:22.804498Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:22.804511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:22.804571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:22.804623Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602699781423426:7134]
2025-10-10T14:39:22.805306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:22.805657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:22.805714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:22.806068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:22.806152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:22.806160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:22.806161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:22.806163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:22.806164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:22.806165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:22.806167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:22.806168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:22.806169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:22.806171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:22.806172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:22.806174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:22.806175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:22.806181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:22.806195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:22.806199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:22.806203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:22.806207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:22.806211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:22.806216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:22.806219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:22.806223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:22.806227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:22.806231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:22.806234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:22.806238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:22.806246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:22.806255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:22.806263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:22.806269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:22.806284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:22.806293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:22.806297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:22.806303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:22.806313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:22.806318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:22.806327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:22.806332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:22.806341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:22.806345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:22.806349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:22.806354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:22.806359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:22.806364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:22.806368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:22.806373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:22.806379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:22.806383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:22.806387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:22.806392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:22.806395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:22.806400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:22.806437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:22.808868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:22.809256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:22.809274Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:22.809277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:22.809281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:22.809288Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2970 [2:7559602699781423426:7134]
2025-10-10T14:39:22.809302Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:22.809323Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:22.809327Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:22.809347Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:22.809350Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:22.809367Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:22.809383Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:22.809396Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:22.809466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:22.809476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:22.809478Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:22.809481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:22.809556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:22.809566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:22.809589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:22.809603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:22.809626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:22.809653Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602699781423420:7134]
2025-10-10T14:39:22.809659Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602699781423420:7134]
2025-10-10T14:39:22.809662Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602699781423420:7134]
2025-10-10T14:39:22.809678Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:22.809698Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:22.809699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602700563663901:2438], now have 1 active actors on pipe
2025-10-10T14:39:22.809703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602700563663955:3221], now have 1 active actors on pipe
2025-10-10T14:39:22.809713Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:22.809721Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:22.809724Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:22.809729Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:22.809733Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:22.809736Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2970
2025-10-10T14:39:22.809756Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2970
2025-10-10T14:39:22.809761Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602699781423420:7134]
2025-10-10T14:39:22.809775Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:22.809776Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:22.809807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:22.809812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:22.809852Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9af7de63-ab85e4d9-fc4499d0-5085e48e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:22.809867Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:22.809878Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:22.809881Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:22.809893Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:22.809904Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:22.809926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:22.810087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:22.810101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:22.810120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:22.810229Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2971 partition: 0 MaxSeqNo: 40 sessionId: src_id|9af7de63-ab85e4d9-fc4499d0-5085e48e_0
2025-10-10T14:39:22.810712Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c66854dd-22b79b76-ded6f398-9dd55793_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|9af7de63-ab85e4d9-fc4499d0-5085e48e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:22.813492Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9af7de63-ab85e4d9-fc4499d0-5085e48e_0] Write session: try to update token
2025-10-10T14:39:22.813511Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9af7de63-ab85e4d9-fc4499d0-5085e48e_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:22.828080Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2971 sessionId: src_id|9af7de63-ab85e4d9-fc4499d0-5085e48e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:22.830178Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:22.830204Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:22.830208Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:22.830211Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:22.830222Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602699781423420:7134]
2025-10-10T14:39:22.830227Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602699781423420:7134]
2025-10-10T14:39:22.830233Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602699781423420:7134]
2025-10-10T14:39:22.830288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:22.830289Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:22.830297Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:22.830305Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:22.830306Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:22.830307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:22.830455Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:22.830969Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:22.886847Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602700563663975:4699]
2025-10-10T14:39:22.887113Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 pipe creation result: OK TabletId: 72075186224037892 Generation: 2970, pipe: [1:7559602700563663975:4699]
2025-10-10T14:39:22.953273Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:22.953591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:22.953612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:22.953660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602700563663975:4699], now have 1 active actors on pipe
2025-10-10T14:39:22.953847Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:22.953868Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 69 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602700563663975:4699]
2025-10-10T14:39:22.953906Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:22.953908Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:22.953909Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:22.953971Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2971 reason: error at write: Disconnected sessionId: src_id|9af7de63-ab85e4d9-fc4499d0-5085e48e_0
2025-10-10T14:39:22.954208Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2971 sessionId: src_id|9af7de63-ab85e4d9-fc4499d0-5085e48e_0 is DEAD
2025-10-10T14:39:22.954437Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9af7de63-ab85e4d9-fc4499d0-5085e48e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:22.954449Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9af7de63-ab85e4d9-fc4499d0-5085e48e_0] Write session will restart in 0.009982s
2025-10-10T14:39:22.954482Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9af7de63-ab85e4d9-fc4499d0-5085e48e_0] Write session: Do CDS request
2025-10-10T14:39:22.954489Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9af7de63-ab85e4d9-fc4499d0-5085e48e_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:22.966171Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9af7de63-ab85e4d9-fc4499d0-5085e48e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:22.966295Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:22.966327Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2972
2025-10-10T14:39:22.966492Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2972 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:22.966546Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2972 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:22.966554Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2972 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:22.966558Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:22.967117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:22.967149Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2972 sessionId:  describe result for acl check
2025-10-10T14:39:22.967192Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:22.967199Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:22.967201Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:22.967209Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602700563664004:3193] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:22.967820Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602700563664004:3193] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:22.969991Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602700563664004:3193] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:22.971759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:22.972080Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:22.972096Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:22.972112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:22.972184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:22.972234Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602699781423488:7138]
2025-10-10T14:39:22.972899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:22.973248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:22.973305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:22.973408Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602700563664004:3193] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:22.973423Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602700563664004:3193] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:22.973426Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602700563664004:3193] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:22.973435Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2972 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:22.973699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:22.973776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:22.973786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:22.973787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:22.973789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:22.973790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:22.973792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:22.973793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:22.973795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:22.973797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:22.973798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:22.973802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:22.973804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:22.973805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:22.973813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:22.973827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:22.973832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:22.973836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:22.973841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:22.973845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:22.973850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:22.973854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:22.973858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:22.973863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:22.973867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:22.973872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:22.973876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:22.973885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:22.973895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:22.973903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:22.973909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:22.973916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:22.973922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:22.973927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:22.973933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:22.973938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:22.973944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:22.973959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:22.973965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:22.973973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:22.973979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:22.973983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:22.973990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:22.973995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:22.974001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:22.974005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:22.974011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:22.974016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:22.974021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:22.974026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:22.974032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:22.974037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:22.974042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:22.974098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:22.976678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:22.977534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:22.977542Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:22.977543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:22.977547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:22.977551Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2971 [2:7559602699781423488:7138]
2025-10-10T14:39:22.977563Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:22.977578Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:22.977580Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:22.977583Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:22.977584Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:22.977602Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:22.977611Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:22.977631Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:22.977696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:22.977701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:22.977702Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:22.977704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:22.977767Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:22.977776Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:22.977784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:22.977791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:22.977801Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:22.977819Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602699781423483:7138]
2025-10-10T14:39:22.977822Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602699781423483:7138]
2025-10-10T14:39:22.977823Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602699781423483:7138]
2025-10-10T14:39:22.977829Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:22.977843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602700563663979:2438], now have 1 active actors on pipe
2025-10-10T14:39:22.977843Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:22.977846Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:22.977849Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:22.977857Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:22.977871Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:22.977874Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:22.977879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602700563664033:3193], now have 1 active actors on pipe
2025-10-10T14:39:22.977902Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602699781423483:7138]
2025-10-10T14:39:22.977909Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:22.977916Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:22.977927Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2971
2025-10-10T14:39:22.977940Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2971
2025-10-10T14:39:22.978044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:22.978068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:22.978102Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a201b57-3ed928d9-2a5f87cd-bcc40f43_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:22.978116Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:22.978125Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:22.978128Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:22.978140Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:22.978157Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:22.978176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:22.978327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:22.978337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:22.978352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:22.978463Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2972 partition: 0 MaxSeqNo: 40 sessionId: src_id|a201b57-3ed928d9-2a5f87cd-bcc40f43_0
2025-10-10T14:39:22.978903Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9af7de63-ab85e4d9-fc4499d0-5085e48e_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|a201b57-3ed928d9-2a5f87cd-bcc40f43_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:22.982081Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a201b57-3ed928d9-2a5f87cd-bcc40f43_0] Write session: try to update token
2025-10-10T14:39:22.982100Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a201b57-3ed928d9-2a5f87cd-bcc40f43_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:22.997864Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:22.997884Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:22.997887Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:22.997890Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:22.997900Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602699781423483:7138]
2025-10-10T14:39:22.997904Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602699781423483:7138]
2025-10-10T14:39:22.997909Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602699781423483:7138]
2025-10-10T14:39:22.997959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:22.997966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:22.997967Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:22.997969Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:22.997974Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:22.997979Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:22.998120Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:23.000517Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2972 sessionId: src_id|a201b57-3ed928d9-2a5f87cd-bcc40f43_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:23.003489Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:23.054286Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602704858631339:4699]
2025-10-10T14:39:23.054588Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 pipe creation result: OK TabletId: 72075186224037892 Generation: 2971, pipe: [1:7559602704858631339:4699]
2025-10-10T14:39:23.116749Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:23.117380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:23.117401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:23.117456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602704858631339:4699], now have 1 active actors on pipe
2025-10-10T14:39:23.117721Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:23.117844Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:23.117914Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 70 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602704858631339:4699]
2025-10-10T14:39:23.117934Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:39:23.118024Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2972 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a201b57-3ed928d9-2a5f87cd-bcc40f43_0
2025-10-10T14:39:23.118220Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2972 sessionId: src_id|a201b57-3ed928d9-2a5f87cd-bcc40f43_0 is DEAD
2025-10-10T14:39:23.118534Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a201b57-3ed928d9-2a5f87cd-bcc40f43_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:39:23.118546Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a201b57-3ed928d9-2a5f87cd-bcc40f43_0] Write session will restart in 0.008823s
2025-10-10T14:39:23.118570Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a201b57-3ed928d9-2a5f87cd-bcc40f43_0] Write session: Do CDS request
2025-10-10T14:39:23.118576Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a201b57-3ed928d9-2a5f87cd-bcc40f43_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:23.128997Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a201b57-3ed928d9-2a5f87cd-bcc40f43_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:23.129107Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:23.129122Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2973
2025-10-10T14:39:23.129234Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2973 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:23.129271Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2973 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:23.129282Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2973 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:23.129286Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:23.129759Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2973 sessionId:  describe result for acl check
2025-10-10T14:39:23.129795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:23.129797Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:23.129798Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:23.129805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602704858631366:3188] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:23.130362Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602704858631366:3188] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:23.132698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602704858631366:3188] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:23.135369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:23.135457Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602704858631366:3188] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:23.135473Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602704858631366:3188] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:23.135476Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602704858631366:3188] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:23.135486Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2973 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:23.136002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:23.136232Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:23.136243Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:23.136255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:23.136312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:23.136363Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602704076390849:7135]
2025-10-10T14:39:23.136993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:23.137390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:23.137486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:23.137869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:23.137940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:23.137947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:23.137948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:23.137949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:23.137950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:23.137951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:23.137952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:23.137954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:23.137955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:23.137956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:23.137958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:23.137959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:23.137960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:23.137967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:23.137981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:23.137986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:23.137989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:23.137992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:23.137996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:23.138000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:23.138004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:23.138007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:23.138012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:23.138016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:23.138020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:23.138024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:23.138033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:23.138042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:23.138048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:23.138056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:23.138060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:23.138065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:23.138069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:23.138074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:23.138079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:23.138084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:23.138089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:23.138095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:23.138100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:23.138106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:23.138111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:23.138123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:23.138127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:23.138132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:23.138140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:23.138145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:23.138149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:23.138153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:23.138158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:23.138167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:23.138172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:23.138177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:23.138222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:23.140844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:23.141786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:23.141802Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:23.141806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:23.141811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:23.141818Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2972 [2:7559602704076390849:7135]
2025-10-10T14:39:23.141838Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:23.141858Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:23.141870Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:23.141874Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:23.141876Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:23.141895Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:23.141908Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:23.141921Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:23.141991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:23.141997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:23.141999Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:23.142002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:23.142077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:23.142084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:23.142098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:23.142112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:23.142133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:23.142165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602704858631340:2438], now have 1 active actors on pipe
2025-10-10T14:39:23.142173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602704858631396:3188], now have 1 active actors on pipe
2025-10-10T14:39:23.142182Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602704076390843:7135]
2025-10-10T14:39:23.142189Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602704076390843:7135]
2025-10-10T14:39:23.142190Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602704076390843:7135]
2025-10-10T14:39:23.142209Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:23.142228Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:23.142236Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:23.142239Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:23.142242Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:23.142249Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:23.142252Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:23.142232Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2972
2025-10-10T14:39:23.142236Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2972
2025-10-10T14:39:23.142286Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602704076390843:7135]
2025-10-10T14:39:23.142296Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:23.142304Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:23.142318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:23.142324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:23.142380Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4123539a-560012ea-ce46c516-45423772_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:23.142392Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:23.142395Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:23.142400Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:23.142411Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:23.142427Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:23.142444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:23.142684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:23.142697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:23.142723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:23.142828Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2973 partition: 0 MaxSeqNo: 40 sessionId: src_id|4123539a-560012ea-ce46c516-45423772_0
2025-10-10T14:39:23.143311Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a201b57-3ed928d9-2a5f87cd-bcc40f43_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|4123539a-560012ea-ce46c516-45423772_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:23.146123Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4123539a-560012ea-ce46c516-45423772_0] Write session: try to update token
2025-10-10T14:39:23.146144Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4123539a-560012ea-ce46c516-45423772_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:23.160665Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2973 sessionId: src_id|4123539a-560012ea-ce46c516-45423772_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:23.161997Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:23.162020Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:23.162025Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:23.162027Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:23.162040Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602704076390843:7135]
2025-10-10T14:39:23.162043Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602704076390843:7135]
2025-10-10T14:39:23.162048Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602704076390843:7135]
2025-10-10T14:39:23.162106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:23.162106Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:23.162113Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:23.162114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:23.162116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:23.162117Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:23.162266Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:23.163561Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:23.218187Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602704858631409:4699]
2025-10-10T14:39:23.218517Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 pipe creation result: OK TabletId: 72075186224037892 Generation: 2972, pipe: [1:7559602704858631409:4699]
2025-10-10T14:39:23.279873Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:23.280440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:23.280458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:23.280507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602704858631409:4699], now have 1 active actors on pipe
2025-10-10T14:39:23.280741Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:23.280796Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 71 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602704858631409:4699]
2025-10-10T14:39:23.280839Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:23.280887Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:39:23.280989Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2973 reason: status is not ok: tablet will be restarted right now sessionId: src_id|4123539a-560012ea-ce46c516-45423772_0
2025-10-10T14:39:23.281235Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2973 sessionId: src_id|4123539a-560012ea-ce46c516-45423772_0 is DEAD
2025-10-10T14:39:23.281413Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4123539a-560012ea-ce46c516-45423772_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:39:23.281426Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4123539a-560012ea-ce46c516-45423772_0] Write session will restart in 0.009502s
2025-10-10T14:39:23.281463Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4123539a-560012ea-ce46c516-45423772_0] Write session: Do CDS request
2025-10-10T14:39:23.281470Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4123539a-560012ea-ce46c516-45423772_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:23.291921Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4123539a-560012ea-ce46c516-45423772_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:23.292002Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:23.292023Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2974
2025-10-10T14:39:23.292164Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2974 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:23.292221Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2974 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:23.292227Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2974 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:23.292232Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:23.292813Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2974 sessionId:  describe result for acl check
2025-10-10T14:39:23.292842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:23.292844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:23.292846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:23.292856Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602704858631421:3179] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:23.293512Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602704858631421:3179] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:23.296212Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602704858631421:3179] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:23.299277Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602704858631421:3179] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:23.299296Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602704858631421:3179] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:23.299300Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602704858631421:3179] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:23.299310Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2974 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:23.305482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:23.306522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:23.306742Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:23.306748Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:23.306762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:23.306825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:23.306866Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602704076390916:7125]
2025-10-10T14:39:23.307505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:23.307847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:23.307900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:23.308240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:23.308302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:23.308303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:23.308305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:23.308306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:23.308308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:23.308309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:23.308310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:23.308311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:23.308316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:23.308317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:23.308319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:23.308320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:23.308321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:23.308333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:23.308347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:23.308351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:23.308355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:23.308359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:23.308363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:23.308367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:23.308371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:23.308376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:23.308380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:23.308384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:23.308388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:23.308392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:23.308401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:23.308410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:23.308417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:23.308423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:23.308428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:23.308433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:23.308437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:23.308442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:23.308447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:23.308453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:23.308459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:23.308464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:23.308469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:23.308477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:23.308482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:23.308488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:23.308492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:23.308497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:23.308500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:23.308505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:23.308509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:23.308514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:23.308518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:23.308522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:23.308526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:23.308531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:23.308573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:23.311216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:23.312283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:23.312296Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:23.312299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:23.312303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:23.312311Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2973 [2:7559602704076390916:7125]
2025-10-10T14:39:23.312327Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:23.312347Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:23.312356Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:23.312362Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:23.312364Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:23.312382Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:23.312390Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:23.312404Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:23.312470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:23.312481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:23.312483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:23.312486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:23.312555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:23.312565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:23.312576Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:23.312588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:23.312604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:23.312627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602704858631465:3179], now have 1 active actors on pipe
2025-10-10T14:39:23.312635Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602704076390911:7125]
2025-10-10T14:39:23.312643Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602704076390911:7125]
2025-10-10T14:39:23.312645Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602704076390911:7125]
2025-10-10T14:39:23.312659Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:23.312669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602704858631410:2438], now have 1 active actors on pipe
2025-10-10T14:39:23.312678Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:23.312683Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:23.312686Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:23.312689Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:23.312694Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:23.312697Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:23.312730Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602704076390911:7125]
2025-10-10T14:39:23.312739Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:23.312713Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2973
2025-10-10T14:39:23.312741Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:23.312778Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2973
2025-10-10T14:39:23.312862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:23.312874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:23.312906Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9bee0c7c-7e4650a7-d50c26d4-2418464_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:23.312919Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:23.312923Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:23.312926Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:23.312938Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:23.312949Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:23.312967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:23.313135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:23.313145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:23.313161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:23.313269Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2974 partition: 0 MaxSeqNo: 40 sessionId: src_id|9bee0c7c-7e4650a7-d50c26d4-2418464_0
2025-10-10T14:39:23.313734Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4123539a-560012ea-ce46c516-45423772_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|9bee0c7c-7e4650a7-d50c26d4-2418464_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:23.316684Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9bee0c7c-7e4650a7-d50c26d4-2418464_0] Write session: try to update token
2025-10-10T14:39:23.316704Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9bee0c7c-7e4650a7-d50c26d4-2418464_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:23.325042Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:39:23.325065Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:23.325088Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602704076390911:7125]
2025-10-10T14:39:23.325150Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:39:23.325249Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:39:23.325392Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:39:23.325562Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:23.325747Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:23.325908Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:23.326130Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:39:23.326187Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:39:23.332671Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2974 sessionId: src_id|9bee0c7c-7e4650a7-d50c26d4-2418464_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:23.335734Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:23.336037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:23.336063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:23.336109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:39:23.336241Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:39:23.346121Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:23.346139Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:23.346142Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:23.346145Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:23.346158Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602704076390911:7125]
2025-10-10T14:39:23.346161Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602704076390911:7125]
2025-10-10T14:39:23.346164Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602704076390911:7125]
2025-10-10T14:39:23.346219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:23.346227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:23.346237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:23.346241Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:23.346249Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:23.346254Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:23.346378Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:23.380962Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602704858631479:4699]
2025-10-10T14:39:23.381253Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 pipe creation result: OK TabletId: 72075186224037892 Generation: 2973, pipe: [1:7559602704858631479:4699]
2025-10-10T14:39:23.464972Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:23.474035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:23.474064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:23.474263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:23.474334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:23.474406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:23.474476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:23.474833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:23.474851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:23.474933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:23.475005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:23.475126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:23.475208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:23.475258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:23.475266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:23.475342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:23.475409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:23.475481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:23.475560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:23.475614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:23.475624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:23.475703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:23.475775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:23.475853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:23.475924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:23.475974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:23.475982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:23.476063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:23.476134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:23.476216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:23.476290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:23.476339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:23.476346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:23.476422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:23.476495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:23.476568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:23.476644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:23.476702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:23.476710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:23.476783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:23.476856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:23.476935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:23.477002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:23.477051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:23.477060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:23.477150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:23.477226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:23.477299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:23.477394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:23.477449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:23.477462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:23.477541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:23.477612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:23.477681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:23.477752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:23.477803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:23.477810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:23.477884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:23.477954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:23.478045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:23.478115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:23.478158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:23.478161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:23.478237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602704858631479:4699], now have 1 active actors on pipe
2025-10-10T14:39:23.479655Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:23.479729Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:23.479750Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:23.479784Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2974 reason: error at write: Disconnected sessionId: src_id|9bee0c7c-7e4650a7-d50c26d4-2418464_0
2025-10-10T14:39:23.480026Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2974 sessionId: src_id|9bee0c7c-7e4650a7-d50c26d4-2418464_0 is DEAD
2025-10-10T14:39:23.480116Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:23.480167Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 72 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602704858631479:4699]
2025-10-10T14:39:23.480386Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9bee0c7c-7e4650a7-d50c26d4-2418464_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:23.480398Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9bee0c7c-7e4650a7-d50c26d4-2418464_0] Write session will restart in 0.008632s
2025-10-10T14:39:23.480425Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9bee0c7c-7e4650a7-d50c26d4-2418464_0] Write session: Do CDS request
2025-10-10T14:39:23.480431Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9bee0c7c-7e4650a7-d50c26d4-2418464_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:23.490331Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9bee0c7c-7e4650a7-d50c26d4-2418464_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:23.490420Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:23.490438Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2975
2025-10-10T14:39:23.490601Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2975 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:23.490639Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2975 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:23.490651Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2975 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:23.490655Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:23.491261Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2975 sessionId:  describe result for acl check
2025-10-10T14:39:23.491293Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:23.491296Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:23.491298Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:23.491306Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602704858631533:3139] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:23.491865Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602704858631533:3139] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:23.494338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:23.494754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602704858631533:3139] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:23.499885Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602704858631533:3139] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:23.499901Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602704858631533:3139] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:23.499905Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602704858631533:3139] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:23.499915Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2975 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:23.499920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:23.500201Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:23.500215Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:23.500229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:23.500302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:23.500351Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602704076391019:7087]
2025-10-10T14:39:23.500951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:23.503805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:23.503881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:23.504302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:23.504400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:23.504408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:23.504409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:23.504410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:23.504412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:23.504414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:23.504415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:23.504417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:23.504419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:23.504420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:23.504421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:23.504422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:23.504423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:23.504432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:23.504445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:23.504448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:23.504452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:23.504455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:23.504459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:23.504462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:23.504466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:23.504469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:23.504473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:23.504477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:23.504481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:23.504484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:23.504493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:23.504503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:23.504514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:23.504520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:23.504524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:23.504529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:23.504534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:23.504539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:23.504544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:23.504549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:23.504553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:23.504559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:23.504564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:23.504570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:23.504575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:23.504580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:23.504584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:23.504591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:23.504619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:23.504624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:23.504629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:23.504634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:23.504637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:23.504643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:23.504647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:23.504657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:23.504701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:23.507566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:23.507924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:23.507938Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:23.507941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:23.507945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:23.507952Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2974 [2:7559602704076391019:7087]
2025-10-10T14:39:23.507967Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:23.507997Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:23.508004Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:23.508008Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:23.508011Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:23.508029Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:23.508042Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:23.508050Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:23.508120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:23.508127Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:23.508129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:23.508132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:23.508382Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2974
2025-10-10T14:39:23.508411Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2974
2025-10-10T14:39:23.508651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:23.508664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:23.508676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:23.508687Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:23.508702Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:23.508730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602704858631508:2438], now have 1 active actors on pipe
2025-10-10T14:39:23.508739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602704858631563:3139], now have 1 active actors on pipe
2025-10-10T14:39:23.508761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:23.508770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:23.508791Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602704076391013:7087]
2025-10-10T14:39:23.508797Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602704076391013:7087]
2025-10-10T14:39:23.508799Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602704076391013:7087]
2025-10-10T14:39:23.508815Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:23.508832Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:23.508836Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:23.508842Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:23.508845Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:23.508854Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:23.508859Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:23.508886Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|40b0de7f-54e9d073-60e6ac7a-31def6ad_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:23.508900Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:23.508908Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:23.508910Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:23.508922Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:23.508935Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:23.508972Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602704076391013:7087]
2025-10-10T14:39:23.508985Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:23.508996Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:23.508999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:23.509188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:23.509201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:23.509224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:23.509368Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2975 partition: 0 MaxSeqNo: 40 sessionId: src_id|40b0de7f-54e9d073-60e6ac7a-31def6ad_0
2025-10-10T14:39:23.509751Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9bee0c7c-7e4650a7-d50c26d4-2418464_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|40b0de7f-54e9d073-60e6ac7a-31def6ad_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:23.512687Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|40b0de7f-54e9d073-60e6ac7a-31def6ad_0] Write session: try to update token
2025-10-10T14:39:23.512711Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|40b0de7f-54e9d073-60e6ac7a-31def6ad_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:23.529298Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2975 sessionId: src_id|40b0de7f-54e9d073-60e6ac7a-31def6ad_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:23.532029Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:39:23.532049Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:23.532064Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602704076391013:7087]
2025-10-10T14:39:23.532121Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:39:23.532324Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:39:23.532506Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:23.532552Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:23.532654Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:23.532800Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:23.533024Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:39:23.533114Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:39:23.533220Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:39:23.533317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:23.533344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:23.533388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:39:23.533526Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:39:23.546983Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:23.547001Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:23.547004Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:23.547008Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:23.547018Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602704076391013:7087]
2025-10-10T14:39:23.547020Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602704076391013:7087]
2025-10-10T14:39:23.547023Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602704076391013:7087]
2025-10-10T14:39:23.547071Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:23.547074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:23.547077Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:23.547081Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:23.547082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:23.547084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:23.547230Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:23.581535Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602704858631575:4699]
2025-10-10T14:39:23.581864Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 pipe creation result: OK TabletId: 72075186224037892 Generation: 2974, pipe: [1:7559602704858631575:4699]
2025-10-10T14:39:23.688966Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:23.698294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:23.698331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:23.698523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:23.698600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:23.698672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:23.698742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:23.698792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:23.698803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:23.698880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:23.698952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:23.699021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:23.699103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:23.699157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:23.699164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:23.699245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:23.699311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:23.699385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:23.699459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:23.699512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:23.699519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:23.699590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:23.699658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:23.699727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:23.699792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:23.699842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:23.699853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:23.699926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:23.699992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:23.700063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:23.700128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:23.700187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:23.700195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:23.700264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:23.700334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:23.700407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:23.700481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:23.700527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:23.700534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:23.700609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:23.700679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:23.700746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:23.700821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:23.700872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:23.700881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:23.700953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:23.701020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:23.701105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:23.701176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:23.701320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:23.701346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:23.701419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:23.701488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:23.701554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:23.701619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:23.701669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:23.701677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:23.701753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:23.701822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:23.701891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:23.701957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:23.702010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:23.702018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:23.702084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602704858631575:4699], now have 1 active actors on pipe
2025-10-10T14:39:23.702428Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:23.702432Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 73 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602704858631575:4699]
2025-10-10T14:39:23.702464Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:23.702467Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:23.702498Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2975 reason: error at write: Disconnected sessionId: src_id|40b0de7f-54e9d073-60e6ac7a-31def6ad_0
2025-10-10T14:39:23.702704Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2975 sessionId: src_id|40b0de7f-54e9d073-60e6ac7a-31def6ad_0 is DEAD
2025-10-10T14:39:23.702886Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40b0de7f-54e9d073-60e6ac7a-31def6ad_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:23.702898Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40b0de7f-54e9d073-60e6ac7a-31def6ad_0] Write session will restart in 0.009544s
2025-10-10T14:39:23.702925Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40b0de7f-54e9d073-60e6ac7a-31def6ad_0] Write session: Do CDS request
2025-10-10T14:39:23.702932Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40b0de7f-54e9d073-60e6ac7a-31def6ad_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:23.703160Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:23.714010Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|40b0de7f-54e9d073-60e6ac7a-31def6ad_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:23.714087Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:23.714111Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2976
2025-10-10T14:39:23.714293Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2976 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:23.714332Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2976 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:23.714343Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2976 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:23.714346Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:23.714819Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2976 sessionId:  describe result for acl check
2025-10-10T14:39:23.714858Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:23.714860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:23.714862Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:23.714868Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602704858631607:3133] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:23.715264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:23.715448Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602704858631607:3133] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:23.719248Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602704858631607:3133] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:23.720604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:23.720885Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:23.720899Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:23.720914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:23.721008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:23.721074Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602704076391096:7082]
2025-10-10T14:39:23.721732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:23.722141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:23.722196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:23.722554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:23.722624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:23.722631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:23.722632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:23.722620Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602704858631607:3133] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:23.722633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:23.722636Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602704858631607:3133] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:23.722635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:23.722640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602704858631607:3133] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:23.722637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:23.722650Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2976 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:23.722638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:23.722639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:23.722641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:23.722642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:23.722643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:23.722644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:23.722646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:23.722654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:23.722668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:23.722672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:23.722677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:23.722680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:23.722684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:23.722687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:23.722690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:23.722693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:23.722697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:23.722701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:23.722704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:23.722708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:23.722717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:23.722728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:23.722734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:23.722740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:23.722747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:23.722753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:23.722757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:23.722761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:23.722765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:23.722770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:23.722775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:23.722781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:23.722786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:23.722792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:23.722797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:23.722803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:23.722808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:23.722813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:23.722818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:23.722824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:23.722832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:23.722838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:23.722847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:23.722853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:23.722858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:23.722863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:23.722901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:23.725368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:23.726117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:23.726136Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:23.726138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:23.726143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:23.726150Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2975 [2:7559602704076391096:7082]
2025-10-10T14:39:23.726164Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:23.726183Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:23.726187Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:23.726191Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:23.726193Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:23.726209Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:23.726223Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:23.726235Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:23.726294Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:23.726301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:23.726303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:23.726306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:23.726382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:23.726390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:23.726402Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:23.726418Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:23.726442Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:23.726473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602704858631578:2438], now have 1 active actors on pipe
2025-10-10T14:39:23.726481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602704858631650:3133], now have 1 active actors on pipe
2025-10-10T14:39:23.726489Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602704076391091:7082]
2025-10-10T14:39:23.726492Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602704076391091:7082]
2025-10-10T14:39:23.726494Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602704076391091:7082]
2025-10-10T14:39:23.726513Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:23.726528Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:23.726519Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2975
2025-10-10T14:39:23.726519Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2975
2025-10-10T14:39:23.726551Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:23.726562Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:23.726563Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:23.726565Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:23.726566Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:23.726592Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602704076391091:7082]
2025-10-10T14:39:23.726595Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:23.726598Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:23.726619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:23.726624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:23.726680Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d99051c2-535dda7-c01936f4-91cf629c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:23.726694Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:23.726702Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:23.726705Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:23.726716Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:23.726732Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:23.726754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:23.726940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:23.726950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:23.726968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:23.727077Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2976 partition: 0 MaxSeqNo: 40 sessionId: src_id|d99051c2-535dda7-c01936f4-91cf629c_0
2025-10-10T14:39:23.727503Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40b0de7f-54e9d073-60e6ac7a-31def6ad_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|d99051c2-535dda7-c01936f4-91cf629c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:23.730387Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d99051c2-535dda7-c01936f4-91cf629c_0] Write session: try to update token
2025-10-10T14:39:23.730406Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d99051c2-535dda7-c01936f4-91cf629c_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:23.745535Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2976 sessionId: src_id|d99051c2-535dda7-c01936f4-91cf629c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:23.746532Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:23.746556Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:23.746560Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:23.746562Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:23.746572Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602704076391091:7082]
2025-10-10T14:39:23.746576Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602704076391091:7082]
2025-10-10T14:39:23.746581Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602704076391091:7082]
2025-10-10T14:39:23.746634Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:23.746635Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:23.746642Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:23.746648Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:23.746650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:23.746654Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:23.746802Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:23.748471Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:23.802289Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602704858631671:4699]
2025-10-10T14:39:23.802536Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 pipe creation result: OK TabletId: 72075186224037892 Generation: 2975, pipe: [1:7559602704858631671:4699]
2025-10-10T14:39:23.861210Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:23.861894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:23.861913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:23.861960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602704858631671:4699], now have 1 active actors on pipe
2025-10-10T14:39:23.862362Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:23.862423Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:23.862431Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:23.862495Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2976 reason: error at write: Disconnected sessionId: src_id|d99051c2-535dda7-c01936f4-91cf629c_0
2025-10-10T14:39:23.862747Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2976 sessionId: src_id|d99051c2-535dda7-c01936f4-91cf629c_0 is DEAD
2025-10-10T14:39:23.862942Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d99051c2-535dda7-c01936f4-91cf629c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:23.862954Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d99051c2-535dda7-c01936f4-91cf629c_0] Write session will restart in 0.008220s
2025-10-10T14:39:23.862956Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 74 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602704858631671:4699]
2025-10-10T14:39:23.862992Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d99051c2-535dda7-c01936f4-91cf629c_0] Write session: Do CDS request
2025-10-10T14:39:23.862999Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d99051c2-535dda7-c01936f4-91cf629c_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:23.863179Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:23.873037Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d99051c2-535dda7-c01936f4-91cf629c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:23.873124Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:23.873150Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2977
2025-10-10T14:39:23.873288Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2977 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:23.873345Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2977 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:23.873361Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2977 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:23.873365Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:23.873828Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2977 sessionId:  describe result for acl check
2025-10-10T14:39:23.873802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:23.873863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:23.873870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:23.873872Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:23.873880Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602704858631710:3109] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:23.874463Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602704858631710:3109] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:23.876811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602704858631710:3109] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:23.879159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:23.879430Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:23.879442Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:23.879454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:23.879513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:23.879562Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602704076391163:7079]
2025-10-10T14:39:23.879779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602704858631710:3109] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:23.879805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602704858631710:3109] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:23.879808Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602704858631710:3109] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:23.879817Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2977 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:23.880189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:23.880506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:23.880554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:23.880892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:23.880951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:23.880957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:23.880958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:23.880960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:23.880961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:23.880962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:23.880964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:23.880965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:23.880967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:23.880968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:23.880969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:23.880971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:23.880972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:23.880978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:23.880993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:23.880998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:23.881002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:23.881007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:23.881011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:23.881015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:23.881019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:23.881023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:23.881029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:23.881033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:23.881037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:23.881040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:23.881048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:23.881057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:23.881073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:23.881078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:23.881082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:23.881089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:23.881093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:23.881097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:23.881101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:23.881106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:23.881109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:23.881114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:23.881118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:23.881123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:23.881127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:23.881131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:23.881141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:23.881146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:23.881152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:23.881157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:23.881161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:23.881166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:23.881170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:23.881175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:23.881185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:23.881191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:23.881240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:23.883790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:23.884641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:23.884658Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:23.884660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:23.884665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:23.884671Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2976 [2:7559602704076391163:7079]
2025-10-10T14:39:23.884685Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:23.884703Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:23.884712Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:23.884716Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:23.884719Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:23.884736Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:23.884748Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:23.884756Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:23.884821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:23.884828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:23.884830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:23.884833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:23.884907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:23.884915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:23.884928Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:23.884940Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:23.884959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:23.884982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602704858631680:2438], now have 1 active actors on pipe
2025-10-10T14:39:23.884985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602704858631741:3109], now have 1 active actors on pipe
2025-10-10T14:39:23.884993Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602704076391158:7079]
2025-10-10T14:39:23.885001Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602704076391158:7079]
2025-10-10T14:39:23.885005Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602704076391158:7079]
2025-10-10T14:39:23.885015Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:23.885031Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:23.885038Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:23.885041Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:23.885045Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:23.885047Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:23.885051Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:23.885109Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602704076391158:7079]
2025-10-10T14:39:23.885122Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:23.885126Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:23.885160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:23.885168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:23.884995Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2976
2025-10-10T14:39:23.885048Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2976
2025-10-10T14:39:23.885209Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e821b698-60e0e793-d8785f60-be292b3f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:23.885221Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:23.885227Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:23.885230Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:23.885241Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:23.885252Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:23.885270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:23.885454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:23.885462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:23.885478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:23.885621Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2977 partition: 0 MaxSeqNo: 40 sessionId: src_id|e821b698-60e0e793-d8785f60-be292b3f_0
2025-10-10T14:39:23.886027Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d99051c2-535dda7-c01936f4-91cf629c_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|e821b698-60e0e793-d8785f60-be292b3f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:23.888854Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e821b698-60e0e793-d8785f60-be292b3f_0] Write session: try to update token
2025-10-10T14:39:23.888877Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e821b698-60e0e793-d8785f60-be292b3f_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:23.904218Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2977 sessionId: src_id|e821b698-60e0e793-d8785f60-be292b3f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:23.905543Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:23.905562Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:23.905565Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:23.905566Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:23.905576Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602704076391158:7079]
2025-10-10T14:39:23.905581Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602704076391158:7079]
2025-10-10T14:39:23.905586Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602704076391158:7079]
2025-10-10T14:39:23.905643Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:23.905651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:23.905649Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:23.905653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:23.905656Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:23.905660Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:23.905807Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:23.906977Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:23.962080Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602704858631755:4699]
2025-10-10T14:39:23.962404Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 pipe creation result: OK TabletId: 72075186224037892 Generation: 2976, pipe: [1:7559602704858631755:4699]
2025-10-10T14:39:24.022135Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:24.022768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:24.022785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:24.022832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602704858631755:4699], now have 1 active actors on pipe
2025-10-10T14:39:24.023057Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:24.023537Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e821b698-60e0e793-d8785f60-be292b3f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:24.023549Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e821b698-60e0e793-d8785f60-be292b3f_0] Write session will restart in 0.008184s
2025-10-10T14:39:24.023575Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e821b698-60e0e793-d8785f60-be292b3f_0] Write session: Do CDS request
2025-10-10T14:39:24.023582Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e821b698-60e0e793-d8785f60-be292b3f_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:24.023054Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:24.023070Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:24.023069Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 75 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602704858631755:4699]
2025-10-10T14:39:24.023092Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:24.023152Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2977 reason: error at write: Disconnected sessionId: src_id|e821b698-60e0e793-d8785f60-be292b3f_0
2025-10-10T14:39:24.023375Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2977 sessionId: src_id|e821b698-60e0e793-d8785f60-be292b3f_0 is DEAD
2025-10-10T14:39:24.032955Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e821b698-60e0e793-d8785f60-be292b3f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:24.033105Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:24.033123Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2978
2025-10-10T14:39:24.033286Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2978 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:24.033327Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2978 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:24.033345Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2978 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:24.033350Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:24.033890Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2978 sessionId:  describe result for acl check
2025-10-10T14:39:24.033951Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:24.033953Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:24.033955Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:24.033964Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602709153599082:3101] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:24.034572Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602709153599082:3101] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:24.034973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:24.036992Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602709153599082:3101] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:24.041193Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602709153599082:3101] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:24.041211Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602709153599082:3101] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:24.041215Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602709153599082:3101] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:24.041224Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2978 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:24.041128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:24.041410Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:24.041416Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:24.041441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:24.041513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:24.041553Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602708371358527:7069]
2025-10-10T14:39:24.042204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:24.042593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:24.042646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:24.042993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:24.043067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:24.043068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:24.043070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:24.043071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:24.043073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:24.043075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:24.043076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:24.043077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:24.043080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:24.043081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:24.043082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:24.043083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:24.043084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:24.043091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:24.043105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:24.043109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:24.043113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:24.043117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:24.043121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:24.043125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:24.043129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:24.043137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:24.043141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:24.043145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:24.043149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:24.043153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:24.043162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:24.043171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:24.043178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:24.043185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:24.043189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:24.043195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:24.043199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:24.043205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:24.043210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:24.043216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:24.043221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:24.043226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:24.043231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:24.043237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:24.043241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:24.043246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:24.043251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:24.043255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:24.043261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:24.043266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:24.043271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:24.043277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:24.043280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:24.043285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:24.043292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:24.043296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:24.043338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:24.046158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:24.046901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:24.046918Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:24.046920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:24.046924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:24.046932Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2977 [2:7559602708371358527:7069]
2025-10-10T14:39:24.046946Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:24.046965Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:24.046974Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:24.046978Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:24.046981Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:24.047000Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:24.047013Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:24.047022Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:24.047104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:24.047115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:24.047118Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:24.047120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:24.047402Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2977
2025-10-10T14:39:24.047403Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2977
2025-10-10T14:39:24.047618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:24.047631Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:24.047646Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:24.047659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:24.047676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:24.047712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602709153599114:3101], now have 1 active actors on pipe
2025-10-10T14:39:24.047722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602709153599052:2438], now have 1 active actors on pipe
2025-10-10T14:39:24.047742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:24.047752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:24.047778Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602708371358521:7069]
2025-10-10T14:39:24.047785Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602708371358521:7069]
2025-10-10T14:39:24.047787Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602708371358521:7069]
2025-10-10T14:39:24.047801Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:24.047821Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:24.047823Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:24.047831Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:24.047833Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:24.047841Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:24.047845Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:24.047867Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cb9d8da4-4f94dbdc-e65014e7-62b6f8d1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:24.047886Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:24.047898Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:24.047904Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:24.047916Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:24.047934Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:24.047979Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602708371358521:7069]
2025-10-10T14:39:24.047996Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:24.048010Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:24.048014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:24.048859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:24.048873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:24.048898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:24.049259Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2978 partition: 0 MaxSeqNo: 40 sessionId: src_id|cb9d8da4-4f94dbdc-e65014e7-62b6f8d1_0
2025-10-10T14:39:24.049748Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e821b698-60e0e793-d8785f60-be292b3f_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|cb9d8da4-4f94dbdc-e65014e7-62b6f8d1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:24.052631Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cb9d8da4-4f94dbdc-e65014e7-62b6f8d1_0] Write session: try to update token
2025-10-10T14:39:24.052652Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cb9d8da4-4f94dbdc-e65014e7-62b6f8d1_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:24.068810Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:24.068837Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:24.068841Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:24.068843Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:24.068854Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602708371358521:7069]
2025-10-10T14:39:24.068863Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602708371358521:7069]
2025-10-10T14:39:24.068867Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602708371358521:7069]
2025-10-10T14:39:24.068917Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:24.068920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:24.068929Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:24.068932Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:24.068932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:24.068936Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:24.069146Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:24.067286Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2978 sessionId: src_id|cb9d8da4-4f94dbdc-e65014e7-62b6f8d1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:24.069995Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:24.123302Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602709153599125:4699]
2025-10-10T14:39:24.123617Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 pipe creation result: OK TabletId: 72075186224037892 Generation: 2977, pipe: [1:7559602709153599125:4699]
2025-10-10T14:39:24.190639Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:24.191228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:24.191249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:24.191303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602709153599125:4699], now have 1 active actors on pipe
2025-10-10T14:39:24.191556Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:24.191564Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 76 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602709153599125:4699]
2025-10-10T14:39:24.191604Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:24.191607Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:24.191681Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2978 reason: error at write: Disconnected sessionId: src_id|cb9d8da4-4f94dbdc-e65014e7-62b6f8d1_0
2025-10-10T14:39:24.191918Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2978 sessionId: src_id|cb9d8da4-4f94dbdc-e65014e7-62b6f8d1_0 is DEAD
2025-10-10T14:39:24.191935Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:24.193581Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb9d8da4-4f94dbdc-e65014e7-62b6f8d1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:24.193594Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb9d8da4-4f94dbdc-e65014e7-62b6f8d1_0] Write session will restart in 0.008560s
2025-10-10T14:39:24.193623Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb9d8da4-4f94dbdc-e65014e7-62b6f8d1_0] Write session: Do CDS request
2025-10-10T14:39:24.193629Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb9d8da4-4f94dbdc-e65014e7-62b6f8d1_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:24.206251Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cb9d8da4-4f94dbdc-e65014e7-62b6f8d1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:24.208504Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:24.208523Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2979
2025-10-10T14:39:24.210330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:24.212545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:24.212846Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:24.212861Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:24.212874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:24.212935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:24.212984Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602708371358596:7067]
2025-10-10T14:39:24.213456Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2979 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:24.213512Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2979 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:24.213519Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2979 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:24.213524Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:24.213621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:24.214040Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2979 sessionId:  describe result for acl check
2025-10-10T14:39:24.214090Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:24.214097Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:24.214099Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:24.214104Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602709153599163:3095] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:24.213987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:24.214038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:24.214342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:24.214388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:24.214390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:24.214391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:24.214392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:24.214394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:24.214395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:24.214396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:24.214398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:24.214399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:24.214400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:24.214404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:24.214405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:24.214406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:24.214412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:24.214424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:24.214428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:24.214431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:24.214434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:24.214737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602709153599163:3095] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:24.214438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:24.214442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:24.214445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:24.214448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:24.214452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:24.214455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:24.214458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:24.214462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:24.214468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:24.214476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:24.214482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:24.214487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:24.214491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:24.214496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:24.214500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:24.214505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:24.214509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:24.214514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:24.214519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:24.214524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:24.214528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:24.214532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:24.214537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:24.214545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:24.214549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:24.214554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:24.214558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:24.214562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:24.214566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:24.214571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:24.214575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:24.214579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:24.214583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:24.214588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:24.214627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:24.217011Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602709153599163:3095] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:24.217211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:24.218176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:24.218191Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:24.218193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:24.218197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:24.218202Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2978 [2:7559602708371358596:7067]
2025-10-10T14:39:24.218215Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:24.218234Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:24.218242Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:24.218246Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:24.218248Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:24.218265Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:24.218272Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:24.218282Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:24.218349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:24.218356Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:24.218358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:24.218360Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:24.218431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:24.218439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:24.218450Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:24.218460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:24.218478Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:24.218500Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602708371358591:7067]
2025-10-10T14:39:24.218502Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602708371358591:7067]
2025-10-10T14:39:24.218504Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602708371358591:7067]
2025-10-10T14:39:24.218520Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:24.218540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602709153599126:2438], now have 1 active actors on pipe
2025-10-10T14:39:24.218554Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:24.218572Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:24.218576Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:24.218603Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602708371358591:7067]
2025-10-10T14:39:24.218605Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:24.218640Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:24.218650Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:24.218652Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:24.218661Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:24.218567Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2978
2025-10-10T14:39:24.224929Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602709153599163:3095] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:24.224957Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602709153599163:3095] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:24.224962Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602709153599163:3095] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:24.224971Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2979 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:24.225505Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2978
2025-10-10T14:39:24.225473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602709153599198:3095], now have 1 active actors on pipe
2025-10-10T14:39:24.225597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:24.225614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:24.225655Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|55bc2ac9-388c194b-c43d8a9c-d9ba9b4f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:24.225678Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:24.225684Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:24.225687Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:24.225704Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:24.225725Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:24.225747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:24.226013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:24.226032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:24.226056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:24.226166Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2979 partition: 0 MaxSeqNo: 40 sessionId: src_id|55bc2ac9-388c194b-c43d8a9c-d9ba9b4f_0
2025-10-10T14:39:24.226618Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb9d8da4-4f94dbdc-e65014e7-62b6f8d1_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|55bc2ac9-388c194b-c43d8a9c-d9ba9b4f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:24.229453Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|55bc2ac9-388c194b-c43d8a9c-d9ba9b4f_0] Write session: try to update token
2025-10-10T14:39:24.229476Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|55bc2ac9-388c194b-c43d8a9c-d9ba9b4f_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:24.241507Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:24.241527Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:24.241531Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:24.241533Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:24.241544Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602708371358591:7067]
2025-10-10T14:39:24.241549Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602708371358591:7067]
2025-10-10T14:39:24.241553Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602708371358591:7067]
2025-10-10T14:39:24.241609Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:24.241617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:24.241620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:24.241650Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:24.241661Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:24.241667Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:24.242156Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:24.246951Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2979 sessionId: src_id|55bc2ac9-388c194b-c43d8a9c-d9ba9b4f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:24.249823Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:24.291821Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602709153599201:4699]
2025-10-10T14:39:24.292158Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 pipe creation result: OK TabletId: 72075186224037892 Generation: 2978, pipe: [1:7559602709153599201:4699]
2025-10-10T14:39:24.358561Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:24.359156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:24.359177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:24.359228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602709153599201:4699], now have 1 active actors on pipe
2025-10-10T14:39:24.359456Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:24.360119Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55bc2ac9-388c194b-c43d8a9c-d9ba9b4f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:24.360131Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55bc2ac9-388c194b-c43d8a9c-d9ba9b4f_0] Write session will restart in 0.007372s
2025-10-10T14:39:24.360170Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55bc2ac9-388c194b-c43d8a9c-d9ba9b4f_0] Write session: Do CDS request
2025-10-10T14:39:24.360177Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55bc2ac9-388c194b-c43d8a9c-d9ba9b4f_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:24.359596Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:24.359612Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:24.359701Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2979 reason: error at write: Disconnected sessionId: src_id|55bc2ac9-388c194b-c43d8a9c-d9ba9b4f_0
2025-10-10T14:39:24.359949Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2979 sessionId: src_id|55bc2ac9-388c194b-c43d8a9c-d9ba9b4f_0 is DEAD
2025-10-10T14:39:24.360057Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:24.360087Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 77 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602709153599201:4699]
2025-10-10T14:39:24.368958Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|55bc2ac9-388c194b-c43d8a9c-d9ba9b4f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:24.369042Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:24.369070Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2980
2025-10-10T14:39:24.369237Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2980 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:24.369284Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2980 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:24.369290Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2980 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:24.369294Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:24.369840Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2980 sessionId:  describe result for acl check
2025-10-10T14:39:24.369892Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:24.369894Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:24.369899Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:24.369905Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602709153599216:3074] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:24.370551Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602709153599216:3074] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:24.373189Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602709153599216:3074] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:24.376613Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602709153599216:3074] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:24.376629Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602709153599216:3074] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:24.376633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602709153599216:3074] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:24.376642Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2980 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:24.382889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:24.387988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:24.388611Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:24.388633Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:24.388648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:24.388717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:24.388765Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602708371358669:7052]
2025-10-10T14:39:24.389438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:24.389807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:24.389855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:24.390179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:24.390242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:24.390248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:24.390250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:24.390251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:24.390252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:24.390253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:24.390254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:24.390255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:24.390257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:24.390258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:24.390259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:24.390260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:24.390261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:24.390268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:24.390281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:24.390285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:24.390288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:24.390292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:24.390298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:24.390301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:24.390305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:24.390308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:24.390312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:24.390316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:24.390319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:24.390323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:24.390332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:24.390341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:24.390347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:24.390352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:24.390356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:24.390361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:24.390365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:24.390370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:24.390375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:24.390380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:24.390384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:24.390393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:24.390397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:24.390403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:24.390407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:24.390412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:24.390418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:24.390423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:24.390429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:24.390433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:24.390438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:24.390443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:24.390455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:24.390461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:24.390464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:24.390469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:24.390505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:24.393149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:24.396089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:24.396104Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:24.396106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:24.396110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:24.396118Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2979 [2:7559602708371358669:7052]
2025-10-10T14:39:24.396133Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:24.396153Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:24.396156Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:24.396160Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:24.396163Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:24.396181Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:24.396190Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:24.396199Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:24.396264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:24.396267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:24.396269Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:24.396272Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:24.396350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:24.396354Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:24.396365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:24.396376Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:24.396392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:24.396414Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602708371358664:7052]
2025-10-10T14:39:24.396417Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602708371358664:7052]
2025-10-10T14:39:24.396419Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602708371358664:7052]
2025-10-10T14:39:24.396436Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:24.396451Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:24.396466Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:24.396470Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:24.396501Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602708371358664:7052]
2025-10-10T14:39:24.396504Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:24.396506Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:24.396511Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:24.396513Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:24.396522Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:24.396681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602709153599247:3074], now have 1 active actors on pipe
2025-10-10T14:39:24.396732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602709153599203:2438], now have 1 active actors on pipe
2025-10-10T14:39:24.397677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:24.397691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:24.397742Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|668fff9-fd88dbe9-ff2dbb81-8f4d861f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:24.397755Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:24.397760Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:24.397768Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:24.397781Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:24.397798Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:24.397822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:24.398837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:24.398848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:24.398868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:24.399490Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55bc2ac9-388c194b-c43d8a9c-d9ba9b4f_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|668fff9-fd88dbe9-ff2dbb81-8f4d861f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:24.397517Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2979
2025-10-10T14:39:24.397564Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2979
2025-10-10T14:39:24.399041Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2980 partition: 0 MaxSeqNo: 40 sessionId: src_id|668fff9-fd88dbe9-ff2dbb81-8f4d861f_0
2025-10-10T14:39:24.402478Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|668fff9-fd88dbe9-ff2dbb81-8f4d861f_0] Write session: try to update token
2025-10-10T14:39:24.402496Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|668fff9-fd88dbe9-ff2dbb81-8f4d861f_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:24.423756Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:24.423779Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:24.423782Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:24.423785Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:24.423796Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602708371358664:7052]
2025-10-10T14:39:24.423804Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602708371358664:7052]
2025-10-10T14:39:24.423809Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602708371358664:7052]
2025-10-10T14:39:24.423863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:24.423877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:24.423880Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:24.424023Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:24.424100Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:24.424070Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2980 sessionId: src_id|668fff9-fd88dbe9-ff2dbb81-8f4d861f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:24.424115Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:24.424122Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:24.426888Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:24.460240Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602709153599277:4699]
2025-10-10T14:39:24.465484Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 pipe creation result: OK TabletId: 72075186224037892 Generation: 2979, pipe: [1:7559602709153599277:4699]
2025-10-10T14:39:24.558269Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:24.558752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:24.558772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:24.558816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602709153599277:4699], now have 1 active actors on pipe
2025-10-10T14:39:24.559055Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 78 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602709153599277:4699]
2025-10-10T14:39:24.559094Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:39:24.559194Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2980 reason: status is not ok: tablet will be restarted right now sessionId: src_id|668fff9-fd88dbe9-ff2dbb81-8f4d861f_0
2025-10-10T14:39:24.559011Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:24.559408Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2980 sessionId: src_id|668fff9-fd88dbe9-ff2dbb81-8f4d861f_0 is DEAD
2025-10-10T14:39:24.559434Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:24.559590Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|668fff9-fd88dbe9-ff2dbb81-8f4d861f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:39:24.559599Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|668fff9-fd88dbe9-ff2dbb81-8f4d861f_0] Write session will restart in 0.007903s
2025-10-10T14:39:24.559623Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|668fff9-fd88dbe9-ff2dbb81-8f4d861f_0] Write session: Do CDS request
2025-10-10T14:39:24.559630Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|668fff9-fd88dbe9-ff2dbb81-8f4d861f_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:24.568982Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|668fff9-fd88dbe9-ff2dbb81-8f4d861f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:24.569039Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:24.569068Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2981
2025-10-10T14:39:24.569256Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2981 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:24.569292Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2981 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:24.569303Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2981 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:24.569308Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:24.569816Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2981 sessionId:  describe result for acl check
2025-10-10T14:39:24.569855Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:24.569864Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:24.569866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:24.569873Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602709153599339:3031] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:24.570448Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602709153599339:3031] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:24.573167Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602709153599339:3031] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:24.577585Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602709153599339:3031] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:24.577572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:24.577602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602709153599339:3031] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:24.577607Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602709153599339:3031] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:24.577616Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2981 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:24.578046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:24.578270Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:24.578281Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:24.578298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:24.578401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:24.578511Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602708371358792:7022]
2025-10-10T14:39:24.579230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:24.579555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:24.579606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:24.580458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:24.580567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:24.580575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:24.580577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:24.580578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:24.580579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:24.580580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:24.580582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:24.580583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:24.580585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:24.580587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:24.580588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:24.580589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:24.580591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:24.580598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:24.580613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:24.580617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:24.580622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:24.580630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:24.580634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:24.580639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:24.580643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:24.580648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:24.580653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:24.580658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:24.580662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:24.580667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:24.580676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:24.580687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:24.580693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:24.580699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:24.580710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:24.580716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:24.580721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:24.580727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:24.580735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:24.580747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:24.580757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:24.580762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:24.580772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:24.580777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:24.580782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:24.580792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:24.580797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:24.580807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:24.580812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:24.580822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:24.580827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:24.580833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:24.580840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:24.580849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:24.580855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:24.580867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:24.580911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:24.583540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:24.583838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:24.583850Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:24.583853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:24.583858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:24.583865Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2980 [2:7559602708371358792:7022]
2025-10-10T14:39:24.583879Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:24.583897Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:24.583900Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:24.583905Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:24.583913Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:24.583929Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:24.583942Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:24.583956Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:24.584035Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:24.584044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:24.584046Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:24.584049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:24.584125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:24.584133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:24.584146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:24.584159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:24.584183Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:24.584210Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602708371358786:7022]
2025-10-10T14:39:24.584217Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602708371358786:7022]
2025-10-10T14:39:24.584220Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602708371358786:7022]
2025-10-10T14:39:24.584233Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:24.584247Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:24.584248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602709153599370:3031], now have 1 active actors on pipe
2025-10-10T14:39:24.584253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602709153599308:2438], now have 1 active actors on pipe
2025-10-10T14:39:24.584257Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:24.584260Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:24.584262Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:24.584278Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:24.584282Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:24.584308Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602708371358786:7022]
2025-10-10T14:39:24.584323Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2980
2025-10-10T14:39:24.584325Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2980
2025-10-10T14:39:24.584321Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:24.584327Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:24.584375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:24.584381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:24.584410Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f03ee18a-84f8a4ab-6b6b5e38-4f4610bc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:24.584423Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:24.584427Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:24.584430Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:24.584441Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:24.584452Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:24.584466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:24.584691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:24.584698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:24.584712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:24.584866Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2981 partition: 0 MaxSeqNo: 40 sessionId: src_id|f03ee18a-84f8a4ab-6b6b5e38-4f4610bc_0
2025-10-10T14:39:24.585312Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|668fff9-fd88dbe9-ff2dbb81-8f4d861f_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|f03ee18a-84f8a4ab-6b6b5e38-4f4610bc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:24.588084Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f03ee18a-84f8a4ab-6b6b5e38-4f4610bc_0] Write session: try to update token
2025-10-10T14:39:24.588103Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f03ee18a-84f8a4ab-6b6b5e38-4f4610bc_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:24.603446Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:39:24.603465Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:24.603478Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602708371358786:7022]
2025-10-10T14:39:24.603519Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:39:24.603536Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:39:24.603654Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2981 sessionId: src_id|f03ee18a-84f8a4ab-6b6b5e38-4f4610bc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:24.603735Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:39:24.603941Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:24.604148Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:24.604351Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:24.604633Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:39:24.604691Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:39:24.606962Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:24.607170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:24.607200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:24.607244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:39:24.607342Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:39:24.614820Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:24.614839Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:24.614842Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:24.614844Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:24.614855Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602708371358786:7022]
2025-10-10T14:39:24.614858Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602708371358786:7022]
2025-10-10T14:39:24.614862Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602708371358786:7022]
2025-10-10T14:39:24.614908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:24.614909Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:24.614917Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:24.614921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:24.614921Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:24.614923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:24.615067Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:24.659375Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602709153599387:4699]
2025-10-10T14:39:24.659690Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 pipe creation result: OK TabletId: 72075186224037892 Generation: 2980, pipe: [1:7559602709153599387:4699]
2025-10-10T14:39:24.735678Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:24.744577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:24.744614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:24.744821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:24.744890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:24.744961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:24.745039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:24.745134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:24.745152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:24.745227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:24.745294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:24.745380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:24.745454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:24.745501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:24.745509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:24.745616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:24.745680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:24.745746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:24.745813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:24.745861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:24.745864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:24.745934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:24.745994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:24.746067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:24.746130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:24.746176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:24.746183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:24.746246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:24.746306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:24.746369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:24.746435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:24.746481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:24.746488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:24.746557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:24.746620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:24.746687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:24.746755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:24.746802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:24.746812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:24.746883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:24.746955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:24.747019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:24.747087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:24.747133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:24.747140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:24.747217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:24.747293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:24.747363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:24.747430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:24.747478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:24.747485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:24.747557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:24.747619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:24.747686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:24.747755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:24.747802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:24.747813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:24.747886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:24.747951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:24.748019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:24.748085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:24.748135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:24.748142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:24.748207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602709153599387:4699], now have 1 active actors on pipe
2025-10-10T14:39:24.748660Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:24.748735Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:24.748742Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:24.748791Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2981 reason: error at write: Disconnected sessionId: src_id|f03ee18a-84f8a4ab-6b6b5e38-4f4610bc_0
2025-10-10T14:39:24.748901Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 79 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602709153599387:4699]
2025-10-10T14:39:24.749085Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2981 sessionId: src_id|f03ee18a-84f8a4ab-6b6b5e38-4f4610bc_0 is DEAD
2025-10-10T14:39:24.749251Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f03ee18a-84f8a4ab-6b6b5e38-4f4610bc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:24.749263Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f03ee18a-84f8a4ab-6b6b5e38-4f4610bc_0] Write session will restart in 0.007051s
2025-10-10T14:39:24.749290Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f03ee18a-84f8a4ab-6b6b5e38-4f4610bc_0] Write session: Do CDS request
2025-10-10T14:39:24.749297Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f03ee18a-84f8a4ab-6b6b5e38-4f4610bc_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:24.749500Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:24.757928Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f03ee18a-84f8a4ab-6b6b5e38-4f4610bc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:24.757996Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:24.758015Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2982
2025-10-10T14:39:24.758161Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2982 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:24.758197Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2982 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:24.758203Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2982 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:24.758207Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:24.758784Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2982 sessionId:  describe result for acl check
2025-10-10T14:39:24.758825Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:24.758835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:24.758837Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:24.758843Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602709153599436:2999] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:24.759405Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602709153599436:2999] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:24.761302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:24.762537Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602709153599436:2999] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:24.767054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:24.767329Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:24.767344Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:24.767358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:24.767358Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602709153599436:2999] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:24.767376Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602709153599436:2999] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:24.767381Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602709153599436:2999] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:24.767391Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2982 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:24.767422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:24.767482Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602708371358865:7026]
2025-10-10T14:39:24.768182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:24.768558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:24.768613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:24.768971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:24.769039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:24.769062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:24.769063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:24.769064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:24.769066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:24.769067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:24.769069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:24.769070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:24.769071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:24.769073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:24.769074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:24.769076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:24.769077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:24.769084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:24.769098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:24.769103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:24.769108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:24.769112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:24.769116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:24.769121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:24.769124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:24.769129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:24.769133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:24.769137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:24.769141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:24.769146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:24.769155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:24.769166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:24.769173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:24.769179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:24.769183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:24.769189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:24.769196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:24.769202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:24.769208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:24.769212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:24.769216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:24.769220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:24.769225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:24.769229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:24.769234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:24.769239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:24.769245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:24.769250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:24.769254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:24.769258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:24.769262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:24.769267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:24.769271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:24.769276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:24.769280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:24.769285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:24.769320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:24.773491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:24.774421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:24.774440Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:24.774442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:24.774446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:24.774454Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2981 [2:7559602708371358865:7026]
2025-10-10T14:39:24.774469Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:24.774488Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:24.774500Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:24.774503Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:24.774505Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:24.774524Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:24.774536Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:24.774544Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:24.774610Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:24.774621Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:24.774623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:24.774626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:24.774712Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:24.774722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:24.774736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:24.774749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:24.774767Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:24.774798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602709153599469:2999], now have 1 active actors on pipe
2025-10-10T14:39:24.774807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602709153599404:2438], now have 1 active actors on pipe
2025-10-10T14:39:24.774815Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602708371358860:7026]
2025-10-10T14:39:24.774817Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602708371358860:7026]
2025-10-10T14:39:24.774819Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602708371358860:7026]
2025-10-10T14:39:24.774833Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:24.774847Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:24.774849Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:24.774853Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:24.774855Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:24.774871Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:24.774874Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:24.774911Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602708371358860:7026]
2025-10-10T14:39:24.774918Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:24.774922Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:24.774916Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2981
2025-10-10T14:39:24.775008Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2981
2025-10-10T14:39:24.775061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:24.775072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:24.775104Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|56ecfa3-a53e5132-4304a23d-9079261b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:24.775119Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:24.775123Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:24.775126Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:24.775138Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:24.775155Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:24.775177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:24.775330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:24.775339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:24.775355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:24.775485Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2982 partition: 0 MaxSeqNo: 40 sessionId: src_id|56ecfa3-a53e5132-4304a23d-9079261b_0
2025-10-10T14:39:24.775926Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f03ee18a-84f8a4ab-6b6b5e38-4f4610bc_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|56ecfa3-a53e5132-4304a23d-9079261b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:24.778840Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|56ecfa3-a53e5132-4304a23d-9079261b_0] Write session: try to update token
2025-10-10T14:39:24.778862Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|56ecfa3-a53e5132-4304a23d-9079261b_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:24.786839Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:39:24.786858Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:24.786870Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602708371358860:7026]
2025-10-10T14:39:24.786914Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:39:24.786926Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:39:24.787111Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:39:24.787261Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:24.787407Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:24.787548Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:24.787747Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:39:24.787791Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:39:24.797190Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2982 sessionId: src_id|56ecfa3-a53e5132-4304a23d-9079261b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:24.800003Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:24.800248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:24.800275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:24.800321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:39:24.800429Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:39:24.804856Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:24.804879Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:24.804883Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:24.804885Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:24.804901Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602708371358860:7026]
2025-10-10T14:39:24.804904Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602708371358860:7026]
2025-10-10T14:39:24.804907Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602708371358860:7026]
2025-10-10T14:39:24.804957Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:24.804970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:24.804970Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:24.804973Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:24.804980Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:24.804984Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:24.805134Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:24.848854Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602709153599485:4699]
2025-10-10T14:39:24.849219Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 pipe creation result: OK TabletId: 72075186224037892 Generation: 2981, pipe: [1:7559602709153599485:4699]
2025-10-10T14:39:24.922712Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:24.931961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:24.931993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:24.932204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:24.932271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:24.932340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:24.932405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:24.933072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:24.933087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:24.933173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:24.933246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:24.933315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:24.933404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:24.933451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:24.933459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:24.933532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:24.933596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:24.933662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:24.933728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:24.933778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:24.933785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:24.933855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:24.933927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:24.933998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:24.934069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:24.934117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:24.934125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:24.934198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:24.934265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:24.934337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:24.934403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:24.934450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:24.934457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:24.934528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:24.934591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:24.934660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:24.934729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:24.934791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:24.934800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:24.934873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:24.934938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:24.935011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:24.935083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:24.935137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:24.935141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:24.935219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:24.935292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:24.935357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:24.935425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:24.935476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:24.935489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:24.935570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:24.935646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:24.935721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:24.935795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:24.935844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:24.935853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:24.935924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:24.935984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:24.936049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:24.936117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:24.936164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:24.936175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:24.936263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602709153599485:4699], now have 1 active actors on pipe
2025-10-10T14:39:24.936643Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:24.936652Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:24.936658Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:24.936704Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2982 reason: error at write: Disconnected sessionId: src_id|56ecfa3-a53e5132-4304a23d-9079261b_0
2025-10-10T14:39:24.936724Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 80 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602709153599485:4699]
2025-10-10T14:39:24.936967Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2982 sessionId: src_id|56ecfa3-a53e5132-4304a23d-9079261b_0 is DEAD
2025-10-10T14:39:24.937065Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:24.937170Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56ecfa3-a53e5132-4304a23d-9079261b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:24.937182Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56ecfa3-a53e5132-4304a23d-9079261b_0] Write session will restart in 0.007506s
2025-10-10T14:39:24.937209Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56ecfa3-a53e5132-4304a23d-9079261b_0] Write session: Do CDS request
2025-10-10T14:39:24.937215Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56ecfa3-a53e5132-4304a23d-9079261b_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:24.946000Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|56ecfa3-a53e5132-4304a23d-9079261b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:24.946063Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:24.946082Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2983
2025-10-10T14:39:24.946328Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2983 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:24.946368Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2983 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:24.946379Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2983 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:24.946387Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:24.946807Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2983 sessionId:  describe result for acl check
2025-10-10T14:39:24.946844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:24.946850Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:24.946853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:24.946860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602709153599508:2996] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:24.947422Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602709153599508:2996] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:24.950279Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602709153599508:2996] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:24.951567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:24.958859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:24.958999Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602709153599508:2996] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:24.959022Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602709153599508:2996] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:24.959027Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602709153599508:2996] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:24.959037Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2983 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:24.959194Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:24.959216Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:24.959229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:24.959310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:24.959358Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602708371358939:7024]
2025-10-10T14:39:24.960029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:24.960374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:24.960447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:24.960820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:24.960891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:24.960898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:24.960899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:24.960901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:24.960902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:24.960903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:24.960905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:24.960906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:24.960907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:24.960908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:24.960910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:24.960911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:24.960912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:24.960919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:24.960935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:24.960939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:24.960943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:24.960947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:24.960952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:24.960955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:24.960959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:24.960963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:24.960968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:24.960972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:24.960975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:24.960979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:24.960988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:24.960998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:24.961005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:24.961011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:24.961016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:24.961021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:24.961026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:24.961031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:24.961036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:24.961041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:24.961069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:24.961074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:24.961080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:24.961085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:24.961089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:24.961094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:24.961099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:24.961104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:24.961109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:24.961115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:24.961119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:24.961124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:24.961128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:24.961134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:24.961138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:24.961143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:24.961185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:24.964043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:24.964952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:24.964965Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:24.964966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:24.964970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:24.964976Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2982 [2:7559602708371358939:7024]
2025-10-10T14:39:24.964987Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:24.965008Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:24.965012Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:24.965015Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:24.965018Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:24.965039Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:24.965067Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:24.965077Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:24.965156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:24.965165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:24.965167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:24.965170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:24.965249Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:24.965259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:24.965272Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:24.965284Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:24.965301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:24.965326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602709153599491:2438], now have 1 active actors on pipe
2025-10-10T14:39:24.965344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602709153599556:2996], now have 1 active actors on pipe
2025-10-10T14:39:24.965353Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602708371358934:7024]
2025-10-10T14:39:24.965356Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602708371358934:7024]
2025-10-10T14:39:24.965358Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602708371358934:7024]
2025-10-10T14:39:24.965371Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:24.965386Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:24.965405Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:24.965409Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:24.965447Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602708371358934:7024]
2025-10-10T14:39:24.965449Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:24.965507Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:24.965511Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:24.965513Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:24.965521Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:24.965816Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2982
2025-10-10T14:39:24.965908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:24.965921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:24.965957Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9873e26e-50c68fe6-65289d0a-4d13e971_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:24.965966Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:24.965971Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:24.965974Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:24.965988Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:24.966002Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:24.966020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:24.966601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:24.966613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:24.966636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:24.967274Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56ecfa3-a53e5132-4304a23d-9079261b_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|9873e26e-50c68fe6-65289d0a-4d13e971_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:24.965860Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2982
2025-10-10T14:39:24.966829Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2983 partition: 0 MaxSeqNo: 40 sessionId: src_id|9873e26e-50c68fe6-65289d0a-4d13e971_0
2025-10-10T14:39:24.970111Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9873e26e-50c68fe6-65289d0a-4d13e971_0] Write session: try to update token
2025-10-10T14:39:24.970134Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9873e26e-50c68fe6-65289d0a-4d13e971_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:24.977934Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:39:24.977963Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:24.977975Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602708371358934:7024]
2025-10-10T14:39:24.978029Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:39:24.978038Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:39:24.978228Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:39:24.978390Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:24.978543Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:24.978697Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:24.978910Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:39:24.978958Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:39:24.991503Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2983 sessionId: src_id|9873e26e-50c68fe6-65289d0a-4d13e971_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:24.994451Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:24.994700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:24.994725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:24.994770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:39:24.994889Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:39:25.013935Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:25.013955Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:25.013958Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:25.013960Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:25.013971Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602708371358934:7024]
2025-10-10T14:39:25.013975Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602708371358934:7024]
2025-10-10T14:39:25.013979Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602708371358934:7024]
2025-10-10T14:39:25.014030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:25.014030Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:25.014037Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:25.014038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:25.014040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:25.014042Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:25.014177Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:25.036749Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602713448566865:4699]
2025-10-10T14:39:25.037167Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 pipe creation result: OK TabletId: 72075186224037892 Generation: 2982, pipe: [1:7559602713448566865:4699]
2025-10-10T14:39:25.130845Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:25.139150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:25.139182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:25.139369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:25.139434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:25.139506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:25.139573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:25.139620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:25.139636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:25.139706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:25.139768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:25.139827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:25.139890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:25.139935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:25.139938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:25.140015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:25.140075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:25.140142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:25.140204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:25.140244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:25.140247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:25.140317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:25.140403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:25.140462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:25.140522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:25.140560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:25.140563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:25.140636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:25.140697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:25.140761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:25.140825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:25.140936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:25.140941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:25.141017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:25.141088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:25.141149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:25.141207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:25.141245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:25.141248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:25.141324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:25.141569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:25.141644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:25.141713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:25.141761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:25.141768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:25.141835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:25.141897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:25.141958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:25.142022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:25.142066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:25.142076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:25.142143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:25.142204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:25.142271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:25.142349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:25.142396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:25.142403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:25.142466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:25.142529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:25.142586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:25.142646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:25.142744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:25.142751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:25.142813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602713448566865:4699], now have 1 active actors on pipe
2025-10-10T14:39:25.143212Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:25.143271Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 81 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602713448566865:4699]
2025-10-10T14:39:25.143300Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:25.143307Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:25.143339Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2983 reason: error at write: Disconnected sessionId: src_id|9873e26e-50c68fe6-65289d0a-4d13e971_0
2025-10-10T14:39:25.143735Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9873e26e-50c68fe6-65289d0a-4d13e971_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:25.143749Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9873e26e-50c68fe6-65289d0a-4d13e971_0] Write session will restart in 0.008626s
2025-10-10T14:39:25.143557Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2983 sessionId: src_id|9873e26e-50c68fe6-65289d0a-4d13e971_0 is DEAD
2025-10-10T14:39:25.143788Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9873e26e-50c68fe6-65289d0a-4d13e971_0] Write session: Do CDS request
2025-10-10T14:39:25.143794Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9873e26e-50c68fe6-65289d0a-4d13e971_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:25.144005Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:25.154011Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9873e26e-50c68fe6-65289d0a-4d13e971_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:25.156858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:25.158053Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:25.158071Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2984
2025-10-10T14:39:25.158241Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2984 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:25.158291Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2984 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:25.158301Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2984 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:25.158305Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:25.158833Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2984 sessionId:  describe result for acl check
2025-10-10T14:39:25.158884Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:25.158888Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:25.158890Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:25.158896Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602713448566905:2978] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:25.159547Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602713448566905:2978] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:25.161873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:25.162129Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:25.162143Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:25.162156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:25.162227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:25.162273Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602712666326310:7015]
2025-10-10T14:39:25.162388Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602713448566905:2978] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:25.162904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:25.163242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:25.163305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:25.163670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:25.163728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:25.163736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:25.163738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:25.163739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:25.163740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:25.163742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:25.163743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:25.163744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:25.163745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:25.163747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:25.163748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:25.163750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:25.163751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:25.163756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:25.163770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:25.163775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:25.163779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:25.163784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:25.163790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:25.163794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:25.163798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:25.163802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:25.163807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:25.163810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:25.163814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:25.163818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:25.163827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:25.163835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:25.163842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:25.163853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:25.163858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:25.163863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:25.163872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:25.163878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:25.163883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:25.163891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:25.163895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:25.163902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:25.163907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:25.163917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:25.163921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:25.163926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:25.163936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:25.163943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:25.163951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:25.163956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:25.163962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:25.163968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:25.163974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:25.163979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:25.163998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:25.164007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:25.164050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:25.166772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:25.166721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602713448566905:2978] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:25.166738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602713448566905:2978] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:25.166742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602713448566905:2978] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:25.166752Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2984 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:25.167733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:25.167745Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:25.167748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:25.167753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:25.167760Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2983 [2:7559602712666326310:7015]
2025-10-10T14:39:25.167773Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:25.167796Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:25.167804Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:25.167808Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:25.167810Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:25.167828Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:25.167840Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:25.167848Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:25.167914Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:25.167923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:25.167926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:25.167929Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:25.168004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:25.168013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:25.168025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:25.168038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:25.168055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:25.168083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602713448566867:2438], now have 1 active actors on pipe
2025-10-10T14:39:25.168098Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602712666326305:7015]
2025-10-10T14:39:25.168100Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602712666326305:7015]
2025-10-10T14:39:25.168102Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602712666326305:7015]
2025-10-10T14:39:25.168117Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:25.168127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602713448566938:2978], now have 1 active actors on pipe
2025-10-10T14:39:25.168136Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:25.168151Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:25.168160Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:25.168171Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:25.168188Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:25.168192Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:25.168199Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602712666326305:7015]
2025-10-10T14:39:25.168158Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2983
2025-10-10T14:39:25.168173Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2983
2025-10-10T14:39:25.168208Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:25.168212Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:25.168253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:25.168258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:25.168298Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4b0246fd-1dc5960d-4f1bc023-8b2a914_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:25.168314Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:25.168318Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:25.168320Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:25.168333Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:25.168345Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:25.168362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:25.168560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:25.168567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:25.168582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:25.168678Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2984 partition: 0 MaxSeqNo: 40 sessionId: src_id|4b0246fd-1dc5960d-4f1bc023-8b2a914_0
2025-10-10T14:39:25.169109Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9873e26e-50c68fe6-65289d0a-4d13e971_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|4b0246fd-1dc5960d-4f1bc023-8b2a914_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:25.172021Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4b0246fd-1dc5960d-4f1bc023-8b2a914_0] Write session: try to update token
2025-10-10T14:39:25.172045Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4b0246fd-1dc5960d-4f1bc023-8b2a914_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:25.188900Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:25.188921Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:25.188925Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:25.188927Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:25.188941Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602712666326305:7015]
2025-10-10T14:39:25.188949Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602712666326305:7015]
2025-10-10T14:39:25.188952Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602712666326305:7015]
2025-10-10T14:39:25.189006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:25.189007Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:25.189015Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:25.189019Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:25.189019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:25.189022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:25.189189Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:25.191171Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2984 sessionId: src_id|4b0246fd-1dc5960d-4f1bc023-8b2a914_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:25.194109Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:25.244472Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602713448566946:4699]
2025-10-10T14:39:25.244795Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 pipe creation result: OK TabletId: 72075186224037892 Generation: 2983, pipe: [1:7559602713448566946:4699]
2025-10-10T14:39:25.313994Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:25.314588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:25.314611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:25.314662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602713448566946:4699], now have 1 active actors on pipe
2025-10-10T14:39:25.315062Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:25.315079Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 82 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602713448566946:4699]
2025-10-10T14:39:25.315107Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:39:25.315189Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2984 reason: status is not ok: tablet will be restarted right now sessionId: src_id|4b0246fd-1dc5960d-4f1bc023-8b2a914_0
2025-10-10T14:39:25.314924Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:25.315422Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2984 sessionId: src_id|4b0246fd-1dc5960d-4f1bc023-8b2a914_0 is DEAD
2025-10-10T14:39:25.315644Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b0246fd-1dc5960d-4f1bc023-8b2a914_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:39:25.315653Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b0246fd-1dc5960d-4f1bc023-8b2a914_0] Write session will restart in 0.009139s
2025-10-10T14:39:25.315685Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b0246fd-1dc5960d-4f1bc023-8b2a914_0] Write session: Do CDS request
2025-10-10T14:39:25.315692Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b0246fd-1dc5960d-4f1bc023-8b2a914_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:25.326000Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4b0246fd-1dc5960d-4f1bc023-8b2a914_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:25.329530Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:25.329556Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2985
2025-10-10T14:39:25.329746Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2985 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:25.329784Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2985 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:25.329794Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2985 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:25.329798Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:25.330611Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2985 sessionId:  describe result for acl check
2025-10-10T14:39:25.330652Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:25.330660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:25.330662Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:25.330668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602713448566986:2972] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:25.331334Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602713448566986:2972] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:25.334007Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602713448566986:2972] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:25.336183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:25.336925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:25.337148Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:25.337159Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:25.337171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:25.337230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:25.337272Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602712666326388:7010]
2025-10-10T14:39:25.337101Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602713448566986:2972] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:25.337114Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602713448566986:2972] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:25.337118Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602713448566986:2972] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:25.337128Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2985 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:25.338183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:25.338606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:25.338652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:25.339008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:25.339066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:25.339075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:25.339076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:25.339078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:25.339079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:25.339080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:25.339081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:25.339083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:25.339084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:25.339085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:25.339086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:25.339087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:25.339089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:25.339094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:25.339108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:25.339113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:25.339117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:25.339121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:25.339126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:25.339130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:25.339134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:25.339139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:25.339145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:25.339149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:25.339153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:25.339157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:25.339166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:25.339174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:25.339181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:25.339187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:25.339192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:25.339198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:25.339204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:25.339209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:25.339215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:25.339220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:25.339225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:25.339237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:25.339242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:25.339247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:25.339252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:25.339258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:25.339262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:25.339268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:25.339272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:25.339277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:25.339282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:25.339287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:25.339292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:25.339297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:25.339302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:25.339307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:25.339352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:25.342204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:25.342527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:25.342541Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:25.342544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:25.342549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:25.342556Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2984 [2:7559602712666326388:7010]
2025-10-10T14:39:25.342573Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:25.342597Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:25.342605Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:25.342609Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:25.342612Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:25.342632Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:25.342644Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:25.342653Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:25.342710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:25.342720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:25.342722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:25.342724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:25.342802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:25.342811Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:25.342823Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:25.342841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:25.342879Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:25.342907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602713448566948:2438], now have 1 active actors on pipe
2025-10-10T14:39:25.342916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602713448567017:2972], now have 1 active actors on pipe
2025-10-10T14:39:25.342923Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602712666326383:7010]
2025-10-10T14:39:25.342926Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602712666326383:7010]
2025-10-10T14:39:25.342929Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602712666326383:7010]
2025-10-10T14:39:25.342953Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:25.342966Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:25.342972Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:25.342977Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:25.342980Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:25.342991Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:25.342994Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:25.342965Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2984
2025-10-10T14:39:25.342980Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2984
2025-10-10T14:39:25.343021Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602712666326383:7010]
2025-10-10T14:39:25.343031Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:25.343033Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:25.343054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:25.343060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:25.343115Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|35f9fe99-9e0cf835-62745cae-5796e6e3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:25.343129Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:25.343133Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:25.343135Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:25.343147Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:25.343164Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:25.343185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:25.343355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:25.343366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:25.343386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:25.343477Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2985 partition: 0 MaxSeqNo: 40 sessionId: src_id|35f9fe99-9e0cf835-62745cae-5796e6e3_0
2025-10-10T14:39:25.348562Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b0246fd-1dc5960d-4f1bc023-8b2a914_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|35f9fe99-9e0cf835-62745cae-5796e6e3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:25.351725Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|35f9fe99-9e0cf835-62745cae-5796e6e3_0] Write session: try to update token
2025-10-10T14:39:25.351746Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|35f9fe99-9e0cf835-62745cae-5796e6e3_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:25.363727Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:25.363747Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:25.363750Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:25.363752Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:25.363764Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602712666326383:7010]
2025-10-10T14:39:25.363769Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602712666326383:7010]
2025-10-10T14:39:25.363774Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602712666326383:7010]
2025-10-10T14:39:25.363838Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:25.363846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:25.363849Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:25.363948Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:25.363956Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:25.363960Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:25.363986Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:25.372985Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2985 sessionId: src_id|35f9fe99-9e0cf835-62745cae-5796e6e3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:25.375906Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:25.415113Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602713448567029:4699]
2025-10-10T14:39:25.415312Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 pipe creation result: OK TabletId: 72075186224037892 Generation: 2984, pipe: [1:7559602713448567029:4699]
2025-10-10T14:39:25.490291Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:25.490972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:25.490989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:25.491015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602713448567029:4699], now have 1 active actors on pipe
2025-10-10T14:39:25.491308Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:25.491340Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 83 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602713448567029:4699]
2025-10-10T14:39:25.491368Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:25.491372Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:25.491447Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2985 reason: error at write: Disconnected sessionId: src_id|35f9fe99-9e0cf835-62745cae-5796e6e3_0
2025-10-10T14:39:25.491511Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:25.491689Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2985 sessionId: src_id|35f9fe99-9e0cf835-62745cae-5796e6e3_0 is DEAD
2025-10-10T14:39:25.491835Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35f9fe99-9e0cf835-62745cae-5796e6e3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:25.491845Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35f9fe99-9e0cf835-62745cae-5796e6e3_0] Write session will restart in 0.006001s
2025-10-10T14:39:25.491882Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35f9fe99-9e0cf835-62745cae-5796e6e3_0] Write session: Do CDS request
2025-10-10T14:39:25.491892Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35f9fe99-9e0cf835-62745cae-5796e6e3_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:25.498906Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|35f9fe99-9e0cf835-62745cae-5796e6e3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:25.498994Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:25.499008Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2986
2025-10-10T14:39:25.499182Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2986 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:25.499219Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2986 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:25.499230Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2986 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:25.499235Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:25.499698Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2986 sessionId:  describe result for acl check
2025-10-10T14:39:25.499745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:25.499752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:25.499754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:25.499761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602713448567055:2951] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:25.500313Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602713448567055:2951] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:25.502635Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602713448567055:2951] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:25.502967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:25.507672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:25.507872Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:25.507883Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:25.507895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:25.507944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:25.507988Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602712666326466:7008]
2025-10-10T14:39:25.507993Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602713448567055:2951] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:25.508018Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602713448567055:2951] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:25.508022Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602713448567055:2951] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:25.508031Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2986 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:25.508648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:25.508937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:25.508976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:25.509320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:25.509391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:25.509398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:25.509399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:25.509401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:25.509402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:25.509403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:25.509404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:25.509406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:25.509407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:25.509409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:25.509410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:25.509411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:25.509412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:25.509418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:25.509433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:25.509437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:25.509442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:25.509448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:25.509453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:25.509457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:25.509462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:25.509466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:25.509472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:25.509476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:25.509480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:25.509485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:25.509492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:25.509502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:25.509515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:25.509522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:25.509527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:25.509533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:25.509539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:25.509545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:25.509550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:25.509556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:25.509561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:25.509566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:25.509571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:25.509577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:25.509583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:25.509589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:25.509593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:25.509599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:25.509604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:25.509609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:25.509614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:25.509619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:25.509624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:25.509630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:25.509639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:25.509645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:25.509691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:25.511944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:25.512263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:25.512276Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:25.512279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:25.512282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:25.512288Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2985 [2:7559602712666326466:7008]
2025-10-10T14:39:25.512299Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:25.512316Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:25.512323Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:25.512327Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:25.512329Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:25.512344Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:25.512352Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:25.512365Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:25.512423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:25.512430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:25.512432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:25.512435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:25.512503Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:25.512511Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:25.512522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:25.512541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:25.512566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:25.512588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602713448567109:2951], now have 1 active actors on pipe
2025-10-10T14:39:25.512596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602713448567030:2438], now have 1 active actors on pipe
2025-10-10T14:39:25.512604Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602712666326460:7008]
2025-10-10T14:39:25.512611Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602712666326460:7008]
2025-10-10T14:39:25.512612Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602712666326460:7008]
2025-10-10T14:39:25.512625Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:25.512640Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:25.512648Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:25.512651Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:25.512653Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:25.512636Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2985
2025-10-10T14:39:25.512662Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:25.512673Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2985
2025-10-10T14:39:25.512670Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:25.512701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:25.512711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:25.512726Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602712666326460:7008]
2025-10-10T14:39:25.512738Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:25.512756Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:25.512773Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|724766e8-134f689d-6801fcff-c59329cc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:25.512785Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:25.512795Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:25.512802Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:25.512813Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:25.512828Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:25.513242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:25.513489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:25.513501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:25.513526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:25.513632Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2986 partition: 0 MaxSeqNo: 40 sessionId: src_id|724766e8-134f689d-6801fcff-c59329cc_0
2025-10-10T14:39:25.514038Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35f9fe99-9e0cf835-62745cae-5796e6e3_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|724766e8-134f689d-6801fcff-c59329cc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:25.516726Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|724766e8-134f689d-6801fcff-c59329cc_0] Write session: try to update token
2025-10-10T14:39:25.516742Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|724766e8-134f689d-6801fcff-c59329cc_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:25.533008Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:25.533032Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:25.533050Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:25.533052Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:25.533063Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602712666326460:7008]
2025-10-10T14:39:25.533069Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602712666326460:7008]
2025-10-10T14:39:25.533076Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602712666326460:7008]
2025-10-10T14:39:25.533116Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:25.533128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:25.533130Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:25.533134Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:25.533135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:25.533138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:25.533283Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:25.535344Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2986 sessionId: src_id|724766e8-134f689d-6801fcff-c59329cc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:25.537847Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:25.591253Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602713448567145:4699]
2025-10-10T14:39:25.591514Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 pipe creation result: OK TabletId: 72075186224037892 Generation: 2985, pipe: [1:7559602713448567145:4699]
2025-10-10T14:39:25.648564Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:25.649039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:25.649064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:25.649124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602713448567145:4699], now have 1 active actors on pipe
2025-10-10T14:39:25.649384Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 84 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602713448567145:4699]
2025-10-10T14:39:25.649437Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:25.649440Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:25.649544Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:25.649566Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2986 reason: error at write: Disconnected sessionId: src_id|724766e8-134f689d-6801fcff-c59329cc_0
2025-10-10T14:39:25.649817Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2986 sessionId: src_id|724766e8-134f689d-6801fcff-c59329cc_0 is DEAD
2025-10-10T14:39:25.649867Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:25.649963Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|724766e8-134f689d-6801fcff-c59329cc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:25.649975Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|724766e8-134f689d-6801fcff-c59329cc_0] Write session will restart in 0.008715s
2025-10-10T14:39:25.650000Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|724766e8-134f689d-6801fcff-c59329cc_0] Write session: Do CDS request
2025-10-10T14:39:25.650006Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|724766e8-134f689d-6801fcff-c59329cc_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:25.660005Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|724766e8-134f689d-6801fcff-c59329cc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:25.660076Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:25.660092Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2987
2025-10-10T14:39:25.660244Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2987 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:25.660291Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2987 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:25.660302Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2987 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:25.660307Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:25.660775Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2987 sessionId:  describe result for acl check
2025-10-10T14:39:25.660811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:25.660818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:25.660820Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:25.660827Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602713448567161:2924] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:25.661511Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602713448567161:2924] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:25.663970Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602713448567161:2924] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:25.665307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:25.671618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602713448567161:2924] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:25.671641Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602713448567161:2924] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:25.671645Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602713448567161:2924] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:25.671655Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2987 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:25.671760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:25.672092Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:25.672108Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:25.672122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:25.672197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:25.672261Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602712666326595:6970]
2025-10-10T14:39:25.672983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:25.673490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:25.673579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:25.673987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:25.674080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:25.674088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:25.674089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:25.674091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:25.674092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:25.674093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:25.674095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:25.674096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:25.674098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:25.674099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:25.674100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:25.674101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:25.674103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:25.674111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:25.674125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:25.674129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:25.674133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:25.674137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:25.674141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:25.674145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:25.674149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:25.674153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:25.674158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:25.674165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:25.674169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:25.674173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:25.674183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:25.674192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:25.674199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:25.674205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:25.674210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:25.674215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:25.674220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:25.674225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:25.674230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:25.674246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:25.674250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:25.674257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:25.674268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:25.674281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:25.674285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:25.674290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:25.674295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:25.674300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:25.674305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:25.674309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:25.674314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:25.674319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:25.674323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:25.674328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:25.674333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:25.674339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:25.674378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:25.677053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:25.677966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:25.677983Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:25.677986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:25.677990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:25.677997Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2986 [2:7559602712666326595:6970]
2025-10-10T14:39:25.678012Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:25.678032Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:25.678036Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:25.678040Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:25.678042Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:25.678061Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:25.678069Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:25.678078Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:25.678146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:25.678155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:25.678157Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:25.678160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:25.678394Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2986
2025-10-10T14:39:25.678412Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2986
2025-10-10T14:39:25.678233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:25.678244Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:25.678257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:25.678269Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:25.678288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:25.678311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602713448567146:2438], now have 1 active actors on pipe
2025-10-10T14:39:25.678315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602713448567216:2924], now have 1 active actors on pipe
2025-10-10T14:39:25.678323Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602712666326589:6970]
2025-10-10T14:39:25.678326Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602712666326589:6970]
2025-10-10T14:39:25.678328Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602712666326589:6970]
2025-10-10T14:39:25.678344Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:25.678358Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:25.678362Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:25.678366Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:25.678373Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:25.678377Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:25.678381Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:25.678411Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602712666326589:6970]
2025-10-10T14:39:25.678415Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:25.678416Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:25.678444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:25.678449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:25.678487Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ca8ef8bc-663ffa72-b08b16be-5de3e5ad_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:25.678498Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:25.678503Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:25.678505Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:25.678518Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:25.678529Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:25.678545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:25.678790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:25.678797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:25.678825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:25.679051Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2987 partition: 0 MaxSeqNo: 40 sessionId: src_id|ca8ef8bc-663ffa72-b08b16be-5de3e5ad_0
2025-10-10T14:39:25.679469Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|724766e8-134f689d-6801fcff-c59329cc_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|ca8ef8bc-663ffa72-b08b16be-5de3e5ad_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:25.682184Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ca8ef8bc-663ffa72-b08b16be-5de3e5ad_0] Write session: try to update token
2025-10-10T14:39:25.682205Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ca8ef8bc-663ffa72-b08b16be-5de3e5ad_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:25.700771Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2987 sessionId: src_id|ca8ef8bc-663ffa72-b08b16be-5de3e5ad_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:25.698598Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:25.698621Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:25.698625Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:25.698627Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:25.698638Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602712666326589:6970]
2025-10-10T14:39:25.698643Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602712666326589:6970]
2025-10-10T14:39:25.698647Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602712666326589:6970]
2025-10-10T14:39:25.698701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:25.698711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:25.698717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:25.698869Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:25.701399Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:25.701408Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:25.701414Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:25.703602Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:25.749411Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602713448567240:4699]
2025-10-10T14:39:25.749670Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 pipe creation result: OK TabletId: 72075186224037892 Generation: 2986, pipe: [1:7559602713448567240:4699]
2025-10-10T14:39:25.814841Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:25.815517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:25.815538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:25.815598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602713448567240:4699], now have 1 active actors on pipe
2025-10-10T14:39:25.815861Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 85 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602713448567240:4699]
2025-10-10T14:39:25.815900Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:25.815935Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:25.815943Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:25.816110Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:25.816395Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca8ef8bc-663ffa72-b08b16be-5de3e5ad_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:25.816404Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca8ef8bc-663ffa72-b08b16be-5de3e5ad_0] Write session will restart in 0.008732s
2025-10-10T14:39:25.816429Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca8ef8bc-663ffa72-b08b16be-5de3e5ad_0] Write session: Do CDS request
2025-10-10T14:39:25.816435Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca8ef8bc-663ffa72-b08b16be-5de3e5ad_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:25.816003Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2987 reason: error at write: Disconnected sessionId: src_id|ca8ef8bc-663ffa72-b08b16be-5de3e5ad_0
2025-10-10T14:39:25.816251Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2987 sessionId: src_id|ca8ef8bc-663ffa72-b08b16be-5de3e5ad_0 is DEAD
2025-10-10T14:39:25.826966Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ca8ef8bc-663ffa72-b08b16be-5de3e5ad_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:25.827031Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:25.827046Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2988
2025-10-10T14:39:25.827235Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2988 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:25.827274Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2988 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:25.827281Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2988 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:25.827286Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:25.827789Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2988 sessionId:  describe result for acl check
2025-10-10T14:39:25.827825Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:25.827827Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:25.827828Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:25.827834Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602713448567285:2879] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:25.828403Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602713448567285:2879] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:25.828974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:25.830800Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602713448567285:2879] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:25.833574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:25.833759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602713448567285:2879] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:25.833772Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602713448567285:2879] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:25.833775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602713448567285:2879] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:25.833784Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2988 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:25.833804Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:25.833817Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:25.833842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:25.833909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:25.833952Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602712666326673:6976]
2025-10-10T14:39:25.834559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:25.834878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:25.834925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:25.835245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:25.835310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:25.835316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:25.835317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:25.835319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:25.835319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:25.835321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:25.835324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:25.835325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:25.835326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:25.835327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:25.835328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:25.835329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:25.835330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:25.835336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:25.835348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:25.835351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:25.835355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:25.835358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:25.835362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:25.835366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:25.835369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:25.835373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:25.835377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:25.835380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:25.835384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:25.835387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:25.835395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:25.835403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:25.835409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:25.835414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:25.835418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:25.835423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:25.835427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:25.835431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:25.835435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:25.835440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:25.835444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:25.835449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:25.835453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:25.835457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:25.835460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:25.835464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:25.835468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:25.835473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:25.835478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:25.835482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:25.835486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:25.835490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:25.835494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:25.835500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:25.835504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:25.835508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:25.835543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:25.839098Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2987
2025-10-10T14:39:25.839106Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2987
2025-10-10T14:39:25.837981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:25.838717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:25.838722Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:25.838724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:25.838727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:25.838733Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2987 [2:7559602712666326673:6976]
2025-10-10T14:39:25.838758Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:25.838775Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:25.838778Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:25.838781Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:25.838783Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:25.838800Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:25.838808Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:25.838815Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:25.838875Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:25.838877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:25.838879Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:25.838881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:25.838948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:25.838951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:25.838961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:25.838972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:25.838987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:25.839011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602713448567315:2879], now have 1 active actors on pipe
2025-10-10T14:39:25.839019Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602712666326668:6976]
2025-10-10T14:39:25.839021Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602712666326668:6976]
2025-10-10T14:39:25.839022Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602712666326668:6976]
2025-10-10T14:39:25.839035Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:25.839043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602713448567243:2438], now have 1 active actors on pipe
2025-10-10T14:39:25.839047Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:25.839050Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:25.839052Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:25.839052Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:25.839067Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:25.839070Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:25.839092Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602712666326668:6976]
2025-10-10T14:39:25.839104Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:25.839105Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:25.839134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:25.839138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:25.839184Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7215ec54-28d38b65-db411d52-96eaea0b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:25.839191Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:25.839195Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:25.839199Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:25.839210Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:25.839221Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:25.839237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:25.839397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:25.839405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:25.839429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:25.839555Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2988 partition: 0 MaxSeqNo: 40 sessionId: src_id|7215ec54-28d38b65-db411d52-96eaea0b_0
2025-10-10T14:39:25.840012Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca8ef8bc-663ffa72-b08b16be-5de3e5ad_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|7215ec54-28d38b65-db411d52-96eaea0b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:25.842720Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7215ec54-28d38b65-db411d52-96eaea0b_0] Write session: try to update token
2025-10-10T14:39:25.842737Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7215ec54-28d38b65-db411d52-96eaea0b_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:25.858912Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:25.858933Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:25.858936Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:25.858938Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:25.858949Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602712666326668:6976]
2025-10-10T14:39:25.858953Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602712666326668:6976]
2025-10-10T14:39:25.858957Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602712666326668:6976]
2025-10-10T14:39:25.859008Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:25.859011Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:25.859017Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:25.859022Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:25.859023Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:25.859026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:25.859164Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:25.860944Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2988 sessionId: src_id|7215ec54-28d38b65-db411d52-96eaea0b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:25.863617Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:25.915848Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602713448567334:4699]
2025-10-10T14:39:25.916072Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 pipe creation result: OK TabletId: 72075186224037892 Generation: 2987, pipe: [1:7559602713448567334:4699]
2025-10-10T14:39:25.976486Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:25.976506Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:25.976579Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2988 reason: error at write: Disconnected sessionId: src_id|7215ec54-28d38b65-db411d52-96eaea0b_0
2025-10-10T14:39:25.976840Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:25.976852Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2988 sessionId: src_id|7215ec54-28d38b65-db411d52-96eaea0b_0 is DEAD
2025-10-10T14:39:25.976889Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 86 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602713448567334:4699]
2025-10-10T14:39:25.975325Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:25.976010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:25.976021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:25.976070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602713448567334:4699], now have 1 active actors on pipe
2025-10-10T14:39:25.977202Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7215ec54-28d38b65-db411d52-96eaea0b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:25.977216Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7215ec54-28d38b65-db411d52-96eaea0b_0] Write session will restart in 0.007893s
2025-10-10T14:39:25.977252Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7215ec54-28d38b65-db411d52-96eaea0b_0] Write session: Do CDS request
2025-10-10T14:39:25.977259Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7215ec54-28d38b65-db411d52-96eaea0b_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:25.977162Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:25.989128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:25.989828Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7215ec54-28d38b65-db411d52-96eaea0b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:25.990231Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:25.990248Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2989
2025-10-10T14:39:25.990450Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2989 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:25.990488Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2989 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:25.990499Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2989 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:25.990504Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:25.990960Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2989 sessionId:  describe result for acl check
2025-10-10T14:39:25.990997Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:25.991004Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:25.991006Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:25.991013Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602713448567381:2890] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:25.991618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602713448567381:2890] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:25.994750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602713448567381:2890] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:25.994799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:25.995090Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:25.995099Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:25.995115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:25.995207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:25.995262Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602712666326753:6964]
2025-10-10T14:39:25.995886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:25.996253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:25.996313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:25.996675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:25.996730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:25.996731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:25.996732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:25.996733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:25.996734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:25.996736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:25.996737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:25.996738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:25.996739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:25.996741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:25.996742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:25.996743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:25.996744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:25.996751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:25.996763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:25.996767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:25.996771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:25.996774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:25.996778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:25.996781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:25.996787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:25.996790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:25.996794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:25.996798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:25.996801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:25.996805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:25.996812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:25.996820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:25.996826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:25.996831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:25.996837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:25.996842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:25.996846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:25.996851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:25.996855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:25.996859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:25.996863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:25.996868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:25.996872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:25.996877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:25.996881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:25.996885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:25.996889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:25.996894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:25.996897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:25.996902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:25.996906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:25.996928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:25.996932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:25.996937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:25.996941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:25.996947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:25.996986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:25.997874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602713448567381:2890] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:25.997889Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602713448567381:2890] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:25.997893Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602713448567381:2890] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:25.997903Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2989 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:26.000440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:26.000770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:26.000784Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:26.000787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:26.000792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:26.000798Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2988 [2:7559602712666326753:6964]
2025-10-10T14:39:26.000812Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:26.000831Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:26.000834Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:26.000839Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:26.000841Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:26.000859Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:26.000867Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:26.000874Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:26.000945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:26.000957Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:26.000959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:26.000961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:26.001051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:26.001059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:26.001072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:26.001088Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:26.001104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:26.001132Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602712666326748:6964]
2025-10-10T14:39:26.001139Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602712666326748:6964]
2025-10-10T14:39:26.001140Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602712666326748:6964]
2025-10-10T14:39:26.001154Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:26.001168Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:26.001188Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:26.001196Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:26.001208Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:26.001211Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:26.001214Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:26.001240Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602712666326748:6964]
2025-10-10T14:39:26.001243Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:26.001287Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:26.001481Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2988
2025-10-10T14:39:26.001510Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2988
2025-10-10T14:39:26.001324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602713448567411:2890], now have 1 active actors on pipe
2025-10-10T14:39:26.001345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602713448567338:2438], now have 1 active actors on pipe
2025-10-10T14:39:26.001658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:26.001664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:26.001701Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b1d9e3b4-cf800009-d2951842-a5583609_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:26.001709Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:26.001714Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:26.001716Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:26.001732Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:26.001744Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:26.001760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:26.003282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:26.003308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:26.003335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:26.003470Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2989 partition: 0 MaxSeqNo: 40 sessionId: src_id|b1d9e3b4-cf800009-d2951842-a5583609_0
2025-10-10T14:39:26.003892Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7215ec54-28d38b65-db411d52-96eaea0b_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|b1d9e3b4-cf800009-d2951842-a5583609_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:26.006627Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b1d9e3b4-cf800009-d2951842-a5583609_0] Write session: try to update token
2025-10-10T14:39:26.006647Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b1d9e3b4-cf800009-d2951842-a5583609_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:26.014955Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:39:26.014974Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:26.014984Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602712666326748:6964]
2025-10-10T14:39:26.015032Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:39:26.015207Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:39:26.015343Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:26.015482Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:26.015630Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:26.015811Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:39:26.015845Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:39:26.016056Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:39:26.034281Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:26.034303Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:26.034307Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:26.034309Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:26.034320Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602712666326748:6964]
2025-10-10T14:39:26.034324Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602712666326748:6964]
2025-10-10T14:39:26.034329Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602712666326748:6964]
2025-10-10T14:39:26.034374Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:26.034378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:26.034380Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:26.034384Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:26.034385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:26.034388Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:26.034523Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:26.038319Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2989 sessionId: src_id|b1d9e3b4-cf800009-d2951842-a5583609_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:26.041051Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:26.076616Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602717743534715:4699]
2025-10-10T14:39:26.076989Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 pipe creation result: OK TabletId: 72075186224037892 Generation: 2988, pipe: [1:7559602717743534715:4699]
2025-10-10T14:39:26.152691Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:26.153278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:26.153291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:26.153319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602717743534715:4699], now have 1 active actors on pipe
2025-10-10T14:39:26.153577Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:26.153984Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 87 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602717743534715:4699]
2025-10-10T14:39:26.154019Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:39:26.154087Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2989 reason: status is not ok: tablet will be restarted right now sessionId: src_id|b1d9e3b4-cf800009-d2951842-a5583609_0
2025-10-10T14:39:26.154294Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2989 sessionId: src_id|b1d9e3b4-cf800009-d2951842-a5583609_0 is DEAD
2025-10-10T14:39:26.154417Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:26.154740Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1d9e3b4-cf800009-d2951842-a5583609_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:39:26.154751Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1d9e3b4-cf800009-d2951842-a5583609_0] Write session will restart in 0.005498s
2025-10-10T14:39:26.154775Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1d9e3b4-cf800009-d2951842-a5583609_0] Write session: Do CDS request
2025-10-10T14:39:26.154781Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1d9e3b4-cf800009-d2951842-a5583609_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:26.161984Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b1d9e3b4-cf800009-d2951842-a5583609_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:26.165717Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:26.165736Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2990
2025-10-10T14:39:26.169473Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2990 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:26.169544Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2990 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:26.169555Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2990 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:26.169563Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:26.170060Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2990 sessionId:  describe result for acl check
2025-10-10T14:39:26.170096Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:26.170098Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:26.170100Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:26.170108Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602717743534758:2880] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:26.170643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602717743534758:2880] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:26.173003Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602717743534758:2880] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:26.176506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:26.176419Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602717743534758:2880] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:26.176437Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602717743534758:2880] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:26.176441Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602717743534758:2880] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:26.176450Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2990 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:26.177198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:26.177430Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:26.177442Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:26.177455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:26.177514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:26.177566Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602716961294131:6968]
2025-10-10T14:39:26.178223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:26.178601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:26.178675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:26.179033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:26.179128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:26.179136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:26.179138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:26.179140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:26.179141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:26.179143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:26.179144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:26.179148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:26.179150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:26.179151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:26.179152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:26.179153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:26.179154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:26.179162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:26.179175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:26.179179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:26.179184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:26.179188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:26.179191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:26.179195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:26.179199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:26.179202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:26.179207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:26.179210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:26.179214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:26.179218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:26.179229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:26.179239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:26.179246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:26.179253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:26.179257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:26.179262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:26.179266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:26.179272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:26.179276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:26.179282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:26.179287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:26.179293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:26.179304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:26.179309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:26.179319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:26.179324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:26.179328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:26.179333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:26.179342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:26.179347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:26.179352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:26.179357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:26.179364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:26.179370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:26.179376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:26.179381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:26.179424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:26.186586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:26.187597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:26.187614Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:26.187616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:26.187620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:26.187628Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2989 [2:7559602716961294131:6968]
2025-10-10T14:39:26.187645Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:26.187669Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:26.187673Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:26.187677Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:26.187679Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:26.187701Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:26.187715Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:26.187729Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:26.187820Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:26.187831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:26.187833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:26.187835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:26.187919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:26.187927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:26.187940Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:26.187952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:26.187969Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:26.187998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602717743534717:2438], now have 1 active actors on pipe
2025-10-10T14:39:26.188007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602717743534788:2880], now have 1 active actors on pipe
2025-10-10T14:39:26.188015Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602716961294125:6968]
2025-10-10T14:39:26.188018Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602716961294125:6968]
2025-10-10T14:39:26.188020Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602716961294125:6968]
2025-10-10T14:39:26.188032Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:26.188052Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:26.188056Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:26.188059Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:26.188061Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:26.188068Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:26.188072Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:26.188065Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2989
2025-10-10T14:39:26.188082Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2989
2025-10-10T14:39:26.188118Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602716961294125:6968]
2025-10-10T14:39:26.188134Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:26.188157Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:26.188341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:26.188356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:26.188402Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f8560a69-328f690d-ff4b410c-db5db2fb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:26.188422Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:26.188426Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:26.188436Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:26.188451Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:26.188468Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:26.188490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:26.188664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:26.188672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:26.188688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:26.188783Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2990 partition: 0 MaxSeqNo: 40 sessionId: src_id|f8560a69-328f690d-ff4b410c-db5db2fb_0
2025-10-10T14:39:26.189346Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1d9e3b4-cf800009-d2951842-a5583609_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|f8560a69-328f690d-ff4b410c-db5db2fb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:26.192123Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f8560a69-328f690d-ff4b410c-db5db2fb_0] Write session: try to update token
2025-10-10T14:39:26.192143Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f8560a69-328f690d-ff4b410c-db5db2fb_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:26.207691Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:26.207713Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:26.207716Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:26.207718Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:26.207730Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602716961294125:6968]
2025-10-10T14:39:26.207734Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602716961294125:6968]
2025-10-10T14:39:26.207738Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602716961294125:6968]
2025-10-10T14:39:26.207777Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:26.207784Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:26.207787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:26.207789Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:26.207795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:26.207797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:26.207926Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:26.210823Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2990 sessionId: src_id|f8560a69-328f690d-ff4b410c-db5db2fb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:26.213807Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:26.254277Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602717743534801:4699]
2025-10-10T14:39:26.254589Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 pipe creation result: OK TabletId: 72075186224037892 Generation: 2989, pipe: [1:7559602717743534801:4699]
2025-10-10T14:39:26.329209Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:26.329898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:26.329916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:26.329963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602717743534801:4699], now have 1 active actors on pipe
2025-10-10T14:39:26.330189Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:26.330405Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:26.330457Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:39:26.330538Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2990 reason: status is not ok: tablet will be restarted right now sessionId: src_id|f8560a69-328f690d-ff4b410c-db5db2fb_0
2025-10-10T14:39:26.330697Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2990 sessionId: src_id|f8560a69-328f690d-ff4b410c-db5db2fb_0 is DEAD
2025-10-10T14:39:26.330736Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 88 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602717743534801:4699]
2025-10-10T14:39:26.330841Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f8560a69-328f690d-ff4b410c-db5db2fb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:39:26.330861Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f8560a69-328f690d-ff4b410c-db5db2fb_0] Write session will restart in 0.009793s
2025-10-10T14:39:26.330890Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f8560a69-328f690d-ff4b410c-db5db2fb_0] Write session: Do CDS request
2025-10-10T14:39:26.330897Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f8560a69-328f690d-ff4b410c-db5db2fb_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:26.341954Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f8560a69-328f690d-ff4b410c-db5db2fb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:26.342048Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:26.342065Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2991
2025-10-10T14:39:26.342299Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2991 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:26.342361Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2991 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:26.342372Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2991 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:26.342376Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:26.342875Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2991 sessionId:  describe result for acl check
2025-10-10T14:39:26.342910Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:26.342912Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:26.342915Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:26.342921Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602717743534837:2856] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:26.343519Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602717743534837:2856] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:26.346241Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602717743534837:2856] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:26.349218Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602717743534837:2856] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:26.349235Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602717743534837:2856] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:26.349239Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602717743534837:2856] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:26.349248Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2991 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:26.357424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:26.358268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:26.358474Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:26.358488Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:26.358500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:26.358553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:26.358600Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602716961294215:6960]
2025-10-10T14:39:26.359298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:26.359622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:26.359669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:26.360015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:26.360084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:26.360086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:26.360087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:26.360088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:26.360090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:26.360091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:26.360092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:26.360093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:26.360095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:26.360096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:26.360097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:26.360098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:26.360099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:26.360105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:26.360119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:26.360123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:26.360128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:26.360132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:26.360136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:26.360140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:26.360144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:26.360147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:26.360152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:26.360169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:26.360173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:26.360177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:26.360188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:26.360196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:26.360211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:26.360217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:26.360222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:26.360227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:26.360231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:26.360237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:26.360242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:26.360247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:26.360251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:26.360256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:26.360261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:26.360266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:26.360271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:26.360277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:26.360281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:26.360286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:26.360291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:26.360297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:26.360301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:26.360307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:26.360311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:26.360316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:26.360320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:26.360325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:26.360368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:26.362922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:26.363854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:26.363867Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:26.363870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:26.363875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:26.363883Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2990 [2:7559602716961294215:6960]
2025-10-10T14:39:26.363896Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:26.363914Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:26.363918Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:26.363921Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:26.363923Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:26.363943Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:26.363951Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:26.363959Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:26.364032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:26.364043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:26.364046Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:26.364050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:26.364121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:26.364133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:26.364146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:26.364158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:26.364176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:26.364200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602717743534802:2438], now have 1 active actors on pipe
2025-10-10T14:39:26.364210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602717743534874:2856], now have 1 active actors on pipe
2025-10-10T14:39:26.364218Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602716961294210:6960]
2025-10-10T14:39:26.364221Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602716961294210:6960]
2025-10-10T14:39:26.364223Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602716961294210:6960]
2025-10-10T14:39:26.364237Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:26.364257Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:26.364263Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:26.364268Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:26.364271Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:26.364279Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:26.364283Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:26.364274Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2990
2025-10-10T14:39:26.364297Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2990
2025-10-10T14:39:26.364312Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602716961294210:6960]
2025-10-10T14:39:26.364323Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:26.364339Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:26.364513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:26.364525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:26.364557Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dfa14614-ed1cd504-b1a6921d-b52edba6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:26.364570Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:26.364574Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:26.364581Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:26.364596Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:26.364606Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:26.364621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:26.364802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:26.364809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:26.364822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:26.364925Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2991 partition: 0 MaxSeqNo: 40 sessionId: src_id|dfa14614-ed1cd504-b1a6921d-b52edba6_0
2025-10-10T14:39:26.365582Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f8560a69-328f690d-ff4b410c-db5db2fb_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|dfa14614-ed1cd504-b1a6921d-b52edba6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:26.368511Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dfa14614-ed1cd504-b1a6921d-b52edba6_0] Write session: try to update token
2025-10-10T14:39:26.368533Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dfa14614-ed1cd504-b1a6921d-b52edba6_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:26.391621Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:26.391646Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:26.391649Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:26.391651Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:26.391665Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602716961294210:6960]
2025-10-10T14:39:26.391669Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602716961294210:6960]
2025-10-10T14:39:26.391672Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602716961294210:6960]
2025-10-10T14:39:26.391726Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:26.391741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:26.391744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:26.391884Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:26.391921Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:26.391938Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:26.391943Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:26.392572Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2991 sessionId: src_id|dfa14614-ed1cd504-b1a6921d-b52edba6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:26.395393Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:26.430947Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602717743534892:4699]
2025-10-10T14:39:26.431307Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 pipe creation result: OK TabletId: 72075186224037892 Generation: 2990, pipe: [1:7559602717743534892:4699]
2025-10-10T14:39:26.516640Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:26.517221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:26.517238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:26.517286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602717743534892:4699], now have 1 active actors on pipe
2025-10-10T14:39:26.517515Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:26.518097Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dfa14614-ed1cd504-b1a6921d-b52edba6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:39:26.518109Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dfa14614-ed1cd504-b1a6921d-b52edba6_0] Write session will restart in 0.009655s
2025-10-10T14:39:26.518135Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dfa14614-ed1cd504-b1a6921d-b52edba6_0] Write session: Do CDS request
2025-10-10T14:39:26.518142Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dfa14614-ed1cd504-b1a6921d-b52edba6_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:26.517532Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 89 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602717743534892:4699]
2025-10-10T14:39:26.517567Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:26.517612Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:39:26.517704Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2991 reason: status is not ok: tablet will be restarted right now sessionId: src_id|dfa14614-ed1cd504-b1a6921d-b52edba6_0
2025-10-10T14:39:26.517920Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2991 sessionId: src_id|dfa14614-ed1cd504-b1a6921d-b52edba6_0 is DEAD
2025-10-10T14:39:26.528942Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dfa14614-ed1cd504-b1a6921d-b52edba6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:26.529045Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:26.529065Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2992
2025-10-10T14:39:26.529233Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2992 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:26.529293Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2992 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:26.529302Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2992 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:26.529314Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:26.529786Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2992 sessionId:  describe result for acl check
2025-10-10T14:39:26.529831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:26.529843Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:26.529845Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:26.529852Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602717743534939:2833] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:26.530441Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602717743534939:2833] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:26.531280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:26.533031Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602717743534939:2833] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:26.536648Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602717743534939:2833] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:26.536665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602717743534939:2833] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:26.536670Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602717743534939:2833] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:26.536682Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2992 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:26.536411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:26.536661Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:26.536669Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:26.536682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:26.536747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:26.536813Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602716961294298:6954]
2025-10-10T14:39:26.537468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:26.537973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:26.538029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:26.538874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:26.538987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:26.538994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:26.538995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:26.538996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:26.538997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:26.538999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:26.539000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:26.539001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:26.539002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:26.539004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:26.539005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:26.539006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:26.539007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:26.539015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:26.539028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:26.539031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:26.539035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:26.539038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:26.539042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:26.539045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:26.539048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:26.539051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:26.539055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:26.539058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:26.539062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:26.539065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:26.539073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:26.539083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:26.539089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:26.539094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:26.539098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:26.539104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:26.539108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:26.539112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:26.539116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:26.539121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:26.539125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:26.539130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:26.539135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:26.539139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:26.539143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:26.539148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:26.539152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:26.539158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:26.539162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:26.539167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:26.539172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:26.539185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:26.539189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:26.539194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:26.539199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:26.539204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:26.539249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:26.541734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:26.542067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:26.542082Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:26.542084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:26.542088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:26.542094Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2991 [2:7559602716961294298:6954]
2025-10-10T14:39:26.542109Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:26.542129Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:26.542132Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:26.542136Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:26.542141Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:26.542158Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:26.542166Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:26.542173Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:26.542262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:26.542273Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:26.542275Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:26.542277Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:26.542348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:26.542357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:26.542368Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:26.542379Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:26.542395Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:26.542424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602717743534894:2438], now have 1 active actors on pipe
2025-10-10T14:39:26.542433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602717743534970:2833], now have 1 active actors on pipe
2025-10-10T14:39:26.542441Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602716961294293:6954]
2025-10-10T14:39:26.542443Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602716961294293:6954]
2025-10-10T14:39:26.542445Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602716961294293:6954]
2025-10-10T14:39:26.542460Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:26.542475Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:26.542478Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:26.542478Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:26.542480Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:26.542473Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2991
2025-10-10T14:39:26.542490Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2991
2025-10-10T14:39:26.542507Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:26.542516Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:26.542554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:26.542563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:26.542578Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602716961294293:6954]
2025-10-10T14:39:26.542591Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:26.542600Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:26.542623Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e1d1b261-77a25a36-ee88dee1-e8b5064d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:26.542635Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:26.542638Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:26.542644Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:26.542655Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:26.542669Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:26.542693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:26.542995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:26.543010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:26.543032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:26.543563Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2992 partition: 0 MaxSeqNo: 40 sessionId: src_id|e1d1b261-77a25a36-ee88dee1-e8b5064d_0
2025-10-10T14:39:26.544008Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dfa14614-ed1cd504-b1a6921d-b52edba6_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|e1d1b261-77a25a36-ee88dee1-e8b5064d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:26.546934Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e1d1b261-77a25a36-ee88dee1-e8b5064d_0] Write session: try to update token
2025-10-10T14:39:26.546957Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e1d1b261-77a25a36-ee88dee1-e8b5064d_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:26.564568Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:26.564600Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:26.564605Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:26.564608Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:26.564621Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602716961294293:6954]
2025-10-10T14:39:26.564628Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602716961294293:6954]
2025-10-10T14:39:26.564635Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602716961294293:6954]
2025-10-10T14:39:26.564711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:26.564734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:26.564744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:26.564995Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:26.565379Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:26.565393Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:26.565398Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:26.565769Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2992 sessionId: src_id|e1d1b261-77a25a36-ee88dee1-e8b5064d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:26.568489Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:26.617816Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602717743534994:4699]
2025-10-10T14:39:26.618161Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 pipe creation result: OK TabletId: 72075186224037892 Generation: 2991, pipe: [1:7559602717743534994:4699]
2025-10-10T14:39:26.680384Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:26.680950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:26.680964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:26.681006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602717743534994:4699], now have 1 active actors on pipe
2025-10-10T14:39:26.681394Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:26.681755Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1d1b261-77a25a36-ee88dee1-e8b5064d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:26.681767Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1d1b261-77a25a36-ee88dee1-e8b5064d_0] Write session will restart in 0.006353s
2025-10-10T14:39:26.681793Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1d1b261-77a25a36-ee88dee1-e8b5064d_0] Write session: Do CDS request
2025-10-10T14:39:26.681799Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1d1b261-77a25a36-ee88dee1-e8b5064d_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:26.681242Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:26.681260Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:26.681357Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2992 reason: error at write: Disconnected sessionId: src_id|e1d1b261-77a25a36-ee88dee1-e8b5064d_0
2025-10-10T14:39:26.681594Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2992 sessionId: src_id|e1d1b261-77a25a36-ee88dee1-e8b5064d_0 is DEAD
2025-10-10T14:39:26.681802Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:26.681849Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 90 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602717743534994:4699]
2025-10-10T14:39:26.688931Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e1d1b261-77a25a36-ee88dee1-e8b5064d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:26.689009Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:26.689046Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2993
2025-10-10T14:39:26.689194Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2993 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:26.689229Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2993 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:26.689239Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2993 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:26.689243Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:26.689693Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2993 sessionId:  describe result for acl check
2025-10-10T14:39:26.689736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:26.689743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:26.689744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:26.689750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602717743535021:2800] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:26.690313Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602717743535021:2800] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:26.692716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602717743535021:2800] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:26.694682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:26.700036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:26.700110Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602717743535021:2800] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:26.700127Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602717743535021:2800] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:26.700132Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602717743535021:2800] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:26.700142Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2993 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:26.700309Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:26.700325Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:26.700339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:26.700419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:26.700471Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602716961294432:6910]
2025-10-10T14:39:26.701110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:26.701472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:26.701532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:26.701863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:26.701945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:26.701954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:26.701955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:26.701956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:26.701958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:26.701959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:26.701960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:26.701962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:26.701963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:26.701964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:26.701966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:26.701967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:26.701968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:26.701976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:26.701989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:26.701994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:26.701998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:26.702001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:26.702005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:26.702009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:26.702012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:26.702016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:26.702020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:26.702027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:26.702031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:26.702036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:26.702044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:26.702053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:26.702060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:26.702067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:26.702071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:26.702077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:26.702082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:26.702087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:26.702096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:26.702108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:26.702113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:26.702124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:26.702130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:26.702135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:26.702144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:26.702150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:26.702155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:26.702161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:26.702167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:26.702171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:26.702177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:26.702188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:26.702193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:26.702198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:26.702203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:26.702213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:26.702252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:26.704903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:26.705874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:26.705889Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:26.705892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:26.705896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:26.705903Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2992 [2:7559602716961294432:6910]
2025-10-10T14:39:26.705917Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:26.705935Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:26.705944Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:26.705947Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:26.705950Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:26.705968Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:26.705981Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:26.705991Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:26.706057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:26.706064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:26.706066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:26.706069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:26.706143Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:26.706151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:26.706164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:26.706182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:26.706204Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:26.706231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602717743535082:2800], now have 1 active actors on pipe
2025-10-10T14:39:26.706239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602717743535006:2438], now have 1 active actors on pipe
2025-10-10T14:39:26.706248Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602716961294427:6910]
2025-10-10T14:39:26.706255Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602716961294427:6910]
2025-10-10T14:39:26.706257Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602716961294427:6910]
2025-10-10T14:39:26.706272Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:26.706288Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:26.706290Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:26.706301Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:26.706303Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:26.706307Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:26.706311Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:26.706297Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2992
2025-10-10T14:39:26.706336Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602716961294427:6910]
2025-10-10T14:39:26.706353Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2992
2025-10-10T14:39:26.706348Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:26.706358Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:26.706392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:26.706398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:26.706429Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|532c7710-8c1bcc3b-210d3e05-edc889e0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:26.706448Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:26.706459Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:26.706461Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:26.706473Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:26.706483Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:26.706507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:26.706643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:26.706652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:26.706668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:26.706810Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2993 partition: 0 MaxSeqNo: 40 sessionId: src_id|532c7710-8c1bcc3b-210d3e05-edc889e0_0
2025-10-10T14:39:26.707280Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1d1b261-77a25a36-ee88dee1-e8b5064d_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|532c7710-8c1bcc3b-210d3e05-edc889e0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:26.710059Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|532c7710-8c1bcc3b-210d3e05-edc889e0_0] Write session: try to update token
2025-10-10T14:39:26.710080Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|532c7710-8c1bcc3b-210d3e05-edc889e0_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:26.718204Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:39:26.718224Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:26.718236Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602716961294427:6910]
2025-10-10T14:39:26.718293Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:39:26.718296Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:39:26.718487Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:39:26.718640Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:26.718812Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:26.718956Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:26.719163Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:39:26.719205Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:39:26.725213Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2993 sessionId: src_id|532c7710-8c1bcc3b-210d3e05-edc889e0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:26.727838Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:26.728066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:26.728088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:26.728131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:39:26.728228Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:39:26.736564Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:26.736591Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:26.736595Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:26.736598Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:26.736609Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602716961294427:6910]
2025-10-10T14:39:26.736613Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602716961294427:6910]
2025-10-10T14:39:26.736620Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602716961294427:6910]
2025-10-10T14:39:26.736675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:26.736674Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:26.736682Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:26.736686Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:26.736689Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:26.736691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:26.736832Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:26.782162Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602717743535106:4699]
2025-10-10T14:39:26.782634Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 pipe creation result: OK TabletId: 72075186224037892 Generation: 2992, pipe: [1:7559602717743535106:4699]
2025-10-10T14:39:26.857356Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:26.866602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:26.866639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:26.866839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:26.866914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:26.866987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:26.867059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:26.867109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:26.867120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:26.867201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:26.867271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:26.867337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:26.867413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:26.867468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:26.867477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:26.867581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:26.867655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:26.867733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:26.867808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:26.867855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:26.867867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:26.867939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:26.868006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:26.868081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:26.868154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:26.868205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:26.868214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:26.868285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:26.868355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:26.868424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:26.868499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:26.868547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:26.868555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:26.868629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:26.868702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:26.868775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:26.868851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:26.868903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:26.868910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:26.868982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:26.869066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:26.869138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:26.869209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:26.869262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:26.869273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:26.869368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:26.869437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:26.869508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:26.869572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:26.869619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:26.869627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:26.869704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:26.869777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:26.869850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:26.869922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:26.870013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:26.870021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:26.870097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:26.870173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:26.870250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:26.870314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:26.870363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:26.870375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:26.870443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602717743535106:4699], now have 1 active actors on pipe
2025-10-10T14:39:26.870815Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:26.870830Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:26.870866Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2993 reason: error at write: Disconnected sessionId: src_id|532c7710-8c1bcc3b-210d3e05-edc889e0_0
2025-10-10T14:39:26.871097Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2993 sessionId: src_id|532c7710-8c1bcc3b-210d3e05-edc889e0_0 is DEAD
2025-10-10T14:39:26.871297Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|532c7710-8c1bcc3b-210d3e05-edc889e0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:26.871308Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|532c7710-8c1bcc3b-210d3e05-edc889e0_0] Write session will restart in 0.009321s
2025-10-10T14:39:26.871337Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|532c7710-8c1bcc3b-210d3e05-edc889e0_0] Write session: Do CDS request
2025-10-10T14:39:26.871344Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|532c7710-8c1bcc3b-210d3e05-edc889e0_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:26.871272Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:26.871321Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 91 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602717743535106:4699]
2025-10-10T14:39:26.871808Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:26.881919Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|532c7710-8c1bcc3b-210d3e05-edc889e0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:26.885694Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:26.885710Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2994
2025-10-10T14:39:26.885872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:26.885920Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2994 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:26.885966Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2994 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:26.885972Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2994 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:26.885977Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:26.890176Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2994 sessionId:  describe result for acl check
2025-10-10T14:39:26.890222Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:26.890224Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:26.890226Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:26.890232Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602717743535163:2766] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:26.890843Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602717743535163:2766] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:26.891674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:26.891947Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:26.891959Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:26.891972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:26.892045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:26.892092Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602716961294517:6906]
2025-10-10T14:39:26.892733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:26.893051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:26.893098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:26.893699Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602717743535163:2766] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:26.893912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:26.894000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:26.894007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:26.894008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:26.894009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:26.894010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:26.894012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:26.894013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:26.894014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:26.894015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:26.894016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:26.894018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:26.894019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:26.894020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:26.894026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:26.894041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:26.894045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:26.894049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:26.894053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:26.894057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:26.894061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:26.894066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:26.894070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:26.894074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:26.894078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:26.894082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:26.894086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:26.894096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:26.894111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:26.894122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:26.894128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:26.894133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:26.894138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:26.894143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:26.894152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:26.894157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:26.894163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:26.894172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:26.894177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:26.894187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:26.894192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:26.894198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:26.894203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:26.894213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:26.894218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:26.894222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:26.894226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:26.894231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:26.894241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:26.894245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:26.894250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:26.894259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:26.894264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:26.894303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:26.896995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:26.896822Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602717743535163:2766] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:26.896838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602717743535163:2766] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:26.896842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602717743535163:2766] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:26.896851Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2994 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:26.897411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:26.897435Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:26.897437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:26.897442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:26.897449Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2993 [2:7559602716961294517:6906]
2025-10-10T14:39:26.897463Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:26.897482Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:26.897492Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:26.897496Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:26.897499Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:26.897516Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:26.897524Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:26.897538Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:26.897598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:26.897605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:26.897607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:26.897609Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:26.897681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:26.897688Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:26.897700Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:26.897713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:26.897736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:26.897764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602717743535199:2766], now have 1 active actors on pipe
2025-10-10T14:39:26.897773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602717743535116:2438], now have 1 active actors on pipe
2025-10-10T14:39:26.897781Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602716961294512:6906]
2025-10-10T14:39:26.897783Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602716961294512:6906]
2025-10-10T14:39:26.897785Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602716961294512:6906]
2025-10-10T14:39:26.897799Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:26.897814Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:26.897830Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:26.897843Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:26.897814Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2993
2025-10-10T14:39:26.897815Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2993
2025-10-10T14:39:26.897870Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602716961294512:6906]
2025-10-10T14:39:26.897878Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:26.897883Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:26.897886Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:26.897888Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:26.897896Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:26.897934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:26.897943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:26.897974Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c86281ea-4ab90520-6cca5693-38ed7a1a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:26.897986Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:26.897990Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:26.897992Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:26.898003Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:26.898014Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:26.898027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:26.898271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:26.898282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:26.898300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:26.898443Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2994 partition: 0 MaxSeqNo: 40 sessionId: src_id|c86281ea-4ab90520-6cca5693-38ed7a1a_0
2025-10-10T14:39:26.901618Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|532c7710-8c1bcc3b-210d3e05-edc889e0_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|c86281ea-4ab90520-6cca5693-38ed7a1a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:26.904228Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c86281ea-4ab90520-6cca5693-38ed7a1a_0] Write session: try to update token
2025-10-10T14:39:26.904247Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c86281ea-4ab90520-6cca5693-38ed7a1a_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:26.910280Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:39:26.910302Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:26.910318Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602716961294512:6906]
2025-10-10T14:39:26.910369Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:39:26.910545Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:39:26.910696Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:26.910847Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:26.910996Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:26.911194Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:39:26.911241Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:39:26.911345Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:39:26.931187Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:26.931213Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:26.931216Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:26.931218Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:26.931234Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602716961294512:6906]
2025-10-10T14:39:26.931237Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602716961294512:6906]
2025-10-10T14:39:26.931241Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602716961294512:6906]
2025-10-10T14:39:26.931292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:26.931304Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:26.931306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:26.931322Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:26.931332Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:26.931337Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:26.931455Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:26.931675Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2994 sessionId: src_id|c86281ea-4ab90520-6cca5693-38ed7a1a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:26.934508Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:26.971560Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602717743535207:4699]
2025-10-10T14:39:26.973883Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 pipe creation result: OK TabletId: 72075186224037892 Generation: 2993, pipe: [1:7559602717743535207:4699]
2025-10-10T14:39:27.052434Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:27.052711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:27.052719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:27.052741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602717743535207:4699], now have 1 active actors on pipe
2025-10-10T14:39:27.053149Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:27.053922Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 92 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602717743535207:4699]
2025-10-10T14:39:27.053952Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:27.053994Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:39:27.054063Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2994 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c86281ea-4ab90520-6cca5693-38ed7a1a_0
2025-10-10T14:39:27.054251Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2994 sessionId: src_id|c86281ea-4ab90520-6cca5693-38ed7a1a_0 is DEAD
2025-10-10T14:39:27.054639Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c86281ea-4ab90520-6cca5693-38ed7a1a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:39:27.054647Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c86281ea-4ab90520-6cca5693-38ed7a1a_0] Write session will restart in 0.006422s
2025-10-10T14:39:27.054665Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c86281ea-4ab90520-6cca5693-38ed7a1a_0] Write session: Do CDS request
2025-10-10T14:39:27.054670Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c86281ea-4ab90520-6cca5693-38ed7a1a_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:27.061930Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c86281ea-4ab90520-6cca5693-38ed7a1a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:27.068101Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:27.068118Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2995
2025-10-10T14:39:27.068262Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2995 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:27.068294Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2995 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:27.068300Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2995 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:27.068305Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:27.069001Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2995 sessionId:  describe result for acl check
2025-10-10T14:39:27.069056Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:27.069058Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:27.069061Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:27.069067Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602722038502516:2758] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:27.069681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602722038502516:2758] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:27.074082Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602722038502516:2758] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:27.077928Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602722038502516:2758] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:27.077944Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602722038502516:2758] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:27.077947Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602722038502516:2758] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:27.077957Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2995 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:27.079529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:27.080686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:27.080863Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:27.080869Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:27.080880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:27.080943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:27.080987Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602721256261900:6900]
2025-10-10T14:39:27.081616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:27.086410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:27.086517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:27.086930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:27.087000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:27.087010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:27.087011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:27.087012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:27.087014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:27.087016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:27.087017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:27.087018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:27.087020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:27.087021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:27.087022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:27.087023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:27.087024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:27.087032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:27.087047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:27.087051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:27.087056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:27.087060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:27.087065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:27.087070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:27.087073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:27.087077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:27.087082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:27.087087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:27.087091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:27.087095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:27.087105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:27.087115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:27.087122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:27.087129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:27.087135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:27.087141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:27.087148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:27.087154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:27.087159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:27.087166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:27.087171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:27.087177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:27.087182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:27.087188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:27.087192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:27.087198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:27.087203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:27.087209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:27.087213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:27.087219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:27.087224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:27.087229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:27.087234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:27.087239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:27.087244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:27.087250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:27.087306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:27.093083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:27.093423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:27.093437Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:27.093441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:27.093445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:27.093453Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2994 [2:7559602721256261900:6900]
2025-10-10T14:39:27.093468Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:27.093499Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:27.093502Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:27.093507Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:27.093516Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:27.093538Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:27.093550Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:27.093558Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:27.093625Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:27.093636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:27.093638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:27.093641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:27.093711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:27.093719Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:27.093731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:27.093742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:27.093758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:27.093787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602722038502580:2758], now have 1 active actors on pipe
2025-10-10T14:39:27.093796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602722038502505:2438], now have 1 active actors on pipe
2025-10-10T14:39:27.093804Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602721256261895:6900]
2025-10-10T14:39:27.093806Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602721256261895:6900]
2025-10-10T14:39:27.093810Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602721256261895:6900]
2025-10-10T14:39:27.093824Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:27.093838Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:27.093843Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:27.093850Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:27.093852Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:27.093859Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:27.093862Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:27.093895Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2994
2025-10-10T14:39:27.093895Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2994
2025-10-10T14:39:27.093900Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602721256261895:6900]
2025-10-10T14:39:27.093914Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:27.093918Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:27.094372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:27.094385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:27.094428Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e15e67f2-c3cc723a-363b7dbc-679bb7b9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:27.094442Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:27.094447Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:27.094449Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:27.094462Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:27.094483Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:27.094498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:27.094703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:27.094713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:27.094730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:27.095396Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2995 partition: 0 MaxSeqNo: 40 sessionId: src_id|e15e67f2-c3cc723a-363b7dbc-679bb7b9_0
2025-10-10T14:39:27.095823Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c86281ea-4ab90520-6cca5693-38ed7a1a_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|e15e67f2-c3cc723a-363b7dbc-679bb7b9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:27.098691Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e15e67f2-c3cc723a-363b7dbc-679bb7b9_0] Write session: try to update token
2025-10-10T14:39:27.098712Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e15e67f2-c3cc723a-363b7dbc-679bb7b9_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:27.106848Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:39:27.106869Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:27.106881Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602721256261895:6900]
2025-10-10T14:39:27.106932Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:39:27.106934Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:39:27.107122Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:39:27.107274Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:27.107417Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:27.107556Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:27.107755Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:39:27.107796Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:39:27.123393Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2995 sessionId: src_id|e15e67f2-c3cc723a-363b7dbc-679bb7b9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:27.125975Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:27.127513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:27.127541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:27.127566Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:27.127569Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:27.127573Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:27.127575Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:27.127585Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602721256261895:6900]
2025-10-10T14:39:27.127589Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602721256261895:6900]
2025-10-10T14:39:27.127593Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602721256261895:6900]
2025-10-10T14:39:27.127657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:27.127672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:27.127674Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:27.127758Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:27.127785Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:27.127794Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:27.127836Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:27.153896Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602722038502595:4699]
2025-10-10T14:39:27.154293Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 pipe creation result: OK TabletId: 72075186224037892 Generation: 2994, pipe: [1:7559602722038502595:4699]
2025-10-10T14:39:27.245273Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:27.245832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:39:27.245868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602722038502595:4699], now have 1 active actors on pipe
2025-10-10T14:39:27.245974Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:39:27.246038Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:27.246079Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:27.246087Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:27.246095Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 93 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602722038502595:4699]
2025-10-10T14:39:27.246203Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2995 reason: error at write: Disconnected sessionId: src_id|e15e67f2-c3cc723a-363b7dbc-679bb7b9_0
2025-10-10T14:39:27.246452Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2995 sessionId: src_id|e15e67f2-c3cc723a-363b7dbc-679bb7b9_0 is DEAD
2025-10-10T14:39:27.246615Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e15e67f2-c3cc723a-363b7dbc-679bb7b9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:27.246626Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e15e67f2-c3cc723a-363b7dbc-679bb7b9_0] Write session will restart in 0.008798s
2025-10-10T14:39:27.246653Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e15e67f2-c3cc723a-363b7dbc-679bb7b9_0] Write session: Do CDS request
2025-10-10T14:39:27.246660Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e15e67f2-c3cc723a-363b7dbc-679bb7b9_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:27.256919Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e15e67f2-c3cc723a-363b7dbc-679bb7b9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:27.257065Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:27.257090Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2996
2025-10-10T14:39:27.257257Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2996 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:27.257299Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2996 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:27.257309Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2996 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:27.257313Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:27.257857Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2996 sessionId:  describe result for acl check
2025-10-10T14:39:27.257909Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:27.257920Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:27.257922Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:27.257929Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602722038502645:2730] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:27.258571Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602722038502645:2730] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:27.258562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:27.264756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:27.265063Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:27.265075Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:27.265088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:27.265150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:27.265198Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602721256261989:6896]
2025-10-10T14:39:27.265927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:27.266116Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602722038502645:2730] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:27.266271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:27.266319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:27.267117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:27.267185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:27.267189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:27.267190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:27.267192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:27.267193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:27.267195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:27.267196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:27.267197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:27.267199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:27.267200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:27.267202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:27.267203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:27.267204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:27.267211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:27.267224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:27.267228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:27.267234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:27.267238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:27.267242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:27.267246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:27.267249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:27.267253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:27.267259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:27.267263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:27.267266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:27.267270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:27.267278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:27.267287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:27.267293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:27.267299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:27.267304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:27.267309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:27.267314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:27.267319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:27.267324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:27.267329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:27.267334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:27.267339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:27.267344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:27.267349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:27.267354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:27.267359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:27.267364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:27.267369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:27.267373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:27.267378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:27.267383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:27.267389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:27.267393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:27.267398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:27.267407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:27.267412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:27.267456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:27.270050Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602722038502645:2730] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:27.270071Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602722038502645:2730] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:27.270076Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602722038502645:2730] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:27.270086Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2996 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:27.270090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:27.270412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:27.270427Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:27.270429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:27.270433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:27.270439Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2995 [2:7559602721256261989:6896]
2025-10-10T14:39:27.270453Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:27.270469Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:27.270477Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:27.270481Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:27.270483Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:27.270500Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:27.270512Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:27.270522Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:27.270588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:27.270595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:27.270597Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:27.270601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:27.270679Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:27.270688Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:27.270700Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:27.270715Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:27.270735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:27.270762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602722038502681:2730], now have 1 active actors on pipe
2025-10-10T14:39:27.270774Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602721256261984:6896]
2025-10-10T14:39:27.270777Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602721256261984:6896]
2025-10-10T14:39:27.270779Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602721256261984:6896]
2025-10-10T14:39:27.270788Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:27.270801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602722038502598:2438], now have 1 active actors on pipe
2025-10-10T14:39:27.270803Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:27.270806Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:27.270808Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:27.270814Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:27.270830Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:27.270834Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:27.270851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:27.270860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:27.270899Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602721256261984:6896]
2025-10-10T14:39:27.270910Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:27.270919Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:27.270936Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7df2abe2-d99591ab-6874d0aa-12fadc35_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:27.270949Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:27.270956Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:27.270958Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:27.270968Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:27.270980Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:27.271016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:27.271193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:27.271202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:27.271217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:27.271797Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e15e67f2-c3cc723a-363b7dbc-679bb7b9_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|7df2abe2-d99591ab-6874d0aa-12fadc35_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:27.270760Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2995
2025-10-10T14:39:27.270792Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2995
2025-10-10T14:39:27.271350Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2996 partition: 0 MaxSeqNo: 40 sessionId: src_id|7df2abe2-d99591ab-6874d0aa-12fadc35_0
2025-10-10T14:39:27.274690Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7df2abe2-d99591ab-6874d0aa-12fadc35_0] Write session: try to update token
2025-10-10T14:39:27.274709Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7df2abe2-d99591ab-6874d0aa-12fadc35_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:27.289717Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2996 sessionId: src_id|7df2abe2-d99591ab-6874d0aa-12fadc35_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:27.292705Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:27.293104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:27.293131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:27.293158Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:27.293167Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:27.293171Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:27.293173Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:27.293185Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602721256261984:6896]
2025-10-10T14:39:27.293194Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602721256261984:6896]
2025-10-10T14:39:27.293197Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602721256261984:6896]
2025-10-10T14:39:27.293245Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:27.293260Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:27.293261Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:27.293265Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:27.293268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:27.293271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:27.293440Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:27.346381Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602722038502688:4699]
2025-10-10T14:39:27.346666Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 pipe creation result: OK TabletId: 72075186224037892 Generation: 2995, pipe: [1:7559602722038502688:4699]
2025-10-10T14:39:27.414682Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:27.415277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:39:27.415342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602722038502688:4699], now have 1 active actors on pipe
2025-10-10T14:39:27.415433Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:39:27.415553Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:27.415670Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 94 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602722038502688:4699]
2025-10-10T14:39:27.427749Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:27.427764Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:27.427794Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2996 reason: error at write: Disconnected sessionId: src_id|7df2abe2-d99591ab-6874d0aa-12fadc35_0
2025-10-10T14:39:27.427964Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2996 sessionId: src_id|7df2abe2-d99591ab-6874d0aa-12fadc35_0 is DEAD
2025-10-10T14:39:27.428124Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7df2abe2-d99591ab-6874d0aa-12fadc35_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:27.428146Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7df2abe2-d99591ab-6874d0aa-12fadc35_0] Write session will restart in 0.008851s
2025-10-10T14:39:27.428173Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7df2abe2-d99591ab-6874d0aa-12fadc35_0] Write session: Do CDS request
2025-10-10T14:39:27.428179Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7df2abe2-d99591ab-6874d0aa-12fadc35_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:27.438101Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7df2abe2-d99591ab-6874d0aa-12fadc35_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:27.438489Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:27.438512Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2997
2025-10-10T14:39:27.438631Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2997 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:27.438672Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2997 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:27.438677Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2997 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:27.438681Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:27.439142Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2997 sessionId:  describe result for acl check
2025-10-10T14:39:27.439185Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:27.439193Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:27.439195Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:27.439203Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602722038502740:2724] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:27.439788Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602722038502740:2724] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:27.439881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:27.440874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:27.441100Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:27.441115Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:27.441129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:27.441191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:27.441239Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602721256262078:6879]
2025-10-10T14:39:27.441914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:27.442230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:27.442302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:27.442598Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602722038502740:2724] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:27.442650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:27.442722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:27.442730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:27.442731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:27.442733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:27.442734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:27.442736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:27.442737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:27.442739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:27.442740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:27.442741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:27.442743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:27.442744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:27.442746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:27.442752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:27.442766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:27.442770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:27.442774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:27.442779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:27.442783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:27.442787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:27.442792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:27.442796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:27.442804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:27.442808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:27.442813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:27.442822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:27.442847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:27.442865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:27.442872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:27.442879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:27.442884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:27.442894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:27.442900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:27.442911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:27.442915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:27.442923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:27.442931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:27.442937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:27.442946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:27.442951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:27.442956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:27.442965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:27.442970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:27.442976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:27.442985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:27.442990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:27.442994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:27.443000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:27.443009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:27.443015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:27.443019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:27.443025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:27.443067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:27.445451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:27.445443Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602722038502740:2724] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:27.445458Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602722038502740:2724] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:27.445462Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602722038502740:2724] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:27.445471Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2997 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:27.446100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:27.446113Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:27.446116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:27.446120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:27.446126Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2996 [2:7559602721256262078:6879]
2025-10-10T14:39:27.446140Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:27.446161Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:27.446170Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:27.446173Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:27.446176Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:27.446192Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:27.446200Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:27.446207Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:27.446272Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:27.446282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:27.446284Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:27.446286Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:27.446353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:27.446362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:27.446373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:27.446385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:27.446401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:27.446428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602722038502774:2724], now have 1 active actors on pipe
2025-10-10T14:39:27.446436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602722038502690:2438], now have 1 active actors on pipe
2025-10-10T14:39:27.446444Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602721256262073:6879]
2025-10-10T14:39:27.446446Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602721256262073:6879]
2025-10-10T14:39:27.446450Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602721256262073:6879]
2025-10-10T14:39:27.446463Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:27.446481Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:27.446497Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:27.446500Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:27.446515Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:27.446529Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602721256262073:6879]
2025-10-10T14:39:27.446531Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:27.446534Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:27.446536Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:27.446525Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2996
2025-10-10T14:39:27.446545Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:27.446552Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2996
2025-10-10T14:39:27.446792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:27.446804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:27.446836Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4051f46-62265820-9968772-6f17562a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:27.446848Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:27.446853Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:27.446855Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:27.446867Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:27.446880Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:27.446898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:27.447109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:27.447117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:27.447132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:27.447223Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2997 partition: 0 MaxSeqNo: 40 sessionId: src_id|4051f46-62265820-9968772-6f17562a_0
2025-10-10T14:39:27.447700Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7df2abe2-d99591ab-6874d0aa-12fadc35_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|4051f46-62265820-9968772-6f17562a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:27.450731Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4051f46-62265820-9968772-6f17562a_0] Write session: try to update token
2025-10-10T14:39:27.450756Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4051f46-62265820-9968772-6f17562a_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:27.465778Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:39:27.465803Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:27.465818Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602721256262073:6879]
2025-10-10T14:39:27.465877Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:39:27.465880Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:39:27.466061Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:39:27.466206Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:27.466342Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:27.466481Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:27.466677Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:39:27.466720Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:39:27.468789Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2997 sessionId: src_id|4051f46-62265820-9968772-6f17562a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:27.471751Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:27.471988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:27.472012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:27.472052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:39:27.472158Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:39:27.482527Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:27.482550Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:27.482554Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:27.482556Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:27.482571Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602721256262073:6879]
2025-10-10T14:39:27.482575Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602721256262073:6879]
2025-10-10T14:39:27.482578Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602721256262073:6879]
2025-10-10T14:39:27.482627Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:27.482627Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:27.482635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:27.482638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:27.482653Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:27.482667Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:27.482765Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:27.515831Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602722038502781:4699]
2025-10-10T14:39:27.516142Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 pipe creation result: OK TabletId: 72075186224037892 Generation: 2996, pipe: [1:7559602722038502781:4699]
2025-10-10T14:39:27.606662Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:27.615371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:27.615404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:27.615593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:27.615661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:27.615725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:27.615786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:27.615834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:27.615844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:27.615910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:27.615974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:27.616038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:27.616109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:27.616155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:27.616164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:27.616233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:27.616293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:27.616358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:27.616422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:27.616466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:27.616473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:27.616535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:27.616598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:27.616661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:27.616724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:27.616769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:27.616777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:27.616841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:27.616902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:27.616995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:27.617073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:27.617117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:27.617124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:27.617187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:27.617246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:27.617308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:27.617386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:27.617433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:27.617444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:27.617511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:27.617575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:27.617643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:27.617710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:27.617753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:27.617760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:27.617823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:27.617883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:27.617945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:27.618008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:27.618050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:27.618057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:27.618119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:27.618179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:27.618244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:27.618307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:27.618350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:27.618359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:27.618421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:27.618480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:27.618542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:27.618606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:27.618648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:27.618655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:27.618724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602722038502781:4699], now have 1 active actors on pipe
2025-10-10T14:39:27.618965Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 95 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602722038502781:4699]
2025-10-10T14:39:27.618992Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:27.618996Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:27.619001Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:27.619030Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2997 reason: error at write: Disconnected sessionId: src_id|4051f46-62265820-9968772-6f17562a_0
2025-10-10T14:39:27.619229Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2997 sessionId: src_id|4051f46-62265820-9968772-6f17562a_0 is DEAD
2025-10-10T14:39:27.619356Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4051f46-62265820-9968772-6f17562a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:27.619369Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4051f46-62265820-9968772-6f17562a_0] Write session will restart in 0.009709s
2025-10-10T14:39:27.619395Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4051f46-62265820-9968772-6f17562a_0] Write session: Do CDS request
2025-10-10T14:39:27.619401Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4051f46-62265820-9968772-6f17562a_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:27.619910Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:27.629935Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4051f46-62265820-9968772-6f17562a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:27.630066Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:27.630094Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2998
2025-10-10T14:39:27.630231Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2998 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:27.630270Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2998 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:27.630281Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2998 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:27.630285Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:27.630825Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2998 sessionId:  describe result for acl check
2025-10-10T14:39:27.630871Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:27.630878Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:27.630880Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:27.630887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602722038502833:2703] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:27.632006Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602722038502833:2703] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:27.634558Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602722038502833:2703] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:27.638096Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602722038502833:2703] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:27.638113Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602722038502833:2703] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:27.638116Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602722038502833:2703] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:27.638126Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2998 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:27.638188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:27.638725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:27.639115Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:27.639127Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:27.639139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:27.639191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:27.639225Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602721256262180:6890]
2025-10-10T14:39:27.639690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:27.640027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:27.640090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:27.640463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:27.640522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:27.640529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:27.640530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:27.640532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:27.640533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:27.640535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:27.640537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:27.640539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:27.640541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:27.640542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:27.640546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:27.640547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:27.640549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:27.640555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:27.640568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:27.640573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:27.640577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:27.640582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:27.640587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:27.640592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:27.640596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:27.640600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:27.640605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:27.640610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:27.640614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:27.640619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:27.640626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:27.640641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:27.640652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:27.640659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:27.640668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:27.640674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:27.640684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:27.640690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:27.640698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:27.640705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:27.640709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:27.640718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:27.640723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:27.640728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:27.640733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:27.640745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:27.640750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:27.640755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:27.640760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:27.640765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:27.640770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:27.640774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:27.640778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:27.640783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:27.640793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:27.640798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:27.640844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:27.643399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:27.643853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:27.643865Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:27.643867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:27.643871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:27.643877Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2997 [2:7559602721256262180:6890]
2025-10-10T14:39:27.643889Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:27.643908Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:27.643915Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:27.643932Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:27.643941Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:27.643961Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:27.643969Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:27.643977Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:27.644039Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:27.644047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:27.644048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:27.644051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:27.644111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:27.644120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:27.644133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:27.644146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:27.644164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:27.644187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602722038502864:2703], now have 1 active actors on pipe
2025-10-10T14:39:27.644195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602722038502784:2438], now have 1 active actors on pipe
2025-10-10T14:39:27.644203Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602721256262174:6890]
2025-10-10T14:39:27.644205Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602721256262174:6890]
2025-10-10T14:39:27.644207Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602721256262174:6890]
2025-10-10T14:39:27.644219Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:27.644234Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:27.644234Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:27.644237Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:27.644239Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:27.644256Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:27.644259Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:27.644292Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602721256262174:6890]
2025-10-10T14:39:27.644301Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:27.644318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:27.644254Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2997
2025-10-10T14:39:27.644319Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:27.644327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:27.644294Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2997
2025-10-10T14:39:27.644377Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e432f337-8a7dc32c-27aad966-37a60908_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:27.644390Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:27.644394Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:27.644396Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:27.644407Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:27.644428Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:27.644447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:27.644637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:27.644649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:27.644673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:27.644774Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2998 partition: 0 MaxSeqNo: 40 sessionId: src_id|e432f337-8a7dc32c-27aad966-37a60908_0
2025-10-10T14:39:27.645223Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4051f46-62265820-9968772-6f17562a_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|e432f337-8a7dc32c-27aad966-37a60908_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:27.648076Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e432f337-8a7dc32c-27aad966-37a60908_0] Write session: try to update token
2025-10-10T14:39:27.648095Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e432f337-8a7dc32c-27aad966-37a60908_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:27.662753Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2998 sessionId: src_id|e432f337-8a7dc32c-27aad966-37a60908_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:27.665468Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:27.666431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:27.666458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:27.666482Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:27.666485Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:27.666488Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:27.666491Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:27.666500Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602721256262174:6890]
2025-10-10T14:39:27.666504Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602721256262174:6890]
2025-10-10T14:39:27.666508Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602721256262174:6890]
2025-10-10T14:39:27.666564Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:27.666569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:27.666575Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:27.666577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:27.666580Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:27.666579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:27.666732Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:27.719129Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602722038502901:4699]
2025-10-10T14:39:27.719402Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 pipe creation result: OK TabletId: 72075186224037892 Generation: 2997, pipe: [1:7559602722038502901:4699]
2025-10-10T14:39:27.790757Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:27.791349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:39:27.791418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602722038502901:4699], now have 1 active actors on pipe
2025-10-10T14:39:27.791501Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:39:27.791604Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:27.791607Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:27.791712Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2998 reason: error at write: Disconnected sessionId: src_id|e432f337-8a7dc32c-27aad966-37a60908_0
2025-10-10T14:39:27.791719Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:27.791763Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 96 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602722038502901:4699]
2025-10-10T14:39:27.791934Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2998 sessionId: src_id|e432f337-8a7dc32c-27aad966-37a60908_0 is DEAD
2025-10-10T14:39:27.793423Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e432f337-8a7dc32c-27aad966-37a60908_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:27.793436Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e432f337-8a7dc32c-27aad966-37a60908_0] Write session will restart in 0.009892s
2025-10-10T14:39:27.793465Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e432f337-8a7dc32c-27aad966-37a60908_0] Write session: Do CDS request
2025-10-10T14:39:27.793471Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e432f337-8a7dc32c-27aad966-37a60908_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:27.805913Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e432f337-8a7dc32c-27aad966-37a60908_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:27.805809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:27.806036Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:27.806058Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2999
2025-10-10T14:39:27.806225Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2999 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:27.806264Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2999 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:27.806275Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2999 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:27.806280Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:27.806739Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2999 sessionId:  describe result for acl check
2025-10-10T14:39:27.806772Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:27.806779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:27.806781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:27.806788Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602722038502968:2662] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:27.807393Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602722038502968:2662] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:27.811707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:27.811905Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602722038502968:2662] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:27.812279Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:27.812291Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:27.812308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:27.812394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:27.812440Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602721256262307:6871]
2025-10-10T14:39:27.813123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:27.813487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:27.813537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:27.813861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:27.813919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:27.813925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:27.813926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:27.813927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:27.813929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:27.813930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:27.813931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:27.813932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:27.813934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:27.813935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:27.813936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:27.813937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:27.813939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:27.813944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:27.813959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:27.813964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:27.813968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:27.813972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:27.813976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:27.813980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:27.813984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:27.813988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:27.813993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:27.813997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:27.814001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:27.814005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:27.814015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:27.814028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:27.814039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:27.814045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:27.814048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:27.814054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:27.814058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:27.814064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:27.814070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:27.814080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:27.814084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:27.814090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:27.814094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:27.814100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:27.814104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:27.814109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:27.814113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:27.814118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:27.814122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:27.814127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:27.814131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:27.814136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:27.814140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:27.814144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:27.814149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:27.814153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:27.814198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:27.815188Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602722038502968:2662] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:27.815202Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602722038502968:2662] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:27.815206Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602722038502968:2662] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:27.815214Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2999 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:27.816893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:27.817279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:27.817300Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:27.817303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:27.817308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:27.817317Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2998 [2:7559602721256262307:6871]
2025-10-10T14:39:27.817351Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:27.817376Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:27.817379Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:27.817384Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:27.817386Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:27.817405Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:27.817428Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:27.817442Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:27.817508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:27.817519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:27.817521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:27.817523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:27.817595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:27.817615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:27.817627Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:27.817642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:27.817657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:27.817681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602722038503001:2662], now have 1 active actors on pipe
2025-10-10T14:39:27.817691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602722038502914:2438], now have 1 active actors on pipe
2025-10-10T14:39:27.817700Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602721256262302:6871]
2025-10-10T14:39:27.817703Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602721256262302:6871]
2025-10-10T14:39:27.817705Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602721256262302:6871]
2025-10-10T14:39:27.817721Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:27.817715Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2998
2025-10-10T14:39:27.817725Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2998
2025-10-10T14:39:27.817737Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:27.817739Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:27.817747Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:27.817750Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:27.817756Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:27.817760Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:27.817786Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602721256262302:6871]
2025-10-10T14:39:27.817795Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:27.817827Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:27.817967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:27.817983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:27.818016Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|56ef872d-a03f0300-1a33e08e-15eaf8e6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:27.818025Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:27.818030Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:27.818033Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:27.818046Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:27.818058Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:27.818080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:27.818242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:27.818250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:27.818264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:27.818383Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2999 partition: 0 MaxSeqNo: 40 sessionId: src_id|56ef872d-a03f0300-1a33e08e-15eaf8e6_0
2025-10-10T14:39:27.818850Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e432f337-8a7dc32c-27aad966-37a60908_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|56ef872d-a03f0300-1a33e08e-15eaf8e6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:27.821688Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|56ef872d-a03f0300-1a33e08e-15eaf8e6_0] Write session: try to update token
2025-10-10T14:39:27.821707Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|56ef872d-a03f0300-1a33e08e-15eaf8e6_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:27.836314Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2999 sessionId: src_id|56ef872d-a03f0300-1a33e08e-15eaf8e6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:27.839327Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:27.839349Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:27.839353Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:27.839355Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:27.839367Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602721256262302:6871]
2025-10-10T14:39:27.839371Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602721256262302:6871]
2025-10-10T14:39:27.839375Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602721256262302:6871]
2025-10-10T14:39:27.839430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:27.839436Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:27.839438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:27.839441Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:27.839444Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:27.839445Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:27.839604Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:27.839663Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:27.892144Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602722038503017:4699]
2025-10-10T14:39:27.892414Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 pipe creation result: OK TabletId: 72075186224037892 Generation: 2998, pipe: [1:7559602722038503017:4699]
2025-10-10T14:39:27.960230Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:27.960738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:27.960755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:27.960803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602722038503017:4699], now have 1 active actors on pipe
2025-10-10T14:39:27.961062Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:27.961079Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:27.961143Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2999 reason: error at write: Disconnected sessionId: src_id|56ef872d-a03f0300-1a33e08e-15eaf8e6_0
2025-10-10T14:39:27.961082Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:27.961403Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:27.961433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2999 sessionId: src_id|56ef872d-a03f0300-1a33e08e-15eaf8e6_0 is DEAD
2025-10-10T14:39:27.961467Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 97 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602722038503017:4699]
2025-10-10T14:39:27.961574Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56ef872d-a03f0300-1a33e08e-15eaf8e6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:27.961586Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56ef872d-a03f0300-1a33e08e-15eaf8e6_0] Write session will restart in 0.009213s
2025-10-10T14:39:27.961613Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56ef872d-a03f0300-1a33e08e-15eaf8e6_0] Write session: Do CDS request
2025-10-10T14:39:27.961632Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56ef872d-a03f0300-1a33e08e-15eaf8e6_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:27.971939Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|56ef872d-a03f0300-1a33e08e-15eaf8e6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:27.972011Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:27.972032Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3000
2025-10-10T14:39:27.972189Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3000 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:27.972243Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3000 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:27.972255Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3000 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:27.972259Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:27.972787Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3000 sessionId:  describe result for acl check
2025-10-10T14:39:27.972833Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:27.972843Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:27.972846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:27.972853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602722038503071:2646] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:27.973486Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602722038503071:2646] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:27.976080Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602722038503071:2646] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:27.980864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:27.981081Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602722038503071:2646] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:27.981099Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602722038503071:2646] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:27.981104Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602722038503071:2646] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:27.981113Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3000 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:27.981518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:27.981717Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:27.981729Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:27.981741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:27.981789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:27.981836Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602721256262399:6865]
2025-10-10T14:39:27.982479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:27.982916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:27.982980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:27.983388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:27.983452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:27.983460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:27.983461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:27.983463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:27.983464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:27.983465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:27.983467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:27.983468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:27.983470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:27.983472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:27.983473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:27.983474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:27.983476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:27.983483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:27.983499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:27.983504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:27.983509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:27.983514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:27.983519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:27.983524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:27.983528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:27.983533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:27.983538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:27.983543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:27.983547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:27.983552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:27.983561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:27.983570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:27.983577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:27.983584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:27.983596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:27.983602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:27.983611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:27.983617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:27.983627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:27.983633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:27.983643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:27.983651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:27.983657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:27.983663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:27.983672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:27.983678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:27.983686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:27.983706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:27.983715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:27.983721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:27.983726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:27.983733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:27.983739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:27.983745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:27.983755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:27.983760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:27.983805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:27.986384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:27.986728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:27.986751Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:27.986753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:27.986758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:27.986766Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2999 [2:7559602721256262399:6865]
2025-10-10T14:39:27.986780Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:27.986802Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:27.986810Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:27.986814Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:27.986816Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:27.986836Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:27.986848Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:27.986860Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:27.986927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:27.986935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:27.986937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:27.986940Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:27.987016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:27.987025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:27.987038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:27.987050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:27.987069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:27.987146Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2999
2025-10-10T14:39:27.987213Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2999
2025-10-10T14:39:27.987665Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3000 partition: 0 MaxSeqNo: 40 sessionId: src_id|52acc4b2-ed17537d-5cde25d9-211933c3_0
2025-10-10T14:39:27.988147Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56ef872d-a03f0300-1a33e08e-15eaf8e6_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|52acc4b2-ed17537d-5cde25d9-211933c3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:27.987094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602722038503021:2438], now have 1 active actors on pipe
2025-10-10T14:39:27.987102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602722038503101:2646], now have 1 active actors on pipe
2025-10-10T14:39:27.987110Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602721256262393:6865]
2025-10-10T14:39:27.987112Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602721256262393:6865]
2025-10-10T14:39:27.987114Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602721256262393:6865]
2025-10-10T14:39:27.987131Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:27.987143Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:27.987145Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:27.987147Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:27.987149Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:27.987162Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:27.987165Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:27.987199Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602721256262393:6865]
2025-10-10T14:39:27.987207Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:27.987213Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:27.987334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:27.987339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:27.987369Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|52acc4b2-ed17537d-5cde25d9-211933c3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:27.987376Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:27.987380Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:27.987384Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:27.987399Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:27.987412Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:27.987426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:27.987558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:27.987561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:27.987577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:27.990984Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|52acc4b2-ed17537d-5cde25d9-211933c3_0] Write session: try to update token
2025-10-10T14:39:27.991001Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|52acc4b2-ed17537d-5cde25d9-211933c3_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:28.010783Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3000 sessionId: src_id|52acc4b2-ed17537d-5cde25d9-211933c3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:28.011443Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:28.011461Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:28.011464Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:28.011467Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:28.011477Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602721256262393:6865]
2025-10-10T14:39:28.011482Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602721256262393:6865]
2025-10-10T14:39:28.011486Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602721256262393:6865]
2025-10-10T14:39:28.011540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:28.011542Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:28.011549Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:28.011553Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:28.011560Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:28.011563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:28.011707Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:28.014065Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:28.061660Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602726333470409:4699]
2025-10-10T14:39:28.062026Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 pipe creation result: OK TabletId: 72075186224037892 Generation: 2999, pipe: [1:7559602726333470409:4699]
2025-10-10T14:39:28.133726Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:28.134382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:28.134401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:28.134451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602726333470409:4699], now have 1 active actors on pipe
2025-10-10T14:39:28.134688Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:28.134809Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:28.134877Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 98 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602726333470409:4699]
2025-10-10T14:39:28.134907Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:28.134910Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:28.134988Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3000 reason: error at write: Disconnected sessionId: src_id|52acc4b2-ed17537d-5cde25d9-211933c3_0
2025-10-10T14:39:28.135220Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3000 sessionId: src_id|52acc4b2-ed17537d-5cde25d9-211933c3_0 is DEAD
2025-10-10T14:39:28.135489Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|52acc4b2-ed17537d-5cde25d9-211933c3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:28.135500Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|52acc4b2-ed17537d-5cde25d9-211933c3_0] Write session will restart in 0.009577s
2025-10-10T14:39:28.135536Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|52acc4b2-ed17537d-5cde25d9-211933c3_0] Write session: Do CDS request
2025-10-10T14:39:28.135542Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|52acc4b2-ed17537d-5cde25d9-211933c3_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:28.146005Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|52acc4b2-ed17537d-5cde25d9-211933c3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:28.146094Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:28.146113Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3001
2025-10-10T14:39:28.146273Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3001 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:28.146324Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3001 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:28.146335Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3001 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:28.146340Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:28.146841Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3001 sessionId:  describe result for acl check
2025-10-10T14:39:28.146882Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:28.146884Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:28.146886Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:28.146893Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602726333470464:2640] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:28.147530Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602726333470464:2640] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:28.148946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:28.150029Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602726333470464:2640] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:28.155042Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602726333470464:2640] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:28.155060Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602726333470464:2640] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:28.155064Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602726333470464:2640] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:28.155074Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3001 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:28.155126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:28.155391Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:28.155404Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:28.155417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:28.155483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:28.155534Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602725551229786:6851]
2025-10-10T14:39:28.156190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:28.156559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:28.156608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:28.156968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:28.157040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:28.157047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:28.157048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:28.157050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:28.157051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:28.157053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:28.157054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:28.157056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:28.157057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:28.157059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:28.157060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:28.157062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:28.157063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:28.157069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:28.157084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:28.157089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:28.157094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:28.157098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:28.157103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:28.157106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:28.157110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:28.157114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:28.157118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:28.157122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:28.157127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:28.157131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:28.157139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:28.157148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:28.157158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:28.157164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:28.157169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:28.157179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:28.157184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:28.157194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:28.157201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:28.157207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:28.157212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:28.157218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:28.157224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:28.157234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:28.157238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:28.157244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:28.157254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:28.157261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:28.157270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:28.157275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:28.157281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:28.157287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:28.157296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:28.157302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:28.157311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:28.157317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:28.157387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:28.159949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:28.160868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:28.160874Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:28.160876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:28.160880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:28.160888Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3000 [2:7559602725551229786:6851]
2025-10-10T14:39:28.160904Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:28.160929Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:28.160933Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:28.160936Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:28.160938Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:28.160955Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:28.160963Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:28.160972Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:28.161063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:28.161065Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:28.161067Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:28.161070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:28.161170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:28.161172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:28.161184Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:28.161195Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:28.161210Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:28.161233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602726333470411:2438], now have 1 active actors on pipe
2025-10-10T14:39:28.161236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602726333470495:2640], now have 1 active actors on pipe
2025-10-10T14:39:28.161245Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602725551229781:6851]
2025-10-10T14:39:28.161247Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602725551229781:6851]
2025-10-10T14:39:28.161249Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602725551229781:6851]
2025-10-10T14:39:28.161267Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:28.161281Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:28.161296Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:28.161300Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:28.161326Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602725551229781:6851]
2025-10-10T14:39:28.161351Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:28.161388Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:28.161401Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:28.161403Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:28.161412Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:28.161535Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3000
2025-10-10T14:39:28.161576Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3000
2025-10-10T14:39:28.161636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:28.161653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:28.161691Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|570d10e4-c5c48d5a-a06d9b4c-dbe44a15_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:28.161700Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:28.161706Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:28.161709Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:28.161723Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:28.161738Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:28.161755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:28.161990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:28.162000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:28.162033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:28.162161Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3001 partition: 0 MaxSeqNo: 40 sessionId: src_id|570d10e4-c5c48d5a-a06d9b4c-dbe44a15_0
2025-10-10T14:39:28.162580Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|52acc4b2-ed17537d-5cde25d9-211933c3_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|570d10e4-c5c48d5a-a06d9b4c-dbe44a15_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:28.165371Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|570d10e4-c5c48d5a-a06d9b4c-dbe44a15_0] Write session: try to update token
2025-10-10T14:39:28.165393Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|570d10e4-c5c48d5a-a06d9b4c-dbe44a15_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:28.183275Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:28.183295Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:28.183299Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:28.183301Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:28.183311Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602725551229781:6851]
2025-10-10T14:39:28.183317Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602725551229781:6851]
2025-10-10T14:39:28.183322Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602725551229781:6851]
2025-10-10T14:39:28.183371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:28.183378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:28.183381Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:28.183390Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:28.183397Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:28.183401Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:28.183506Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3001 sessionId: src_id|570d10e4-c5c48d5a-a06d9b4c-dbe44a15_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:28.183519Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:28.186231Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:28.235242Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602726333470507:4699]
2025-10-10T14:39:28.235558Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 pipe creation result: OK TabletId: 72075186224037892 Generation: 3000, pipe: [1:7559602726333470507:4699]
2025-10-10T14:39:28.301693Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:28.302145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:28.302161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:28.302208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602726333470507:4699], now have 1 active actors on pipe
2025-10-10T14:39:28.302456Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:28.302506Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 99 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602726333470507:4699]
2025-10-10T14:39:28.302527Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:28.302528Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1661: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 closed with error: reason# too much attempts to restart pipe
2025-10-10T14:39:28.302531Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:28.302604Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3001 reason: error at write: Disconnected sessionId: src_id|570d10e4-c5c48d5a-a06d9b4c-dbe44a15_0
2025-10-10T14:39:28.302684Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3001 sessionId: src_id|570d10e4-c5c48d5a-a06d9b4c-dbe44a15_0 is DEAD
2025-10-10T14:39:28.302457Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:28.302770Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 30 consumer shared/user session shared/user_1_30_7993540039997143720_v1 is DEAD
2025-10-10T14:39:28.302914Z :ERROR: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] Got error. Status: UNAVAILABLE. Description: <main>: Error: too much attempts to restart pipe, code: 500027 
2025-10-10T14:39:28.302912Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559602649024037567:4734] disconnected; active server actors: 1
2025-10-10T14:39:28.302925Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559602649024037567:4734] client user disconnected session shared/user_1_30_7993540039997143720_v1
2025-10-10T14:39:28.302998Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|570d10e4-c5c48d5a-a06d9b4c-dbe44a15_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:28.303007Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|570d10e4-c5c48d5a-a06d9b4c-dbe44a15_0] Write session will restart in 0.007731s
2025-10-10T14:39:28.303034Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|570d10e4-c5c48d5a-a06d9b4c-dbe44a15_0] Write session: Do CDS request
2025-10-10T14:39:28.303041Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|570d10e4-c5c48d5a-a06d9b4c-dbe44a15_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:28.303108Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-10T14:39:28.303117Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-10T14:39:28.303126Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] Reconnecting session to cluster  in 0.007424s
2025-10-10T14:39:28.311809Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] Successfully connected. Initializing session
2025-10-10T14:39:28.311908Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|570d10e4-c5c48d5a-a06d9b4c-dbe44a15_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:28.312074Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:28.312090Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3002
2025-10-10T14:39:28.312120Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-10T14:39:28.312122Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 31
2025-10-10T14:39:28.312232Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3002 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:28.312270Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3002 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:28.312281Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3002 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:28.312285Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:28.312320Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 31 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-10T14:39:28.312374Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 read init: from# ipv6:[::1]:37328, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-10T14:39:28.312503Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 auth for : user
2025-10-10T14:39:28.312945Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3002 sessionId:  describe result for acl check
2025-10-10T14:39:28.313005Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:28.313013Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:28.313015Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:28.313021Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602726333470558:2621] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:28.313664Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602726333470558:2621] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:28.313771Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 Handle describe topics response
2025-10-10T14:39:28.313803Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 auth is DEAD
2025-10-10T14:39:28.313824Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 auth ok: topics# 1, initDone# 0
2025-10-10T14:39:28.314134Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 register session: topic# rt3.dc1--test-topic
2025-10-10T14:39:28.314358Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559602726333470566:2589] connected; active server actors: 1
2025-10-10T14:39:28.314376Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7559602726333470566:2589] session shared/user_1_31_11885534020854623286_v1
2025-10-10T14:39:28.314388Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-10-10T14:39:28.314403Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-10-10T14:39:28.314415Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_31_11885534020854623286_v1" (Sender=[1:7559602726333470535:2589], Pipe=[1:7559602726333470566:2589], Partitions=[], ActiveFamilyCount=0)
2025-10-10T14:39:28.314419Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-10T14:39:28.314435Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-10-10T14:39:28.314445Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_31_11885534020854623286_v1" (Sender=[1:7559602726333470535:2589], Pipe=[1:7559602726333470566:2589], Partitions=[], ActiveFamilyCount=0)
2025-10-10T14:39:28.314456Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_31_11885534020854623286_v1" sender [1:7559602726333470535:2589] lock partition 0 for ReadingSession "shared/user_1_31_11885534020854623286_v1" (Sender=[1:7559602726333470535:2589], Pipe=[1:7559602726333470566:2589], Partitions=[], ActiveFamilyCount=1) generation 1 step 31
2025-10-10T14:39:28.314464Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-10-10T14:39:28.314469Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000031s
2025-10-10T14:39:28.314675Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 31 Session: "shared/user_1_31_11885534020854623286_v1" ClientId: "user" PipeClient { RawX1: 7559602726333470566 RawX2: 4503603922340381 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-10T14:39:28.314693Z :INFO: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] Got InitResponse. ReadSessionId: shared/user_1_31_11885534020854623286_v1
2025-10-10T14:39:28.314705Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-10T14:39:28.316299Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602726333470558:2621] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:28.321293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:28.321443Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602726333470558:2621] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:28.321458Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602726333470558:2621] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:28.321462Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602726333470558:2621] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:28.321472Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3002 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:28.322255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:28.322499Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:28.322511Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:28.322524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:28.322584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:28.322629Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602725551229883:6858]
2025-10-10T14:39:28.323254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:28.323558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:28.323612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:28.323959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:28.324029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:28.324036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:28.324037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:28.324039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:28.324040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:28.324042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:28.324043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:28.324044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:28.324045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:28.324047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:28.324048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:28.324049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:28.324050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:28.324057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:28.324071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:28.324075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:28.324079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:28.324083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:28.324088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:28.324092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:28.324096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:28.324100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:28.324104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:28.324108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:28.324112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:28.324117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:28.324125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:28.324134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:28.324142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:28.324148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:28.324152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:28.324157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:28.324162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:28.324167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:28.324171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:28.324176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:28.324181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:28.324186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:28.324195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:28.324211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:28.324220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:28.324225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:28.324230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:28.324236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:28.324239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:28.324243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:28.324253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:28.324258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:28.324262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:28.324267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:28.324276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:28.324281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:28.324322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:28.327001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:28.327960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:28.327974Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:28.327976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:28.327980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:28.327988Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3001 [2:7559602725551229883:6858]
2025-10-10T14:39:28.328002Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:28.328023Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:28.328031Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:28.328034Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:28.328036Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:28.328055Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:28.328066Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:28.328074Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:28.328141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:28.328152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:28.328154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:28.328156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:28.328228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:28.328236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:28.328248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:28.328261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:28.328282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:28.328309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602726333470599:2621], now have 1 active actors on pipe
2025-10-10T14:39:28.328317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602726333470574:2572], now have 1 active actors on pipe
2025-10-10T14:39:28.328320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602726333470508:2438], now have 1 active actors on pipe
2025-10-10T14:39:28.328328Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602725551229877:6858]
2025-10-10T14:39:28.328332Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602725551229877:6858]
2025-10-10T14:39:28.328334Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602725551229877:6858]
2025-10-10T14:39:28.328348Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:28.328363Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:28.328350Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3001
2025-10-10T14:39:28.328363Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:28.328367Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:28.328365Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 3001, pipe: [1:7559602726333470574:2572]
2025-10-10T14:39:28.328369Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:28.328385Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:28.328401Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3001
2025-10-10T14:39:28.328389Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:28.328440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:28.328449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:28.328465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_31_11885534020854623286_v1 on pipe: [1:7559602726333470574:2572]
2025-10-10T14:39:28.328486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:28.328492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:28.328499Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602725551229877:6858]
2025-10-10T14:39:28.328501Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_31_11885534020854623286_v1:1 with generation 3001
2025-10-10T14:39:28.328507Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:28.328522Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:28.328534Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:28.328540Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:28.328542Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:28.328558Z node 2 :PERSQUEUE DEBUG: partition.cpp:3747: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_31_11885534020854623286_v1
2025-10-10T14:39:28.328560Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:28.328595Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ad5e1c2d-9a9f2e65-e25e1b7b-28bc6c84_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:28.328606Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:39:28.328617Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:39:28.332680Z node 2 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:39:28.332713Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:39:28.332724Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:28.332731Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:28.332734Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:28.332750Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:28.332765Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:28.332778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-10T14:39:28.332798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-10T14:39:28.332819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:28.332958Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 40 WriteTimestampMS: 1760106661000 SizeLag: 17206678 WriteTimestampEstimateMS: 1760107168327 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-10T14:39:28.332987Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 40 readOffset 0 committedOffset 0
2025-10-10T14:39:28.333036Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 sending to client partition status
2025-10-10T14:39:28.333056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:28.333069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:28.333090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:28.333244Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3002 partition: 0 MaxSeqNo: 40 sessionId: src_id|ad5e1c2d-9a9f2e65-e25e1b7b-28bc6c84_0
2025-10-10T14:39:28.333611Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|570d10e4-c5c48d5a-a06d9b4c-dbe44a15_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|ad5e1c2d-9a9f2e65-e25e1b7b-28bc6c84_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:28.336455Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ad5e1c2d-9a9f2e65-e25e1b7b-28bc6c84_0] Write session: try to update token
2025-10-10T14:39:28.336476Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ad5e1c2d-9a9f2e65-e25e1b7b-28bc6c84_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:28.349982Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:28.350012Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:28.350018Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:28.350021Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:28.350036Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602725551229877:6858]
2025-10-10T14:39:28.350041Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602725551229877:6858]
2025-10-10T14:39:28.350046Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602725551229877:6858]
2025-10-10T14:39:28.350118Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:28.350118Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:28.350127Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:28.350132Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:28.350134Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:28.350138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:28.351165Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:28.352456Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3002 sessionId: src_id|ad5e1c2d-9a9f2e65-e25e1b7b-28bc6c84_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:28.355330Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:28.466430Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:28.467176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:28.467194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:28.467494Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:28.467510Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 0 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602726333470574:2572]
2025-10-10T14:39:28.467513Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:28.467530Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:28.467581Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3002 reason: error at write: Disconnected sessionId: src_id|ad5e1c2d-9a9f2e65-e25e1b7b-28bc6c84_0
2025-10-10T14:39:28.467437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_31_11885534020854623286_v1
2025-10-10T14:39:28.467459Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:28.467493Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_31_11885534020854623286_v1
2025-10-10T14:39:28.467836Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3002 sessionId: src_id|ad5e1c2d-9a9f2e65-e25e1b7b-28bc6c84_0 is DEAD
2025-10-10T14:39:28.467992Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad5e1c2d-9a9f2e65-e25e1b7b-28bc6c84_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:28.468004Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad5e1c2d-9a9f2e65-e25e1b7b-28bc6c84_0] Write session will restart in 0.009388s
2025-10-10T14:39:28.468034Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad5e1c2d-9a9f2e65-e25e1b7b-28bc6c84_0] Write session: Do CDS request
2025-10-10T14:39:28.468040Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad5e1c2d-9a9f2e65-e25e1b7b-28bc6c84_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:28.478984Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ad5e1c2d-9a9f2e65-e25e1b7b-28bc6c84_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:28.478997Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:28.479014Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3003
2025-10-10T14:39:28.479232Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3003 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:28.479270Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3003 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:28.479281Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3003 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:28.479286Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:28.479693Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3003 sessionId:  describe result for acl check
2025-10-10T14:39:28.479729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:28.479730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:28.479731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:28.479736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602726333470665:2573] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:28.480427Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602726333470665:2573] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:28.482149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:28.482878Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602726333470665:2573] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:28.487502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:28.487849Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602726333470665:2573] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:28.487866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602726333470665:2573] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:28.487870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602726333470665:2573] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:28.487879Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3003 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:28.488126Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:28.488139Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:28.488156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:28.488243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:28.488294Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602725551229979:6860]
2025-10-10T14:39:28.488906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:28.489309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:28.489379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:28.489731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:28.489812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:28.489820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:28.489821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:28.489822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:28.489824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:28.489826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:28.489827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:28.489831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:28.489832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:28.489833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:28.489834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:28.489835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:28.489837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:28.489844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:28.489859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:28.489863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:28.489867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:28.489871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:28.489875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:28.489879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:28.489883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:28.489886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:28.489891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:28.489894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:28.489898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:28.489901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:28.489909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:28.489918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:28.489925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:28.489930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:28.489936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:28.489942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:28.489961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:28.489967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:28.489973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:28.489983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:28.489988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:28.489993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:28.490001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:28.490011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:28.490016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:28.490025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:28.490030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:28.490035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:28.490044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:28.490049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:28.490055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:28.490064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:28.490069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:28.490074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:28.490083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:28.490088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:28.490129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:28.492698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:28.493043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:28.493057Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:28.493060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:28.493064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:28.493071Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3002 [2:7559602725551229979:6860]
2025-10-10T14:39:28.493086Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:28.493105Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:28.493108Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:28.493112Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:28.493114Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:28.493134Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:28.493147Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:28.493160Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:28.493228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:28.493238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:28.493240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:28.493243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:28.493320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:28.493327Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:28.493357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:28.493368Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:28.493384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:28.493416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602726333470698:2573], now have 1 active actors on pipe
2025-10-10T14:39:28.493424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602726333470612:2438], now have 1 active actors on pipe
2025-10-10T14:39:28.493432Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602725551229973:6860]
2025-10-10T14:39:28.493436Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602725551229973:6860]
2025-10-10T14:39:28.493439Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602725551229973:6860]
2025-10-10T14:39:28.493458Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:28.493475Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:28.493484Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:28.493488Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:28.493491Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:28.493494Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:28.493497Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:28.493491Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3002
2025-10-10T14:39:28.493503Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3002
2025-10-10T14:39:28.493523Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602725551229973:6860]
2025-10-10T14:39:28.493535Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:28.493542Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:28.494271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:28.494287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:28.494323Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2b1e4fb6-8deef286-ff146300-1a0b895e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:28.494337Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:28.494347Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:28.494351Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:28.494376Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:28.494395Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:28.494414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:28.494628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:28.494643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:28.494668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:28.494752Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3003 partition: 0 MaxSeqNo: 40 sessionId: src_id|2b1e4fb6-8deef286-ff146300-1a0b895e_0
2025-10-10T14:39:28.495191Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad5e1c2d-9a9f2e65-e25e1b7b-28bc6c84_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|2b1e4fb6-8deef286-ff146300-1a0b895e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:28.497867Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2b1e4fb6-8deef286-ff146300-1a0b895e_0] Write session: try to update token
2025-10-10T14:39:28.497887Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2b1e4fb6-8deef286-ff146300-1a0b895e_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:28.512801Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3003 sessionId: src_id|2b1e4fb6-8deef286-ff146300-1a0b895e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:28.515536Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:28.517277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:28.517303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:28.517347Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:28.517350Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:28.517354Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:28.517356Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:28.517369Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602725551229973:6860]
2025-10-10T14:39:28.517373Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602725551229973:6860]
2025-10-10T14:39:28.517376Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602725551229973:6860]
2025-10-10T14:39:28.517445Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:28.517462Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:28.517464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:28.517480Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:28.517487Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:28.517502Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:28.517628Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:28.567520Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602726333470710:2572]
2025-10-10T14:39:28.567895Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 pipe creation result: OK TabletId: 72075186224037892 Generation: 3002, pipe: [1:7559602726333470710:2572]
2025-10-10T14:39:28.636359Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:39:28.635687Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:28.636198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:39:28.636259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602726333470710:2572], now have 1 active actors on pipe
2025-10-10T14:39:28.637125Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 1 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602726333470710:2572]
2025-10-10T14:39:28.637154Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:28.649075Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:28.649091Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:28.649120Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3003 reason: error at write: Disconnected sessionId: src_id|2b1e4fb6-8deef286-ff146300-1a0b895e_0
2025-10-10T14:39:28.649301Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3003 sessionId: src_id|2b1e4fb6-8deef286-ff146300-1a0b895e_0 is DEAD
2025-10-10T14:39:28.649701Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b1e4fb6-8deef286-ff146300-1a0b895e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:28.649713Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b1e4fb6-8deef286-ff146300-1a0b895e_0] Write session will restart in 0.009137s
2025-10-10T14:39:28.649739Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b1e4fb6-8deef286-ff146300-1a0b895e_0] Write session: Do CDS request
2025-10-10T14:39:28.649747Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b1e4fb6-8deef286-ff146300-1a0b895e_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:28.659952Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2b1e4fb6-8deef286-ff146300-1a0b895e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:28.660028Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:28.660044Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3004
2025-10-10T14:39:28.660181Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3004 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:28.660215Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3004 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:28.660221Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3004 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:28.660225Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:28.661216Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3004 sessionId:  describe result for acl check
2025-10-10T14:39:28.661258Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:28.661260Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:28.661262Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:28.661269Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602726333470769:2554] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:28.661891Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602726333470769:2554] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:28.665312Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602726333470769:2554] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:28.666634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:28.666997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:28.667465Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:28.667480Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:28.667493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:28.667554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:28.667593Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602725551230085:6852]
2025-10-10T14:39:28.668250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:28.668561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:28.668615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:28.668965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:28.669081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:28.669087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:28.669088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:28.669089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:28.669090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:28.669092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:28.669092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:28.669093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:28.669094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:28.669095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:28.669097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:28.669098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:28.669098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:28.669105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:28.669119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:28.669122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:28.669126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:28.669130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:28.669133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:28.669136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:28.669139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:28.669143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:28.669162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:28.669165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:28.669169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:28.669172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:28.669181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:28.669189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:28.669195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:28.669201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:28.669217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:28.669223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:28.669227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:28.669231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:28.669236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:28.669240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:28.669243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:28.669248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:28.669252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:28.669257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:28.669260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:28.669266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:28.669271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:28.669276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:28.669280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:28.669285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:28.669289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:28.669293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:28.669299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:28.669304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:28.669310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:28.669316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:28.669375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:28.670138Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602726333470769:2554] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:28.670157Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602726333470769:2554] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:28.670162Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602726333470769:2554] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:28.670171Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3004 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:28.671964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:28.672612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:28.672625Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:28.672628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:28.672632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:28.672639Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3003 [2:7559602725551230085:6852]
2025-10-10T14:39:28.672658Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:28.672678Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:28.672686Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:28.672693Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:28.672695Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:28.672714Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:28.672727Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:28.672736Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:28.672806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:28.672813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:28.672815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:28.672817Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:28.672887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:28.672896Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:28.672907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:28.672918Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:28.672934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:28.672959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602726333470802:2554], now have 1 active actors on pipe
2025-10-10T14:39:28.672962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602726333470711:2438], now have 1 active actors on pipe
2025-10-10T14:39:28.672969Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602725551230080:6852]
2025-10-10T14:39:28.672972Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602725551230080:6852]
2025-10-10T14:39:28.672974Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602725551230080:6852]
2025-10-10T14:39:28.673000Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:28.673017Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:28.673040Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:28.673048Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:28.673079Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602725551230080:6852]
2025-10-10T14:39:28.673082Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:28.673149Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:28.673153Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:28.673156Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:28.673164Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:28.673593Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3003
2025-10-10T14:39:28.673623Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3003
2025-10-10T14:39:28.673768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:28.673780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:28.673813Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|90b5181d-d073644b-dab152c1-53ddf199_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:28.673830Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:28.673834Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:28.673837Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:28.673850Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:28.673864Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:28.673882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:28.674101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:28.674112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:28.674137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:28.674208Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3004 partition: 0 MaxSeqNo: 40 sessionId: src_id|90b5181d-d073644b-dab152c1-53ddf199_0
2025-10-10T14:39:28.674653Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b1e4fb6-8deef286-ff146300-1a0b895e_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|90b5181d-d073644b-dab152c1-53ddf199_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:28.677408Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|90b5181d-d073644b-dab152c1-53ddf199_0] Write session: try to update token
2025-10-10T14:39:28.677428Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|90b5181d-d073644b-dab152c1-53ddf199_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:28.693247Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:39:28.693267Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:28.693279Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602725551230080:6852]
2025-10-10T14:39:28.693371Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:39:28.693439Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:39:28.693623Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:39:28.693763Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:28.693903Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:28.694041Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:28.694220Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:39:28.694258Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:39:28.705626Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3004 sessionId: src_id|90b5181d-d073644b-dab152c1-53ddf199_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:28.706645Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:28.706668Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:28.706671Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:28.706673Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:28.706684Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602725551230080:6852]
2025-10-10T14:39:28.706689Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602725551230080:6852]
2025-10-10T14:39:28.706695Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602725551230080:6852]
2025-10-10T14:39:28.706741Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:28.706744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:28.706748Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:28.706754Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:28.706757Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:28.706761Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:28.706897Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:28.708235Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:28.737014Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602726333470824:2572]
2025-10-10T14:39:28.737399Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 pipe creation result: OK TabletId: 72075186224037892 Generation: 3003, pipe: [1:7559602726333470824:2572]
2025-10-10T14:39:28.823470Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:28.824546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:28.824565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:28.824603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602726333470824:2572], now have 1 active actors on pipe
2025-10-10T14:39:28.824889Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:28.825212Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 2 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602726333470824:2572]
2025-10-10T14:39:28.825261Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:39:28.825364Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3004 reason: status is not ok: tablet will be restarted right now sessionId: src_id|90b5181d-d073644b-dab152c1-53ddf199_0
2025-10-10T14:39:28.825413Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:28.825595Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3004 sessionId: src_id|90b5181d-d073644b-dab152c1-53ddf199_0 is DEAD
2025-10-10T14:39:28.825944Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90b5181d-d073644b-dab152c1-53ddf199_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:39:28.825953Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90b5181d-d073644b-dab152c1-53ddf199_0] Write session will restart in 0.006125s
2025-10-10T14:39:28.825979Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90b5181d-d073644b-dab152c1-53ddf199_0] Write session: Do CDS request
2025-10-10T14:39:28.825984Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90b5181d-d073644b-dab152c1-53ddf199_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:28.832947Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|90b5181d-d073644b-dab152c1-53ddf199_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:28.833046Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:28.833066Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3005
2025-10-10T14:39:28.833190Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3005 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:28.833229Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3005 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:28.833242Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3005 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:28.833245Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:28.833699Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3005 sessionId:  describe result for acl check
2025-10-10T14:39:28.833734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:28.833735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:28.833737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:28.833744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602726333470866:2494] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:28.834301Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602726333470866:2494] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:28.837760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602726333470866:2494] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:28.840246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:28.845647Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602726333470866:2494] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:28.845665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602726333470866:2494] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:28.845669Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602726333470866:2494] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:28.845680Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3005 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:28.845876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:28.846148Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:28.846164Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:28.846179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:28.846261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:28.846312Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602725551230219:6822]
2025-10-10T14:39:28.846952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:28.847368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:28.847432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:28.847789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:28.847881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:28.847890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:28.847895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:28.847897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:28.847898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:28.847899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:28.847901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:28.847902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:28.847903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:28.847905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:28.847906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:28.847907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:28.847909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:28.847916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:28.847931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:28.847935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:28.847939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:28.847944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:28.847947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:28.847952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:28.847956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:28.847961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:28.847965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:28.847969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:28.847973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:28.847977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:28.847985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:28.847994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:28.848001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:28.848007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:28.848012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:28.848017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:28.848021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:28.848028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:28.848033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:28.848039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:28.848043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:28.848049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:28.848054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:28.848060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:28.848065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:28.848070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:28.848075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:28.848082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:28.848094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:28.848100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:28.848105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:28.848112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:28.848116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:28.848122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:28.848130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:28.848135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:28.848181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:28.851129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:28.851810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:28.851823Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:28.851826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:28.851830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:28.851837Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3004 [2:7559602725551230219:6822]
2025-10-10T14:39:28.851853Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:28.851873Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:28.851881Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:28.851886Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:28.851888Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:28.851910Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:28.851925Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:28.851933Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:28.851999Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:28.852009Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:28.852011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:28.852014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:28.852108Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:28.852117Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:28.852131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:28.852150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:28.852173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:28.852202Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602725551230213:6822]
2025-10-10T14:39:28.852210Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602725551230213:6822]
2025-10-10T14:39:28.852212Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602725551230213:6822]
2025-10-10T14:39:28.852222Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:28.852237Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:28.852239Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:28.852241Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:28.852243Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:28.852256Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:28.852260Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:28.852272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602726333470850:2438], now have 1 active actors on pipe
2025-10-10T14:39:28.852276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602726333470938:2494], now have 1 active actors on pipe
2025-10-10T14:39:28.852306Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602725551230213:6822]
2025-10-10T14:39:28.852319Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:28.852328Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:28.852579Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3004
2025-10-10T14:39:28.852629Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3004
2025-10-10T14:39:28.852702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:28.852712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:28.852768Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6d92f3e7-4e708a7d-742c438f-a746d794_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:28.852784Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:28.852794Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:28.852796Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:28.852810Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:28.852828Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:28.852863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:28.853127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:28.853140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:28.853162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:28.853448Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3005 partition: 0 MaxSeqNo: 40 sessionId: src_id|6d92f3e7-4e708a7d-742c438f-a746d794_0
2025-10-10T14:39:28.853877Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90b5181d-d073644b-dab152c1-53ddf199_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|6d92f3e7-4e708a7d-742c438f-a746d794_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:28.856526Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6d92f3e7-4e708a7d-742c438f-a746d794_0] Write session: try to update token
2025-10-10T14:39:28.856543Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6d92f3e7-4e708a7d-742c438f-a746d794_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:28.865577Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:39:28.865598Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:28.865609Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602725551230213:6822]
2025-10-10T14:39:28.865660Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:39:28.865844Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:39:28.865989Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:28.866126Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:28.866262Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:28.866456Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:39:28.866496Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:39:28.869552Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:39:28.876042Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3005 sessionId: src_id|6d92f3e7-4e708a7d-742c438f-a746d794_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:28.878704Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:28.878993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:28.879013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:28.879055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:39:28.879193Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:39:28.884495Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:28.884514Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:28.884518Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:28.884520Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:28.884531Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602725551230213:6822]
2025-10-10T14:39:28.884535Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602725551230213:6822]
2025-10-10T14:39:28.884543Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602725551230213:6822]
2025-10-10T14:39:28.884593Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:28.884598Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:28.884603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:28.884605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:28.884612Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:28.884616Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:28.884738Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:28.924886Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602726333470957:2572]
2025-10-10T14:39:28.925204Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 pipe creation result: OK TabletId: 72075186224037892 Generation: 3004, pipe: [1:7559602726333470957:2572]
2025-10-10T14:39:29.008067Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:29.017382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:29.017417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:29.017614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:29.017690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:29.017764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:29.017836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:29.017888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:29.017900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:29.017976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:29.018042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:29.018114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:29.018184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:29.018236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:29.018249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:29.018322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:29.018392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:29.018467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:29.018547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:29.018601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:29.018610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:29.018683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:29.018750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:29.018818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:29.018893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:29.018946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:29.018954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:29.019023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:29.019160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:29.019230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:29.019302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:29.019355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:29.019363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:29.019438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:29.019510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:29.019577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:29.019649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:29.019699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:29.019706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:29.019783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:29.019854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:29.019925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:29.019989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:29.020054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:29.020060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:29.020135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:29.021358Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 3 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602726333470957:2572]
2025-10-10T14:39:29.020198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:29.021369Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:29.020263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:29.020325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:29.020373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:29.020376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:29.020455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:29.021411Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:29.020518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:29.021414Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:29.020580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:29.021450Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3005 reason: error at write: Disconnected sessionId: src_id|6d92f3e7-4e708a7d-742c438f-a746d794_0
2025-10-10T14:39:29.020640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:29.020681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:29.020684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:29.020756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:29.020824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:29.020887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:29.020955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:29.021019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:29.021023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:29.021101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602726333470957:2572], now have 1 active actors on pipe
2025-10-10T14:39:29.021696Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3005 sessionId: src_id|6d92f3e7-4e708a7d-742c438f-a746d794_0 is DEAD
2025-10-10T14:39:29.022406Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d92f3e7-4e708a7d-742c438f-a746d794_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:29.022417Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d92f3e7-4e708a7d-742c438f-a746d794_0] Write session will restart in 0.007075s
2025-10-10T14:39:29.022454Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d92f3e7-4e708a7d-742c438f-a746d794_0] Write session: Do CDS request
2025-10-10T14:39:29.022461Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d92f3e7-4e708a7d-742c438f-a746d794_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:29.022502Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:29.030899Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6d92f3e7-4e708a7d-742c438f-a746d794_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:29.031273Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:29.031289Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3006
2025-10-10T14:39:29.031436Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3006 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:29.031486Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3006 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:29.031492Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3006 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:29.031496Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:29.032024Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3006 sessionId:  describe result for acl check
2025-10-10T14:39:29.032066Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:29.032076Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:29.032078Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:29.032084Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602730628438276:2485] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:29.032685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602730628438276:2485] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:29.035717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602730628438276:2485] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:29.036262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:29.041711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:29.041943Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:29.041954Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:29.041966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:29.042015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:29.041981Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602730628438276:2485] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:29.041999Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602730628438276:2485] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:29.042003Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602730628438276:2485] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:29.042011Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3006 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:29.042078Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602729846197610:6826]
2025-10-10T14:39:29.042808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:29.043104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:29.043518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:29.043869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:29.043919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:29.043926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:29.043927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:29.043929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:29.043930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:29.043932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:29.043933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:29.043934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:29.043936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:29.043937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:29.043938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:29.043939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:29.043941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:29.043947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:29.043961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:29.043965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:29.043970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:29.043974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:29.043979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:29.043983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:29.043987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:29.043991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:29.043995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:29.043999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:29.044003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:29.044007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:29.044014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:29.044023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:29.044029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:29.044035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:29.044039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:29.044045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:29.044049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:29.044055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:29.044065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:29.044070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:29.044079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:29.044084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:29.044089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:29.044100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:29.044104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:29.044109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:29.044115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:29.044124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:29.044128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:29.044133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:29.044138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:29.044143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:29.044148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:29.044153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:29.044164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:29.044169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:29.044210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:29.046751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:29.047057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:29.047069Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:29.047070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:29.047074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:29.047081Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3005 [2:7559602729846197610:6826]
2025-10-10T14:39:29.047094Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:29.047111Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:29.047114Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:29.047118Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:29.047120Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:29.047137Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:29.047150Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:29.047158Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:29.047218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:29.047228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:29.047230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:29.047233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:29.047302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:29.047309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:29.047320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:29.047331Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:29.047348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:29.047375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602730628438255:2438], now have 1 active actors on pipe
2025-10-10T14:39:29.047388Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602729846197605:6826]
2025-10-10T14:39:29.047396Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602729846197605:6826]
2025-10-10T14:39:29.047400Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602729846197605:6826]
2025-10-10T14:39:29.047413Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:29.047422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602730628438345:2485], now have 1 active actors on pipe
2025-10-10T14:39:29.047426Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:29.047430Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:29.047442Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:29.047444Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:29.047445Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:29.047448Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:29.047474Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602729846197605:6826]
2025-10-10T14:39:29.047482Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:29.047488Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:29.047526Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3005
2025-10-10T14:39:29.047556Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3005
2025-10-10T14:39:29.047612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:29.047622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:29.047656Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c1797b82-327c2c3a-2a5f324e-6d623db6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:29.047664Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:29.047668Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:29.047670Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:29.047682Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:29.047694Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:29.047709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:29.047840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:29.047848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:29.047860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:29.047944Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3006 partition: 0 MaxSeqNo: 40 sessionId: src_id|c1797b82-327c2c3a-2a5f324e-6d623db6_0
2025-10-10T14:39:29.048390Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d92f3e7-4e708a7d-742c438f-a746d794_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|c1797b82-327c2c3a-2a5f324e-6d623db6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:29.051546Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c1797b82-327c2c3a-2a5f324e-6d623db6_0] Write session: try to update token
2025-10-10T14:39:29.051582Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c1797b82-327c2c3a-2a5f324e-6d623db6_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:29.059784Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:39:29.059801Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:29.059812Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602729846197605:6826]
2025-10-10T14:39:29.059862Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:39:29.059864Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:39:29.060039Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:39:29.060169Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:29.060292Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:29.060417Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:29.060606Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:39:29.060642Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:39:29.066400Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3006 sessionId: src_id|c1797b82-327c2c3a-2a5f324e-6d623db6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:29.069019Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:29.069791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:29.069816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:29.069875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:39:29.069971Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:39:29.078333Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:29.078352Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:29.078355Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:29.078357Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:29.078370Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602729846197605:6826]
2025-10-10T14:39:29.078374Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602729846197605:6826]
2025-10-10T14:39:29.078378Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602729846197605:6826]
2025-10-10T14:39:29.078432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:29.078438Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:29.078443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:29.078445Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:29.078447Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:29.078450Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:29.078603Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:29.121510Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602730628438356:2572]
2025-10-10T14:39:29.121880Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 pipe creation result: OK TabletId: 72075186224037892 Generation: 3005, pipe: [1:7559602730628438356:2572]
2025-10-10T14:39:29.198610Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:29.207877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:29.207910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:29.208121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:29.208188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:29.208260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:29.208332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:29.208378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:29.208383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:29.208466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:29.208535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:29.208604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:29.208675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:29.208727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:29.208730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:29.208958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:29.209043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:29.209112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:29.209182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:29.209227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:29.209230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:29.209310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:29.209520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:29.209597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:29.209672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:29.209719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:29.209727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:29.209802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:29.212149Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 4 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602730628438356:2572]
2025-10-10T14:39:29.212187Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:29.212194Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:29.212197Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:29.212235Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3006 reason: error at write: Disconnected sessionId: src_id|c1797b82-327c2c3a-2a5f324e-6d623db6_0
2025-10-10T14:39:29.212504Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3006 sessionId: src_id|c1797b82-327c2c3a-2a5f324e-6d623db6_0 is DEAD
2025-10-10T14:39:29.212664Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1797b82-327c2c3a-2a5f324e-6d623db6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:29.212677Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1797b82-327c2c3a-2a5f324e-6d623db6_0] Write session will restart in 0.007091s
2025-10-10T14:39:29.212704Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1797b82-327c2c3a-2a5f324e-6d623db6_0] Write session: Do CDS request
2025-10-10T14:39:29.212710Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1797b82-327c2c3a-2a5f324e-6d623db6_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:29.209872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:29.209946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:29.210013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:29.210056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:29.210059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:29.210139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:29.210205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:29.210269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:29.210337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:29.210381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:29.210385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:29.210461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:29.210524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:29.210592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:29.210662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:29.210704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:29.210707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:29.210783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:29.210847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:29.210915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:29.210982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:29.211026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:29.211029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:29.211101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:29.211165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:29.211231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:29.211296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:29.211344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:29.211347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:29.211421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:29.211484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:29.211550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:29.211616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:29.211658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:29.211661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:29.211731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602730628438356:2572], now have 1 active actors on pipe
2025-10-10T14:39:29.212895Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:29.220956Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c1797b82-327c2c3a-2a5f324e-6d623db6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:29.221091Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:29.221107Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3007
2025-10-10T14:39:29.221343Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3007 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:29.221397Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3007 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:29.221403Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3007 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:29.221408Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:29.221878Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3007 sessionId:  describe result for acl check
2025-10-10T14:39:29.221912Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:29.221918Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:29.221920Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:29.221926Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602730628438374:2472] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:29.222539Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602730628438374:2472] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:29.226799Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602730628438374:2472] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:29.229176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:29.235377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:29.235501Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602730628438374:2472] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:29.235524Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602730628438374:2472] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:29.235529Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602730628438374:2472] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:29.235541Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3007 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:29.235639Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:29.235655Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:29.235668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:29.235732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:29.235785Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602729846197707:6823]
2025-10-10T14:39:29.236449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:29.236819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:29.236870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:29.237214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:29.237286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:29.237293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:29.237294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:29.237295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:29.237296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:29.237298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:29.237299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:29.237303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:29.237304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:29.237305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:29.237306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:29.237307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:29.237309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:29.237314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:29.237328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:29.237350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:29.237353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:29.237356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:29.237360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:29.237363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:29.237367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:29.237371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:29.237375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:29.237379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:29.237382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:29.237386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:29.237396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:29.237409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:29.237415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:29.237425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:29.237432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:29.237441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:29.237445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:29.237451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:29.237460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:29.237465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:29.237469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:29.237479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:29.237485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:29.237493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:29.237497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:29.237502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:29.237505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:29.237515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:29.237519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:29.237524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:29.237532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:29.237536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:29.237540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:29.237545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:29.237553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:29.237557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:29.237605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:29.240423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:29.240769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:29.240786Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:29.240788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:29.240793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:29.240800Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3006 [2:7559602729846197707:6823]
2025-10-10T14:39:29.240813Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:29.240832Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:29.240835Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:29.240839Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:29.240842Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:29.240861Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:29.240876Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:29.240884Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:29.240951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:29.240959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:29.240961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:29.240963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:29.241057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:29.241065Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:29.241094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:29.241110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:29.241131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:29.241161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602730628438359:2438], now have 1 active actors on pipe
2025-10-10T14:39:29.241170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602730628438449:2472], now have 1 active actors on pipe
2025-10-10T14:39:29.241178Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602729846197702:6823]
2025-10-10T14:39:29.241185Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602729846197702:6823]
2025-10-10T14:39:29.241188Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602729846197702:6823]
2025-10-10T14:39:29.241202Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:29.241222Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:29.241224Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:29.241227Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:29.241229Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:29.241243Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:29.241247Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:29.241217Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3006
2025-10-10T14:39:29.241223Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3006
2025-10-10T14:39:29.241290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:29.241300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:29.241316Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602729846197702:6823]
2025-10-10T14:39:29.241327Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:29.241352Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:29.241388Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|545d7fd8-13f6976c-46bdeca7-e1d85cde_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:29.241402Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:29.241411Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:29.241414Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:29.241428Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:29.241442Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:29.241472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:29.241622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:29.241630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:29.241648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:29.241735Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3007 partition: 0 MaxSeqNo: 40 sessionId: src_id|545d7fd8-13f6976c-46bdeca7-e1d85cde_0
2025-10-10T14:39:29.242201Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1797b82-327c2c3a-2a5f324e-6d623db6_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|545d7fd8-13f6976c-46bdeca7-e1d85cde_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:29.245110Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|545d7fd8-13f6976c-46bdeca7-e1d85cde_0] Write session: try to update token
2025-10-10T14:39:29.245131Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|545d7fd8-13f6976c-46bdeca7-e1d85cde_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:29.264540Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3007 sessionId: src_id|545d7fd8-13f6976c-46bdeca7-e1d85cde_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:29.262600Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:29.262619Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:29.262624Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:29.262625Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:29.262635Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602729846197702:6823]
2025-10-10T14:39:29.262643Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602729846197702:6823]
2025-10-10T14:39:29.262648Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602729846197702:6823]
2025-10-10T14:39:29.262701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:29.262700Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:29.262708Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:29.262709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:29.262712Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:29.262712Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:29.262858Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:29.267499Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:29.312464Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602730628438460:2572]
2025-10-10T14:39:29.313549Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 pipe creation result: OK TabletId: 72075186224037892 Generation: 3006, pipe: [1:7559602730628438460:2572]
2025-10-10T14:39:29.387168Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:29.387993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:29.388007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:29.388054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602730628438460:2572], now have 1 active actors on pipe
2025-10-10T14:39:29.389698Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:29.389714Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:29.389800Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3007 reason: error at write: Disconnected sessionId: src_id|545d7fd8-13f6976c-46bdeca7-e1d85cde_0
2025-10-10T14:39:29.389983Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:29.389990Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3007 sessionId: src_id|545d7fd8-13f6976c-46bdeca7-e1d85cde_0 is DEAD
2025-10-10T14:39:29.390037Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 5 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602730628438460:2572]
2025-10-10T14:39:29.390270Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|545d7fd8-13f6976c-46bdeca7-e1d85cde_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:29.390284Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|545d7fd8-13f6976c-46bdeca7-e1d85cde_0] Write session will restart in 0.008910s
2025-10-10T14:39:29.390310Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|545d7fd8-13f6976c-46bdeca7-e1d85cde_0] Write session: Do CDS request
2025-10-10T14:39:29.390315Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|545d7fd8-13f6976c-46bdeca7-e1d85cde_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:29.389820Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:29.400924Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|545d7fd8-13f6976c-46bdeca7-e1d85cde_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:29.401292Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:29.401311Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3008
2025-10-10T14:39:29.401814Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3008 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:29.401863Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3008 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:29.401874Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3008 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:29.401878Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:29.402372Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3008 sessionId:  describe result for acl check
2025-10-10T14:39:29.402412Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:29.402423Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:29.402425Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:29.402432Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602730628438479:2460] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:29.403008Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602730628438479:2460] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:29.405885Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602730628438479:2460] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:29.410126Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602730628438479:2460] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:29.410143Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602730628438479:2460] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:29.410147Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602730628438479:2460] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:29.410156Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3008 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:29.415794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:29.419236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:29.419501Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:29.419507Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:29.419521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:29.419585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:29.419629Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602729846197808:6815]
2025-10-10T14:39:29.420291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:29.420637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:29.420700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:29.421113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:29.421166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:29.421168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:29.421169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:29.421170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:29.421172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:29.421173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:29.421174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:29.421176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:29.421177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:29.421179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:29.421180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:29.421181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:29.421183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:29.421189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:29.421204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:29.421209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:29.421214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:29.421219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:29.421224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:29.421229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:29.421233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:29.421238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:29.421243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:29.421247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:29.421252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:29.421256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:29.421264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:29.421274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:29.421281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:29.421287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:29.421293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:29.421301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:29.421306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:29.421311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:29.421317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:29.421323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:29.421328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:29.421349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:29.421354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:29.421360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:29.421365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:29.421371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:29.421376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:29.421382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:29.421387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:29.421393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:29.421399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:29.421404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:29.421409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:29.421416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:29.421421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:29.421427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:29.421473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:29.424106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:29.425003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:29.425010Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:29.425012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:29.425017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:29.425025Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3007 [2:7559602729846197808:6815]
2025-10-10T14:39:29.425040Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:29.425058Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:29.425062Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:29.425065Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:29.425070Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:29.425088Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:29.425097Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:29.425105Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:29.425175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:29.425177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:29.425179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:29.425181Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:29.425259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:29.425262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:29.425275Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:29.425289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:29.425308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:29.425349Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602729846197803:6815]
2025-10-10T14:39:29.425352Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602729846197803:6815]
2025-10-10T14:39:29.425354Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602729846197803:6815]
2025-10-10T14:39:29.425364Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:29.425380Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:29.425382Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:29.425385Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:29.425388Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:29.425397Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:29.425401Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:29.425412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602730628438462:2438], now have 1 active actors on pipe
2025-10-10T14:39:29.425415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602730628438551:2460], now have 1 active actors on pipe
2025-10-10T14:39:29.425445Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602729846197803:6815]
2025-10-10T14:39:29.425455Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:29.425547Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3007
2025-10-10T14:39:29.425592Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3007
2025-10-10T14:39:29.425833Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:29.426048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:29.426069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:29.426114Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b0534f26-134f788a-ae3c30c5-bb6cc145_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:29.426129Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:29.426140Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:29.426144Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:29.426168Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:29.426189Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:29.426209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:29.427717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:29.427732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:29.427777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:29.427949Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3008 partition: 0 MaxSeqNo: 40 sessionId: src_id|b0534f26-134f788a-ae3c30c5-bb6cc145_0
2025-10-10T14:39:29.428456Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|545d7fd8-13f6976c-46bdeca7-e1d85cde_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|b0534f26-134f788a-ae3c30c5-bb6cc145_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:29.431349Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b0534f26-134f788a-ae3c30c5-bb6cc145_0] Write session: try to update token
2025-10-10T14:39:29.431373Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b0534f26-134f788a-ae3c30c5-bb6cc145_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:29.446581Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:29.446604Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:29.446608Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:29.446610Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:29.446620Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602729846197803:6815]
2025-10-10T14:39:29.446625Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602729846197803:6815]
2025-10-10T14:39:29.446629Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602729846197803:6815]
2025-10-10T14:39:29.446685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:29.446694Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:29.446697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:29.446869Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:29.448159Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3008 sessionId: src_id|b0534f26-134f788a-ae3c30c5-bb6cc145_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:29.449453Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:29.449469Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:29.449474Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:29.450966Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:29.490135Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602730628438565:2572]
2025-10-10T14:39:29.490526Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 pipe creation result: OK TabletId: 72075186224037892 Generation: 3007, pipe: [1:7559602730628438565:2572]
2025-10-10T14:39:29.570201Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:29.570801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:29.570819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:29.570876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602730628438565:2572], now have 1 active actors on pipe
2025-10-10T14:39:29.571262Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:29.571277Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:29.571341Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3008 reason: error at write: Disconnected sessionId: src_id|b0534f26-134f788a-ae3c30c5-bb6cc145_0
2025-10-10T14:39:29.571147Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:29.571543Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3008 sessionId: src_id|b0534f26-134f788a-ae3c30c5-bb6cc145_0 is DEAD
2025-10-10T14:39:29.571711Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0534f26-134f788a-ae3c30c5-bb6cc145_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:29.571724Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0534f26-134f788a-ae3c30c5-bb6cc145_0] Write session will restart in 0.009120s
2025-10-10T14:39:29.571756Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0534f26-134f788a-ae3c30c5-bb6cc145_0] Write session: Do CDS request
2025-10-10T14:39:29.571763Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0534f26-134f788a-ae3c30c5-bb6cc145_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:29.571688Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 6 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602730628438565:2572]
2025-10-10T14:39:29.571709Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:29.588241Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b0534f26-134f788a-ae3c30c5-bb6cc145_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:29.588325Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:29.588340Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3009
2025-10-10T14:39:29.588493Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3009 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:29.588528Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3009 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:29.588539Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3009 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:29.588543Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:29.589320Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3009 sessionId:  describe result for acl check
2025-10-10T14:39:29.589371Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:29.589378Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:29.589380Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:29.589387Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602730628438628:2447] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:29.589970Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602730628438628:2447] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:29.592357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:29.592730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602730628438628:2447] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:29.605829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:29.606304Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602730628438628:2447] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:29.606324Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602730628438628:2447] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:29.606327Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602730628438628:2447] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:29.606337Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3009 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:29.606631Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:29.606644Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:29.606660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:29.606754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:29.606806Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602729846197919:6811]
2025-10-10T14:39:29.607373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:29.607849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:29.607914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:29.608285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:29.608347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:29.608353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:29.608355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:29.608357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:29.608358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:29.608362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:29.608364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:29.608365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:29.608366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:29.608368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:29.608369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:29.608371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:29.608372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:29.608380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:29.608395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:29.608400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:29.608404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:29.608409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:29.608414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:29.608418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:29.608422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:29.608427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:29.608432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:29.608437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:29.608442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:29.608446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:29.608455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:29.608464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:29.608476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:29.608487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:29.608492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:29.608503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:29.608508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:29.608516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:29.608527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:29.608533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:29.608540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:29.608546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:29.608551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:29.608560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:29.608565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:29.608571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:29.608580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:29.608587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:29.608596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:29.608602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:29.608607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:29.608618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:29.608623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:29.608636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:29.608641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:29.608647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:29.608695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:29.611467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:29.611791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:29.611804Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:29.611807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:29.611811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:29.611818Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3008 [2:7559602729846197919:6811]
2025-10-10T14:39:29.611832Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:29.611851Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:29.611859Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:29.611863Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:29.611865Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:29.611900Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:29.611913Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:29.611924Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:29.611988Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:29.611996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:29.611998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:29.612001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:29.612075Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:29.612083Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:29.612096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:29.612112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:29.612136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:29.612160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602730628438659:2447], now have 1 active actors on pipe
2025-10-10T14:39:29.612164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602730628438568:2438], now have 1 active actors on pipe
2025-10-10T14:39:29.612173Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602729846197901:6811]
2025-10-10T14:39:29.612181Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602729846197901:6811]
2025-10-10T14:39:29.612184Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602729846197901:6811]
2025-10-10T14:39:29.612197Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:29.612216Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:29.612195Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3008
2025-10-10T14:39:29.612232Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:29.612203Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3008
2025-10-10T14:39:29.612233Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:29.612237Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:29.612242Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:29.612245Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:29.612268Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602729846197901:6811]
2025-10-10T14:39:29.612276Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:29.612290Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:29.612301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:29.612306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:29.612357Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|93d0320e-a3ba6af2-2ba48772-c24d1d91_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:29.612374Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:29.612383Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:29.612388Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:29.612399Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:29.612411Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:29.612429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:29.612646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:29.612657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:29.612681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:29.612811Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3009 partition: 0 MaxSeqNo: 40 sessionId: src_id|93d0320e-a3ba6af2-2ba48772-c24d1d91_0
2025-10-10T14:39:29.613242Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0534f26-134f788a-ae3c30c5-bb6cc145_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|93d0320e-a3ba6af2-2ba48772-c24d1d91_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:29.615964Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|93d0320e-a3ba6af2-2ba48772-c24d1d91_0] Write session: try to update token
2025-10-10T14:39:29.615983Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|93d0320e-a3ba6af2-2ba48772-c24d1d91_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:29.631032Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3009 sessionId: src_id|93d0320e-a3ba6af2-2ba48772-c24d1d91_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:29.634057Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:29.634284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:29.634308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:29.634349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:39:29.634445Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:39:29.640855Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:29.640874Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:29.640877Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:29.640879Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:29.640889Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602729846197901:6811]
2025-10-10T14:39:29.640894Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602729846197901:6811]
2025-10-10T14:39:29.640898Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602729846197901:6811]
2025-10-10T14:39:29.640953Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:29.640961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:29.640981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:29.640967Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:29.640989Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:29.640995Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:29.641163Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:29.673223Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602730628438671:2572]
2025-10-10T14:39:29.674061Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 pipe creation result: OK TabletId: 72075186224037892 Generation: 3008, pipe: [1:7559602730628438671:2572]
2025-10-10T14:39:29.760655Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:29.770393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:29.770425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:29.770612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:29.770682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:29.770746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:29.770820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:29.770866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:29.770871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:29.770949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:29.771021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:29.771098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:29.771169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:29.771216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:29.771224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:29.771299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:29.771366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:29.771440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:29.771501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:29.771541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:29.771544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:29.771611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:29.771675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:29.771738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:29.771803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:29.771844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:29.771847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:29.771915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:29.771975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:29.772039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:29.772101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:29.772142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:29.772145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:29.772215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:29.772277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:29.772338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:29.772401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:29.772443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:29.772446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:29.772517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:29.772576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:29.772640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:29.772703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:29.772747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:29.772750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:29.772821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:29.772881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:29.772941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:29.773020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:29.773064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:29.773067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:29.773136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:29.773197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:29.773257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:29.773317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:29.773548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:29.773559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:29.776062Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:29.776086Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:29.776114Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3009 reason: error at write: Disconnected sessionId: src_id|93d0320e-a3ba6af2-2ba48772-c24d1d91_0
2025-10-10T14:39:29.776354Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3009 sessionId: src_id|93d0320e-a3ba6af2-2ba48772-c24d1d91_0 is DEAD
2025-10-10T14:39:29.776531Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:29.776565Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 7 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602730628438671:2572]
2025-10-10T14:39:29.776736Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|93d0320e-a3ba6af2-2ba48772-c24d1d91_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:29.776744Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|93d0320e-a3ba6af2-2ba48772-c24d1d91_0] Write session will restart in 0.006971s
2025-10-10T14:39:29.776773Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|93d0320e-a3ba6af2-2ba48772-c24d1d91_0] Write session: Do CDS request
2025-10-10T14:39:29.776780Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|93d0320e-a3ba6af2-2ba48772-c24d1d91_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:29.773654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:29.773740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:29.773801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:29.773860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:29.773900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:29.773904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:29.775419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602730628438671:2572], now have 1 active actors on pipe
2025-10-10T14:39:29.776853Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:29.784951Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|93d0320e-a3ba6af2-2ba48772-c24d1d91_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:29.785008Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:29.785025Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3010
2025-10-10T14:39:29.785179Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3010 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:29.785213Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3010 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:29.785218Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3010 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:29.785222Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:29.785751Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3010 sessionId:  describe result for acl check
2025-10-10T14:39:29.785788Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:29.785790Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:29.785793Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:29.785799Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602730628438706:2423] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:29.786354Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602730628438706:2423] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:29.789161Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602730628438706:2423] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:29.792556Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602730628438706:2423] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:29.792574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602730628438706:2423] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:29.792577Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602730628438706:2423] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:29.792586Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3010 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:29.800232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:29.805973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:29.806226Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:29.806237Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:29.806250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:29.806315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:29.806368Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602729846198058:6801]
2025-10-10T14:39:29.807019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:29.807409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:29.807458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:29.807819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:29.807880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:29.807887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:29.807888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:29.807889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:29.807890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:29.807891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:29.807893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:29.807894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:29.807895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:29.807896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:29.807897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:29.807899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:29.807900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:29.807906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:29.807918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:29.807922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:29.807926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:29.807930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:29.807933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:29.807936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:29.807939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:29.807943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:29.807947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:29.807951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:29.807954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:29.807959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:29.807966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:29.807976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:29.807983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:29.807989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:29.807993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:29.808000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:29.808004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:29.808010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:29.808014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:29.808019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:29.808029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:29.808034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:29.808039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:29.808044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:29.808048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:29.808054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:29.808058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:29.808063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:29.808066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:29.808070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:29.808075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:29.808079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:29.808083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:29.808093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:29.808097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:29.808102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:29.808145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:29.810721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:29.811462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:29.811475Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:29.811477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:29.811481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:29.811488Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3009 [2:7559602729846198058:6801]
2025-10-10T14:39:29.811501Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:29.811519Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:29.811527Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:29.811530Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:29.811535Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:29.811553Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:29.811565Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:29.811573Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:29.811635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:29.811642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:29.811644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:29.811647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:29.811717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:29.811725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:29.811736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:29.811747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:29.811769Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:29.811795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602730628438699:2438], now have 1 active actors on pipe
2025-10-10T14:39:29.811804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602730628438743:2423], now have 1 active actors on pipe
2025-10-10T14:39:29.811812Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602729846198028:6801]
2025-10-10T14:39:29.811815Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602729846198028:6801]
2025-10-10T14:39:29.811817Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602729846198028:6801]
2025-10-10T14:39:29.811829Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:29.811838Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:29.811840Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:29.811842Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:29.811847Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:29.811863Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:29.811871Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:29.811896Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602729846198028:6801]
2025-10-10T14:39:29.811906Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:29.811919Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3009
2025-10-10T14:39:29.811944Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3009
2025-10-10T14:39:29.811913Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:29.811979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:29.811988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:29.812024Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5af0c0a-2d908a9-a81474d3-89f7a1a2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:29.812042Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:29.812045Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:29.812048Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:29.812060Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:29.812072Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:29.812089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:29.812250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:29.812258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:29.812274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:29.812415Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3010 partition: 0 MaxSeqNo: 40 sessionId: src_id|5af0c0a-2d908a9-a81474d3-89f7a1a2_0
2025-10-10T14:39:29.812846Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|93d0320e-a3ba6af2-2ba48772-c24d1d91_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|5af0c0a-2d908a9-a81474d3-89f7a1a2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:29.815593Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5af0c0a-2d908a9-a81474d3-89f7a1a2_0] Write session: try to update token
2025-10-10T14:39:29.815612Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5af0c0a-2d908a9-a81474d3-89f7a1a2_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:29.823991Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:39:29.824013Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:29.824024Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602729846198028:6801]
2025-10-10T14:39:29.824080Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:39:29.824146Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:39:29.824260Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:39:29.824405Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:29.824551Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:29.824701Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:29.824895Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:39:29.824940Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:39:29.829933Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3010 sessionId: src_id|5af0c0a-2d908a9-a81474d3-89f7a1a2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:29.832681Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:29.833314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:29.833359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:29.833406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:39:29.833536Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:39:29.842918Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:29.842942Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:29.842947Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:29.842949Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:29.842967Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602729846198028:6801]
2025-10-10T14:39:29.842972Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602729846198028:6801]
2025-10-10T14:39:29.842977Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602729846198028:6801]
2025-10-10T14:39:29.843034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:29.843044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:29.843047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:29.843046Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:29.843053Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:29.843066Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:29.843213Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:29.876678Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602730628438822:2572]
2025-10-10T14:39:29.876990Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 pipe creation result: OK TabletId: 72075186224037892 Generation: 3009, pipe: [1:7559602730628438822:2572]
2025-10-10T14:39:29.973150Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:29.982397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:29.982430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:29.982619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:29.982691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:29.982766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:29.982832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:29.982883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:29.982893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:29.982964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:29.983032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:29.983097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:29.983164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:29.983212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:29.983220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:29.983286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:29.983352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:29.983417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:29.983479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:29.983523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:29.983530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:29.983600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:29.983670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:29.983733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:29.983800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:29.983848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:29.983855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:29.983926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:29.983990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:29.984056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:29.984121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:29.984166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:29.984176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:29.984242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:29.984306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:29.984366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:29.984433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:29.984483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:29.984491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:29.984559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:29.984621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:29.984688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:29.984756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:29.984801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:29.984811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:29.984878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:29.984941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:29.985018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:29.985085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:29.985133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:29.985142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:29.985208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:29.985278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:29.985360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:29.985425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:29.985475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:29.985484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:29.985554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:29.985618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:29.985686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:29.985750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:29.985797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:29.985804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:29.985872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602730628438822:2572], now have 1 active actors on pipe
2025-10-10T14:39:29.986215Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:29.986290Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:29.986298Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:29.986343Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3010 reason: error at write: Disconnected sessionId: src_id|5af0c0a-2d908a9-a81474d3-89f7a1a2_0
2025-10-10T14:39:29.986548Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3010 sessionId: src_id|5af0c0a-2d908a9-a81474d3-89f7a1a2_0 is DEAD
2025-10-10T14:39:29.986598Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 8 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602730628438822:2572]
2025-10-10T14:39:29.986710Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5af0c0a-2d908a9-a81474d3-89f7a1a2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:29.986722Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5af0c0a-2d908a9-a81474d3-89f7a1a2_0] Write session will restart in 0.005478s
2025-10-10T14:39:29.986747Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5af0c0a-2d908a9-a81474d3-89f7a1a2_0] Write session: Do CDS request
2025-10-10T14:39:29.986754Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5af0c0a-2d908a9-a81474d3-89f7a1a2_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:29.987330Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:29.993920Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5af0c0a-2d908a9-a81474d3-89f7a1a2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:29.993973Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:29.993988Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3011
2025-10-10T14:39:29.994181Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3011 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:29.994225Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3011 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:29.994237Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3011 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:29.994242Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:29.994694Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3011 sessionId:  describe result for acl check
2025-10-10T14:39:29.994727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:29.994735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:29.994738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:29.994743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602730628438842:2408] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:29.995372Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602730628438842:2408] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:29.998348Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602730628438842:2408] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:30.002155Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602730628438842:2408] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:30.002171Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602730628438842:2408] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:30.002175Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602730628438842:2408] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:30.002185Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3011 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:30.008149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:30.008822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:30.009055Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:30.009067Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:30.009079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:30.009142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:30.009189Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602734141165457:6791]
2025-10-10T14:39:30.009863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:30.010225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:30.010300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:30.010661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:30.010727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:30.010737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:30.010738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:30.010739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:30.010740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:30.010742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:30.010743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:30.010744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:30.010745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:30.010747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:30.010748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:30.010749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:30.010751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:30.010757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:30.010771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:30.010775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:30.010780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:30.010784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:30.010788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:30.010792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:30.010796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:30.010800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:30.010808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:30.010811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:30.010816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:30.010819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:30.010828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:30.010838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:30.010845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:30.010851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:30.010855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:30.010860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:30.010865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:30.010870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:30.010875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:30.010880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:30.010884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:30.010890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:30.010895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:30.010900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:30.010905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:30.010911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:30.010922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:30.010928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:30.010936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:30.010944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:30.010955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:30.010964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:30.010969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:30.010979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:30.010983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:30.010989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:30.011034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:30.013655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:30.014006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:30.014019Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:30.014021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:30.014026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:30.014033Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3010 [2:7559602734141165457:6791]
2025-10-10T14:39:30.014048Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:30.014066Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:30.014070Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:30.014074Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:30.014076Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:30.014093Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:30.014106Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:30.014114Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:30.014177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:30.014185Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:30.014187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:30.014190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:30.014273Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:30.014281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:30.014292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:30.014303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:30.014324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:30.014353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602730628438829:2438], now have 1 active actors on pipe
2025-10-10T14:39:30.014361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602734923406214:2408], now have 1 active actors on pipe
2025-10-10T14:39:30.014370Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602734141165452:6791]
2025-10-10T14:39:30.014376Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602734141165452:6791]
2025-10-10T14:39:30.014380Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602734141165452:6791]
2025-10-10T14:39:30.014393Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:30.014419Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:30.014424Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:30.014424Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:30.014440Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:30.014439Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:30.014447Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:30.014399Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3010
2025-10-10T14:39:30.014456Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3010
2025-10-10T14:39:30.014486Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602734141165452:6791]
2025-10-10T14:39:30.014495Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:30.014516Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:30.014525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:30.014531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:30.014564Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3c21216d-e9a99c8-2413385d-d479ac66_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:30.014577Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:30.014582Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:30.014584Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:30.014597Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:30.014609Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:30.014628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:30.014839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:30.014852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:30.014876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:30.014984Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3011 partition: 0 MaxSeqNo: 40 sessionId: src_id|3c21216d-e9a99c8-2413385d-d479ac66_0
2025-10-10T14:39:30.015394Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5af0c0a-2d908a9-a81474d3-89f7a1a2_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|3c21216d-e9a99c8-2413385d-d479ac66_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:30.018362Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3c21216d-e9a99c8-2413385d-d479ac66_0] Write session: try to update token
2025-10-10T14:39:30.018383Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3c21216d-e9a99c8-2413385d-d479ac66_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:30.033550Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3011 sessionId: src_id|3c21216d-e9a99c8-2413385d-d479ac66_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:30.035566Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:30.035585Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:30.035588Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:30.035591Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:30.035601Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602734141165452:6791]
2025-10-10T14:39:30.035605Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602734141165452:6791]
2025-10-10T14:39:30.035612Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602734141165452:6791]
2025-10-10T14:39:30.035666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:30.035664Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:30.035671Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:30.035676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:30.035676Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:30.035679Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:30.035828Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:30.036386Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:30.086563Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602734923406228:2572]
2025-10-10T14:39:30.087056Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 pipe creation result: OK TabletId: 72075186224037892 Generation: 3010, pipe: [1:7559602734923406228:2572]
2025-10-10T14:39:30.135039Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:155: [72075186224037893][rt3.dc1--test-topic] TPersQueueReadBalancer::HandleWakeup
2025-10-10T14:39:30.135074Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 17
2025-10-10T14:39:30.154567Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:30.156447Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:39:30.156908Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c21216d-e9a99c8-2413385d-d479ac66_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:39:30.156917Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c21216d-e9a99c8-2413385d-d479ac66_0] Write session will restart in 0.005964s
2025-10-10T14:39:30.156937Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c21216d-e9a99c8-2413385d-d479ac66_0] Write session: Do CDS request
2025-10-10T14:39:30.156941Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c21216d-e9a99c8-2413385d-d479ac66_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:30.156536Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3011 reason: status is not ok: tablet will be restarted right now sessionId: src_id|3c21216d-e9a99c8-2413385d-d479ac66_0
2025-10-10T14:39:30.156768Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3011 sessionId: src_id|3c21216d-e9a99c8-2413385d-d479ac66_0 is DEAD
2025-10-10T14:39:30.156998Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:30.157012Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 17
2025-10-10T14:39:30.157061Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 9 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602734923406228:2572]
2025-10-10T14:39:30.155374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:30.155390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:30.155431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602734923406228:2572], now have 1 active actors on pipe
2025-10-10T14:39:30.155705Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:30.163995Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3c21216d-e9a99c8-2413385d-d479ac66_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:30.164087Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:30.164105Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3012
2025-10-10T14:39:30.164255Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3012 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:30.164293Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3012 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:30.164299Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3012 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:30.164303Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:30.164750Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3012 sessionId:  describe result for acl check
2025-10-10T14:39:30.164786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:30.164792Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:30.164794Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:30.164800Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602734923406241:2399] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:30.165484Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602734923406241:2399] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:30.168914Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602734923406241:2399] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:30.173997Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602734923406241:2399] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:30.174020Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602734923406241:2399] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:30.174024Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602734923406241:2399] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:30.174034Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3012 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:30.180714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:30.185992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:30.186275Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:30.186297Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:30.186314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:30.186397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:30.186447Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602734141165561:6784]
2025-10-10T14:39:30.187120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:30.187543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:30.187610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:30.187991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:30.188058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:30.188064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:30.188066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:30.188067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:30.188068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:30.188069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:30.188071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:30.188073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:30.188075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:30.188076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:30.188077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:30.188079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:30.188080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:30.188087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:30.188100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:30.188104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:30.188109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:30.188113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:30.188118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:30.188122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:30.188127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:30.188131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:30.188136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:30.188140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:30.188144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:30.188148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:30.188155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:30.188164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:30.188172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:30.188178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:30.188182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:30.188188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:30.188192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:30.188197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:30.188201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:30.188209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:30.188214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:30.188220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:30.188228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:30.188239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:30.188243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:30.188251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:30.188255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:30.188273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:30.188278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:30.188288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:30.188293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:30.188298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:30.188302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:30.188308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:30.188312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:30.188318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:30.188361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:30.191393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:30.191758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:30.191773Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:30.191775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:30.191779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:30.191787Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3011 [2:7559602734141165561:6784]
2025-10-10T14:39:30.191801Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:30.191820Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:30.191824Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:30.191827Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:30.191830Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:30.191850Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:30.191863Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:30.191872Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:30.191960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:30.191968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:30.191970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:30.191973Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:30.192047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:30.192058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:30.192071Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:30.192090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:30.192112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:30.192140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602734923406298:2399], now have 1 active actors on pipe
2025-10-10T14:39:30.192148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602734923406233:2438], now have 1 active actors on pipe
2025-10-10T14:39:30.192157Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602734141165556:6784]
2025-10-10T14:39:30.192183Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3011
2025-10-10T14:39:30.192228Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3011
2025-10-10T14:39:30.192159Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602734141165556:6784]
2025-10-10T14:39:30.192161Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602734141165556:6784]
2025-10-10T14:39:30.192174Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:30.192189Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:30.192205Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:30.192205Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:30.192208Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:30.192208Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:30.192210Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:30.192239Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602734141165556:6784]
2025-10-10T14:39:30.192242Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:30.192248Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:30.192272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:30.192277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:30.192333Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bfe30ac3-fd6dd669-fff5ad3e-26dc0794_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:30.192347Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:30.192352Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:30.192354Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:30.192367Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:30.192383Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:30.192458Z node 2 :PERSQUEUE DEBUG: partition.cpp:1000: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 80296142 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-10-10T14:39:30.192497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:30.192746Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 9 Generation: 1 StatsReportRound: 21 DataSize: 80296142 UsedReserveSize: 0
2025-10-10T14:39:30.192804Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-10-10T14:39:30.193796Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3012 partition: 0 MaxSeqNo: 40 sessionId: src_id|bfe30ac3-fd6dd669-fff5ad3e-26dc0794_0
2025-10-10T14:39:30.194254Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c21216d-e9a99c8-2413385d-d479ac66_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|bfe30ac3-fd6dd669-fff5ad3e-26dc0794_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:30.192727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:30.192738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:30.192761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:30.197170Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bfe30ac3-fd6dd669-fff5ad3e-26dc0794_0] Write session: try to update token
2025-10-10T14:39:30.197190Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bfe30ac3-fd6dd669-fff5ad3e-26dc0794_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:30.214358Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:30.214385Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:30.214388Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:30.214390Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:30.214405Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602734141165556:6784]
2025-10-10T14:39:30.214409Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602734141165556:6784]
2025-10-10T14:39:30.214413Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602734141165556:6784]
2025-10-10T14:39:30.214466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:30.214469Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:30.214474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:30.214476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:30.214477Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:30.214482Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:30.214633Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:30.215189Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3012 sessionId: src_id|bfe30ac3-fd6dd669-fff5ad3e-26dc0794_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:30.218083Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:30.256613Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602734923406342:2572]
2025-10-10T14:39:30.256975Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 pipe creation result: OK TabletId: 72075186224037892 Generation: 3011, pipe: [1:7559602734923406342:2572]
2025-10-10T14:39:30.331422Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:30.332349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:30.332370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:30.332423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602734923406342:2572], now have 1 active actors on pipe
2025-10-10T14:39:30.332854Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:30.332868Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:30.332885Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:30.332976Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3012 reason: error at write: Disconnected sessionId: src_id|bfe30ac3-fd6dd669-fff5ad3e-26dc0794_0
2025-10-10T14:39:30.333206Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3012 sessionId: src_id|bfe30ac3-fd6dd669-fff5ad3e-26dc0794_0 is DEAD
2025-10-10T14:39:30.333217Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 10 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602734923406342:2572]
2025-10-10T14:39:30.333240Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:30.333253Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 0
2025-10-10T14:39:30.334019Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bfe30ac3-fd6dd669-fff5ad3e-26dc0794_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:30.334031Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bfe30ac3-fd6dd669-fff5ad3e-26dc0794_0] Write session will restart in 0.006406s
2025-10-10T14:39:30.334070Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bfe30ac3-fd6dd669-fff5ad3e-26dc0794_0] Write session: Do CDS request
2025-10-10T14:39:30.334077Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bfe30ac3-fd6dd669-fff5ad3e-26dc0794_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:30.342005Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bfe30ac3-fd6dd669-fff5ad3e-26dc0794_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:30.342103Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:30.342122Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3013
2025-10-10T14:39:30.342276Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3013 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:30.342313Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3013 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:30.342320Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3013 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:30.342324Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:30.342913Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3013 sessionId:  describe result for acl check
2025-10-10T14:39:30.342952Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:30.342959Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:30.342961Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:30.342968Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602734923406375:2393] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:30.343534Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602734923406375:2393] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:30.346446Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602734923406375:2393] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:30.347493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:30.353069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:30.353311Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:30.353322Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:30.353345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:30.353403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:30.353446Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602734141165667:6764]
2025-10-10T14:39:30.354093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:30.354454Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602734923406375:2393] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:30.354474Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602734923406375:2393] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:30.354479Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602734923406375:2393] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:30.354489Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3013 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:30.354570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:30.354619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:30.354921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:30.354983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:30.354984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:30.354985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:30.354986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:30.354988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:30.354989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:30.354990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:30.354991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:30.354992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:30.354994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:30.354995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:30.354996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:30.354997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:30.355002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:30.355017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:30.355035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:30.355038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:30.355041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:30.355045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:30.355048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:30.355051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:30.355055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:30.355059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:30.355062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:30.355067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:30.355070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:30.355078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:30.355086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:30.355093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:30.355098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:30.355102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:30.355106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:30.355110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:30.355114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:30.355119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:30.355124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:30.355128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:30.355133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:30.355137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:30.355141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:30.355145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:30.355149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:30.355152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:30.355157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:30.355160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:30.355166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:30.355170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:30.355174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:30.355178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:30.355182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:30.355186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:30.355190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:30.355227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:30.361039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:30.361401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:30.361416Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:30.361418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:30.361423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:30.361431Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3012 [2:7559602734141165667:6764]
2025-10-10T14:39:30.361449Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:30.361469Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:30.361476Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:30.361481Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:30.361484Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:30.361503Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:30.361516Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:30.361528Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:30.361615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:30.361626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:30.361628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:30.361631Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:30.361709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:30.361717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:30.361827Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3012
2025-10-10T14:39:30.361845Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3012
2025-10-10T14:39:30.361742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:30.361763Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:30.361783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:30.361808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602734923406347:2438], now have 1 active actors on pipe
2025-10-10T14:39:30.361813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602734923406446:2393], now have 1 active actors on pipe
2025-10-10T14:39:30.361821Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602734141165662:6764]
2025-10-10T14:39:30.361824Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602734141165662:6764]
2025-10-10T14:39:30.361828Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602734141165662:6764]
2025-10-10T14:39:30.361844Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:30.361860Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:30.361878Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:30.361882Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:30.361895Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:30.362269Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 9 Generation: 1 StatsReportRound: 22 DataSize: 80296142 UsedReserveSize: 0
2025-10-10T14:39:30.362308Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-10-10T14:39:30.361898Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:30.361901Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:30.361917Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602734141165662:6764]
2025-10-10T14:39:30.361920Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:30.361922Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:30.361958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:30.361963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:30.362050Z node 2 :PERSQUEUE DEBUG: partition.cpp:1000: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 80296142 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-10-10T14:39:30.362089Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4958bc2d-f939c59a-9758ddca-7129503a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:30.362096Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:30.362100Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:30.362103Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:30.362115Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:30.362125Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:30.362142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:30.362866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:30.362875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:30.362900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:30.363027Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3013 partition: 0 MaxSeqNo: 40 sessionId: src_id|4958bc2d-f939c59a-9758ddca-7129503a_0
2025-10-10T14:39:30.363432Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bfe30ac3-fd6dd669-fff5ad3e-26dc0794_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|4958bc2d-f939c59a-9758ddca-7129503a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:30.366747Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4958bc2d-f939c59a-9758ddca-7129503a_0] Write session: try to update token
2025-10-10T14:39:30.366772Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4958bc2d-f939c59a-9758ddca-7129503a_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:30.382874Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:30.382897Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:30.382901Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:30.382903Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:30.382914Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602734141165662:6764]
2025-10-10T14:39:30.382920Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602734141165662:6764]
2025-10-10T14:39:30.382925Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602734141165662:6764]
2025-10-10T14:39:30.382979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:30.382994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:30.382997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:30.382998Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:30.383018Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:30.383027Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:30.383141Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:30.384449Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3013 sessionId: src_id|4958bc2d-f939c59a-9758ddca-7129503a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:30.387053Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:30.433258Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602734923406458:2572]
2025-10-10T14:39:30.433607Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 pipe creation result: OK TabletId: 72075186224037892 Generation: 3012, pipe: [1:7559602734923406458:2572]
2025-10-10T14:39:30.500551Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:30.500763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:30.500779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:30.500828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602734923406458:2572], now have 1 active actors on pipe
2025-10-10T14:39:30.501032Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:30.501123Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 11 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602734923406458:2572]
2025-10-10T14:39:30.501168Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:39:30.501261Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3013 reason: status is not ok: tablet will be restarted right now sessionId: src_id|4958bc2d-f939c59a-9758ddca-7129503a_0
2025-10-10T14:39:30.501514Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3013 sessionId: src_id|4958bc2d-f939c59a-9758ddca-7129503a_0 is DEAD
2025-10-10T14:39:30.501560Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:30.501846Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4958bc2d-f939c59a-9758ddca-7129503a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:39:30.501859Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4958bc2d-f939c59a-9758ddca-7129503a_0] Write session will restart in 0.005907s
2025-10-10T14:39:30.501883Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4958bc2d-f939c59a-9758ddca-7129503a_0] Write session: Do CDS request
2025-10-10T14:39:30.501890Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4958bc2d-f939c59a-9758ddca-7129503a_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:30.508922Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4958bc2d-f939c59a-9758ddca-7129503a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:30.509026Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:30.509042Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3014
2025-10-10T14:39:30.509189Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3014 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:30.509227Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3014 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:30.509238Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3014 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:30.509243Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:30.509776Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3014 sessionId:  describe result for acl check
2025-10-10T14:39:30.509812Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:30.509815Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:30.509817Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:30.509823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602734923406477:2383] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:30.510435Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602734923406477:2383] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:30.513062Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602734923406477:2383] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:30.515960Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602734923406477:2383] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:30.515973Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602734923406477:2383] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:30.515977Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602734923406477:2383] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:30.515986Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3014 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:30.521232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:30.521837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:30.522045Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:30.522056Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:30.522069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:30.522119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:30.522166Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602734141165774:6775]
2025-10-10T14:39:30.522823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:30.523169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:30.523216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:30.523568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:30.523641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:30.523647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:30.523649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:30.523650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:30.523651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:30.523653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:30.523654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:30.523655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:30.523656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:30.523658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:30.523659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:30.523660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:30.523661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:30.523667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:30.523680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:30.523684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:30.523688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:30.523692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:30.523696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:30.523699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:30.523703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:30.523706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:30.523711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:30.523715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:30.523719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:30.523723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:30.523732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:30.523741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:30.523748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:30.523754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:30.523759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:30.523765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:30.523769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:30.523774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:30.523780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:30.523786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:30.523791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:30.523796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:30.523801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:30.523815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:30.523826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:30.523832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:30.523840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:30.523845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:30.523850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:30.523855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:30.523860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:30.523866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:30.523870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:30.523876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:30.523880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:30.523886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:30.523925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:30.526606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:30.526979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:30.526996Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:30.527014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:30.527019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:30.527026Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3013 [2:7559602734141165774:6775]
2025-10-10T14:39:30.527042Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:30.527068Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:30.527076Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:30.527080Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:30.527083Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:30.527103Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:30.527116Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:30.527124Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:30.527186Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:30.527193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:30.527195Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:30.527198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:30.527258Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:30.527264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:30.527272Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:30.527280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:30.527292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:30.527312Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602734141165769:6775]
2025-10-10T14:39:30.527316Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602734141165769:6775]
2025-10-10T14:39:30.527318Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602734141165769:6775]
2025-10-10T14:39:30.527329Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:30.527345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602734923406463:2438], now have 1 active actors on pipe
2025-10-10T14:39:30.527346Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:30.527349Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:30.527352Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:30.527352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602734923406558:2383], now have 1 active actors on pipe
2025-10-10T14:39:30.527360Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:30.527375Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:30.527383Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:30.527409Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602734141165769:6775]
2025-10-10T14:39:30.527420Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:30.527426Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:30.527410Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3013
2025-10-10T14:39:30.527438Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3013
2025-10-10T14:39:30.527587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:30.527597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:30.527624Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|94a4412c-5fbd851e-b3d977d-420897bb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:30.527634Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:30.527637Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:30.527639Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:30.527648Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:30.527659Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:30.527671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:30.527894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:30.527906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:30.527930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:30.528043Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3014 partition: 0 MaxSeqNo: 40 sessionId: src_id|94a4412c-5fbd851e-b3d977d-420897bb_0
2025-10-10T14:39:30.528456Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4958bc2d-f939c59a-9758ddca-7129503a_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|94a4412c-5fbd851e-b3d977d-420897bb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:30.531312Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|94a4412c-5fbd851e-b3d977d-420897bb_0] Write session: try to update token
2025-10-10T14:39:30.531334Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|94a4412c-5fbd851e-b3d977d-420897bb_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:30.546660Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:39:30.546679Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:30.546691Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602734141165769:6775]
2025-10-10T14:39:30.546753Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:39:30.546779Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:39:30.546953Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:39:30.547107Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:30.547262Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:30.547415Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:30.547516Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3014 sessionId: src_id|94a4412c-5fbd851e-b3d977d-420897bb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:30.547617Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:39:30.547667Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:39:30.550275Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:30.550492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:30.550521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:30.550560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:39:30.550667Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:39:30.567552Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:30.567575Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:30.567579Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:30.567582Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:30.567592Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602734141165769:6775]
2025-10-10T14:39:30.567600Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602734141165769:6775]
2025-10-10T14:39:30.567603Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602734141165769:6775]
2025-10-10T14:39:30.567655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:30.567662Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:30.567668Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:30.567668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:30.567671Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:30.567673Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:30.567811Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:30.601163Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602734923406571:2572]
2025-10-10T14:39:30.601512Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 pipe creation result: OK TabletId: 72075186224037892 Generation: 3013, pipe: [1:7559602734923406571:2572]
2025-10-10T14:39:30.684162Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:30.692525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:30.692557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:30.692743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:30.692817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:30.692885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:30.692974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:30.693025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:30.693035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:30.693110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:30.693176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:30.693244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:30.693310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:30.693373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:30.693381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:30.693450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:30.693515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:30.693582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:30.693655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:30.693707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:30.693715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:30.693786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:30.693860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:30.693928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:30.693999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:30.694045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:30.694055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:30.694127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:30.694198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:30.694264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:30.694334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:30.694377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:30.694384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:30.694456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:30.694526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:30.694596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:30.694661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:30.694709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:30.694718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:30.694791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:30.694857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:30.694924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:30.694991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:30.695041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:30.695049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:30.695122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:30.695186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:30.695254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:30.695329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:30.695379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:30.695387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:30.695453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:30.695521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:30.695589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:30.695659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:30.695703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:30.695712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:30.695781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:30.695861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:30.695930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:30.696000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:30.696045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:30.696052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:30.696121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602734923406571:2572], now have 1 active actors on pipe
2025-10-10T14:39:30.696395Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:30.696418Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:30.696460Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3014 reason: error at write: Disconnected sessionId: src_id|94a4412c-5fbd851e-b3d977d-420897bb_0
2025-10-10T14:39:30.696480Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 12 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602734923406571:2572]
2025-10-10T14:39:30.696500Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:30.696731Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3014 sessionId: src_id|94a4412c-5fbd851e-b3d977d-420897bb_0 is DEAD
2025-10-10T14:39:30.696900Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94a4412c-5fbd851e-b3d977d-420897bb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:30.696911Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94a4412c-5fbd851e-b3d977d-420897bb_0] Write session will restart in 0.005904s
2025-10-10T14:39:30.696938Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94a4412c-5fbd851e-b3d977d-420897bb_0] Write session: Do CDS request
2025-10-10T14:39:30.696945Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94a4412c-5fbd851e-b3d977d-420897bb_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:30.697796Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:30.704013Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|94a4412c-5fbd851e-b3d977d-420897bb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:30.704127Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:30.704146Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3015
2025-10-10T14:39:30.704311Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3015 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:30.704365Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3015 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:30.704379Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3015 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:30.704385Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:30.704859Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3015 sessionId:  describe result for acl check
2025-10-10T14:39:30.704899Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:30.704905Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:30.704907Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:30.704914Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602734923406587:2371] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:30.705519Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602734923406587:2371] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:30.708418Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602734923406587:2371] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:30.710824Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602734923406587:2371] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:30.710840Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602734923406587:2371] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:30.710844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602734923406587:2371] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:30.710853Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3015 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:30.711104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:30.716990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:30.717449Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:30.717462Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:30.717476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:30.717544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:30.717592Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602734141165892:6772]
2025-10-10T14:39:30.718237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:30.718582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:30.718625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:30.718943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:30.718990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:30.718997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:30.718999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:30.719000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:30.719001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:30.719002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:30.719004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:30.719005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:30.719006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:30.719007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:30.719008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:30.719010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:30.719011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:30.719016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:30.719031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:30.719036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:30.719040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:30.719045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:30.719049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:30.719053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:30.719059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:30.719063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:30.719067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:30.719071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:30.719074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:30.719076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:30.719082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:30.719091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:30.719098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:30.719104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:30.719109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:30.719119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:30.719124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:30.719134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:30.719138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:30.719143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:30.719150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:30.719155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:30.719160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:30.719165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:30.719173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:30.719179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:30.719187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:30.719192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:30.719196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:30.719202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:30.719210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:30.719216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:30.719220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:30.719230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:30.719234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:30.719239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:30.719283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:30.721741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:30.722053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:30.722066Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:30.722068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:30.722072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:30.722078Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3014 [2:7559602734141165892:6772]
2025-10-10T14:39:30.722089Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:30.722111Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:30.722118Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:30.722122Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:30.722124Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:30.722141Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:30.722154Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:30.722166Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:30.722218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:30.722225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:30.722226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:30.722229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:30.722292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:30.722299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:30.722310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:30.722321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:30.722341Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:30.722367Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602734141165886:6772]
2025-10-10T14:39:30.722375Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602734141165886:6772]
2025-10-10T14:39:30.722377Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602734141165886:6772]
2025-10-10T14:39:30.722391Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:30.722406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602734923406671:2371], now have 1 active actors on pipe
2025-10-10T14:39:30.722412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602734923406574:2438], now have 1 active actors on pipe
2025-10-10T14:39:30.722420Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:30.722429Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:30.722429Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:30.722433Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:30.722435Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:30.722437Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:30.722445Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3014
2025-10-10T14:39:30.722462Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602734141165886:6772]
2025-10-10T14:39:30.722459Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3014
2025-10-10T14:39:30.722474Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:30.722480Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:30.722509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:30.722514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:30.722553Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|781d985f-faee6872-da9b69cd-7997f6ab_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:30.722567Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:30.722571Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:30.722573Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:30.722587Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:30.722603Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:30.722626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:30.722859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:30.722871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:30.722893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:30.723004Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3015 partition: 0 MaxSeqNo: 40 sessionId: src_id|781d985f-faee6872-da9b69cd-7997f6ab_0
2025-10-10T14:39:30.723463Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94a4412c-5fbd851e-b3d977d-420897bb_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|781d985f-faee6872-da9b69cd-7997f6ab_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:30.726661Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|781d985f-faee6872-da9b69cd-7997f6ab_0] Write session: try to update token
2025-10-10T14:39:30.726681Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|781d985f-faee6872-da9b69cd-7997f6ab_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:30.741608Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3015 sessionId: src_id|781d985f-faee6872-da9b69cd-7997f6ab_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:30.742238Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:30.742257Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:30.742260Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:30.742262Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:30.742272Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602734141165886:6772]
2025-10-10T14:39:30.742281Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602734141165886:6772]
2025-10-10T14:39:30.742285Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602734141165886:6772]
2025-10-10T14:39:30.742334Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:30.742337Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:30.742341Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:30.742347Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:30.742348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:30.742351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:30.742510Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:30.744465Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:30.796862Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602734923406695:2572]
2025-10-10T14:39:30.797213Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 pipe creation result: OK TabletId: 72075186224037892 Generation: 3014, pipe: [1:7559602734923406695:2572]
2025-10-10T14:39:30.864629Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:30.864849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:30.864863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:30.864907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602734923406695:2572], now have 1 active actors on pipe
2025-10-10T14:39:30.865118Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:30.865121Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:30.865139Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:30.865168Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 13 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602734923406695:2572]
2025-10-10T14:39:30.865212Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3015 reason: error at write: Disconnected sessionId: src_id|781d985f-faee6872-da9b69cd-7997f6ab_0
2025-10-10T14:39:30.865463Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:30.865481Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3015 sessionId: src_id|781d985f-faee6872-da9b69cd-7997f6ab_0 is DEAD
2025-10-10T14:39:30.865686Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|781d985f-faee6872-da9b69cd-7997f6ab_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:30.865700Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|781d985f-faee6872-da9b69cd-7997f6ab_0] Write session will restart in 0.006351s
2025-10-10T14:39:30.865725Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|781d985f-faee6872-da9b69cd-7997f6ab_0] Write session: Do CDS request
2025-10-10T14:39:30.865736Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|781d985f-faee6872-da9b69cd-7997f6ab_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:30.873003Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|781d985f-faee6872-da9b69cd-7997f6ab_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:30.873144Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:30.873172Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3016
2025-10-10T14:39:30.873344Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3016 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:30.873393Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3016 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:30.873408Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3016 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:30.873416Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:30.873913Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3016 sessionId:  describe result for acl check
2025-10-10T14:39:30.873962Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:30.873970Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:30.873972Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:30.873979Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602734923406744:2336] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:30.874554Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602734923406744:2336] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:30.876607Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602734923406744:2336] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:30.879462Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602734923406744:2336] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:30.879478Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602734923406744:2336] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:30.879482Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602734923406744:2336] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:30.879491Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3016 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:30.887070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:30.887854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:30.888098Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:30.888112Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:30.888125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:30.888182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:30.888230Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602734141166038:6735]
2025-10-10T14:39:30.888897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:30.889288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:30.889368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:30.889765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:30.889844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:30.889851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:30.889852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:30.889854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:30.889855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:30.889857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:30.889858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:30.889859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:30.889861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:30.889862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:30.889865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:30.889867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:30.889868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:30.889875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:30.889888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:30.889893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:30.889897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:30.889901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:30.889905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:30.889909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:30.889914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:30.889918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:30.889925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:30.889928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:30.889932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:30.889936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:30.889945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:30.889955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:30.889962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:30.889968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:30.889973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:30.889980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:30.889985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:30.889993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:30.889999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:30.890005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:30.890009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:30.890015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:30.890025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:30.890031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:30.890036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:30.890045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:30.890050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:30.890060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:30.890065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:30.890071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:30.890078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:30.890084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:30.890097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:30.890103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:30.890108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:30.890114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:30.890159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:30.892731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:30.893774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:30.893789Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:30.893792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:30.893796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:30.893803Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3015 [2:7559602734141166038:6735]
2025-10-10T14:39:30.893818Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:30.893841Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:30.893851Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:30.893855Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:30.893860Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:30.893879Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:30.893892Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:30.893900Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:30.893964Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:30.893974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:30.893975Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:30.893978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:30.894055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:30.894063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:30.894076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:30.894093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:30.894113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:30.894141Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602734141166033:6735]
2025-10-10T14:39:30.894143Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602734141166033:6735]
2025-10-10T14:39:30.894145Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602734141166033:6735]
2025-10-10T14:39:30.894160Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:30.894166Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:30.894169Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:30.894170Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:30.894177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602734923406822:2336], now have 1 active actors on pipe
2025-10-10T14:39:30.894181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602734923406729:2438], now have 1 active actors on pipe
2025-10-10T14:39:30.894190Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:30.894209Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:30.894212Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:30.894248Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602734141166033:6735]
2025-10-10T14:39:30.894255Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:30.894260Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:30.894509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:30.894515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:30.894547Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f231f43d-87d974f5-a28bfe7-78093f1c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:30.894555Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:30.894560Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:30.894562Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:30.894574Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:30.894585Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:30.894599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:30.894785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:30.894797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:30.894821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:30.895404Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|781d985f-faee6872-da9b69cd-7997f6ab_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|f231f43d-87d974f5-a28bfe7-78093f1c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:30.894241Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3015
2025-10-10T14:39:30.894470Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3015
2025-10-10T14:39:30.894947Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3016 partition: 0 MaxSeqNo: 40 sessionId: src_id|f231f43d-87d974f5-a28bfe7-78093f1c_0
2025-10-10T14:39:30.898470Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f231f43d-87d974f5-a28bfe7-78093f1c_0] Write session: try to update token
2025-10-10T14:39:30.898492Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f231f43d-87d974f5-a28bfe7-78093f1c_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:30.906042Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:39:30.906061Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:30.906073Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602734141166033:6735]
2025-10-10T14:39:30.906123Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:39:30.906126Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:39:30.906297Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:39:30.906438Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:30.906571Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:30.906708Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:30.906903Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:39:30.906947Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:39:30.913945Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3016 sessionId: src_id|f231f43d-87d974f5-a28bfe7-78093f1c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:30.916973Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:30.917371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:30.917393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:30.917434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:39:30.917521Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:39:30.924834Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:30.924853Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:30.924856Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:30.924858Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:30.924870Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602734141166033:6735]
2025-10-10T14:39:30.924874Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602734141166033:6735]
2025-10-10T14:39:30.924881Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602734141166033:6735]
2025-10-10T14:39:30.924933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:30.924941Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:30.924944Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:30.924960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:30.924968Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:30.924972Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:30.925125Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:30.965265Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602734923406839:2572]
2025-10-10T14:39:30.965646Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 pipe creation result: OK TabletId: 72075186224037892 Generation: 3015, pipe: [1:7559602734923406839:2572]
2025-10-10T14:39:31.043620Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:31.052877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:31.052907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:31.053122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:31.053196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:31.053269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:31.053386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:31.053674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:31.053688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:31.053782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:31.053851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:31.053924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:31.053994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:31.054040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:31.054047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:31.054122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:31.054186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:31.054253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:31.054322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:31.054374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:31.054389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:31.054459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:31.054528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:31.054597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:31.054667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:31.054714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:31.054722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:31.054788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:31.054856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:31.054927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:31.054998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:31.055043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:31.055055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:31.055128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:31.055201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:31.055270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:31.055337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:31.055384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:31.055387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:31.055460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:31.055525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:31.055602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:31.055672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:31.055721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:31.055732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:31.055804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:31.055876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:31.055946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:31.056014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:31.056064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:31.056072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:31.056141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:31.056205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:31.056272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:31.056342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:31.056389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:31.056397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:31.056467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:31.056531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:31.056597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:31.056668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:31.056716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:31.056724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:31.056793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602734923406839:2572], now have 1 active actors on pipe
2025-10-10T14:39:31.057177Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:31.057202Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:31.057218Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:31.057237Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3016 reason: error at write: Disconnected sessionId: src_id|f231f43d-87d974f5-a28bfe7-78093f1c_0
2025-10-10T14:39:31.057299Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 14 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602734923406839:2572]
2025-10-10T14:39:31.057590Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3016 sessionId: src_id|f231f43d-87d974f5-a28bfe7-78093f1c_0 is DEAD
2025-10-10T14:39:31.057733Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f231f43d-87d974f5-a28bfe7-78093f1c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:31.057744Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f231f43d-87d974f5-a28bfe7-78093f1c_0] Write session will restart in 0.007070s
2025-10-10T14:39:31.057770Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f231f43d-87d974f5-a28bfe7-78093f1c_0] Write session: Do CDS request
2025-10-10T14:39:31.057776Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f231f43d-87d974f5-a28bfe7-78093f1c_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:31.057978Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:31.065949Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f231f43d-87d974f5-a28bfe7-78093f1c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:31.066053Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:31.066082Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3017
2025-10-10T14:39:31.066239Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3017 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:31.066284Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3017 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:31.066294Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3017 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:31.066298Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:31.066721Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3017 sessionId:  describe result for acl check
2025-10-10T14:39:31.066764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:31.066773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:31.066775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:31.066781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602739218374153:2318] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:31.067369Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602739218374153:2318] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:31.070628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602739218374153:2318] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:31.072842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:31.077573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:31.077720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602739218374153:2318] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:31.077736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602739218374153:2318] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:31.077740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602739218374153:2318] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:31.077749Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3017 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:31.077816Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:31.077829Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:31.077842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:31.077900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:31.077945Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602738436133441:6730]
2025-10-10T14:39:31.078621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:31.078906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:31.078954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:31.079292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:31.079357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:31.079363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:31.079364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:31.079365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:31.079367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:31.079368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:31.079369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:31.079370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:31.079371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:31.079373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:31.079374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:31.079375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:31.079376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:31.079382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:31.079397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:31.079401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:31.079405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:31.079409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:31.079414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:31.079418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:31.079422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:31.079427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:31.079432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:31.079436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:31.079440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:31.079443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:31.079452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:31.079460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:31.079466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:31.079472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:31.079477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:31.079483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:31.079487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:31.079498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:31.079503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:31.079509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:31.079514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:31.079519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:31.079523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:31.079535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:31.079540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:31.079546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:31.079551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:31.079556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:31.079563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:31.079569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:31.079573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:31.079578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:31.079585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:31.079590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:31.079597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:31.079604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:31.079645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:31.082258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:31.082971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:31.082985Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:31.082988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:31.082992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:31.082999Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3016 [2:7559602738436133441:6730]
2025-10-10T14:39:31.083024Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:31.083041Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:31.083051Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:31.083055Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:31.083058Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:31.083076Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:31.083084Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:31.083092Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:31.083147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:31.083154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:31.083158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:31.083160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:31.083228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:31.083235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:31.083246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:31.083258Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:31.083275Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:31.083301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602739218374138:2438], now have 1 active actors on pipe
2025-10-10T14:39:31.083308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602739218374238:2318], now have 1 active actors on pipe
2025-10-10T14:39:31.083316Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602738436133436:6730]
2025-10-10T14:39:31.083323Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602738436133436:6730]
2025-10-10T14:39:31.083325Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602738436133436:6730]
2025-10-10T14:39:31.083340Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:31.083354Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:31.083362Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:31.083366Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:31.083369Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:31.083378Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:31.083382Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:31.083405Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602738436133436:6730]
2025-10-10T14:39:31.083411Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:31.083387Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3016
2025-10-10T14:39:31.083410Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3016
2025-10-10T14:39:31.083426Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:31.083445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:31.083450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:31.083489Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b0663aa2-5539e05c-ba3f4a43-a9b2cfca_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:31.083505Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:31.083509Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:31.083511Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:31.083522Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:31.083531Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:31.083545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:31.083730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:31.083742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:31.083765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:31.083898Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3017 partition: 0 MaxSeqNo: 40 sessionId: src_id|b0663aa2-5539e05c-ba3f4a43-a9b2cfca_0
2025-10-10T14:39:31.084355Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f231f43d-87d974f5-a28bfe7-78093f1c_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|b0663aa2-5539e05c-ba3f4a43-a9b2cfca_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:31.087271Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b0663aa2-5539e05c-ba3f4a43-a9b2cfca_0] Write session: try to update token
2025-10-10T14:39:31.087289Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b0663aa2-5539e05c-ba3f4a43-a9b2cfca_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:31.101543Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3017 sessionId: src_id|b0663aa2-5539e05c-ba3f4a43-a9b2cfca_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:31.103844Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:31.103861Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:31.103864Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:31.103867Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:31.103877Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602738436133436:6730]
2025-10-10T14:39:31.103882Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602738436133436:6730]
2025-10-10T14:39:31.103886Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602738436133436:6730]
2025-10-10T14:39:31.103937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:31.103940Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:31.103949Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:31.103952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:31.103955Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:31.103955Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:31.104089Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:31.104262Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:31.157711Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602739218374250:2572]
2025-10-10T14:39:31.157984Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 pipe creation result: OK TabletId: 72075186224037892 Generation: 3016, pipe: [1:7559602739218374250:2572]
2025-10-10T14:39:31.226919Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:31.227653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:31.227669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:31.227717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602739218374250:2572], now have 1 active actors on pipe
2025-10-10T14:39:31.227959Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:31.227997Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:31.228016Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 15 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602739218374250:2572]
2025-10-10T14:39:31.228059Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:31.228063Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:31.228143Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3017 reason: error at write: Disconnected sessionId: src_id|b0663aa2-5539e05c-ba3f4a43-a9b2cfca_0
2025-10-10T14:39:31.228392Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3017 sessionId: src_id|b0663aa2-5539e05c-ba3f4a43-a9b2cfca_0 is DEAD
2025-10-10T14:39:31.228559Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0663aa2-5539e05c-ba3f4a43-a9b2cfca_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:31.228572Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0663aa2-5539e05c-ba3f4a43-a9b2cfca_0] Write session will restart in 0.008064s
2025-10-10T14:39:31.228599Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0663aa2-5539e05c-ba3f4a43-a9b2cfca_0] Write session: Do CDS request
2025-10-10T14:39:31.228606Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0663aa2-5539e05c-ba3f4a43-a9b2cfca_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:31.237952Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b0663aa2-5539e05c-ba3f4a43-a9b2cfca_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:31.238028Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:31.238044Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3018
2025-10-10T14:39:31.238195Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3018 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:31.238229Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3018 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:31.238235Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3018 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:31.238239Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:31.238699Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3018 sessionId:  describe result for acl check
2025-10-10T14:39:31.238741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:31.238749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:31.238751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:31.238758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602739218374292:2304] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:31.239402Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602739218374292:2304] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:31.241618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602739218374292:2304] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:31.248223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:31.248429Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602739218374292:2304] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:31.248448Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602739218374292:2304] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:31.248452Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602739218374292:2304] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:31.248462Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3018 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:31.248833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:31.249118Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:31.249130Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:31.249144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:31.249205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:31.249254Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602738436133553:6726]
2025-10-10T14:39:31.249926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:31.250249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:31.250303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:31.250656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:31.250724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:31.250725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:31.250727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:31.250728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:31.250730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:31.250731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:31.250733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:31.250734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:31.250735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:31.250737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:31.250738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:31.250739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:31.250740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:31.250746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:31.250760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:31.250765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:31.250769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:31.250773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:31.250777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:31.250781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:31.250785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:31.250789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:31.250793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:31.250796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:31.250800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:31.250803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:31.250812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:31.250821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:31.250827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:31.250832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:31.250841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:31.250846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:31.250850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:31.250855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:31.250859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:31.250864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:31.250869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:31.250874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:31.250878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:31.250883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:31.250888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:31.250893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:31.250897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:31.250904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:31.250908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:31.250913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:31.250917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:31.250922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:31.250926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:31.250932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:31.250937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:31.250942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:31.250982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:31.253569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:31.254430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:31.254442Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:31.254446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:31.254450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:31.254456Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3017 [2:7559602738436133553:6726]
2025-10-10T14:39:31.254469Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:31.254487Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:31.254491Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:31.254497Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:31.254499Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:31.254516Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:31.254524Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:31.254532Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:31.254595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:31.254597Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:31.254599Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:31.254602Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:31.254672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:31.254680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:31.254692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:31.254710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:31.254734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:31.254762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602739218374353:2304], now have 1 active actors on pipe
2025-10-10T14:39:31.254770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602739218374251:2438], now have 1 active actors on pipe
2025-10-10T14:39:31.254779Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602738436133547:6726]
2025-10-10T14:39:31.254781Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602738436133547:6726]
2025-10-10T14:39:31.254783Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602738436133547:6726]
2025-10-10T14:39:31.254798Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:31.254817Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:31.254820Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:31.254824Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:31.254827Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:31.254839Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:31.254842Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:31.254825Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3017
2025-10-10T14:39:31.254826Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3017
2025-10-10T14:39:31.254869Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602738436133547:6726]
2025-10-10T14:39:31.254879Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:31.254882Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:31.254914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:31.254924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:31.254965Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|61c97655-e401d985-6ed69934-4a054b0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:31.254978Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:31.254982Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:31.254984Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:31.254995Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:31.255007Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:31.255024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:31.255210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:31.255224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:31.255249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:31.255371Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3018 partition: 0 MaxSeqNo: 40 sessionId: src_id|61c97655-e401d985-6ed69934-4a054b0_0
2025-10-10T14:39:31.255818Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0663aa2-5539e05c-ba3f4a43-a9b2cfca_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|61c97655-e401d985-6ed69934-4a054b0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:31.258595Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61c97655-e401d985-6ed69934-4a054b0_0] Write session: try to update token
2025-10-10T14:39:31.258613Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61c97655-e401d985-6ed69934-4a054b0_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:31.276475Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:31.276501Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:31.276505Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:31.276508Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:31.276519Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602738436133547:6726]
2025-10-10T14:39:31.276527Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602738436133547:6726]
2025-10-10T14:39:31.276531Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602738436133547:6726]
2025-10-10T14:39:31.276586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:31.276586Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:31.276595Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:31.276598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:31.276599Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:31.276601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:31.276751Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:31.277625Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3018 sessionId: src_id|61c97655-e401d985-6ed69934-4a054b0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:31.280196Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:31.328214Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602739218374366:2572]
2025-10-10T14:39:31.328575Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 pipe creation result: OK TabletId: 72075186224037892 Generation: 3017, pipe: [1:7559602739218374366:2572]
2025-10-10T14:39:31.397571Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:31.398229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:31.398240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:31.398290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602739218374366:2572], now have 1 active actors on pipe
2025-10-10T14:39:31.398564Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:31.399176Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61c97655-e401d985-6ed69934-4a054b0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:31.399198Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61c97655-e401d985-6ed69934-4a054b0_0] Write session will restart in 0.008748s
2025-10-10T14:39:31.399225Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61c97655-e401d985-6ed69934-4a054b0_0] Write session: Do CDS request
2025-10-10T14:39:31.399233Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61c97655-e401d985-6ed69934-4a054b0_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:31.398693Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 16 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602739218374366:2572]
2025-10-10T14:39:31.398735Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:31.398738Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:31.398800Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3018 reason: error at write: Disconnected sessionId: src_id|61c97655-e401d985-6ed69934-4a054b0_0
2025-10-10T14:39:31.399012Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3018 sessionId: src_id|61c97655-e401d985-6ed69934-4a054b0_0 is DEAD
2025-10-10T14:39:31.399165Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:31.408968Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61c97655-e401d985-6ed69934-4a054b0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:31.411838Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:31.411857Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3019
2025-10-10T14:39:31.412075Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3019 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:31.412123Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3019 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:31.412130Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3019 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:31.412135Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:31.412585Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3019 sessionId:  describe result for acl check
2025-10-10T14:39:31.412617Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:31.412618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:31.412620Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:31.412628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602739218374387:2059] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:31.413293Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602739218374387:2059] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:31.417775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602739218374387:2059] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:31.430250Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602739218374387:2059] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:31.430269Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602739218374387:2059] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:31.430274Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602739218374387:2059] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:31.430285Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3019 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:31.430622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:31.432884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:31.433198Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:31.433216Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:31.433231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:31.433306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:31.433379Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602738436133665:6707]
2025-10-10T14:39:31.434084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:31.437353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:31.437447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:31.437860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:31.437948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:31.437957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:31.437959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:31.437960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:31.437962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:31.437963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:31.437965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:31.437967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:31.437968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:31.437970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:31.437972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:31.437973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:31.437974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:31.437983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:31.437998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:31.438003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:31.438008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:31.438012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:31.438017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:31.438022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:31.438026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:31.438030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:31.438035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:31.438040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:31.438044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:31.438048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:31.438058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:31.438069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:31.438076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:31.438089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:31.438094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:31.438101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:31.438106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:31.438118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:31.438124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:31.438136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:31.438143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:31.438154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:31.438159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:31.438171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:31.438176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:31.438189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:31.438195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:31.438201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:31.438206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:31.438217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:31.438226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:31.438236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:31.438241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:31.438252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:31.438257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:31.438264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:31.438314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:31.446665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:31.447724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:31.447745Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:31.447748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:31.447753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:31.447765Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3018 [2:7559602738436133665:6707]
2025-10-10T14:39:31.447782Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:31.447807Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:31.447817Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:31.447821Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:31.447824Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:31.447846Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:31.447854Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:31.447870Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:31.447946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:31.447960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:31.447962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:31.447965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:31.448197Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3018
2025-10-10T14:39:31.448205Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3018
2025-10-10T14:39:31.448055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:31.448066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:31.448084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:31.448097Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:31.448116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:31.448142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602739218374370:2438], now have 1 active actors on pipe
2025-10-10T14:39:31.448146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602739218374472:2059], now have 1 active actors on pipe
2025-10-10T14:39:31.448156Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602738436133658:6707]
2025-10-10T14:39:31.448158Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602738436133658:6707]
2025-10-10T14:39:31.448161Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602738436133658:6707]
2025-10-10T14:39:31.448177Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:31.448198Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:31.448200Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:31.448203Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:31.448207Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:31.448217Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:31.448221Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:31.448267Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602738436133658:6707]
2025-10-10T14:39:31.448277Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:31.448287Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:31.448514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:31.448532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:31.448571Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3cac69b7-901ba5fb-8e83f189-987d45d6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:31.448586Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:31.448591Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:31.448593Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:31.448606Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:31.448625Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:31.448651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:31.448905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:31.448918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:31.448937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:31.449074Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3019 partition: 0 MaxSeqNo: 40 sessionId: src_id|3cac69b7-901ba5fb-8e83f189-987d45d6_0
2025-10-10T14:39:31.449540Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61c97655-e401d985-6ed69934-4a054b0_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|3cac69b7-901ba5fb-8e83f189-987d45d6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:31.452312Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3cac69b7-901ba5fb-8e83f189-987d45d6_0] Write session: try to update token
2025-10-10T14:39:31.452331Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3cac69b7-901ba5fb-8e83f189-987d45d6_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:31.474964Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3019 sessionId: src_id|3cac69b7-901ba5fb-8e83f189-987d45d6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:31.478364Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:31.479641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:31.479670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:31.479699Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:31.479703Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:31.479707Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:31.479710Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:31.479721Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602738436133658:6707]
2025-10-10T14:39:31.479727Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602738436133658:6707]
2025-10-10T14:39:31.479732Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602738436133658:6707]
2025-10-10T14:39:31.479779Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:31.479786Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:31.479790Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:31.479813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:31.479825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:31.479828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:31.479994Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:31.498721Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602739218374485:2572]
2025-10-10T14:39:31.499028Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 pipe creation result: OK TabletId: 72075186224037892 Generation: 3018, pipe: [1:7559602739218374485:2572]
2025-10-10T14:39:31.598537Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:31.599070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:39:31.599137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602739218374485:2572], now have 1 active actors on pipe
2025-10-10T14:39:31.599183Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:39:31.599754Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 17 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602739218374485:2572]
2025-10-10T14:39:31.600071Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:31.610296Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:31.610310Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:31.610335Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3019 reason: error at write: Disconnected sessionId: src_id|3cac69b7-901ba5fb-8e83f189-987d45d6_0
2025-10-10T14:39:31.610514Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3019 sessionId: src_id|3cac69b7-901ba5fb-8e83f189-987d45d6_0 is DEAD
2025-10-10T14:39:31.610663Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3cac69b7-901ba5fb-8e83f189-987d45d6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:31.610676Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3cac69b7-901ba5fb-8e83f189-987d45d6_0] Write session will restart in 0.008323s
2025-10-10T14:39:31.610702Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3cac69b7-901ba5fb-8e83f189-987d45d6_0] Write session: Do CDS request
2025-10-10T14:39:31.610709Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3cac69b7-901ba5fb-8e83f189-987d45d6_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:31.619908Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3cac69b7-901ba5fb-8e83f189-987d45d6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:31.620022Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:31.620038Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3020
2025-10-10T14:39:31.620169Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3020 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:31.620204Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3020 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:31.620215Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3020 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:31.620222Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:31.620695Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3020 sessionId:  describe result for acl check
2025-10-10T14:39:31.620734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:31.620742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:31.620743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:31.620750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602739218374558:10496] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:31.621244Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602739218374558:10496] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:31.624267Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602739218374558:10496] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:31.627414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:31.627699Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602739218374558:10496] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:31.627717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602739218374558:10496] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:31.627721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602739218374558:10496] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:31.627731Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3020 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:31.628023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:31.628258Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:31.628272Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:31.628287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:31.628360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:31.628414Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602738436133788:6708]
2025-10-10T14:39:31.629067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:31.629395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:31.629442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:31.629770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:31.629824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:31.629831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:31.629832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:31.629834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:31.629835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:31.629837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:31.629838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:31.629840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:31.629841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:31.629842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:31.629844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:31.629845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:31.629846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:31.629852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:31.629866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:31.629870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:31.629874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:31.629878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:31.629882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:31.629886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:31.629890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:31.629894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:31.629899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:31.629903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:31.629907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:31.629911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:31.629918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:31.629928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:31.629934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:31.629939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:31.629945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:31.629951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:31.629955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:31.629961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:31.629971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:31.629976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:31.629985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:31.629991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:31.630000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:31.630005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:31.630010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:31.630015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:31.630020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:31.630025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:31.630030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:31.630036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:31.630041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:31.630051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:31.630055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:31.630065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:31.630071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:31.630081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:31.630120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:31.632837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:31.633181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:31.633193Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:31.633196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:31.633200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:31.633207Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3019 [2:7559602738436133788:6708]
2025-10-10T14:39:31.633221Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:31.633239Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:31.633245Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:31.633249Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:31.633251Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:31.633268Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:31.633277Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:31.633290Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:31.633370Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:31.633378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:31.633380Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:31.633383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:31.633454Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:31.633462Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:31.633475Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:31.633493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:31.633512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:31.633544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602739218374590:10496], now have 1 active actors on pipe
2025-10-10T14:39:31.633553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602739218374487:2438], now have 1 active actors on pipe
2025-10-10T14:39:31.633561Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602738436133782:6708]
2025-10-10T14:39:31.633563Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602738436133782:6708]
2025-10-10T14:39:31.633565Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602738436133782:6708]
2025-10-10T14:39:31.633578Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:31.633596Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:31.633599Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:31.633599Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:31.633601Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:31.633615Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:31.633620Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:31.633643Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602738436133782:6708]
2025-10-10T14:39:31.633654Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:31.633673Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:31.633665Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3019
2025-10-10T14:39:31.633666Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3019
2025-10-10T14:39:31.633724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:31.633734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:31.633772Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fd4497aa-54ca73e4-aa8acf4c-8da53797_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:31.633788Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:31.633792Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:31.633795Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:31.633806Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:31.633818Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:31.633834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:31.633979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:31.633987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:31.634002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:31.634079Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3020 partition: 0 MaxSeqNo: 40 sessionId: src_id|fd4497aa-54ca73e4-aa8acf4c-8da53797_0
2025-10-10T14:39:31.634512Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3cac69b7-901ba5fb-8e83f189-987d45d6_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|fd4497aa-54ca73e4-aa8acf4c-8da53797_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:31.637322Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fd4497aa-54ca73e4-aa8acf4c-8da53797_0] Write session: try to update token
2025-10-10T14:39:31.637358Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fd4497aa-54ca73e4-aa8acf4c-8da53797_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:31.652358Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3020 sessionId: src_id|fd4497aa-54ca73e4-aa8acf4c-8da53797_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:31.654733Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:39:31.654758Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:31.654772Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602738436133782:6708]
2025-10-10T14:39:31.654831Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:39:31.654843Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:39:31.655020Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:39:31.655149Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:31.655171Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:31.655321Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:31.655472Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:31.655666Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:39:31.655734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:31.655748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:31.655774Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:39:31.655817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:39:31.655907Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:39:31.665658Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:31.665680Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:31.665683Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:31.665685Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:31.665697Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602738436133782:6708]
2025-10-10T14:39:31.665702Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602738436133782:6708]
2025-10-10T14:39:31.665705Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602738436133782:6708]
2025-10-10T14:39:31.665753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:31.665768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:31.665771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:31.665771Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:31.665777Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:31.665781Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:31.665903Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:31.699919Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602739218374602:2572]
2025-10-10T14:39:31.700167Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 pipe creation result: OK TabletId: 72075186224037892 Generation: 3019, pipe: [1:7559602739218374602:2572]
2025-10-10T14:39:31.783867Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:31.792841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:31.792872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:31.793069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:31.793136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:31.793202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:31.793274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:31.793322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:31.793355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:31.793428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:31.793493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:31.793559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:31.793629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:31.793676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:31.793684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:31.793754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:31.793820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:31.793891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:31.793966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:31.794014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:31.794021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:31.794093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:31.794161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:31.794234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:31.794300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:31.794346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:31.794355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:31.794422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:31.794490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:31.794556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:31.794627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:31.794683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:31.794692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:31.794761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:31.794823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:31.794892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:31.794960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:31.795008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:31.795018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:31.795085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:31.795147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:31.795214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:31.795275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:31.795319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:31.795330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:31.795396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:31.795462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:31.795528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:31.795591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:31.795638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:31.795641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:31.795709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:31.795769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:31.795836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:31.795905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:31.795952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:31.795961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:31.796029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:31.796094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:31.796159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:31.796228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:31.796273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:31.796281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:31.796342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602739218374602:2572], now have 1 active actors on pipe
2025-10-10T14:39:31.796621Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:31.796642Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:31.796656Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 18 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602739218374602:2572]
2025-10-10T14:39:31.796679Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3020 reason: error at write: Disconnected sessionId: src_id|fd4497aa-54ca73e4-aa8acf4c-8da53797_0
2025-10-10T14:39:31.796699Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:31.796980Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3020 sessionId: src_id|fd4497aa-54ca73e4-aa8acf4c-8da53797_0 is DEAD
2025-10-10T14:39:31.797133Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd4497aa-54ca73e4-aa8acf4c-8da53797_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:31.797157Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd4497aa-54ca73e4-aa8acf4c-8da53797_0] Write session will restart in 0.006540s
2025-10-10T14:39:31.797185Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd4497aa-54ca73e4-aa8acf4c-8da53797_0] Write session: Do CDS request
2025-10-10T14:39:31.797192Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd4497aa-54ca73e4-aa8acf4c-8da53797_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:31.797683Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:31.805100Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fd4497aa-54ca73e4-aa8acf4c-8da53797_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:31.805105Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:31.805120Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3021
2025-10-10T14:39:31.805379Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3021 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:31.805421Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3021 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:31.805431Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3021 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:31.805435Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:31.805939Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3021 sessionId:  describe result for acl check
2025-10-10T14:39:31.805988Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:31.805996Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:31.805998Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:31.806005Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602739218374632:10491] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:31.806626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602739218374632:10491] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:31.809469Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602739218374632:10491] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:31.812826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602739218374632:10491] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:31.812842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602739218374632:10491] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:31.812846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602739218374632:10491] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:31.812855Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3021 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:31.814318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:31.819747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:31.820015Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:31.820027Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:31.820040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:31.820106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:31.820150Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602738436133901:6703]
2025-10-10T14:39:31.820717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:31.821074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:31.821123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:31.821458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:31.821534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:31.821540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:31.821542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:31.821543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:31.821545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:31.821547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:31.821548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:31.821550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:31.821551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:31.821552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:31.821554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:31.821555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:31.821557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:31.821562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:31.821576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:31.821579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:31.821584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:31.821587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:31.821591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:31.821594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:31.821598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:31.821602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:31.821606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:31.821610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:31.821613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:31.821617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:31.821628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:31.821636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:31.821649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:31.821654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:31.821665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:31.821669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:31.821673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:31.821678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:31.821683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:31.821688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:31.821693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:31.821697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:31.821702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:31.821707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:31.821716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:31.821721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:31.821726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:31.821736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:31.821739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:31.821745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:31.821756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:31.821761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:31.821764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:31.821769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:31.821774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:31.821778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:31.821821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:31.824414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:31.825135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:31.825159Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:31.825161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:31.825166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:31.825172Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3020 [2:7559602738436133901:6703]
2025-10-10T14:39:31.825185Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:31.825204Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:31.825213Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:31.825216Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:31.825220Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:31.825240Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:31.825253Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:31.825264Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:31.825350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:31.825358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:31.825360Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:31.825363Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:31.825441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:31.825450Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:31.825462Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:31.825475Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:31.825495Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:31.825517Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602738436133896:6703]
2025-10-10T14:39:31.825524Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602738436133896:6703]
2025-10-10T14:39:31.825527Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602738436133896:6703]
2025-10-10T14:39:31.825537Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:31.825545Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:31.825548Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:31.825550Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:31.825556Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:31.825574Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:31.825582Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:31.825594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602739218374616:2438], now have 1 active actors on pipe
2025-10-10T14:39:31.825602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602739218374721:10491], now have 1 active actors on pipe
2025-10-10T14:39:31.825624Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602738436133896:6703]
2025-10-10T14:39:31.825637Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:31.825651Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3020
2025-10-10T14:39:31.825657Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3020
2025-10-10T14:39:31.825680Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:31.825799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:31.825813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:31.825867Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8f1f5701-666cf63b-41468a20-f8ce574_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:31.825881Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:31.825887Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:31.825890Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:31.825903Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:31.825922Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:31.825956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:31.826149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:31.826158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:31.826174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:31.826286Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3021 partition: 0 MaxSeqNo: 40 sessionId: src_id|8f1f5701-666cf63b-41468a20-f8ce574_0
2025-10-10T14:39:31.826738Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd4497aa-54ca73e4-aa8acf4c-8da53797_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|8f1f5701-666cf63b-41468a20-f8ce574_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:31.829637Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8f1f5701-666cf63b-41468a20-f8ce574_0] Write session: try to update token
2025-10-10T14:39:31.829657Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8f1f5701-666cf63b-41468a20-f8ce574_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:31.844810Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3021 sessionId: src_id|8f1f5701-666cf63b-41468a20-f8ce574_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:31.845597Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:31.845619Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:31.845623Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:31.845625Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:31.845634Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602738436133896:6703]
2025-10-10T14:39:31.845639Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602738436133896:6703]
2025-10-10T14:39:31.845643Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602738436133896:6703]
2025-10-10T14:39:31.845696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:31.845714Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:31.845721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:31.845761Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:31.845779Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:31.845783Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:31.845871Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:31.847600Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:31.897057Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602739218374755:2572]
2025-10-10T14:39:31.897416Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 pipe creation result: OK TabletId: 72075186224037892 Generation: 3020, pipe: [1:7559602739218374755:2572]
2025-10-10T14:39:31.963793Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:31.964098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:31.964119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:31.964167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602739218374755:2572], now have 1 active actors on pipe
2025-10-10T14:39:31.964578Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:31.964592Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:31.964659Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3021 reason: error at write: Disconnected sessionId: src_id|8f1f5701-666cf63b-41468a20-f8ce574_0
2025-10-10T14:39:31.964685Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:31.964865Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 19 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602739218374755:2572]
2025-10-10T14:39:31.964873Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3021 sessionId: src_id|8f1f5701-666cf63b-41468a20-f8ce574_0 is DEAD
2025-10-10T14:39:31.964893Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:31.965087Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f1f5701-666cf63b-41468a20-f8ce574_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:31.965099Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f1f5701-666cf63b-41468a20-f8ce574_0] Write session will restart in 0.005749s
2025-10-10T14:39:31.965124Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f1f5701-666cf63b-41468a20-f8ce574_0] Write session: Do CDS request
2025-10-10T14:39:31.965134Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f1f5701-666cf63b-41468a20-f8ce574_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:31.971992Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8f1f5701-666cf63b-41468a20-f8ce574_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:31.972086Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:31.972104Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3022
2025-10-10T14:39:31.972257Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3022 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:31.972302Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3022 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:31.972313Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3022 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:31.972317Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:31.972831Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3022 sessionId:  describe result for acl check
2025-10-10T14:39:31.972871Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:31.972875Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:31.972877Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:31.972883Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602739218374784:10474] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:31.973724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602739218374784:10474] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:31.975881Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602739218374784:10474] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:31.979211Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602739218374784:10474] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:31.979225Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602739218374784:10474] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:31.979229Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602739218374784:10474] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:31.979239Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3022 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:31.985555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:31.986190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:31.986487Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:31.986507Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:31.986524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:31.986612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:31.986660Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602738436134052:6680]
2025-10-10T14:39:31.987445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:31.987875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:31.987935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:31.988329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:31.988396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:31.988403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:31.988405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:31.988406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:31.988408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:31.988409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:31.988411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:31.988412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:31.988414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:31.988416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:31.988417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:31.988419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:31.988420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:31.988427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:31.988441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:31.988446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:31.988451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:31.988455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:31.988460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:31.988464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:31.988468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:31.988472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:31.988479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:31.988483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:31.988487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:31.988491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:31.988499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:31.988508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:31.988515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:31.988520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:31.988525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:31.988531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:31.988536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:31.988541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:31.988546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:31.988552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:31.988557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:31.988563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:31.988568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:31.988581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:31.988586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:31.988592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:31.988598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:31.988603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:31.988608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:31.988613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:31.988620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:31.988625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:31.988630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:31.988637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:31.988647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:31.988652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:31.988705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:31.991216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:31.992174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:31.992192Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:31.992194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:31.992199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:31.992206Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3021 [2:7559602738436134052:6680]
2025-10-10T14:39:31.992221Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:31.992243Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:31.992246Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:31.992250Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:31.992253Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:31.992272Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:31.992290Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:31.992298Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:31.992367Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:31.992378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:31.992380Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:31.992382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:31.992453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:31.992462Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:31.992476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:31.992488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:31.992510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:31.992537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602739218374871:10474], now have 1 active actors on pipe
2025-10-10T14:39:31.992541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602739218374770:2438], now have 1 active actors on pipe
2025-10-10T14:39:31.992550Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602738436134047:6680]
2025-10-10T14:39:31.992557Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602738436134047:6680]
2025-10-10T14:39:31.992560Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602738436134047:6680]
2025-10-10T14:39:31.992573Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:31.992592Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:31.992606Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3021
2025-10-10T14:39:31.992608Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:31.992623Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3021
2025-10-10T14:39:31.992614Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:31.992617Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:31.992619Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:31.992621Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:31.992648Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602738436134047:6680]
2025-10-10T14:39:31.992651Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:31.992665Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:31.992691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:31.992696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:31.992748Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1675988a-67545f0d-e13773a0-1f09e065_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:31.992762Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:31.992768Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:31.992771Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:31.992783Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:31.992794Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:31.992813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:31.992971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:31.992997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:31.993026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:31.993156Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3022 partition: 0 MaxSeqNo: 40 sessionId: src_id|1675988a-67545f0d-e13773a0-1f09e065_0
2025-10-10T14:39:31.993649Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f1f5701-666cf63b-41468a20-f8ce574_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|1675988a-67545f0d-e13773a0-1f09e065_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:31.996550Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1675988a-67545f0d-e13773a0-1f09e065_0] Write session: try to update token
2025-10-10T14:39:31.996568Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1675988a-67545f0d-e13773a0-1f09e065_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:32.012297Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:32.012319Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:32.012323Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:32.012325Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:32.012335Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602738436134047:6680]
2025-10-10T14:39:32.012340Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602738436134047:6680]
2025-10-10T14:39:32.012345Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602738436134047:6680]
2025-10-10T14:39:32.012395Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:32.012395Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:32.012403Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:32.012408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:32.012410Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:32.012411Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:32.012553Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:32.014206Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3022 sessionId: src_id|1675988a-67545f0d-e13773a0-1f09e065_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:32.017059Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:32.064995Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602743513342180:2572]
2025-10-10T14:39:32.065298Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 pipe creation result: OK TabletId: 72075186224037892 Generation: 3021, pipe: [1:7559602743513342180:2572]
2025-10-10T14:39:32.130610Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:32.130964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:32.130987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:32.131053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602743513342180:2572], now have 1 active actors on pipe
2025-10-10T14:39:32.131336Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:32.131312Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:32.131315Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 20 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602743513342180:2572]
2025-10-10T14:39:32.131329Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:32.131346Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:32.131395Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3022 reason: error at write: Disconnected sessionId: src_id|1675988a-67545f0d-e13773a0-1f09e065_0
2025-10-10T14:39:32.131621Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3022 sessionId: src_id|1675988a-67545f0d-e13773a0-1f09e065_0 is DEAD
2025-10-10T14:39:32.131829Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1675988a-67545f0d-e13773a0-1f09e065_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:32.131841Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1675988a-67545f0d-e13773a0-1f09e065_0] Write session will restart in 0.006880s
2025-10-10T14:39:32.131867Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1675988a-67545f0d-e13773a0-1f09e065_0] Write session: Do CDS request
2025-10-10T14:39:32.131874Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1675988a-67545f0d-e13773a0-1f09e065_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:32.140039Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1675988a-67545f0d-e13773a0-1f09e065_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:32.140085Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:32.140117Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3023
2025-10-10T14:39:32.140287Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3023 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:32.140346Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3023 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:32.140358Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3023 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:32.140362Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:32.140876Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3023 sessionId:  describe result for acl check
2025-10-10T14:39:32.140917Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:32.140927Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:32.140942Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:32.140949Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602743513342198:10470] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:32.141542Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602743513342198:10470] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:32.144423Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602743513342198:10470] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:32.147219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:32.153112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:32.153407Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602743513342198:10470] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:32.153429Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602743513342198:10470] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:32.153434Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602743513342198:10470] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:32.153445Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3023 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:32.153431Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:32.153444Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:32.153458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:32.153520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:32.153564Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602742731101461:6684]
2025-10-10T14:39:32.154215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:32.154506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:32.154554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:32.154888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:32.154957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:32.154963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:32.154965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:32.154966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:32.154968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:32.154969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:32.154970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:32.154971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:32.154973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:32.154974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:32.154975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:32.154976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:32.154978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:32.154983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:32.154997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:32.155002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:32.155006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:32.155011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:32.155015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:32.155019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:32.155022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:32.155026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:32.155031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:32.155035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:32.155039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:32.155042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:32.155050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:32.155060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:32.155067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:32.155073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:32.155078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:32.155083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:32.155089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:32.155095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:32.155100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:32.155105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:32.155110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:32.155115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:32.155120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:32.155126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:32.155131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:32.155136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:32.155141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:32.155147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:32.155152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:32.155158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:32.155163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:32.155169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:32.155173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:32.155179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:32.155183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:32.155190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:32.155230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:32.157781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:32.158721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:32.158734Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:32.158737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:32.158741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:32.158748Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3022 [2:7559602742731101461:6684]
2025-10-10T14:39:32.158763Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:32.158783Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:32.158787Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:32.158790Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:32.158792Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:32.158810Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:32.158821Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:32.158830Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:32.158893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:32.158902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:32.158905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:32.158907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:32.158977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:32.158987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:32.159000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:32.159011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:32.159029Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:32.159052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602743513342182:2438], now have 1 active actors on pipe
2025-10-10T14:39:32.159062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602743513342289:10470], now have 1 active actors on pipe
2025-10-10T14:39:32.159070Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602742731101456:6684]
2025-10-10T14:39:32.159072Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602742731101456:6684]
2025-10-10T14:39:32.159074Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602742731101456:6684]
2025-10-10T14:39:32.159087Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:32.159102Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:32.159102Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:32.159105Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:32.159108Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:32.159118Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:32.159122Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:32.159147Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602742731101456:6684]
2025-10-10T14:39:32.159155Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:32.159139Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3022
2025-10-10T14:39:32.159162Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3022
2025-10-10T14:39:32.159172Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:32.159210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:32.159216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:32.159246Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ebfd446f-1998651e-2d0c0c0-607041d4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:32.159263Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:32.159268Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:32.159271Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:32.159283Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:32.159296Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:32.159312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:32.159501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:32.159516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:32.159541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:32.159676Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3023 partition: 0 MaxSeqNo: 40 sessionId: src_id|ebfd446f-1998651e-2d0c0c0-607041d4_0
2025-10-10T14:39:32.160086Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1675988a-67545f0d-e13773a0-1f09e065_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|ebfd446f-1998651e-2d0c0c0-607041d4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:32.163034Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ebfd446f-1998651e-2d0c0c0-607041d4_0] Write session: try to update token
2025-10-10T14:39:32.163054Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ebfd446f-1998651e-2d0c0c0-607041d4_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:32.178620Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:39:32.178645Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:32.178658Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602742731101456:6684]
2025-10-10T14:39:32.178717Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:39:32.178723Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:39:32.178914Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:39:32.179082Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:32.179239Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:32.179392Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:32.179433Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3023 sessionId: src_id|ebfd446f-1998651e-2d0c0c0-607041d4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:32.179599Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:39:32.179649Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:39:32.182390Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:32.182646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:32.182669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:32.182735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:39:32.182836Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:39:32.192468Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:32.192494Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:32.192498Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:32.192500Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:32.192512Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602742731101456:6684]
2025-10-10T14:39:32.192516Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602742731101456:6684]
2025-10-10T14:39:32.192520Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602742731101456:6684]
2025-10-10T14:39:32.192571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:32.192574Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:32.192579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:32.192582Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:32.192586Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:32.192590Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:32.192736Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:32.231356Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602743513342300:2572]
2025-10-10T14:39:32.231750Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 pipe creation result: OK TabletId: 72075186224037892 Generation: 3022, pipe: [1:7559602743513342300:2572]
2025-10-10T14:39:32.313407Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:32.322570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:32.322599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:32.322784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:32.322841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:32.322898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:32.322956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:32.322995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:32.323004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:32.323074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:32.323130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:32.323190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:32.323256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:32.323295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:32.323298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:32.323363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:32.323419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:32.323481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:32.323543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:32.323583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:32.323586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:32.323655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:32.323715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:32.323774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:32.323837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:32.323878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:32.323882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:32.323950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:32.324009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:32.324069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:32.324128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:32.324168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:32.324190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:32.324258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:32.324316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:32.324373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:32.324433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:32.324475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:32.324478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:32.324544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:32.324604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:32.324667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:32.324730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:32.324773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:32.324777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:32.324843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:32.324898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:32.324968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:32.325028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:32.325068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:32.325072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:32.325140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:32.325196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:32.325258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:32.325318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:32.326337Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:32.326359Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:32.326395Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3023 reason: error at write: Disconnected sessionId: src_id|ebfd446f-1998651e-2d0c0c0-607041d4_0
2025-10-10T14:39:32.326652Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3023 sessionId: src_id|ebfd446f-1998651e-2d0c0c0-607041d4_0 is DEAD
2025-10-10T14:39:32.326819Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ebfd446f-1998651e-2d0c0c0-607041d4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:32.326826Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ebfd446f-1998651e-2d0c0c0-607041d4_0] Write session will restart in 0.009552s
2025-10-10T14:39:32.326853Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ebfd446f-1998651e-2d0c0c0-607041d4_0] Write session: Do CDS request
2025-10-10T14:39:32.326859Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ebfd446f-1998651e-2d0c0c0-607041d4_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:32.326868Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:32.326915Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 21 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602743513342300:2572]
2025-10-10T14:39:32.325632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:32.325643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:32.325709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:32.325766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:32.325826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:32.325884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:32.325923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:32.325926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:32.325996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602743513342300:2572], now have 1 active actors on pipe
2025-10-10T14:39:32.327356Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:32.337873Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ebfd446f-1998651e-2d0c0c0-607041d4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:32.337984Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:32.338012Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3024
2025-10-10T14:39:32.338167Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3024 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:32.338228Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3024 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:32.338240Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3024 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:32.338245Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:32.338764Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3024 sessionId:  describe result for acl check
2025-10-10T14:39:32.338815Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:32.338822Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:32.338823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:32.338830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602743513342316:10462] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:32.339423Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602743513342316:10462] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:32.342609Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602743513342316:10462] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:32.347451Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602743513342316:10462] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:32.347467Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602743513342316:10462] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:32.347471Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602743513342316:10462] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:32.347480Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3024 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:32.348507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:32.349615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:32.349924Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:32.349934Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:32.349950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:32.350036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:32.350095Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602742731101579:6676]
2025-10-10T14:39:32.350821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:32.355441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:32.355524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:32.355929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:32.356002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:32.356003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:32.356004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:32.356005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:32.356007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:32.356008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:32.356010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:32.356011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:32.356013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:32.356014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:32.356015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:32.356017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:32.356018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:32.356026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:32.356040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:32.356045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:32.356049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:32.356052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:32.356057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:32.356060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:32.356064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:32.356068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:32.356072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:32.356076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:32.356080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:32.356083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:32.356093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:32.356102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:32.356108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:32.356114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:32.356119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:32.356124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:32.356129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:32.356134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:32.356140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:32.356145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:32.356150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:32.356155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:32.356160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:32.356166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:32.356170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:32.356176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:32.356181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:32.356186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:32.356191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:32.356199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:32.356204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:32.356210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:32.356215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:32.356221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:32.356226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:32.356231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:32.356274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:32.359004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:32.359700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:32.359707Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:32.359709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:32.359713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:32.359721Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3023 [2:7559602742731101579:6676]
2025-10-10T14:39:32.359735Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:32.359756Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:32.359760Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:32.360244Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3023
2025-10-10T14:39:32.360281Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3023
2025-10-10T14:39:32.359764Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:32.359766Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:32.359786Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:32.359796Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:32.359806Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:32.359876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:32.359878Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:32.359880Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:32.359883Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:32.359959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:32.359962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:32.359975Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:32.359986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:32.360002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:32.360024Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602742731101574:6676]
2025-10-10T14:39:32.360027Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602742731101574:6676]
2025-10-10T14:39:32.360029Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602742731101574:6676]
2025-10-10T14:39:32.360038Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:32.360052Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:32.360070Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:32.360073Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:32.360073Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:32.360077Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:32.360079Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:32.360103Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602742731101574:6676]
2025-10-10T14:39:32.360106Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:32.360114Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:32.360130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602743513342409:10462], now have 1 active actors on pipe
2025-10-10T14:39:32.360134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602743513342303:2438], now have 1 active actors on pipe
2025-10-10T14:39:32.360522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:32.360533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:32.360569Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5804e9bc-8f2bd15-161f61dc-f903b742_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:32.360578Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:32.360582Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:32.360585Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:32.360599Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:32.360611Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:32.360628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:32.360902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:32.360939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:32.360958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:32.361077Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3024 partition: 0 MaxSeqNo: 40 sessionId: src_id|5804e9bc-8f2bd15-161f61dc-f903b742_0
2025-10-10T14:39:32.361638Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ebfd446f-1998651e-2d0c0c0-607041d4_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|5804e9bc-8f2bd15-161f61dc-f903b742_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:32.364615Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5804e9bc-8f2bd15-161f61dc-f903b742_0] Write session: try to update token
2025-10-10T14:39:32.364634Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5804e9bc-8f2bd15-161f61dc-f903b742_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:32.374640Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:39:32.374665Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:32.374677Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602742731101574:6676]
2025-10-10T14:39:32.374736Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:39:32.374736Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:39:32.374927Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:39:32.375076Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:32.375230Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:32.375387Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:32.375766Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:39:32.375819Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:39:32.380763Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3024 sessionId: src_id|5804e9bc-8f2bd15-161f61dc-f903b742_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:32.383637Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:32.383916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:32.383943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:32.383996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:39:32.384105Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:39:32.391813Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:32.391836Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:32.391840Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:32.391842Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:32.391854Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602742731101574:6676]
2025-10-10T14:39:32.391858Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602742731101574:6676]
2025-10-10T14:39:32.391865Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602742731101574:6676]
2025-10-10T14:39:32.391920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:32.391925Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:32.391934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:32.391935Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:32.391937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:32.391939Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:32.392077Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:32.429428Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602743513342421:2572]
2025-10-10T14:39:32.429810Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 pipe creation result: OK TabletId: 72075186224037892 Generation: 3023, pipe: [1:7559602743513342421:2572]
2025-10-10T14:39:32.515869Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:32.524682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:32.524720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:32.524917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:32.525024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:32.525099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:32.525179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:32.525233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:32.525245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:32.525347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:32.525425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:32.525496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:32.525573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:32.525625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:32.525637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:32.525712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:32.525784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:32.525859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:32.525934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:32.525980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:32.525991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:32.526070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:32.526153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:32.526227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:32.526302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:32.526355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:32.526364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:32.526441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:32.526516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:32.526591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:32.526667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:32.526723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:32.526733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:32.526811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:32.526887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:32.526960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:32.527039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:32.527088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:32.527101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:32.527175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:32.527251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:32.527330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:32.527398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:32.527455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:32.527464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:32.527545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:32.527614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:32.527684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:32.527760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:32.527811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:32.527818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:32.527898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:32.527966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:32.528089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:32.528238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:32.528313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:32.528326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:32.528403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:32.528472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:32.528549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:32.528631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:32.528689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:32.528698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:32.528769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602743513342421:2572], now have 1 active actors on pipe
2025-10-10T14:39:32.529022Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:32.529096Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 22 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602743513342421:2572]
2025-10-10T14:39:32.529259Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:32.529268Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:32.529303Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3024 reason: error at write: Disconnected sessionId: src_id|5804e9bc-8f2bd15-161f61dc-f903b742_0
2025-10-10T14:39:32.529616Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3024 sessionId: src_id|5804e9bc-8f2bd15-161f61dc-f903b742_0 is DEAD
2025-10-10T14:39:32.529796Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5804e9bc-8f2bd15-161f61dc-f903b742_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:32.529808Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5804e9bc-8f2bd15-161f61dc-f903b742_0] Write session will restart in 0.009570s
2025-10-10T14:39:32.529835Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5804e9bc-8f2bd15-161f61dc-f903b742_0] Write session: Do CDS request
2025-10-10T14:39:32.529841Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5804e9bc-8f2bd15-161f61dc-f903b742_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:32.530369Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:32.541064Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5804e9bc-8f2bd15-161f61dc-f903b742_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:32.541074Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:32.541092Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3025
2025-10-10T14:39:32.541323Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3025 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:32.541379Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3025 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:32.541390Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3025 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:32.541395Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:32.542122Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3025 sessionId:  describe result for acl check
2025-10-10T14:39:32.542162Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:32.542165Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:32.542166Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:32.542174Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602743513342458:10456] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:32.542743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602743513342458:10456] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:32.546969Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602743513342458:10456] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:32.547579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:32.553371Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602743513342458:10456] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:32.553389Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602743513342458:10456] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:32.553393Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602743513342458:10456] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:32.553404Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3025 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:32.553598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:32.553846Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:32.553861Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:32.553875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:32.553938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:32.553988Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602742731101695:6672]
2025-10-10T14:39:32.554613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:32.555013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:32.555076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:32.555437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:32.555512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:32.555519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:32.555520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:32.555522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:32.555523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:32.555524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:32.555525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:32.555527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:32.555528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:32.555529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:32.555531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:32.555533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:32.555544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:32.555552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:32.555566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:32.555570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:32.555575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:32.555579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:32.555583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:32.555588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:32.555592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:32.555597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:32.555602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:32.555606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:32.555615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:32.555619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:32.555629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:32.555643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:32.555649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:32.555655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:32.555660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:32.555665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:32.555670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:32.555675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:32.555680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:32.555685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:32.555689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:32.555693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:32.555699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:32.555704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:32.555708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:32.555716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:32.555739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:32.555748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:32.555752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:32.555757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:32.555761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:32.555766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:32.555770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:32.555776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:32.555781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:32.555786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:32.555831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:32.558498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:32.558823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:32.558837Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:32.558840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:32.558844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:32.558851Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3024 [2:7559602742731101695:6672]
2025-10-10T14:39:32.558864Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:32.558883Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:32.558895Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:32.558899Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:32.558902Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:32.558919Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:32.558928Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:32.558936Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:32.558999Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:32.559007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:32.559009Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:32.559012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:32.559078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:32.559085Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:32.559097Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:32.559114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:32.559133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:32.559162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602743513342532:10456], now have 1 active actors on pipe
2025-10-10T14:39:32.559166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602743513342424:2438], now have 1 active actors on pipe
2025-10-10T14:39:32.559175Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602742731101689:6672]
2025-10-10T14:39:32.559182Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602742731101689:6672]
2025-10-10T14:39:32.559184Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602742731101689:6672]
2025-10-10T14:39:32.559196Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:32.559210Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:32.559210Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:32.559213Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:32.559216Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:32.559230Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:32.559233Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:32.559224Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3024
2025-10-10T14:39:32.559239Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3024
2025-10-10T14:39:32.559260Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602742731101689:6672]
2025-10-10T14:39:32.559270Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:32.559271Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:32.559287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:32.559292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:32.559349Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|422cc033-2cd42db5-a0e7b7f8-7b8c8ef9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:32.559361Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:32.559365Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:32.559367Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:32.559379Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:32.559394Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:32.559416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:32.559629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:32.559642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:32.559671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:32.559768Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3025 partition: 0 MaxSeqNo: 40 sessionId: src_id|422cc033-2cd42db5-a0e7b7f8-7b8c8ef9_0
2025-10-10T14:39:32.560172Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5804e9bc-8f2bd15-161f61dc-f903b742_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|422cc033-2cd42db5-a0e7b7f8-7b8c8ef9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:32.562915Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|422cc033-2cd42db5-a0e7b7f8-7b8c8ef9_0] Write session: try to update token
2025-10-10T14:39:32.562932Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|422cc033-2cd42db5-a0e7b7f8-7b8c8ef9_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:32.579341Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:32.579360Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:32.579364Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:32.579366Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:32.579377Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602742731101689:6672]
2025-10-10T14:39:32.579381Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602742731101689:6672]
2025-10-10T14:39:32.579385Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602742731101689:6672]
2025-10-10T14:39:32.579440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:32.579444Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:32.579452Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:32.579453Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:32.579455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:32.579457Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:32.579592Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:32.580480Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3025 sessionId: src_id|422cc033-2cd42db5-a0e7b7f8-7b8c8ef9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:32.587198Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:32.629203Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602743513342544:2572]
2025-10-10T14:39:32.629467Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 pipe creation result: OK TabletId: 72075186224037892 Generation: 3024, pipe: [1:7559602743513342544:2572]
2025-10-10T14:39:32.697048Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:32.697310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:32.697345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:32.697395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602743513342544:2572], now have 1 active actors on pipe
2025-10-10T14:39:32.697607Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 23 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602743513342544:2572]
2025-10-10T14:39:32.697647Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:32.697650Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:32.697697Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:32.697726Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3025 reason: error at write: Disconnected sessionId: src_id|422cc033-2cd42db5-a0e7b7f8-7b8c8ef9_0
2025-10-10T14:39:32.697957Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3025 sessionId: src_id|422cc033-2cd42db5-a0e7b7f8-7b8c8ef9_0 is DEAD
2025-10-10T14:39:32.698111Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|422cc033-2cd42db5-a0e7b7f8-7b8c8ef9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:32.698124Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|422cc033-2cd42db5-a0e7b7f8-7b8c8ef9_0] Write session will restart in 0.006926s
2025-10-10T14:39:32.698149Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|422cc033-2cd42db5-a0e7b7f8-7b8c8ef9_0] Write session: Do CDS request
2025-10-10T14:39:32.698156Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|422cc033-2cd42db5-a0e7b7f8-7b8c8ef9_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:32.698680Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:32.705965Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|422cc033-2cd42db5-a0e7b7f8-7b8c8ef9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:32.706082Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:32.706099Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3026
2025-10-10T14:39:32.706241Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3026 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:32.706291Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3026 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:32.706302Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3026 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:32.706306Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:32.706786Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3026 sessionId:  describe result for acl check
2025-10-10T14:39:32.706833Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:32.706837Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:32.706839Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:32.706845Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602743513342601:10453] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:32.707390Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602743513342601:10453] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:32.709925Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602743513342601:10453] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:32.711578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:32.712619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:32.712655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602743513342601:10453] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:32.712669Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602743513342601:10453] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:32.712673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602743513342601:10453] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:32.712680Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3026 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:32.712816Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:32.712828Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:32.712839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:32.712898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:32.712951Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602742731101823:6656]
2025-10-10T14:39:32.713577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:32.713898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:32.713945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:32.714267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:32.714330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:32.714337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:32.714338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:32.714339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:32.714341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:32.714342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:32.714343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:32.714344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:32.714345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:32.714346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:32.714348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:32.714349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:32.714350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:32.714355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:32.714369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:32.714373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:32.714378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:32.714382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:32.714386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:32.714390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:32.714394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:32.714398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:32.714402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:32.714406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:32.714410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:32.714414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:32.714421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:32.714430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:32.714436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:32.714440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:32.714444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:32.714450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:32.714454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:32.714459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:32.714463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:32.714468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:32.714472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:32.714477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:32.714482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:32.714489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:32.714493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:32.714499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:32.714503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:32.714509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:32.714513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:32.714518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:32.714523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:32.714528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:32.714532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:32.714537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:32.714543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:32.714561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:32.714601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:32.717125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:32.717583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:32.717597Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:32.717600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:32.717604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:32.717612Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3025 [2:7559602742731101823:6656]
2025-10-10T14:39:32.717627Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:32.717648Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:32.717656Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:32.717661Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:32.717664Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:32.717682Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:32.717696Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:32.717705Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:32.718310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:32.718324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:32.718327Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:32.718330Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:32.718416Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:32.718425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:32.718438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:32.718457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:32.718479Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:32.718509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602743513342720:10453], now have 1 active actors on pipe
2025-10-10T14:39:32.718515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602743513342548:2438], now have 1 active actors on pipe
2025-10-10T14:39:32.718524Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602742731101818:6656]
2025-10-10T14:39:32.718527Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602742731101818:6656]
2025-10-10T14:39:32.718529Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602742731101818:6656]
2025-10-10T14:39:32.718544Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:32.718561Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:32.718581Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:32.718584Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:32.718595Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:32.718579Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3025
2025-10-10T14:39:32.718607Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:32.718609Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:32.718600Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3025
2025-10-10T14:39:32.718615Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602742731101818:6656]
2025-10-10T14:39:32.718618Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:32.718652Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:32.718706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:32.718718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:32.718754Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|312fec79-da7b221b-8ef52648-bededaac_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:32.718771Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:32.718780Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:32.718783Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:32.718795Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:32.718807Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:32.718831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:32.718996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:32.719004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:32.719019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:32.719117Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3026 partition: 0 MaxSeqNo: 40 sessionId: src_id|312fec79-da7b221b-8ef52648-bededaac_0
2025-10-10T14:39:32.719542Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|422cc033-2cd42db5-a0e7b7f8-7b8c8ef9_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|312fec79-da7b221b-8ef52648-bededaac_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:32.722383Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|312fec79-da7b221b-8ef52648-bededaac_0] Write session: try to update token
2025-10-10T14:39:32.722404Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|312fec79-da7b221b-8ef52648-bededaac_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:32.730485Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:39:32.730512Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:32.730525Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602742731101818:6656]
2025-10-10T14:39:32.730578Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:39:32.730583Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:39:32.730783Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:39:32.730925Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:32.731101Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:32.731240Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:32.731455Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:39:32.731506Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:39:32.737480Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3026 sessionId: src_id|312fec79-da7b221b-8ef52648-bededaac_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:32.740201Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:32.740427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:32.740449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:32.740493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:39:32.740568Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:39:32.748929Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:32.748947Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:32.748950Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:32.748952Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:32.748962Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602742731101818:6656]
2025-10-10T14:39:32.748966Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602742731101818:6656]
2025-10-10T14:39:32.748970Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602742731101818:6656]
2025-10-10T14:39:32.749018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:32.749018Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:32.749024Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:32.749026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:32.749028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:32.749032Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:32.749171Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:32.797655Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602743513342743:2572]
2025-10-10T14:39:32.797974Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 pipe creation result: OK TabletId: 72075186224037892 Generation: 3025, pipe: [1:7559602743513342743:2572]
2025-10-10T14:39:32.869130Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:32.877843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:32.877869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:32.878060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:32.878121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:32.878182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:32.878240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:32.878296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:32.878311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:32.878381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:32.878439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:32.878496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:32.878567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:32.878612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:32.878617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:32.878684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:32.878744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:32.878815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:32.878875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:32.878923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:32.878929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:32.879012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:32.879089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:32.879155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:32.879218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:32.879262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:32.879273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:32.879365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:32.879434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:32.879503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:32.879577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:32.879628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:32.879635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:32.879710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:32.879776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:32.879841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:32.879912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:32.879962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:32.879969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:32.880049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:32.880117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:32.880187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:32.880254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:32.880301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:32.880310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:32.880389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:32.880456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:32.880530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:32.880601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:32.880653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:32.880660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:32.880731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:32.880796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:32.880866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:32.880950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:32.881000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:32.881007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:32.881081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:32.881152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:32.881219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:32.881289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:32.881353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:32.881363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:32.881443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602743513342743:2572], now have 1 active actors on pipe
2025-10-10T14:39:32.882908Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:32.882923Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 24 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602743513342743:2572]
2025-10-10T14:39:32.882959Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:32.883005Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:39:32.883058Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3026 reason: status is not ok: tablet will be restarted right now sessionId: src_id|312fec79-da7b221b-8ef52648-bededaac_0
2025-10-10T14:39:32.883290Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3026 sessionId: src_id|312fec79-da7b221b-8ef52648-bededaac_0 is DEAD
2025-10-10T14:39:32.883492Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|312fec79-da7b221b-8ef52648-bededaac_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:39:32.883505Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|312fec79-da7b221b-8ef52648-bededaac_0] Write session will restart in 0.007382s
2025-10-10T14:39:32.883548Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|312fec79-da7b221b-8ef52648-bededaac_0] Write session: Do CDS request
2025-10-10T14:39:32.883555Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|312fec79-da7b221b-8ef52648-bededaac_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:32.891999Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|312fec79-da7b221b-8ef52648-bededaac_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:32.892126Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:32.892147Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3027
2025-10-10T14:39:32.892330Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3027 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:32.892380Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3027 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:32.892393Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3027 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:32.892397Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:32.892866Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3027 sessionId:  describe result for acl check
2025-10-10T14:39:32.892909Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:32.892910Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:32.892912Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:32.892934Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602743513342837:10441] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:32.893584Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602743513342837:10441] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:32.896464Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602743513342837:10441] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:32.898284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:32.900157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:32.900369Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602743513342837:10441] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:32.900387Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602743513342837:10441] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:32.900391Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602743513342837:10441] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:32.900401Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3027 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:32.900402Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:32.900416Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:32.900430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:32.900496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:32.900549Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602742731101941:6649]
2025-10-10T14:39:32.901216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:32.901583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:32.901645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:32.901994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:32.902055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:32.902062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:32.902063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:32.902065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:32.902066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:32.902067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:32.902068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:32.902069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:32.902069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:32.902070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:32.902071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:32.902072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:32.902073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:32.902078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:32.902087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:32.902090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:32.902092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:32.902095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:32.902097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:32.902100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:32.902102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:32.902104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:32.902107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:32.902110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:32.902112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:32.902114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:32.902121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:32.902127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:32.902133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:32.902136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:32.902139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:32.902143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:32.902146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:32.902149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:32.902152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:32.902156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:32.902159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:32.902162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:32.902165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:32.902168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:32.902171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:32.902174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:32.902178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:32.902181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:32.902183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:32.902187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:32.902189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:32.902192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:32.902195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:32.902198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:32.902201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:32.902204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:32.902227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:32.904765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:32.906034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:32.906055Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:32.906058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:32.906063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:32.906070Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3026 [2:7559602742731101941:6649]
2025-10-10T14:39:32.906087Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:32.906108Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:32.906117Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:32.906122Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:32.906125Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:32.906147Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:32.906163Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:32.906172Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:32.906238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:32.906248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:32.906250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:32.906253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:32.906331Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:32.906341Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:32.906354Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:32.906372Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:32.906395Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:32.906425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602743513342927:10441], now have 1 active actors on pipe
2025-10-10T14:39:32.906431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602743513342753:2438], now have 1 active actors on pipe
2025-10-10T14:39:32.906440Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602742731101936:6649]
2025-10-10T14:39:32.906443Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602742731101936:6649]
2025-10-10T14:39:32.906445Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602742731101936:6649]
2025-10-10T14:39:32.906462Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:32.906477Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:32.906494Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:32.906505Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:32.906482Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3026
2025-10-10T14:39:32.906487Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3026
2025-10-10T14:39:32.906540Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602742731101936:6649]
2025-10-10T14:39:32.906546Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:32.906550Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:32.906550Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:32.906553Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:32.906560Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:32.906584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:32.906589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:32.906633Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|89108b38-f15af682-970e72a9-43fd7552_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:32.906648Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:32.906655Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:32.906657Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:32.906670Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:32.906683Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:32.906705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:32.906909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:32.906920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:32.906942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:32.907023Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3027 partition: 0 MaxSeqNo: 40 sessionId: src_id|89108b38-f15af682-970e72a9-43fd7552_0
2025-10-10T14:39:32.907474Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|312fec79-da7b221b-8ef52648-bededaac_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|89108b38-f15af682-970e72a9-43fd7552_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:32.910419Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|89108b38-f15af682-970e72a9-43fd7552_0] Write session: try to update token
2025-10-10T14:39:32.910442Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|89108b38-f15af682-970e72a9-43fd7552_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:32.926935Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:32.926954Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:32.926957Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:32.926959Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:32.926969Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602742731101936:6649]
2025-10-10T14:39:32.926974Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602742731101936:6649]
2025-10-10T14:39:32.926978Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602742731101936:6649]
2025-10-10T14:39:32.927020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:32.927026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:32.927027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:32.927037Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:32.927051Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:32.927055Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:32.927045Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3027 sessionId: src_id|89108b38-f15af682-970e72a9-43fd7552_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:32.927166Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:32.929777Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:32.982983Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602743513342963:2572]
2025-10-10T14:39:32.983242Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 pipe creation result: OK TabletId: 72075186224037892 Generation: 3026, pipe: [1:7559602743513342963:2572]
2025-10-10T14:39:33.044993Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:33.045592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:33.045612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:33.045678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602743513342963:2572], now have 1 active actors on pipe
2025-10-10T14:39:33.045926Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:33.046375Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 25 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602743513342963:2572]
2025-10-10T14:39:33.046401Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:39:33.046406Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:33.046494Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3027 reason: status is not ok: tablet will be restarted right now sessionId: src_id|89108b38-f15af682-970e72a9-43fd7552_0
2025-10-10T14:39:33.046741Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3027 sessionId: src_id|89108b38-f15af682-970e72a9-43fd7552_0 is DEAD
2025-10-10T14:39:33.046903Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89108b38-f15af682-970e72a9-43fd7552_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:39:33.046914Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89108b38-f15af682-970e72a9-43fd7552_0] Write session will restart in 0.007678s
2025-10-10T14:39:33.046940Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89108b38-f15af682-970e72a9-43fd7552_0] Write session: Do CDS request
2025-10-10T14:39:33.046947Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89108b38-f15af682-970e72a9-43fd7552_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:33.055951Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|89108b38-f15af682-970e72a9-43fd7552_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:33.056057Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:33.056073Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3028
2025-10-10T14:39:33.056232Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3028 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:33.056271Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3028 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:33.056286Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3028 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:33.056290Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:33.056984Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3028 sessionId:  describe result for acl check
2025-10-10T14:39:33.057035Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:33.057042Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:33.057044Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:33.057051Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602747808310311:10429] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:33.057658Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602747808310311:10429] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:33.060130Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602747808310311:10429] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:33.062722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602747808310311:10429] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:33.062753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602747808310311:10429] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:33.062757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602747808310311:10429] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:33.062766Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3028 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:33.065907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:33.066497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:33.066731Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:33.066743Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:33.066755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:33.066809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:33.066855Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602747026069395:6630]
2025-10-10T14:39:33.067530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:33.067896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:33.067989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:33.068380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:33.068463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:33.068464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:33.068465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:33.068467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:33.068468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:33.068470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:33.068471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:33.068473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:33.068474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:33.068476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:33.068477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:33.068478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:33.068479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:33.068487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:33.068502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:33.068507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:33.068512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:33.068517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:33.068521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:33.068525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:33.068529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:33.068533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:33.068537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:33.068542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:33.068546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:33.068551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:33.068560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:33.068570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:33.068578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:33.068585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:33.068591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:33.068597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:33.068603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:33.068609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:33.068615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:33.068622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:33.068627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:33.068633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:33.068639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:33.068646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:33.068651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:33.068658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:33.068664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:33.068670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:33.068674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:33.068681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:33.068686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:33.068692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:33.068697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:33.068704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:33.068709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:33.068715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:33.068762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:33.071292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:33.072234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:33.072252Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:33.072255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:33.072260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:33.072267Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3027 [2:7559602747026069395:6630]
2025-10-10T14:39:33.072283Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:33.072303Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:33.072315Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:33.072319Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:33.072322Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:33.072340Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:33.072358Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:33.072372Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:33.072443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:33.072453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:33.072455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:33.072458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:33.072539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:33.072548Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:33.072562Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:33.072581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:33.072600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:33.072626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602747808310260:2438], now have 1 active actors on pipe
2025-10-10T14:39:33.072636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602747808310430:10429], now have 1 active actors on pipe
2025-10-10T14:39:33.072644Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602747026069390:6630]
2025-10-10T14:39:33.072652Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602747026069390:6630]
2025-10-10T14:39:33.072655Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602747026069390:6630]
2025-10-10T14:39:33.072671Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:33.072689Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:33.072692Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:33.072701Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:33.072703Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:33.072700Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3027
2025-10-10T14:39:33.072710Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:33.072749Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3027
2025-10-10T14:39:33.072714Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:33.072744Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602747026069390:6630]
2025-10-10T14:39:33.072748Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:33.072756Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:33.072877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:33.072889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:33.072940Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ef0d1893-aadd4705-d1c87a83-dcf13777_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:33.072955Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:33.072960Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:33.072963Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:33.072980Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:33.072997Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:33.073018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:33.073261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:33.073271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:33.073290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:33.076842Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3028 partition: 0 MaxSeqNo: 40 sessionId: src_id|ef0d1893-aadd4705-d1c87a83-dcf13777_0
2025-10-10T14:39:33.077395Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89108b38-f15af682-970e72a9-43fd7552_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|ef0d1893-aadd4705-d1c87a83-dcf13777_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:33.080234Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ef0d1893-aadd4705-d1c87a83-dcf13777_0] Write session: try to update token
2025-10-10T14:39:33.080250Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ef0d1893-aadd4705-d1c87a83-dcf13777_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:33.096838Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3028 sessionId: src_id|ef0d1893-aadd4705-d1c87a83-dcf13777_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:33.099743Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:33.102135Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:39:33.099940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:33.099963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:33.101937Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:33.101942Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:33.101946Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:33.101948Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:33.101957Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602747026069390:6630]
2025-10-10T14:39:33.101963Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602747026069390:6630]
2025-10-10T14:39:33.101967Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602747026069390:6630]
2025-10-10T14:39:33.102022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:39:33.102025Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:33.102032Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:33.102037Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:33.102041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:33.102050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:33.102052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:33.102213Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:33.146325Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602747808310444:2572]
2025-10-10T14:39:33.146695Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 pipe creation result: OK TabletId: 72075186224037892 Generation: 3027, pipe: [1:7559602747808310444:2572]
2025-10-10T14:39:33.221246Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:33.231166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:33.231197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:33.231399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:33.231470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:33.231546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:33.231624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:33.231878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:33.231892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:33.231968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:33.232037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:33.232105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:33.232179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:33.232226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:33.232238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:33.232309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:33.232377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:33.232452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:33.232525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:33.232576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:33.232584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:33.232654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:33.232727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:33.232796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:33.232866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:33.232932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:33.232941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:33.233015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:33.233081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:33.233154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:33.233229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:33.233278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:33.233288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:33.233643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:33.233717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:33.233783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:33.233865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:33.233918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:33.233921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:33.233993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:33.234052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:33.234119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:33.234187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:33.234235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:33.234238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:33.234310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:33.234373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:33.234440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:33.234508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:33.234825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:33.234829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:33.234904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:33.234966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:33.235026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:33.235097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:33.235139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:33.235142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:33.235218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:33.235280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:33.235344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:33.235412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:33.235476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:33.235480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:33.235547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602747808310444:2572], now have 1 active actors on pipe
2025-10-10T14:39:33.236098Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:33.235855Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 26 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602747808310444:2572]
2025-10-10T14:39:33.235891Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:33.236195Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:33.236198Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:33.236231Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3028 reason: error at write: Disconnected sessionId: src_id|ef0d1893-aadd4705-d1c87a83-dcf13777_0
2025-10-10T14:39:33.236465Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3028 sessionId: src_id|ef0d1893-aadd4705-d1c87a83-dcf13777_0 is DEAD
2025-10-10T14:39:33.236890Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef0d1893-aadd4705-d1c87a83-dcf13777_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:33.236902Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef0d1893-aadd4705-d1c87a83-dcf13777_0] Write session will restart in 0.006823s
2025-10-10T14:39:33.236973Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef0d1893-aadd4705-d1c87a83-dcf13777_0] Write session: Do CDS request
2025-10-10T14:39:33.236980Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef0d1893-aadd4705-d1c87a83-dcf13777_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:33.244980Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ef0d1893-aadd4705-d1c87a83-dcf13777_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:33.245054Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:33.245075Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3029
2025-10-10T14:39:33.245227Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3029 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:33.245269Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3029 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:33.245280Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3029 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:33.245284Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:33.245780Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3029 sessionId:  describe result for acl check
2025-10-10T14:39:33.245813Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:33.245815Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:33.245817Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:33.245824Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602747808310513:10424] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:33.246400Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602747808310513:10424] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:33.249480Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602747808310513:10424] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:33.251367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:33.253185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:33.253316Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602747808310513:10424] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:33.253349Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602747808310513:10424] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:33.253352Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602747808310513:10424] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:33.253362Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3029 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:33.253425Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:33.253437Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:33.253450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:33.253504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:33.253548Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602747026069516:6624]
2025-10-10T14:39:33.254253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:33.254583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:33.254646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:33.255019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:33.255089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:33.255104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:33.255106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:33.255107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:33.255108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:33.255110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:33.255111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:33.255113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:33.255114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:33.255115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:33.255117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:33.255118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:33.255119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:33.255127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:33.255142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:33.255146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:33.255150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:33.255153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:33.255157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:33.255161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:33.255164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:33.255168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:33.255172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:33.255176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:33.255179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:33.255183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:33.255191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:33.255201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:33.255209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:33.255214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:33.255219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:33.255223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:33.255228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:33.255232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:33.255237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:33.255242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:33.255245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:33.255250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:33.255255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:33.255260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:33.255264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:33.255273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:33.255279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:33.255284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:33.255287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:33.255292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:33.255297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:33.255301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:33.255305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:33.255309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:33.255314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:33.255318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:33.255354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:33.257833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:33.258597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:33.258621Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:33.258623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:33.258627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:33.258633Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3028 [2:7559602747026069516:6624]
2025-10-10T14:39:33.258645Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:33.258664Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:33.258671Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:33.258675Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:33.258677Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:33.258694Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:33.258706Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:33.258713Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:33.258771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:33.258778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:33.258780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:33.258782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:33.258850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:33.258858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:33.258870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:33.258881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:33.258900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:33.258926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602747808310446:2438], now have 1 active actors on pipe
2025-10-10T14:39:33.258934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602747808310618:10424], now have 1 active actors on pipe
2025-10-10T14:39:33.258942Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602747026069511:6624]
2025-10-10T14:39:33.258948Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602747026069511:6624]
2025-10-10T14:39:33.258950Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602747026069511:6624]
2025-10-10T14:39:33.258964Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:33.258982Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:33.258996Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:33.258997Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:33.259000Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:33.259000Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:33.259002Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:33.259026Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602747026069511:6624]
2025-10-10T14:39:33.258998Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3028
2025-10-10T14:39:33.259033Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:33.259011Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3028
2025-10-10T14:39:33.259050Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:33.259066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:33.259074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:33.259107Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b3c20d9a-6ace0df3-1def41fb-4b3587ae_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:33.259118Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:33.259122Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:33.259124Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:33.259134Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:33.259143Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:33.259155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:33.259287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:33.259295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:33.259310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:33.259404Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3029 partition: 0 MaxSeqNo: 40 sessionId: src_id|b3c20d9a-6ace0df3-1def41fb-4b3587ae_0
2025-10-10T14:39:33.259839Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef0d1893-aadd4705-d1c87a83-dcf13777_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|b3c20d9a-6ace0df3-1def41fb-4b3587ae_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:33.262786Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b3c20d9a-6ace0df3-1def41fb-4b3587ae_0] Write session: try to update token
2025-10-10T14:39:33.262805Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b3c20d9a-6ace0df3-1def41fb-4b3587ae_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:33.277609Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3029 sessionId: src_id|b3c20d9a-6ace0df3-1def41fb-4b3587ae_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:33.278864Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:33.278889Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:33.278892Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:33.278895Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:33.278906Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602747026069511:6624]
2025-10-10T14:39:33.278911Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602747026069511:6624]
2025-10-10T14:39:33.278916Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602747026069511:6624]
2025-10-10T14:39:33.278959Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:33.278969Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:33.278974Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:33.278977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:33.278979Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:33.278979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:33.279144Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:33.280219Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:33.336297Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602747808310631:2572]
2025-10-10T14:39:33.336654Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 pipe creation result: OK TabletId: 72075186224037892 Generation: 3028, pipe: [1:7559602747808310631:2572]
2025-10-10T14:39:33.400109Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:33.400891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:33.400919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:33.400969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602747808310631:2572], now have 1 active actors on pipe
2025-10-10T14:39:33.401204Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 27 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602747808310631:2572]
2025-10-10T14:39:33.401214Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:33.401216Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:33.401220Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:33.401238Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:33.401410Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3029 reason: error at write: Disconnected sessionId: src_id|b3c20d9a-6ace0df3-1def41fb-4b3587ae_0
2025-10-10T14:39:33.401657Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3029 sessionId: src_id|b3c20d9a-6ace0df3-1def41fb-4b3587ae_0 is DEAD
2025-10-10T14:39:33.401843Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3c20d9a-6ace0df3-1def41fb-4b3587ae_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:33.401856Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3c20d9a-6ace0df3-1def41fb-4b3587ae_0] Write session will restart in 0.007276s
2025-10-10T14:39:33.401895Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3c20d9a-6ace0df3-1def41fb-4b3587ae_0] Write session: Do CDS request
2025-10-10T14:39:33.401906Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3c20d9a-6ace0df3-1def41fb-4b3587ae_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:33.410995Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b3c20d9a-6ace0df3-1def41fb-4b3587ae_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:33.411024Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:33.411041Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3030
2025-10-10T14:39:33.411226Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3030 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:33.411260Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3030 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:33.411271Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3030 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:33.411275Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:33.411782Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3030 sessionId:  describe result for acl check
2025-10-10T14:39:33.411824Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:33.411827Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:33.411829Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:33.411836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602747808310762:10414] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:33.412435Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602747808310762:10414] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:33.414595Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602747808310762:10414] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:33.416780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:33.417258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:33.417296Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602747808310762:10414] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:33.417310Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602747808310762:10414] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:33.417314Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602747808310762:10414] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:33.417324Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3030 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:33.417853Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:33.417869Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:33.417887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:33.417966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:33.418011Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602747026069638:6626]
2025-10-10T14:39:33.418646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:33.418979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:33.419024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:33.419340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:33.419404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:33.419411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:33.419412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:33.419413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:33.419415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:33.419416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:33.419417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:33.419419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:33.419420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:33.419421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:33.419422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:33.419423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:33.419425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:33.419432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:33.419446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:33.419450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:33.419454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:33.419458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:33.419463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:33.419467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:33.419470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:33.419474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:33.419478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:33.419481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:33.419484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:33.419487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:33.419495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:33.419504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:33.419512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:33.419517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:33.419522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:33.419527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:33.419531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:33.419535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:33.419539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:33.419544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:33.419548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:33.419552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:33.419557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:33.419563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:33.419567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:33.419572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:33.419577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:33.419582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:33.419585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:33.419589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:33.419594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:33.419616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:33.419621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:33.419626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:33.419630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:33.419636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:33.419676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:33.422344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:33.422654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:33.422666Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:33.422669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:33.422673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:33.422679Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3029 [2:7559602747026069638:6626]
2025-10-10T14:39:33.422693Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:33.422714Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:33.422721Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:33.422724Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:33.422727Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:33.422744Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:33.422755Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:33.422764Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:33.422821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:33.422827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:33.422829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:33.422834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:33.422901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:33.422908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:33.422919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:33.422934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:33.422954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:33.422979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602747808310806:10414], now have 1 active actors on pipe
2025-10-10T14:39:33.422986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602747808310632:2438], now have 1 active actors on pipe
2025-10-10T14:39:33.422994Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602747026069632:6626]
2025-10-10T14:39:33.423002Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602747026069632:6626]
2025-10-10T14:39:33.423004Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602747026069632:6626]
2025-10-10T14:39:33.423016Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:33.423030Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:33.423034Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:33.423040Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:33.423043Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:33.423051Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:33.423054Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:33.423037Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3029
2025-10-10T14:39:33.423048Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3029
2025-10-10T14:39:33.423079Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602747026069632:6626]
2025-10-10T14:39:33.423087Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:33.423091Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:33.423108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:33.423117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:33.423172Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|76fba329-56921ff6-4e824288-dcede47f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:33.423183Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:33.423187Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:33.423189Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:33.423199Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:33.423210Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:33.423233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:33.423379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:33.423384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:33.423396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:33.423476Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3030 partition: 0 MaxSeqNo: 40 sessionId: src_id|76fba329-56921ff6-4e824288-dcede47f_0
2025-10-10T14:39:33.423926Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3c20d9a-6ace0df3-1def41fb-4b3587ae_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|76fba329-56921ff6-4e824288-dcede47f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:33.426977Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|76fba329-56921ff6-4e824288-dcede47f_0] Write session: try to update token
2025-10-10T14:39:33.427000Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|76fba329-56921ff6-4e824288-dcede47f_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:33.443990Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3030 sessionId: src_id|76fba329-56921ff6-4e824288-dcede47f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:33.445986Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:33.446010Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:33.446014Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:33.446016Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:33.446032Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602747026069632:6626]
2025-10-10T14:39:33.446037Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602747026069632:6626]
2025-10-10T14:39:33.446041Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602747026069632:6626]
2025-10-10T14:39:33.446099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:33.446108Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:33.446111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:33.446114Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:33.446122Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:33.446129Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:33.446294Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:33.446994Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:33.501177Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602747808310818:2572]
2025-10-10T14:39:33.501555Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 pipe creation result: OK TabletId: 72075186224037892 Generation: 3029, pipe: [1:7559602747808310818:2572]
2025-10-10T14:39:33.564474Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:33.565283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:33.565298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:33.565356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602747808310818:2572], now have 1 active actors on pipe
2025-10-10T14:39:33.565588Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:33.565587Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:33.565602Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:33.565631Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 28 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602747808310818:2572]
2025-10-10T14:39:33.565655Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:33.565664Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3030 reason: error at write: Disconnected sessionId: src_id|76fba329-56921ff6-4e824288-dcede47f_0
2025-10-10T14:39:33.565897Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3030 sessionId: src_id|76fba329-56921ff6-4e824288-dcede47f_0 is DEAD
2025-10-10T14:39:33.566074Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|76fba329-56921ff6-4e824288-dcede47f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:33.566084Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|76fba329-56921ff6-4e824288-dcede47f_0] Write session will restart in 0.005127s
2025-10-10T14:39:33.566110Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|76fba329-56921ff6-4e824288-dcede47f_0] Write session: Do CDS request
2025-10-10T14:39:33.566116Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|76fba329-56921ff6-4e824288-dcede47f_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:33.572888Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|76fba329-56921ff6-4e824288-dcede47f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:33.573027Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:33.573045Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3031
2025-10-10T14:39:33.573219Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3031 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:33.573267Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3031 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:33.573287Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3031 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:33.573297Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:33.573792Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3031 sessionId:  describe result for acl check
2025-10-10T14:39:33.573833Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:33.573840Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:33.573842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:33.573848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602747808310855:10415] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:33.574425Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602747808310855:10415] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:33.577077Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602747808310855:10415] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:33.578672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:33.580782Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602747808310855:10415] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:33.580796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602747808310855:10415] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:33.580800Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602747808310855:10415] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:33.580807Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3031 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:33.580829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:33.581065Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:33.581079Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:33.581092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:33.581160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:33.581202Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602747026069760:6620]
2025-10-10T14:39:33.581836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:33.582255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:33.582307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:33.582632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:33.582698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:33.582705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:33.582706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:33.582707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:33.582708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:33.582710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:33.582711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:33.582713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:33.582714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:33.582715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:33.582717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:33.582718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:33.582719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:33.582725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:33.582739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:33.582744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:33.582748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:33.582752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:33.582755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:33.582759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:33.582763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:33.582768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:33.582772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:33.582776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:33.582780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:33.582784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:33.582793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:33.582802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:33.582808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:33.582815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:33.582819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:33.582825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:33.582834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:33.582839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:33.582846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:33.582856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:33.582861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:33.582868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:33.582873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:33.582879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:33.582889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:33.582894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:33.582900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:33.582909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:33.582913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:33.582923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:33.582927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:33.582932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:33.582940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:33.582944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:33.582948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:33.582952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:33.582988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:33.585592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:33.586423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:33.586436Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:33.586439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:33.586443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:33.586450Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3030 [2:7559602747026069760:6620]
2025-10-10T14:39:33.586465Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:33.586483Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:33.586487Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:33.586491Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:33.586499Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:33.586516Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:33.586528Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:33.586542Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:33.586607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:33.586615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:33.586617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:33.586620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:33.586688Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:33.586695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:33.586706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:33.586717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:33.586732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:33.586758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602747808310994:10415], now have 1 active actors on pipe
2025-10-10T14:39:33.586767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602747808310819:2438], now have 1 active actors on pipe
2025-10-10T14:39:33.586775Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602747026069754:6620]
2025-10-10T14:39:33.586781Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602747026069754:6620]
2025-10-10T14:39:33.586783Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602747026069754:6620]
2025-10-10T14:39:33.586797Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:33.586812Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:33.586813Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:33.586820Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:33.586822Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:33.586830Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:33.586833Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:33.586801Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3030
2025-10-10T14:39:33.586806Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3030
2025-10-10T14:39:33.586864Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602747026069754:6620]
2025-10-10T14:39:33.586873Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:33.586874Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:33.586899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:33.586911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:33.586960Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3ba059e4-400eb077-139107b-304713d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:33.586974Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:33.586979Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:33.586981Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:33.586993Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:33.587004Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:33.587029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:33.587207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:33.587215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:33.587230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:33.587343Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3031 partition: 0 MaxSeqNo: 40 sessionId: src_id|3ba059e4-400eb077-139107b-304713d_0
2025-10-10T14:39:33.587799Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|76fba329-56921ff6-4e824288-dcede47f_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|3ba059e4-400eb077-139107b-304713d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:33.590566Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3ba059e4-400eb077-139107b-304713d_0] Write session: try to update token
2025-10-10T14:39:33.590584Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3ba059e4-400eb077-139107b-304713d_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:33.605173Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3031 sessionId: src_id|3ba059e4-400eb077-139107b-304713d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:33.608055Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:33.608083Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:33.608086Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:33.608089Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:33.608098Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602747026069754:6620]
2025-10-10T14:39:33.608104Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602747026069754:6620]
2025-10-10T14:39:33.608109Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602747026069754:6620]
2025-10-10T14:39:33.608168Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:33.608169Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:33.608175Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:33.608180Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:33.608184Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:33.608187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:33.608381Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:33.608862Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:33.665959Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602747808311006:2572]
2025-10-10T14:39:33.666311Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 pipe creation result: OK TabletId: 72075186224037892 Generation: 3030, pipe: [1:7559602747808311006:2572]
2025-10-10T14:39:33.723947Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:33.724243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:33.724259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:33.724308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602747808311006:2572], now have 1 active actors on pipe
2025-10-10T14:39:33.724551Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:33.724554Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:33.724567Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:33.724590Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 29 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602747808311006:2572]
2025-10-10T14:39:33.724615Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:33.724643Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3031 reason: error at write: Disconnected sessionId: src_id|3ba059e4-400eb077-139107b-304713d_0
2025-10-10T14:39:33.724873Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3031 sessionId: src_id|3ba059e4-400eb077-139107b-304713d_0 is DEAD
2025-10-10T14:39:33.725087Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ba059e4-400eb077-139107b-304713d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:33.725100Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ba059e4-400eb077-139107b-304713d_0] Write session will restart in 0.009920s
2025-10-10T14:39:33.725138Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ba059e4-400eb077-139107b-304713d_0] Write session: Do CDS request
2025-10-10T14:39:33.725148Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ba059e4-400eb077-139107b-304713d_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:33.735966Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3ba059e4-400eb077-139107b-304713d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:33.736041Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:33.736060Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3032
2025-10-10T14:39:33.736248Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3032 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:33.736294Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3032 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:33.736305Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3032 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:33.736308Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:33.736783Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3032 sessionId:  describe result for acl check
2025-10-10T14:39:33.736826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:33.736836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:33.736839Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:33.736845Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602747808311152:10411] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:33.737473Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602747808311152:10411] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:33.737573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:33.739604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:33.739849Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:33.739870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602747808311152:10411] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:33.739881Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:33.739898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:33.739972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:33.740023Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602747026069894:6614]
2025-10-10T14:39:33.740679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:33.741087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:33.741145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:33.741512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:33.741612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:33.741626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:33.741627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:33.741629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:33.741630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:33.741631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:33.741632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:33.741636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:33.741638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:33.741639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:33.741640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:33.741642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:33.741643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:33.741651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:33.741665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:33.741670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:33.741675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:33.741679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:33.741684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:33.741688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:33.741693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:33.741697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:33.741701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:33.741706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:33.741709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:33.741713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:33.741721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:33.741730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:33.741737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:33.741744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:33.741749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:33.741755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:33.741762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:33.741768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:33.741774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:33.741779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:33.741783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:33.741789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:33.741798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:33.741804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:33.741815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:33.741821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:33.741826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:33.741837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:33.741841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:33.741846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:33.741851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:33.741856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:33.741862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:33.741867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:33.741871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:33.741876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:33.741914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:33.743135Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602747808311152:10411] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:33.743153Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602747808311152:10411] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:33.743158Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602747808311152:10411] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:33.743167Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3032 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:33.744804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:33.745165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:33.745187Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:33.745190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:33.745194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:33.745212Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3031 [2:7559602747026069894:6614]
2025-10-10T14:39:33.745228Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:33.745254Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:33.745262Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:33.745266Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:33.745269Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:33.745288Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:33.745296Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:33.745311Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:33.745404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:33.745412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:33.745414Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:33.745417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:33.745492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:33.745501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:33.745513Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:33.745524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:33.745545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:33.745574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602747808311187:10411], now have 1 active actors on pipe
2025-10-10T14:39:33.745588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602747808311007:2438], now have 1 active actors on pipe
2025-10-10T14:39:33.745596Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602747026069889:6614]
2025-10-10T14:39:33.745598Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602747026069889:6614]
2025-10-10T14:39:33.745600Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602747026069889:6614]
2025-10-10T14:39:33.745616Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:33.745651Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3031
2025-10-10T14:39:33.745657Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3031
2025-10-10T14:39:33.745633Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:33.745645Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:33.745649Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:33.745652Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:33.745660Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:33.745664Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:33.745698Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602747026069889:6614]
2025-10-10T14:39:33.745702Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:33.745704Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:33.745735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:33.745741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:33.745782Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9a02015d-3059d9fb-7cdb46c8-99a5710b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:33.745791Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:33.745796Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:33.745798Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:33.745812Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:33.745826Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:33.745853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:33.746051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:33.746066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:33.746093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:33.746218Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3032 partition: 0 MaxSeqNo: 40 sessionId: src_id|9a02015d-3059d9fb-7cdb46c8-99a5710b_0
2025-10-10T14:39:33.746670Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ba059e4-400eb077-139107b-304713d_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|9a02015d-3059d9fb-7cdb46c8-99a5710b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:33.749701Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9a02015d-3059d9fb-7cdb46c8-99a5710b_0] Write session: try to update token
2025-10-10T14:39:33.749722Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9a02015d-3059d9fb-7cdb46c8-99a5710b_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:33.764796Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3032 sessionId: src_id|9a02015d-3059d9fb-7cdb46c8-99a5710b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:33.766592Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:33.766616Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:33.766620Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:33.766622Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:33.766631Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602747026069889:6614]
2025-10-10T14:39:33.766636Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602747026069889:6614]
2025-10-10T14:39:33.766641Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602747026069889:6614]
2025-10-10T14:39:33.766693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:33.766698Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:33.766705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:33.766706Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:33.766709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:33.766710Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:33.766883Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:33.767752Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:33.824725Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602747808311207:2572]
2025-10-10T14:39:33.825031Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 pipe creation result: OK TabletId: 72075186224037892 Generation: 3031, pipe: [1:7559602747808311207:2572]
2025-10-10T14:39:33.884898Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:33.885460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:33.885478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:33.885530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602747808311207:2572], now have 1 active actors on pipe
2025-10-10T14:39:33.885759Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:33.885831Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:33.885858Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:33.885951Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3032 reason: error at write: Disconnected sessionId: src_id|9a02015d-3059d9fb-7cdb46c8-99a5710b_0
2025-10-10T14:39:33.885951Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 30 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602747808311207:2572]
2025-10-10T14:39:33.885973Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:33.886190Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3032 sessionId: src_id|9a02015d-3059d9fb-7cdb46c8-99a5710b_0 is DEAD
2025-10-10T14:39:33.886380Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a02015d-3059d9fb-7cdb46c8-99a5710b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:33.886390Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a02015d-3059d9fb-7cdb46c8-99a5710b_0] Write session will restart in 0.008027s
2025-10-10T14:39:33.886435Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a02015d-3059d9fb-7cdb46c8-99a5710b_0] Write session: Do CDS request
2025-10-10T14:39:33.886443Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a02015d-3059d9fb-7cdb46c8-99a5710b_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:33.896157Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9a02015d-3059d9fb-7cdb46c8-99a5710b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:33.896284Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:33.896303Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3033
2025-10-10T14:39:33.896436Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3033 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:33.896474Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3033 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:33.896486Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3033 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:33.896491Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:33.897036Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3033 sessionId:  describe result for acl check
2025-10-10T14:39:33.897080Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:33.897082Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:33.897084Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:33.897091Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602747808311342:10397] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:33.897722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602747808311342:10397] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:33.900279Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602747808311342:10397] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:33.903009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:33.903541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:33.903749Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:33.903759Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:33.903771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:33.903825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:33.903872Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602747026070018:6611]
2025-10-10T14:39:33.904462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:33.904785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:33.904837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:33.905173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:33.905257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:33.905258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:33.905259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:33.905261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:33.905262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:33.905263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:33.905265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:33.905266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:33.905267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:33.905268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:33.905269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:33.905270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:33.905272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:33.905278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:33.905292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:33.905296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:33.905300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:33.905304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:33.905308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:33.905312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:33.905315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:33.905318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:33.905322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:33.905325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:33.905346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:33.905349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:33.905357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:33.905366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:33.905373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:33.905378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:33.905381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:33.905386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:33.905390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:33.905395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:33.905399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:33.905404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:33.905408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:33.905412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:33.905417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:33.905423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:33.905427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:33.905431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:33.905436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:33.905443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:33.905448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:33.905453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:33.905459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:33.905465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:33.905469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:33.905474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:33.905479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:33.905485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:33.905531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:33.906420Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602747808311342:10397] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:33.906436Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602747808311342:10397] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:33.906440Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602747808311342:10397] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:33.906450Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3033 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:33.908060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:33.908844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:33.908861Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:33.908864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:33.908868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:33.908877Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3032 [2:7559602747026070018:6611]
2025-10-10T14:39:33.908892Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:33.908923Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:33.908926Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:33.908930Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:33.908933Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:33.908950Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:33.908962Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:33.908971Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:33.909041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:33.909047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:33.909049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:33.909052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:33.909124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:33.909132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:33.909143Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:33.909158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:33.909178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:33.909206Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602747026070013:6611]
2025-10-10T14:39:33.909209Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602747026070013:6611]
2025-10-10T14:39:33.909211Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602747026070013:6611]
2025-10-10T14:39:33.909220Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:33.909229Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:33.909233Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:33.909235Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:33.909237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602747808311397:10397], now have 1 active actors on pipe
2025-10-10T14:39:33.909241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602747808311213:2438], now have 1 active actors on pipe
2025-10-10T14:39:33.909247Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:33.909262Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:33.909265Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:33.909298Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602747026070013:6611]
2025-10-10T14:39:33.909306Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:33.909359Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:33.909355Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3032
2025-10-10T14:39:33.909356Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3032
2025-10-10T14:39:33.909486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:33.909497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:33.909534Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1b5ccbac-7d282fcb-5e20b1d1-2e00f8fe_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:33.909543Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:33.909547Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:33.909550Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:33.909565Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:33.909577Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:33.909593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:33.909835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:33.909845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:33.909863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:33.909958Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3033 partition: 0 MaxSeqNo: 40 sessionId: src_id|1b5ccbac-7d282fcb-5e20b1d1-2e00f8fe_0
2025-10-10T14:39:33.910402Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a02015d-3059d9fb-7cdb46c8-99a5710b_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|1b5ccbac-7d282fcb-5e20b1d1-2e00f8fe_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:33.913460Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1b5ccbac-7d282fcb-5e20b1d1-2e00f8fe_0] Write session: try to update token
2025-10-10T14:39:33.913479Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1b5ccbac-7d282fcb-5e20b1d1-2e00f8fe_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:33.921787Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:39:33.921809Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:33.921820Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602747026070013:6611]
2025-10-10T14:39:33.921877Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:39:33.921946Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:39:33.922090Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:39:33.922252Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:33.922401Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:33.922555Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:33.922904Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:39:33.922951Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:39:33.930428Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3033 sessionId: src_id|1b5ccbac-7d282fcb-5e20b1d1-2e00f8fe_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:33.933108Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:33.933368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:33.933394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:33.933447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:39:33.933550Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:39:33.944373Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:33.944398Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:33.944401Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:33.944403Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:33.944415Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602747026070013:6611]
2025-10-10T14:39:33.944419Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602747026070013:6611]
2025-10-10T14:39:33.944423Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602747026070013:6611]
2025-10-10T14:39:33.944479Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:33.944481Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:33.944493Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:33.944493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:33.944500Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:33.944500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:33.944656Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:33.986005Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602747808311418:2572]
2025-10-10T14:39:33.986208Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 pipe creation result: OK TabletId: 72075186224037892 Generation: 3032, pipe: [1:7559602747808311418:2572]
2025-10-10T14:39:34.065545Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:34.074549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:34.074581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:34.074772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:34.074837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:34.074909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:34.074979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:34.075431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:34.075448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:34.075522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:34.075586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:34.075651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:34.075716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:34.075763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:34.075769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:34.075836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:34.075892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:34.075951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:34.076016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:34.076064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:34.076070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:34.076157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:34.076218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:34.076282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:34.076342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:34.076384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:34.076389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:34.076456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:34.076522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:34.076586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:34.076647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:34.076692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:34.076698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:34.076769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:34.076830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:34.076891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:34.076964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:34.077011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:34.077018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:34.077085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:34.077144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:34.077208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:34.077271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:34.077321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:34.077344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:34.077410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:34.077468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:34.077532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:34.077595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:34.077637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:34.077642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:34.077705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:34.077762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:34.077832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:34.077894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:34.077936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:34.077942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:34.078003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:34.078068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:34.078131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:34.078194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:34.078257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:34.078264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:34.078334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602747808311418:2572], now have 1 active actors on pipe
2025-10-10T14:39:34.078628Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:34.078650Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 31 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602747808311418:2572]
2025-10-10T14:39:34.078684Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:34.078687Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:34.078722Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3033 reason: error at write: Disconnected sessionId: src_id|1b5ccbac-7d282fcb-5e20b1d1-2e00f8fe_0
2025-10-10T14:39:34.078990Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3033 sessionId: src_id|1b5ccbac-7d282fcb-5e20b1d1-2e00f8fe_0 is DEAD
2025-10-10T14:39:34.079019Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:34.079142Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b5ccbac-7d282fcb-5e20b1d1-2e00f8fe_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:34.079153Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b5ccbac-7d282fcb-5e20b1d1-2e00f8fe_0] Write session will restart in 0.006359s
2025-10-10T14:39:34.079180Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b5ccbac-7d282fcb-5e20b1d1-2e00f8fe_0] Write session: Do CDS request
2025-10-10T14:39:34.079187Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b5ccbac-7d282fcb-5e20b1d1-2e00f8fe_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:34.086986Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1b5ccbac-7d282fcb-5e20b1d1-2e00f8fe_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:34.087126Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:34.087142Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3034
2025-10-10T14:39:34.087285Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3034 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:34.087326Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3034 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:34.087337Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3034 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:34.087341Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:34.087874Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3034 sessionId:  describe result for acl check
2025-10-10T14:39:34.087930Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:34.087937Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:34.087940Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:34.087947Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602752103278780:10389] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:34.088636Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602752103278780:10389] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:34.091526Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602752103278780:10389] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:34.092973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:34.094938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:34.095010Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602752103278780:10389] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:34.095024Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602752103278780:10389] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:34.095028Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602752103278780:10389] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:34.095038Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3034 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:34.095134Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:34.095147Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:34.095159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:34.095206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:34.095251Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602751321037476:6552]
2025-10-10T14:39:34.095945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:34.096267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:34.096309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:34.096647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:34.096709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:34.096715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:34.096716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:34.096717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:34.096719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:34.096720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:34.096722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:34.096723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:34.096725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:34.096726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:34.096727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:34.096729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:34.096730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:34.096736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:34.096750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:34.096755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:34.096759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:34.096766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:34.096771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:34.096775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:34.096780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:34.096784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:34.096789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:34.096794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:34.096803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:34.096808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:34.096815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:34.096828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:34.096839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:34.096846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:34.096855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:34.096859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:34.096864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:34.096870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:34.096876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:34.096882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:34.096886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:34.096892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:34.096912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:34.096922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:34.096927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:34.096937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:34.096946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:34.096951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:34.096959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:34.096965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:34.096974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:34.096979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:34.096988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:34.096998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:34.097004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:34.097013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:34.097059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:34.099520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:34.100156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:34.100170Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:34.100173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:34.100177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:34.100184Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3033 [2:7559602751321037476:6552]
2025-10-10T14:39:34.100199Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:34.100218Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:34.100221Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:34.100225Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:34.100228Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:34.100244Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:34.100257Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:34.100264Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:34.100322Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:34.100329Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:34.100331Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:34.100334Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:34.100404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:34.100411Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:34.100424Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:34.100442Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:34.100466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:34.100493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602752103278904:10389], now have 1 active actors on pipe
2025-10-10T14:39:34.100501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602752103278729:2438], now have 1 active actors on pipe
2025-10-10T14:39:34.100509Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602751321037471:6552]
2025-10-10T14:39:34.100517Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602751321037471:6552]
2025-10-10T14:39:34.100519Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602751321037471:6552]
2025-10-10T14:39:34.100532Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:34.100548Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:34.100550Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:34.100553Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:34.100556Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:34.100570Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:34.100573Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:34.100544Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3033
2025-10-10T14:39:34.100563Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3033
2025-10-10T14:39:34.100606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:34.100617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:34.100632Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602751321037471:6552]
2025-10-10T14:39:34.100642Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:34.100666Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:34.100679Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bbb848d4-dc1eb3f3-92cc2e50-307a3187_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:34.100686Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:34.100695Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:34.100698Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:34.100710Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:34.100720Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:34.100745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:34.100885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:34.100892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:34.100915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:34.101003Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3034 partition: 0 MaxSeqNo: 40 sessionId: src_id|bbb848d4-dc1eb3f3-92cc2e50-307a3187_0
2025-10-10T14:39:34.101438Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b5ccbac-7d282fcb-5e20b1d1-2e00f8fe_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|bbb848d4-dc1eb3f3-92cc2e50-307a3187_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:34.104194Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bbb848d4-dc1eb3f3-92cc2e50-307a3187_0] Write session: try to update token
2025-10-10T14:39:34.104210Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bbb848d4-dc1eb3f3-92cc2e50-307a3187_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:34.121326Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3034 sessionId: src_id|bbb848d4-dc1eb3f3-92cc2e50-307a3187_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:34.124236Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:34.123688Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:34.123717Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:34.123721Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:34.123723Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:34.123739Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602751321037471:6552]
2025-10-10T14:39:34.123743Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602751321037471:6552]
2025-10-10T14:39:34.123747Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602751321037471:6552]
2025-10-10T14:39:34.123803Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:34.123803Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:34.123810Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:34.123812Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:34.123814Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:34.123815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:34.123982Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:34.179027Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602752103278916:2572]
2025-10-10T14:39:34.179454Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 pipe creation result: OK TabletId: 72075186224037892 Generation: 3033, pipe: [1:7559602752103278916:2572]
2025-10-10T14:39:34.244280Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:34.244922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:34.244943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:34.244995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602752103278916:2572], now have 1 active actors on pipe
2025-10-10T14:39:34.245221Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:34.245227Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 32 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602752103278916:2572]
2025-10-10T14:39:34.245236Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:34.245251Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:34.245250Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:34.245648Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bbb848d4-dc1eb3f3-92cc2e50-307a3187_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:34.245660Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bbb848d4-dc1eb3f3-92cc2e50-307a3187_0] Write session will restart in 0.007334s
2025-10-10T14:39:34.245684Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bbb848d4-dc1eb3f3-92cc2e50-307a3187_0] Write session: Do CDS request
2025-10-10T14:39:34.245690Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bbb848d4-dc1eb3f3-92cc2e50-307a3187_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:34.245291Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3034 reason: error at write: Disconnected sessionId: src_id|bbb848d4-dc1eb3f3-92cc2e50-307a3187_0
2025-10-10T14:39:34.245506Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3034 sessionId: src_id|bbb848d4-dc1eb3f3-92cc2e50-307a3187_0 is DEAD
2025-10-10T14:39:34.253917Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bbb848d4-dc1eb3f3-92cc2e50-307a3187_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:34.254012Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:34.254030Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3035
2025-10-10T14:39:34.254166Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3035 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:34.254219Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3035 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:34.254231Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3035 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:34.254236Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:34.254754Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3035 sessionId:  describe result for acl check
2025-10-10T14:39:34.254792Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:34.254795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:34.254797Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:34.254803Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602752103278933:10385] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:34.255386Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602752103278933:10385] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:34.257647Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602752103278933:10385] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:34.260737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602752103278933:10385] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:34.260754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602752103278933:10385] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:34.260758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602752103278933:10385] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:34.260768Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3035 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:34.264633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:34.265218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:34.265426Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:34.265437Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:34.265449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:34.265509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:34.265550Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602751321037604:6550]
2025-10-10T14:39:34.266352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:34.266738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:34.266808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:34.267164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:34.267230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:34.267237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:34.267238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:34.267239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:34.267241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:34.267242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:34.267244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:34.267248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:34.267249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:34.267250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:34.267252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:34.267253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:34.267254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:34.267261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:34.267275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:34.267279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:34.267288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:34.267292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:34.267296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:34.267300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:34.267304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:34.267308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:34.267314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:34.267317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:34.267321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:34.267325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:34.267335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:34.267349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:34.267361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:34.267371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:34.267376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:34.267381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:34.267385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:34.267390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:34.267395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:34.267401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:34.267405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:34.267411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:34.267416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:34.267427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:34.267432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:34.267441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:34.267450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:34.267459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:34.267467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:34.267472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:34.267481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:34.267491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:34.267499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:34.267505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:34.267514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:34.267523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:34.267561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:34.270183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:34.270948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:34.270962Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:34.270964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:34.270969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:34.270976Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3034 [2:7559602751321037604:6550]
2025-10-10T14:39:34.270988Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:34.271006Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:34.271009Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:34.271012Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:34.271014Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:34.271031Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:34.271043Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:34.271051Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:34.271118Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:34.271124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:34.271126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:34.271129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:34.271199Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:34.271206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:34.271218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:34.271234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:34.271252Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:34.271280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602752103278918:2438], now have 1 active actors on pipe
2025-10-10T14:39:34.271288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602752103279095:10385], now have 1 active actors on pipe
2025-10-10T14:39:34.271296Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602751321037599:6550]
2025-10-10T14:39:34.271303Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602751321037599:6550]
2025-10-10T14:39:34.271305Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602751321037599:6550]
2025-10-10T14:39:34.271319Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:34.271331Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:34.271338Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:34.271342Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:34.271345Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:34.271355Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:34.271358Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:34.271386Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602751321037599:6550]
2025-10-10T14:39:34.271393Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:34.271400Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:34.271367Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3034
2025-10-10T14:39:34.271371Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3034
2025-10-10T14:39:34.271426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:34.271439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:34.271481Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|136a334e-74f5996a-13f1f0c7-bf90c4de_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:34.271492Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:34.271496Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:34.271499Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:34.271511Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:34.271526Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:34.271542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:34.271681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:34.271690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:34.271706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:34.271807Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3035 partition: 0 MaxSeqNo: 40 sessionId: src_id|136a334e-74f5996a-13f1f0c7-bf90c4de_0
2025-10-10T14:39:34.272274Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bbb848d4-dc1eb3f3-92cc2e50-307a3187_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|136a334e-74f5996a-13f1f0c7-bf90c4de_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:34.274984Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|136a334e-74f5996a-13f1f0c7-bf90c4de_0] Write session: try to update token
2025-10-10T14:39:34.275005Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|136a334e-74f5996a-13f1f0c7-bf90c4de_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:34.288776Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3035 sessionId: src_id|136a334e-74f5996a-13f1f0c7-bf90c4de_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:34.292085Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:34.292113Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:34.292116Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:34.292119Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:34.292131Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602751321037599:6550]
2025-10-10T14:39:34.292137Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602751321037599:6550]
2025-10-10T14:39:34.292141Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602751321037599:6550]
2025-10-10T14:39:34.292193Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:34.292200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:34.292207Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:34.292209Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:34.292212Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:34.292221Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:34.292408Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:34.292450Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:34.345405Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602752103279109:2572]
2025-10-10T14:39:34.345723Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 pipe creation result: OK TabletId: 72075186224037892 Generation: 3034, pipe: [1:7559602752103279109:2572]
2025-10-10T14:39:34.408509Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:34.409062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:34.409085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:34.409131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602752103279109:2572], now have 1 active actors on pipe
2025-10-10T14:39:34.409373Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:34.409382Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:34.409451Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 33 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602752103279109:2572]
2025-10-10T14:39:34.409680Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:34.409692Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:34.409754Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3035 reason: error at write: Disconnected sessionId: src_id|136a334e-74f5996a-13f1f0c7-bf90c4de_0
2025-10-10T14:39:34.409982Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3035 sessionId: src_id|136a334e-74f5996a-13f1f0c7-bf90c4de_0 is DEAD
2025-10-10T14:39:34.410347Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|136a334e-74f5996a-13f1f0c7-bf90c4de_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:34.410360Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|136a334e-74f5996a-13f1f0c7-bf90c4de_0] Write session will restart in 0.005855s
2025-10-10T14:39:34.410399Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|136a334e-74f5996a-13f1f0c7-bf90c4de_0] Write session: Do CDS request
2025-10-10T14:39:34.410406Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|136a334e-74f5996a-13f1f0c7-bf90c4de_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:34.417967Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|136a334e-74f5996a-13f1f0c7-bf90c4de_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:34.418057Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:34.418072Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3036
2025-10-10T14:39:34.418244Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3036 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:34.418280Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3036 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:34.418291Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3036 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:34.418296Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:34.418803Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3036 sessionId:  describe result for acl check
2025-10-10T14:39:34.418844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:34.418845Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:34.418847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:34.418854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602752103279168:10380] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:34.419457Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602752103279168:10380] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:34.422187Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602752103279168:10380] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:34.426406Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602752103279168:10380] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:34.426425Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602752103279168:10380] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:34.426429Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602752103279168:10380] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:34.426439Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3036 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:34.426768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:34.427959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:34.428215Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:34.428228Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:34.428241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:34.428294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:34.428345Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602751321037730:6536]
2025-10-10T14:39:34.429134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:34.429526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:34.429586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:34.429973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:34.430033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:34.430039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:34.430040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:34.430042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:34.430043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:34.430045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:34.430047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:34.430048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:34.430049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:34.430051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:34.430052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:34.430053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:34.430055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:34.430062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:34.430076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:34.430081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:34.430085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:34.430089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:34.430094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:34.430098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:34.430102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:34.430107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:34.430111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:34.430115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:34.430119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:34.430123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:34.430133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:34.430143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:34.430150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:34.430156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:34.430161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:34.430167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:34.430172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:34.430178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:34.430190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:34.430206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:34.430211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:34.430217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:34.430223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:34.430229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:34.430234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:34.430240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:34.430244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:34.430250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:34.430255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:34.430260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:34.430268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:34.430273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:34.430280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:34.430290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:34.430295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:34.430301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:34.430340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:34.433011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:34.434103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:34.434119Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:34.434122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:34.434126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:34.434136Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3035 [2:7559602751321037730:6536]
2025-10-10T14:39:34.434153Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:34.434182Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:34.434194Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:34.434198Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:34.434201Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:34.434220Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:34.434233Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:34.434246Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:34.434312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:34.434318Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:34.434320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:34.434323Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:34.434399Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:34.434407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:34.434420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:34.434432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:34.434449Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:34.434475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602752103279110:2438], now have 1 active actors on pipe
2025-10-10T14:39:34.434484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602752103279289:10380], now have 1 active actors on pipe
2025-10-10T14:39:34.434492Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602751321037724:6536]
2025-10-10T14:39:34.434495Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602751321037724:6536]
2025-10-10T14:39:34.434497Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602751321037724:6536]
2025-10-10T14:39:34.434513Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:34.434528Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:34.434543Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:34.434551Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:34.434554Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:34.434556Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:34.434559Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:34.434590Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602751321037724:6536]
2025-10-10T14:39:34.434602Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:34.434641Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:34.434601Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3035
2025-10-10T14:39:34.434614Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3035
2025-10-10T14:39:34.434775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:34.434795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:34.434833Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7b153e2d-5008fc10-4b8ad80a-d38b5e84_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:34.434850Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:34.434855Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:34.434858Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:34.434872Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:34.434891Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:34.434927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:34.435144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:34.435156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:34.435174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:34.435285Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3036 partition: 0 MaxSeqNo: 40 sessionId: src_id|7b153e2d-5008fc10-4b8ad80a-d38b5e84_0
2025-10-10T14:39:34.435740Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|136a334e-74f5996a-13f1f0c7-bf90c4de_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|7b153e2d-5008fc10-4b8ad80a-d38b5e84_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:34.438771Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7b153e2d-5008fc10-4b8ad80a-d38b5e84_0] Write session: try to update token
2025-10-10T14:39:34.438793Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7b153e2d-5008fc10-4b8ad80a-d38b5e84_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:34.450928Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:39:34.450947Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:34.450958Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602751321037724:6536]
2025-10-10T14:39:34.451012Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:39:34.451214Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:39:34.451363Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:34.451508Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:34.451650Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:34.451838Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:39:34.451880Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:39:34.453107Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:39:34.456323Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3036 sessionId: src_id|7b153e2d-5008fc10-4b8ad80a-d38b5e84_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:34.459185Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:34.459486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:34.459513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:34.459557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:39:34.459680Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:39:34.477894Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:34.477915Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:34.477923Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:34.477926Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:34.477937Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602751321037724:6536]
2025-10-10T14:39:34.477941Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602751321037724:6536]
2025-10-10T14:39:34.477944Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602751321037724:6536]
2025-10-10T14:39:34.477995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:34.478003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:34.478003Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:34.478010Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:34.478011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:34.478157Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:34.478159Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:34.509776Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602752103279302:2572]
2025-10-10T14:39:34.510084Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 pipe creation result: OK TabletId: 72075186224037892 Generation: 3035, pipe: [1:7559602752103279302:2572]
2025-10-10T14:39:34.598208Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:34.607304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:34.607332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:34.607494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:34.607570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:34.607658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:34.607753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:34.607811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:34.607825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:34.607920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:34.607988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:34.608064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:34.608134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:34.608183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:34.608189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:34.608259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:34.608317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:34.608380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:34.608442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:34.608483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:34.608486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:34.608560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:34.608626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:34.608688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:34.608766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:34.608813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:34.608816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:34.608905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:34.608969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:34.609039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:34.609106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:34.609149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:34.609152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:34.609223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:34.609284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:34.609479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:34.609559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:34.609618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:34.609631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:34.609704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:34.609775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:34.609839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:34.609901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:34.609956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:34.609970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:34.610044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:34.610106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:34.610175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:34.610245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:34.610298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:34.610305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:34.610389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:34.610486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:34.610581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:34.610656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:34.610703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:34.610711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:34.610786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:34.610855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:34.610925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:34.610997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:34.611050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:34.611057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:34.611119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602752103279302:2572], now have 1 active actors on pipe
2025-10-10T14:39:34.612605Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b153e2d-5008fc10-4b8ad80a-d38b5e84_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:34.612623Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b153e2d-5008fc10-4b8ad80a-d38b5e84_0] Write session will restart in 0.009322s
2025-10-10T14:39:34.612651Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b153e2d-5008fc10-4b8ad80a-d38b5e84_0] Write session: Do CDS request
2025-10-10T14:39:34.612657Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b153e2d-5008fc10-4b8ad80a-d38b5e84_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:34.612483Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:34.611413Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 34 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602752103279302:2572]
2025-10-10T14:39:34.611478Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:34.611694Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:34.611710Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:34.611749Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3036 reason: error at write: Disconnected sessionId: src_id|7b153e2d-5008fc10-4b8ad80a-d38b5e84_0
2025-10-10T14:39:34.612032Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3036 sessionId: src_id|7b153e2d-5008fc10-4b8ad80a-d38b5e84_0 is DEAD
2025-10-10T14:39:34.623042Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7b153e2d-5008fc10-4b8ad80a-d38b5e84_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:34.623096Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:34.623115Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3037
2025-10-10T14:39:34.623348Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3037 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:34.623409Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3037 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:34.623437Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3037 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:34.623447Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:34.623995Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3037 sessionId:  describe result for acl check
2025-10-10T14:39:34.624069Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:34.624083Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:34.624087Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:34.624096Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602752103279392:10376] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:34.624701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602752103279392:10376] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:34.628078Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602752103279392:10376] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:34.632453Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602752103279392:10376] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:34.632471Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602752103279392:10376] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:34.632476Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602752103279392:10376] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:34.632486Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3037 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:34.633655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:34.635626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:34.635849Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:34.635861Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:34.635874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:34.635937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:34.635985Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602751321037870:6547]
2025-10-10T14:39:34.636597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:34.637003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:34.637066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:34.637423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:34.637486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:34.637494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:34.637495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:34.637496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:34.637497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:34.637499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:34.637500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:34.637502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:34.637503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:34.637504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:34.637506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:34.637507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:34.637508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:34.637514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:34.637529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:34.637533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:34.637538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:34.637542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:34.637546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:34.637550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:34.637554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:34.637558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:34.637563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:34.637567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:34.637571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:34.637575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:34.637583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:34.637591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:34.637598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:34.637604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:34.637608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:34.637613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:34.637617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:34.637622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:34.637626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:34.637631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:34.637636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:34.637642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:34.637646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:34.637652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:34.637656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:34.637661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:34.637667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:34.637672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:34.637676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:34.637684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:34.637688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:34.637701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:34.637706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:34.637711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:34.637715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:34.637720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:34.637770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:34.640366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:34.641075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:34.641088Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:34.641090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:34.641095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:34.641102Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3036 [2:7559602751321037870:6547]
2025-10-10T14:39:34.641117Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:34.641139Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:34.641148Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:34.641153Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:34.641156Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:34.641174Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:34.641183Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:34.641192Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:34.641260Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:34.641268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:34.641270Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:34.641273Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:34.641367Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:34.641378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:34.641392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:34.641409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:34.641427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:34.641455Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602751321037865:6547]
2025-10-10T14:39:34.641462Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602751321037865:6547]
2025-10-10T14:39:34.641464Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602751321037865:6547]
2025-10-10T14:39:34.641475Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:34.641481Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:34.641484Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:34.641486Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:34.641495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602752103279487:10376], now have 1 active actors on pipe
2025-10-10T14:39:34.641499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602752103279308:2438], now have 1 active actors on pipe
2025-10-10T14:39:34.641511Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:34.641533Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:34.641541Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:34.641531Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3036
2025-10-10T14:39:34.641568Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3036
2025-10-10T14:39:34.641573Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602751321037865:6547]
2025-10-10T14:39:34.641585Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:34.641592Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:34.641603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:34.641608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:34.641664Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fdd3ec7d-2071e71c-9fc785a8-e487e6c0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:34.641678Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:34.641682Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:34.641685Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:34.641698Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:34.641713Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:34.641736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:34.641926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:34.641937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:34.641956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:34.642051Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3037 partition: 0 MaxSeqNo: 40 sessionId: src_id|fdd3ec7d-2071e71c-9fc785a8-e487e6c0_0
2025-10-10T14:39:34.642503Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b153e2d-5008fc10-4b8ad80a-d38b5e84_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|fdd3ec7d-2071e71c-9fc785a8-e487e6c0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:34.645533Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fdd3ec7d-2071e71c-9fc785a8-e487e6c0_0] Write session: try to update token
2025-10-10T14:39:34.645557Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fdd3ec7d-2071e71c-9fc785a8-e487e6c0_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:34.661671Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:34.661695Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:34.661700Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:34.661702Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:34.661714Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602751321037865:6547]
2025-10-10T14:39:34.661719Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602751321037865:6547]
2025-10-10T14:39:34.661723Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602751321037865:6547]
2025-10-10T14:39:34.661771Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:34.661776Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:34.661779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:34.661781Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:34.661790Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:34.661793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:34.661930Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:34.663696Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3037 sessionId: src_id|fdd3ec7d-2071e71c-9fc785a8-e487e6c0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:34.666522Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:34.711461Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602752103279502:2572]
2025-10-10T14:39:34.711849Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 pipe creation result: OK TabletId: 72075186224037892 Generation: 3036, pipe: [1:7559602752103279502:2572]
2025-10-10T14:39:34.779202Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:34.779450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:34.779467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:34.779515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602752103279502:2572], now have 1 active actors on pipe
2025-10-10T14:39:34.779754Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:34.779771Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:34.779839Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 35 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602752103279502:2572]
2025-10-10T14:39:34.779877Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:39:34.779971Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3037 reason: status is not ok: tablet will be restarted right now sessionId: src_id|fdd3ec7d-2071e71c-9fc785a8-e487e6c0_0
2025-10-10T14:39:34.780188Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3037 sessionId: src_id|fdd3ec7d-2071e71c-9fc785a8-e487e6c0_0 is DEAD
2025-10-10T14:39:34.780353Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fdd3ec7d-2071e71c-9fc785a8-e487e6c0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:39:34.780361Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fdd3ec7d-2071e71c-9fc785a8-e487e6c0_0] Write session will restart in 0.008955s
2025-10-10T14:39:34.780385Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fdd3ec7d-2071e71c-9fc785a8-e487e6c0_0] Write session: Do CDS request
2025-10-10T14:39:34.780392Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fdd3ec7d-2071e71c-9fc785a8-e487e6c0_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:34.790987Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fdd3ec7d-2071e71c-9fc785a8-e487e6c0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:34.791002Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:34.791020Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3038
2025-10-10T14:39:34.791260Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3038 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:34.791299Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3038 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:34.791311Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3038 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:34.791314Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:34.791911Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3038 sessionId:  describe result for acl check
2025-10-10T14:39:34.791959Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:34.791969Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:34.791971Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:34.791977Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602752103279665:10366] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:34.792573Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602752103279665:10366] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:34.794828Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602752103279665:10366] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:34.794980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:34.796852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:34.797084Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:34.797097Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:34.797109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:34.797165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:34.797210Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602751321037997:6544]
2025-10-10T14:39:34.797800Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602752103279665:10366] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:34.797814Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602752103279665:10366] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:34.797818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602752103279665:10366] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:34.797828Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3038 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:34.797860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:34.798160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:34.798209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:34.798543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:34.798613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:34.798620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:34.798621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:34.798622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:34.798624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:34.798625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:34.798626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:34.798627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:34.798629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:34.798630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:34.798631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:34.798633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:34.798634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:34.798641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:34.798654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:34.798658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:34.798662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:34.798666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:34.798670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:34.798674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:34.798677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:34.798681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:34.798684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:34.798688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:34.798691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:34.798694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:34.798704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:34.798713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:34.798719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:34.798725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:34.798729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:34.798735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:34.798740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:34.798745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:34.798750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:34.798758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:34.798763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:34.798772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:34.798777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:34.798783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:34.798787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:34.798793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:34.798800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:34.798808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:34.798812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:34.798819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:34.798824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:34.798829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:34.798833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:34.798839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:34.798844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:34.798849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:34.798896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:34.801515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:34.801892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:34.801904Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:34.801906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:34.801910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:34.801917Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3037 [2:7559602751321037997:6544]
2025-10-10T14:39:34.801933Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:34.801955Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:34.801963Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:34.801967Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:34.801970Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:34.801989Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:34.802003Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:34.802011Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:34.802077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:34.802085Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:34.802087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:34.802090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:34.802165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:34.802173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:34.802186Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:34.802203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:34.802228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:34.802255Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602751321037992:6544]
2025-10-10T14:39:34.802262Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602751321037992:6544]
2025-10-10T14:39:34.802265Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602751321037992:6544]
2025-10-10T14:39:34.802279Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:34.802294Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:34.802302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602752103279698:10366], now have 1 active actors on pipe
2025-10-10T14:39:34.802306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602752103279515:2438], now have 1 active actors on pipe
2025-10-10T14:39:34.802306Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:34.802309Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:34.802316Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:34.802333Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:34.802342Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:34.802326Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3037
2025-10-10T14:39:34.802336Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3037
2025-10-10T14:39:34.802376Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602751321037992:6544]
2025-10-10T14:39:34.802390Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:34.802414Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:34.802546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:34.802558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:34.802589Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|426ece3a-49de30d0-d1348ba8-ddfe54da_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:34.802603Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:34.802612Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:34.802615Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:34.802628Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:34.802643Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:34.802663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:34.802875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:34.802884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:34.802901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:34.803023Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3038 partition: 0 MaxSeqNo: 40 sessionId: src_id|426ece3a-49de30d0-d1348ba8-ddfe54da_0
2025-10-10T14:39:34.803516Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fdd3ec7d-2071e71c-9fc785a8-e487e6c0_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|426ece3a-49de30d0-d1348ba8-ddfe54da_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:34.806372Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|426ece3a-49de30d0-d1348ba8-ddfe54da_0] Write session: try to update token
2025-10-10T14:39:34.806394Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|426ece3a-49de30d0-d1348ba8-ddfe54da_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:34.815308Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:39:34.815328Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:34.815340Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602751321037992:6544]
2025-10-10T14:39:34.815400Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:39:34.815415Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:39:34.815601Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:39:34.815751Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:34.815909Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:34.816084Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:34.816317Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:39:34.816375Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:39:34.824163Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3038 sessionId: src_id|426ece3a-49de30d0-d1348ba8-ddfe54da_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:34.827041Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:34.827355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:34.827383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:34.827431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:39:34.827554Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:39:34.833859Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:34.833886Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:34.833890Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:34.833892Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:34.833904Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602751321037992:6544]
2025-10-10T14:39:34.833908Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602751321037992:6544]
2025-10-10T14:39:34.833914Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602751321037992:6544]
2025-10-10T14:39:34.833978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:34.833979Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:34.833986Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:34.833990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:34.833991Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:34.833993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:34.834137Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:34.879957Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602752103279715:2572]
2025-10-10T14:39:34.880283Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 pipe creation result: OK TabletId: 72075186224037892 Generation: 3037, pipe: [1:7559602752103279715:2572]
2025-10-10T14:39:34.955075Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:34.963985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:34.964018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:34.964205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:34.964277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:34.964350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:34.964421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:34.964467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:34.964478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:34.964549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:34.964611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:34.964678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:34.964749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:34.964793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:34.964800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:34.964873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:34.964954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:34.965018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:34.965084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:34.965131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:34.965138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:34.965208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:34.965276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:34.965359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:34.965425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:34.965477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:34.965484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:34.965554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:34.965618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:34.965683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:34.965751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:34.965799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:34.965807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:34.965876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:34.965936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:34.966012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:34.966075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:34.966121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:34.966128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:34.966195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:34.966261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:34.966331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:34.966401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:34.966447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:34.966454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:34.966534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:34.966597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:34.966663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:34.966729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:34.966775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:34.966782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:34.966851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:34.966914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:34.966983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:34.967049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:34.967096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:34.967107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:34.967173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:34.967235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:34.967302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:34.967369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:34.967415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:34.967423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:34.967499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602752103279715:2572], now have 1 active actors on pipe
2025-10-10T14:39:34.967844Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:34.967861Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:34.967869Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 36 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602752103279715:2572]
2025-10-10T14:39:34.967896Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:34.967903Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3038 reason: error at write: Disconnected sessionId: src_id|426ece3a-49de30d0-d1348ba8-ddfe54da_0
2025-10-10T14:39:34.968180Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3038 sessionId: src_id|426ece3a-49de30d0-d1348ba8-ddfe54da_0 is DEAD
2025-10-10T14:39:34.969018Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:34.969574Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|426ece3a-49de30d0-d1348ba8-ddfe54da_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:34.969606Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|426ece3a-49de30d0-d1348ba8-ddfe54da_0] Write session will restart in 0.009263s
2025-10-10T14:39:34.969633Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|426ece3a-49de30d0-d1348ba8-ddfe54da_0] Write session: Do CDS request
2025-10-10T14:39:34.969640Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|426ece3a-49de30d0-d1348ba8-ddfe54da_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:34.979967Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|426ece3a-49de30d0-d1348ba8-ddfe54da_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:34.980041Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:34.980059Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3039
2025-10-10T14:39:34.980215Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3039 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:34.980252Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3039 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:34.980266Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3039 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:34.980270Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:34.980782Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3039 sessionId:  describe result for acl check
2025-10-10T14:39:34.980820Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:34.980829Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:34.980832Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:34.980838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602752103279811:10356] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:34.981496Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602752103279811:10356] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:34.984842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602752103279811:10356] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:34.985405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:34.987883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:34.988109Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:34.988121Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:34.988132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:34.988186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:34.988230Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602751321038127:6540]
2025-10-10T14:39:34.988816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:34.989184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:34.989234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:34.989240Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602752103279811:10356] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:34.989258Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602752103279811:10356] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:34.989263Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602752103279811:10356] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:34.989273Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3039 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:34.989599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:34.989677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:34.989685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:34.989687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:34.989688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:34.989689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:34.989690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:34.989691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:34.989692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:34.989693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:34.989694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:34.989695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:34.989697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:34.989698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:34.989704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:34.989718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:34.989722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:34.989726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:34.989730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:34.989734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:34.989738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:34.989742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:34.989746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:34.989750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:34.989754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:34.989757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:34.989760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:34.989769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:34.989778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:34.989784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:34.989789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:34.989793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:34.989797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:34.989802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:34.989807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:34.989811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:34.989816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:34.989821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:34.989825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:34.989830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:34.989835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:34.989839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:34.989843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:34.989850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:34.989855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:34.989861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:34.989866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:34.989872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:34.989877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:34.989881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:34.989887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:34.989891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:34.989895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:34.989933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:34.992463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:34.993398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:34.993410Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:34.993412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:34.993416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:34.993423Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3038 [2:7559602751321038127:6540]
2025-10-10T14:39:34.993435Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:34.993452Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:34.993455Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:34.993459Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:34.993461Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:34.993477Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:34.993489Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:34.993497Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:34.993552Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:34.993558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:34.993561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:34.993563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:34.993626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:34.993633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:34.993644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:34.993664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:34.993682Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:34.993703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602752103279905:10356], now have 1 active actors on pipe
2025-10-10T14:39:34.993712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602752103279722:2438], now have 1 active actors on pipe
2025-10-10T14:39:34.993719Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602751321038122:6540]
2025-10-10T14:39:34.993722Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602751321038122:6540]
2025-10-10T14:39:34.993724Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602751321038122:6540]
2025-10-10T14:39:34.993738Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:34.993751Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:34.993767Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:34.993774Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:34.993789Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3038
2025-10-10T14:39:34.993793Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:34.993798Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602751321038122:6540]
2025-10-10T14:39:34.993801Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:34.993806Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:34.993808Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:34.993816Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:34.993906Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3038
2025-10-10T14:39:34.993980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:34.994001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:34.994036Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e547510b-16b2e4ed-b7343f19-a224c1ff_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:34.994044Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:34.994050Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:34.994053Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:34.994064Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:34.994074Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:34.994094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:34.994252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:34.994265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:34.994290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:34.994388Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3039 partition: 0 MaxSeqNo: 40 sessionId: src_id|e547510b-16b2e4ed-b7343f19-a224c1ff_0
2025-10-10T14:39:34.994809Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|426ece3a-49de30d0-d1348ba8-ddfe54da_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|e547510b-16b2e4ed-b7343f19-a224c1ff_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:34.997661Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e547510b-16b2e4ed-b7343f19-a224c1ff_0] Write session: try to update token
2025-10-10T14:39:34.997685Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e547510b-16b2e4ed-b7343f19-a224c1ff_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:35.006098Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:39:35.006120Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:35.006132Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602751321038122:6540]
2025-10-10T14:39:35.006187Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:39:35.006189Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:39:35.006373Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:39:35.006527Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:35.006668Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:35.006814Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:35.007027Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:39:35.007086Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:39:35.015954Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3039 sessionId: src_id|e547510b-16b2e4ed-b7343f19-a224c1ff_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:35.018761Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:35.019004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:35.019029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:35.019077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:39:35.019208Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:39:35.024245Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:35.024265Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:35.024268Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:35.024271Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:35.024282Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602751321038122:6540]
2025-10-10T14:39:35.024287Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602751321038122:6540]
2025-10-10T14:39:35.024294Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602751321038122:6540]
2025-10-10T14:39:35.024348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:35.024350Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:35.024360Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:35.024362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:35.024364Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:35.024365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:35.024496Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:35.067870Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602756398247223:2572]
2025-10-10T14:39:35.068164Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 pipe creation result: OK TabletId: 72075186224037892 Generation: 3038, pipe: [1:7559602756398247223:2572]
2025-10-10T14:39:35.137609Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:35.146505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:35.146538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:35.146731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:35.146803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:35.146870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:35.146935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:35.146986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:35.146996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:35.147074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:35.147135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:35.147199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:35.147273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:35.147319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:35.147326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:35.147399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:35.147461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:35.147535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:35.147604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:35.147655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:35.147663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:35.147741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:35.147809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:35.147877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:35.147948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:35.147997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:35.148005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:35.148078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:35.148149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:35.148215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:35.148278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:35.148325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:35.148328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:35.148405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:35.148466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:35.148527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:35.148586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:35.148630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:35.148634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:35.148705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:35.148760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:35.148821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:35.148904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:35.148945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:35.148948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:35.149017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:35.149075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:35.149134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:35.149192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:35.149238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:35.149241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:35.149315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:35.149539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:35.149607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:35.149675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:35.149733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:35.149743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:35.149815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:35.149880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:35.149946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:35.150007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:35.150054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:35.150062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:35.150129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602756398247223:2572], now have 1 active actors on pipe
2025-10-10T14:39:35.150380Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 37 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602756398247223:2572]
2025-10-10T14:39:35.150414Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:35.150855Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:35.150871Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:35.150903Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3039 reason: error at write: Disconnected sessionId: src_id|e547510b-16b2e4ed-b7343f19-a224c1ff_0
2025-10-10T14:39:35.151171Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3039 sessionId: src_id|e547510b-16b2e4ed-b7343f19-a224c1ff_0 is DEAD
2025-10-10T14:39:35.151288Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e547510b-16b2e4ed-b7343f19-a224c1ff_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:35.151302Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e547510b-16b2e4ed-b7343f19-a224c1ff_0] Write session will restart in 0.006134s
2025-10-10T14:39:35.151341Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e547510b-16b2e4ed-b7343f19-a224c1ff_0] Write session: Do CDS request
2025-10-10T14:39:35.151347Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e547510b-16b2e4ed-b7343f19-a224c1ff_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:35.151423Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:35.158957Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e547510b-16b2e4ed-b7343f19-a224c1ff_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:35.158977Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:35.158995Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3040
2025-10-10T14:39:35.159188Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3040 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:35.159239Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3040 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:35.159261Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3040 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:35.159271Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:35.159728Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3040 sessionId:  describe result for acl check
2025-10-10T14:39:35.159774Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:35.159780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:35.159782Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:35.159788Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602756398247308:10340] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:35.160404Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602756398247308:10340] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:35.162962Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602756398247308:10340] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:35.165983Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602756398247308:10340] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:35.166006Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602756398247308:10340] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:35.166009Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602756398247308:10340] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:35.166018Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3040 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:35.167976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:35.170706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:35.171270Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:35.171288Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:35.171306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:35.171385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:35.171436Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602755616005593:6519]
2025-10-10T14:39:35.172050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:35.172451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:35.172532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:35.172910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:35.173007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:35.173016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:35.173017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:35.173018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:35.173020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:35.173022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:35.173023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:35.173024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:35.173026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:35.173027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:35.173028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:35.173029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:35.173031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:35.173037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:35.173052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:35.173057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:35.173061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:35.173064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:35.173069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:35.173073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:35.173077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:35.173081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:35.173086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:35.173090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:35.173094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:35.173097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:35.173107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:35.173116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:35.173123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:35.173128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:35.173135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:35.173140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:35.173144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:35.173149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:35.173155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:35.173160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:35.173164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:35.173170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:35.173196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:35.173210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:35.173216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:35.173221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:35.173226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:35.173232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:35.173236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:35.173248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:35.173252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:35.173256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:35.173261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:35.173266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:35.173270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:35.173275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:35.173310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:35.176873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:35.177217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:35.177233Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:35.177248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:35.177253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:35.177260Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3039 [2:7559602755616005593:6519]
2025-10-10T14:39:35.177276Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:35.177305Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:35.177309Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:35.177313Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:35.177317Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:35.177369Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:35.177382Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:35.177391Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:35.177473Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:35.177475Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:35.177477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:35.177480Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:35.177557Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:35.177564Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:35.177577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:35.177601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:35.177623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:35.177652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602756398247239:2438], now have 1 active actors on pipe
2025-10-10T14:39:35.177661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602756398247417:10340], now have 1 active actors on pipe
2025-10-10T14:39:35.177670Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602755616005588:6519]
2025-10-10T14:39:35.177672Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602755616005588:6519]
2025-10-10T14:39:35.177674Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602755616005588:6519]
2025-10-10T14:39:35.177689Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:35.177704Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:35.177716Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:35.177719Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:35.177721Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:35.177736Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:35.177740Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:35.177729Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3039
2025-10-10T14:39:35.177778Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602755616005588:6519]
2025-10-10T14:39:35.177789Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:35.177756Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3039
2025-10-10T14:39:35.177807Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:35.177986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:35.178002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:35.178052Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|25f31a2e-42deb01f-d6e5a870-74574d15_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:35.178067Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:35.178076Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:35.178079Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:35.178095Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:35.178113Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:35.178134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:35.178344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:35.178360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:35.178386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:35.178638Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3040 partition: 0 MaxSeqNo: 40 sessionId: src_id|25f31a2e-42deb01f-d6e5a870-74574d15_0
2025-10-10T14:39:35.181455Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e547510b-16b2e4ed-b7343f19-a224c1ff_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|25f31a2e-42deb01f-d6e5a870-74574d15_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:35.184193Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|25f31a2e-42deb01f-d6e5a870-74574d15_0] Write session: try to update token
2025-10-10T14:39:35.184214Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|25f31a2e-42deb01f-d6e5a870-74574d15_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:35.193304Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:39:35.193326Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:35.193358Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602755616005588:6519]
2025-10-10T14:39:35.193413Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:39:35.193413Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:39:35.193607Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:39:35.193748Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:35.193881Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:35.194016Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:35.194216Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:39:35.194260Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:39:35.207251Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3040 sessionId: src_id|25f31a2e-42deb01f-d6e5a870-74574d15_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:35.209994Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:35.212939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:35.212967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:35.213013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:39:35.213112Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:39:35.214996Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:35.215014Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:35.215017Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:35.215019Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:35.215030Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602755616005588:6519]
2025-10-10T14:39:35.215038Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602755616005588:6519]
2025-10-10T14:39:35.215042Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602755616005588:6519]
2025-10-10T14:39:35.215091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:35.215103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:35.215105Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:35.215112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:35.215112Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:35.215117Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:35.215268Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:35.250624Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602756398247431:2572]
2025-10-10T14:39:35.250918Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 pipe creation result: OK TabletId: 72075186224037892 Generation: 3039, pipe: [1:7559602756398247431:2572]
2025-10-10T14:39:35.330001Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:35.339774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:35.339812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:35.339995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:35.340067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:35.340138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:35.340207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:35.340265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:35.340275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:35.340346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:35.340410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:35.340481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:35.340549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:35.340596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:35.340608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:35.340685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:35.340742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:35.340801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:35.340874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:35.340935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:35.340945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:35.341011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:35.341077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:35.341145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:35.341214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:35.341258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:35.341265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:35.341351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:35.341412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:35.341477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:35.341544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:35.341589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:35.341596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:35.341667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:35.341726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:35.341797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:35.341862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:35.341905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:35.341911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:35.341973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:35.342035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:35.342093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:35.342162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:35.342209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:35.342216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:35.342284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:35.342345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:35.342409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:35.342473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:35.342518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:35.342523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:35.342587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:35.342664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:35.342729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:35.342801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:35.342849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:35.342856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:35.342925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:35.342985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:35.343051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:35.343121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:35.343169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:35.343177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:35.343252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602756398247431:2572], now have 1 active actors on pipe
2025-10-10T14:39:35.343559Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:35.343609Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:35.343615Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:35.343620Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 38 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602756398247431:2572]
2025-10-10T14:39:35.343650Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3040 reason: error at write: Disconnected sessionId: src_id|25f31a2e-42deb01f-d6e5a870-74574d15_0
2025-10-10T14:39:35.343900Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3040 sessionId: src_id|25f31a2e-42deb01f-d6e5a870-74574d15_0 is DEAD
2025-10-10T14:39:35.344056Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|25f31a2e-42deb01f-d6e5a870-74574d15_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:35.344070Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|25f31a2e-42deb01f-d6e5a870-74574d15_0] Write session will restart in 0.007288s
2025-10-10T14:39:35.344100Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|25f31a2e-42deb01f-d6e5a870-74574d15_0] Write session: Do CDS request
2025-10-10T14:39:35.344107Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|25f31a2e-42deb01f-d6e5a870-74574d15_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:35.344554Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:35.352985Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|25f31a2e-42deb01f-d6e5a870-74574d15_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:35.353089Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:35.353114Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3041
2025-10-10T14:39:35.353256Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3041 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:35.353292Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3041 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:35.353298Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3041 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:35.353303Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:35.353906Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3041 sessionId:  describe result for acl check
2025-10-10T14:39:35.353948Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:35.353950Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:35.353952Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:35.353959Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602756398247481:10329] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:35.354665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602756398247481:10329] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:35.357791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602756398247481:10329] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:35.360384Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602756398247481:10329] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:35.360407Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602756398247481:10329] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:35.360411Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602756398247481:10329] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:35.360421Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3041 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:35.361092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:35.363613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:35.363849Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:35.363860Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:35.363875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:35.363939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:35.363988Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602755616005727:6516]
2025-10-10T14:39:35.364615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:35.365019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:35.365073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:35.365432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:35.365501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:35.365510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:35.365511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:35.365512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:35.365514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:35.365515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:35.365517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:35.365518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:35.365519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:35.365520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:35.365522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:35.365523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:35.365525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:35.365532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:35.365545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:35.365550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:35.365554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:35.365558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:35.365562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:35.365566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:35.365570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:35.365573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:35.365579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:35.365582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:35.365586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:35.365589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:35.365598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:35.365606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:35.365614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:35.365620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:35.365625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:35.365630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:35.365635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:35.365641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:35.365646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:35.365652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:35.365656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:35.365662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:35.365669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:35.365674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:35.365678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:35.365684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:35.365690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:35.365696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:35.365699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:35.365704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:35.365707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:35.365712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:35.365716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:35.365722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:35.365730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:35.365752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:35.365792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:35.368344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:35.369225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:35.369241Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:35.369243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:35.369247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:35.369255Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3040 [2:7559602755616005727:6516]
2025-10-10T14:39:35.369270Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:35.369290Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:35.369297Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:35.369300Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:35.369303Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:35.369321Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:35.369349Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:35.369359Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:35.369429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:35.369438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:35.369440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:35.369442Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:35.369517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:35.369529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:35.369542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:35.369554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:35.369573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:35.369601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602756398247616:10329], now have 1 active actors on pipe
2025-10-10T14:39:35.369609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602756398247434:2438], now have 1 active actors on pipe
2025-10-10T14:39:35.369617Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602755616005722:6516]
2025-10-10T14:39:35.369619Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602755616005722:6516]
2025-10-10T14:39:35.369621Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602755616005722:6516]
2025-10-10T14:39:35.369636Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:35.369656Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:35.369675Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:35.369683Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:35.369703Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:35.369713Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:35.369717Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:35.369719Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602755616005722:6516]
2025-10-10T14:39:35.369722Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:35.369725Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:35.369682Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3040
2025-10-10T14:39:35.369697Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3040
2025-10-10T14:39:35.369791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:35.369801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:35.369837Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|24bb40ec-5ff8394e-88cde624-526cfc8b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:35.369852Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:35.369862Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:35.369865Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:35.369878Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:35.369891Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:35.369908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:35.370106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:35.370120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:35.370155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:35.370305Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3041 partition: 0 MaxSeqNo: 40 sessionId: src_id|24bb40ec-5ff8394e-88cde624-526cfc8b_0
2025-10-10T14:39:35.370746Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|25f31a2e-42deb01f-d6e5a870-74574d15_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|24bb40ec-5ff8394e-88cde624-526cfc8b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:35.373586Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|24bb40ec-5ff8394e-88cde624-526cfc8b_0] Write session: try to update token
2025-10-10T14:39:35.373608Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|24bb40ec-5ff8394e-88cde624-526cfc8b_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:35.382167Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:39:35.382188Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:35.382200Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602755616005722:6516]
2025-10-10T14:39:35.382247Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:39:35.382249Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:39:35.382419Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:39:35.382560Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:35.382700Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:35.382835Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:35.383026Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:39:35.383070Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:39:35.390156Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3041 sessionId: src_id|24bb40ec-5ff8394e-88cde624-526cfc8b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:35.393097Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:35.393392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:35.393431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:35.393473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:39:35.393575Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:39:35.411655Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:35.411679Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:35.411682Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:35.411684Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:35.411695Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602755616005722:6516]
2025-10-10T14:39:35.411699Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602755616005722:6516]
2025-10-10T14:39:35.411704Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602755616005722:6516]
2025-10-10T14:39:35.411749Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:35.411752Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:35.411759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:35.411762Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:35.411771Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:35.411775Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:35.411904Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:35.443863Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602756398247630:2572]
2025-10-10T14:39:35.444179Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 pipe creation result: OK TabletId: 72075186224037892 Generation: 3040, pipe: [1:7559602756398247630:2572]
2025-10-10T14:39:35.527754Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:35.535267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:35.535297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:35.535477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:35.535548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:35.535613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:35.535672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:35.535720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:35.535728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:35.535795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:35.535861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:35.535930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:35.535992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:35.536033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:35.536039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:35.536102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:35.536157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:35.536215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:35.536275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:35.536319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:35.536324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:35.536386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:35.536446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:35.536516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:35.536575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:35.536616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:35.536623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:35.536696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:35.536765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:35.536827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:35.536899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:35.536947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:35.536950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:35.537022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:35.537088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:35.537147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:35.537210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:35.537254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:35.537262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:35.537353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:35.537412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:35.537472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:35.537537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:35.537585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:35.537592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:35.537654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:35.537711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:35.537772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:35.537833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:35.537880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:35.537885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:35.537951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:35.538021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:35.538083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:35.538148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:35.538270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:35.538276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:35.538337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:35.538391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:35.538454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:35.538523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:35.538564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:35.538569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:35.538640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602756398247630:2572], now have 1 active actors on pipe
2025-10-10T14:39:35.538933Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 39 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602756398247630:2572]
2025-10-10T14:39:35.538947Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:35.538951Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:35.538970Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:35.538985Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3041 reason: error at write: Disconnected sessionId: src_id|24bb40ec-5ff8394e-88cde624-526cfc8b_0
2025-10-10T14:39:35.539217Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3041 sessionId: src_id|24bb40ec-5ff8394e-88cde624-526cfc8b_0 is DEAD
2025-10-10T14:39:35.539384Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24bb40ec-5ff8394e-88cde624-526cfc8b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:35.539393Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24bb40ec-5ff8394e-88cde624-526cfc8b_0] Write session will restart in 0.008572s
2025-10-10T14:39:35.539419Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24bb40ec-5ff8394e-88cde624-526cfc8b_0] Write session: Do CDS request
2025-10-10T14:39:35.539425Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24bb40ec-5ff8394e-88cde624-526cfc8b_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:35.539829Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:35.548990Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|24bb40ec-5ff8394e-88cde624-526cfc8b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:35.549044Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:35.549062Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3042
2025-10-10T14:39:35.549213Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3042 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:35.549254Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3042 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:35.549263Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3042 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:35.549268Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:35.549806Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3042 sessionId:  describe result for acl check
2025-10-10T14:39:35.549843Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:35.549849Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:35.549851Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:35.549857Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602756398247786:10327] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:35.550448Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602756398247786:10327] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:35.552318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:35.553287Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602756398247786:10327] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:35.554935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:35.555143Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:35.555154Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:35.555166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:35.555213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:35.555255Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602755616005859:6510]
2025-10-10T14:39:35.555873Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602756398247786:10327] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:35.555878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:35.555887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602756398247786:10327] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:35.555891Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602756398247786:10327] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:35.555899Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3042 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:35.556210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:35.556285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:35.556632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:35.556697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:35.556703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:35.556704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:35.556705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:35.556707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:35.556708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:35.556709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:35.556710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:35.556712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:35.556713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:35.556714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:35.556716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:35.556717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:35.556723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:35.556736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:35.556741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:35.556745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:35.556749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:35.556753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:35.556757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:35.556761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:35.556765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:35.556778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:35.556781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:35.556785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:35.556789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:35.556797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:35.556811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:35.556821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:35.556827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:35.556836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:35.556842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:35.556850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:35.556855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:35.556860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:35.556869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:35.556873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:35.556886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:35.556895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:35.556900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:35.556905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:35.556914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:35.556919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:35.556925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:35.556935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:35.556942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:35.556946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:35.556956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:35.556960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:35.556965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:35.556973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:35.556978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:35.557017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:35.559485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:35.560211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:35.560225Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:35.560227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:35.560231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:35.560237Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3041 [2:7559602755616005859:6510]
2025-10-10T14:39:35.560262Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:35.560282Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:35.560290Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:35.560294Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:35.560296Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:35.560315Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:35.560328Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:35.560336Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:35.560399Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:35.560406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:35.560407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:35.560410Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:35.560476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:35.560486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:35.560498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:35.560509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:35.560525Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:35.560549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602756398247633:2438], now have 1 active actors on pipe
2025-10-10T14:39:35.560558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602756398247819:10327], now have 1 active actors on pipe
2025-10-10T14:39:35.560566Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602755616005854:6510]
2025-10-10T14:39:35.560569Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602755616005854:6510]
2025-10-10T14:39:35.560571Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602755616005854:6510]
2025-10-10T14:39:35.560589Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:35.560609Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:35.560611Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:35.560616Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:35.560611Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3041
2025-10-10T14:39:35.560620Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:35.560626Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:35.560613Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3041
2025-10-10T14:39:35.560630Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:35.560660Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602755616005854:6510]
2025-10-10T14:39:35.560663Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:35.560667Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:35.560685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:35.560695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:35.560745Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|62ba167e-1e7e8ab9-75957356-424091bb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:35.560757Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:35.560761Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:35.560763Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:35.560774Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:35.560790Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:35.560814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:35.561013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:35.561027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:35.561051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:35.561182Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3042 partition: 0 MaxSeqNo: 40 sessionId: src_id|62ba167e-1e7e8ab9-75957356-424091bb_0
2025-10-10T14:39:35.561637Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24bb40ec-5ff8394e-88cde624-526cfc8b_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|62ba167e-1e7e8ab9-75957356-424091bb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:35.564459Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|62ba167e-1e7e8ab9-75957356-424091bb_0] Write session: try to update token
2025-10-10T14:39:35.564479Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|62ba167e-1e7e8ab9-75957356-424091bb_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:35.579236Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3042 sessionId: src_id|62ba167e-1e7e8ab9-75957356-424091bb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:35.580289Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:35.580319Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:35.580323Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:35.580325Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:35.580334Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602755616005854:6510]
2025-10-10T14:39:35.580339Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602755616005854:6510]
2025-10-10T14:39:35.580343Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602755616005854:6510]
2025-10-10T14:39:35.580395Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:35.580397Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:35.580409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:35.580412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:35.580412Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:35.580416Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:35.580582Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:35.582136Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:35.639271Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602756398247830:2572]
2025-10-10T14:39:35.639567Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 pipe creation result: OK TabletId: 72075186224037892 Generation: 3041, pipe: [1:7559602756398247830:2572]
2025-10-10T14:39:35.696144Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:35.696893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:35.696911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:35.696958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602756398247830:2572], now have 1 active actors on pipe
2025-10-10T14:39:35.697221Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 40 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602756398247830:2572]
2025-10-10T14:39:35.697225Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:35.697253Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:35.697256Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:35.697362Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3042 reason: error at write: Disconnected sessionId: src_id|62ba167e-1e7e8ab9-75957356-424091bb_0
2025-10-10T14:39:35.697486Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:35.697601Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3042 sessionId: src_id|62ba167e-1e7e8ab9-75957356-424091bb_0 is DEAD
2025-10-10T14:39:35.697828Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|62ba167e-1e7e8ab9-75957356-424091bb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:35.697838Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|62ba167e-1e7e8ab9-75957356-424091bb_0] Write session will restart in 0.009634s
2025-10-10T14:39:35.697863Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|62ba167e-1e7e8ab9-75957356-424091bb_0] Write session: Do CDS request
2025-10-10T14:39:35.697886Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|62ba167e-1e7e8ab9-75957356-424091bb_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:35.708980Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|62ba167e-1e7e8ab9-75957356-424091bb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:35.709456Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:35.709481Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3043
2025-10-10T14:39:35.709606Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3043 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:35.709643Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3043 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:35.709653Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3043 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:35.709657Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:35.710062Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3043 sessionId:  describe result for acl check
2025-10-10T14:39:35.710103Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:35.710111Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:35.710113Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:35.710120Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602756398247988:10317] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:35.710685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602756398247988:10317] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:35.710988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:35.713026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:35.713163Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602756398247988:10317] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:35.713211Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:35.713223Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:35.713234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:35.713282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:35.713321Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602755616006005:6512]
2025-10-10T14:39:35.714000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:35.714357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:35.714434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:35.714792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:35.714853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:35.714863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:35.714865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:35.714866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:35.714867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:35.714868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:35.714870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:35.714871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:35.714872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:35.714873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:35.714875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:35.714876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:35.714877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:35.714883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:35.714896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:35.714901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:35.714905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:35.714909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:35.714913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:35.714917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:35.714921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:35.714924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:35.714929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:35.714933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:35.714937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:35.714942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:35.714949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:35.714958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:35.714964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:35.714969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:35.714974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:35.714979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:35.714983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:35.714988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:35.714992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:35.714998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:35.715002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:35.715007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:35.715012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:35.715017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:35.715029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:35.715034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:35.715038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:35.715044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:35.715048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:35.715054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:35.715059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:35.715064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:35.715069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:35.715075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:35.715079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:35.715085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:35.715127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:35.715641Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602756398247988:10317] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:35.715654Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602756398247988:10317] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:35.715658Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602756398247988:10317] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:35.715666Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3043 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:35.717574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:35.717916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:35.717929Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:35.717932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:35.717936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:35.717942Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3042 [2:7559602755616006005:6512]
2025-10-10T14:39:35.717955Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:35.717973Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:35.717976Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:35.717980Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:35.717982Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:35.718000Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:35.718013Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:35.718020Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:35.718083Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:35.718103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:35.718105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:35.718108Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:35.718175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:35.718183Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:35.718200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:35.718214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:35.718237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:35.718266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602756398248023:10317], now have 1 active actors on pipe
2025-10-10T14:39:35.718276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602756398247832:2438], now have 1 active actors on pipe
2025-10-10T14:39:35.718283Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602755616006000:6512]
2025-10-10T14:39:35.718286Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602755616006000:6512]
2025-10-10T14:39:35.718288Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602755616006000:6512]
2025-10-10T14:39:35.718302Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:35.718317Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:35.718317Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:35.718320Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:35.718322Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:35.718336Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:35.718339Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:35.718347Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3042
2025-10-10T14:39:35.718352Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3042
2025-10-10T14:39:35.718366Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602755616006000:6512]
2025-10-10T14:39:35.718376Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:35.718382Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:35.718404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:35.718409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:35.718448Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|29e94257-3518f76-ec2fb6cc-14f2ee6f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:35.718461Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:35.718465Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:35.718469Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:35.718480Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:35.718490Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:35.718507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:35.718638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:35.718646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:35.718660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:35.718775Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3043 partition: 0 MaxSeqNo: 40 sessionId: src_id|29e94257-3518f76-ec2fb6cc-14f2ee6f_0
2025-10-10T14:39:35.719151Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|62ba167e-1e7e8ab9-75957356-424091bb_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|29e94257-3518f76-ec2fb6cc-14f2ee6f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:35.722130Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|29e94257-3518f76-ec2fb6cc-14f2ee6f_0] Write session: try to update token
2025-10-10T14:39:35.722146Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|29e94257-3518f76-ec2fb6cc-14f2ee6f_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:35.738367Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3043 sessionId: src_id|29e94257-3518f76-ec2fb6cc-14f2ee6f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:35.739413Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:35.739433Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:35.739436Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:35.739437Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:35.739444Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602755616006000:6512]
2025-10-10T14:39:35.739447Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602755616006000:6512]
2025-10-10T14:39:35.739450Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602755616006000:6512]
2025-10-10T14:39:35.739493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:35.739500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:35.739503Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:35.739560Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:35.739579Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:35.739583Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:35.739637Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:35.741111Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:35.797504Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602756398248042:2572]
2025-10-10T14:39:35.798089Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 pipe creation result: OK TabletId: 72075186224037892 Generation: 3042, pipe: [1:7559602756398248042:2572]
2025-10-10T14:39:35.857865Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:35.858130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:35.858147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:35.858190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602756398248042:2572], now have 1 active actors on pipe
2025-10-10T14:39:35.858420Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:35.859081Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|29e94257-3518f76-ec2fb6cc-14f2ee6f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:39:35.859092Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|29e94257-3518f76-ec2fb6cc-14f2ee6f_0] Write session will restart in 0.007148s
2025-10-10T14:39:35.859117Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|29e94257-3518f76-ec2fb6cc-14f2ee6f_0] Write session: Do CDS request
2025-10-10T14:39:35.858489Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 41 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602756398248042:2572]
2025-10-10T14:39:35.858521Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:35.859123Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|29e94257-3518f76-ec2fb6cc-14f2ee6f_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:35.858567Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:39:35.858663Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3043 reason: status is not ok: tablet will be restarted right now sessionId: src_id|29e94257-3518f76-ec2fb6cc-14f2ee6f_0
2025-10-10T14:39:35.858916Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3043 sessionId: src_id|29e94257-3518f76-ec2fb6cc-14f2ee6f_0 is DEAD
2025-10-10T14:39:35.867942Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|29e94257-3518f76-ec2fb6cc-14f2ee6f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:35.868810Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:35.868842Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3044
2025-10-10T14:39:35.869022Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3044 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:35.869073Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3044 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:35.869080Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3044 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:35.869085Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:35.869605Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3044 sessionId:  describe result for acl check
2025-10-10T14:39:35.869644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:35.869650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:35.869653Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:35.869659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602756398248084:10308] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:35.870308Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602756398248084:10308] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:35.873618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602756398248084:10308] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:35.883161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:35.883717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:35.883620Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602756398248084:10308] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:35.883640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602756398248084:10308] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:35.883646Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602756398248084:10308] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:35.883655Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3044 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:35.884418Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:35.884431Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:35.884465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:35.884544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:35.884597Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602755616006141:6506]
2025-10-10T14:39:35.885270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:35.885629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:35.885694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:35.886057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:35.886123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:35.886131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:35.886133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:35.886134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:35.886135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:35.886137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:35.886138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:35.886139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:35.886141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:35.886142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:35.886143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:35.886144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:35.886145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:35.886152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:35.886166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:35.886171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:35.886176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:35.886180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:35.886184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:35.886189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:35.886193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:35.886197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:35.886202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:35.886207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:35.886211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:35.886216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:35.886227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:35.886236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:35.886243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:35.886250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:35.886255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:35.886261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:35.886265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:35.886272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:35.886276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:35.886282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:35.886286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:35.886292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:35.886297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:35.886303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:35.886308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:35.886313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:35.886319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:35.886324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:35.886329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:35.886335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:35.886348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:35.886353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:35.886358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:35.886364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:35.886370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:35.886376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:35.886424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:35.888994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:35.889378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:35.889392Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:35.889395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:35.889399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:35.889406Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3043 [2:7559602755616006141:6506]
2025-10-10T14:39:35.889421Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:35.889439Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:35.889443Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:35.889447Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:35.889449Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:35.889467Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:35.889482Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:35.889492Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:35.889559Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:35.889568Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:35.889570Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:35.889573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:35.889777Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3043
2025-10-10T14:39:35.889780Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3043
2025-10-10T14:39:35.889662Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:35.889673Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:35.889686Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:35.889708Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:35.889727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:35.889753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602756398248239:10308], now have 1 active actors on pipe
2025-10-10T14:39:35.889757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602756398248051:2438], now have 1 active actors on pipe
2025-10-10T14:39:35.889767Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602755616006135:6506]
2025-10-10T14:39:35.889769Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602755616006135:6506]
2025-10-10T14:39:35.889771Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602755616006135:6506]
2025-10-10T14:39:35.889786Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:35.889801Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:35.889819Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:35.889822Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:35.889831Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:35.889834Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:35.889837Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:35.889847Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602755616006135:6506]
2025-10-10T14:39:35.889851Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:35.889888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:35.889893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:35.889928Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|da0aaf0a-9e4f255d-4fe00924-f2a9892b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:35.889936Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:35.889941Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:35.889944Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:35.889959Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:35.889971Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:35.889973Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:35.889986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:35.890171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:35.890187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:35.890213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:35.890327Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3044 partition: 0 MaxSeqNo: 40 sessionId: src_id|da0aaf0a-9e4f255d-4fe00924-f2a9892b_0
2025-10-10T14:39:35.890774Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|29e94257-3518f76-ec2fb6cc-14f2ee6f_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|da0aaf0a-9e4f255d-4fe00924-f2a9892b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:35.893811Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|da0aaf0a-9e4f255d-4fe00924-f2a9892b_0] Write session: try to update token
2025-10-10T14:39:35.893834Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|da0aaf0a-9e4f255d-4fe00924-f2a9892b_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:35.909789Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:35.909814Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:35.909817Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:35.909820Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:35.909831Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602755616006135:6506]
2025-10-10T14:39:35.909837Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602755616006135:6506]
2025-10-10T14:39:35.909840Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602755616006135:6506]
2025-10-10T14:39:35.909892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:35.909900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:35.909903Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:35.909905Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:35.909913Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:35.909917Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:35.910046Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:35.910892Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3044 sessionId: src_id|da0aaf0a-9e4f255d-4fe00924-f2a9892b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:35.913609Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:35.958746Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602756398248253:2572]
2025-10-10T14:39:35.959050Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 pipe creation result: OK TabletId: 72075186224037892 Generation: 3043, pipe: [1:7559602756398248253:2572]
2025-10-10T14:39:36.028085Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:36.028738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:36.028763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:36.028813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602756398248253:2572], now have 1 active actors on pipe
2025-10-10T14:39:36.029069Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:36.029086Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:36.029104Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 42 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602756398248253:2572]
2025-10-10T14:39:36.029644Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da0aaf0a-9e4f255d-4fe00924-f2a9892b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:36.029657Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da0aaf0a-9e4f255d-4fe00924-f2a9892b_0] Write session will restart in 0.008135s
2025-10-10T14:39:36.029144Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:36.029154Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:36.029685Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da0aaf0a-9e4f255d-4fe00924-f2a9892b_0] Write session: Do CDS request
2025-10-10T14:39:36.029218Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3044 reason: error at write: Disconnected sessionId: src_id|da0aaf0a-9e4f255d-4fe00924-f2a9892b_0
2025-10-10T14:39:36.029467Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3044 sessionId: src_id|da0aaf0a-9e4f255d-4fe00924-f2a9892b_0 is DEAD
2025-10-10T14:39:36.029698Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da0aaf0a-9e4f255d-4fe00924-f2a9892b_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:36.038963Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|da0aaf0a-9e4f255d-4fe00924-f2a9892b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:36.039108Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:36.039127Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3045
2025-10-10T14:39:36.039249Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3045 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:36.039280Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3045 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:36.039286Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3045 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:36.039291Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:36.039720Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3045 sessionId:  describe result for acl check
2025-10-10T14:39:36.039752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:36.039755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:36.039756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:36.039763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602760693215649:10304] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:36.040365Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602760693215649:10304] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:36.042857Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602760693215649:10304] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:36.046612Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602760693215649:10304] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:36.046630Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602760693215649:10304] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:36.046634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602760693215649:10304] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:36.046643Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3045 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:36.050935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:36.053921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:36.054169Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:36.054181Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:36.054193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:36.054249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:36.054308Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602759910973573:6498]
2025-10-10T14:39:36.054954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:36.055385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:36.055445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:36.055834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:36.055922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:36.055933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:36.055934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:36.055935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:36.055936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:36.055937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:36.055939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:36.055940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:36.055941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:36.055942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:36.055943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:36.055945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:36.055946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:36.055953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:36.055966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:36.055971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:36.055974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:36.055977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:36.055981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:36.055985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:36.055989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:36.055993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:36.055998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:36.056001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:36.056004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:36.056008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:36.056018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:36.056028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:36.056035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:36.056040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:36.056045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:36.056050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:36.056054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:36.056060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:36.056064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:36.056069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:36.056073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:36.056078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:36.056083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:36.056088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:36.056093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:36.056098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:36.056103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:36.056108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:36.056113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:36.056119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:36.056124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:36.056129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:36.056133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:36.056138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:36.056142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:36.056147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:36.056186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:36.061367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:36.062489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:36.062504Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:36.062506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:36.062511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:36.062518Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3044 [2:7559602759910973573:6498]
2025-10-10T14:39:36.062533Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:36.062552Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:36.062561Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:36.062565Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:36.062568Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:36.062588Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:36.062605Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:36.062613Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:36.062688Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:36.062696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:36.062699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:36.062703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:36.062774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:36.062786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:36.062798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:36.062814Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:36.062837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:36.062867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602760693215701:10304], now have 1 active actors on pipe
2025-10-10T14:39:36.062875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602760693215551:2438], now have 1 active actors on pipe
2025-10-10T14:39:36.062885Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602759910973568:6498]
2025-10-10T14:39:36.062887Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602759910973568:6498]
2025-10-10T14:39:36.062889Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602759910973568:6498]
2025-10-10T14:39:36.062905Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:36.062920Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:36.062943Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:36.062949Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:36.062964Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:36.062967Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:36.062970Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:36.062986Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602759910973568:6498]
2025-10-10T14:39:36.062989Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:36.062944Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3044
2025-10-10T14:39:36.063003Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:36.063036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:36.062985Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3044
2025-10-10T14:39:36.063041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:36.063077Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c80f0db7-caa5b571-4cf53c2f-7bdfa0f3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:36.063092Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:36.063100Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:36.063102Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:36.063114Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:36.063130Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:36.063151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:36.063622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:36.063634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:36.063655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:36.063755Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3045 partition: 0 MaxSeqNo: 40 sessionId: src_id|c80f0db7-caa5b571-4cf53c2f-7bdfa0f3_0
2025-10-10T14:39:36.064179Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da0aaf0a-9e4f255d-4fe00924-f2a9892b_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|c80f0db7-caa5b571-4cf53c2f-7bdfa0f3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:36.066952Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c80f0db7-caa5b571-4cf53c2f-7bdfa0f3_0] Write session: try to update token
2025-10-10T14:39:36.066970Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c80f0db7-caa5b571-4cf53c2f-7bdfa0f3_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:36.081431Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:39:36.081453Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:36.081467Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602759910973568:6498]
2025-10-10T14:39:36.081526Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:39:36.081527Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:39:36.081722Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:39:36.081877Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:36.082025Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:36.082173Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:36.082377Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:39:36.082443Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:39:36.085077Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3045 sessionId: src_id|c80f0db7-caa5b571-4cf53c2f-7bdfa0f3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:36.087993Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:36.088229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:36.088253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:36.088314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:39:36.088428Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:39:36.095013Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:36.095034Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:36.095038Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:36.095040Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:36.095052Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602759910973568:6498]
2025-10-10T14:39:36.095056Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602759910973568:6498]
2025-10-10T14:39:36.095059Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602759910973568:6498]
2025-10-10T14:39:36.095111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:36.095110Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:36.095118Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:36.095123Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:36.095125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:36.095128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:36.095277Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:36.129236Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602760693215765:2572]
2025-10-10T14:39:36.129525Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 pipe creation result: OK TabletId: 72075186224037892 Generation: 3044, pipe: [1:7559602760693215765:2572]
2025-10-10T14:39:36.211674Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:36.220756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:36.220796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:36.221021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:36.221094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:36.221177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:36.221257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:36.221309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:36.221320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:36.225228Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c80f0db7-caa5b571-4cf53c2f-7bdfa0f3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:36.225245Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c80f0db7-caa5b571-4cf53c2f-7bdfa0f3_0] Write session will restart in 0.007621s
2025-10-10T14:39:36.225272Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c80f0db7-caa5b571-4cf53c2f-7bdfa0f3_0] Write session: Do CDS request
2025-10-10T14:39:36.225279Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c80f0db7-caa5b571-4cf53c2f-7bdfa0f3_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:36.221422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:36.221497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:36.221569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:36.221636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:36.221679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:36.221683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:36.221765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:36.221826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:36.221891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:36.221966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:36.222008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:36.222010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:36.222088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:36.222165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:36.222231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:36.222298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:36.222353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:36.222356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:36.222426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:36.222484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:36.222547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:36.222608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:36.222652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:36.222655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:36.222732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:36.222794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:36.222858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:36.222932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:36.222976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:36.222979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:36.223052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:36.223113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:36.223180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:36.223243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:36.223289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:36.223293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:36.223369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:36.223431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:36.223495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:36.223561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:36.223602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:36.223605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:36.223676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:36.223739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:36.223813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:36.223880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:36.223924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:36.223927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:36.224002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:36.224063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:36.224128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:36.224187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:36.224231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:36.224234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:36.224326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602760693215765:2572], now have 1 active actors on pipe
2025-10-10T14:39:36.225814Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:36.224676Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 43 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602760693215765:2572]
2025-10-10T14:39:36.224723Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:36.224767Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:36.224770Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:36.224801Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3045 reason: error at write: Disconnected sessionId: src_id|c80f0db7-caa5b571-4cf53c2f-7bdfa0f3_0
2025-10-10T14:39:36.225060Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3045 sessionId: src_id|c80f0db7-caa5b571-4cf53c2f-7bdfa0f3_0 is DEAD
2025-10-10T14:39:36.233946Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c80f0db7-caa5b571-4cf53c2f-7bdfa0f3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:36.234134Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:36.234152Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3046
2025-10-10T14:39:36.234607Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3046 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:36.234652Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3046 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:36.234658Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3046 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:36.234662Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:36.235315Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3046 sessionId:  describe result for acl check
2025-10-10T14:39:36.235365Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:36.235372Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:36.235374Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:36.235382Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602760693215804:10287] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:36.235974Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602760693215804:10287] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:36.240067Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602760693215804:10287] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:36.243237Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602760693215804:10287] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:36.243259Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602760693215804:10287] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:36.243263Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602760693215804:10287] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:36.243273Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3046 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:36.245582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:36.248085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:36.248716Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:36.248723Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:36.248740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:36.248819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:36.248862Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602759910973749:6482]
2025-10-10T14:39:36.249554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:36.249930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:36.250007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:36.250402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:36.250470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:36.250478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:36.250479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:36.250481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:36.250483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:36.250484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:36.250486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:36.250488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:36.250489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:36.250491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:36.250493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:36.250494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:36.250496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:36.250504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:36.250519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:36.250524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:36.250529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:36.250533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:36.250543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:36.250548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:36.250558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:36.250563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:36.250569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:36.250573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:36.250582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:36.250587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:36.250597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:36.250609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:36.250617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:36.250629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:36.250639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:36.250644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:36.250654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:36.250661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:36.250666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:36.250672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:36.250682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:36.250689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:36.250699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:36.250704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:36.250713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:36.250720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:36.250730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:36.250736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:36.250741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:36.250752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:36.250761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:36.250771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:36.250777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:36.250787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:36.250792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:36.250803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:36.250849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:36.253677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:36.254012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:36.254027Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:36.254030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:36.254034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:36.254046Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3045 [2:7559602759910973749:6482]
2025-10-10T14:39:36.254065Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:36.254090Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:36.254100Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:36.254104Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:36.254106Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:36.254126Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:36.254134Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:36.254143Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:36.254209Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:36.254217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:36.254219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:36.254222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:36.254296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:36.254304Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:36.254318Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:36.254339Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:36.254359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:36.254384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602760693215966:10287], now have 1 active actors on pipe
2025-10-10T14:39:36.254388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602760693215779:2438], now have 1 active actors on pipe
2025-10-10T14:39:36.254397Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602759910973744:6482]
2025-10-10T14:39:36.254402Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602759910973744:6482]
2025-10-10T14:39:36.254404Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602759910973744:6482]
2025-10-10T14:39:36.254423Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:36.254445Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:36.254469Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:36.254477Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:36.254486Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3045
2025-10-10T14:39:36.254503Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:36.254514Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:36.254517Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602759910973744:6482]
2025-10-10T14:39:36.254518Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:36.254519Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:36.254526Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:36.254664Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3045
2025-10-10T14:39:36.254696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:36.254727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:36.254769Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|77307948-a5e3b03c-66e9601-244a476c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:36.254783Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:36.254789Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:36.254794Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:36.254808Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:36.254825Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:36.254849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:36.255192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:36.255207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:36.255241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:36.255408Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3046 partition: 0 MaxSeqNo: 40 sessionId: src_id|77307948-a5e3b03c-66e9601-244a476c_0
2025-10-10T14:39:36.255853Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c80f0db7-caa5b571-4cf53c2f-7bdfa0f3_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|77307948-a5e3b03c-66e9601-244a476c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:36.258629Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|77307948-a5e3b03c-66e9601-244a476c_0] Write session: try to update token
2025-10-10T14:39:36.258654Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|77307948-a5e3b03c-66e9601-244a476c_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:36.276622Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:36.276644Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:36.276647Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:36.276649Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:36.276661Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602759910973744:6482]
2025-10-10T14:39:36.276666Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602759910973744:6482]
2025-10-10T14:39:36.276670Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602759910973744:6482]
2025-10-10T14:39:36.276721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:36.276721Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:36.276728Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:36.276733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:36.276734Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:36.276736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:36.276894Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:36.280669Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3046 sessionId: src_id|77307948-a5e3b03c-66e9601-244a476c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:36.283542Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:36.324847Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602760693215981:2572]
2025-10-10T14:39:36.325249Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 pipe creation result: OK TabletId: 72075186224037892 Generation: 3045, pipe: [1:7559602760693215981:2572]
2025-10-10T14:39:36.394044Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:36.394338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:36.394355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:36.394421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602760693215981:2572], now have 1 active actors on pipe
2025-10-10T14:39:36.394667Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:36.394657Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:36.394690Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 44 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602760693215981:2572]
2025-10-10T14:39:36.394726Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:36.394729Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:36.394811Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3046 reason: error at write: Disconnected sessionId: src_id|77307948-a5e3b03c-66e9601-244a476c_0
2025-10-10T14:39:36.395042Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3046 sessionId: src_id|77307948-a5e3b03c-66e9601-244a476c_0 is DEAD
2025-10-10T14:39:36.395211Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77307948-a5e3b03c-66e9601-244a476c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:36.395231Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77307948-a5e3b03c-66e9601-244a476c_0] Write session will restart in 0.005458s
2025-10-10T14:39:36.395258Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77307948-a5e3b03c-66e9601-244a476c_0] Write session: Do CDS request
2025-10-10T14:39:36.395268Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77307948-a5e3b03c-66e9601-244a476c_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:36.401886Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|77307948-a5e3b03c-66e9601-244a476c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:36.401980Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:36.402005Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3047
2025-10-10T14:39:36.402112Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3047 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:36.402163Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3047 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:36.402176Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3047 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:36.402180Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:36.402597Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3047 sessionId:  describe result for acl check
2025-10-10T14:39:36.402629Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:36.402635Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:36.402637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:36.402643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602760693216018:10277] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:36.403223Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602760693216018:10277] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:36.406150Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602760693216018:10277] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:36.409147Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602760693216018:10277] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:36.409163Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602760693216018:10277] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:36.409166Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602760693216018:10277] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:36.409176Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3047 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:36.412259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:36.412905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:36.413104Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:36.413113Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:36.413122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:36.413173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:36.413212Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602759910973889:6469]
2025-10-10T14:39:36.413723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:36.414205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:36.414252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:36.414587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:36.414659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:36.414666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:36.414667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:36.414669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:36.414670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:36.414671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:36.414672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:36.414674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:36.414675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:36.414676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:36.414678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:36.414679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:36.414681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:36.414696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:36.414710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:36.414714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:36.414718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:36.414722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:36.414727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:36.414730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:36.414734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:36.414746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:36.414755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:36.414759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:36.414763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:36.414767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:36.414774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:36.414783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:36.414794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:36.414805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:36.414809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:36.414818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:36.414821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:36.414825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:36.414828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:36.414831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:36.414834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:36.414837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:36.414841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:36.414844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:36.414847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:36.414857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:36.414862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:36.414867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:36.414876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:36.414882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:36.414886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:36.414889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:36.414892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:36.414895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:36.414898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:36.414901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:36.414926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:36.417452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:36.417829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:36.417842Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:36.417844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:36.417848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:36.417856Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3046 [2:7559602759910973889:6469]
2025-10-10T14:39:36.417879Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:36.417902Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:36.417910Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:36.417914Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:36.417916Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:36.417936Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:36.417945Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:36.417968Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:36.418037Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:36.418045Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:36.418047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:36.418050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:36.418131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:36.418140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:36.418152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:36.418169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:36.418192Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:36.418220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602760693216175:10277], now have 1 active actors on pipe
2025-10-10T14:39:36.418228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602760693215985:2438], now have 1 active actors on pipe
2025-10-10T14:39:36.418236Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602759910973884:6469]
2025-10-10T14:39:36.418242Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602759910973884:6469]
2025-10-10T14:39:36.418245Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602759910973884:6469]
2025-10-10T14:39:36.418258Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:36.418278Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:36.418293Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:36.418295Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:36.418299Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:36.418301Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:36.418302Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:36.418289Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3046
2025-10-10T14:39:36.418289Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3046
2025-10-10T14:39:36.418334Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602759910973884:6469]
2025-10-10T14:39:36.418343Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:36.418346Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:36.418369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:36.418375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:36.418418Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2e6c000-2015d660-f1955bb-9b965ee1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:36.418432Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:36.418437Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:36.418440Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:36.418452Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:36.418468Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:36.418486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:36.418641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:36.418651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:36.418667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:36.418753Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3047 partition: 0 MaxSeqNo: 40 sessionId: src_id|2e6c000-2015d660-f1955bb-9b965ee1_0
2025-10-10T14:39:36.419203Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77307948-a5e3b03c-66e9601-244a476c_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|2e6c000-2015d660-f1955bb-9b965ee1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:36.422057Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2e6c000-2015d660-f1955bb-9b965ee1_0] Write session: try to update token
2025-10-10T14:39:36.422080Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2e6c000-2015d660-f1955bb-9b965ee1_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:36.437281Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3047 sessionId: src_id|2e6c000-2015d660-f1955bb-9b965ee1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:36.438794Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:36.438831Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:36.438834Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:36.438836Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:36.438847Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602759910973884:6469]
2025-10-10T14:39:36.438852Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602759910973884:6469]
2025-10-10T14:39:36.438858Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602759910973884:6469]
2025-10-10T14:39:36.438917Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:36.438929Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:36.438932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:36.438932Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:36.438942Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:36.438946Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:36.439084Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:36.440109Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:36.494779Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602760693216189:2572]
2025-10-10T14:39:36.495099Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 pipe creation result: OK TabletId: 72075186224037892 Generation: 3046, pipe: [1:7559602760693216189:2572]
2025-10-10T14:39:36.556160Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:36.556473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:36.556496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:36.556559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602760693216189:2572], now have 1 active actors on pipe
2025-10-10T14:39:36.556829Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:36.556812Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:36.557366Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e6c000-2015d660-f1955bb-9b965ee1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:36.557385Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e6c000-2015d660-f1955bb-9b965ee1_0] Write session will restart in 0.006836s
2025-10-10T14:39:36.556821Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 45 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602760693216189:2572]
2025-10-10T14:39:36.556828Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:36.557411Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e6c000-2015d660-f1955bb-9b965ee1_0] Write session: Do CDS request
2025-10-10T14:39:36.556910Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3047 reason: error at write: Disconnected sessionId: src_id|2e6c000-2015d660-f1955bb-9b965ee1_0
2025-10-10T14:39:36.556952Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:36.557154Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3047 sessionId: src_id|2e6c000-2015d660-f1955bb-9b965ee1_0 is DEAD
2025-10-10T14:39:36.557417Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e6c000-2015d660-f1955bb-9b965ee1_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:36.565899Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2e6c000-2015d660-f1955bb-9b965ee1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:36.566679Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:36.566699Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3048
2025-10-10T14:39:36.566865Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3048 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:36.566921Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3048 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:36.566933Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3048 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:36.566938Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:36.567400Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3048 sessionId:  describe result for acl check
2025-10-10T14:39:36.567452Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:36.567460Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:36.567463Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:36.567469Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602760693216313:10265] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:36.568076Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602760693216313:10265] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:36.570053Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602760693216313:10265] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:36.574272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:36.574438Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602760693216313:10265] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:36.574454Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602760693216313:10265] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:36.574458Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602760693216313:10265] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:36.574468Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3048 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:36.574761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:36.574953Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:36.574967Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:36.574981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:36.575043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:36.575092Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602759910974028:6452]
2025-10-10T14:39:36.575743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:36.576062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:36.576119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:36.576415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:36.576480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:36.576487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:36.576488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:36.576490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:36.576491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:36.576493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:36.576494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:36.576496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:36.576497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:36.576498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:36.576500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:36.576501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:36.576503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:36.576508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:36.576517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:36.576520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:36.576522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:36.576524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:36.576527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:36.576529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:36.576531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:36.576533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:36.576536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:36.576538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:36.576540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:36.576542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:36.576549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:36.576555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:36.576559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:36.576563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:36.576566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:36.576569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:36.576572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:36.576575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:36.576578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:36.576581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:36.576584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:36.576588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:36.576591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:36.576594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:36.576597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:36.576601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:36.576604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:36.576607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:36.576610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:36.576614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:36.576618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:36.576624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:36.576628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:36.576633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:36.576639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:36.576644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:36.576676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:36.579180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:36.579561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:36.579575Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:36.579578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:36.579582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:36.579590Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3047 [2:7559602759910974028:6452]
2025-10-10T14:39:36.579606Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:36.579627Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:36.579636Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:36.579640Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:36.579643Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:36.579662Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:36.579678Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:36.579686Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:36.579748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:36.579756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:36.579758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:36.579761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:36.580026Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3047
2025-10-10T14:39:36.580040Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3047
2025-10-10T14:39:36.580529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:36.580541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:36.580555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:36.580569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:36.580587Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:36.580618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602760693216190:2438], now have 1 active actors on pipe
2025-10-10T14:39:36.580628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602760693216382:10265], now have 1 active actors on pipe
2025-10-10T14:39:36.580642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:36.580648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:36.580672Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602759910974022:6452]
2025-10-10T14:39:36.580680Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602759910974022:6452]
2025-10-10T14:39:36.580682Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602759910974022:6452]
2025-10-10T14:39:36.580699Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:36.580710Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:36.580716Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:36.580718Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:36.580724Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:36.580741Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:36.580744Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:36.580765Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7ebcb279-ca54598d-fb63fad-3a69d7af_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:36.580778Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:36.580786Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:36.580788Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:36.580799Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:36.580812Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:36.580848Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602759910974022:6452]
2025-10-10T14:39:36.580876Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:36.580892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:36.580900Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:36.581046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:36.581055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:36.581071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:36.581196Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3048 partition: 0 MaxSeqNo: 40 sessionId: src_id|7ebcb279-ca54598d-fb63fad-3a69d7af_0
2025-10-10T14:39:36.581708Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e6c000-2015d660-f1955bb-9b965ee1_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|7ebcb279-ca54598d-fb63fad-3a69d7af_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:36.584675Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7ebcb279-ca54598d-fb63fad-3a69d7af_0] Write session: try to update token
2025-10-10T14:39:36.584697Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7ebcb279-ca54598d-fb63fad-3a69d7af_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:36.599613Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3048 sessionId: src_id|7ebcb279-ca54598d-fb63fad-3a69d7af_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:36.601036Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:36.601063Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:36.601066Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:36.601068Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:36.601091Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602759910974022:6452]
2025-10-10T14:39:36.601096Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602759910974022:6452]
2025-10-10T14:39:36.601100Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602759910974022:6452]
2025-10-10T14:39:36.601153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:36.601159Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:36.601167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:36.601167Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:36.601169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:36.601171Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:36.601328Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:36.602569Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:36.657147Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602760693216394:2572]
2025-10-10T14:39:36.657516Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 pipe creation result: OK TabletId: 72075186224037892 Generation: 3047, pipe: [1:7559602760693216394:2572]
2025-10-10T14:39:36.716488Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:36.716777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:36.716797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:36.716846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602760693216394:2572], now have 1 active actors on pipe
2025-10-10T14:39:36.717071Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:36.717104Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:36.717114Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 46 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602760693216394:2572]
2025-10-10T14:39:36.717139Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:39:36.717228Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3048 reason: status is not ok: tablet will be restarted right now sessionId: src_id|7ebcb279-ca54598d-fb63fad-3a69d7af_0
2025-10-10T14:39:36.717472Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3048 sessionId: src_id|7ebcb279-ca54598d-fb63fad-3a69d7af_0 is DEAD
2025-10-10T14:39:36.717627Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ebcb279-ca54598d-fb63fad-3a69d7af_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:39:36.717637Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ebcb279-ca54598d-fb63fad-3a69d7af_0] Write session will restart in 0.006421s
2025-10-10T14:39:36.717661Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ebcb279-ca54598d-fb63fad-3a69d7af_0] Write session: Do CDS request
2025-10-10T14:39:36.717668Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ebcb279-ca54598d-fb63fad-3a69d7af_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:36.724925Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7ebcb279-ca54598d-fb63fad-3a69d7af_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:36.725049Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:36.725068Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3049
2025-10-10T14:39:36.725193Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3049 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:36.725235Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3049 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:36.725248Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3049 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:36.725252Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:36.725774Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3049 sessionId:  describe result for acl check
2025-10-10T14:39:36.725815Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:36.725822Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:36.725825Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:36.725832Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602760693216446:10257] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:36.726494Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602760693216446:10257] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:36.729734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602760693216446:10257] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:36.732464Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602760693216446:10257] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:36.732481Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602760693216446:10257] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:36.732484Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602760693216446:10257] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:36.732493Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3049 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:36.736039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:36.736620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:36.736809Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:36.736822Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:36.736833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:36.736898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:36.736942Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602759910974180:6463]
2025-10-10T14:39:36.737617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:36.737935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:36.737987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:36.738324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:36.738389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:36.738395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:36.738397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:36.738398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:36.738399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:36.738401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:36.738402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:36.738403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:36.738404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:36.738406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:36.738407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:36.738408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:36.738410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:36.738416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:36.738430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:36.738435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:36.738439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:36.738443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:36.738448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:36.738452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:36.738456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:36.738459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:36.738464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:36.738468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:36.738472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:36.738475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:36.738484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:36.738494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:36.738500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:36.738506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:36.738510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:36.738516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:36.738520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:36.738526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:36.738532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:36.738537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:36.738542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:36.738547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:36.738551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:36.738557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:36.738567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:36.738572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:36.738582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:36.738588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:36.738598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:36.738602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:36.738607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:36.738618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:36.738622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:36.738632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:36.738637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:36.738643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:36.738686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:36.741182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:36.741588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:36.741602Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:36.741604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:36.741609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:36.741616Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3048 [2:7559602759910974180:6463]
2025-10-10T14:39:36.741630Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:36.741650Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:36.741660Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:36.741664Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:36.741666Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:36.741683Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:36.741696Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:36.741708Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:36.741774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:36.741782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:36.741784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:36.741787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:36.741859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:36.741871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:36.741882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:36.741892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:36.741909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:36.741934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602760693216395:2438], now have 1 active actors on pipe
2025-10-10T14:39:36.741944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602760693216586:10257], now have 1 active actors on pipe
2025-10-10T14:39:36.741952Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602759910974175:6463]
2025-10-10T14:39:36.741954Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602759910974175:6463]
2025-10-10T14:39:36.741956Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602759910974175:6463]
2025-10-10T14:39:36.741972Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:36.741983Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:36.741986Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:36.741987Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:36.741988Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:36.741992Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3048
2025-10-10T14:39:36.742020Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3048
2025-10-10T14:39:36.742004Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:36.742015Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:36.742044Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602759910974175:6463]
2025-10-10T14:39:36.742052Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:36.742057Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:36.742192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:36.742204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:36.742237Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|14399fa1-332c01ca-fc01d145-a31f6567_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:36.742249Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:36.742253Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:36.742261Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:36.742272Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:36.742289Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:36.742307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:36.742477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:36.742490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:36.742510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:36.742611Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3049 partition: 0 MaxSeqNo: 40 sessionId: src_id|14399fa1-332c01ca-fc01d145-a31f6567_0
2025-10-10T14:39:36.743078Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ebcb279-ca54598d-fb63fad-3a69d7af_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|14399fa1-332c01ca-fc01d145-a31f6567_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:36.745948Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|14399fa1-332c01ca-fc01d145-a31f6567_0] Write session: try to update token
2025-10-10T14:39:36.745973Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|14399fa1-332c01ca-fc01d145-a31f6567_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:36.760004Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:39:36.760033Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:36.760046Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602759910974175:6463]
2025-10-10T14:39:36.760103Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:39:36.760128Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:39:36.760305Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:39:36.760470Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:36.760612Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:36.760747Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:36.760984Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:39:36.761034Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:39:36.763618Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3049 sessionId: src_id|14399fa1-332c01ca-fc01d145-a31f6567_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:36.766367Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:36.766611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:36.766653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:36.766709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:39:36.766797Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:39:36.772442Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:36.772465Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:36.772469Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:36.772471Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:36.772482Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602759910974175:6463]
2025-10-10T14:39:36.772487Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602759910974175:6463]
2025-10-10T14:39:36.772490Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602759910974175:6463]
2025-10-10T14:39:36.772540Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:36.772542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:36.772547Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:36.772551Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:36.772551Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:36.772554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:36.772714Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:36.817386Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602760693216612:2572]
2025-10-10T14:39:36.817602Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 pipe creation result: OK TabletId: 72075186224037892 Generation: 3048, pipe: [1:7559602760693216612:2572]
2025-10-10T14:39:36.889057Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:36.897720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:36.897750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:36.897927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:36.897988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:36.898050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:36.898112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:36.898465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:36.898478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:36.898546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:36.898605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:36.898666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:36.898731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:36.898775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:36.898784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:36.898848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:36.898907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:36.898965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:36.899026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:36.899144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:36.899151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:36.899213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:36.899275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:36.899334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:36.899395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:36.899441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:36.899449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:36.899510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:36.899569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:36.899629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:36.899692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:36.899734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:36.899741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:36.899806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:36.899863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:36.899923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:36.899986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:36.900029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:36.900038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:36.900101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:36.900159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:36.900222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:36.900279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:36.900323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:36.900330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:36.900391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:36.900448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:36.900507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:36.900569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:36.900611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:36.900619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:36.900682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:36.900742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:36.900800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:36.900874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:36.900917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:36.900925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:36.900988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:36.901045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:36.901108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:36.901172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:36.901216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:36.901223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:36.901289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602760693216612:2572], now have 1 active actors on pipe
2025-10-10T14:39:36.901536Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:36.901549Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 47 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602760693216612:2572]
2025-10-10T14:39:36.901580Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:36.901587Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:36.901620Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3049 reason: error at write: Disconnected sessionId: src_id|14399fa1-332c01ca-fc01d145-a31f6567_0
2025-10-10T14:39:36.901853Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3049 sessionId: src_id|14399fa1-332c01ca-fc01d145-a31f6567_0 is DEAD
2025-10-10T14:39:36.902008Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|14399fa1-332c01ca-fc01d145-a31f6567_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:36.902027Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|14399fa1-332c01ca-fc01d145-a31f6567_0] Write session will restart in 0.006831s
2025-10-10T14:39:36.901992Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:36.902063Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|14399fa1-332c01ca-fc01d145-a31f6567_0] Write session: Do CDS request
2025-10-10T14:39:36.902071Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|14399fa1-332c01ca-fc01d145-a31f6567_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:36.909959Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|14399fa1-332c01ca-fc01d145-a31f6567_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:36.910033Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:36.910051Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3050
2025-10-10T14:39:36.910237Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3050 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:36.910285Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3050 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:36.910295Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3050 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:36.910300Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:36.910792Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3050 sessionId:  describe result for acl check
2025-10-10T14:39:36.910830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:36.910836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:36.910838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:36.910844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602760693216673:10252] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:36.911418Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602760693216673:10252] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:36.914611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602760693216673:10252] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:36.917570Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602760693216673:10252] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:36.917589Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602760693216673:10252] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:36.917593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602760693216673:10252] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:36.917602Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3050 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:36.918070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:36.920719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:36.921003Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:36.921018Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:36.921031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:36.921619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:36.921675Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602759910974321:6462]
2025-10-10T14:39:36.922291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:36.922728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:36.922801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:36.923149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:36.923222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:36.923230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:36.923231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:36.923232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:36.923233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:36.923234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:36.923236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:36.923237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:36.923238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:36.923239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:36.923240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:36.923242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:36.923243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:36.923249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:36.923262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:36.923265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:36.923269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:36.923273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:36.923276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:36.923280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:36.923283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:36.923287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:36.923291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:36.923294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:36.923297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:36.923301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:36.923310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:36.923318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:36.923325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:36.923330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:36.923333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:36.923338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:36.923342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:36.923347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:36.923351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:36.923356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:36.923360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:36.923365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:36.923372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:36.923377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:36.923383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:36.923401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:36.923405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:36.923410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:36.923413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:36.923418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:36.923422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:36.923427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:36.923430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:36.923435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:36.923439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:36.923444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:36.923476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:36.931496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:36.931860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:36.931877Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:36.931880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:36.931885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:36.931893Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3049 [2:7559602759910974321:6462]
2025-10-10T14:39:36.931912Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:36.931934Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:36.931949Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:36.931958Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:36.931961Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:36.931981Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:36.931994Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:36.932003Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:36.932068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:36.932075Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:36.932077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:36.932079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:36.932153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:36.932160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:36.932171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:36.932185Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:36.932216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:36.932243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602760693216622:2438], now have 1 active actors on pipe
2025-10-10T14:39:36.932252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602760693216814:10252], now have 1 active actors on pipe
2025-10-10T14:39:36.932260Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602759910974316:6462]
2025-10-10T14:39:36.932263Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602759910974316:6462]
2025-10-10T14:39:36.932265Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602759910974316:6462]
2025-10-10T14:39:36.932278Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:36.932294Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:36.932298Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:36.932307Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:36.932310Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:36.932313Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:36.932316Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:36.932359Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602759910974316:6462]
2025-10-10T14:39:36.932370Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:36.932394Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:36.932324Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3049
2025-10-10T14:39:36.932390Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3049
2025-10-10T14:39:36.932523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:36.932535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:36.932569Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|10b042bd-c31ae167-2d004862-55e1ef20_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:36.932582Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:36.932590Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:36.932593Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:36.932605Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:36.932620Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:36.932638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:36.932820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:36.932829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:36.932844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:36.932975Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3050 partition: 0 MaxSeqNo: 40 sessionId: src_id|10b042bd-c31ae167-2d004862-55e1ef20_0
2025-10-10T14:39:36.933459Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|14399fa1-332c01ca-fc01d145-a31f6567_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|10b042bd-c31ae167-2d004862-55e1ef20_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:36.936149Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10b042bd-c31ae167-2d004862-55e1ef20_0] Write session: try to update token
2025-10-10T14:39:36.936168Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10b042bd-c31ae167-2d004862-55e1ef20_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:36.944843Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:39:36.944874Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:36.944886Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602759910974316:6462]
2025-10-10T14:39:36.944939Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:39:36.944950Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:39:36.945145Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:39:36.945299Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:36.945466Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:36.945612Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:36.945806Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:39:36.945855Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:39:36.951401Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3050 sessionId: src_id|10b042bd-c31ae167-2d004862-55e1ef20_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:36.954197Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:36.954497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:36.954524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:36.954570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:39:36.954668Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:39:36.964216Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:36.964240Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:36.964243Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:36.964245Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:36.964257Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602759910974316:6462]
2025-10-10T14:39:36.964261Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602759910974316:6462]
2025-10-10T14:39:36.964265Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602759910974316:6462]
2025-10-10T14:39:36.964314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:36.964321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:36.964324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:36.964323Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:36.964336Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:36.964341Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:36.964459Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:37.001693Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602764988184124:2572]
2025-10-10T14:39:37.002041Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 pipe creation result: OK TabletId: 72075186224037892 Generation: 3049, pipe: [1:7559602764988184124:2572]
2025-10-10T14:39:37.087629Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:37.097080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:37.097119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:37.097425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:37.097508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:37.097585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:37.097666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:37.097714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:37.097719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:37.097813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:37.097891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:37.097964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:37.098041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:37.098091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:37.098095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:37.098177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:37.098242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:37.098325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:37.098402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:37.098568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:37.098571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:37.098656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:37.098724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:37.098796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:37.098875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:37.098919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:37.098922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:37.099000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:37.099074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:37.099143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:37.099211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:37.099257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:37.099260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:37.099340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:37.099411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:37.099491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:37.099566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:37.099611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:37.099618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:37.099701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:37.099773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:37.099847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:37.099925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:37.099973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:37.099976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:37.100062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:37.100127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:37.100202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:37.100276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:37.100327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:37.100330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:37.100410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:37.100481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:37.100552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:37.100626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:37.100671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:37.100674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:37.100758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:37.100828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:37.100914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:37.100989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:37.101159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:37.101162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:37.101231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602764988184124:2572], now have 1 active actors on pipe
2025-10-10T14:39:37.101578Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 48 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602764988184124:2572]
2025-10-10T14:39:37.101639Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:37.101642Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:37.101673Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3050 reason: error at write: Disconnected sessionId: src_id|10b042bd-c31ae167-2d004862-55e1ef20_0
2025-10-10T14:39:37.101848Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:37.101885Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3050 sessionId: src_id|10b042bd-c31ae167-2d004862-55e1ef20_0 is DEAD
2025-10-10T14:39:37.102038Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10b042bd-c31ae167-2d004862-55e1ef20_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:37.102047Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10b042bd-c31ae167-2d004862-55e1ef20_0] Write session will restart in 0.005921s
2025-10-10T14:39:37.102073Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10b042bd-c31ae167-2d004862-55e1ef20_0] Write session: Do CDS request
2025-10-10T14:39:37.102079Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10b042bd-c31ae167-2d004862-55e1ef20_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:37.102797Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:37.108954Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10b042bd-c31ae167-2d004862-55e1ef20_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:37.109034Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:37.109052Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3051
2025-10-10T14:39:37.109180Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3051 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:37.109224Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3051 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:37.109230Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3051 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:37.109235Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:37.109843Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3051 sessionId:  describe result for acl check
2025-10-10T14:39:37.109883Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:37.109890Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:37.109892Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:37.109900Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602764988184138:10248] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:37.110484Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602764988184138:10248] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:37.115271Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602764988184138:10248] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:37.119196Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602764988184138:10248] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:37.119211Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602764988184138:10248] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:37.119215Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602764988184138:10248] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:37.119225Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3051 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:37.138009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:37.138614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:37.138817Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:37.138823Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:37.138834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:37.138883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:37.138926Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602764205941760:6461]
2025-10-10T14:39:37.139649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:37.141023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:37.141541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:37.142292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:37.142376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:37.142382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:37.142383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:37.142385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:37.142386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:37.142387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:37.142389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:37.142390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:37.142391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:37.142393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:37.142394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:37.142396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:37.142397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:37.142404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:37.142418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:37.142422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:37.142427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:37.142431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:37.142435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:37.142439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:37.142443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:37.142448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:37.142453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:37.142457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:37.142461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:37.142465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:37.142473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:37.142489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:37.142501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:37.142512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:37.142522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:37.142527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:37.142536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:37.142546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:37.142557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:37.142567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:37.142576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:37.142586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:37.142595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:37.142605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:37.142614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:37.142623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:37.142632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:37.142643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:37.142651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:37.142661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:37.142669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:37.142675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:37.142683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:37.142693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:37.142702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:37.142712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:37.142759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:37.145525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:37.145849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:37.145862Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:37.145865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:37.145869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:37.145877Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3050 [2:7559602764205941760:6461]
2025-10-10T14:39:37.145893Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:37.145915Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:37.145919Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:37.145923Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:37.145926Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:37.145945Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:37.145953Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:37.145962Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:37.146027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:37.146029Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:37.146032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:37.146034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:37.146129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:37.146137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:37.146148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:37.146166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:37.146189Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:37.146216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602764988184126:2438], now have 1 active actors on pipe
2025-10-10T14:39:37.146226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602764988184188:10248], now have 1 active actors on pipe
2025-10-10T14:39:37.146234Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602764205941755:6461]
2025-10-10T14:39:37.146243Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602764205941755:6461]
2025-10-10T14:39:37.146245Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602764205941755:6461]
2025-10-10T14:39:37.146262Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:37.146291Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:37.146312Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:37.146316Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:37.146345Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602764205941755:6461]
2025-10-10T14:39:37.146344Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:37.146348Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:37.146351Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:37.146355Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:37.146364Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:37.146699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:37.146713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:37.146744Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c815da57-53681fb2-5223a75b-1c97dee7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:37.146758Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:37.146767Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:37.146770Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:37.146787Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:37.146805Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:37.146820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:37.147049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:37.147057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:37.147073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:37.147986Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10b042bd-c31ae167-2d004862-55e1ef20_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|c815da57-53681fb2-5223a75b-1c97dee7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:37.146330Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3050
2025-10-10T14:39:37.146384Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3050
2025-10-10T14:39:37.147207Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3051 partition: 0 MaxSeqNo: 40 sessionId: src_id|c815da57-53681fb2-5223a75b-1c97dee7_0
2025-10-10T14:39:37.150791Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c815da57-53681fb2-5223a75b-1c97dee7_0] Write session: try to update token
2025-10-10T14:39:37.150811Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c815da57-53681fb2-5223a75b-1c97dee7_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:37.168867Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:37.168897Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:37.168900Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:37.168902Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:37.168914Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602764205941755:6461]
2025-10-10T14:39:37.168919Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602764205941755:6461]
2025-10-10T14:39:37.168927Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602764205941755:6461]
2025-10-10T14:39:37.168984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:37.168992Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:37.168995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:37.169153Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:37.171462Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3051 sessionId: src_id|c815da57-53681fb2-5223a75b-1c97dee7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:37.173689Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:37.173712Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:37.173717Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:37.175056Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:37.201881Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602764988184346:2572]
2025-10-10T14:39:37.202614Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 pipe creation result: OK TabletId: 72075186224037892 Generation: 3050, pipe: [1:7559602764988184346:2572]
2025-10-10T14:39:37.296518Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:37.296864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:37.296887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:37.296936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602764988184346:2572], now have 1 active actors on pipe
2025-10-10T14:39:37.297196Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:37.297218Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:37.297235Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:37.297290Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:37.297304Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3051 reason: error at write: Disconnected sessionId: src_id|c815da57-53681fb2-5223a75b-1c97dee7_0
2025-10-10T14:39:37.297371Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 49 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602764988184346:2572]
2025-10-10T14:39:37.297554Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3051 sessionId: src_id|c815da57-53681fb2-5223a75b-1c97dee7_0 is DEAD
2025-10-10T14:39:37.297702Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c815da57-53681fb2-5223a75b-1c97dee7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:37.297712Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c815da57-53681fb2-5223a75b-1c97dee7_0] Write session will restart in 0.008059s
2025-10-10T14:39:37.297739Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c815da57-53681fb2-5223a75b-1c97dee7_0] Write session: Do CDS request
2025-10-10T14:39:37.297750Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c815da57-53681fb2-5223a75b-1c97dee7_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:37.306943Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c815da57-53681fb2-5223a75b-1c97dee7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:37.307041Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:37.307059Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3052
2025-10-10T14:39:37.307194Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3052 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:37.307233Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3052 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:37.307241Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3052 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:37.307244Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:37.307742Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3052 sessionId:  describe result for acl check
2025-10-10T14:39:37.307794Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:37.307803Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:37.307805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:37.307812Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602764988184441:8063] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:37.308431Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602764988184441:8063] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:37.311136Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602764988184441:8063] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:37.314848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602764988184441:8063] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:37.314866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602764988184441:8063] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:37.314870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602764988184441:8063] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:37.314881Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3052 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:37.317547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:37.318982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:37.319743Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:37.319761Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:37.319780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:37.319866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:37.319922Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602764205941944:6434]
2025-10-10T14:39:37.320642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:37.321244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:37.321306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:37.321743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:37.321806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:37.321813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:37.321815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:37.321817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:37.321818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:37.321819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:37.321820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:37.321822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:37.321823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:37.321825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:37.321826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:37.321828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:37.321830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:37.321835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:37.321847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:37.321851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:37.321856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:37.321860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:37.321865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:37.321868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:37.321872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:37.321877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:37.321884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:37.321888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:37.321892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:37.321896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:37.321904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:37.321912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:37.321918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:37.321925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:37.321929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:37.321935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:37.321941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:37.321947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:37.321952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:37.321957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:37.321961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:37.321967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:37.321981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:37.321987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:37.321992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:37.321997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:37.322003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:37.322009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:37.322013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:37.322019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:37.322024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:37.322029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:37.322034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:37.322039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:37.322044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:37.322049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:37.322098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:37.324971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:37.326232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:37.326248Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:37.326251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:37.326255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:37.326264Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3051 [2:7559602764205941944:6434]
2025-10-10T14:39:37.326280Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:37.326298Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:37.326308Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:37.326312Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:37.326315Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:37.326333Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:37.326342Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:37.326349Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:37.326418Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:37.326428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:37.326430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:37.326433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:37.326506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:37.326513Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:37.326525Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:37.326554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:37.326574Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:37.326595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602764988184555:8063], now have 1 active actors on pipe
2025-10-10T14:39:37.326599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602764988184359:2438], now have 1 active actors on pipe
2025-10-10T14:39:37.326606Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602764205941938:6434]
2025-10-10T14:39:37.326608Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602764205941938:6434]
2025-10-10T14:39:37.326611Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602764205941938:6434]
2025-10-10T14:39:37.326627Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:37.326640Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:37.326664Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:37.326667Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:37.326670Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:37.326678Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:37.326682Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:37.326701Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602764205941938:6434]
2025-10-10T14:39:37.326711Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:37.326714Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:37.326738Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3051
2025-10-10T14:39:37.326793Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3051
2025-10-10T14:39:37.326852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:37.326862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:37.326892Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|53e22551-7441bb85-56a02ae8-7a3b7ed1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:37.326905Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:37.326909Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:37.326912Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:37.326921Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:37.326933Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:37.326950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:37.327134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:37.327145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:37.327158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:37.327265Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3052 partition: 0 MaxSeqNo: 40 sessionId: src_id|53e22551-7441bb85-56a02ae8-7a3b7ed1_0
2025-10-10T14:39:37.327739Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c815da57-53681fb2-5223a75b-1c97dee7_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|53e22551-7441bb85-56a02ae8-7a3b7ed1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:37.330629Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|53e22551-7441bb85-56a02ae8-7a3b7ed1_0] Write session: try to update token
2025-10-10T14:39:37.330652Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|53e22551-7441bb85-56a02ae8-7a3b7ed1_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:37.340939Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:39:37.340965Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:37.340978Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602764205941938:6434]
2025-10-10T14:39:37.341037Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:39:37.341040Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:39:37.341225Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:39:37.341398Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:37.341538Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:37.341689Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:37.341886Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:39:37.341945Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:39:37.348561Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3052 sessionId: src_id|53e22551-7441bb85-56a02ae8-7a3b7ed1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:37.351238Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:37.351522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:37.351550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:37.351592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:39:37.351722Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:39:37.361526Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:37.361556Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:37.361560Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:37.361563Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:37.361575Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602764205941938:6434]
2025-10-10T14:39:37.361580Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602764205941938:6434]
2025-10-10T14:39:37.361590Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602764205941938:6434]
2025-10-10T14:39:37.361649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:37.361659Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:37.361663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:37.361666Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:37.361666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:37.361670Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:37.361820Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:37.397458Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602764988184567:2572]
2025-10-10T14:39:37.397863Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 pipe creation result: OK TabletId: 72075186224037892 Generation: 3051, pipe: [1:7559602764988184567:2572]
2025-10-10T14:39:37.479180Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:37.488446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:37.488482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:37.488663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:37.488729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:37.488796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:37.488880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:37.488936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:37.488949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:37.489021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:37.489092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:37.489158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:37.489229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:37.489275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:37.489282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:37.489368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:37.489435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:37.489502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:37.489570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:37.489620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:37.489627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:37.489694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:37.489756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:37.489823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:37.489891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:37.489938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:37.489946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:37.490013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:37.490072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:37.490135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:37.490197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:37.490248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:37.490255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:37.490324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:37.490388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:37.490458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:37.490522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:37.490579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:37.490586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:37.490655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:37.490717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:37.490784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:37.490851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:37.490901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:37.490908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:37.490978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:37.491041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:37.491104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:37.491178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:37.491222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:37.491229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:37.491298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:37.491359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:37.491425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:37.491489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:37.491533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:37.491540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:37.491612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:37.491674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:37.491741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:37.491806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:37.491853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:37.491861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:37.491928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602764988184567:2572], now have 1 active actors on pipe
2025-10-10T14:39:37.492265Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:37.492283Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:37.492319Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3052 reason: error at write: Disconnected sessionId: src_id|53e22551-7441bb85-56a02ae8-7a3b7ed1_0
2025-10-10T14:39:37.492400Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 50 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602764988184567:2572]
2025-10-10T14:39:37.492434Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:37.492576Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3052 sessionId: src_id|53e22551-7441bb85-56a02ae8-7a3b7ed1_0 is DEAD
2025-10-10T14:39:37.492756Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53e22551-7441bb85-56a02ae8-7a3b7ed1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:37.492768Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53e22551-7441bb85-56a02ae8-7a3b7ed1_0] Write session will restart in 0.007431s
2025-10-10T14:39:37.492794Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53e22551-7441bb85-56a02ae8-7a3b7ed1_0] Write session: Do CDS request
2025-10-10T14:39:37.492801Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53e22551-7441bb85-56a02ae8-7a3b7ed1_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:37.493247Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:37.501964Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|53e22551-7441bb85-56a02ae8-7a3b7ed1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:37.502091Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:37.502108Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3053
2025-10-10T14:39:37.502217Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3053 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:37.502253Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3053 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:37.502265Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3053 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:37.502270Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:37.502839Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3053 sessionId:  describe result for acl check
2025-10-10T14:39:37.502885Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:37.502890Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:37.502892Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:37.502900Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602764988184605:8067] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:37.503531Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602764988184605:8067] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:37.507543Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602764988184605:8067] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:37.512093Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602764988184605:8067] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:37.512112Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602764988184605:8067] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:37.512117Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602764988184605:8067] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:37.512128Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3053 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:37.514495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:37.518346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:37.518643Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:37.518666Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:37.518681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:37.518743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:37.518794Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602764205942088:6428]
2025-10-10T14:39:37.519466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:37.519994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:37.520100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:37.520532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:37.520647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:37.520662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:37.520663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:37.520665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:37.520667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:37.520668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:37.520670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:37.520671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:37.520673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:37.520675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:37.520676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:37.520677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:37.520678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:37.520686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:37.520700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:37.520720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:37.520725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:37.520729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:37.520734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:37.520738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:37.520742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:37.520745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:37.520750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:37.520754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:37.520758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:37.520762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:37.520771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:37.520780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:37.520794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:37.520799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:37.520806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:37.520816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:37.520820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:37.520826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:37.520831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:37.520837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:37.520841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:37.520860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:37.520865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:37.520871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:37.520876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:37.520881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:37.520896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:37.520903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:37.520908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:37.520913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:37.520918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:37.520923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:37.520928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:37.520933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:37.520938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:37.520944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:37.520990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:37.525228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:37.525894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:37.525907Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:37.525910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:37.525915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:37.525921Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3052 [2:7559602764205942088:6428]
2025-10-10T14:39:37.525936Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:37.525954Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:37.525958Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:37.525962Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:37.525964Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:37.525982Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:37.525996Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:37.526009Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:37.526077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:37.526084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:37.526086Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:37.526089Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:37.526163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:37.526170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:37.526182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:37.526199Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:37.526288Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3052
2025-10-10T14:39:37.526222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:37.526316Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3052
2025-10-10T14:39:37.526251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602764988184570:2438], now have 1 active actors on pipe
2025-10-10T14:39:37.526255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602764988184764:8067], now have 1 active actors on pipe
2025-10-10T14:39:37.526263Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602764205942083:6428]
2025-10-10T14:39:37.526266Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602764205942083:6428]
2025-10-10T14:39:37.526269Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602764205942083:6428]
2025-10-10T14:39:37.526286Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:37.526301Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:37.526301Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:37.526304Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:37.526307Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:37.526318Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:37.526322Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:37.526357Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602764205942083:6428]
2025-10-10T14:39:37.526364Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:37.526381Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:37.531608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:37.531633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:37.531676Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|90300023-3a798df2-41b21d3e-ea826155_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:37.531700Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:37.531712Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:37.531715Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:37.531732Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:37.531757Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:37.531788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:37.532116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:37.532133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:37.532160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:37.532322Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3053 partition: 0 MaxSeqNo: 40 sessionId: src_id|90300023-3a798df2-41b21d3e-ea826155_0
2025-10-10T14:39:37.532808Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53e22551-7441bb85-56a02ae8-7a3b7ed1_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|90300023-3a798df2-41b21d3e-ea826155_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:37.535646Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|90300023-3a798df2-41b21d3e-ea826155_0] Write session: try to update token
2025-10-10T14:39:37.535665Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|90300023-3a798df2-41b21d3e-ea826155_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:37.548910Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:37.548934Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:37.548938Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:37.548941Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:37.548953Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602764205942083:6428]
2025-10-10T14:39:37.548958Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602764205942083:6428]
2025-10-10T14:39:37.548964Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602764205942083:6428]
2025-10-10T14:39:37.549012Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:37.549020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:37.549027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:37.549028Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:37.549030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:37.549032Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:37.549171Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:37.552684Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3053 sessionId: src_id|90300023-3a798df2-41b21d3e-ea826155_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:37.555502Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:37.592482Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602764988184778:2572]
2025-10-10T14:39:37.592889Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 pipe creation result: OK TabletId: 72075186224037892 Generation: 3052, pipe: [1:7559602764988184778:2572]
2025-10-10T14:39:37.673064Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:37.673880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:37.673897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:37.673945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602764988184778:2572], now have 1 active actors on pipe
2025-10-10T14:39:37.674217Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:37.674631Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90300023-3a798df2-41b21d3e-ea826155_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:37.674642Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90300023-3a798df2-41b21d3e-ea826155_0] Write session will restart in 0.007842s
2025-10-10T14:39:37.674667Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90300023-3a798df2-41b21d3e-ea826155_0] Write session: Do CDS request
2025-10-10T14:39:37.674673Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90300023-3a798df2-41b21d3e-ea826155_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:37.674193Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:37.674208Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:37.674213Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:37.674254Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 51 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602764988184778:2572]
2025-10-10T14:39:37.674287Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3053 reason: error at write: Disconnected sessionId: src_id|90300023-3a798df2-41b21d3e-ea826155_0
2025-10-10T14:39:37.674525Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3053 sessionId: src_id|90300023-3a798df2-41b21d3e-ea826155_0 is DEAD
2025-10-10T14:39:37.684001Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|90300023-3a798df2-41b21d3e-ea826155_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:37.684037Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:37.684056Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3054
2025-10-10T14:39:37.684325Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3054 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:37.684360Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3054 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:37.684367Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3054 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:37.684371Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:37.684892Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3054 sessionId:  describe result for acl check
2025-10-10T14:39:37.684929Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:37.684931Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:37.684935Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:37.684942Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602764988184838:8066] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:37.685561Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602764988184838:8066] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:37.692584Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602764988184838:8066] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:37.698025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:37.698654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:37.698864Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:37.698877Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:37.698890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:37.698949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:37.698997Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602764205942244:6427]
2025-10-10T14:39:37.699679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:37.699733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602764988184838:8066] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:37.699751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602764988184838:8066] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:37.699755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602764988184838:8066] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:37.699765Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3054 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:37.699976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:37.700025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:37.700379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:37.700442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:37.700448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:37.700450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:37.700451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:37.700452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:37.700454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:37.700455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:37.700457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:37.700458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:37.700460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:37.700462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:37.700463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:37.700465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:37.700472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:37.700486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:37.700491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:37.700496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:37.700500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:37.700504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:37.700508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:37.700513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:37.700517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:37.700522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:37.700527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:37.700531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:37.700536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:37.700544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:37.700556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:37.700567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:37.700573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:37.700578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:37.700584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:37.700591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:37.700597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:37.700607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:37.700613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:37.700618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:37.700628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:37.700637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:37.700646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:37.700652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:37.700657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:37.700661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:37.700666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:37.700671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:37.700678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:37.700686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:37.700695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:37.700701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:37.700707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:37.700717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:37.700723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:37.700768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:37.703492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:37.704556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:37.704571Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:37.704574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:37.704579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:37.704588Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3053 [2:7559602764205942244:6427]
2025-10-10T14:39:37.704602Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:37.704622Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:37.704626Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:37.704630Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:37.704637Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:37.704657Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:37.704669Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:37.704681Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:37.704750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:37.704756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:37.704758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:37.704761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:37.704835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:37.704852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:37.704866Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:37.704882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:37.704902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:37.704925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602764988184781:2438], now have 1 active actors on pipe
2025-10-10T14:39:37.704929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602764988184981:8066], now have 1 active actors on pipe
2025-10-10T14:39:37.704937Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602764205942239:6427]
2025-10-10T14:39:37.704944Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602764205942239:6427]
2025-10-10T14:39:37.704947Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602764205942239:6427]
2025-10-10T14:39:37.704961Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:37.704974Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:37.704976Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:37.704978Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:37.704982Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:37.704999Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:37.705007Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:37.705039Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602764205942239:6427]
2025-10-10T14:39:37.705046Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:37.705018Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3053
2025-10-10T14:39:37.705072Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3053
2025-10-10T14:39:37.705049Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:37.705102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:37.705107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:37.705140Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f73d7456-e3c17df8-3d864b46-903648b7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:37.705150Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:37.705155Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:37.705158Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:37.705172Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:37.705187Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:37.705210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:37.705424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:37.705435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:37.705455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:37.705655Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3054 partition: 0 MaxSeqNo: 40 sessionId: src_id|f73d7456-e3c17df8-3d864b46-903648b7_0
2025-10-10T14:39:37.706117Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90300023-3a798df2-41b21d3e-ea826155_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|f73d7456-e3c17df8-3d864b46-903648b7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:37.708993Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f73d7456-e3c17df8-3d864b46-903648b7_0] Write session: try to update token
2025-10-10T14:39:37.709013Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f73d7456-e3c17df8-3d864b46-903648b7_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:37.724215Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3054 sessionId: src_id|f73d7456-e3c17df8-3d864b46-903648b7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:37.725613Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:37.725642Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:37.725645Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:37.725647Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:37.725662Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602764205942239:6427]
2025-10-10T14:39:37.725667Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602764205942239:6427]
2025-10-10T14:39:37.725670Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602764205942239:6427]
2025-10-10T14:39:37.725735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:37.725745Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:37.725751Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:37.725752Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:37.725754Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:37.725755Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:37.725924Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:37.727123Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:37.774295Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602764988184999:2572]
2025-10-10T14:39:37.774606Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 pipe creation result: OK TabletId: 72075186224037892 Generation: 3053, pipe: [1:7559602764988184999:2572]
2025-10-10T14:39:37.844796Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:37.845178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:37.845206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:37.845270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602764988184999:2572], now have 1 active actors on pipe
2025-10-10T14:39:37.845529Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:37.845546Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 52 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602764988184999:2572]
2025-10-10T14:39:37.845578Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:37.845581Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:37.845651Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3054 reason: error at write: Disconnected sessionId: src_id|f73d7456-e3c17df8-3d864b46-903648b7_0
2025-10-10T14:39:37.845871Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:37.845906Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3054 sessionId: src_id|f73d7456-e3c17df8-3d864b46-903648b7_0 is DEAD
2025-10-10T14:39:37.846119Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f73d7456-e3c17df8-3d864b46-903648b7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:37.846130Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f73d7456-e3c17df8-3d864b46-903648b7_0] Write session will restart in 0.007436s
2025-10-10T14:39:37.846157Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f73d7456-e3c17df8-3d864b46-903648b7_0] Write session: Do CDS request
2025-10-10T14:39:37.846167Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f73d7456-e3c17df8-3d864b46-903648b7_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:37.854951Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f73d7456-e3c17df8-3d864b46-903648b7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:37.855014Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:37.855050Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3055
2025-10-10T14:39:37.855244Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3055 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:37.855289Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3055 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:37.855300Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3055 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:37.855304Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:37.855859Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3055 sessionId:  describe result for acl check
2025-10-10T14:39:37.855898Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:37.855900Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:37.855904Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:37.855911Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602764988185026:8083] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:37.856498Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602764988185026:8083] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:37.859064Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602764988185026:8083] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:37.861885Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602764988185026:8083] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:37.861903Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602764988185026:8083] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:37.861917Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602764988185026:8083] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:37.861926Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3055 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:37.873865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:37.876413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:37.877143Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:37.877151Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:37.877171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:37.877266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:37.877317Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602764205942391:6421]
2025-10-10T14:39:37.878060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:37.878580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:37.878667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:37.879059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:37.879151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:37.879153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:37.879155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:37.879156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:37.879158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:37.879160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:37.879161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:37.879163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:37.879165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:37.879166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:37.879168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:37.879169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:37.879171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:37.879178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:37.879194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:37.879198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:37.879202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:37.879206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:37.879211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:37.879215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:37.879220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:37.879224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:37.879229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:37.879234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:37.879239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:37.879243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:37.879254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:37.879264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:37.879274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:37.879281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:37.879287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:37.879293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:37.879299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:37.879305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:37.879311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:37.879318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:37.879323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:37.879328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:37.879334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:37.879340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:37.879346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:37.879353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:37.879359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:37.879386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:37.879392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:37.879398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:37.879404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:37.879410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:37.879418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:37.879424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:37.879430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:37.879436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:37.879483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:37.882693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:37.883077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:37.883083Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:37.883086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:37.883090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:37.883100Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3054 [2:7559602764205942391:6421]
2025-10-10T14:39:37.883595Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3054
2025-10-10T14:39:37.883115Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:37.883139Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:37.883637Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3054
2025-10-10T14:39:37.883144Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:37.883148Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:37.883150Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:37.883169Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:37.883178Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:37.883186Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:37.883262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:37.883264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:37.883266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:37.883269Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:37.883352Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:37.883356Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:37.883368Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:37.883380Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:37.883397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:37.883422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602764988185154:8083], now have 1 active actors on pipe
2025-10-10T14:39:37.883425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602764988185009:2438], now have 1 active actors on pipe
2025-10-10T14:39:37.883434Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602764205942386:6421]
2025-10-10T14:39:37.883436Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602764205942386:6421]
2025-10-10T14:39:37.883439Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602764205942386:6421]
2025-10-10T14:39:37.883459Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:37.883476Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:37.883477Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:37.883481Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:37.883483Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:37.883494Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:37.883498Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:37.883531Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602764205942386:6421]
2025-10-10T14:39:37.883544Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:37.883549Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:37.883963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:37.883979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:37.884028Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a1357f3-ae5c7bf0-a23dd38c-5841f1b7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:37.884038Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:37.884043Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:37.884046Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:37.884060Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:37.884074Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:37.884094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:37.884701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:37.884713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:37.884736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:37.884959Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3055 partition: 0 MaxSeqNo: 40 sessionId: src_id|a1357f3-ae5c7bf0-a23dd38c-5841f1b7_0
2025-10-10T14:39:37.893481Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f73d7456-e3c17df8-3d864b46-903648b7_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|a1357f3-ae5c7bf0-a23dd38c-5841f1b7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:37.896813Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a1357f3-ae5c7bf0-a23dd38c-5841f1b7_0] Write session: try to update token
2025-10-10T14:39:37.896853Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a1357f3-ae5c7bf0-a23dd38c-5841f1b7_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:37.907450Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:37.907477Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:37.907481Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:37.907484Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:37.907496Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602764205942386:6421]
2025-10-10T14:39:37.907501Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602764205942386:6421]
2025-10-10T14:39:37.907508Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602764205942386:6421]
2025-10-10T14:39:37.907567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:37.907577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:37.907577Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:37.907586Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:37.907590Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:37.907591Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:37.907764Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:37.919309Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3055 sessionId: src_id|a1357f3-ae5c7bf0-a23dd38c-5841f1b7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:37.922584Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:37.945855Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602764988185226:2572]
2025-10-10T14:39:37.946185Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 pipe creation result: OK TabletId: 72075186224037892 Generation: 3054, pipe: [1:7559602764988185226:2572]
2025-10-10T14:39:38.038671Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:38.039540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:38.039561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:38.039586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602764988185226:2572], now have 1 active actors on pipe
2025-10-10T14:39:38.039826Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:38.039862Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 53 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602764988185226:2572]
2025-10-10T14:39:38.039892Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:38.039895Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:38.039854Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:38.039967Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3055 reason: error at write: Disconnected sessionId: src_id|a1357f3-ae5c7bf0-a23dd38c-5841f1b7_0
2025-10-10T14:39:38.040221Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3055 sessionId: src_id|a1357f3-ae5c7bf0-a23dd38c-5841f1b7_0 is DEAD
2025-10-10T14:39:38.040396Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1357f3-ae5c7bf0-a23dd38c-5841f1b7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:38.040406Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1357f3-ae5c7bf0-a23dd38c-5841f1b7_0] Write session will restart in 0.005368s
2025-10-10T14:39:38.040433Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1357f3-ae5c7bf0-a23dd38c-5841f1b7_0] Write session: Do CDS request
2025-10-10T14:39:38.040442Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1357f3-ae5c7bf0-a23dd38c-5841f1b7_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:38.046896Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a1357f3-ae5c7bf0-a23dd38c-5841f1b7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:38.047032Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:38.047048Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3056
2025-10-10T14:39:38.047216Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3056 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:38.047253Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3056 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:38.047264Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3056 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:38.047268Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:38.047722Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3056 sessionId:  describe result for acl check
2025-10-10T14:39:38.047761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:38.047767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:38.047771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:38.047777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602769283152540:8093] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:38.048354Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602769283152540:8093] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:38.051515Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602769283152540:8093] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:38.054550Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602769283152540:8093] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:38.054565Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602769283152540:8093] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:38.054569Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602769283152540:8093] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:38.054579Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3056 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:38.059310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:38.059882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:38.060107Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:38.060121Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:38.060133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:38.060201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:38.060256Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602768500909835:6415]
2025-10-10T14:39:38.060943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:38.061277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:38.061322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:38.061683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:38.061745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:38.061751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:38.061752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:38.061754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:38.061755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:38.061756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:38.061757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:38.061759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:38.061760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:38.061761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:38.061763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:38.061764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:38.061765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:38.061772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:38.061786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:38.061790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:38.061794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:38.061798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:38.061803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:38.061806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:38.061822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:38.061825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:38.061828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:38.061830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:38.061832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:38.061834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:38.061842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:38.061851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:38.061857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:38.061863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:38.061867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:38.061872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:38.061877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:38.061883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:38.061888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:38.061896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:38.061900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:38.061903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:38.061906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:38.061909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:38.061912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:38.061915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:38.061918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:38.061921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:38.061924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:38.061927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:38.061934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:38.061941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:38.061951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:38.061957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:38.061962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:38.061970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:38.061995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:38.064588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:38.065419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:38.065433Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:38.065435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:38.065440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:38.065446Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3055 [2:7559602768500909835:6415]
2025-10-10T14:39:38.065459Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:38.065479Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:38.065482Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:38.065486Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:38.065489Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:38.065507Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:38.065515Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:38.065523Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:38.065587Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:38.065595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:38.065597Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:38.065600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:38.065669Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:38.065677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:38.065690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:38.065704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:38.065728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:38.065756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602769283152722:8093], now have 1 active actors on pipe
2025-10-10T14:39:38.065765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602769283152525:2438], now have 1 active actors on pipe
2025-10-10T14:39:38.065773Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602768500909830:6415]
2025-10-10T14:39:38.065776Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602768500909830:6415]
2025-10-10T14:39:38.065779Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602768500909830:6415]
2025-10-10T14:39:38.065793Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:38.065807Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:38.065812Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3055
2025-10-10T14:39:38.065822Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3055
2025-10-10T14:39:38.065814Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:38.065831Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:38.065832Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:38.065834Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:38.065836Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:38.065868Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602768500909830:6415]
2025-10-10T14:39:38.065875Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:38.065881Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:38.065897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:38.065905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:38.065963Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2c48a821-799d7911-3acf2541-a88997b6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:38.065977Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:38.065981Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:38.065984Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:38.065996Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:38.066006Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:38.066024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:38.066180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:38.066188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:38.066203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:38.066281Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3056 partition: 0 MaxSeqNo: 40 sessionId: src_id|2c48a821-799d7911-3acf2541-a88997b6_0
2025-10-10T14:39:38.066754Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1357f3-ae5c7bf0-a23dd38c-5841f1b7_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|2c48a821-799d7911-3acf2541-a88997b6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:38.069544Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2c48a821-799d7911-3acf2541-a88997b6_0] Write session: try to update token
2025-10-10T14:39:38.069562Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2c48a821-799d7911-3acf2541-a88997b6_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:38.084140Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3056 sessionId: src_id|2c48a821-799d7911-3acf2541-a88997b6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:38.086224Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:38.086248Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:38.086252Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:38.086254Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:38.086264Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602768500909830:6415]
2025-10-10T14:39:38.086269Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602768500909830:6415]
2025-10-10T14:39:38.086273Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602768500909830:6415]
2025-10-10T14:39:38.086327Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:38.086327Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:38.086342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:38.086345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:38.086356Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:38.086361Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:38.086484Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:38.086904Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:38.139881Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602769283152736:2572]
2025-10-10T14:39:38.140211Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 pipe creation result: OK TabletId: 72075186224037892 Generation: 3055, pipe: [1:7559602769283152736:2572]
2025-10-10T14:39:38.205873Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:38.206447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:38.206469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:38.206522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602769283152736:2572], now have 1 active actors on pipe
2025-10-10T14:39:38.206765Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:38.206780Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:38.206780Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:38.206764Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:38.206827Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 54 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602769283152736:2572]
2025-10-10T14:39:38.206853Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3056 reason: error at write: Disconnected sessionId: src_id|2c48a821-799d7911-3acf2541-a88997b6_0
2025-10-10T14:39:38.207095Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3056 sessionId: src_id|2c48a821-799d7911-3acf2541-a88997b6_0 is DEAD
2025-10-10T14:39:38.207283Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c48a821-799d7911-3acf2541-a88997b6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:38.207296Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c48a821-799d7911-3acf2541-a88997b6_0] Write session will restart in 0.006377s
2025-10-10T14:39:38.207324Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c48a821-799d7911-3acf2541-a88997b6_0] Write session: Do CDS request
2025-10-10T14:39:38.207330Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c48a821-799d7911-3acf2541-a88997b6_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:38.214958Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2c48a821-799d7911-3acf2541-a88997b6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:38.215132Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:38.215151Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3057
2025-10-10T14:39:38.215272Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3057 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:38.215308Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3057 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:38.215315Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3057 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:38.215319Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:38.215784Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3057 sessionId:  describe result for acl check
2025-10-10T14:39:38.215822Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:38.215828Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:38.215831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:38.215838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602769283152769:8108] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:38.216405Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602769283152769:8108] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:38.219180Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602769283152769:8108] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:38.222651Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602769283152769:8108] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:38.222669Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602769283152769:8108] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:38.222672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602769283152769:8108] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:38.222682Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3057 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:38.225306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:38.228878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:38.229149Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:38.229169Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:38.229185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:38.229251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:38.229311Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602768500909996:6413]
2025-10-10T14:39:38.230019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:38.230432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:38.230505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:38.230893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:38.230980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:38.230988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:38.230989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:38.230991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:38.230992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:38.230993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:38.230995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:38.230996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:38.230997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:38.230998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:38.230999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:38.231000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:38.231004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:38.231012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:38.231025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:38.231030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:38.231034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:38.231038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:38.231042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:38.231046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:38.231050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:38.231054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:38.231059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:38.231064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:38.231068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:38.231072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:38.231080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:38.231090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:38.231098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:38.231104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:38.231109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:38.231113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:38.231117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:38.231123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:38.231128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:38.231132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:38.231136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:38.231141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:38.231145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:38.231149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:38.231153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:38.231158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:38.231163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:38.231173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:38.231177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:38.231187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:38.231192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:38.231197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:38.231202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:38.231208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:38.231212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:38.231217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:38.231256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:38.236043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:38.236769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:38.236785Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:38.236787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:38.236791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:38.236798Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3056 [2:7559602768500909996:6413]
2025-10-10T14:39:38.236813Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:38.236847Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:38.236859Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:38.236864Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:38.236866Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:38.236885Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:38.236899Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:38.236912Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:38.236986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:38.236993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:38.236995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:38.236997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:38.237071Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:38.237082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:38.237095Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:38.237108Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:38.237127Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:38.237150Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602768500909991:6413]
2025-10-10T14:39:38.237152Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602768500909991:6413]
2025-10-10T14:39:38.237154Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602768500909991:6413]
2025-10-10T14:39:38.237164Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:38.237174Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:38.237178Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:38.237178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602769283152738:2438], now have 1 active actors on pipe
2025-10-10T14:39:38.237180Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:38.237188Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:38.237204Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:38.237207Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:38.237213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602769283152946:8108], now have 1 active actors on pipe
2025-10-10T14:39:38.237252Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602768500909991:6413]
2025-10-10T14:39:38.237261Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:38.237277Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:38.237381Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3056
2025-10-10T14:39:38.237429Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3056
2025-10-10T14:39:38.238688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:38.238716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:38.238753Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d1a4b7d3-ad1edee3-12f21398-b8344a2b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:38.238773Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:38.238778Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:38.238781Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:38.238795Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:38.238818Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:38.238857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:38.239045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:38.239057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:38.239075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:38.239189Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3057 partition: 0 MaxSeqNo: 40 sessionId: src_id|d1a4b7d3-ad1edee3-12f21398-b8344a2b_0
2025-10-10T14:39:38.239684Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c48a821-799d7911-3acf2541-a88997b6_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|d1a4b7d3-ad1edee3-12f21398-b8344a2b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:38.242639Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d1a4b7d3-ad1edee3-12f21398-b8344a2b_0] Write session: try to update token
2025-10-10T14:39:38.242659Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d1a4b7d3-ad1edee3-12f21398-b8344a2b_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:38.257669Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3057 sessionId: src_id|d1a4b7d3-ad1edee3-12f21398-b8344a2b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:38.260567Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:38.257778Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:38.257801Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:38.257804Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:38.257806Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:38.257816Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602768500909991:6413]
2025-10-10T14:39:38.257820Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602768500909991:6413]
2025-10-10T14:39:38.257824Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602768500909991:6413]
2025-10-10T14:39:38.257880Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:38.257884Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:38.257888Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:38.257891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:38.257892Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:38.257894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:38.258027Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:38.306787Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602769283152975:2572]
2025-10-10T14:39:38.307104Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 pipe creation result: OK TabletId: 72075186224037892 Generation: 3056, pipe: [1:7559602769283152975:2572]
2025-10-10T14:39:38.376444Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:38.376764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:38.376779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:38.376825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602769283152975:2572], now have 1 active actors on pipe
2025-10-10T14:39:38.377073Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:38.377091Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:38.377150Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:38.377161Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3057 reason: error at write: Disconnected sessionId: src_id|d1a4b7d3-ad1edee3-12f21398-b8344a2b_0
2025-10-10T14:39:38.377204Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 55 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602769283152975:2572]
2025-10-10T14:39:38.377106Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:38.377429Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3057 sessionId: src_id|d1a4b7d3-ad1edee3-12f21398-b8344a2b_0 is DEAD
2025-10-10T14:39:38.377581Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1a4b7d3-ad1edee3-12f21398-b8344a2b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:38.377594Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1a4b7d3-ad1edee3-12f21398-b8344a2b_0] Write session will restart in 0.006704s
2025-10-10T14:39:38.377620Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1a4b7d3-ad1edee3-12f21398-b8344a2b_0] Write session: Do CDS request
2025-10-10T14:39:38.377630Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1a4b7d3-ad1edee3-12f21398-b8344a2b_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:38.385904Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d1a4b7d3-ad1edee3-12f21398-b8344a2b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:38.386248Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:38.386264Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3058
2025-10-10T14:39:38.386466Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3058 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:38.386505Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3058 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:38.386512Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3058 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:38.386516Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:38.386998Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3058 sessionId:  describe result for acl check
2025-10-10T14:39:38.387039Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:38.387042Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:38.387044Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:38.387050Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602769283153060:8125] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:38.387641Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602769283153060:8125] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:38.390400Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602769283153060:8125] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:38.393520Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602769283153060:8125] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:38.393537Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602769283153060:8125] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:38.393541Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602769283153060:8125] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:38.393551Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3058 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:38.394287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:38.397224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:38.397485Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:38.397502Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:38.397517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:38.397583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:38.397630Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602768500910171:6369]
2025-10-10T14:39:38.398272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:38.398589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:38.398633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:38.398963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:38.399043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:38.399055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:38.399057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:38.399059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:38.399061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:38.399063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:38.399064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:38.399065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:38.399066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:38.399068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:38.399069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:38.399070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:38.399071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:38.399077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:38.399090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:38.399094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:38.399099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:38.399102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:38.399106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:38.399110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:38.399113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:38.399117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:38.399124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:38.399127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:38.399130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:38.399134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:38.399145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:38.399154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:38.399160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:38.399166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:38.399171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:38.399176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:38.399181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:38.399186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:38.399193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:38.399198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:38.399203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:38.399209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:38.399215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:38.399221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:38.399226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:38.399230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:38.399235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:38.399241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:38.399245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:38.399250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:38.399259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:38.399264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:38.399269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:38.399273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:38.399278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:38.399284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:38.399323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:38.403697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:38.404041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:38.404055Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:38.404058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:38.404062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:38.404069Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3057 [2:7559602768500910171:6369]
2025-10-10T14:39:38.404084Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:38.404472Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3057
2025-10-10T14:39:38.404508Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3057
2025-10-10T14:39:38.404110Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:38.404121Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:38.404125Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:38.404127Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:38.404145Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:38.404153Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:38.404161Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:38.404243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:38.404245Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:38.404250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:38.404253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:38.404329Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:38.404331Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:38.404342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:38.404354Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:38.404371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:38.404395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602769283152977:2438], now have 1 active actors on pipe
2025-10-10T14:39:38.404399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602769283153178:8125], now have 1 active actors on pipe
2025-10-10T14:39:38.404409Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602768500910166:6369]
2025-10-10T14:39:38.404412Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602768500910166:6369]
2025-10-10T14:39:38.404414Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602768500910166:6369]
2025-10-10T14:39:38.404428Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:38.404443Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:38.404442Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:38.404446Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:38.404448Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:38.404459Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:38.404463Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:38.404498Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602768500910166:6369]
2025-10-10T14:39:38.404501Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:38.404511Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:38.405081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:38.405089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:38.405133Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e0426e60-a1ee2f45-7d7b6a3b-7332142e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:38.405142Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:38.405146Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:38.405148Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:38.405160Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:38.405174Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:38.405192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:38.405443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:38.405471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:38.405502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:38.405673Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3058 partition: 0 MaxSeqNo: 40 sessionId: src_id|e0426e60-a1ee2f45-7d7b6a3b-7332142e_0
2025-10-10T14:39:38.406164Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1a4b7d3-ad1edee3-12f21398-b8344a2b_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|e0426e60-a1ee2f45-7d7b6a3b-7332142e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:38.409037Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e0426e60-a1ee2f45-7d7b6a3b-7332142e_0] Write session: try to update token
2025-10-10T14:39:38.409056Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e0426e60-a1ee2f45-7d7b6a3b-7332142e_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:38.424170Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3058 sessionId: src_id|e0426e60-a1ee2f45-7d7b6a3b-7332142e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:38.424731Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:38.424755Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:38.424758Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:38.424761Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:38.424773Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602768500910166:6369]
2025-10-10T14:39:38.424777Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602768500910166:6369]
2025-10-10T14:39:38.424782Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602768500910166:6369]
2025-10-10T14:39:38.424843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:38.424850Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:38.424852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:38.424855Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:38.424875Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:38.424880Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:38.424994Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:38.427424Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:38.477240Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602769283153191:2572]
2025-10-10T14:39:38.477567Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 pipe creation result: OK TabletId: 72075186224037892 Generation: 3057, pipe: [1:7559602769283153191:2572]
2025-10-10T14:39:38.545473Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:38.546056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:38.546076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:38.546127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602769283153191:2572], now have 1 active actors on pipe
2025-10-10T14:39:38.546380Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:38.546415Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:38.546461Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 56 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602769283153191:2572]
2025-10-10T14:39:38.546478Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:39:38.546556Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3058 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e0426e60-a1ee2f45-7d7b6a3b-7332142e_0
2025-10-10T14:39:38.546806Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3058 sessionId: src_id|e0426e60-a1ee2f45-7d7b6a3b-7332142e_0 is DEAD
2025-10-10T14:39:38.547297Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0426e60-a1ee2f45-7d7b6a3b-7332142e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:39:38.547309Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0426e60-a1ee2f45-7d7b6a3b-7332142e_0] Write session will restart in 0.007084s
2025-10-10T14:39:38.547346Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0426e60-a1ee2f45-7d7b6a3b-7332142e_0] Write session: Do CDS request
2025-10-10T14:39:38.547353Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0426e60-a1ee2f45-7d7b6a3b-7332142e_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:38.556894Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e0426e60-a1ee2f45-7d7b6a3b-7332142e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:38.557139Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:38.557156Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3059
2025-10-10T14:39:38.557283Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3059 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:38.557316Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3059 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:38.557323Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3059 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:38.557343Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:38.557836Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3059 sessionId:  describe result for acl check
2025-10-10T14:39:38.557877Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:38.557884Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:38.557887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:38.557893Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602769283153224:8137] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:38.558489Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602769283153224:8137] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:38.560953Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602769283153224:8137] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:38.564392Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602769283153224:8137] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:38.564407Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602769283153224:8137] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:38.564410Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602769283153224:8137] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:38.564419Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3059 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:38.567194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:38.570743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:38.571003Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:38.571009Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:38.571022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:38.571086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:38.571124Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602768500910320:6382]
2025-10-10T14:39:38.571743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:38.572094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:38.572144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:38.572488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:38.572548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:38.572555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:38.572556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:38.572558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:38.572559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:38.572560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:38.572562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:38.572563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:38.572564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:38.572565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:38.572567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:38.572568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:38.572570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:38.572575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:38.572590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:38.572594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:38.572598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:38.572602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:38.572606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:38.572610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:38.572614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:38.572618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:38.572623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:38.572627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:38.572631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:38.572635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:38.572642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:38.572652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:38.572658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:38.572665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:38.572669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:38.572675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:38.572679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:38.572685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:38.572690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:38.572695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:38.572700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:38.572711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:38.572717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:38.572722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:38.572727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:38.572734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:38.572739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:38.572751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:38.572756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:38.572761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:38.572770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:38.572775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:38.572782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:38.572788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:38.572797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:38.572802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:38.572856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:38.576164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:38.576508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:38.576524Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:38.576527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:38.576532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:38.576552Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3058 [2:7559602768500910320:6382]
2025-10-10T14:39:38.576571Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:38.576596Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:38.576604Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:38.576608Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:38.576611Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:38.576630Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:38.576643Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:38.576653Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:38.576722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:38.576729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:38.576731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:38.576734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:38.576959Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3058
2025-10-10T14:39:38.577001Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3058
2025-10-10T14:39:38.577514Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:38.577529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:38.577544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:38.577558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:38.577583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:38.577614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602769283153393:8137], now have 1 active actors on pipe
2025-10-10T14:39:38.577623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602769283153193:2438], now have 1 active actors on pipe
2025-10-10T14:39:38.577641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:38.577653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:38.577678Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602768500910315:6382]
2025-10-10T14:39:38.577686Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602768500910315:6382]
2025-10-10T14:39:38.577688Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602768500910315:6382]
2025-10-10T14:39:38.577703Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:38.577724Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:38.577737Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:38.577748Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:38.577749Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:38.577751Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:38.577752Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:38.577775Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|45e601f2-f9232223-52859ab1-11d2f3e4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:38.577790Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:38.577799Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:38.577802Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:38.577815Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:38.577831Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:38.577874Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602768500910315:6382]
2025-10-10T14:39:38.577886Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:38.577893Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:38.577902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:38.578083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:38.578091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:38.578108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:38.578193Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3059 partition: 0 MaxSeqNo: 40 sessionId: src_id|45e601f2-f9232223-52859ab1-11d2f3e4_0
2025-10-10T14:39:38.578644Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0426e60-a1ee2f45-7d7b6a3b-7332142e_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|45e601f2-f9232223-52859ab1-11d2f3e4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:38.581530Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|45e601f2-f9232223-52859ab1-11d2f3e4_0] Write session: try to update token
2025-10-10T14:39:38.581548Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|45e601f2-f9232223-52859ab1-11d2f3e4_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:38.596046Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3059 sessionId: src_id|45e601f2-f9232223-52859ab1-11d2f3e4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:38.596668Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:39:38.596693Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:38.596705Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602768500910315:6382]
2025-10-10T14:39:38.596754Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:39:38.596764Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:39:38.596973Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:39:38.597134Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:38.597288Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:38.597452Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:38.597673Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:39:38.597719Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:39:38.598709Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:38.598926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:38.598946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:38.598985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:39:38.599075Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:39:38.608914Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:38.608937Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:38.608941Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:38.608943Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:38.608955Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602768500910315:6382]
2025-10-10T14:39:38.608958Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602768500910315:6382]
2025-10-10T14:39:38.608962Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602768500910315:6382]
2025-10-10T14:39:38.609011Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:38.609014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:38.609018Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:38.609022Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:38.609022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:38.609025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:38.609156Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:38.646735Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602769283153408:2572]
2025-10-10T14:39:38.647032Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 pipe creation result: OK TabletId: 72075186224037892 Generation: 3058, pipe: [1:7559602769283153408:2572]
2025-10-10T14:39:38.725844Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:38.734210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:38.734240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:38.734413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:38.734471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:38.734534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:38.734595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:38.734984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:38.734997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:38.735063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:38.735119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:38.735175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:38.735234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:38.735280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:38.735287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:38.735351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:38.735413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:38.735472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:38.735537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:38.735584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:38.735591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:38.735652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:38.735709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:38.735768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:38.735840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:38.735887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:38.735893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:38.735971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:38.736031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:38.736088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:38.736143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:38.736192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:38.736198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:38.736255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:38.736312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:38.736373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:38.736441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:38.736481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:38.736486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:38.736550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:38.736617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:38.736675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:38.736734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:38.736775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:38.736780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:38.736857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:38.736920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:38.736985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:38.737046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:38.737088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:38.737096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:38.737159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:38.737215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:38.737273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:38.737345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:38.737390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:38.737396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:38.737458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:38.737511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:38.737566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:38.737631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:38.737671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:38.737677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:38.737733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602769283153408:2572], now have 1 active actors on pipe
2025-10-10T14:39:38.737950Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 57 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602769283153408:2572]
2025-10-10T14:39:38.737967Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:38.738007Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:38.738012Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:38.738044Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3059 reason: error at write: Disconnected sessionId: src_id|45e601f2-f9232223-52859ab1-11d2f3e4_0
2025-10-10T14:39:38.738299Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3059 sessionId: src_id|45e601f2-f9232223-52859ab1-11d2f3e4_0 is DEAD
2025-10-10T14:39:38.738308Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:38.738460Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45e601f2-f9232223-52859ab1-11d2f3e4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:38.738470Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45e601f2-f9232223-52859ab1-11d2f3e4_0] Write session will restart in 0.009832s
2025-10-10T14:39:38.738497Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45e601f2-f9232223-52859ab1-11d2f3e4_0] Write session: Do CDS request
2025-10-10T14:39:38.738503Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45e601f2-f9232223-52859ab1-11d2f3e4_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:38.749929Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|45e601f2-f9232223-52859ab1-11d2f3e4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:38.749970Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:38.749989Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3060
2025-10-10T14:39:38.750181Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3060 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:38.750229Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3060 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:38.750241Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3060 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:38.750246Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:38.750710Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3060 sessionId:  describe result for acl check
2025-10-10T14:39:38.750758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:38.750765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:38.750767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:38.750773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602769283153567:8139] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:38.751345Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602769283153567:8139] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:38.754078Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602769283153567:8139] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:38.757620Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602769283153567:8139] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:38.757637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602769283153567:8139] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:38.757640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602769283153567:8139] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:38.757650Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3060 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:38.757826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:38.758374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:38.758585Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:38.758598Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:38.758612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:38.758673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:38.758720Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602768500910482:6379]
2025-10-10T14:39:38.759342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:38.759696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:38.759742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:38.760077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:38.760138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:38.760144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:38.760146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:38.760147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:38.760149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:38.760150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:38.760152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:38.760153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:38.760155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:38.760156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:38.760157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:38.760159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:38.760160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:38.760166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:38.760181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:38.760184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:38.760188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:38.760192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:38.760195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:38.760199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:38.760202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:38.760205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:38.760209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:38.760212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:38.760216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:38.760219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:38.760228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:38.760236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:38.760243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:38.760248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:38.760252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:38.760260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:38.760265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:38.760269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:38.760273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:38.760278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:38.760282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:38.760288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:38.760293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:38.760299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:38.760303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:38.760309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:38.760314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:38.760319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:38.760325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:38.760330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:38.760335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:38.760340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:38.760345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:38.760357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:38.760362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:38.760366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:38.760406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:38.762947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:38.763713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:38.763729Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:38.763731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:38.763735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:38.763743Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3059 [2:7559602768500910482:6379]
2025-10-10T14:39:38.763758Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:38.763782Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:38.763791Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:38.763794Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:38.763796Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:38.763814Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:38.763826Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:38.763834Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:38.763906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:38.763914Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:38.763916Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:38.763918Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:38.763987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:38.763995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:38.764010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:38.764024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:38.764043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:38.764070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602769283153411:2438], now have 1 active actors on pipe
2025-10-10T14:39:38.764079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602769283153614:8139], now have 1 active actors on pipe
2025-10-10T14:39:38.764087Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602768500910476:6379]
2025-10-10T14:39:38.764093Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602768500910476:6379]
2025-10-10T14:39:38.764095Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602768500910476:6379]
2025-10-10T14:39:38.764110Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:38.764123Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:38.764126Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:38.764129Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:38.764131Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:38.764145Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:38.764149Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:38.764180Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602768500910476:6379]
2025-10-10T14:39:38.764190Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:38.764192Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:38.764173Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3059
2025-10-10T14:39:38.764165Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3059
2025-10-10T14:39:38.764218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:38.764228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:38.764272Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d08b34bf-49f3f3d9-d4d2bfe2-8367bb0c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:38.764285Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:38.764293Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:38.764295Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:38.764308Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:38.764323Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:38.764354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:38.764581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:38.764593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:38.764611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:38.764718Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3060 partition: 0 MaxSeqNo: 40 sessionId: src_id|d08b34bf-49f3f3d9-d4d2bfe2-8367bb0c_0
2025-10-10T14:39:38.765163Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45e601f2-f9232223-52859ab1-11d2f3e4_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|d08b34bf-49f3f3d9-d4d2bfe2-8367bb0c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:38.767951Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d08b34bf-49f3f3d9-d4d2bfe2-8367bb0c_0] Write session: try to update token
2025-10-10T14:39:38.767971Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d08b34bf-49f3f3d9-d4d2bfe2-8367bb0c_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:38.782334Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3060 sessionId: src_id|d08b34bf-49f3f3d9-d4d2bfe2-8367bb0c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:38.783774Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:38.783800Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:38.783803Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:38.783805Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:38.783815Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602768500910476:6379]
2025-10-10T14:39:38.783820Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602768500910476:6379]
2025-10-10T14:39:38.783824Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602768500910476:6379]
2025-10-10T14:39:38.783875Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:38.783874Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:38.783882Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:38.783887Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:38.783890Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:38.783893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:38.785176Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:38.784031Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:38.838201Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602769283153643:2572]
2025-10-10T14:39:38.838528Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 pipe creation result: OK TabletId: 72075186224037892 Generation: 3059, pipe: [1:7559602769283153643:2572]
2025-10-10T14:39:38.904640Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:38.905248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:38.905264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:38.905314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602769283153643:2572], now have 1 active actors on pipe
2025-10-10T14:39:38.905652Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:38.905858Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 58 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602769283153643:2572]
2025-10-10T14:39:38.905887Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:38.905898Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:38.905971Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3060 reason: error at write: Disconnected sessionId: src_id|d08b34bf-49f3f3d9-d4d2bfe2-8367bb0c_0
2025-10-10T14:39:38.906213Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3060 sessionId: src_id|d08b34bf-49f3f3d9-d4d2bfe2-8367bb0c_0 is DEAD
2025-10-10T14:39:38.906369Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d08b34bf-49f3f3d9-d4d2bfe2-8367bb0c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:38.906381Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d08b34bf-49f3f3d9-d4d2bfe2-8367bb0c_0] Write session will restart in 0.007928s
2025-10-10T14:39:38.906409Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d08b34bf-49f3f3d9-d4d2bfe2-8367bb0c_0] Write session: Do CDS request
2025-10-10T14:39:38.906416Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d08b34bf-49f3f3d9-d4d2bfe2-8367bb0c_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:38.906185Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:38.916078Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:38.916110Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3061
2025-10-10T14:39:38.916302Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d08b34bf-49f3f3d9-d4d2bfe2-8367bb0c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:38.916555Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3061 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:38.916598Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3061 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:38.916604Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3061 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:38.916608Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:38.917096Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3061 sessionId:  describe result for acl check
2025-10-10T14:39:38.917146Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:38.917148Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:38.917150Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:38.917156Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602769283153733:8152] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:38.917777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602769283153733:8152] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:38.920705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602769283153733:8152] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:38.923864Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602769283153733:8152] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:38.923883Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602769283153733:8152] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:38.923887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602769283153733:8152] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:38.923897Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3061 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:38.930497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:38.931175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:38.931381Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:38.931394Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:38.931406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:38.931469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:38.931522Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602768500910633:6376]
2025-10-10T14:39:38.932171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:38.932572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:38.932622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:38.932971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:38.933041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:38.933051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:38.933052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:38.933053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:38.933055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:38.933056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:38.933057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:38.933058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:38.933059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:38.933060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:38.933062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:38.933063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:38.933065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:38.933072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:38.933085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:38.933089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:38.933092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:38.933096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:38.933101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:38.933105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:38.933109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:38.933113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:38.933118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:38.933122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:38.933126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:38.933131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:38.933139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:38.933147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:38.933154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:38.933160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:38.933164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:38.933170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:38.933174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:38.933180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:38.933185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:38.933191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:38.933195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:38.933200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:38.933204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:38.933209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:38.933213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:38.933220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:38.933224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:38.933230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:38.933234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:38.933239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:38.933243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:38.933248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:38.933253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:38.933258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:38.933262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:38.933267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:38.933309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:38.936051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:38.936469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:38.936498Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:38.936506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:38.936514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:38.936520Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3060 [2:7559602768500910633:6376]
2025-10-10T14:39:38.936543Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:38.936568Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:38.936577Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:38.936581Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:38.936584Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:38.936604Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:38.936617Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:38.936631Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:38.936716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:38.936725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:38.936728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:38.936730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:38.936820Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:38.936840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:38.936854Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:38.936866Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:38.936884Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:38.936910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602769283153857:8152], now have 1 active actors on pipe
2025-10-10T14:39:38.936921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602769283153650:2438], now have 1 active actors on pipe
2025-10-10T14:39:38.936931Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602768500910628:6376]
2025-10-10T14:39:38.936933Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602768500910628:6376]
2025-10-10T14:39:38.936936Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602768500910628:6376]
2025-10-10T14:39:38.936952Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:38.936967Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:38.936979Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:38.936981Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:38.936966Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3060
2025-10-10T14:39:38.936988Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:38.936970Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3060
2025-10-10T14:39:38.937006Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:38.937010Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:38.937049Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602768500910628:6376]
2025-10-10T14:39:38.937060Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:38.937071Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:38.937150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:38.937163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:38.937203Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3393c09c-2b8737e9-a807c1f4-55922da5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:38.937218Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:38.937227Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:38.937231Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:38.937244Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:38.937261Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:38.937277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:38.937817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:38.937830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:38.937852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:38.938004Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3061 partition: 0 MaxSeqNo: 40 sessionId: src_id|3393c09c-2b8737e9-a807c1f4-55922da5_0
2025-10-10T14:39:38.938472Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d08b34bf-49f3f3d9-d4d2bfe2-8367bb0c_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|3393c09c-2b8737e9-a807c1f4-55922da5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:38.941420Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3393c09c-2b8737e9-a807c1f4-55922da5_0] Write session: try to update token
2025-10-10T14:39:38.941436Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3393c09c-2b8737e9-a807c1f4-55922da5_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:38.956600Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3061 sessionId: src_id|3393c09c-2b8737e9-a807c1f4-55922da5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:38.959512Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:38.959543Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:38.959549Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:38.959552Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:38.959564Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602768500910628:6376]
2025-10-10T14:39:38.959571Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602768500910628:6376]
2025-10-10T14:39:38.959578Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602768500910628:6376]
2025-10-10T14:39:38.959634Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:38.959646Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:38.959652Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:38.959656Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:38.959660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:38.959663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:38.959889Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:38.960679Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:39.006128Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602773578121171:2572]
2025-10-10T14:39:39.006448Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 pipe creation result: OK TabletId: 72075186224037892 Generation: 3060, pipe: [1:7559602773578121171:2572]
2025-10-10T14:39:39.086823Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:39.087368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:39.087387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:39.087434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602773578121171:2572], now have 1 active actors on pipe
2025-10-10T14:39:39.087784Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:39.088190Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3393c09c-2b8737e9-a807c1f4-55922da5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:39.088204Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3393c09c-2b8737e9-a807c1f4-55922da5_0] Write session will restart in 0.005214s
2025-10-10T14:39:39.088232Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3393c09c-2b8737e9-a807c1f4-55922da5_0] Write session: Do CDS request
2025-10-10T14:39:39.088238Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3393c09c-2b8737e9-a807c1f4-55922da5_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:39.087668Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:39.087685Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:39.087694Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 59 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602773578121171:2572]
2025-10-10T14:39:39.087728Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:39.087750Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3061 reason: error at write: Disconnected sessionId: src_id|3393c09c-2b8737e9-a807c1f4-55922da5_0
2025-10-10T14:39:39.087993Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3061 sessionId: src_id|3393c09c-2b8737e9-a807c1f4-55922da5_0 is DEAD
2025-10-10T14:39:39.097880Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3393c09c-2b8737e9-a807c1f4-55922da5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:39.097977Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:39.098002Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3062
2025-10-10T14:39:39.098163Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3062 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:39.098214Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3062 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:39.098221Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3062 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:39.098225Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:39.098899Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3062 sessionId:  describe result for acl check
2025-10-10T14:39:39.098938Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:39.098945Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:39.098947Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:39.098954Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602773578121259:8158] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:39.099536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602773578121259:8158] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:39.102563Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602773578121259:8158] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:39.105081Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602773578121259:8158] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:39.105095Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602773578121259:8158] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:39.105098Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602773578121259:8158] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:39.105107Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3062 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:39.108965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:39.109570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:39.109778Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:39.109792Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:39.109803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:39.109861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:39.109909Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602772795878081:6371]
2025-10-10T14:39:39.110552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:39.110846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:39.110905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:39.111247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:39.111315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:39.111322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:39.111323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:39.111325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:39.111326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:39.111328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:39.111329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:39.111330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:39.111332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:39.111333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:39.111335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:39.111336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:39.111337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:39.111344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:39.111358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:39.111363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:39.111368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:39.111372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:39.111376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:39.111380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:39.111385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:39.111389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:39.111394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:39.111398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:39.111403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:39.111407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:39.111416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:39.111425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:39.111432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:39.111439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:39.111444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:39.111449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:39.111454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:39.111466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:39.111471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:39.111478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:39.111482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:39.111488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:39.111496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:39.111502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:39.111512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:39.111518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:39.111523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:39.111535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:39.111539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:39.111548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:39.111555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:39.111560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:39.111565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:39.111571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:39.111581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:39.111587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:39.111633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:39.114312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:39.115316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:39.115331Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:39.115333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:39.115337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:39.115344Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3061 [2:7559602772795878081:6371]
2025-10-10T14:39:39.115358Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:39.115377Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:39.115386Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:39.115389Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:39.115392Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:39.115411Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:39.115424Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:39.115433Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:39.115498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:39.115507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:39.115509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:39.115512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:39.115602Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:39.115611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:39.115624Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:39.115638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:39.115657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:39.115686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602773578121378:8158], now have 1 active actors on pipe
2025-10-10T14:39:39.115698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602773578121173:2438], now have 1 active actors on pipe
2025-10-10T14:39:39.115706Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602772795878076:6371]
2025-10-10T14:39:39.115714Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602772795878076:6371]
2025-10-10T14:39:39.115716Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602772795878076:6371]
2025-10-10T14:39:39.115734Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:39.115751Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:39.115755Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:39.115755Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:39.115758Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:39.115773Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:39.115781Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:39.115758Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3061
2025-10-10T14:39:39.115824Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602772795878076:6371]
2025-10-10T14:39:39.115774Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3061
2025-10-10T14:39:39.115838Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:39.115844Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:39.115957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:39.115968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:39.116007Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|77824d1a-b91337fe-759d0186-7122a958_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:39.116020Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:39.116024Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:39.116027Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:39.116039Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:39.116057Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:39.116078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:39.116275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:39.116283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:39.116298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:39.116396Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3062 partition: 0 MaxSeqNo: 40 sessionId: src_id|77824d1a-b91337fe-759d0186-7122a958_0
2025-10-10T14:39:39.116853Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3393c09c-2b8737e9-a807c1f4-55922da5_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|77824d1a-b91337fe-759d0186-7122a958_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:39.119563Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|77824d1a-b91337fe-759d0186-7122a958_0] Write session: try to update token
2025-10-10T14:39:39.119581Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|77824d1a-b91337fe-759d0186-7122a958_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:39.136052Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:39:39.136079Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:39.136092Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602772795878076:6371]
2025-10-10T14:39:39.136154Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:39:39.136172Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:39:39.136350Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:39:39.136512Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:39.136669Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:39.136836Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:39.137045Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:39:39.137098Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:39:39.138301Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3062 sessionId: src_id|77824d1a-b91337fe-759d0186-7122a958_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:39.141325Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:39.142032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:39.142067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:39.142128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:39:39.142250Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:39:39.148917Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:39.148943Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:39.148947Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:39.148950Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:39.148961Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602772795878076:6371]
2025-10-10T14:39:39.148965Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602772795878076:6371]
2025-10-10T14:39:39.148969Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602772795878076:6371]
2025-10-10T14:39:39.149021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:39.149026Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:39.149033Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:39.149033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:39.149037Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:39.149038Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:39.149175Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:39.187946Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602773578121391:2572]
2025-10-10T14:39:39.188272Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 pipe creation result: OK TabletId: 72075186224037892 Generation: 3061, pipe: [1:7559602773578121391:2572]
2025-10-10T14:39:39.266935Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:39.276237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:39.276277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:39.276470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:39.276545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:39.276618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:39.276685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:39.276732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:39.276748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:39.276833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:39.276891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:39.276954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:39.277017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:39.277063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:39.277066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:39.277139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:39.277200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:39.277263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:39.277323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:39.277455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:39.277468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:39.277536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:39.277607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:39.277679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:39.277750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:39.277800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:39.277808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:39.277880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:39.277948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:39.278019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:39.278091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:39.278214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:39.278222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:39.278292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:39.278361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:39.278436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:39.278511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:39.278626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:39.278638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:39.278714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:39.278780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:39.278857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:39.278924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:39.278969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:39.278976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:39.279051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:39.279117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:39.279185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:39.279250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:39.279296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:39.279306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:39.279377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:39.279442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:39.279510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:39.279580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:39.279629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:39.279636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:39.279706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:39.279769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:39.279837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:39.279901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:39.279945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:39.279952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:39.280010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602773578121391:2572], now have 1 active actors on pipe
2025-10-10T14:39:39.280418Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 60 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602773578121391:2572]
2025-10-10T14:39:39.280476Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:39.280483Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:39.280517Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3062 reason: error at write: Disconnected sessionId: src_id|77824d1a-b91337fe-759d0186-7122a958_0
2025-10-10T14:39:39.280848Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3062 sessionId: src_id|77824d1a-b91337fe-759d0186-7122a958_0 is DEAD
2025-10-10T14:39:39.280948Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77824d1a-b91337fe-759d0186-7122a958_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:39.280959Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77824d1a-b91337fe-759d0186-7122a958_0] Write session will restart in 0.008236s
2025-10-10T14:39:39.280984Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77824d1a-b91337fe-759d0186-7122a958_0] Write session: Do CDS request
2025-10-10T14:39:39.280991Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77824d1a-b91337fe-759d0186-7122a958_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:39.281072Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:39.281144Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:39.290932Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|77824d1a-b91337fe-759d0186-7122a958_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:39.290992Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:39.291009Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3063
2025-10-10T14:39:39.291200Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3063 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:39.291238Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3063 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:39.291248Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3063 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:39.291252Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:39.291699Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3063 sessionId:  describe result for acl check
2025-10-10T14:39:39.291737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:39.291739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:39.291741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:39.291747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602773578121422:8181] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:39.292322Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602773578121422:8181] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:39.294967Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602773578121422:8181] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:39.297908Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602773578121422:8181] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:39.297923Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602773578121422:8181] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:39.297927Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602773578121422:8181] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:39.297936Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3063 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:39.304872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:39.305572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:39.305794Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:39.305807Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:39.305818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:39.305869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:39.305916Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602772795878249:6362]
2025-10-10T14:39:39.306588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:39.307035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:39.307086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:39.307402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:39.307466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:39.307474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:39.307475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:39.307477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:39.307478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:39.307480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:39.307481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:39.307482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:39.307483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:39.307485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:39.307486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:39.307487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:39.307488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:39.307494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:39.307506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:39.307510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:39.307515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:39.307519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:39.307523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:39.307527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:39.307531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:39.307535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:39.307539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:39.307544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:39.307547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:39.307551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:39.307559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:39.307568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:39.307575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:39.307580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:39.307585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:39.307590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:39.307593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:39.307596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:39.307599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:39.307602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:39.307604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:39.307607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:39.307610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:39.307614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:39.307616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:39.307620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:39.307622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:39.307627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:39.307630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:39.307633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:39.307636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:39.307638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:39.307641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:39.307644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:39.307647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:39.307650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:39.307673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:39.310229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:39.311046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:39.311058Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:39.311061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:39.311065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:39.311072Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3062 [2:7559602772795878249:6362]
2025-10-10T14:39:39.311085Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:39.311103Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:39.311108Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:39.311112Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:39.311114Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:39.311132Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:39.311149Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:39.311163Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:39.311227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:39.311233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:39.311236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:39.311238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:39.311315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:39.311323Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:39.311336Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:39.311349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:39.311371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:39.311402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602773578121398:2438], now have 1 active actors on pipe
2025-10-10T14:39:39.311407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602773578121600:8181], now have 1 active actors on pipe
2025-10-10T14:39:39.311416Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602772795878244:6362]
2025-10-10T14:39:39.311423Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602772795878244:6362]
2025-10-10T14:39:39.311426Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602772795878244:6362]
2025-10-10T14:39:39.311440Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:39.311459Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:39.311480Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:39.311482Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:39.311487Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:39.311488Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:39.311489Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:39.311516Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602772795878244:6362]
2025-10-10T14:39:39.311529Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:39.311531Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:39.311525Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3062
2025-10-10T14:39:39.311587Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3062
2025-10-10T14:39:39.311676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:39.311688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:39.311718Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|36839017-c72e454a-841bdc24-becd4cac_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:39.311733Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:39.311737Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:39.311740Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:39.311753Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:39.311765Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:39.311785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:39.311939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:39.311949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:39.311965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:39.312090Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3063 partition: 0 MaxSeqNo: 40 sessionId: src_id|36839017-c72e454a-841bdc24-becd4cac_0
2025-10-10T14:39:39.313471Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77824d1a-b91337fe-759d0186-7122a958_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|36839017-c72e454a-841bdc24-becd4cac_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:39.316922Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|36839017-c72e454a-841bdc24-becd4cac_0] Write session: try to update token
2025-10-10T14:39:39.316947Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|36839017-c72e454a-841bdc24-becd4cac_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:39.324038Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:39:39.324060Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:39.324071Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602772795878244:6362]
2025-10-10T14:39:39.324113Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:39:39.324126Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:39:39.324293Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:39:39.324444Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:39.324585Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:39.324718Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:39.324926Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:39:39.324970Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:39:39.337144Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3063 sessionId: src_id|36839017-c72e454a-841bdc24-becd4cac_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:39.339872Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:39.340098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:39.340125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:39.340167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:39:39.343797Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:39.343826Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:39.343829Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:39.343831Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:39.343843Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602772795878244:6362]
2025-10-10T14:39:39.343847Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602772795878244:6362]
2025-10-10T14:39:39.343851Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602772795878244:6362]
2025-10-10T14:39:39.343909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:39.343924Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:39.343927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:39.344079Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:39.344356Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:39.344377Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:39.344384Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:39.340271Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:39:39.380435Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602773578121636:2572]
2025-10-10T14:39:39.380693Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 pipe creation result: OK TabletId: 72075186224037892 Generation: 3062, pipe: [1:7559602773578121636:2572]
2025-10-10T14:39:39.460951Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:39.470405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:39.470439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:39.470637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:39.470706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:39.470783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:39.470860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:39.470909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:39.470919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:39.470998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:39.471066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:39.471131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:39.471204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:39.471252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:39.471255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:39.471328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:39.471389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:39.471458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:39.471523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:39.471569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:39.471572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:39.471660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:39.471725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:39.471793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:39.471860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:39.471907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:39.471910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:39.471989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:39.472052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:39.472121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:39.472185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:39.472234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:39.472237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:39.472309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:39.472370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:39.472432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:39.472499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:39.472541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:39.472544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:39.472619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:39.472679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:39.472746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:39.472807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:39.472868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:39.472874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:39.472943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:39.473001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:39.473062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:39.473127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:39.473172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:39.473175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:39.473243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:39.473312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:39.473601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:39.473682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:39.473733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:39.473736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:39.473808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:39.473868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:39.473948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:39.474019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:39.474070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:39.474077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:39.474139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602773578121636:2572], now have 1 active actors on pipe
2025-10-10T14:39:39.474445Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:39.474484Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 61 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602773578121636:2572]
2025-10-10T14:39:39.474516Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:39.474521Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:39.474562Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3063 reason: error at write: Disconnected sessionId: src_id|36839017-c72e454a-841bdc24-becd4cac_0
2025-10-10T14:39:39.474860Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3063 sessionId: src_id|36839017-c72e454a-841bdc24-becd4cac_0 is DEAD
2025-10-10T14:39:39.474995Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|36839017-c72e454a-841bdc24-becd4cac_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:39.475006Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|36839017-c72e454a-841bdc24-becd4cac_0] Write session will restart in 0.009304s
2025-10-10T14:39:39.475033Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|36839017-c72e454a-841bdc24-becd4cac_0] Write session: Do CDS request
2025-10-10T14:39:39.475039Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|36839017-c72e454a-841bdc24-becd4cac_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:39.475537Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:39.485952Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|36839017-c72e454a-841bdc24-becd4cac_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:39.486407Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:39.486436Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3064
2025-10-10T14:39:39.486612Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3064 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:39.486661Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3064 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:39.486672Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3064 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:39.486677Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:39.487137Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3064 sessionId:  describe result for acl check
2025-10-10T14:39:39.487174Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:39.487181Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:39.487183Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:39.487191Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602773578121745:5207] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:39.487791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602773578121745:5207] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:39.493963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:39.495932Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602773578121745:5207] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:39.496891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:39.497390Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:39.497407Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:39.497424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:39.497502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:39.497550Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602772795878430:6351]
2025-10-10T14:39:39.498162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:39.498519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:39.498565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:39.498898Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602773578121745:5207] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:39.498916Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602773578121745:5207] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:39.498920Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602773578121745:5207] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:39.498928Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3064 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:39.498879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:39.498942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:39.498944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:39.498945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:39.498946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:39.498947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:39.498948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:39.498949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:39.498950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:39.498952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:39.498953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:39.498954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:39.498956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:39.498957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:39.498963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:39.498977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:39.498981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:39.498985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:39.498989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:39.498993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:39.498997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:39.499000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:39.499004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:39.499008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:39.499012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:39.499015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:39.499019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:39.499028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:39.499037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:39.499044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:39.499050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:39.499054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:39.499059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:39.499063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:39.499069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:39.499073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:39.499078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:39.499083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:39.499088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:39.499092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:39.499098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:39.499103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:39.499108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:39.499113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:39.499118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:39.499122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:39.499127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:39.499134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:39.499139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:39.499142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:39.499147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:39.499151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:39.499156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:39.499191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:39.501681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:39.502052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:39.502057Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:39.502060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:39.502064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:39.502071Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3063 [2:7559602772795878430:6351]
2025-10-10T14:39:39.502084Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:39.502103Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:39.502106Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:39.502110Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:39.502112Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:39.502131Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:39.502139Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:39.502148Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:39.502212Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:39.502215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:39.502217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:39.502220Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:39.502295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:39.502299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:39.502309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:39.502320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:39.502336Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:39.502360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602773578121849:5207], now have 1 active actors on pipe
2025-10-10T14:39:39.502364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602773578121639:2438], now have 1 active actors on pipe
2025-10-10T14:39:39.502372Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602772795878424:6351]
2025-10-10T14:39:39.502374Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602772795878424:6351]
2025-10-10T14:39:39.502376Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602772795878424:6351]
2025-10-10T14:39:39.502391Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:39.502405Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:39.502408Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:39.502412Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:39.502414Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:39.502421Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:39.502424Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:39.502467Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602772795878424:6351]
2025-10-10T14:39:39.502479Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:39.502467Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3063
2025-10-10T14:39:39.502498Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:39.502514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:39.502504Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3063
2025-10-10T14:39:39.502519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:39.502558Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d83d3737-b48ac068-43125a7b-8d208266_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:39.502572Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:39.502575Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:39.502578Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:39.502590Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:39.502950Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3064 partition: 0 MaxSeqNo: 40 sessionId: src_id|d83d3737-b48ac068-43125a7b-8d208266_0
2025-10-10T14:39:39.502606Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:39.502631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:39.502848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:39.502852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:39.502870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:39.503378Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|36839017-c72e454a-841bdc24-becd4cac_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|d83d3737-b48ac068-43125a7b-8d208266_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:39.506065Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d83d3737-b48ac068-43125a7b-8d208266_0] Write session: try to update token
2025-10-10T14:39:39.506082Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d83d3737-b48ac068-43125a7b-8d208266_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:39.525030Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3064 sessionId: src_id|d83d3737-b48ac068-43125a7b-8d208266_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:39.527830Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:39.528042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:39.528075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:39.528119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:39:39.528240Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:39:39.532246Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:39.532274Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:39.532278Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:39.532285Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:39.532295Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602772795878424:6351]
2025-10-10T14:39:39.532299Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602772795878424:6351]
2025-10-10T14:39:39.532304Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602772795878424:6351]
2025-10-10T14:39:39.532367Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:39.532374Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:39.532382Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:39.532383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:39.532385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:39.532398Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:39.532541Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:39.574454Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602773578121858:2572]
2025-10-10T14:39:39.574738Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 pipe creation result: OK TabletId: 72075186224037892 Generation: 3063, pipe: [1:7559602773578121858:2572]
2025-10-10T14:39:39.646236Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:39.655446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:39.655480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:39.655655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:39.655731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:39.655810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:39.655889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:39.655944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:39.655955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:39.656038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:39.656109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:39.656178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:39.656254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:39.656303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:39.656310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:39.656384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:39.656451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:39.656527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:39.656597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:39.656648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:39.656655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:39.656726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:39.656794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:39.656873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:39.656937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:39.656984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:39.656991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:39.657061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:39.657120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:39.657183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:39.657256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:39.657302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:39.657310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:39.657394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:39.657459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:39.657524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:39.657586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:39.657630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:39.657639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:39.657709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:39.657769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:39.657836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:39.657899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:39.657948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:39.657957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:39.658028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:39.658095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:39.658159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:39.658229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:39.658281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:39.658290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:39.658358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:39.658419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:39.658486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:39.658555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:39.658600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:39.658607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:39.658670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:39.658735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:39.658803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:39.658864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:39.658910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:39.658919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:39.658982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602773578121858:2572], now have 1 active actors on pipe
2025-10-10T14:39:39.659677Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d83d3737-b48ac068-43125a7b-8d208266_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:39.659692Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d83d3737-b48ac068-43125a7b-8d208266_0] Write session will restart in 0.007035s
2025-10-10T14:39:39.659720Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d83d3737-b48ac068-43125a7b-8d208266_0] Write session: Do CDS request
2025-10-10T14:39:39.659216Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:39.659228Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:39.659726Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d83d3737-b48ac068-43125a7b-8d208266_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:39.659231Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:39.659266Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3064 reason: error at write: Disconnected sessionId: src_id|d83d3737-b48ac068-43125a7b-8d208266_0
2025-10-10T14:39:39.659286Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 62 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602773578121858:2572]
2025-10-10T14:39:39.659509Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3064 sessionId: src_id|d83d3737-b48ac068-43125a7b-8d208266_0 is DEAD
2025-10-10T14:39:39.660388Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:39.667985Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d83d3737-b48ac068-43125a7b-8d208266_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:39.668122Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:39.668139Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3065
2025-10-10T14:39:39.668263Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3065 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:39.668300Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3065 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:39.668310Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3065 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:39.668315Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:39.668830Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3065 sessionId:  describe result for acl check
2025-10-10T14:39:39.668881Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:39.668888Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:39.668890Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:39.668899Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602773578121912:5190] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:39.669550Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602773578121912:5190] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:39.672107Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602773578121912:5190] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:39.674963Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602773578121912:5190] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:39.674980Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602773578121912:5190] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:39.674983Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602773578121912:5190] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:39.674992Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3065 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:39.676115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:39.678813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:39.679063Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:39.679083Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:39.679099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:39.679175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:39.679225Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602772795878599:6342]
2025-10-10T14:39:39.679692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:39.680044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:39.680100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:39.680458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:39.680546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:39.680553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:39.680555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:39.680556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:39.680557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:39.680558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:39.680559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:39.680560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:39.680562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:39.680563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:39.680564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:39.680565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:39.680566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:39.680574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:39.680587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:39.680592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:39.680596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:39.680600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:39.680604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:39.680608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:39.680611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:39.680615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:39.680619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:39.680622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:39.680626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:39.680629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:39.680637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:39.680645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:39.680652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:39.680657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:39.680662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:39.680667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:39.680672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:39.680677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:39.680682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:39.680688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:39.680692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:39.680698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:39.680703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:39.680709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:39.680714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:39.680720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:39.680725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:39.680731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:39.680737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:39.680742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:39.680746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:39.680751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:39.680768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:39.680774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:39.680778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:39.680783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:39.680836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:39.683436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:39.684347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:39.684360Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:39.684362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:39.684366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:39.684374Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3064 [2:7559602772795878599:6342]
2025-10-10T14:39:39.684389Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:39.684412Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:39.684419Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:39.684423Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:39.684425Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:39.684444Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:39.684457Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:39.684466Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:39.684542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:39.684550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:39.684552Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:39.684554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:39.684637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:39.684645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:39.684657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:39.684674Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:39.684695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:39.684722Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602772795878594:6342]
2025-10-10T14:39:39.684729Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602772795878594:6342]
2025-10-10T14:39:39.684731Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602772795878594:6342]
2025-10-10T14:39:39.684740Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:39.684753Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:39.684759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602773578121860:2438], now have 1 active actors on pipe
2025-10-10T14:39:39.684762Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:39.684765Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:39.684766Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:39.684782Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:39.684786Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:39.684792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602773578122069:5190], now have 1 active actors on pipe
2025-10-10T14:39:39.684834Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602772795878594:6342]
2025-10-10T14:39:39.684848Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:39.684856Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:39.685076Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3064
2025-10-10T14:39:39.685087Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3064
2025-10-10T14:39:39.685753Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3065 partition: 0 MaxSeqNo: 40 sessionId: src_id|c25568a5-b9b2e188-41b61c3d-f9cf8d2b_0
2025-10-10T14:39:39.686188Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d83d3737-b48ac068-43125a7b-8d208266_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|c25568a5-b9b2e188-41b61c3d-f9cf8d2b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:39.685296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:39.685307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:39.685358Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c25568a5-b9b2e188-41b61c3d-f9cf8d2b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:39.685367Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:39.685372Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:39.685375Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:39.685387Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:39.685402Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:39.685419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:39.685619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:39.685622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:39.685638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:39.689124Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c25568a5-b9b2e188-41b61c3d-f9cf8d2b_0] Write session: try to update token
2025-10-10T14:39:39.689141Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c25568a5-b9b2e188-41b61c3d-f9cf8d2b_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:39.702939Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:39:39.702960Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:39.702973Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602772795878594:6342]
2025-10-10T14:39:39.703028Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:39:39.703031Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:39:39.703218Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:39:39.703373Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:39.703520Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:39.703659Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:39.703777Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3065 sessionId: src_id|c25568a5-b9b2e188-41b61c3d-f9cf8d2b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:39.703870Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:39:39.703915Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:39:39.706534Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:39.706759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:39.706778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:39.706832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:39:39.706959Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:39:39.719216Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:39.719233Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:39.719237Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:39.719239Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:39.719251Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602772795878594:6342]
2025-10-10T14:39:39.719255Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602772795878594:6342]
2025-10-10T14:39:39.719264Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602772795878594:6342]
2025-10-10T14:39:39.719314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:39.719322Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:39.719326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:39.719329Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:39.719329Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:39.719334Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:39.719471Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:39.759316Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602773578122083:2572]
2025-10-10T14:39:39.759622Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 pipe creation result: OK TabletId: 72075186224037892 Generation: 3064, pipe: [1:7559602773578122083:2572]
2025-10-10T14:39:39.817696Z :ERROR: [/Root] OnFederationDiscovery: Got error. Status: CLIENT_DEADLINE_EXCEEDED. Description: [ { <main>: Error: GRpc error: (4): Deadline Exceeded } { <main>: Error: Grpc error response on endpoint localhost:7170 } ]
2025-10-10T14:39:39.838552Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:39.847261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:39.847293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:39.847484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:39.847548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:39.847614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:39.847684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:39.847729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:39.847739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:39.847808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:39.847875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:39.847937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:39.848005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:39.848059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:39.848070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:39.848138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:39.848202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:39.848266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:39.848335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:39.848381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:39.848388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:39.848456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:39.848523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:39.848587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:39.848651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:39.848697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:39.848703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:39.848769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:39.848845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:39.848910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:39.848983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:39.849029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:39.849036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:39.849108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:39.849175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:39.849239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:39.849300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:39.849363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:39.849371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:39.849439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:39.849503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:39.849577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:39.849659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:39.849704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:39.849711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:39.849775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:39.849835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:39.849894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:39.849958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:39.850005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:39.850009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:39.850074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:39.850134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:39.850198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:39.850261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:39.850306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:39.850313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:39.850379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:39.850440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:39.850512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:39.850580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:39.850627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:39.850634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:39.850708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602773578122083:2572], now have 1 active actors on pipe
2025-10-10T14:39:39.850985Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:39.851001Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:39.851035Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3065 reason: error at write: Disconnected sessionId: src_id|c25568a5-b9b2e188-41b61c3d-f9cf8d2b_0
2025-10-10T14:39:39.851275Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3065 sessionId: src_id|c25568a5-b9b2e188-41b61c3d-f9cf8d2b_0 is DEAD
2025-10-10T14:39:39.851315Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:39.851380Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 63 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602773578122083:2572]
2025-10-10T14:39:39.851438Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c25568a5-b9b2e188-41b61c3d-f9cf8d2b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:39.851446Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c25568a5-b9b2e188-41b61c3d-f9cf8d2b_0] Write session will restart in 0.005995s
2025-10-10T14:39:39.851473Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c25568a5-b9b2e188-41b61c3d-f9cf8d2b_0] Write session: Do CDS request
2025-10-10T14:39:39.851479Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c25568a5-b9b2e188-41b61c3d-f9cf8d2b_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:39.851794Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:39.858887Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c25568a5-b9b2e188-41b61c3d-f9cf8d2b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:39.859024Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:39.859042Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3066
2025-10-10T14:39:39.859164Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3066 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:39.859212Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3066 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:39.859223Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3066 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:39.859227Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:39.859820Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3066 sessionId:  describe result for acl check
2025-10-10T14:39:39.859860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:39.859867Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:39.859869Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:39.859876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602773578122118:5172] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:39.860483Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602773578122118:5172] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:39.863248Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602773578122118:5172] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:39.866168Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602773578122118:5172] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:39.866182Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602773578122118:5172] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:39.866185Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602773578122118:5172] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:39.866195Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3066 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:39.869877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:39.873039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:39.873269Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:39.873279Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:39.873292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:39.873406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:39.873454Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602772795878756:6346]
2025-10-10T14:39:39.874104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:39.874489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:39.874555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:39.874938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:39.874992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:39.874994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:39.874995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:39.874997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:39.874999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:39.875000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:39.875002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:39.875003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:39.875004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:39.875006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:39.875007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:39.875008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:39.875009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:39.875016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:39.875030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:39.875035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:39.875039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:39.875043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:39.875047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:39.875051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:39.875055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:39.875060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:39.875073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:39.875077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:39.875081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:39.875085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:39.875093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:39.875103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:39.875109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:39.875115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:39.875120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:39.875125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:39.875141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:39.875146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:39.875151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:39.875157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:39.875163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:39.875168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:39.875175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:39.875180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:39.875184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:39.875190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:39.875195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:39.875200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:39.875205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:39.875210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:39.875218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:39.875224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:39.875228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:39.875233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:39.875237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:39.875243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:39.875284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:39.879186Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3065
2025-10-10T14:39:39.879194Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3065
2025-10-10T14:39:39.878321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:39.878705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:39.878711Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:39.878714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:39.878719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:39.878726Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3065 [2:7559602772795878756:6346]
2025-10-10T14:39:39.878741Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:39.878763Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:39.878767Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:39.878771Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:39.878774Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:39.878795Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:39.878804Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:39.878813Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:39.878890Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:39.878893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:39.878895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:39.878901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:39.878987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:39.880208Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3066 partition: 0 MaxSeqNo: 40 sessionId: src_id|4a491c05-c16be384-564ac765-8ea29111_0
2025-10-10T14:39:39.878990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:39.879002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:39.879013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:39.879029Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:39.879054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602773578122291:5172], now have 1 active actors on pipe
2025-10-10T14:39:39.879059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602773578122100:2438], now have 1 active actors on pipe
2025-10-10T14:39:39.879067Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602772795878751:6346]
2025-10-10T14:39:39.879070Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602772795878751:6346]
2025-10-10T14:39:39.879071Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602772795878751:6346]
2025-10-10T14:39:39.879090Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:39.879103Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:39.879107Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:39.879107Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:39.879109Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:39.879124Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:39.879127Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:39.879169Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602772795878751:6346]
2025-10-10T14:39:39.879180Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:39.879221Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:39.879295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:39.879301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:39.879340Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4a491c05-c16be384-564ac765-8ea29111_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:39.879349Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:39.879355Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:39.879357Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:39.879374Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:39.879387Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:39.879404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:39.879625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:39.879630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:39.879649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:39.880716Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c25568a5-b9b2e188-41b61c3d-f9cf8d2b_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|4a491c05-c16be384-564ac765-8ea29111_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:39.883646Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4a491c05-c16be384-564ac765-8ea29111_0] Write session: try to update token
2025-10-10T14:39:39.883670Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4a491c05-c16be384-564ac765-8ea29111_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:39.895380Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:39:39.895400Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:39.895413Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602772795878751:6346]
2025-10-10T14:39:39.895472Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:39:39.895472Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:39:39.895702Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:39:39.895883Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:39.896060Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:39.896238Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:39.896480Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:39:39.896534Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:39:39.900794Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3066 sessionId: src_id|4a491c05-c16be384-564ac765-8ea29111_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:39.903662Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:39.904063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:39.904097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:39.904149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:39:39.904327Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:39:39.914347Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:39.914365Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:39.914369Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:39.914371Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:39.914384Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602772795878751:6346]
2025-10-10T14:39:39.914389Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602772795878751:6346]
2025-10-10T14:39:39.914393Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602772795878751:6346]
2025-10-10T14:39:39.914444Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:39.914452Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:39.914455Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:39.914457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:39.914462Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:39.914467Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:39.914601Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:39.952550Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602773578122328:2572]
2025-10-10T14:39:39.953367Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 pipe creation result: OK TabletId: 72075186224037892 Generation: 3065, pipe: [1:7559602773578122328:2572]
2025-10-10T14:39:40.077220Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:40.086282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:40.086309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:40.086489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:40.086552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:40.086621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:40.086680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:40.086720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:40.086729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:40.086794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:40.086855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:40.086915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:40.086971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:40.087016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:40.087024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:40.087088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:40.087154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:40.087215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:40.087278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:40.087323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:40.087330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:40.087400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:40.087462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:40.087523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:40.087589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:40.087634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:40.087637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:40.087705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:40.087761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:40.087821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:40.087879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:40.087918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:40.087921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:40.087988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:40.088044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:40.088100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:40.088160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:40.088201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:40.088204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:40.088269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:40.088322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:40.088381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:40.088438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:40.088478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:40.088481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:40.088547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:40.088604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:40.088663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:40.088723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:40.088764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:40.088766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:40.088844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:40.088901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:40.088964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:40.089023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:40.089065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:40.089067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:40.089133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:40.089189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:40.089251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:40.089311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:40.089527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:40.089536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:40.089599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602773578122328:2572], now have 1 active actors on pipe
2025-10-10T14:39:40.089856Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 64 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602773578122328:2572]
2025-10-10T14:39:40.089860Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:40.089865Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:40.089913Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3066 reason: error at write: Disconnected sessionId: src_id|4a491c05-c16be384-564ac765-8ea29111_0
2025-10-10T14:39:40.089913Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:40.090843Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:40.091659Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3066 sessionId: src_id|4a491c05-c16be384-564ac765-8ea29111_0 is DEAD
2025-10-10T14:39:40.093417Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a491c05-c16be384-564ac765-8ea29111_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:40.093431Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a491c05-c16be384-564ac765-8ea29111_0] Write session will restart in 0.006146s
2025-10-10T14:39:40.093457Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a491c05-c16be384-564ac765-8ea29111_0] Write session: Do CDS request
2025-10-10T14:39:40.093463Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a491c05-c16be384-564ac765-8ea29111_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:40.100895Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4a491c05-c16be384-564ac765-8ea29111_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:40.101022Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:40.101040Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3067
2025-10-10T14:39:40.101162Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3067 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:40.101211Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3067 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:40.101221Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3067 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:40.101226Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:40.101730Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3067 sessionId:  describe result for acl check
2025-10-10T14:39:40.101772Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:40.101775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:40.101778Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:40.101785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602777873089714:5171] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:40.102372Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602777873089714:5171] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:40.106878Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602777873089714:5171] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:40.110028Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602777873089714:5171] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:40.110045Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602777873089714:5171] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:40.110049Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602777873089714:5171] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:40.110059Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3067 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:40.114788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:40.115397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:40.115594Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:40.115606Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:40.115618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:40.115664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:40.115709Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602777090846210:6344]
2025-10-10T14:39:40.116376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:40.116728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:40.116784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:40.117140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:40.117193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:40.117199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:40.117200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:40.117202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:40.117203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:40.117204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:40.117206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:40.117207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:40.117208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:40.117210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:40.117211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:40.117212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:40.117213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:40.117219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:40.117233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:40.117237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:40.117241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:40.117245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:40.117249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:40.117253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:40.117258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:40.117262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:40.117266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:40.117269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:40.117273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:40.117277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:40.117286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:40.117294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:40.117301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:40.117307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:40.117311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:40.117317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:40.117321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:40.117327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:40.117347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:40.117357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:40.117361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:40.117367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:40.117372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:40.117381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:40.117386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:40.117391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:40.117396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:40.117406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:40.117411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:40.117423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:40.117427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:40.117434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:40.117439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:40.117445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:40.117449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:40.117455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:40.117494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:40.120016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:40.120846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:40.120857Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:40.120859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:40.120864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:40.120872Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3066 [2:7559602777090846210:6344]
2025-10-10T14:39:40.120885Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:40.120903Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:40.120907Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:40.120911Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:40.120913Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:40.120932Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:40.120940Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:40.120949Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:40.121015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:40.121022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:40.121024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:40.121027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:40.121099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:40.121107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:40.121117Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:40.121129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:40.121151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:40.121173Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602777090846205:6344]
2025-10-10T14:39:40.121180Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602777090846205:6344]
2025-10-10T14:39:40.121182Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602777090846205:6344]
2025-10-10T14:39:40.121192Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:40.121200Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:40.121206Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:40.121212Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:40.121217Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:40.121222Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:40.121225Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:40.121237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602777873089626:2438], now have 1 active actors on pipe
2025-10-10T14:39:40.121245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602777873089835:5171], now have 1 active actors on pipe
2025-10-10T14:39:40.121272Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602777090846205:6344]
2025-10-10T14:39:40.121283Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:40.121292Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3066
2025-10-10T14:39:40.121366Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3066
2025-10-10T14:39:40.121294Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:40.121397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:40.121403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:40.121436Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b09da80e-d0a44b2a-1fb0cc63-99d89887_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:40.121443Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:40.121447Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:40.121449Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:40.121461Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:40.121471Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:40.121485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:40.121765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:40.121777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:40.121815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:40.121940Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3067 partition: 0 MaxSeqNo: 40 sessionId: src_id|b09da80e-d0a44b2a-1fb0cc63-99d89887_0
2025-10-10T14:39:40.125429Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a491c05-c16be384-564ac765-8ea29111_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|b09da80e-d0a44b2a-1fb0cc63-99d89887_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:40.128027Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b09da80e-d0a44b2a-1fb0cc63-99d89887_0] Write session: try to update token
2025-10-10T14:39:40.128048Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b09da80e-d0a44b2a-1fb0cc63-99d89887_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:40.140741Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:40.140765Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:40.140769Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:40.140772Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:40.140783Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602777090846205:6344]
2025-10-10T14:39:40.140788Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602777090846205:6344]
2025-10-10T14:39:40.140792Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602777090846205:6344]
2025-10-10T14:39:40.140856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:40.140862Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:40.140864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:40.140867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:40.140868Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:40.140873Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:40.141003Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:40.151060Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3067 sessionId: src_id|b09da80e-d0a44b2a-1fb0cc63-99d89887_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:40.154089Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:40.189936Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602777873089849:2572]
2025-10-10T14:39:40.190270Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 pipe creation result: OK TabletId: 72075186224037892 Generation: 3066, pipe: [1:7559602777873089849:2572]
2025-10-10T14:39:40.260042Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:40.260699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:40.260711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:40.260730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602777873089849:2572], now have 1 active actors on pipe
2025-10-10T14:39:40.260939Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:40.260996Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 65 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602777873089849:2572]
2025-10-10T14:39:40.261003Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:40.261030Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:39:40.261117Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3067 reason: status is not ok: tablet will be restarted right now sessionId: src_id|b09da80e-d0a44b2a-1fb0cc63-99d89887_0
2025-10-10T14:39:40.261372Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3067 sessionId: src_id|b09da80e-d0a44b2a-1fb0cc63-99d89887_0 is DEAD
2025-10-10T14:39:40.261559Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b09da80e-d0a44b2a-1fb0cc63-99d89887_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:39:40.261567Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b09da80e-d0a44b2a-1fb0cc63-99d89887_0] Write session will restart in 0.009534s
2025-10-10T14:39:40.261604Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b09da80e-d0a44b2a-1fb0cc63-99d89887_0] Write session: Do CDS request
2025-10-10T14:39:40.261611Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b09da80e-d0a44b2a-1fb0cc63-99d89887_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:40.271914Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b09da80e-d0a44b2a-1fb0cc63-99d89887_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:40.272020Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:40.272037Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3068
2025-10-10T14:39:40.272215Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3068 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:40.272275Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3068 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:40.272286Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3068 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:40.272291Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:40.273064Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3068 sessionId:  describe result for acl check
2025-10-10T14:39:40.273103Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:40.273109Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:40.273111Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:40.273118Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602777873089979:5142] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:40.273722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602777873089979:5142] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:40.276381Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602777873089979:5142] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:40.282049Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602777873089979:5142] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:40.282069Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602777873089979:5142] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:40.282073Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602777873089979:5142] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:40.282083Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3068 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:40.282023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:40.282651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:40.282878Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:40.282890Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:40.282903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:40.282956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:40.283002Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602777090846371:6334]
2025-10-10T14:39:40.283592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:40.283929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:40.283981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:40.284310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:40.284369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:40.284376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:40.284377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:40.284378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:40.284380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:40.284381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:40.284383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:40.284384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:40.284385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:40.284387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:40.284388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:40.284390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:40.284391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:40.284396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:40.284410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:40.284415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:40.284419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:40.284423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:40.284427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:40.284431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:40.284435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:40.284439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:40.284443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:40.284447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:40.284451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:40.284455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:40.284462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:40.284471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:40.284477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:40.284483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:40.284487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:40.284492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:40.284496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:40.284502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:40.284514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:40.284520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:40.284524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:40.284529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:40.284533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:40.284539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:40.284543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:40.284548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:40.284552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:40.284562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:40.284567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:40.284571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:40.284580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:40.284585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:40.284589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:40.284599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:40.284603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:40.284608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:40.284651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:40.287147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:40.287523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:40.287533Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:40.287535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:40.287540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:40.287546Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3067 [2:7559602777090846371:6334]
2025-10-10T14:39:40.287559Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:40.287577Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:40.287581Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:40.287585Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:40.287587Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:40.287605Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:40.287618Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:40.287626Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:40.287707Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:40.287714Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:40.287716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:40.287719Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:40.287788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:40.287795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:40.287807Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:40.287820Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:40.287842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:40.287866Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602777090846365:6334]
2025-10-10T14:39:40.287872Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602777090846365:6334]
2025-10-10T14:39:40.287874Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602777090846365:6334]
2025-10-10T14:39:40.287888Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:40.287904Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:40.287913Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:40.287915Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:40.287917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602777873089851:2438], now have 1 active actors on pipe
2025-10-10T14:39:40.287920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602777873090063:5142], now have 1 active actors on pipe
2025-10-10T14:39:40.287928Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:40.287943Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:40.287952Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:40.287982Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602777090846365:6334]
2025-10-10T14:39:40.287985Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:40.287963Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3067
2025-10-10T14:39:40.287965Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3067
2025-10-10T14:39:40.287996Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:40.288022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:40.288027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:40.288063Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4b5ab5bd-336a3e7c-86f583c3-90db9fad_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:40.288075Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:40.288079Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:40.288086Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:40.288097Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:40.288110Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:40.288125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:40.288296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:40.288308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:40.288334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:40.288481Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3068 partition: 0 MaxSeqNo: 40 sessionId: src_id|4b5ab5bd-336a3e7c-86f583c3-90db9fad_0
2025-10-10T14:39:40.288978Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b09da80e-d0a44b2a-1fb0cc63-99d89887_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|4b5ab5bd-336a3e7c-86f583c3-90db9fad_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:40.291906Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4b5ab5bd-336a3e7c-86f583c3-90db9fad_0] Write session: try to update token
2025-10-10T14:39:40.291926Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4b5ab5bd-336a3e7c-86f583c3-90db9fad_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:40.308125Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3068 sessionId: src_id|4b5ab5bd-336a3e7c-86f583c3-90db9fad_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:40.311087Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:40.312429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:40.312461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:40.312490Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:40.312493Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:40.312497Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:40.312499Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:40.312509Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602777090846365:6334]
2025-10-10T14:39:40.312515Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602777090846365:6334]
2025-10-10T14:39:40.312519Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602777090846365:6334]
2025-10-10T14:39:40.312576Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:40.312588Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:40.312588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:40.312593Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:40.312597Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:40.312599Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:40.312770Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:40.360950Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602777873090088:2572]
2025-10-10T14:39:40.361570Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 pipe creation result: OK TabletId: 72075186224037892 Generation: 3067, pipe: [1:7559602777873090088:2572]
2025-10-10T14:39:40.434895Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:40.435185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:39:40.435256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602777873090088:2572], now have 1 active actors on pipe
2025-10-10T14:39:40.435333Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:39:40.435599Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 66 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602777873090088:2572]
2025-10-10T14:39:40.435641Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:40.448667Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b5ab5bd-336a3e7c-86f583c3-90db9fad_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:40.448686Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b5ab5bd-336a3e7c-86f583c3-90db9fad_0] Write session will restart in 0.006969s
2025-10-10T14:39:40.448712Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b5ab5bd-336a3e7c-86f583c3-90db9fad_0] Write session: Do CDS request
2025-10-10T14:39:40.448719Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b5ab5bd-336a3e7c-86f583c3-90db9fad_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:40.448265Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:40.448282Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:40.448310Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3068 reason: error at write: Disconnected sessionId: src_id|4b5ab5bd-336a3e7c-86f583c3-90db9fad_0
2025-10-10T14:39:40.448498Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3068 sessionId: src_id|4b5ab5bd-336a3e7c-86f583c3-90db9fad_0 is DEAD
2025-10-10T14:39:40.460315Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4b5ab5bd-336a3e7c-86f583c3-90db9fad_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:40.460794Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:40.460830Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3069
2025-10-10T14:39:40.460950Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3069 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:40.460989Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3069 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:40.461000Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3069 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:40.461004Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:40.461436Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3069 sessionId:  describe result for acl check
2025-10-10T14:39:40.461479Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:40.461481Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:40.461484Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:40.461490Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602777873090229:5114] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:40.462077Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602777873090229:5114] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:40.464971Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602777873090229:5114] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:40.468321Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602777873090229:5114] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:40.468339Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602777873090229:5114] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:40.468343Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602777873090229:5114] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:40.468354Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3069 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:40.469141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:40.473276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:40.473544Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:40.473555Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:40.473569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:40.473630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:40.473679Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602777090846569:6318]
2025-10-10T14:39:40.474233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:40.474610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:40.474680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:40.475023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:40.475098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:40.475104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:40.475106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:40.475107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:40.475108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:40.475110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:40.475111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:40.475112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:40.475113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:40.475115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:40.475116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:40.475117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:40.475119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:40.475127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:40.475142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:40.475146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:40.475150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:40.475154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:40.475159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:40.475163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:40.475167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:40.475173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:40.475177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:40.475181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:40.475189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:40.475193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:40.475208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:40.475221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:40.475232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:40.475242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:40.475251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:40.475257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:40.475265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:40.475271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:40.475277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:40.475287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:40.475293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:40.475304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:40.475316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:40.475326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:40.475335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:40.475341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:40.475349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:40.475355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:40.475363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:40.475371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:40.475381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:40.475386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:40.475395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:40.475400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:40.475408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:40.475414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:40.475454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:40.478606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:40.479435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:40.479449Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:40.479452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:40.479456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:40.479463Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3068 [2:7559602777090846569:6318]
2025-10-10T14:39:40.479478Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:40.479498Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:40.479506Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:40.479510Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:40.479513Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:40.479532Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:40.479541Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:40.479551Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:40.479624Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:40.479633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:40.479635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:40.479638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:40.479710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:40.479719Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:40.479734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:40.479751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:40.479772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:40.479798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602777873090104:2438], now have 1 active actors on pipe
2025-10-10T14:39:40.479802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602777873090312:5114], now have 1 active actors on pipe
2025-10-10T14:39:40.479810Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602777090846563:6318]
2025-10-10T14:39:40.479812Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602777090846563:6318]
2025-10-10T14:39:40.479814Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602777090846563:6318]
2025-10-10T14:39:40.479828Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:40.479847Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:40.479848Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:40.479849Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:40.479852Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:40.479864Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:40.479868Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:40.479855Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3068
2025-10-10T14:39:40.479871Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3068
2025-10-10T14:39:40.479902Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602777090846563:6318]
2025-10-10T14:39:40.479911Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:40.479914Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:40.479932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:40.479942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:40.479996Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b9c30f59-6a329aa8-dcfc6449-2eac734d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:40.480010Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:40.480014Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:40.480016Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:40.480028Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:40.480039Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:40.480058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:40.480326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:40.480334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:40.480352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:40.480447Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3069 partition: 0 MaxSeqNo: 40 sessionId: src_id|b9c30f59-6a329aa8-dcfc6449-2eac734d_0
2025-10-10T14:39:40.480899Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b5ab5bd-336a3e7c-86f583c3-90db9fad_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|b9c30f59-6a329aa8-dcfc6449-2eac734d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:40.483920Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b9c30f59-6a329aa8-dcfc6449-2eac734d_0] Write session: try to update token
2025-10-10T14:39:40.483942Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b9c30f59-6a329aa8-dcfc6449-2eac734d_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:40.500095Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:40.500114Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:40.500122Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:40.500125Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:40.500135Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602777090846563:6318]
2025-10-10T14:39:40.500139Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602777090846563:6318]
2025-10-10T14:39:40.500142Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602777090846563:6318]
2025-10-10T14:39:40.500203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:40.500207Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:40.500212Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:40.500214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:40.500215Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:40.500220Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:40.500369Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:40.499526Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3069 sessionId: src_id|b9c30f59-6a329aa8-dcfc6449-2eac734d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:40.502246Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:40.535519Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602777873090325:2572]
2025-10-10T14:39:40.535866Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 pipe creation result: OK TabletId: 72075186224037892 Generation: 3068, pipe: [1:7559602777873090325:2572]
2025-10-10T14:39:40.623052Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:40.623564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:40.623581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:40.623629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602777873090325:2572], now have 1 active actors on pipe
2025-10-10T14:39:40.623832Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:40.624746Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b9c30f59-6a329aa8-dcfc6449-2eac734d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:39:40.624760Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b9c30f59-6a329aa8-dcfc6449-2eac734d_0] Write session will restart in 0.009456s
2025-10-10T14:39:40.624815Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b9c30f59-6a329aa8-dcfc6449-2eac734d_0] Write session: Do CDS request
2025-10-10T14:39:40.624822Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b9c30f59-6a329aa8-dcfc6449-2eac734d_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:40.624051Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:40.624118Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:39:40.624190Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3069 reason: status is not ok: tablet will be restarted right now sessionId: src_id|b9c30f59-6a329aa8-dcfc6449-2eac734d_0
2025-10-10T14:39:40.624472Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 67 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602777873090325:2572]
2025-10-10T14:39:40.624581Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3069 sessionId: src_id|b9c30f59-6a329aa8-dcfc6449-2eac734d_0 is DEAD
2025-10-10T14:39:40.635994Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b9c30f59-6a329aa8-dcfc6449-2eac734d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:40.637720Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:40.637737Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3070
2025-10-10T14:39:40.637994Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3070 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:40.638033Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3070 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:40.638039Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3070 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:40.638043Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:40.638575Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3070 sessionId:  describe result for acl check
2025-10-10T14:39:40.638619Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:40.638621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:40.638623Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:40.638631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602777873090434:5115] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:40.639314Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602777873090434:5115] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:40.641925Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602777873090434:5115] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:40.646033Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602777873090434:5115] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:40.646053Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602777873090434:5115] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:40.646056Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602777873090434:5115] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:40.646067Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3070 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:40.650573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:40.654634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:40.655342Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:40.655353Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:40.655371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:40.655452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:40.655499Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602777090846742:6317]
2025-10-10T14:39:40.656212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:40.661361Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3069
2025-10-10T14:39:40.656665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:40.656715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:40.657096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:40.657153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:40.657155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:40.657156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:40.657157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:40.657159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:40.657161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:40.661421Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3069
2025-10-10T14:39:40.657162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:40.657164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:40.657165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:40.657166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:40.657168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:40.657169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:40.657170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:40.657177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:40.657189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:40.657193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:40.657196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:40.657200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:40.657204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:40.657207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:40.657210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:40.657214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:40.657218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:40.657222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:40.657226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:40.657229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:40.657238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:40.657250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:40.657256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:40.657262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:40.657270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:40.657275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:40.657279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:40.657285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:40.657289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:40.657295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:40.657299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:40.657304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:40.657313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:40.657318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:40.657322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:40.657345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:40.657351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:40.657357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:40.657361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:40.657366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:40.657371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:40.657376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:40.657380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:40.657385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:40.657389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:40.657394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:40.657442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:40.660509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:40.660889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:40.660893Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:40.660897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:40.660901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:40.660909Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3069 [2:7559602777090846742:6317]
2025-10-10T14:39:40.660924Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:40.660947Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:40.660951Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:40.660955Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:40.660958Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:40.660978Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:40.660986Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:40.660995Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:40.661064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:40.661067Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:40.661070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:40.661074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:40.661162Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:40.661166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:40.661181Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:40.661193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:40.661209Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:40.661232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602777873090328:2438], now have 1 active actors on pipe
2025-10-10T14:39:40.661235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602777873090531:5115], now have 1 active actors on pipe
2025-10-10T14:39:40.661244Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602777090846737:6317]
2025-10-10T14:39:40.661246Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602777090846737:6317]
2025-10-10T14:39:40.661248Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602777090846737:6317]
2025-10-10T14:39:40.661263Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:40.661278Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:40.661293Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:40.661296Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:40.661348Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602777090846737:6317]
2025-10-10T14:39:40.661351Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:40.661543Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:40.661547Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:40.661550Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:40.661557Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:40.661649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:40.661655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:40.661690Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e301605-da067344-5e005e8c-56ceef53_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:40.661698Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:40.661703Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:40.661706Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:40.661719Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:40.661731Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:40.661747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:40.662185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:40.662193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:40.662209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:40.666031Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3070 partition: 0 MaxSeqNo: 40 sessionId: src_id|e301605-da067344-5e005e8c-56ceef53_0
2025-10-10T14:39:40.666529Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b9c30f59-6a329aa8-dcfc6449-2eac734d_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|e301605-da067344-5e005e8c-56ceef53_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:40.669536Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e301605-da067344-5e005e8c-56ceef53_0] Write session: try to update token
2025-10-10T14:39:40.669560Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e301605-da067344-5e005e8c-56ceef53_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:40.692693Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3070 sessionId: src_id|e301605-da067344-5e005e8c-56ceef53_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:40.696116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:40.696143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:40.696170Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:40.696175Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:40.696179Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:40.696181Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:40.696192Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602777090846737:6317]
2025-10-10T14:39:40.696196Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602777090846737:6317]
2025-10-10T14:39:40.696200Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602777090846737:6317]
2025-10-10T14:39:40.696250Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:40.696258Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:40.696263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:40.696263Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:40.696270Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:40.696272Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:40.696418Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:40.695663Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:40.724433Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602777873090555:2572]
2025-10-10T14:39:40.724791Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 pipe creation result: OK TabletId: 72075186224037892 Generation: 3069, pipe: [1:7559602777873090555:2572]
2025-10-10T14:39:40.815345Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:40.815855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:39:40.815919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602777873090555:2572], now have 1 active actors on pipe
2025-10-10T14:39:40.816024Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:39:40.816156Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 68 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602777873090555:2572]
2025-10-10T14:39:40.816183Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:40.830054Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:40.830070Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:40.830100Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3070 reason: error at write: Disconnected sessionId: src_id|e301605-da067344-5e005e8c-56ceef53_0
2025-10-10T14:39:40.830319Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3070 sessionId: src_id|e301605-da067344-5e005e8c-56ceef53_0 is DEAD
2025-10-10T14:39:40.830489Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e301605-da067344-5e005e8c-56ceef53_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:40.830501Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e301605-da067344-5e005e8c-56ceef53_0] Write session will restart in 0.009340s
2025-10-10T14:39:40.830526Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e301605-da067344-5e005e8c-56ceef53_0] Write session: Do CDS request
2025-10-10T14:39:40.830532Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e301605-da067344-5e005e8c-56ceef53_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:40.840990Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e301605-da067344-5e005e8c-56ceef53_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:40.841264Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:40.841284Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3071
2025-10-10T14:39:40.841454Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3071 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:40.841516Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3071 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:40.841527Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3071 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:40.841531Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:40.842025Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3071 sessionId:  describe result for acl check
2025-10-10T14:39:40.842067Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:40.842073Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:40.842075Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:40.842081Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602777873090755:5102] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:40.842662Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602777873090755:5102] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:40.844666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:40.845416Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602777873090755:5102] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:40.847999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:40.848575Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602777873090755:5102] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:40.848575Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:40.848592Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602777873090755:5102] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:40.848596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602777873090755:5102] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:40.848588Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:40.848605Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3071 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:40.848606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:40.848684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:40.848733Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602777090846905:6310]
2025-10-10T14:39:40.849440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:40.849779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:40.849831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:40.850163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:40.850246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:40.850254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:40.850255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:40.850256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:40.850257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:40.850259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:40.850260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:40.850261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:40.850262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:40.850264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:40.850266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:40.850267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:40.850268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:40.850275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:40.850289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:40.850294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:40.850301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:40.850305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:40.850309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:40.850313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:40.850317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:40.850321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:40.850326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:40.850329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:40.850333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:40.850337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:40.850345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:40.850356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:40.850363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:40.850370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:40.850377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:40.850382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:40.850387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:40.850392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:40.850397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:40.850403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:40.850407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:40.850412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:40.850418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:40.850423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:40.850427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:40.850433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:40.850438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:40.850449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:40.850453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:40.850459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:40.850467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:40.850472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:40.850477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:40.850484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:40.850489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:40.850494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:40.850536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:40.853126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:40.853518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:40.853543Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:40.853546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:40.853551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:40.853558Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3070 [2:7559602777090846905:6310]
2025-10-10T14:39:40.853572Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:40.853593Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:40.853601Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:40.853605Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:40.853608Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:40.853626Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:40.853634Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:40.853643Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:40.853723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:40.853732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:40.853733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:40.853738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:40.853825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:40.853837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:40.853849Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:40.853860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:40.853880Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:40.853909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602777873090787:5102], now have 1 active actors on pipe
2025-10-10T14:39:40.853917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602777873090570:2438], now have 1 active actors on pipe
2025-10-10T14:39:40.853925Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602777090846900:6310]
2025-10-10T14:39:40.853927Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602777090846900:6310]
2025-10-10T14:39:40.853929Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602777090846900:6310]
2025-10-10T14:39:40.853957Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3070
2025-10-10T14:39:40.853959Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3070
2025-10-10T14:39:40.854440Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:40.854456Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:40.854467Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:40.854468Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:40.854470Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:40.854491Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:40.854497Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:40.854516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:40.854528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:40.854576Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602777090846900:6310]
2025-10-10T14:39:40.854590Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:40.854596Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:40.854613Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c5c15472-5574c53b-cdd18a14-49105b63_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:40.854626Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:40.854632Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:40.854635Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:40.854648Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:40.854665Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:40.854708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:40.854946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:40.854956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:40.854974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:40.855091Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3071 partition: 0 MaxSeqNo: 40 sessionId: src_id|c5c15472-5574c53b-cdd18a14-49105b63_0
2025-10-10T14:39:40.855576Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e301605-da067344-5e005e8c-56ceef53_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|c5c15472-5574c53b-cdd18a14-49105b63_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:40.858529Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c5c15472-5574c53b-cdd18a14-49105b63_0] Write session: try to update token
2025-10-10T14:39:40.858553Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c5c15472-5574c53b-cdd18a14-49105b63_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:40.873892Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3071 sessionId: src_id|c5c15472-5574c53b-cdd18a14-49105b63_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:40.875037Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:40.875059Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:40.875063Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:40.875066Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:40.875078Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602777090846900:6310]
2025-10-10T14:39:40.875083Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602777090846900:6310]
2025-10-10T14:39:40.875086Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602777090846900:6310]
2025-10-10T14:39:40.875144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:40.875149Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:40.875156Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:40.875161Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:40.875162Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:40.875166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:40.875318Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:40.876530Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:40.916448Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602777873090804:2572]
2025-10-10T14:39:40.916732Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 pipe creation result: OK TabletId: 72075186224037892 Generation: 3070, pipe: [1:7559602777873090804:2572]
2025-10-10T14:39:41.009720Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:41.010312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:41.010323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:41.010373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602777873090804:2572], now have 1 active actors on pipe
2025-10-10T14:39:41.011086Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 69 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602777873090804:2572]
2025-10-10T14:39:41.011127Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:41.011130Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:41.011189Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3071 reason: error at write: Disconnected sessionId: src_id|c5c15472-5574c53b-cdd18a14-49105b63_0
2025-10-10T14:39:41.011419Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3071 sessionId: src_id|c5c15472-5574c53b-cdd18a14-49105b63_0 is DEAD
2025-10-10T14:39:41.011714Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:41.010741Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:41.013426Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5c15472-5574c53b-cdd18a14-49105b63_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:41.013440Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5c15472-5574c53b-cdd18a14-49105b63_0] Write session will restart in 0.005777s
2025-10-10T14:39:41.013467Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5c15472-5574c53b-cdd18a14-49105b63_0] Write session: Do CDS request
2025-10-10T14:39:41.013477Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5c15472-5574c53b-cdd18a14-49105b63_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:41.022040Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c5c15472-5574c53b-cdd18a14-49105b63_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:41.022197Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:41.022219Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3072
2025-10-10T14:39:41.022801Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3072 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:41.022850Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3072 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:41.022862Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3072 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:41.022867Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:41.023638Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3072 sessionId:  describe result for acl check
2025-10-10T14:39:41.023685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:41.023694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:41.023696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:41.023703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602782168058136:5092] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:41.024352Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602782168058136:5092] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:41.028359Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602782168058136:5092] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:41.033286Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602782168058136:5092] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:41.033308Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602782168058136:5092] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:41.033313Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602782168058136:5092] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:41.033323Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3072 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:41.043287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:41.048572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:41.048874Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:41.048901Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:41.048916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:41.048992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:41.049055Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602781385814365:6308]
2025-10-10T14:39:41.049756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:41.051175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:41.051245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:41.051627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:41.051695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:41.051696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:41.051698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:41.051699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:41.051701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:41.051702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:41.051704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:41.051705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:41.051707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:41.051708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:41.051709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:41.051711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:41.051712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:41.051719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:41.051734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:41.051738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:41.051744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:41.051748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:41.051752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:41.051756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:41.051761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:41.051766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:41.051770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:41.051774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:41.051778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:41.051782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:41.051792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:41.051802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:41.051809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:41.051814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:41.051820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:41.051825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:41.051832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:41.051838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:41.051843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:41.051849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:41.051855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:41.051860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:41.051870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:41.051875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:41.051881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:41.051887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:41.051893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:41.051899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:41.051904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:41.051910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:41.051915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:41.051921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:41.051926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:41.051932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:41.051937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:41.051943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:41.051988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:41.055240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:41.056094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:41.056114Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:41.056117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:41.056122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:41.056129Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3071 [2:7559602781385814365:6308]
2025-10-10T14:39:41.056148Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:41.056169Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:41.056173Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:41.056178Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:41.056180Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:41.056202Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:41.056216Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:41.056226Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:41.056296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:41.056307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:41.056309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:41.056312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:41.056396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:41.056405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:41.056420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:41.056435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:41.056455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:41.056485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602782168058220:5092], now have 1 active actors on pipe
2025-10-10T14:39:41.056495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602782168058102:2438], now have 1 active actors on pipe
2025-10-10T14:39:41.056504Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602781385814360:6308]
2025-10-10T14:39:41.056507Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602781385814360:6308]
2025-10-10T14:39:41.056509Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602781385814360:6308]
2025-10-10T14:39:41.056526Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:41.056540Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:41.056548Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:41.056550Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:41.056553Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:41.056568Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:41.056572Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:41.056615Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602781385814360:6308]
2025-10-10T14:39:41.056624Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:41.056629Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:41.056771Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3071
2025-10-10T14:39:41.056832Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3071
2025-10-10T14:39:41.056932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:41.056945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:41.056983Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5ab5c202-3a051369-9d4ba052-cccfa199_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:41.056993Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:41.056998Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:41.057001Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:41.057015Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:41.057027Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:41.057046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:41.057492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:41.057506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:41.057529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:41.057692Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3072 partition: 0 MaxSeqNo: 40 sessionId: src_id|5ab5c202-3a051369-9d4ba052-cccfa199_0
2025-10-10T14:39:41.061458Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5c15472-5574c53b-cdd18a14-49105b63_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|5ab5c202-3a051369-9d4ba052-cccfa199_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:41.064364Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5ab5c202-3a051369-9d4ba052-cccfa199_0] Write session: try to update token
2025-10-10T14:39:41.064389Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5ab5c202-3a051369-9d4ba052-cccfa199_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:41.080748Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:41.080768Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:41.080772Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:41.080775Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:41.080786Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602781385814360:6308]
2025-10-10T14:39:41.080802Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602781385814360:6308]
2025-10-10T14:39:41.080806Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602781385814360:6308]
2025-10-10T14:39:41.080862Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:41.080871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:41.080874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:41.080908Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:41.080923Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:41.080928Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:41.081024Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:41.085726Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3072 sessionId: src_id|5ab5c202-3a051369-9d4ba052-cccfa199_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:41.088365Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:41.109963Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602782168058331:2572]
2025-10-10T14:39:41.110425Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 pipe creation result: OK TabletId: 72075186224037892 Generation: 3071, pipe: [1:7559602782168058331:2572]
2025-10-10T14:39:41.198865Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:41.199459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:41.199475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:41.199523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602782168058331:2572], now have 1 active actors on pipe
2025-10-10T14:39:41.199797Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:41.199897Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 70 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602782168058331:2572]
2025-10-10T14:39:41.199898Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:41.199903Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:41.199934Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:41.199966Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3072 reason: error at write: Disconnected sessionId: src_id|5ab5c202-3a051369-9d4ba052-cccfa199_0
2025-10-10T14:39:41.200231Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3072 sessionId: src_id|5ab5c202-3a051369-9d4ba052-cccfa199_0 is DEAD
2025-10-10T14:39:41.200460Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ab5c202-3a051369-9d4ba052-cccfa199_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:41.200473Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ab5c202-3a051369-9d4ba052-cccfa199_0] Write session will restart in 0.009164s
2025-10-10T14:39:41.200498Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ab5c202-3a051369-9d4ba052-cccfa199_0] Write session: Do CDS request
2025-10-10T14:39:41.200520Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ab5c202-3a051369-9d4ba052-cccfa199_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:41.210972Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5ab5c202-3a051369-9d4ba052-cccfa199_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:41.211361Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:41.211377Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3073
2025-10-10T14:39:41.211535Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3073 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:41.211611Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3073 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:41.211630Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3073 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:41.211643Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:41.212087Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3073 sessionId:  describe result for acl check
2025-10-10T14:39:41.212134Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:41.212141Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:41.212146Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:41.212152Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602782168058403:5073] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:41.212763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602782168058403:5073] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:41.215653Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602782168058403:5073] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:41.219387Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602782168058403:5073] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:41.219403Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602782168058403:5073] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:41.219407Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602782168058403:5073] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:41.219417Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3073 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:41.226089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:41.226855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:41.227486Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:41.227500Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:41.227524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:41.227599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:41.227665Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602781385814529:6303]
2025-10-10T14:39:41.228466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:41.228894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:41.228942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:41.229260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:41.229311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:41.229317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:41.229318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:41.229319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:41.229321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:41.229322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:41.229322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:41.229324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:41.229325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:41.229326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:41.229327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:41.229342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:41.229344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:41.229350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:41.229364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:41.229369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:41.229373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:41.229377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:41.229381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:41.229385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:41.229389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:41.229393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:41.229397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:41.229401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:41.229405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:41.229409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:41.229415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:41.229422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:41.229426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:41.229430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:41.229437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:41.229442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:41.229446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:41.229452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:41.229456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:41.229463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:41.229467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:41.229472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:41.229476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:41.229481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:41.229484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:41.229489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:41.229493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:41.229498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:41.229505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:41.229509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:41.229513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:41.229518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:41.229521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:41.229527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:41.229532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:41.229538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:41.229574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:41.232263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:41.232719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:41.232739Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:41.232743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:41.232748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:41.232756Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3072 [2:7559602781385814529:6303]
2025-10-10T14:39:41.232774Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:41.232811Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:41.232816Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:41.232820Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:41.232824Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:41.232863Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:41.232886Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:41.232897Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:41.232994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:41.233005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:41.233007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:41.233010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:41.233087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:41.233091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:41.233100Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:41.233107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:41.233118Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:41.233136Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602781385814524:6303]
2025-10-10T14:39:41.233138Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602781385814524:6303]
2025-10-10T14:39:41.233140Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602781385814524:6303]
2025-10-10T14:39:41.233149Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:41.233159Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:41.233165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602782168058548:5073], now have 1 active actors on pipe
2025-10-10T14:39:41.233168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602782168058333:2438], now have 1 active actors on pipe
2025-10-10T14:39:41.233169Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:41.233172Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:41.233177Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:41.233193Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:41.233197Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:41.233226Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602781385814524:6303]
2025-10-10T14:39:41.233234Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:41.233247Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:41.233277Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3072
2025-10-10T14:39:41.233289Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3072
2025-10-10T14:39:41.233390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:41.233403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:41.233441Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a0667c6-1ee5d0bd-aa4957bf-643f1e89_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:41.233460Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:41.233464Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:41.233466Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:41.233478Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:41.233490Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:41.233506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:41.233664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:41.233678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:41.233712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:41.233807Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3073 partition: 0 MaxSeqNo: 40 sessionId: src_id|a0667c6-1ee5d0bd-aa4957bf-643f1e89_0
2025-10-10T14:39:41.234273Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ab5c202-3a051369-9d4ba052-cccfa199_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|a0667c6-1ee5d0bd-aa4957bf-643f1e89_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:41.237104Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a0667c6-1ee5d0bd-aa4957bf-643f1e89_0] Write session: try to update token
2025-10-10T14:39:41.237123Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a0667c6-1ee5d0bd-aa4957bf-643f1e89_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:41.245213Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:39:41.245233Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:41.245245Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602781385814524:6303]
2025-10-10T14:39:41.245300Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:39:41.245327Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:39:41.245510Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:39:41.245649Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:41.245790Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:41.245920Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:41.246107Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:39:41.246151Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:39:41.252047Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3073 sessionId: src_id|a0667c6-1ee5d0bd-aa4957bf-643f1e89_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:41.254652Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:41.254878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:41.254901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:41.254953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:39:41.255040Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:39:41.264977Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:41.264992Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:41.264995Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:41.264997Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:41.265005Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602781385814524:6303]
2025-10-10T14:39:41.265008Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602781385814524:6303]
2025-10-10T14:39:41.265013Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602781385814524:6303]
2025-10-10T14:39:41.265062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:41.265076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:41.265078Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:41.265084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:41.265085Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:41.265089Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:41.265214Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:41.299937Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602782168058562:2572]
2025-10-10T14:39:41.300544Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 pipe creation result: OK TabletId: 72075186224037892 Generation: 3072, pipe: [1:7559602782168058562:2572]
2025-10-10T14:39:41.386977Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:41.398384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:41.398413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:41.398667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:41.398739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:41.398814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:41.398895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:41.398947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:41.398956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:41.399229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:41.399683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:41.399759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:41.399840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:41.399887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:41.399894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:41.399968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:41.400035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:41.400112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:41.400187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:41.400232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:41.400240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:41.400312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:41.400380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:41.400448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:41.400519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:41.400567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:41.400574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:41.400646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:41.400719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:41.400807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:41.401081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:41.401132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:41.401141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:41.401424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:41.401492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:41.401559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:41.401626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:41.401673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:41.401680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:41.401749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:41.401815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:41.401892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:41.401958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:41.402008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:41.402018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:41.402084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:41.402155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:41.402225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:41.402296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:41.402346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:41.402353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:41.402425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:41.402494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:41.402561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:41.402838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:41.402895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:41.402903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:41.403177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:41.403251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:41.403324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:41.403390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:41.403436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:41.403444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:41.403507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602782168058562:2572], now have 1 active actors on pipe
2025-10-10T14:39:41.404965Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:41.405663Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:39:41.405748Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3073 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a0667c6-1ee5d0bd-aa4957bf-643f1e89_0
2025-10-10T14:39:41.405993Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3073 sessionId: src_id|a0667c6-1ee5d0bd-aa4957bf-643f1e89_0 is DEAD
2025-10-10T14:39:41.406225Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a0667c6-1ee5d0bd-aa4957bf-643f1e89_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:39:41.406237Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a0667c6-1ee5d0bd-aa4957bf-643f1e89_0] Write session will restart in 0.006863s
2025-10-10T14:39:41.406284Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a0667c6-1ee5d0bd-aa4957bf-643f1e89_0] Write session: Do CDS request
2025-10-10T14:39:41.406291Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a0667c6-1ee5d0bd-aa4957bf-643f1e89_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:41.406283Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:41.406343Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 71 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602782168058562:2572]
2025-10-10T14:39:41.415013Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a0667c6-1ee5d0bd-aa4957bf-643f1e89_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:41.417441Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:41.417461Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3074
2025-10-10T14:39:41.417629Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3074 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:41.417682Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3074 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:41.417696Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3074 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:41.417700Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:41.418377Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3074 sessionId:  describe result for acl check
2025-10-10T14:39:41.418418Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:41.418425Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:41.418427Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:41.418435Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602782168058681:5054] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:41.419036Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602782168058681:5054] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:41.423256Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602782168058681:5054] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:41.427050Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602782168058681:5054] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:41.427067Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602782168058681:5054] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:41.427071Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602782168058681:5054] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:41.427081Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3074 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:41.429615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:41.435376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:41.435676Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:41.435681Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:41.435693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:41.435752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:41.435798Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602781385814709:6297]
2025-10-10T14:39:41.436519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:41.437129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:41.437184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:41.437603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:41.437672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:41.437674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:41.437675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:41.437676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:41.437677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:41.437679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:41.437680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:41.437681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:41.437682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:41.437683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:41.437685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:41.437686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:41.437687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:41.437694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:41.437706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:41.437710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:41.437714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:41.437718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:41.437722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:41.437726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:41.437729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:41.437734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:41.437738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:41.437754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:41.437758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:41.437761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:41.437769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:41.437778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:41.437785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:41.437790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:41.437795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:41.437800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:41.437805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:41.437810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:41.437814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:41.437820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:41.437824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:41.437829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:41.437834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:41.437839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:41.437843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:41.437850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:41.437854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:41.437859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:41.437863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:41.437868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:41.437872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:41.437878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:41.437882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:41.437888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:41.437893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:41.437898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:41.437939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:41.442612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:41.443379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:41.443385Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:41.443387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:41.443392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:41.443399Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3073 [2:7559602781385814709:6297]
2025-10-10T14:39:41.443415Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:41.443435Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:41.443439Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:41.443443Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:41.443445Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:41.443469Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:41.443476Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:41.443485Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:41.443554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:41.443556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:41.443558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:41.443561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:41.443647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:41.443649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:41.443663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:41.443677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:41.443695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:41.443719Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602781385814704:6297]
2025-10-10T14:39:41.443721Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602781385814704:6297]
2025-10-10T14:39:41.443728Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602781385814704:6297]
2025-10-10T14:39:41.443747Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:41.443762Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:41.443792Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:41.443796Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:41.443843Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602781385814704:6297]
2025-10-10T14:39:41.443845Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:41.444395Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:41.444402Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:41.444404Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:41.444411Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:41.445302Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3073
2025-10-10T14:39:41.445357Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3073
2025-10-10T14:39:41.449416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602782168058792:5054], now have 1 active actors on pipe
2025-10-10T14:39:41.449436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602782168058573:2438], now have 1 active actors on pipe
2025-10-10T14:39:41.449462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:41.449471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:41.449517Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5b086d69-86eafc2-f06d2edf-5b8ceba7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:41.449534Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:41.449545Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:41.449547Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:41.449564Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:41.449591Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:41.449619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:41.449911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:41.449923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:41.449946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:41.450092Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3074 partition: 0 MaxSeqNo: 40 sessionId: src_id|5b086d69-86eafc2-f06d2edf-5b8ceba7_0
2025-10-10T14:39:41.450609Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a0667c6-1ee5d0bd-aa4957bf-643f1e89_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|5b086d69-86eafc2-f06d2edf-5b8ceba7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:41.453454Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5b086d69-86eafc2-f06d2edf-5b8ceba7_0] Write session: try to update token
2025-10-10T14:39:41.453482Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5b086d69-86eafc2-f06d2edf-5b8ceba7_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:41.475247Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:41.475267Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:41.475270Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:41.475272Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:41.475281Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602781385814704:6297]
2025-10-10T14:39:41.475285Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602781385814704:6297]
2025-10-10T14:39:41.475288Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602781385814704:6297]
2025-10-10T14:39:41.475339Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:41.475338Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:41.475345Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:41.475347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:41.475349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:41.475350Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:41.475489Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:41.481103Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3074 sessionId: src_id|5b086d69-86eafc2-f06d2edf-5b8ceba7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:41.484061Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:41.506786Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602782168058819:2572]
2025-10-10T14:39:41.507059Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 pipe creation result: OK TabletId: 72075186224037892 Generation: 3073, pipe: [1:7559602782168058819:2572]
2025-10-10T14:39:41.598402Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:41.598702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:41.598713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:41.598765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602782168058819:2572], now have 1 active actors on pipe
2025-10-10T14:39:41.599032Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:41.599048Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:41.599130Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3074 reason: error at write: Disconnected sessionId: src_id|5b086d69-86eafc2-f06d2edf-5b8ceba7_0
2025-10-10T14:39:41.599351Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3074 sessionId: src_id|5b086d69-86eafc2-f06d2edf-5b8ceba7_0 is DEAD
2025-10-10T14:39:41.599047Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:41.599353Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:41.599405Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 72 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602782168058819:2572]
2025-10-10T14:39:41.599508Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5b086d69-86eafc2-f06d2edf-5b8ceba7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:41.599521Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5b086d69-86eafc2-f06d2edf-5b8ceba7_0] Write session will restart in 0.009117s
2025-10-10T14:39:41.599547Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5b086d69-86eafc2-f06d2edf-5b8ceba7_0] Write session: Do CDS request
2025-10-10T14:39:41.599554Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5b086d69-86eafc2-f06d2edf-5b8ceba7_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:41.609911Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5b086d69-86eafc2-f06d2edf-5b8ceba7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:41.610006Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:41.610025Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3075
2025-10-10T14:39:41.610134Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3075 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:41.610176Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3075 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:41.610188Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3075 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:41.610193Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:41.610706Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3075 sessionId:  describe result for acl check
2025-10-10T14:39:41.610744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:41.610746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:41.610748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:41.610755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602782168058855:5017] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:41.611331Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602782168058855:5017] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:41.614558Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602782168058855:5017] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:41.618265Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602782168058855:5017] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:41.618285Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602782168058855:5017] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:41.618289Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602782168058855:5017] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:41.618299Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3075 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:41.629190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:41.629756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:41.629996Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:41.630005Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:41.630020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:41.630096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:41.630140Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602781385814912:6281]
2025-10-10T14:39:41.630775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:41.631157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:41.631219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:41.631848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:41.631933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:41.631939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:41.631940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:41.631942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:41.631943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:41.631944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:41.631945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:41.631946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:41.631947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:41.631948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:41.631950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:41.631951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:41.631952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:41.631958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:41.631972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:41.631976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:41.631980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:41.631983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:41.631987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:41.631990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:41.631994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:41.631997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:41.632001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:41.632005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:41.632008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:41.632012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:41.632021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:41.632030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:41.632036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:41.632041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:41.632048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:41.632053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:41.632057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:41.632062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:41.632066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:41.632071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:41.632074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:41.632079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:41.632083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:41.632087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:41.632095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:41.632099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:41.632116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:41.632122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:41.632126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:41.632131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:41.632135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:41.632139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:41.632143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:41.632148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:41.632152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:41.632156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:41.632191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:41.634975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:41.635309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:41.635320Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:41.635323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:41.635328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:41.635334Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3074 [2:7559602781385814912:6281]
2025-10-10T14:39:41.635348Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:41.635366Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:41.635370Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:41.635374Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:41.635376Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:41.635394Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:41.635402Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:41.635411Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:41.635470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:41.635479Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:41.635481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:41.635484Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:41.635560Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:41.635569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:41.635581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:41.635604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:41.635678Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3074
2025-10-10T14:39:41.635708Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3074
2025-10-10T14:39:41.635621Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:41.635650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602782168058822:2438], now have 1 active actors on pipe
2025-10-10T14:39:41.635653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602782168058987:5017], now have 1 active actors on pipe
2025-10-10T14:39:41.635661Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602781385814907:6281]
2025-10-10T14:39:41.635665Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602781385814907:6281]
2025-10-10T14:39:41.635667Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602781385814907:6281]
2025-10-10T14:39:41.635691Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:41.635696Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:41.635699Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:41.635702Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:41.635706Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:41.635723Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:41.635726Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:41.635755Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602781385814907:6281]
2025-10-10T14:39:41.635758Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:41.635766Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:41.635781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:41.635786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:41.635843Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bd4438a1-b20e2167-a37208be-feb00e52_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:41.635851Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:41.635855Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:41.635857Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:41.635869Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:41.635881Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:41.635904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:41.636112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:41.636120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:41.636136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:41.636246Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3075 partition: 0 MaxSeqNo: 40 sessionId: src_id|bd4438a1-b20e2167-a37208be-feb00e52_0
2025-10-10T14:39:41.636657Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5b086d69-86eafc2-f06d2edf-5b8ceba7_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|bd4438a1-b20e2167-a37208be-feb00e52_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:41.639350Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bd4438a1-b20e2167-a37208be-feb00e52_0] Write session: try to update token
2025-10-10T14:39:41.639375Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bd4438a1-b20e2167-a37208be-feb00e52_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:41.654173Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3075 sessionId: src_id|bd4438a1-b20e2167-a37208be-feb00e52_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:41.657034Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:41.658847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:41.658871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:41.658898Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:41.658902Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:41.658906Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:41.658908Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:41.658917Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602781385814907:6281]
2025-10-10T14:39:41.658925Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602781385814907:6281]
2025-10-10T14:39:41.658929Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602781385814907:6281]
2025-10-10T14:39:41.658971Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:41.658981Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:41.658985Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:41.658994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:41.659002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:41.659004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:41.659130Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:41.699300Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602782168059052:2572]
2025-10-10T14:39:41.699623Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 pipe creation result: OK TabletId: 72075186224037892 Generation: 3074, pipe: [1:7559602782168059052:2572]
2025-10-10T14:39:41.776890Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:41.777566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:39:41.777634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602782168059052:2572], now have 1 active actors on pipe
2025-10-10T14:39:41.778612Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:39:41.778664Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 73 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602782168059052:2572]
2025-10-10T14:39:41.778692Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:41.778720Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:41.778730Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:41.778826Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3075 reason: error at write: Disconnected sessionId: src_id|bd4438a1-b20e2167-a37208be-feb00e52_0
2025-10-10T14:39:41.779021Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3075 sessionId: src_id|bd4438a1-b20e2167-a37208be-feb00e52_0 is DEAD
2025-10-10T14:39:41.779185Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd4438a1-b20e2167-a37208be-feb00e52_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:41.779196Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd4438a1-b20e2167-a37208be-feb00e52_0] Write session will restart in 0.005566s
2025-10-10T14:39:41.779223Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd4438a1-b20e2167-a37208be-feb00e52_0] Write session: Do CDS request
2025-10-10T14:39:41.779230Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd4438a1-b20e2167-a37208be-feb00e52_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:41.786003Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bd4438a1-b20e2167-a37208be-feb00e52_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:41.786096Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:41.786114Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3076
2025-10-10T14:39:41.786251Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3076 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:41.786287Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3076 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:41.786298Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3076 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:41.786302Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:41.786762Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3076 sessionId:  describe result for acl check
2025-10-10T14:39:41.786804Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:41.786822Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:41.786824Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:41.786831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602782168059068:7744] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:41.787402Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602782168059068:7744] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:41.789929Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602782168059068:7744] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:41.793494Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602782168059068:7744] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:41.793514Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602782168059068:7744] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:41.793518Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602782168059068:7744] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:41.793527Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3076 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:41.797895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:41.801065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:41.801317Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:41.801344Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:41.801360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:41.801440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:41.801487Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602781385815079:6272]
2025-10-10T14:39:41.802117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:41.802452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:41.802491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:41.802825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:41.802890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:41.802896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:41.802897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:41.802899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:41.802900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:41.802901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:41.802902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:41.802904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:41.802905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:41.802906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:41.802907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:41.802909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:41.802910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:41.802915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:41.802928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:41.802932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:41.802935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:41.802939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:41.802943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:41.802947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:41.802950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:41.802954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:41.802958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:41.802961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:41.802965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:41.802970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:41.802978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:41.802987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:41.802993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:41.802997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:41.803001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:41.803006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:41.803010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:41.803015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:41.803020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:41.803026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:41.803030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:41.803036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:41.803041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:41.803046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:41.803051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:41.803059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:41.803067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:41.803079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:41.803083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:41.803088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:41.803098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:41.803103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:41.803112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:41.803117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:41.803122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:41.803127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:41.803175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:41.806134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:41.806851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:41.806864Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:41.806867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:41.806871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:41.806878Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3075 [2:7559602781385815079:6272]
2025-10-10T14:39:41.806893Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:41.806913Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:41.806921Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:41.806926Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:41.806928Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:41.806946Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:41.806959Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:41.806972Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:41.807043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:41.807050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:41.807052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:41.807055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:41.807175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:41.807184Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:41.807196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:41.807209Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:41.807228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:41.807252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602782168059054:2438], now have 1 active actors on pipe
2025-10-10T14:39:41.807255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602782168059252:7744], now have 1 active actors on pipe
2025-10-10T14:39:41.807264Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602781385815074:6272]
2025-10-10T14:39:41.807266Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602781385815074:6272]
2025-10-10T14:39:41.807268Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602781385815074:6272]
2025-10-10T14:39:41.807285Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:41.807301Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:41.807280Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3075
2025-10-10T14:39:41.807322Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:41.807310Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3075
2025-10-10T14:39:41.807326Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:41.807356Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:41.807360Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:41.807362Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:41.807364Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602781385815074:6272]
2025-10-10T14:39:41.807367Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:41.807369Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:41.807410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:41.807421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:41.807450Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a5d81369-f4769f22-966e21e9-c37a5775_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:41.807465Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:41.807473Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:41.807476Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:41.807487Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:41.807498Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:41.807518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:41.807854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:41.807868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:41.807893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:41.808029Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3076 partition: 0 MaxSeqNo: 40 sessionId: src_id|a5d81369-f4769f22-966e21e9-c37a5775_0
2025-10-10T14:39:41.808441Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd4438a1-b20e2167-a37208be-feb00e52_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|a5d81369-f4769f22-966e21e9-c37a5775_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:41.811274Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a5d81369-f4769f22-966e21e9-c37a5775_0] Write session: try to update token
2025-10-10T14:39:41.811292Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a5d81369-f4769f22-966e21e9-c37a5775_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:41.825587Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3076 sessionId: src_id|a5d81369-f4769f22-966e21e9-c37a5775_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:41.826139Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:39:41.826157Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:41.826168Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602781385815074:6272]
2025-10-10T14:39:41.826216Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:39:41.826219Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:39:41.826413Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:39:41.826565Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:41.826723Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:41.826944Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:41.827706Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:39:41.827755Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:39:41.828105Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:41.828346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:41.828362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:41.828398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:39:41.828483Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:39:41.838418Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:41.838433Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:41.838436Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:41.838438Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:41.838449Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602781385815074:6272]
2025-10-10T14:39:41.838454Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602781385815074:6272]
2025-10-10T14:39:41.838457Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602781385815074:6272]
2025-10-10T14:39:41.838505Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:41.838511Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:41.838517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:41.838524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:41.838528Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:41.838533Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:41.838667Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:41.878943Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602782168059305:2572]
2025-10-10T14:39:41.879227Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 pipe creation result: OK TabletId: 72075186224037892 Generation: 3075, pipe: [1:7559602782168059305:2572]
2025-10-10T14:39:41.959877Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:41.968897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:41.968938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:41.969123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:41.969185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:41.969254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:41.969324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:41.969386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:41.969398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:41.969467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:41.969529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:41.969593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:41.969663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:41.969711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:41.969723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:41.969792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:41.969864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:41.969932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:41.970002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:41.970045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:41.970053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:41.970126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:41.970194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:41.970259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:41.970326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:41.970370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:41.970378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:41.970444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:41.970506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:41.970573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:41.970644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:41.970699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:41.970709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:41.970785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:41.970850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:41.970920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:41.970986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:41.971037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:41.971044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:41.971109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:41.971170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:41.971235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:41.971300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:41.971345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:41.971351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:41.971421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:41.971485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:41.971551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:41.971615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:41.971660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:41.971667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:41.971734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:41.971804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:41.971872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:41.971936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:41.971992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:41.972000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:41.972067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:41.972128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:41.972193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:41.972256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:41.972304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:41.972311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:41.972383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602782168059305:2572], now have 1 active actors on pipe
2025-10-10T14:39:41.972642Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:41.972683Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 74 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602782168059305:2572]
2025-10-10T14:39:41.972736Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:41.972744Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:41.972788Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3076 reason: error at write: Disconnected sessionId: src_id|a5d81369-f4769f22-966e21e9-c37a5775_0
2025-10-10T14:39:41.973029Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3076 sessionId: src_id|a5d81369-f4769f22-966e21e9-c37a5775_0 is DEAD
2025-10-10T14:39:41.973242Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a5d81369-f4769f22-966e21e9-c37a5775_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:41.973254Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a5d81369-f4769f22-966e21e9-c37a5775_0] Write session will restart in 0.009270s
2025-10-10T14:39:41.973294Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a5d81369-f4769f22-966e21e9-c37a5775_0] Write session: Do CDS request
2025-10-10T14:39:41.973300Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a5d81369-f4769f22-966e21e9-c37a5775_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:41.973954Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:41.983972Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a5d81369-f4769f22-966e21e9-c37a5775_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:41.984053Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:41.984081Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3077
2025-10-10T14:39:41.984199Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3077 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:41.984251Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3077 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:41.984261Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3077 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:41.984266Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:41.984754Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3077 sessionId:  describe result for acl check
2025-10-10T14:39:41.984803Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:41.984810Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:41.984813Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:41.984819Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602782168059502:4997] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:41.985414Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602782168059502:4997] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:41.987388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:41.987958Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602782168059502:4997] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:41.991119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:41.991331Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602782168059502:4997] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:41.991345Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602782168059502:4997] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:41.991348Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602782168059502:4997] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:41.991356Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3077 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:41.991594Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:41.991606Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:41.991633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:41.991706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:41.991748Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602781385815247:6270]
2025-10-10T14:39:41.992382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:41.992722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:41.992790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:41.993121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:41.993179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:41.993185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:41.993186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:41.993188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:41.993189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:41.993190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:41.993191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:41.993192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:41.993194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:41.993195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:41.993197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:41.993198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:41.993199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:41.993204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:41.993219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:41.993223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:41.993228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:41.993232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:41.993237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:41.993241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:41.993246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:41.993250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:41.993253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:41.993258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:41.993262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:41.993267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:41.993274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:41.993286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:41.993297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:41.993303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:41.993312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:41.993318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:41.993322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:41.993328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:41.993350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:41.993355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:41.993360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:41.993366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:41.993371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:41.993378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:41.993383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:41.993396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:41.993400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:41.993405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:41.993410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:41.993416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:41.993420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:41.993425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:41.993430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:41.993435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:41.993439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:41.993444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:41.993487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:41.996181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:41.996501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:41.996514Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:41.996516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:41.996520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:41.996526Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3076 [2:7559602781385815247:6270]
2025-10-10T14:39:41.996539Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:41.996556Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:41.996566Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:41.996570Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:41.996573Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:41.996591Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:41.996598Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:41.996606Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:41.996665Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:41.996673Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:41.996675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:41.996677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:41.996743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:41.996755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:41.996766Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:41.996788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:41.996804Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:41.996837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602782168059531:4997], now have 1 active actors on pipe
2025-10-10T14:39:41.996841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602782168059313:2438], now have 1 active actors on pipe
2025-10-10T14:39:41.996849Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602781385815241:6270]
2025-10-10T14:39:41.996852Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602781385815241:6270]
2025-10-10T14:39:41.996854Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602781385815241:6270]
2025-10-10T14:39:41.996868Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:41.996882Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:41.996883Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:41.996886Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:41.996889Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:41.996898Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:41.996901Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:41.996884Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3076
2025-10-10T14:39:41.996886Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3076
2025-10-10T14:39:41.996935Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602781385815241:6270]
2025-10-10T14:39:41.996946Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:41.996954Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:41.996965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:41.996975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:41.997029Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8caac897-3188f756-6d38b70d-dce5269b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:41.997043Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:41.997051Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:41.997054Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:41.997065Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:41.997080Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:41.997102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:41.997235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:41.997246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:41.997261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:41.997361Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3077 partition: 0 MaxSeqNo: 40 sessionId: src_id|8caac897-3188f756-6d38b70d-dce5269b_0
2025-10-10T14:39:41.997745Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a5d81369-f4769f22-966e21e9-c37a5775_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|8caac897-3188f756-6d38b70d-dce5269b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:42.000382Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8caac897-3188f756-6d38b70d-dce5269b_0] Write session: try to update token
2025-10-10T14:39:42.000399Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8caac897-3188f756-6d38b70d-dce5269b_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:42.015456Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3077 sessionId: src_id|8caac897-3188f756-6d38b70d-dce5269b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:42.017251Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:42.017273Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:42.017276Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:42.017279Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:42.017289Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602781385815241:6270]
2025-10-10T14:39:42.017294Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602781385815241:6270]
2025-10-10T14:39:42.017298Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602781385815241:6270]
2025-10-10T14:39:42.017371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:42.017373Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:42.017380Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:42.017384Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:42.017387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:42.017390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:42.017586Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:42.018347Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:42.073045Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602786463026838:2572]
2025-10-10T14:39:42.073432Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 pipe creation result: OK TabletId: 72075186224037892 Generation: 3076, pipe: [1:7559602786463026838:2572]
2025-10-10T14:39:42.138075Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:42.138370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:42.138385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:42.138434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602786463026838:2572], now have 1 active actors on pipe
2025-10-10T14:39:42.138684Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:42.138707Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 75 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602786463026838:2572]
2025-10-10T14:39:42.138733Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:39:42.138829Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3077 reason: status is not ok: tablet will be restarted right now sessionId: src_id|8caac897-3188f756-6d38b70d-dce5269b_0
2025-10-10T14:39:42.138674Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:42.139081Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3077 sessionId: src_id|8caac897-3188f756-6d38b70d-dce5269b_0 is DEAD
2025-10-10T14:39:42.139237Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8caac897-3188f756-6d38b70d-dce5269b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:39:42.139249Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8caac897-3188f756-6d38b70d-dce5269b_0] Write session will restart in 0.006920s
2025-10-10T14:39:42.139276Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8caac897-3188f756-6d38b70d-dce5269b_0] Write session: Do CDS request
2025-10-10T14:39:42.139282Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8caac897-3188f756-6d38b70d-dce5269b_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:42.147959Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8caac897-3188f756-6d38b70d-dce5269b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:42.148433Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:42.148462Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3078
2025-10-10T14:39:42.148693Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3078 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:42.148742Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3078 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:42.148754Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3078 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:42.148785Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:42.149272Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3078 sessionId:  describe result for acl check
2025-10-10T14:39:42.149314Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:42.149316Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:42.149317Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:42.149325Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602786463026854:4986] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:42.149965Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602786463026854:4986] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:42.152880Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602786463026854:4986] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:42.156435Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602786463026854:4986] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:42.156453Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602786463026854:4986] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:42.156457Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602786463026854:4986] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:42.156467Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3078 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:42.172661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:42.173462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:42.173717Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:42.173730Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:42.173744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:42.173814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:42.173866Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602785680782714:6268]
2025-10-10T14:39:42.174528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:42.174981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:42.175055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:42.175435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:42.175509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:42.175517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:42.175518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:42.175519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:42.175521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:42.175522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:42.175523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:42.175525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:42.175526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:42.175527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:42.175529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:42.175530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:42.175531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:42.175538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:42.175552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:42.175556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:42.175561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:42.175565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:42.175569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:42.175573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:42.175578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:42.175582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:42.175587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:42.175591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:42.175595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:42.175611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:42.175622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:42.175631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:42.175644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:42.175650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:42.175654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:42.175660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:42.175664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:42.175670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:42.175675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:42.175681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:42.175687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:42.175692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:42.175697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:42.175703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:42.175708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:42.175714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:42.175720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:42.175726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:42.175731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:42.175737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:42.175741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:42.175746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:42.175752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:42.175758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:42.175763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:42.175768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:42.175812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:42.179877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:42.180266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:42.180283Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:42.180286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:42.180290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:42.180299Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3077 [2:7559602785680782714:6268]
2025-10-10T14:39:42.180316Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:42.180338Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:42.180347Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:42.180352Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:42.180355Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:42.180376Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:42.180385Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:42.180394Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:42.180469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:42.180479Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:42.180482Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:42.180485Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:42.180568Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:42.180577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:42.180589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:42.180601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:42.180617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:42.180646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602786463026916:4986], now have 1 active actors on pipe
2025-10-10T14:39:42.180655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602786463026841:2438], now have 1 active actors on pipe
2025-10-10T14:39:42.180664Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602785680782709:6268]
2025-10-10T14:39:42.180667Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602785680782709:6268]
2025-10-10T14:39:42.180670Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602785680782709:6268]
2025-10-10T14:39:42.180684Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:42.180702Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:42.180705Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:42.180711Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:42.180714Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:42.180722Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:42.180725Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:42.180727Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3077
2025-10-10T14:39:42.180745Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3077
2025-10-10T14:39:42.180767Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602785680782709:6268]
2025-10-10T14:39:42.180796Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:42.180805Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:42.180816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:42.180822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:42.180893Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|548a149c-fbbb0189-34932a-f2a8667d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:42.180906Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:42.180911Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:42.180918Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:42.180933Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:42.180951Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:42.180978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:42.181141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:42.181152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:42.181173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:42.181350Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3078 partition: 0 MaxSeqNo: 40 sessionId: src_id|548a149c-fbbb0189-34932a-f2a8667d_0
2025-10-10T14:39:42.181762Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8caac897-3188f756-6d38b70d-dce5269b_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|548a149c-fbbb0189-34932a-f2a8667d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:42.184511Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|548a149c-fbbb0189-34932a-f2a8667d_0] Write session: try to update token
2025-10-10T14:39:42.184533Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|548a149c-fbbb0189-34932a-f2a8667d_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:42.203268Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:42.203291Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:42.203295Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:42.203297Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:42.203307Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602785680782709:6268]
2025-10-10T14:39:42.203311Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602785680782709:6268]
2025-10-10T14:39:42.203315Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602785680782709:6268]
2025-10-10T14:39:42.203374Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:42.203376Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:42.203383Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:42.203384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:42.203388Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:42.203388Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:42.203563Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:42.208291Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3078 sessionId: src_id|548a149c-fbbb0189-34932a-f2a8667d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:42.211220Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:42.238902Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602786463027074:2572]
2025-10-10T14:39:42.239228Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 pipe creation result: OK TabletId: 72075186224037892 Generation: 3077, pipe: [1:7559602786463027074:2572]
2025-10-10T14:39:42.320238Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:42.321283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:42.321306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:42.321373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602786463027074:2572], now have 1 active actors on pipe
2025-10-10T14:39:42.321605Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:42.321722Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:42.321739Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:42.321807Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3078 reason: error at write: Disconnected sessionId: src_id|548a149c-fbbb0189-34932a-f2a8667d_0
2025-10-10T14:39:42.322002Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:42.322051Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3078 sessionId: src_id|548a149c-fbbb0189-34932a-f2a8667d_0 is DEAD
2025-10-10T14:39:42.322072Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 76 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602786463027074:2572]
2025-10-10T14:39:42.322205Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|548a149c-fbbb0189-34932a-f2a8667d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:42.322216Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|548a149c-fbbb0189-34932a-f2a8667d_0] Write session will restart in 0.009416s
2025-10-10T14:39:42.322242Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|548a149c-fbbb0189-34932a-f2a8667d_0] Write session: Do CDS request
2025-10-10T14:39:42.322248Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|548a149c-fbbb0189-34932a-f2a8667d_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:42.334284Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|548a149c-fbbb0189-34932a-f2a8667d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:42.334365Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:42.334386Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3079
2025-10-10T14:39:42.334549Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3079 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:42.334590Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3079 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:42.334609Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3079 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:42.334613Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:42.335068Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3079 sessionId:  describe result for acl check
2025-10-10T14:39:42.335121Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:42.335127Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:42.335129Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:42.335136Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602786463027240:4969] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:42.335734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602786463027240:4969] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:42.338299Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602786463027240:4969] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:42.339427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:42.343726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:42.343867Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602786463027240:4969] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:42.343888Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602786463027240:4969] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:42.343892Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602786463027240:4969] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:42.343901Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3079 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:42.343990Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:42.344001Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:42.344014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:42.344076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:42.344132Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602785680782885:6265]
2025-10-10T14:39:42.344802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:42.345118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:42.345165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:42.345494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:42.345560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:42.345567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:42.345569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:42.345570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:42.345571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:42.345573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:42.345574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:42.345575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:42.345577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:42.345578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:42.345579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:42.345580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:42.345582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:42.345588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:42.345601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:42.345606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:42.345610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:42.345614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:42.345617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:42.345621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:42.345625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:42.345629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:42.345634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:42.345637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:42.345640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:42.345644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:42.345652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:42.345661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:42.345668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:42.345674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:42.345679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:42.345684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:42.345688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:42.345693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:42.345698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:42.345704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:42.345709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:42.345714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:42.345718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:42.345723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:42.345728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:42.345733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:42.345738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:42.345743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:42.345748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:42.345754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:42.345759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:42.345764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:42.345771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:42.345781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:42.345786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:42.345792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:42.345834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:42.348545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:42.349402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:42.349416Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:42.349418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:42.349424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:42.349432Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3078 [2:7559602785680782885:6265]
2025-10-10T14:39:42.349450Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:42.349472Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:42.349476Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:42.349479Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:42.349483Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:42.349502Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:42.349510Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:42.349519Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:42.349583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:42.349592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:42.349595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:42.349597Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:42.349671Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:42.349679Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:42.349692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:42.349706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:42.349731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:42.349756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602786463027300:4969], now have 1 active actors on pipe
2025-10-10T14:39:42.349765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602786463027077:2438], now have 1 active actors on pipe
2025-10-10T14:39:42.349772Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602785680782880:6265]
2025-10-10T14:39:42.349780Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602785680782880:6265]
2025-10-10T14:39:42.349783Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602785680782880:6265]
2025-10-10T14:39:42.349797Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:42.349817Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:42.349838Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:42.349843Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:42.349875Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602785680782880:6265]
2025-10-10T14:39:42.349884Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:42.349847Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3078
2025-10-10T14:39:42.349866Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3078
2025-10-10T14:39:42.350029Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:42.350037Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:42.350040Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:42.350049Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:42.350146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:42.350158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:42.350191Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ae966f9e-919408ac-9354f566-f67cbc03_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:42.350205Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:42.350210Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:42.350218Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:42.350230Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:42.350247Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:42.350267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:42.350404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:42.350412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:42.350426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:42.350572Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3079 partition: 0 MaxSeqNo: 40 sessionId: src_id|ae966f9e-919408ac-9354f566-f67cbc03_0
2025-10-10T14:39:42.351032Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|548a149c-fbbb0189-34932a-f2a8667d_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|ae966f9e-919408ac-9354f566-f67cbc03_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:42.354082Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ae966f9e-919408ac-9354f566-f67cbc03_0] Write session: try to update token
2025-10-10T14:39:42.354112Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ae966f9e-919408ac-9354f566-f67cbc03_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:42.373849Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:42.373868Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:42.373872Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:42.373874Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:42.373885Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602785680782880:6265]
2025-10-10T14:39:42.373889Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602785680782880:6265]
2025-10-10T14:39:42.373893Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602785680782880:6265]
2025-10-10T14:39:42.373948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:42.373952Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:42.373956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:42.373958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:42.373959Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:42.373964Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:42.374113Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:42.375588Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3079 sessionId: src_id|ae966f9e-919408ac-9354f566-f67cbc03_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:42.378552Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:42.422215Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602786463027311:2572]
2025-10-10T14:39:42.422911Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 pipe creation result: OK TabletId: 72075186224037892 Generation: 3078, pipe: [1:7559602786463027311:2572]
2025-10-10T14:39:42.495064Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:42.495894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:42.495912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:42.495962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602786463027311:2572], now have 1 active actors on pipe
2025-10-10T14:39:42.496141Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:42.496666Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:39:42.496755Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3079 reason: status is not ok: tablet will be restarted right now sessionId: src_id|ae966f9e-919408ac-9354f566-f67cbc03_0
2025-10-10T14:39:42.497062Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3079 sessionId: src_id|ae966f9e-919408ac-9354f566-f67cbc03_0 is DEAD
2025-10-10T14:39:42.497291Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:42.497371Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 77 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602786463027311:2572]
2025-10-10T14:39:42.501453Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae966f9e-919408ac-9354f566-f67cbc03_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:39:42.501472Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae966f9e-919408ac-9354f566-f67cbc03_0] Write session will restart in 0.005354s
2025-10-10T14:39:42.501502Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae966f9e-919408ac-9354f566-f67cbc03_0] Write session: Do CDS request
2025-10-10T14:39:42.501510Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae966f9e-919408ac-9354f566-f67cbc03_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:42.507976Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ae966f9e-919408ac-9354f566-f67cbc03_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:42.508047Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:42.508066Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3080
2025-10-10T14:39:42.508241Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3080 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:42.508278Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3080 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:42.508289Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3080 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:42.508294Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:42.508721Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3080 sessionId:  describe result for acl check
2025-10-10T14:39:42.508754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:42.508762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:42.508764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:42.508779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602786463027343:4951] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:42.509362Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602786463027343:4951] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:42.511994Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602786463027343:4951] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:42.515354Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602786463027343:4951] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:42.515372Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602786463027343:4951] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:42.515375Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602786463027343:4951] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:42.515384Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3080 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:42.526755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:42.527517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:42.527739Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:42.527749Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:42.527761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:42.527811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:42.527858Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602785680783087:6260]
2025-10-10T14:39:42.528569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:42.528969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:42.529029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:42.529429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:42.529494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:42.529500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:42.529502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:42.529503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:42.529504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:42.529506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:42.529507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:42.529509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:42.529510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:42.529512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:42.529513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:42.529514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:42.529516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:42.529524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:42.529538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:42.529543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:42.529548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:42.529553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:42.529558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:42.529562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:42.529565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:42.529569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:42.529572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:42.529576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:42.529581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:42.529585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:42.529593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:42.529603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:42.529612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:42.529618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:42.529624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:42.529630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:42.529635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:42.529641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:42.529648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:42.529657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:42.529662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:42.529668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:42.529673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:42.529680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:42.529685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:42.529697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:42.529702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:42.529713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:42.529717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:42.529723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:42.529728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:42.529733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:42.529739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:42.529745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:42.529750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:42.529756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:42.529803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:42.532638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:42.532952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:42.532964Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:42.532967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:42.532971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:42.532979Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3079 [2:7559602785680783087:6260]
2025-10-10T14:39:42.532991Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:42.533015Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:42.533018Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:42.533022Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:42.533025Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:42.533361Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3079
2025-10-10T14:39:42.533384Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3079
2025-10-10T14:39:42.533044Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:42.533061Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:42.533069Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:42.533128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:42.533130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:42.533133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:42.533135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:42.533204Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:42.533207Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:42.533220Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:42.533233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:42.533253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:42.533278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602786463027326:2438], now have 1 active actors on pipe
2025-10-10T14:39:42.533282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602786463027462:4951], now have 1 active actors on pipe
2025-10-10T14:39:42.533291Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602785680783082:6260]
2025-10-10T14:39:42.533293Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602785680783082:6260]
2025-10-10T14:39:42.533296Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602785680783082:6260]
2025-10-10T14:39:42.533310Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:42.533324Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:42.533324Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:42.533327Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:42.533350Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:42.533358Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:42.533361Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:42.533395Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602785680783082:6260]
2025-10-10T14:39:42.533403Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:42.533417Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:42.533438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:42.533443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:42.533476Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1f80885a-746415fc-196c4a15-7bdb2292_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:42.533484Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:42.533488Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:42.533490Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:42.533501Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:42.533512Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:42.533526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:42.533675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:42.533684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:42.533710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:42.533859Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3080 partition: 0 MaxSeqNo: 40 sessionId: src_id|1f80885a-746415fc-196c4a15-7bdb2292_0
2025-10-10T14:39:42.534260Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae966f9e-919408ac-9354f566-f67cbc03_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|1f80885a-746415fc-196c4a15-7bdb2292_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:42.537012Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1f80885a-746415fc-196c4a15-7bdb2292_0] Write session: try to update token
2025-10-10T14:39:42.537035Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1f80885a-746415fc-196c4a15-7bdb2292_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:42.551317Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3080 sessionId: src_id|1f80885a-746415fc-196c4a15-7bdb2292_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:42.553671Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:42.553690Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:42.553694Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:42.553696Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:42.553707Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602785680783082:6260]
2025-10-10T14:39:42.553712Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602785680783082:6260]
2025-10-10T14:39:42.553717Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602785680783082:6260]
2025-10-10T14:39:42.553767Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:42.553775Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:42.553774Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:42.553778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:42.553781Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:42.553786Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:42.553909Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:42.554035Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:42.596814Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602786463027573:2572]
2025-10-10T14:39:42.597131Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 pipe creation result: OK TabletId: 72075186224037892 Generation: 3079, pipe: [1:7559602786463027573:2572]
2025-10-10T14:39:42.675418Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:42.675894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:42.675909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:42.675959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602786463027573:2572], now have 1 active actors on pipe
2025-10-10T14:39:42.676233Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:42.676237Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 78 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602786463027573:2572]
2025-10-10T14:39:42.676291Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:42.676300Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:42.676381Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3080 reason: error at write: Disconnected sessionId: src_id|1f80885a-746415fc-196c4a15-7bdb2292_0
2025-10-10T14:39:42.676602Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3080 sessionId: src_id|1f80885a-746415fc-196c4a15-7bdb2292_0 is DEAD
2025-10-10T14:39:42.676603Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:42.677506Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f80885a-746415fc-196c4a15-7bdb2292_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:42.677518Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f80885a-746415fc-196c4a15-7bdb2292_0] Write session will restart in 0.005317s
2025-10-10T14:39:42.677545Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f80885a-746415fc-196c4a15-7bdb2292_0] Write session: Do CDS request
2025-10-10T14:39:42.677555Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f80885a-746415fc-196c4a15-7bdb2292_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:42.683974Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1f80885a-746415fc-196c4a15-7bdb2292_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:42.684044Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:42.684061Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3081
2025-10-10T14:39:42.684354Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3081 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:42.684419Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3081 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:42.684441Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3081 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:42.684446Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:42.684940Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3081 sessionId:  describe result for acl check
2025-10-10T14:39:42.684973Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:42.684979Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:42.684980Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:42.684985Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602786463027591:3836] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:42.685548Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602786463027591:3836] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:42.688697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602786463027591:3836] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:42.692583Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602786463027591:3836] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:42.692599Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602786463027591:3836] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:42.692603Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602786463027591:3836] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:42.692612Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3081 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:42.697408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:42.701132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:42.701380Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:42.701404Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:42.701416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:42.701468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:42.701528Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602785680783277:6236]
2025-10-10T14:39:42.702238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:42.702556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:42.702599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:42.702940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:42.703597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:42.703606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:42.703608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:42.703609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:42.703611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:42.703612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:42.703613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:42.703615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:42.703616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:42.703618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:42.703619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:42.703621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:42.703622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:42.703629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:42.703644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:42.703650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:42.703654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:42.703659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:42.703664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:42.703669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:42.703673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:42.703678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:42.703683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:42.703688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:42.703692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:42.703697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:42.703707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:42.703716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:42.703723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:42.703730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:42.703737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:42.703743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:42.703747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:42.703753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:42.703759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:42.703765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:42.703771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:42.703782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:42.703788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:42.703794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:42.703799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:42.703805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:42.703810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:42.703817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:42.703827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:42.703834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:42.703841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:42.703852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:42.703857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:42.703867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:42.703873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:42.703880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:42.703931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:42.706904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:42.707241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:42.707255Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:42.707259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:42.707263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:42.707271Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3080 [2:7559602785680783277:6236]
2025-10-10T14:39:42.707286Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:42.707305Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:42.707313Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:42.707317Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:42.707320Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:42.707338Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:42.707350Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:42.707363Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:42.707425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:42.707432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:42.707435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:42.707437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:42.707510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:42.707518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:42.707531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:42.707545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:42.707570Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:42.707597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602786463027575:2438], now have 1 active actors on pipe
2025-10-10T14:39:42.707605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602786463027758:3836], now have 1 active actors on pipe
2025-10-10T14:39:42.707613Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602785680783272:6236]
2025-10-10T14:39:42.707615Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602785680783272:6236]
2025-10-10T14:39:42.707618Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602785680783272:6236]
2025-10-10T14:39:42.707631Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:42.707649Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:42.707651Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:42.707654Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:42.707656Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:42.707683Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:42.707691Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:42.707715Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602785680783272:6236]
2025-10-10T14:39:42.707726Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:42.707733Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:42.707779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:42.707790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:42.707823Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|734da6a9-b19ee6d9-fe20bf16-4809c8a1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:42.707834Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:42.707839Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:42.707842Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:42.707854Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:42.707868Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:42.707887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:42.708044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:42.708052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:42.708067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:42.708673Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f80885a-746415fc-196c4a15-7bdb2292_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|734da6a9-b19ee6d9-fe20bf16-4809c8a1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:42.707649Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3080
2025-10-10T14:39:42.707689Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3080
2025-10-10T14:39:42.708230Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3081 partition: 0 MaxSeqNo: 40 sessionId: src_id|734da6a9-b19ee6d9-fe20bf16-4809c8a1_0
2025-10-10T14:39:42.711702Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|734da6a9-b19ee6d9-fe20bf16-4809c8a1_0] Write session: try to update token
2025-10-10T14:39:42.711723Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|734da6a9-b19ee6d9-fe20bf16-4809c8a1_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:42.728192Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3081 sessionId: src_id|734da6a9-b19ee6d9-fe20bf16-4809c8a1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:42.729194Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:42.729209Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:42.729211Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:42.729212Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:42.729220Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602785680783272:6236]
2025-10-10T14:39:42.729223Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602785680783272:6236]
2025-10-10T14:39:42.729226Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602785680783272:6236]
2025-10-10T14:39:42.729268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:42.729275Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:42.729276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:42.729294Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:42.729300Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:42.729305Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:42.729433Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:42.730936Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:42.776536Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602786463027813:2572]
2025-10-10T14:39:42.776904Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 pipe creation result: OK TabletId: 72075186224037892 Generation: 3080, pipe: [1:7559602786463027813:2572]
2025-10-10T14:39:42.846602Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:42.846973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:42.846995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:42.847056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602786463027813:2572], now have 1 active actors on pipe
2025-10-10T14:39:42.847343Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:42.847359Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:42.847360Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:42.847432Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 79 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602786463027813:2572]
2025-10-10T14:39:42.847445Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3081 reason: error at write: Disconnected sessionId: src_id|734da6a9-b19ee6d9-fe20bf16-4809c8a1_0
2025-10-10T14:39:42.847568Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:42.847685Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3081 sessionId: src_id|734da6a9-b19ee6d9-fe20bf16-4809c8a1_0 is DEAD
2025-10-10T14:39:42.847877Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|734da6a9-b19ee6d9-fe20bf16-4809c8a1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:42.847885Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|734da6a9-b19ee6d9-fe20bf16-4809c8a1_0] Write session will restart in 0.005077s
2025-10-10T14:39:42.847914Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|734da6a9-b19ee6d9-fe20bf16-4809c8a1_0] Write session: Do CDS request
2025-10-10T14:39:42.847924Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|734da6a9-b19ee6d9-fe20bf16-4809c8a1_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:42.853925Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|734da6a9-b19ee6d9-fe20bf16-4809c8a1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:42.854081Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:42.854101Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3082
2025-10-10T14:39:42.854241Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3082 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:42.854285Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3082 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:42.854296Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3082 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:42.854301Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:42.854817Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3082 sessionId:  describe result for acl check
2025-10-10T14:39:42.854868Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:42.854874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:42.854880Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:42.854887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602786463027847:4914] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:42.855490Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602786463027847:4914] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:42.859219Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602786463027847:4914] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:42.862472Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602786463027847:4914] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:42.862489Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602786463027847:4914] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:42.862493Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602786463027847:4914] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:42.862503Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3082 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:42.865387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:42.868700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:42.869193Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:42.869199Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:42.869214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:42.869286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:42.869323Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602785680783450:6234]
2025-10-10T14:39:42.869890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:42.870249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:42.870299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:42.870624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:42.870676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:42.870678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:42.870679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:42.870680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:42.870681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:42.870683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:42.870684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:42.870685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:42.870687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:42.870688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:42.870689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:42.870690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:42.870692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:42.870698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:42.870712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:42.870716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:42.870720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:42.870724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:42.870728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:42.870732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:42.870736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:42.870740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:42.870746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:42.870750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:42.870754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:42.870758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:42.870766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:42.870776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:42.870783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:42.870789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:42.870796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:42.870801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:42.870806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:42.870811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:42.870816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:42.870822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:42.870826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:42.870831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:42.870836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:42.870841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:42.870846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:42.870851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:42.870856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:42.870862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:42.870867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:42.870872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:42.870876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:42.870881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:42.870886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:42.870891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:42.870896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:42.870901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:42.870941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:42.874384Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3081
2025-10-10T14:39:42.873710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:42.874015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:42.874018Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:42.874020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:42.874023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:42.874029Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3081 [2:7559602785680783450:6234]
2025-10-10T14:39:42.874038Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:42.874453Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3081
2025-10-10T14:39:42.874052Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:42.874054Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:42.874057Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:42.874058Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:42.874070Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:42.874077Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:42.874084Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:42.874141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:42.874143Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:42.874144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:42.874147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:42.874212Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:42.874215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:42.874226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:42.874237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:42.874253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:42.874276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602786463027828:2438], now have 1 active actors on pipe
2025-10-10T14:39:42.874280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602786463028055:4914], now have 1 active actors on pipe
2025-10-10T14:39:42.874287Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602785680783445:6234]
2025-10-10T14:39:42.874290Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602785680783445:6234]
2025-10-10T14:39:42.874292Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602785680783445:6234]
2025-10-10T14:39:42.874304Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:42.874315Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:42.874325Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:42.874328Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:42.874347Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602785680783445:6234]
2025-10-10T14:39:42.874349Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:42.874395Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:42.874397Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:42.874399Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:42.874405Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:42.874493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:42.874502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:42.874540Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5c018945-2e75899b-1d327399-c5f1a92a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:42.874548Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:42.874551Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:42.874553Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:42.874563Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:42.874574Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:42.874590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:42.874953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:42.874962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:42.874975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:42.875095Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3082 partition: 0 MaxSeqNo: 40 sessionId: src_id|5c018945-2e75899b-1d327399-c5f1a92a_0
2025-10-10T14:39:42.875498Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|734da6a9-b19ee6d9-fe20bf16-4809c8a1_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|5c018945-2e75899b-1d327399-c5f1a92a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:42.878151Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5c018945-2e75899b-1d327399-c5f1a92a_0] Write session: try to update token
2025-10-10T14:39:42.878169Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5c018945-2e75899b-1d327399-c5f1a92a_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:42.894007Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3082 sessionId: src_id|5c018945-2e75899b-1d327399-c5f1a92a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:42.895048Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:42.895071Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:42.895074Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:42.895077Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:42.895086Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602785680783445:6234]
2025-10-10T14:39:42.895093Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602785680783445:6234]
2025-10-10T14:39:42.895097Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602785680783445:6234]
2025-10-10T14:39:42.895149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:42.895156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:42.895155Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:42.895159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:42.895163Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:42.895171Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:42.895324Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:42.896642Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:42.947533Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602786463028072:2572]
2025-10-10T14:39:42.947826Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 pipe creation result: OK TabletId: 72075186224037892 Generation: 3081, pipe: [1:7559602786463028072:2572]
2025-10-10T14:39:43.014061Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:43.015189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:43.015207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:43.015259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602786463028072:2572], now have 1 active actors on pipe
2025-10-10T14:39:43.015560Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:43.015603Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 80 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602786463028072:2572]
2025-10-10T14:39:43.015629Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:43.015641Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:43.015734Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3082 reason: error at write: Disconnected sessionId: src_id|5c018945-2e75899b-1d327399-c5f1a92a_0
2025-10-10T14:39:43.015752Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:43.015973Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3082 sessionId: src_id|5c018945-2e75899b-1d327399-c5f1a92a_0 is DEAD
2025-10-10T14:39:43.016181Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c018945-2e75899b-1d327399-c5f1a92a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:43.016194Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c018945-2e75899b-1d327399-c5f1a92a_0] Write session will restart in 0.005230s
2025-10-10T14:39:43.016234Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c018945-2e75899b-1d327399-c5f1a92a_0] Write session: Do CDS request
2025-10-10T14:39:43.016242Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c018945-2e75899b-1d327399-c5f1a92a_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:43.022930Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5c018945-2e75899b-1d327399-c5f1a92a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:43.023025Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:43.023043Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3083
2025-10-10T14:39:43.023162Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3083 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:43.023214Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3083 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:43.023226Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3083 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:43.023239Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:43.023741Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3083 sessionId:  describe result for acl check
2025-10-10T14:39:43.023790Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:43.023797Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:43.023799Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:43.023805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602790757995384:4890] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:43.024401Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602790757995384:4890] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:43.028534Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602790757995384:4890] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:43.035656Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602790757995384:4890] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:43.035673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602790757995384:4890] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:43.035676Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602790757995384:4890] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:43.035684Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3083 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:43.048409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:43.051152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:43.051393Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:43.051404Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:43.051416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:43.051492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:43.051543Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602789975750919:6227]
2025-10-10T14:39:43.052177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:43.052588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:43.052638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:43.053236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:43.053355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:43.053363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:43.053364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:43.053366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:43.053367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:43.053368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:43.053370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:43.053371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:43.053373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:43.053374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:43.053376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:43.053377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:43.053378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:43.053385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:43.053399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:43.053403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:43.053407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:43.053411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:43.053417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:43.053421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:43.053425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:43.053429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:43.053433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:43.053436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:43.053440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:43.053444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:43.053455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:43.053463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:43.053470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:43.053475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:43.053480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:43.053485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:43.053494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:43.053500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:43.053506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:43.053511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:43.053519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:43.053524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:43.053528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:43.053533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:43.053542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:43.053547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:43.053551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:43.053556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:43.053560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:43.053566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:43.053570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:43.053575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:43.053580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:43.053595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:43.053600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:43.053605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:43.053647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:43.056552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:43.056926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:43.056940Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:43.056943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:43.056947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:43.056953Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3082 [2:7559602789975750919:6227]
2025-10-10T14:39:43.056968Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:43.056986Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:43.056989Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:43.056993Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:43.056995Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:43.057017Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:43.057043Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:43.057059Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:43.057144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:43.057153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:43.057156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:43.057159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:43.057243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:43.057251Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:43.057262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:43.057274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:43.057296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:43.057326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602790757995521:4890], now have 1 active actors on pipe
2025-10-10T14:39:43.057352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602790757995369:2438], now have 1 active actors on pipe
2025-10-10T14:39:43.057362Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602789975750914:6227]
2025-10-10T14:39:43.057367Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602789975750914:6227]
2025-10-10T14:39:43.057369Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602789975750914:6227]
2025-10-10T14:39:43.057384Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:43.057401Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:43.057406Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:43.057410Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:43.057412Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:43.057420Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:43.057426Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:43.057415Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3082
2025-10-10T14:39:43.057422Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3082
2025-10-10T14:39:43.057459Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602789975750914:6227]
2025-10-10T14:39:43.057469Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:43.057471Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:43.057489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:43.057502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:43.057560Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6bae696a-71ca6460-7ea1d5f5-9cd7c447_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:43.057578Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:43.057586Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:43.057589Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:43.057601Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:43.057613Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:43.057642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:43.058060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:43.058072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:43.058094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:43.058259Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3083 partition: 0 MaxSeqNo: 40 sessionId: src_id|6bae696a-71ca6460-7ea1d5f5-9cd7c447_0
2025-10-10T14:39:43.058731Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c018945-2e75899b-1d327399-c5f1a92a_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|6bae696a-71ca6460-7ea1d5f5-9cd7c447_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:43.061515Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6bae696a-71ca6460-7ea1d5f5-9cd7c447_0] Write session: try to update token
2025-10-10T14:39:43.061536Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6bae696a-71ca6460-7ea1d5f5-9cd7c447_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:43.076349Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3083 sessionId: src_id|6bae696a-71ca6460-7ea1d5f5-9cd7c447_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:43.078882Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:43.078903Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:43.078907Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:43.078910Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:43.078922Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602789975750914:6227]
2025-10-10T14:39:43.078932Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602789975750914:6227]
2025-10-10T14:39:43.078936Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602789975750914:6227]
2025-10-10T14:39:43.078987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:43.079000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:43.079003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:43.079003Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:43.079022Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:43.079034Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:43.079106Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:43.079142Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:43.117482Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602790757995609:2572]
2025-10-10T14:39:43.117802Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 pipe creation result: OK TabletId: 72075186224037892 Generation: 3082, pipe: [1:7559602790757995609:2572]
2025-10-10T14:39:43.199213Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:43.200142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:43.200152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:43.200203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602790757995609:2572], now have 1 active actors on pipe
2025-10-10T14:39:43.200465Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:43.200775Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:43.200791Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:43.200864Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3083 reason: error at write: Disconnected sessionId: src_id|6bae696a-71ca6460-7ea1d5f5-9cd7c447_0
2025-10-10T14:39:43.201097Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 81 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602790757995609:2572]
2025-10-10T14:39:43.201104Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3083 sessionId: src_id|6bae696a-71ca6460-7ea1d5f5-9cd7c447_0 is DEAD
2025-10-10T14:39:43.201153Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:43.201559Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6bae696a-71ca6460-7ea1d5f5-9cd7c447_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:43.201571Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6bae696a-71ca6460-7ea1d5f5-9cd7c447_0] Write session will restart in 0.005640s
2025-10-10T14:39:43.201598Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6bae696a-71ca6460-7ea1d5f5-9cd7c447_0] Write session: Do CDS request
2025-10-10T14:39:43.201608Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6bae696a-71ca6460-7ea1d5f5-9cd7c447_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:43.209519Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6bae696a-71ca6460-7ea1d5f5-9cd7c447_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:43.210031Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:43.210051Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3084
2025-10-10T14:39:43.210215Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3084 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:43.210252Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3084 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:43.210263Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3084 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:43.210268Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:43.211525Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3084 sessionId:  describe result for acl check
2025-10-10T14:39:43.211569Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:43.211579Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:43.211581Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:43.211588Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602790757995644:4888] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:43.212189Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602790757995644:4888] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:43.215269Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602790757995644:4888] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:43.219195Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602790757995644:4888] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:43.219209Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602790757995644:4888] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:43.219213Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602790757995644:4888] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:43.219222Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3084 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:43.229903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:43.230609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:43.230870Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:43.230883Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:43.230898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:43.230968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:43.231015Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602789975751093:6225]
2025-10-10T14:39:43.231717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:43.232065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:43.232133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:43.232479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:43.232883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:43.232892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:43.232894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:43.232896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:43.232897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:43.232899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:43.232900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:43.232902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:43.232903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:43.232905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:43.232906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:43.232908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:43.232924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:43.232933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:43.232949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:43.232953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:43.232958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:43.232963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:43.232967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:43.232972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:43.232976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:43.232981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:43.232986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:43.232991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:43.232995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:43.233000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:43.233010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:43.233020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:43.233029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:43.233038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:43.233045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:43.233053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:43.233058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:43.233064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:43.233073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:43.233078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:43.233088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:43.233093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:43.233098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:43.233103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:43.233108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:43.233118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:43.233124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:43.233130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:43.233139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:43.233144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:43.233150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:43.233156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:43.233160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:43.233166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:43.233173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:43.233178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:43.233224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:43.236135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:43.236462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:43.236477Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:43.236480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:43.236485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:43.236492Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3083 [2:7559602789975751093:6225]
2025-10-10T14:39:43.236506Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:43.236526Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:43.236532Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:43.236536Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:43.236539Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:43.236556Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:43.236570Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:43.236596Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:43.236657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:43.236665Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:43.236667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:43.236669Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:43.236739Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:43.236750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:43.236778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:43.236793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:43.236813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:43.236836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602790757995611:2438], now have 1 active actors on pipe
2025-10-10T14:39:43.236840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602790757995774:4888], now have 1 active actors on pipe
2025-10-10T14:39:43.236848Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602789975751088:6225]
2025-10-10T14:39:43.236853Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602789975751088:6225]
2025-10-10T14:39:43.236856Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602789975751088:6225]
2025-10-10T14:39:43.236918Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3083
2025-10-10T14:39:43.236945Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3083
2025-10-10T14:39:43.236869Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:43.236888Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:43.236889Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:43.236894Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:43.236896Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:43.236907Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:43.236910Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:43.236937Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602789975751088:6225]
2025-10-10T14:39:43.236942Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:43.236942Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:43.236974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:43.236980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:43.237028Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|75450d04-a527d27d-27158aea-2a430aa8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:43.237036Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:43.237040Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:43.237042Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:43.237055Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:43.237066Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:43.237085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:43.237316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:43.237344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:43.237368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:43.237494Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3084 partition: 0 MaxSeqNo: 40 sessionId: src_id|75450d04-a527d27d-27158aea-2a430aa8_0
2025-10-10T14:39:43.237945Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6bae696a-71ca6460-7ea1d5f5-9cd7c447_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|75450d04-a527d27d-27158aea-2a430aa8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:43.240837Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|75450d04-a527d27d-27158aea-2a430aa8_0] Write session: try to update token
2025-10-10T14:39:43.240859Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|75450d04-a527d27d-27158aea-2a430aa8_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:43.256276Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3084 sessionId: src_id|75450d04-a527d27d-27158aea-2a430aa8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:43.258746Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:43.258768Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:43.258771Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:43.258773Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:43.258785Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602789975751088:6225]
2025-10-10T14:39:43.258790Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602789975751088:6225]
2025-10-10T14:39:43.258794Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602789975751088:6225]
2025-10-10T14:39:43.258851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:43.258855Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:43.258862Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:43.258865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:43.258868Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:43.258868Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:43.259028Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:43.259085Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:43.300824Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602790757995851:2572]
2025-10-10T14:39:43.301606Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 pipe creation result: OK TabletId: 72075186224037892 Generation: 3083, pipe: [1:7559602790757995851:2572]
2025-10-10T14:39:43.380982Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:43.381606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:43.381630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:43.381692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602790757995851:2572], now have 1 active actors on pipe
2025-10-10T14:39:43.381987Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:43.382861Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75450d04-a527d27d-27158aea-2a430aa8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:43.382873Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75450d04-a527d27d-27158aea-2a430aa8_0] Write session will restart in 0.007262s
2025-10-10T14:39:43.382898Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75450d04-a527d27d-27158aea-2a430aa8_0] Write session: Do CDS request
2025-10-10T14:39:43.382904Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75450d04-a527d27d-27158aea-2a430aa8_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:43.381991Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:43.382008Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 82 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602790757995851:2572]
2025-10-10T14:39:43.382035Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:43.382038Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:43.382103Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3084 reason: error at write: Disconnected sessionId: src_id|75450d04-a527d27d-27158aea-2a430aa8_0
2025-10-10T14:39:43.382356Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3084 sessionId: src_id|75450d04-a527d27d-27158aea-2a430aa8_0 is DEAD
2025-10-10T14:39:43.391983Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|75450d04-a527d27d-27158aea-2a430aa8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:43.392396Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:43.392416Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3085
2025-10-10T14:39:43.392602Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3085 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:43.392639Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3085 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:43.392646Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3085 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:43.392650Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:43.393099Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3085 sessionId:  describe result for acl check
2025-10-10T14:39:43.393125Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:43.393127Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:43.393129Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:43.393136Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602790757995922:4886] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:43.393742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602790757995922:4886] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:43.398422Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602790757995922:4886] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:43.401406Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602790757995922:4886] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:43.401423Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602790757995922:4886] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:43.401427Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602790757995922:4886] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:43.401437Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3085 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:43.407789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:43.408292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:43.408560Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:43.408585Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:43.408602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:43.408673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:43.408716Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602789975751270:6218]
2025-10-10T14:39:43.409485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:43.409935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:43.409987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:43.410418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:43.410499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:43.410501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:43.410503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:43.410504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:43.410506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:43.410507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:43.410508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:43.410512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:43.410514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:43.410515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:43.410517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:43.410518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:43.410519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:43.410526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:43.410542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:43.410546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:43.410551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:43.410555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:43.410560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:43.410565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:43.410569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:43.410574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:43.410580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:43.410584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:43.410589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:43.410593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:43.410601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:43.410633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:43.410640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:43.410646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:43.410651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:43.410657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:43.410664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:43.410670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:43.410678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:43.410683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:43.410688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:43.410694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:43.410702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:43.410708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:43.410714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:43.410720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:43.410724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:43.410730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:43.410735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:43.410741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:43.410746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:43.410752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:43.410756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:43.410762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:43.410768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:43.410773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:43.410817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:43.413502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:43.414442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:43.414450Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:43.414453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:43.414458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:43.414466Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3084 [2:7559602789975751270:6218]
2025-10-10T14:39:43.414484Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:43.414504Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:43.414508Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:43.414513Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:43.414515Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:43.414535Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:43.414544Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:43.414552Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:43.414615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:43.414617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:43.414619Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:43.414621Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:43.414701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:43.414705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:43.414718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:43.414731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:43.414750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:43.414774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602790757995853:2438], now have 1 active actors on pipe
2025-10-10T14:39:43.414780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602790757996080:4886], now have 1 active actors on pipe
2025-10-10T14:39:43.414789Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602789975751265:6218]
2025-10-10T14:39:43.414791Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602789975751265:6218]
2025-10-10T14:39:43.414793Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602789975751265:6218]
2025-10-10T14:39:43.414813Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:43.414828Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:43.414847Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:43.414851Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:43.414863Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:43.414867Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:43.414869Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:43.414877Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602789975751265:6218]
2025-10-10T14:39:43.414880Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:43.414908Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:43.414933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:43.414938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:43.414969Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|271fea3-7b5a72c4-1cc1f5ff-fd7f0767_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:43.414977Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:43.414981Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:43.414984Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:43.414999Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:43.415010Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:43.415025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:43.415451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:43.415461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:43.415483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:43.415987Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75450d04-a527d27d-27158aea-2a430aa8_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|271fea3-7b5a72c4-1cc1f5ff-fd7f0767_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:43.414835Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3084
2025-10-10T14:39:43.414871Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3084
2025-10-10T14:39:43.415613Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3085 partition: 0 MaxSeqNo: 40 sessionId: src_id|271fea3-7b5a72c4-1cc1f5ff-fd7f0767_0
2025-10-10T14:39:43.418830Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|271fea3-7b5a72c4-1cc1f5ff-fd7f0767_0] Write session: try to update token
2025-10-10T14:39:43.418847Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|271fea3-7b5a72c4-1cc1f5ff-fd7f0767_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:43.435875Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:39:43.435898Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:43.435912Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602789975751265:6218]
2025-10-10T14:39:43.435974Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:39:43.435975Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:39:43.436177Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:39:43.436339Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:43.436493Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:43.436646Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:43.436865Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:39:43.436917Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:39:43.439204Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3085 sessionId: src_id|271fea3-7b5a72c4-1cc1f5ff-fd7f0767_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:43.442028Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:43.442251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:43.442272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:43.442317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:39:43.442665Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:39:43.448748Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:43.448785Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:43.448789Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:43.448791Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:43.448803Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602789975751265:6218]
2025-10-10T14:39:43.448808Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602789975751265:6218]
2025-10-10T14:39:43.448812Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602789975751265:6218]
2025-10-10T14:39:43.448867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:43.448874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:43.448880Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:43.449020Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:43.453600Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:43.453626Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:43.453631Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:43.482029Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602790757996094:2572]
2025-10-10T14:39:43.482329Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 pipe creation result: OK TabletId: 72075186224037892 Generation: 3084, pipe: [1:7559602790757996094:2572]
2025-10-10T14:39:43.570299Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:43.579708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:43.579736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:43.579906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:43.579971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:43.580039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:43.580104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:43.580152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:43.580164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:43.580233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:43.580300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:43.580369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:43.580438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:43.580486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:43.580495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:43.580570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:43.580642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:43.580719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:43.580810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:43.580860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:43.580869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:43.580945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:43.581021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:43.581097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:43.581175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:43.581225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:43.581234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:43.581302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:43.581386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:43.581453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:43.581519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:43.581563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:43.581569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:43.581643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:43.581709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:43.581777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:43.581845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:43.581899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:43.581907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:43.581979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:43.582045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:43.582111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:43.582178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:43.582224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:43.582231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:43.582298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:43.582363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:43.585483Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 83 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602790757996094:2572]
2025-10-10T14:39:43.585515Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:43.585553Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:39:43.582434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:43.582509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:43.582554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:43.582557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:43.582632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:43.582737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:43.582804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:43.582870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:43.582918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:43.582921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:43.582999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:43.583056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:43.583114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:43.583173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:43.583214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:43.583217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:43.583283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602790757996094:2572], now have 1 active actors on pipe
2025-10-10T14:39:43.584536Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:43.586011Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|271fea3-7b5a72c4-1cc1f5ff-fd7f0767_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:39:43.586023Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|271fea3-7b5a72c4-1cc1f5ff-fd7f0767_0] Write session will restart in 0.007156s
2025-10-10T14:39:43.586050Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|271fea3-7b5a72c4-1cc1f5ff-fd7f0767_0] Write session: Do CDS request
2025-10-10T14:39:43.586056Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|271fea3-7b5a72c4-1cc1f5ff-fd7f0767_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:43.585598Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3085 reason: status is not ok: tablet will be restarted right now sessionId: src_id|271fea3-7b5a72c4-1cc1f5ff-fd7f0767_0
2025-10-10T14:39:43.586025Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3085 sessionId: src_id|271fea3-7b5a72c4-1cc1f5ff-fd7f0767_0 is DEAD
2025-10-10T14:39:43.594952Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|271fea3-7b5a72c4-1cc1f5ff-fd7f0767_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:43.595023Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:43.595054Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3086
2025-10-10T14:39:43.595192Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3086 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:43.595239Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3086 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:43.595249Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3086 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:43.595254Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:43.595686Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3086 sessionId:  describe result for acl check
2025-10-10T14:39:43.595725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:43.595730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:43.595732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:43.595740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602790757996209:4849] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:43.596323Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602790757996209:4849] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:43.599181Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602790757996209:4849] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:43.601986Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602790757996209:4849] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:43.602002Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602790757996209:4849] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:43.602006Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602790757996209:4849] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:43.602015Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3086 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:43.602720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:43.607196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:43.607449Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:43.607471Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:43.607484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:43.607559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:43.607604Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602789975751485:6206]
2025-10-10T14:39:43.608246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:43.608633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:43.608712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:43.609537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:43.609639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:43.609646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:43.609648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:43.609649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:43.609651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:43.609652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:43.609654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:43.609655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:43.609657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:43.609658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:43.609660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:43.609661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:43.609663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:43.609670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:43.609685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:43.609690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:43.609695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:43.609699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:43.609704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:43.609708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:43.609712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:43.609716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:43.609721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:43.609726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:43.609730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:43.609734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:43.609745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:43.609755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:43.609762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:43.609768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:43.609773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:43.609782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:43.609786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:43.609792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:43.609802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:43.609809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:43.609818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:43.609824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:43.609829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:43.609834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:43.609844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:43.609850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:43.609854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:43.609860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:43.609870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:43.609875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:43.609880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:43.609885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:43.609894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:43.609900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:43.609909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:43.609915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:43.609960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:43.615961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:43.616290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:43.616305Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:43.616308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:43.616312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:43.616320Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3085 [2:7559602789975751485:6206]
2025-10-10T14:39:43.616337Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:43.616358Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:43.616364Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:43.616368Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:43.616371Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:43.616390Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:43.616398Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:43.616407Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:43.616491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:43.616502Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:43.616504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:43.616520Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:43.616599Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:43.616602Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:43.616629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:43.616643Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:43.616663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:43.616688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602790757996348:4849], now have 1 active actors on pipe
2025-10-10T14:39:43.616692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602790757996114:2438], now have 1 active actors on pipe
2025-10-10T14:39:43.616701Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602789975751480:6206]
2025-10-10T14:39:43.616704Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602789975751480:6206]
2025-10-10T14:39:43.616707Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602789975751480:6206]
2025-10-10T14:39:43.616722Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:43.616737Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:43.616774Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:43.616784Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:43.616824Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602789975751480:6206]
2025-10-10T14:39:43.616832Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:43.616892Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:43.616901Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:43.616903Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:43.616912Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:43.617088Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3085
2025-10-10T14:39:43.617127Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3085
2025-10-10T14:39:43.617179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:43.617194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:43.617243Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a111f63e-84ea4f68-7ab3f443-cdd243d2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:43.617259Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:43.617271Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:43.617274Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:43.617288Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:43.617314Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:43.617351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:43.617573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:43.617591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:43.617610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:43.617722Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3086 partition: 0 MaxSeqNo: 40 sessionId: src_id|a111f63e-84ea4f68-7ab3f443-cdd243d2_0
2025-10-10T14:39:43.618329Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|271fea3-7b5a72c4-1cc1f5ff-fd7f0767_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|a111f63e-84ea4f68-7ab3f443-cdd243d2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:43.621327Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a111f63e-84ea4f68-7ab3f443-cdd243d2_0] Write session: try to update token
2025-10-10T14:39:43.621755Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a111f63e-84ea4f68-7ab3f443-cdd243d2_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:43.630517Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:39:43.630537Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:43.630549Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602789975751480:6206]
2025-10-10T14:39:43.630605Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:39:43.630800Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:39:43.630945Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:43.631088Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:43.631233Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:43.631434Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:39:43.631476Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:39:43.631570Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:39:43.645041Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3086 sessionId: src_id|a111f63e-84ea4f68-7ab3f443-cdd243d2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:43.647827Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:43.648058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:43.648088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:43.648129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:39:43.648276Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:39:43.651591Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:43.651612Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:43.651616Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:43.651618Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:43.651628Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602789975751480:6206]
2025-10-10T14:39:43.651633Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602789975751480:6206]
2025-10-10T14:39:43.651637Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602789975751480:6206]
2025-10-10T14:39:43.651687Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:43.651696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:43.651699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:43.651851Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:43.654975Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:43.654997Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:43.655004Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:43.685861Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602790757996361:2572]
2025-10-10T14:39:43.686369Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 pipe creation result: OK TabletId: 72075186224037892 Generation: 3085, pipe: [1:7559602790757996361:2572]
2025-10-10T14:39:43.772240Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:43.781096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:43.781131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:43.781326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:43.781462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:43.784720Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 84 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602790757996361:2572]
2025-10-10T14:39:43.784742Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:43.784762Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:43.784773Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:43.784808Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3086 reason: error at write: Disconnected sessionId: src_id|a111f63e-84ea4f68-7ab3f443-cdd243d2_0
2025-10-10T14:39:43.785039Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3086 sessionId: src_id|a111f63e-84ea4f68-7ab3f443-cdd243d2_0 is DEAD
2025-10-10T14:39:43.785200Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a111f63e-84ea4f68-7ab3f443-cdd243d2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:43.785212Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a111f63e-84ea4f68-7ab3f443-cdd243d2_0] Write session will restart in 0.009934s
2025-10-10T14:39:43.785261Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a111f63e-84ea4f68-7ab3f443-cdd243d2_0] Write session: Do CDS request
2025-10-10T14:39:43.785268Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a111f63e-84ea4f68-7ab3f443-cdd243d2_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:43.781531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:43.781603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:43.781651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:43.781656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:43.781727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:43.781787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:43.781850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:43.781914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:43.781956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:43.781959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:43.782031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:43.782088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:43.782153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:43.782214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:43.782255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:43.782258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:43.782329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:43.782389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:43.782464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:43.782528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:43.782570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:43.782573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:43.782643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:43.782700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:43.782759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:43.782820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:43.782867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:43.782870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:43.782959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:43.783031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:43.783091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:43.783155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:43.783194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:43.783200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:43.783266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:43.783321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:43.783382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:43.783441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:43.783485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:43.783488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:43.783558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:43.783612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:43.783677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:43.783743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:43.783782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:43.783785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:43.783855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:43.783915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:43.783976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:43.784040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:43.784083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:43.784087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:43.784156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:43.784217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:43.784279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:43.784346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:43.784390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:43.784394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:43.784466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602790757996361:2572], now have 1 active actors on pipe
2025-10-10T14:39:43.786276Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:43.796947Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a111f63e-84ea4f68-7ab3f443-cdd243d2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:43.797127Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:43.797144Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3087
2025-10-10T14:39:43.797317Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3087 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:43.797379Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3087 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:43.797389Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3087 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:43.797403Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:43.797903Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3087 sessionId:  describe result for acl check
2025-10-10T14:39:43.797941Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:43.797943Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:43.797946Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:43.797951Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602790757996467:4841] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:43.798498Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602790757996467:4841] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:43.800953Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602790757996467:4841] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:43.804548Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602790757996467:4841] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:43.804568Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602790757996467:4841] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:43.804572Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602790757996467:4841] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:43.804582Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3087 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:43.811499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:43.816415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:43.816679Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:43.816691Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:43.816704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:43.816773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:43.816818Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602789975751676:6198]
2025-10-10T14:39:43.817435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:43.817772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:43.817820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:43.818152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:43.818216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:43.818223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:43.818224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:43.818225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:43.818227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:43.818229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:43.818230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:43.818232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:43.818233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:43.818235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:43.818236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:43.818238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:43.818239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:43.818245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:43.818259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:43.818263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:43.818268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:43.818271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:43.818276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:43.818280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:43.818284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:43.818287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:43.818292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:43.818295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:43.818322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:43.818326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:43.818335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:43.818343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:43.818353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:43.818358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:43.818361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:43.818366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:43.818374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:43.818379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:43.818383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:43.818393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:43.818396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:43.818401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:43.818405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:43.818410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:43.818414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:43.818420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:43.818425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:43.818429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:43.818432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:43.818437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:43.818440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:43.818445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:43.818448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:43.818452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:43.818456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:43.818460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:43.818495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:43.822377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:43.822700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:43.822714Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:43.822716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:43.822720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:43.822727Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3086 [2:7559602789975751676:6198]
2025-10-10T14:39:43.822742Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:43.822763Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:43.822766Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:43.822770Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:43.822772Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:43.822808Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:43.822821Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:43.822830Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:43.822896Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:43.822904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:43.822906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:43.822909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:43.822991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:43.822999Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:43.823010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:43.823021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:43.823041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:43.823068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602790757996365:2438], now have 1 active actors on pipe
2025-10-10T14:39:43.823076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602790757996568:4841], now have 1 active actors on pipe
2025-10-10T14:39:43.823085Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602789975751671:6198]
2025-10-10T14:39:43.823092Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602789975751671:6198]
2025-10-10T14:39:43.823095Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602789975751671:6198]
2025-10-10T14:39:43.823108Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:43.823124Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:43.823129Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:43.823133Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:43.823136Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:43.823144Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:43.823148Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:43.823180Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602789975751671:6198]
2025-10-10T14:39:43.823187Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:43.823199Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:43.823215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:43.823221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:43.823147Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3086
2025-10-10T14:39:43.823200Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3086
2025-10-10T14:39:43.823259Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|57a79570-91eaa1b4-82cd7e93-567fbee8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:43.823271Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:43.823276Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:43.823278Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:43.823291Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:43.823305Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:43.823328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:43.823634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:43.823641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:43.823656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:43.823796Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3087 partition: 0 MaxSeqNo: 40 sessionId: src_id|57a79570-91eaa1b4-82cd7e93-567fbee8_0
2025-10-10T14:39:43.824245Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a111f63e-84ea4f68-7ab3f443-cdd243d2_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|57a79570-91eaa1b4-82cd7e93-567fbee8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:43.826994Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|57a79570-91eaa1b4-82cd7e93-567fbee8_0] Write session: try to update token
2025-10-10T14:39:43.827015Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|57a79570-91eaa1b4-82cd7e93-567fbee8_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:43.843840Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3087 sessionId: src_id|57a79570-91eaa1b4-82cd7e93-567fbee8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:43.846618Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:43.844903Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:43.844925Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:43.844929Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:43.844931Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:43.844941Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602789975751671:6198]
2025-10-10T14:39:43.844946Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602789975751671:6198]
2025-10-10T14:39:43.844950Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602789975751671:6198]
2025-10-10T14:39:43.845011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:43.845020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:43.845022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:43.845177Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:43.845200Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:43.845208Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:43.845215Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:43.883987Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602790757996626:2572]
2025-10-10T14:39:43.884307Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 pipe creation result: OK TabletId: 72075186224037892 Generation: 3086, pipe: [1:7559602790757996626:2572]
2025-10-10T14:39:43.967251Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:43.968258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:43.968278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:43.968329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602790757996626:2572], now have 1 active actors on pipe
2025-10-10T14:39:43.968581Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 85 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602790757996626:2572]
2025-10-10T14:39:43.968590Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:43.968624Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:43.968627Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:43.968741Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3087 reason: error at write: Disconnected sessionId: src_id|57a79570-91eaa1b4-82cd7e93-567fbee8_0
2025-10-10T14:39:43.968808Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:43.969033Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3087 sessionId: src_id|57a79570-91eaa1b4-82cd7e93-567fbee8_0 is DEAD
2025-10-10T14:39:43.969125Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|57a79570-91eaa1b4-82cd7e93-567fbee8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:43.969136Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|57a79570-91eaa1b4-82cd7e93-567fbee8_0] Write session will restart in 0.008474s
2025-10-10T14:39:43.969163Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|57a79570-91eaa1b4-82cd7e93-567fbee8_0] Write session: Do CDS request
2025-10-10T14:39:43.969173Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|57a79570-91eaa1b4-82cd7e93-567fbee8_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:43.978986Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|57a79570-91eaa1b4-82cd7e93-567fbee8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:43.979112Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:43.979131Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3088
2025-10-10T14:39:43.979296Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3088 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:43.979332Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3088 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:43.979343Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3088 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:43.979347Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:43.979982Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3088 sessionId:  describe result for acl check
2025-10-10T14:39:43.980022Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:43.980024Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:43.980027Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:43.980034Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602790757996691:4825] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:43.980631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602790757996691:4825] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:43.983081Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602790757996691:4825] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:43.986095Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602790757996691:4825] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:43.986109Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602790757996691:4825] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:43.986113Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602790757996691:4825] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:43.986122Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3088 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:43.991723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:43.992341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:43.992787Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:43.992803Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:43.992814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:43.992875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:43.992921Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602789975751855:6193]
2025-10-10T14:39:43.993618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:43.993986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:43.994032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:43.994388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:43.994443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:43.994449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:43.994451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:43.994452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:43.994453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:43.994454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:43.994456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:43.994457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:43.994459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:43.994460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:43.994461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:43.994463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:43.994464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:43.994471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:43.994485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:43.994490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:43.994494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:43.994499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:43.994503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:43.994508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:43.994512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:43.994517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:43.994522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:43.994526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:43.994530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:43.994534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:43.994542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:43.994550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:43.994557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:43.994564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:43.994569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:43.994578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:43.994584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:43.994591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:43.994597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:43.994602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:43.994607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:43.994613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:43.994618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:43.994631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:43.994636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:43.994644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:43.994653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:43.994660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:43.994670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:43.994676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:43.994681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:43.994686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:43.994691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:43.994697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:43.994702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:43.994708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:43.994753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:43.997748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:43.998045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:43.998056Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:43.998059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:43.998063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:43.998070Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3087 [2:7559602789975751855:6193]
2025-10-10T14:39:43.998083Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:43.998100Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:43.998107Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:43.998110Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:43.998112Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:43.998129Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:43.998140Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:43.998149Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:43.998212Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:43.998222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:43.998224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:43.998226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:43.998294Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:43.998303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:43.998314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:43.998327Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:43.998349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:43.998371Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602789975751850:6193]
2025-10-10T14:39:43.998378Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602789975751850:6193]
2025-10-10T14:39:43.998381Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602789975751850:6193]
2025-10-10T14:39:43.998390Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:43.998402Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:43.998404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602790757996634:2438], now have 1 active actors on pipe
2025-10-10T14:39:43.998406Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:43.998408Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:43.998408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602790757996861:4825], now have 1 active actors on pipe
2025-10-10T14:39:43.998417Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:43.998437Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:43.998445Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:43.998472Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3087
2025-10-10T14:39:43.998500Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3087
2025-10-10T14:39:43.998470Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602789975751850:6193]
2025-10-10T14:39:43.998485Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:43.998486Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:43.998541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:43.998549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:43.998578Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f0e91862-3bc2737-9a15601e-48c050ce_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:43.998592Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:43.998596Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:43.998599Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:43.998611Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:43.998626Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:43.998638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:43.998821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:43.998831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:43.998848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:43.998944Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3088 partition: 0 MaxSeqNo: 40 sessionId: src_id|f0e91862-3bc2737-9a15601e-48c050ce_0
2025-10-10T14:39:43.999401Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|57a79570-91eaa1b4-82cd7e93-567fbee8_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|f0e91862-3bc2737-9a15601e-48c050ce_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:44.002138Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f0e91862-3bc2737-9a15601e-48c050ce_0] Write session: try to update token
2025-10-10T14:39:44.002160Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f0e91862-3bc2737-9a15601e-48c050ce_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:44.017760Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3088 sessionId: src_id|f0e91862-3bc2737-9a15601e-48c050ce_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:44.019419Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:44.019445Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:44.019448Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:44.019450Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:44.019459Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602789975751850:6193]
2025-10-10T14:39:44.019466Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602789975751850:6193]
2025-10-10T14:39:44.019470Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602789975751850:6193]
2025-10-10T14:39:44.019519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:44.019522Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:44.019529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:44.019530Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:44.019532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:44.019534Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:44.019669Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:44.020601Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:44.068830Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602795052964170:2572]
2025-10-10T14:39:44.069154Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 pipe creation result: OK TabletId: 72075186224037892 Generation: 3087, pipe: [1:7559602795052964170:2572]
2025-10-10T14:39:44.146013Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:44.146654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:44.146669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:44.146720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602795052964170:2572], now have 1 active actors on pipe
2025-10-10T14:39:44.146961Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:44.147002Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:44.147075Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 86 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602795052964170:2572]
2025-10-10T14:39:44.147098Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:39:44.147210Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3088 reason: status is not ok: tablet will be restarted right now sessionId: src_id|f0e91862-3bc2737-9a15601e-48c050ce_0
2025-10-10T14:39:44.147443Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3088 sessionId: src_id|f0e91862-3bc2737-9a15601e-48c050ce_0 is DEAD
2025-10-10T14:39:44.147737Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f0e91862-3bc2737-9a15601e-48c050ce_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:39:44.147745Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f0e91862-3bc2737-9a15601e-48c050ce_0] Write session will restart in 0.005583s
2025-10-10T14:39:44.147772Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f0e91862-3bc2737-9a15601e-48c050ce_0] Write session: Do CDS request
2025-10-10T14:39:44.147779Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f0e91862-3bc2737-9a15601e-48c050ce_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:44.155014Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f0e91862-3bc2737-9a15601e-48c050ce_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:44.155136Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:44.155152Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3089
2025-10-10T14:39:44.155264Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3089 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:44.155306Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3089 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:44.155312Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3089 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:44.155317Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:44.155762Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3089 sessionId:  describe result for acl check
2025-10-10T14:39:44.155791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:44.155793Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:44.155795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:44.155803Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602795052964188:4812] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:44.156401Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602795052964188:4812] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:44.159031Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602795052964188:4812] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:44.163365Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602795052964188:4812] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:44.163382Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602795052964188:4812] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:44.163386Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602795052964188:4812] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:44.163395Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3089 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:44.169326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:44.173283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:44.173615Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:44.173629Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:44.173642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:44.173707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:44.173755Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602794270719332:6189]
2025-10-10T14:39:44.174391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:44.174770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:44.174836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:44.175191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:44.175273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:44.175280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:44.175282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:44.175283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:44.175285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:44.175286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:44.175287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:44.175288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:44.175290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:44.175291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:44.175293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:44.175294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:44.175296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:44.175302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:44.175317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:44.175322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:44.175326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:44.175331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:44.175335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:44.175340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:44.175344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:44.175348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:44.175353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:44.175357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:44.175361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:44.175369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:44.175380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:44.175390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:44.175398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:44.175404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:44.175414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:44.175419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:44.175423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:44.175430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:44.175435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:44.175441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:44.175458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:44.175468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:44.175474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:44.175485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:44.175489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:44.175495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:44.175505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:44.175511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:44.175516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:44.175524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:44.175529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:44.175545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:44.175555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:44.175561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:44.175571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:44.175576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:44.175623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:44.179835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:44.181049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:44.181066Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:44.181069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:44.181073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:44.181081Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3088 [2:7559602794270719332:6189]
2025-10-10T14:39:44.181097Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:44.181118Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:44.181122Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:44.181125Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:44.181127Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:44.181147Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:44.181166Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:44.181174Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:44.181249Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:44.181257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:44.181259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:44.181262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:44.181360Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:44.181368Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:44.181383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:44.181399Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:44.181419Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:44.181447Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602794270719327:6189]
2025-10-10T14:39:44.181455Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602794270719327:6189]
2025-10-10T14:39:44.181457Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602794270719327:6189]
2025-10-10T14:39:44.181475Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:44.181494Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:44.181509Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:44.181512Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:44.181527Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:44.181530Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:44.181532Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:44.181555Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602794270719327:6189]
2025-10-10T14:39:44.181558Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:44.181606Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:44.181963Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3088
2025-10-10T14:39:44.182023Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3088
2025-10-10T14:39:44.182176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602795052964173:2438], now have 1 active actors on pipe
2025-10-10T14:39:44.182189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602795052964346:4812], now have 1 active actors on pipe
2025-10-10T14:39:44.182215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:44.182235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:44.182272Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1a4bf86a-f420bb45-9b620fef-cc958908_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:44.182283Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:44.182289Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:44.182292Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:44.182310Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:44.182325Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:44.182345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:44.182704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:44.182714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:44.182736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:44.182912Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3089 partition: 0 MaxSeqNo: 40 sessionId: src_id|1a4bf86a-f420bb45-9b620fef-cc958908_0
2025-10-10T14:39:44.183364Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f0e91862-3bc2737-9a15601e-48c050ce_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|1a4bf86a-f420bb45-9b620fef-cc958908_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:44.186510Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1a4bf86a-f420bb45-9b620fef-cc958908_0] Write session: try to update token
2025-10-10T14:39:44.186528Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1a4bf86a-f420bb45-9b620fef-cc958908_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:44.203084Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:39:44.203105Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:44.203118Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602794270719327:6189]
2025-10-10T14:39:44.203171Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:39:44.203351Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:39:44.203494Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:44.203627Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:44.203758Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:44.203944Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:39:44.203980Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:39:44.204415Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:39:44.206738Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3089 sessionId: src_id|1a4bf86a-f420bb45-9b620fef-cc958908_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:44.209509Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:44.209988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:44.210012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:44.210068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:39:44.210149Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:39:44.215208Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:44.215223Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:44.215227Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:44.215230Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:44.215242Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602794270719327:6189]
2025-10-10T14:39:44.215246Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602794270719327:6189]
2025-10-10T14:39:44.215250Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602794270719327:6189]
2025-10-10T14:39:44.215303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:44.215302Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:44.215310Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:44.215315Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:44.215319Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:44.215322Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:44.215455Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:44.247007Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602795052964417:2572]
2025-10-10T14:39:44.247379Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 pipe creation result: OK TabletId: 72075186224037892 Generation: 3088, pipe: [1:7559602795052964417:2572]
2025-10-10T14:39:44.332316Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:44.341676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:44.341707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:44.345193Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 87 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602795052964417:2572]
2025-10-10T14:39:44.345197Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:44.345245Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:44.345248Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:44.345280Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3089 reason: error at write: Disconnected sessionId: src_id|1a4bf86a-f420bb45-9b620fef-cc958908_0
2025-10-10T14:39:44.345537Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3089 sessionId: src_id|1a4bf86a-f420bb45-9b620fef-cc958908_0 is DEAD
2025-10-10T14:39:44.345793Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a4bf86a-f420bb45-9b620fef-cc958908_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:44.345805Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a4bf86a-f420bb45-9b620fef-cc958908_0] Write session will restart in 0.005415s
2025-10-10T14:39:44.345829Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a4bf86a-f420bb45-9b620fef-cc958908_0] Write session: Do CDS request
2025-10-10T14:39:44.345835Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a4bf86a-f420bb45-9b620fef-cc958908_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:44.341886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:44.341952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:44.342014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:44.342075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:44.342114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:44.342119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:44.342191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:44.342250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:44.342325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:44.342382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:44.342421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:44.342424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:44.342489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:44.342543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:44.342606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:44.342664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:44.342701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:44.342704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:44.342769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:44.342827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:44.342906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:44.342971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:44.343013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:44.343016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:44.343081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:44.343143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:44.343203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:44.343265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:44.343305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:44.343308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:44.343375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:44.343433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:44.343491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:44.343554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:44.343592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:44.343595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:44.343663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:44.343719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:44.343781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:44.343840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:44.343892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:44.343895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:44.343963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:44.344019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:44.344073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:44.344131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:44.344168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:44.344171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:44.344237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:44.344293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:44.344354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:44.344414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:44.344472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:44.344475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:44.344551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:44.344608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:44.344666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:44.344723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:44.344777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:44.344780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:44.344865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602795052964417:2572], now have 1 active actors on pipe
2025-10-10T14:39:44.346162Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:44.353472Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1a4bf86a-f420bb45-9b620fef-cc958908_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:44.357522Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:44.357539Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3090
2025-10-10T14:39:44.361469Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3090 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:44.361532Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3090 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:44.361539Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3090 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:44.361544Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:44.362123Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3090 sessionId:  describe result for acl check
2025-10-10T14:39:44.362169Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:44.362184Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:44.362186Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:44.362194Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602795052964436:4829] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:44.362821Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602795052964436:4829] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:44.367188Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602795052964436:4829] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:44.371880Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602795052964436:4829] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:44.371893Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602795052964436:4829] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:44.371897Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602795052964436:4829] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:44.371907Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3090 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:44.385873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:44.387060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:44.387301Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:44.387313Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:44.387328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:44.387388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:44.387438Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602794270719515:6186]
2025-10-10T14:39:44.388088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:44.388590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:44.388683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:44.389058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:44.389170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:44.389177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:44.389179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:44.389180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:44.389181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:44.389182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:44.389183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:44.389185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:44.389186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:44.389188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:44.389189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:44.389190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:44.389192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:44.389199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:44.389213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:44.389217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:44.389220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:44.389224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:44.389227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:44.389231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:44.389236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:44.389240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:44.389245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:44.389250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:44.389255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:44.389259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:44.389270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:44.389280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:44.389287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:44.389294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:44.389305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:44.389325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:44.389347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:44.389353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:44.389359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:44.389370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:44.389375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:44.389381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:44.389390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:44.389397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:44.389407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:44.389413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:44.389423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:44.389429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:44.389435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:44.389441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:44.389457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:44.389462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:44.389467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:44.389473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:44.389478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:44.389484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:44.389529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:44.392621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:44.393037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:44.393051Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:44.393053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:44.393057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:44.393064Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3089 [2:7559602794270719515:6186]
2025-10-10T14:39:44.393079Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:44.393097Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:44.393106Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:44.393110Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:44.393112Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:44.393130Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:44.393138Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:44.393148Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:44.393219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:44.393229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:44.393231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:44.393234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:44.393301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:44.393314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:44.393325Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:44.393353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:44.393369Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:44.393396Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602794270719510:6186]
2025-10-10T14:39:44.393403Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602794270719510:6186]
2025-10-10T14:39:44.393406Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602794270719510:6186]
2025-10-10T14:39:44.393420Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:44.393437Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:44.393457Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:44.393464Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:44.393490Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602794270719510:6186]
2025-10-10T14:39:44.393497Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:44.393599Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:44.393608Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:44.393610Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:44.393617Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:44.393754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602795052964604:4829], now have 1 active actors on pipe
2025-10-10T14:39:44.393769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602795052964420:2438], now have 1 active actors on pipe
2025-10-10T14:39:44.393971Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3089
2025-10-10T14:39:44.393980Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3089
2025-10-10T14:39:44.394275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:44.394288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:44.394323Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a9a33b76-70fd4cd-9aca6662-921f9d3f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:44.394339Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:44.394348Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:44.394351Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:44.394373Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:44.394392Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:44.394413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:44.401691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:44.401726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:44.401767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:44.401917Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3090 partition: 0 MaxSeqNo: 40 sessionId: src_id|a9a33b76-70fd4cd-9aca6662-921f9d3f_0
2025-10-10T14:39:44.402391Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a4bf86a-f420bb45-9b620fef-cc958908_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|a9a33b76-70fd4cd-9aca6662-921f9d3f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:44.405067Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a9a33b76-70fd4cd-9aca6662-921f9d3f_0] Write session: try to update token
2025-10-10T14:39:44.405090Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a9a33b76-70fd4cd-9aca6662-921f9d3f_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:44.415054Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:44.415074Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:44.415078Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:44.415080Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:44.415091Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602794270719510:6186]
2025-10-10T14:39:44.415096Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602794270719510:6186]
2025-10-10T14:39:44.415100Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602794270719510:6186]
2025-10-10T14:39:44.415149Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:44.415151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:44.415159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:44.415162Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:44.415163Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:44.415168Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:44.415307Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:44.421738Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3090 sessionId: src_id|a9a33b76-70fd4cd-9aca6662-921f9d3f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:44.424316Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:44.445134Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602795052964666:2572]
2025-10-10T14:39:44.445828Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 pipe creation result: OK TabletId: 72075186224037892 Generation: 3089, pipe: [1:7559602795052964666:2572]
2025-10-10T14:39:44.537958Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:44.538288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:44.538317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:44.538370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602795052964666:2572], now have 1 active actors on pipe
2025-10-10T14:39:44.538769Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:44.539354Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9a33b76-70fd4cd-9aca6662-921f9d3f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:44.539365Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9a33b76-70fd4cd-9aca6662-921f9d3f_0] Write session will restart in 0.008265s
2025-10-10T14:39:44.539391Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9a33b76-70fd4cd-9aca6662-921f9d3f_0] Write session: Do CDS request
2025-10-10T14:39:44.539398Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9a33b76-70fd4cd-9aca6662-921f9d3f_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:44.538812Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:44.538828Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:44.538904Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3090 reason: error at write: Disconnected sessionId: src_id|a9a33b76-70fd4cd-9aca6662-921f9d3f_0
2025-10-10T14:39:44.539135Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3090 sessionId: src_id|a9a33b76-70fd4cd-9aca6662-921f9d3f_0 is DEAD
2025-10-10T14:39:44.539275Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 88 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602795052964666:2572]
2025-10-10T14:39:44.539291Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:44.548982Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a9a33b76-70fd4cd-9aca6662-921f9d3f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:44.549063Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:44.549084Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3091
2025-10-10T14:39:44.549222Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3091 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:44.549255Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3091 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:44.549261Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3091 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:44.549266Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:44.549713Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3091 sessionId:  describe result for acl check
2025-10-10T14:39:44.549744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:44.549745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:44.549749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:44.549756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602795052964682:4794] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:44.550353Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602795052964682:4794] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:44.553534Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602795052964682:4794] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:44.556698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602795052964682:4794] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:44.556715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602795052964682:4794] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:44.556719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602795052964682:4794] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:44.556728Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3091 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:44.563852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:44.567595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:44.567830Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:44.567844Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:44.567857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:44.567923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:44.567974Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602794270719698:6185]
2025-10-10T14:39:44.568639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:44.569048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:44.569102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:44.569453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:44.569529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:44.569536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:44.569537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:44.569538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:44.569540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:44.569541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:44.569542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:44.569543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:44.569544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:44.569558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:44.569559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:44.569560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:44.569562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:44.569568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:44.569584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:44.569589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:44.569594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:44.569599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:44.569603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:44.569608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:44.569612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:44.569617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:44.569622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:44.569627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:44.569632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:44.569637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:44.569645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:44.569656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:44.569668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:44.569675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:44.569685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:44.569691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:44.569701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:44.569706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:44.569716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:44.569723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:44.569733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:44.569739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:44.569744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:44.569750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:44.569753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:44.569759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:44.569768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:44.569773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:44.569780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:44.569786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:44.569791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:44.569796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:44.569802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:44.569814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:44.569819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:44.569824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:44.569865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:44.572394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:44.574132Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3090
2025-10-10T14:39:44.574167Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3090
2025-10-10T14:39:44.573481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:44.573499Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:44.573502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:44.573506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:44.573513Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3090 [2:7559602794270719698:6185]
2025-10-10T14:39:44.573529Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:44.573547Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:44.573551Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:44.573555Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:44.573557Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:44.573575Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:44.573583Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:44.573590Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:44.573671Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:44.573673Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:44.573675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:44.573678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:44.573751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:44.573753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:44.573766Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:44.573779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:44.573798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:44.573819Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602794270719693:6185]
2025-10-10T14:39:44.573822Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602794270719693:6185]
2025-10-10T14:39:44.573824Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602794270719693:6185]
2025-10-10T14:39:44.573835Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:44.573845Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:44.573850Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:44.573850Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:44.573853Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:44.573866Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:44.573870Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:44.573882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602795052964669:2438], now have 1 active actors on pipe
2025-10-10T14:39:44.573886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602795052964811:4794], now have 1 active actors on pipe
2025-10-10T14:39:44.573930Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602794270719693:6185]
2025-10-10T14:39:44.573940Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:44.574510Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:44.575121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:44.575140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:44.575179Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|573c09a-8667d46c-7076caeb-7bb0618d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:44.575197Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:44.575203Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:44.575206Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:44.575220Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:44.575233Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:44.575256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:44.575497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:44.575506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:44.575527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:44.575815Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3091 partition: 0 MaxSeqNo: 40 sessionId: src_id|573c09a-8667d46c-7076caeb-7bb0618d_0
2025-10-10T14:39:44.576407Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9a33b76-70fd4cd-9aca6662-921f9d3f_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|573c09a-8667d46c-7076caeb-7bb0618d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:44.579092Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|573c09a-8667d46c-7076caeb-7bb0618d_0] Write session: try to update token
2025-10-10T14:39:44.579115Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|573c09a-8667d46c-7076caeb-7bb0618d_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:44.589724Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:39:44.589747Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:44.589760Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602794270719693:6185]
2025-10-10T14:39:44.589809Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:39:44.589811Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:39:44.590037Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:39:44.590205Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:44.590361Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:44.590513Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:44.591127Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:39:44.591174Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:39:44.598809Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3091 sessionId: src_id|573c09a-8667d46c-7076caeb-7bb0618d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:44.601732Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:44.601938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:44.601959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:44.602013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:39:44.602181Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:39:44.610034Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:44.610055Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:44.610059Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:44.610062Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:44.610072Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602794270719693:6185]
2025-10-10T14:39:44.610076Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602794270719693:6185]
2025-10-10T14:39:44.610080Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602794270719693:6185]
2025-10-10T14:39:44.610131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:44.610133Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:44.610140Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:44.610141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:44.610143Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:44.610145Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:44.610291Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:44.639187Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602795052964936:2572]
2025-10-10T14:39:44.640497Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 pipe creation result: OK TabletId: 72075186224037892 Generation: 3090, pipe: [1:7559602795052964936:2572]
2025-10-10T14:39:44.728590Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:44.737462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:44.737495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:44.737680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:44.737754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:44.737824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:44.737887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:44.738237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:44.738250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:44.738318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:44.738380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:44.738446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:44.738514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:44.738561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:44.738564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:44.738635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:44.738690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:44.738749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:44.738806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:44.738845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:44.738851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:44.738914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:44.738976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:44.739036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:44.739096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:44.739137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:44.739140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:44.739209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:44.739266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:44.739327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:44.739385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:44.739427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:44.739430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:44.739501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:44.739561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:44.739622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:44.739691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:44.739736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:44.739740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:44.739812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:44.739872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:44.739939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:44.740005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:44.740057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:44.740059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:44.740135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:44.740193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:44.740254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:44.740318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:44.740361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:44.740364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:44.740435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:44.740494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:44.740558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:44.740625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:44.740677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:44.740681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:44.740810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:44.740870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:44.740935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:44.741000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:44.741050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:44.741053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:44.741114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602795052964936:2572], now have 1 active actors on pipe
2025-10-10T14:39:44.741998Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|573c09a-8667d46c-7076caeb-7bb0618d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:44.742011Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|573c09a-8667d46c-7076caeb-7bb0618d_0] Write session will restart in 0.005356s
2025-10-10T14:39:44.742038Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|573c09a-8667d46c-7076caeb-7bb0618d_0] Write session: Do CDS request
2025-10-10T14:39:44.742045Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|573c09a-8667d46c-7076caeb-7bb0618d_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:44.742098Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:44.741429Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 89 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602795052964936:2572]
2025-10-10T14:39:44.741435Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:44.741473Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:44.741476Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:44.741512Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3091 reason: error at write: Disconnected sessionId: src_id|573c09a-8667d46c-7076caeb-7bb0618d_0
2025-10-10T14:39:44.741755Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3091 sessionId: src_id|573c09a-8667d46c-7076caeb-7bb0618d_0 is DEAD
2025-10-10T14:39:44.748925Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|573c09a-8667d46c-7076caeb-7bb0618d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:44.749045Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:44.749064Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3092
2025-10-10T14:39:44.749189Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3092 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:44.749227Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3092 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:44.749238Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3092 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:44.749243Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:44.749833Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3092 sessionId:  describe result for acl check
2025-10-10T14:39:44.749872Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:44.749879Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:44.749881Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:44.749887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602795052964962:4771] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:44.750437Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602795052964962:4771] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:44.753122Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602795052964962:4771] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:44.758014Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602795052964962:4771] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:44.758035Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602795052964962:4771] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:44.758040Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602795052964962:4771] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:44.758050Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3092 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:44.764931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:44.769403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:44.769691Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:44.769705Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:44.769720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:44.769793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:44.769843Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602794270719932:6159]
2025-10-10T14:39:44.770448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:44.770798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:44.770849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:44.771197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:44.771282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:44.771289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:44.771291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:44.771292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:44.771294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:44.771295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:44.771297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:44.771297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:44.771299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:44.771300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:44.771301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:44.771302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:44.771303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:44.771310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:44.771323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:44.771328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:44.771332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:44.771335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:44.771339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:44.771343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:44.771347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:44.771351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:44.771355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:44.771359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:44.771363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:44.771367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:44.771375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:44.771384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:44.771391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:44.771396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:44.771403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:44.771407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:44.771412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:44.771417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:44.771421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:44.771426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:44.771433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:44.771437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:44.771442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:44.771453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:44.771457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:44.771461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:44.771466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:44.771475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:44.771480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:44.771485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:44.771493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:44.771498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:44.771502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:44.771508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:44.771513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:44.771518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:44.771557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:44.774816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:44.775757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:44.775773Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:44.775779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:44.775784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:44.775792Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3091 [2:7559602794270719932:6159]
2025-10-10T14:39:44.775807Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:44.775835Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:44.775843Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:44.775847Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:44.775849Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:44.775869Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:44.775878Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:44.775888Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:44.775961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:44.775969Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:44.775971Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:44.775974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:44.776049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:44.776058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:44.776073Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:44.776083Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:44.776101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:44.776132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602795052965081:4771], now have 1 active actors on pipe
2025-10-10T14:39:44.776136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602795052964946:2438], now have 1 active actors on pipe
2025-10-10T14:39:44.776143Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602794270719927:6159]
2025-10-10T14:39:44.776145Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602794270719927:6159]
2025-10-10T14:39:44.776147Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602794270719927:6159]
2025-10-10T14:39:44.776164Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:44.776179Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:44.776186Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:44.776191Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:44.776194Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:44.776200Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:44.776204Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:44.776187Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3091
2025-10-10T14:39:44.776244Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602794270719927:6159]
2025-10-10T14:39:44.776257Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:44.776204Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3091
2025-10-10T14:39:44.776263Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:44.776283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:44.776293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:44.776351Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|420f96c2-1d77e0a8-b57351e8-295c10fb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:44.776364Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:44.776368Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:44.776375Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:44.776387Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:44.776399Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:44.776427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:44.776624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:44.776638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:44.776663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:44.776852Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3092 partition: 0 MaxSeqNo: 40 sessionId: src_id|420f96c2-1d77e0a8-b57351e8-295c10fb_0
2025-10-10T14:39:44.777325Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|573c09a-8667d46c-7076caeb-7bb0618d_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|420f96c2-1d77e0a8-b57351e8-295c10fb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:44.780228Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|420f96c2-1d77e0a8-b57351e8-295c10fb_0] Write session: try to update token
2025-10-10T14:39:44.780248Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|420f96c2-1d77e0a8-b57351e8-295c10fb_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:44.801063Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:44.801082Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:44.801085Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:44.801087Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:44.801097Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602794270719927:6159]
2025-10-10T14:39:44.801101Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602794270719927:6159]
2025-10-10T14:39:44.801105Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602794270719927:6159]
2025-10-10T14:39:44.801144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:44.801151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:44.801152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:44.801154Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:44.801162Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:44.801166Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:44.801281Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:44.803828Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3092 sessionId: src_id|420f96c2-1d77e0a8-b57351e8-295c10fb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:44.806749Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:44.841475Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602795052965210:2572]
2025-10-10T14:39:44.841867Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 pipe creation result: OK TabletId: 72075186224037892 Generation: 3091, pipe: [1:7559602795052965210:2572]
2025-10-10T14:39:44.924908Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:44.925748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:44.925766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:44.925813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602795052965210:2572], now have 1 active actors on pipe
2025-10-10T14:39:44.926038Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:44.926040Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:44.926053Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:44.926086Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 90 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602795052965210:2572]
2025-10-10T14:39:44.926109Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3092 reason: error at write: Disconnected sessionId: src_id|420f96c2-1d77e0a8-b57351e8-295c10fb_0
2025-10-10T14:39:44.926360Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3092 sessionId: src_id|420f96c2-1d77e0a8-b57351e8-295c10fb_0 is DEAD
2025-10-10T14:39:44.926523Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|420f96c2-1d77e0a8-b57351e8-295c10fb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:44.926536Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|420f96c2-1d77e0a8-b57351e8-295c10fb_0] Write session will restart in 0.005609s
2025-10-10T14:39:44.926562Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|420f96c2-1d77e0a8-b57351e8-295c10fb_0] Write session: Do CDS request
2025-10-10T14:39:44.926568Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|420f96c2-1d77e0a8-b57351e8-295c10fb_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:44.926041Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:44.933952Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|420f96c2-1d77e0a8-b57351e8-295c10fb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:44.934051Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:44.934067Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3093
2025-10-10T14:39:44.934203Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3093 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:44.934251Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3093 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:44.934275Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3093 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:44.934286Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:44.934821Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3093 sessionId:  describe result for acl check
2025-10-10T14:39:44.934865Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:44.934872Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:44.934875Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:44.934882Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602795052965251:4760] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:44.935488Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602795052965251:4760] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:44.937822Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602795052965251:4760] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:44.941515Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602795052965251:4760] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:44.941530Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602795052965251:4760] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:44.941534Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602795052965251:4760] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:44.941543Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3093 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:44.944896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:44.949290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:44.949571Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:44.949587Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:44.949600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:44.949666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:44.949721Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602794270720117:6145]
2025-10-10T14:39:44.950497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:44.951933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:44.951995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:44.952425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:44.952503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:44.952514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:44.952515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:44.952516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:44.952517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:44.952519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:44.952520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:44.952521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:44.952523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:44.952524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:44.952525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:44.952526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:44.952527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:44.952534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:44.952547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:44.952551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:44.952556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:44.952560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:44.952565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:44.952569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:44.952573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:44.952576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:44.952580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:44.952584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:44.952588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:44.952591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:44.952601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:44.952611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:44.952617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:44.952621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:44.952628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:44.952633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:44.952637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:44.952643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:44.952648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:44.952652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:44.952657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:44.952661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:44.952667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:44.952671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:44.952675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:44.952682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:44.952687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:44.952692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:44.952696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:44.952700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:44.952705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:44.952710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:44.952715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:44.952720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:44.952725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:44.952746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:44.952801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:44.955427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:44.955785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:44.955800Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:44.955803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:44.955807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:44.955814Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3092 [2:7559602794270720117:6145]
2025-10-10T14:39:44.955828Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:44.955848Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:44.955851Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:44.955855Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:44.955857Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:44.955876Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:44.955883Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:44.955892Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:44.955952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:44.955962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:44.955965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:44.955968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:44.956042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:44.956053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:44.956064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:44.956074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:44.956088Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:44.956112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602795052965451:4760], now have 1 active actors on pipe
2025-10-10T14:39:44.956121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602795052965218:2438], now have 1 active actors on pipe
2025-10-10T14:39:44.956130Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602794270720111:6145]
2025-10-10T14:39:44.956132Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602794270720111:6145]
2025-10-10T14:39:44.956135Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602794270720111:6145]
2025-10-10T14:39:44.956149Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:44.956164Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:44.956171Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:44.956175Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:44.956178Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:44.956183Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:44.956187Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:44.956213Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602794270720111:6145]
2025-10-10T14:39:44.956225Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:44.956204Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3092
2025-10-10T14:39:44.956204Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3092
2025-10-10T14:39:44.956248Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:44.956387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:44.956399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:44.956433Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ef0c7556-a0c0549b-633bcd26-e8444c27_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:44.956448Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:44.956452Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:44.956455Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:44.956478Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:44.956496Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:44.956511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:44.956681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:44.956689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:44.956705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:44.956833Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3093 partition: 0 MaxSeqNo: 40 sessionId: src_id|ef0c7556-a0c0549b-633bcd26-e8444c27_0
2025-10-10T14:39:44.957295Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|420f96c2-1d77e0a8-b57351e8-295c10fb_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|ef0c7556-a0c0549b-633bcd26-e8444c27_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:44.959904Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ef0c7556-a0c0549b-633bcd26-e8444c27_0] Write session: try to update token
2025-10-10T14:39:44.959922Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ef0c7556-a0c0549b-633bcd26-e8444c27_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:44.970544Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:39:44.970564Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:44.970576Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602794270720111:6145]
2025-10-10T14:39:44.970629Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:39:44.970630Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:39:44.971353Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:39:44.971931Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:44.972505Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:44.972683Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:44.972920Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:39:44.972979Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:39:44.975919Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3093 sessionId: src_id|ef0c7556-a0c0549b-633bcd26-e8444c27_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:44.978978Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:44.979185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:44.979209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:44.979270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:39:44.979401Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:39:44.989266Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:44.989286Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:44.989289Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:44.989291Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:44.989301Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602794270720111:6145]
2025-10-10T14:39:44.989305Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602794270720111:6145]
2025-10-10T14:39:44.989309Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602794270720111:6145]
2025-10-10T14:39:44.989373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:44.989376Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:44.989382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:44.989383Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:44.989385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:44.989387Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:44.989520Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:45.026264Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602799347932762:2572]
2025-10-10T14:39:45.029635Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 pipe creation result: OK TabletId: 72075186224037892 Generation: 3092, pipe: [1:7559602799347932762:2572]
2025-10-10T14:39:45.108325Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:45.117793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:45.117826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:45.118019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:45.118093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:45.118165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:45.118232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:45.118289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:45.118304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:45.118381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:45.118480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:45.118548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:45.118617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:45.118664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:45.118668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:45.118740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:45.118823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:45.118888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:45.118954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:45.119003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:45.119011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:45.119081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:45.119152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:45.119222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:45.119288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:45.119333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:45.119341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:45.119407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:45.119467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:45.119538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:45.119604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:45.119651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:45.119658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:45.119730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:45.119794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:45.119856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:45.119926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:45.119972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:45.119980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:45.120054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:45.120125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:45.120191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:45.120263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:45.120310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:45.120318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:45.120387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:45.120452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:45.120517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:45.120584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:45.120630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:45.120637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:45.120709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:45.120791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:45.120861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:45.120928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:45.120975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:45.120981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:45.121051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:45.121118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:45.121186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:45.121265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:45.121309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:45.121317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:45.121418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602799347932762:2572], now have 1 active actors on pipe
2025-10-10T14:39:45.121653Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 91 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602799347932762:2572]
2025-10-10T14:39:45.121699Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:45.121704Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:45.121735Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3093 reason: error at write: Disconnected sessionId: src_id|ef0c7556-a0c0549b-633bcd26-e8444c27_0
2025-10-10T14:39:45.122026Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3093 sessionId: src_id|ef0c7556-a0c0549b-633bcd26-e8444c27_0 is DEAD
2025-10-10T14:39:45.122223Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:45.122654Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:45.125588Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef0c7556-a0c0549b-633bcd26-e8444c27_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:45.125599Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef0c7556-a0c0549b-633bcd26-e8444c27_0] Write session will restart in 0.006531s
2025-10-10T14:39:45.125642Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef0c7556-a0c0549b-633bcd26-e8444c27_0] Write session: Do CDS request
2025-10-10T14:39:45.125648Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef0c7556-a0c0549b-633bcd26-e8444c27_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:45.137843Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ef0c7556-a0c0549b-633bcd26-e8444c27_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:45.138074Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:45.138093Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3094
2025-10-10T14:39:45.138267Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3094 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:45.138320Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3094 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:45.138330Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3094 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:45.138335Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:45.138909Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3094 sessionId:  describe result for acl check
2025-10-10T14:39:45.138952Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:45.138954Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:45.138956Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:45.138963Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602799347932856:4748] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:45.139535Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602799347932856:4748] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:45.142583Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602799347932856:4748] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:45.145409Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602799347932856:4748] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:45.145425Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602799347932856:4748] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:45.145429Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602799347932856:4748] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:45.145438Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3094 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:45.149230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:45.153556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:45.153819Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:45.153826Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:45.153840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:45.153907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:45.153963Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602798565687598:6155]
2025-10-10T14:39:45.154563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:45.155019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:45.155063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:45.155352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:45.155402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:45.155412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:45.155413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:45.155415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:45.155416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:45.155417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:45.155418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:45.155419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:45.155420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:45.155422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:45.155424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:45.155425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:45.155426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:45.155432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:45.155444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:45.155448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:45.155451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:45.155455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:45.155459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:45.155462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:45.155466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:45.155469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:45.155473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:45.155477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:45.155480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:45.155483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:45.155492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:45.155499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:45.155506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:45.155511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:45.155518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:45.155523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:45.155526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:45.155531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:45.155535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:45.155539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:45.155544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:45.155549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:45.155553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:45.155558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:45.155561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:45.155565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:45.155570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:45.155574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:45.155578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:45.155583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:45.155586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:45.155591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:45.155594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:45.155598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:45.155602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:45.155606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:45.155640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:45.158394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:45.159144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:45.159160Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:45.159162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:45.159167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:45.159174Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3093 [2:7559602798565687598:6155]
2025-10-10T14:39:45.159198Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:45.159216Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:45.159225Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:45.159228Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:45.159231Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:45.159249Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:45.159262Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:45.159270Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:45.159342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:45.159350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:45.159353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:45.159355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:45.159423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:45.159430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:45.159440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:45.159455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:45.159562Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3093
2025-10-10T14:39:45.159474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:45.159622Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3093
2025-10-10T14:39:45.159500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602799347932765:2438], now have 1 active actors on pipe
2025-10-10T14:39:45.159508Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602798565687593:6155]
2025-10-10T14:39:45.159510Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602798565687593:6155]
2025-10-10T14:39:45.159512Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602798565687593:6155]
2025-10-10T14:39:45.159525Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:45.159535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602799347932998:4748], now have 1 active actors on pipe
2025-10-10T14:39:45.159539Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:45.159542Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:45.159544Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:45.159544Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:45.159561Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:45.159564Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:45.159603Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602798565687593:6155]
2025-10-10T14:39:45.159610Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:45.159617Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:45.159652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:45.159656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:45.159689Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3099517b-392ca509-3a324efe-64c6d036_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:45.159697Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:45.159701Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:45.159704Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:45.159716Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:45.159733Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:45.159751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:45.159991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:45.160000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:45.160142Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3094 partition: 0 MaxSeqNo: 40 sessionId: src_id|3099517b-392ca509-3a324efe-64c6d036_0
2025-10-10T14:39:45.160017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:45.160660Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef0c7556-a0c0549b-633bcd26-e8444c27_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|3099517b-392ca509-3a324efe-64c6d036_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:45.163526Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3099517b-392ca509-3a324efe-64c6d036_0] Write session: try to update token
2025-10-10T14:39:45.163546Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3099517b-392ca509-3a324efe-64c6d036_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:45.172042Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:39:45.172059Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:45.172073Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602798565687593:6155]
2025-10-10T14:39:45.172119Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:39:45.172126Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:39:45.172311Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:39:45.172476Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:45.172625Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:45.172781Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:45.172977Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:39:45.173021Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:39:45.180030Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3094 sessionId: src_id|3099517b-392ca509-3a324efe-64c6d036_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:45.182952Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:45.183243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:45.183271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:45.183325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:39:45.183454Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:39:45.191836Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:45.191856Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:45.191861Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:45.191864Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:45.191876Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602798565687593:6155]
2025-10-10T14:39:45.191891Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602798565687593:6155]
2025-10-10T14:39:45.191896Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602798565687593:6155]
2025-10-10T14:39:45.191953Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:45.191963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:45.191965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:45.192244Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:45.192276Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:45.192284Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:45.192289Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:45.221829Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602799347933018:2572]
2025-10-10T14:39:45.222245Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 pipe creation result: OK TabletId: 72075186224037892 Generation: 3093, pipe: [1:7559602799347933018:2572]
2025-10-10T14:39:45.309563Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:45.319448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:45.319476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:45.319692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:45.319767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:45.319848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:45.319932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:45.319988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:45.319999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:45.320085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:45.320161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:45.320233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:45.320314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:45.320368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:45.320371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:45.320455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:45.320519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:45.320586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:45.320652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:45.320693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:45.320696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:45.320783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:45.320851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:45.320918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:45.320986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:45.321029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:45.321032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:45.321122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:45.321202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:45.321286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:45.321495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:45.321552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:45.321560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:45.321632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:45.321695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:45.321764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:45.321844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:45.321898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:45.321905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:45.321980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:45.322042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:45.322115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:45.322184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:45.322234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:45.322243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:45.324063Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:45.324092Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:45.324130Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3094 reason: error at write: Disconnected sessionId: src_id|3099517b-392ca509-3a324efe-64c6d036_0
2025-10-10T14:39:45.324393Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 92 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602799347933018:2572]
2025-10-10T14:39:45.324423Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:45.324424Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3094 sessionId: src_id|3099517b-392ca509-3a324efe-64c6d036_0 is DEAD
2025-10-10T14:39:45.322330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:45.322442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:45.322558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:45.322687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:45.322754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:45.322759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:45.322899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:45.323020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:45.323092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:45.323172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:45.323226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:45.323229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:45.323309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:45.323377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:45.323448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:45.323564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:45.323617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:45.323620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:45.323703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602799347933018:2572], now have 1 active actors on pipe
2025-10-10T14:39:45.325485Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:45.326483Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3099517b-392ca509-3a324efe-64c6d036_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:45.326496Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3099517b-392ca509-3a324efe-64c6d036_0] Write session will restart in 0.005704s
2025-10-10T14:39:45.326523Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3099517b-392ca509-3a324efe-64c6d036_0] Write session: Do CDS request
2025-10-10T14:39:45.326529Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3099517b-392ca509-3a324efe-64c6d036_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:45.335882Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3099517b-392ca509-3a324efe-64c6d036_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:45.335962Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:45.335987Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3095
2025-10-10T14:39:45.336168Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3095 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:45.336222Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3095 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:45.336228Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3095 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:45.336232Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:45.337965Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3095 sessionId:  describe result for acl check
2025-10-10T14:39:45.338007Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:45.338010Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:45.338012Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:45.338019Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602799347933035:4738] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:45.338626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602799347933035:4738] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:45.344765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602799347933035:4738] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:45.354146Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602799347933035:4738] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:45.354171Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602799347933035:4738] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:45.354185Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602799347933035:4738] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:45.354195Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3095 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:45.361659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:45.367092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:45.367352Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:45.367366Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:45.367378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:45.367451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:45.367501Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602798565687787:6153]
2025-10-10T14:39:45.368192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:45.368547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:45.368595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:45.368940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:45.368998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:45.369006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:45.369007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:45.369008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:45.369009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:45.369010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:45.369011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:45.369012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:45.369013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:45.369014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:45.369015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:45.369016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:45.369017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:45.369020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:45.369029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:45.369032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:45.369035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:45.369037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:45.369039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:45.369042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:45.369044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:45.369047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:45.369049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:45.369052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:45.369054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:45.369056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:45.369062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:45.369067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:45.369073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:45.369077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:45.369080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:45.369085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:45.369090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:45.369096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:45.369102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:45.369107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:45.369112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:45.369119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:45.369125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:45.369132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:45.369141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:45.369147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:45.369153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:45.369158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:45.369162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:45.369170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:45.369179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:45.369185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:45.369190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:45.369195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:45.369199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:45.369205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:45.369244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:45.371901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:45.373239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:45.373256Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:45.373258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:45.373262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:45.373268Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3094 [2:7559602798565687787:6153]
2025-10-10T14:39:45.373277Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:45.373293Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:45.373297Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:45.373300Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:45.373304Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:45.373321Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:45.373351Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:45.373366Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:45.373431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:45.373438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:45.373440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:45.373442Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:45.373506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:45.373516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:45.373529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:45.373548Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:45.373570Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:45.373591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602799347933021:2438], now have 1 active actors on pipe
2025-10-10T14:39:45.373603Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602798565687782:6153]
2025-10-10T14:39:45.373605Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602798565687782:6153]
2025-10-10T14:39:45.373607Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602798565687782:6153]
2025-10-10T14:39:45.373620Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:45.373629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602799347933181:4738], now have 1 active actors on pipe
2025-10-10T14:39:45.373641Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:45.373644Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:45.373645Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:45.373647Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:45.373658Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:45.373661Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:45.373689Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602798565687782:6153]
2025-10-10T14:39:45.373701Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:45.373707Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:45.373737Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3094
2025-10-10T14:39:45.373791Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3094
2025-10-10T14:39:45.373941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:45.373956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:45.373977Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7ce59b0d-c4eef312-4e5dfbe9-f52be962_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:45.373983Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:45.373986Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:45.373988Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:45.373997Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:45.374018Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:45.374030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:45.374202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:45.374215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:45.374229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:45.374340Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3095 partition: 0 MaxSeqNo: 40 sessionId: src_id|7ce59b0d-c4eef312-4e5dfbe9-f52be962_0
2025-10-10T14:39:45.374873Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3099517b-392ca509-3a324efe-64c6d036_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|7ce59b0d-c4eef312-4e5dfbe9-f52be962_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:45.377643Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7ce59b0d-c4eef312-4e5dfbe9-f52be962_0] Write session: try to update token
2025-10-10T14:39:45.377662Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7ce59b0d-c4eef312-4e5dfbe9-f52be962_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:45.395039Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:45.395066Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:45.395070Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:45.395073Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:45.395097Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602798565687782:6153]
2025-10-10T14:39:45.395103Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602798565687782:6153]
2025-10-10T14:39:45.395109Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602798565687782:6153]
2025-10-10T14:39:45.395169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:45.395176Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:45.395182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:45.395185Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:45.395186Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:45.395191Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:45.395367Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:45.396920Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3095 sessionId: src_id|7ce59b0d-c4eef312-4e5dfbe9-f52be962_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:45.399881Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:45.424544Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602799347933271:2572]
2025-10-10T14:39:45.424881Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 pipe creation result: OK TabletId: 72075186224037892 Generation: 3094, pipe: [1:7559602799347933271:2572]
2025-10-10T14:39:45.519612Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:45.520607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:45.520625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:45.520668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602799347933271:2572], now have 1 active actors on pipe
2025-10-10T14:39:45.520979Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:45.521055Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:45.521136Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:39:45.521250Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3095 reason: status is not ok: tablet will be restarted right now sessionId: src_id|7ce59b0d-c4eef312-4e5dfbe9-f52be962_0
2025-10-10T14:39:45.521496Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3095 sessionId: src_id|7ce59b0d-c4eef312-4e5dfbe9-f52be962_0 is DEAD
2025-10-10T14:39:45.521616Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 93 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602799347933271:2572]
2025-10-10T14:39:45.521659Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ce59b0d-c4eef312-4e5dfbe9-f52be962_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:39:45.521675Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ce59b0d-c4eef312-4e5dfbe9-f52be962_0] Write session will restart in 0.006954s
2025-10-10T14:39:45.521710Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ce59b0d-c4eef312-4e5dfbe9-f52be962_0] Write session: Do CDS request
2025-10-10T14:39:45.521717Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ce59b0d-c4eef312-4e5dfbe9-f52be962_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:45.529968Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7ce59b0d-c4eef312-4e5dfbe9-f52be962_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:45.530413Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:45.530437Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3096
2025-10-10T14:39:45.530640Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3096 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:45.530707Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3096 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:45.530720Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3096 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:45.530726Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:45.531305Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3096 sessionId:  describe result for acl check
2025-10-10T14:39:45.531358Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:45.531363Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:45.531368Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:45.531375Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602799347933324:4721] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:45.531988Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602799347933324:4721] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:45.534407Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602799347933324:4721] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:45.537750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602799347933324:4721] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:45.537769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602799347933324:4721] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:45.537774Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602799347933324:4721] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:45.537783Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3096 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:45.547405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:45.548186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:45.548380Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:45.548392Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:45.548403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:45.548457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:45.548510Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602798565687974:6151]
2025-10-10T14:39:45.549319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:45.549757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:45.549807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:45.550328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:45.550587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:45.550598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:45.550599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:45.550600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:45.550602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:45.550604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:45.550605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:45.550607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:45.550608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:45.550610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:45.550611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:45.550613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:45.550614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:45.550624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:45.550638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:45.550642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:45.550647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:45.550651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:45.550656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:45.550661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:45.550665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:45.550670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:45.550675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:45.550679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:45.550684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:45.550688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:45.550698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:45.550709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:45.550717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:45.550723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:45.550728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:45.550735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:45.550740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:45.550746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:45.550751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:45.550757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:45.550762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:45.550769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:45.550775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:45.550781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:45.550786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:45.550793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:45.550798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:45.550804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:45.550808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:45.550814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:45.550820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:45.550826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:45.550833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:45.550839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:45.550844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:45.550849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:45.550892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:45.553841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:45.554943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:45.554964Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:45.554967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:45.554971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:45.554980Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3095 [2:7559602798565687974:6151]
2025-10-10T14:39:45.554996Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:45.555017Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:45.555022Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:45.555025Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:45.555028Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:45.555047Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:45.555061Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:45.555069Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:45.555139Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:45.555148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:45.555150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:45.555153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:45.555229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:45.555239Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:45.555252Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:45.555271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:45.555289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:45.555322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602799347933274:2438], now have 1 active actors on pipe
2025-10-10T14:39:45.555332Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602798565687969:6151]
2025-10-10T14:39:45.555334Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602798565687969:6151]
2025-10-10T14:39:45.555337Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602798565687969:6151]
2025-10-10T14:39:45.555356Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:45.555368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602799347933511:4721], now have 1 active actors on pipe
2025-10-10T14:39:45.555377Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:45.555394Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:45.555394Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:45.555398Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:45.555398Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:45.555402Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:45.555432Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602798565687969:6151]
2025-10-10T14:39:45.555406Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3095
2025-10-10T14:39:45.555451Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:45.555425Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3095
2025-10-10T14:39:45.555460Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:45.555644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:45.555668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:45.555703Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fb03fad9-71c357cf-cb6365e0-fc7552b2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:45.555721Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:45.555727Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:45.555735Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:45.555750Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:45.555771Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:45.555796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:45.555991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:45.556002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:45.556018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:45.556158Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3096 partition: 0 MaxSeqNo: 40 sessionId: src_id|fb03fad9-71c357cf-cb6365e0-fc7552b2_0
2025-10-10T14:39:45.556682Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ce59b0d-c4eef312-4e5dfbe9-f52be962_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|fb03fad9-71c357cf-cb6365e0-fc7552b2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:45.559439Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fb03fad9-71c357cf-cb6365e0-fc7552b2_0] Write session: try to update token
2025-10-10T14:39:45.559459Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fb03fad9-71c357cf-cb6365e0-fc7552b2_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:45.567928Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:39:45.567952Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:45.567963Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602798565687969:6151]
2025-10-10T14:39:45.568018Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:39:45.568019Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:39:45.568232Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:39:45.568416Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:45.568661Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:45.568876Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:45.569105Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:39:45.569167Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:39:45.575345Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3096 sessionId: src_id|fb03fad9-71c357cf-cb6365e0-fc7552b2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:45.578073Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:45.578329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:45.578354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:45.578398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:39:45.578500Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:39:45.588593Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:45.588614Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:45.588618Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:45.588620Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:45.588631Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602798565687969:6151]
2025-10-10T14:39:45.588636Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602798565687969:6151]
2025-10-10T14:39:45.588640Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602798565687969:6151]
2025-10-10T14:39:45.588708Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:45.588702Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:45.588735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:45.588737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:45.588742Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:45.588749Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:45.588890Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:45.621213Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602799347933525:2572]
2025-10-10T14:39:45.621615Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 pipe creation result: OK TabletId: 72075186224037892 Generation: 3095, pipe: [1:7559602799347933525:2572]
2025-10-10T14:39:45.708506Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:45.717507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:45.717540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:45.717725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:45.717794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:45.717858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:45.717928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:45.717982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:45.717993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:45.718065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:45.718135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:45.718201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:45.718266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:45.718313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:45.718322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:45.718398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:45.718460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:45.718532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:45.718602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:45.718647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:45.718654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:45.718725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:45.718797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:45.718869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:45.718939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:45.718995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:45.719003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:45.719071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:45.719142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:45.719207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:45.719273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:45.719318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:45.719328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:45.719395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:45.719459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:45.719526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:45.719595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:45.719640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:45.719649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:45.719714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:45.719777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:45.719841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:45.719925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:45.719973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:45.719981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:45.720053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:45.720116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:45.720179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:45.720245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:45.720379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:45.720387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:45.720456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:45.720520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:45.720591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:45.720657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:45.720700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:45.720707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:45.720788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:45.720851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:45.720914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:45.720977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:45.721024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:45.721035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:45.721106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602799347933525:2572], now have 1 active actors on pipe
2025-10-10T14:39:45.721876Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb03fad9-71c357cf-cb6365e0-fc7552b2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:45.721888Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb03fad9-71c357cf-cb6365e0-fc7552b2_0] Write session will restart in 0.005302s
2025-10-10T14:39:45.721915Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb03fad9-71c357cf-cb6365e0-fc7552b2_0] Write session: Do CDS request
2025-10-10T14:39:45.721401Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:45.721418Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:45.721921Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb03fad9-71c357cf-cb6365e0-fc7552b2_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:45.721453Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3096 reason: error at write: Disconnected sessionId: src_id|fb03fad9-71c357cf-cb6365e0-fc7552b2_0
2025-10-10T14:39:45.721681Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3096 sessionId: src_id|fb03fad9-71c357cf-cb6365e0-fc7552b2_0 is DEAD
2025-10-10T14:39:45.721842Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 94 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602799347933525:2572]
2025-10-10T14:39:45.721857Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:45.722459Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:45.728972Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fb03fad9-71c357cf-cb6365e0-fc7552b2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:45.729479Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:45.729498Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3097
2025-10-10T14:39:45.729652Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3097 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:45.729692Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3097 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:45.729704Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3097 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:45.729708Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:45.730140Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3097 sessionId:  describe result for acl check
2025-10-10T14:39:45.730170Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:45.730172Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:45.730174Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:45.730180Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602799347933569:4676] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:45.730729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602799347933569:4676] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:45.733566Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602799347933569:4676] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:45.736931Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602799347933569:4676] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:45.736950Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602799347933569:4676] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:45.736957Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602799347933569:4676] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:45.736967Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3097 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:45.742241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:45.742840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:45.743001Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:45.743015Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:45.743027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:45.743067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:45.743102Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602798565688212:6121]
2025-10-10T14:39:45.743539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:45.747861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:45.747980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:45.748367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:45.748456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:45.748464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:45.748466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:45.748467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:45.748469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:45.748470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:45.748471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:45.748472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:45.748474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:45.748475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:45.748477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:45.748478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:45.748479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:45.748487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:45.748501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:45.748505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:45.748510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:45.748514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:45.748518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:45.748522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:45.748526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:45.748531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:45.748535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:45.748539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:45.748543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:45.748547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:45.748558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:45.748568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:45.748575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:45.748581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:45.748585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:45.748590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:45.748594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:45.748599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:45.748604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:45.748609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:45.748615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:45.748621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:45.748626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:45.748631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:45.748635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:45.748641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:45.748645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:45.748661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:45.748665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:45.748671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:45.748680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:45.748684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:45.748688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:45.748693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:45.748698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:45.748703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:45.748751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:45.751529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:45.752518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:45.752530Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:45.752533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:45.752539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:45.752547Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3096 [2:7559602798565688212:6121]
2025-10-10T14:39:45.752563Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:45.752584Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:45.752588Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:45.752592Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:45.752595Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:45.752613Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:45.752622Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:45.752631Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:45.752709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:45.752731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:45.752734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:45.752737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:45.752817Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:45.752826Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:45.752841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:45.752861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:45.752887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:45.752917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602799347933734:4676], now have 1 active actors on pipe
2025-10-10T14:39:45.752927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602799347933554:2438], now have 1 active actors on pipe
2025-10-10T14:39:45.752936Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602798565688206:6121]
2025-10-10T14:39:45.752944Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602798565688206:6121]
2025-10-10T14:39:45.752946Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602798565688206:6121]
2025-10-10T14:39:45.752963Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:45.752985Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:45.752988Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:45.753003Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:45.753005Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:45.753008Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:45.753012Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:45.753042Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602798565688206:6121]
2025-10-10T14:39:45.753016Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3096
2025-10-10T14:39:45.753049Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:45.753016Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3096
2025-10-10T14:39:45.753052Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:45.753081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:45.753088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:45.753133Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3d085e6f-81e04ed5-8c76f6fb-d4df6069_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:45.753145Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:45.753149Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:45.753172Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:45.753185Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:45.753196Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:45.753216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:45.753483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:45.753493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:45.753510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:45.753612Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3097 partition: 0 MaxSeqNo: 40 sessionId: src_id|3d085e6f-81e04ed5-8c76f6fb-d4df6069_0
2025-10-10T14:39:45.754070Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb03fad9-71c357cf-cb6365e0-fc7552b2_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|3d085e6f-81e04ed5-8c76f6fb-d4df6069_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:45.757297Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3d085e6f-81e04ed5-8c76f6fb-d4df6069_0] Write session: try to update token
2025-10-10T14:39:45.757317Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3d085e6f-81e04ed5-8c76f6fb-d4df6069_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:45.773798Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3097 sessionId: src_id|3d085e6f-81e04ed5-8c76f6fb-d4df6069_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:45.773915Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:45.773932Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:45.773936Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:45.773938Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:45.773948Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602798565688206:6121]
2025-10-10T14:39:45.773952Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602798565688206:6121]
2025-10-10T14:39:45.773956Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602798565688206:6121]
2025-10-10T14:39:45.774006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:45.774019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:45.774018Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:45.774026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:45.774026Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:45.774031Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:45.774170Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:45.776546Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:45.821582Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602799347933816:2572]
2025-10-10T14:39:45.821898Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 pipe creation result: OK TabletId: 72075186224037892 Generation: 3096, pipe: [1:7559602799347933816:2572]
2025-10-10T14:39:45.893883Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:45.894690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:45.894706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:45.894758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602799347933816:2572], now have 1 active actors on pipe
2025-10-10T14:39:45.895018Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:45.895033Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:45.895089Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3097 reason: error at write: Disconnected sessionId: src_id|3d085e6f-81e04ed5-8c76f6fb-d4df6069_0
2025-10-10T14:39:45.895324Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3097 sessionId: src_id|3d085e6f-81e04ed5-8c76f6fb-d4df6069_0 is DEAD
2025-10-10T14:39:45.895357Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 95 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602799347933816:2572]
2025-10-10T14:39:45.895380Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:45.894980Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:45.895705Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d085e6f-81e04ed5-8c76f6fb-d4df6069_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:45.895718Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d085e6f-81e04ed5-8c76f6fb-d4df6069_0] Write session will restart in 0.007051s
2025-10-10T14:39:45.895743Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d085e6f-81e04ed5-8c76f6fb-d4df6069_0] Write session: Do CDS request
2025-10-10T14:39:45.895767Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d085e6f-81e04ed5-8c76f6fb-d4df6069_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:45.903955Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3d085e6f-81e04ed5-8c76f6fb-d4df6069_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:45.904018Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:45.904037Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3098
2025-10-10T14:39:45.905540Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3098 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:45.905595Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3098 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:45.905601Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3098 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:45.905605Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:45.906204Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3098 sessionId:  describe result for acl check
2025-10-10T14:39:45.906244Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:45.906252Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:45.906254Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:45.906261Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602799347933841:4641] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:45.906844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602799347933841:4641] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:45.909473Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602799347933841:4641] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:45.912712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602799347933841:4641] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:45.912738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602799347933841:4641] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:45.912742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602799347933841:4641] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:45.912751Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3098 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:45.920363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:45.928611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:45.928910Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:45.928923Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:45.928947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:45.929015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:45.929069Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602798565688402:6118]
2025-10-10T14:39:45.929814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:45.938054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:45.938170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:45.938632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:45.938715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:45.938723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:45.938724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:45.938726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:45.938727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:45.938729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:45.938731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:45.938732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:45.938733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:45.938735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:45.938737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:45.938738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:45.938740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:45.938748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:45.938762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:45.938766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:45.938770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:45.938774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:45.938779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:45.938784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:45.938788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:45.938793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:45.938798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:45.938802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:45.938806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:45.938810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:45.938823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:45.938835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:45.938851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:45.938858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:45.938864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:45.938873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:45.938877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:45.938884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:45.938889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:45.938909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:45.938913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:45.938920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:45.938925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:45.938931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:45.938936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:45.938941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:45.938947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:45.938953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:45.938958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:45.938964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:45.938969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:45.938975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:45.938980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:45.938986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:45.938991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:45.938997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:45.939044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:45.944360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:45.945447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:45.945463Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:45.945466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:45.945470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:45.945479Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3097 [2:7559602798565688402:6118]
2025-10-10T14:39:45.945495Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:45.945516Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:45.945527Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:45.945531Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:45.945533Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:45.945554Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:45.945568Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:45.945578Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:45.945673Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:45.945676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:45.945678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:45.945680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:45.945762Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:45.945773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:45.945789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:45.945804Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:45.945824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:45.945847Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602798565688397:6118]
2025-10-10T14:39:45.945855Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602798565688397:6118]
2025-10-10T14:39:45.945857Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602798565688397:6118]
2025-10-10T14:39:45.945869Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:45.945885Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:45.945895Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:45.945900Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:45.945902Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:45.945906Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:45.945909Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:45.945958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602799347933823:2438], now have 1 active actors on pipe
2025-10-10T14:39:45.945966Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602798565688397:6118]
2025-10-10T14:39:45.945974Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:45.945984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602799347933983:4641], now have 1 active actors on pipe
2025-10-10T14:39:45.946092Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:45.949425Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3097
2025-10-10T14:39:45.949431Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3097
2025-10-10T14:39:45.949744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:45.949777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:45.949819Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e568dc43-ffd6eff6-cb53b635-d6a3792e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:45.949852Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:45.949864Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:45.949872Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:45.949890Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:45.949916Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:45.949943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:45.953874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:45.953898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:45.953939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:45.954089Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3098 partition: 0 MaxSeqNo: 40 sessionId: src_id|e568dc43-ffd6eff6-cb53b635-d6a3792e_0
2025-10-10T14:39:45.954526Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d085e6f-81e04ed5-8c76f6fb-d4df6069_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|e568dc43-ffd6eff6-cb53b635-d6a3792e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:45.957406Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e568dc43-ffd6eff6-cb53b635-d6a3792e_0] Write session: try to update token
2025-10-10T14:39:45.957425Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e568dc43-ffd6eff6-cb53b635-d6a3792e_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:45.971878Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:45.971903Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:45.971906Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:45.971908Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:45.971919Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602798565688397:6118]
2025-10-10T14:39:45.971924Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602798565688397:6118]
2025-10-10T14:39:45.971927Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602798565688397:6118]
2025-10-10T14:39:45.971980Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:45.971989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:45.971992Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:45.972132Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:45.973741Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:45.973756Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:45.973760Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:45.984274Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3098 sessionId: src_id|e568dc43-ffd6eff6-cb53b635-d6a3792e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:45.987015Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:45.995484Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602799347934080:2572]
2025-10-10T14:39:45.995835Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 pipe creation result: OK TabletId: 72075186224037892 Generation: 3097, pipe: [1:7559602799347934080:2572]
2025-10-10T14:39:46.099635Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:46.100408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:46.100420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:46.100448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602799347934080:2572], now have 1 active actors on pipe
2025-10-10T14:39:46.100763Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:46.101173Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:46.101239Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:39:46.101315Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3098 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e568dc43-ffd6eff6-cb53b635-d6a3792e_0
2025-10-10T14:39:46.101572Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3098 sessionId: src_id|e568dc43-ffd6eff6-cb53b635-d6a3792e_0 is DEAD
2025-10-10T14:39:46.101626Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 96 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602799347934080:2572]
2025-10-10T14:39:46.107284Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e568dc43-ffd6eff6-cb53b635-d6a3792e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:39:46.107301Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e568dc43-ffd6eff6-cb53b635-d6a3792e_0] Write session will restart in 0.008944s
2025-10-10T14:39:46.107326Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e568dc43-ffd6eff6-cb53b635-d6a3792e_0] Write session: Do CDS request
2025-10-10T14:39:46.107332Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e568dc43-ffd6eff6-cb53b635-d6a3792e_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:46.117961Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e568dc43-ffd6eff6-cb53b635-d6a3792e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:46.118508Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:46.118540Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3099
2025-10-10T14:39:46.118696Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3099 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:46.118744Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3099 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:46.118765Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3099 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:46.118769Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:46.119394Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3099 sessionId:  describe result for acl check
2025-10-10T14:39:46.119439Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:46.119447Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:46.119452Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:46.119458Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602803642901578:4661] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:46.120070Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602803642901578:4661] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:46.122520Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602803642901578:4661] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:46.123898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:46.128887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:46.129197Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602803642901578:4661] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:46.129217Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602803642901578:4661] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:46.129221Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602803642901578:4661] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:46.129232Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3099 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:46.129172Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:46.129184Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:46.129197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:46.129263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:46.129315Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602802860655887:6112]
2025-10-10T14:39:46.129964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:46.130377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:46.130434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:46.130778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:46.130852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:46.130859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:46.130861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:46.130862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:46.130863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:46.130865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:46.130866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:46.130867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:46.130869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:46.130871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:46.130873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:46.130874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:46.130875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:46.130882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:46.130897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:46.130901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:46.130906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:46.130910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:46.130914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:46.130918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:46.130922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:46.130926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:46.130931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:46.130935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:46.130939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:46.130943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:46.130954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:46.130963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:46.130970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:46.130975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:46.130980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:46.130986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:46.130997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:46.131003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:46.131008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:46.131014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:46.131019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:46.131031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:46.131036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:46.131043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:46.131047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:46.131053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:46.131064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:46.131070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:46.131077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:46.131082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:46.131089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:46.131095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:46.131102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:46.131107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:46.131130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:46.131135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:46.131180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:46.134204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:46.135182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:46.135198Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:46.135200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:46.135204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:46.135212Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3098 [2:7559602802860655887:6112]
2025-10-10T14:39:46.135228Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:46.135253Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:46.135257Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:46.135261Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:46.135263Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:46.135283Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:46.135290Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:46.135299Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:46.135368Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:46.135371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:46.135373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:46.135376Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:46.135460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:46.135463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:46.135477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:46.135490Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:46.135508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:46.135544Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602802860655882:6112]
2025-10-10T14:39:46.135547Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602802860655882:6112]
2025-10-10T14:39:46.135549Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602802860655882:6112]
2025-10-10T14:39:46.135564Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:46.135588Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:46.135606Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:46.135609Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:46.135651Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602802860655882:6112]
2025-10-10T14:39:46.135655Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:46.135910Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:46.135923Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:46.135925Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:46.135932Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:46.136236Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3098
2025-10-10T14:39:46.136243Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3098
2025-10-10T14:39:46.136259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602803642901378:2438], now have 1 active actors on pipe
2025-10-10T14:39:46.136268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602803642901621:4661], now have 1 active actors on pipe
2025-10-10T14:39:46.136601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:46.136605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:46.136638Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9357d6c6-d255181c-bb4fbbf2-b9dedd69_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:46.136646Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:46.136650Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:46.136652Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:46.136665Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:46.136677Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:46.136693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:46.136953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:46.136956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:46.136968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:46.137090Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3099 partition: 0 MaxSeqNo: 40 sessionId: src_id|9357d6c6-d255181c-bb4fbbf2-b9dedd69_0
2025-10-10T14:39:46.137619Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e568dc43-ffd6eff6-cb53b635-d6a3792e_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|9357d6c6-d255181c-bb4fbbf2-b9dedd69_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:46.140546Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9357d6c6-d255181c-bb4fbbf2-b9dedd69_0] Write session: try to update token
2025-10-10T14:39:46.140570Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9357d6c6-d255181c-bb4fbbf2-b9dedd69_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:46.162240Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:46.162263Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:46.162267Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:46.162270Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:46.162282Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602802860655882:6112]
2025-10-10T14:39:46.162287Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602802860655882:6112]
2025-10-10T14:39:46.162291Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602802860655882:6112]
2025-10-10T14:39:46.162339Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:46.162342Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:46.162346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:46.162348Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:46.162348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:46.162353Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:46.162500Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:46.162556Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3099 sessionId: src_id|9357d6c6-d255181c-bb4fbbf2-b9dedd69_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:46.165479Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:46.201792Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602803642901633:2572]
2025-10-10T14:39:46.202863Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 pipe creation result: OK TabletId: 72075186224037892 Generation: 3098, pipe: [1:7559602803642901633:2572]
2025-10-10T14:39:46.282189Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:46.282865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:46.282878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:46.282931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602803642901633:2572], now have 1 active actors on pipe
2025-10-10T14:39:46.283171Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:46.283199Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:46.283204Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:46.283236Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 97 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602803642901633:2572]
2025-10-10T14:39:46.283316Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3099 reason: error at write: Disconnected sessionId: src_id|9357d6c6-d255181c-bb4fbbf2-b9dedd69_0
2025-10-10T14:39:46.283554Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3099 sessionId: src_id|9357d6c6-d255181c-bb4fbbf2-b9dedd69_0 is DEAD
2025-10-10T14:39:46.283211Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:46.283804Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9357d6c6-d255181c-bb4fbbf2-b9dedd69_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:46.283817Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9357d6c6-d255181c-bb4fbbf2-b9dedd69_0] Write session will restart in 0.008986s
2025-10-10T14:39:46.283843Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9357d6c6-d255181c-bb4fbbf2-b9dedd69_0] Write session: Do CDS request
2025-10-10T14:39:46.283855Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9357d6c6-d255181c-bb4fbbf2-b9dedd69_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:46.293896Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9357d6c6-d255181c-bb4fbbf2-b9dedd69_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:46.294331Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:46.294350Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3100
2025-10-10T14:39:46.294527Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3100 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:46.294569Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3100 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:46.294581Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3100 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:46.294586Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:46.295052Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3100 sessionId:  describe result for acl check
2025-10-10T14:39:46.295101Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:46.295108Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:46.295110Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:46.295118Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602803642901651:4643] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:46.295727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602803642901651:4643] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:46.298388Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602803642901651:4643] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:46.301511Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602803642901651:4643] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:46.301527Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602803642901651:4643] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:46.301531Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602803642901651:4643] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:46.301542Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3100 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:46.310345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:46.315206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:46.315942Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:46.315957Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:46.315977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:46.316070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:46.316124Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602802860656081:6105]
2025-10-10T14:39:46.316773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:46.317436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:46.317511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:46.317877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:46.317950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:46.317957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:46.317959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:46.317960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:46.317961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:46.317963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:46.317964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:46.317965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:46.317967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:46.317968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:46.317969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:46.317970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:46.317971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:46.317990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:46.318004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:46.318009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:46.318013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:46.318018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:46.318022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:46.318026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:46.318031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:46.318035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:46.318040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:46.318044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:46.318049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:46.318052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:46.318062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:46.318071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:46.318078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:46.318084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:46.318088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:46.318094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:46.318100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:46.318105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:46.318112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:46.318118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:46.318123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:46.318129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:46.318134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:46.318147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:46.318156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:46.318161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:46.318166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:46.318173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:46.318178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:46.318184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:46.318188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:46.318194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:46.318204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:46.318210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:46.318215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:46.318221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:46.318265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:46.321325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:46.321699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:46.321715Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:46.321718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:46.321723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:46.321730Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3099 [2:7559602802860656081:6105]
2025-10-10T14:39:46.321745Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:46.321765Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:46.321774Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:46.321778Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:46.321781Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:46.321799Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:46.321812Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:46.321823Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:46.321891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:46.321898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:46.321901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:46.321904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:46.321973Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:46.321984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:46.321998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:46.322013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:46.322033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:46.322060Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602802860656076:6105]
2025-10-10T14:39:46.322068Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602802860656076:6105]
2025-10-10T14:39:46.322070Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602802860656076:6105]
2025-10-10T14:39:46.322085Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:46.322109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602803642901738:4643], now have 1 active actors on pipe
2025-10-10T14:39:46.322113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602803642901634:2438], now have 1 active actors on pipe
2025-10-10T14:39:46.322121Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:46.322137Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:46.322141Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:46.322170Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602802860656076:6105]
2025-10-10T14:39:46.322178Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:46.322189Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:46.322199Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:46.322201Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:46.322216Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:46.322167Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3099
2025-10-10T14:39:46.322189Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3099
2025-10-10T14:39:46.322407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:46.322431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:46.322469Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6fc15d97-a36d68e-62149e5e-a1dff5de_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:46.322484Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:46.322492Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:46.322495Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:46.322508Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:46.322524Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:46.322544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:46.323784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:46.323799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:46.323824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:46.323970Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3100 partition: 0 MaxSeqNo: 40 sessionId: src_id|6fc15d97-a36d68e-62149e5e-a1dff5de_0
2025-10-10T14:39:46.324606Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9357d6c6-d255181c-bb4fbbf2-b9dedd69_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|6fc15d97-a36d68e-62149e5e-a1dff5de_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:46.327589Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6fc15d97-a36d68e-62149e5e-a1dff5de_0] Write session: try to update token
2025-10-10T14:39:46.327627Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6fc15d97-a36d68e-62149e5e-a1dff5de_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:46.345788Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:46.345812Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:46.345816Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:46.345819Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:46.345830Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602802860656076:6105]
2025-10-10T14:39:46.345835Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602802860656076:6105]
2025-10-10T14:39:46.345839Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602802860656076:6105]
2025-10-10T14:39:46.345894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:46.345903Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:46.345905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:46.346073Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:46.349498Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:46.349520Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:46.349525Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:46.351374Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3100 sessionId: src_id|6fc15d97-a36d68e-62149e5e-a1dff5de_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:46.354385Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:46.383546Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602803642901894:2572]
2025-10-10T14:39:46.384247Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 pipe creation result: OK TabletId: 72075186224037892 Generation: 3099, pipe: [1:7559602803642901894:2572]
2025-10-10T14:39:46.469827Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:46.470908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:46.470938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:46.470990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602803642901894:2572], now have 1 active actors on pipe
2025-10-10T14:39:46.471297Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:46.472331Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6fc15d97-a36d68e-62149e5e-a1dff5de_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:39:46.472345Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6fc15d97-a36d68e-62149e5e-a1dff5de_0] Write session will restart in 0.005228s
2025-10-10T14:39:46.472374Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6fc15d97-a36d68e-62149e5e-a1dff5de_0] Write session: Do CDS request
2025-10-10T14:39:46.471769Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 98 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602803642901894:2572]
2025-10-10T14:39:46.472381Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6fc15d97-a36d68e-62149e5e-a1dff5de_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:46.471816Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:39:46.471897Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3100 reason: status is not ok: tablet will be restarted right now sessionId: src_id|6fc15d97-a36d68e-62149e5e-a1dff5de_0
2025-10-10T14:39:46.472058Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:46.472154Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3100 sessionId: src_id|6fc15d97-a36d68e-62149e5e-a1dff5de_0 is DEAD
2025-10-10T14:39:46.478960Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6fc15d97-a36d68e-62149e5e-a1dff5de_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:46.479130Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:46.479148Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3101
2025-10-10T14:39:46.479328Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3101 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:46.479365Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3101 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:46.479380Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3101 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:46.479384Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:46.479882Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3101 sessionId:  describe result for acl check
2025-10-10T14:39:46.479921Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:46.479923Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:46.479924Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:46.479934Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602803642901910:4628] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:46.480522Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602803642901910:4628] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:46.482971Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602803642901910:4628] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:46.487098Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602803642901910:4628] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:46.487119Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602803642901910:4628] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:46.487123Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602803642901910:4628] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:46.487135Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3101 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:46.503236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:46.504351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:46.504633Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:46.504640Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:46.504657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:46.504747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:46.504810Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602802860656273:6103]
2025-10-10T14:39:46.505463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:46.505871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:46.505940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:46.506293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:46.506379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:46.506386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:46.506387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:46.506389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:46.506390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:46.506391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:46.506395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:46.506396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:46.506398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:46.506399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:46.506400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:46.506402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:46.506403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:46.506410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:46.506423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:46.506427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:46.506430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:46.506434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:46.506437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:46.506441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:46.506444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:46.506447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:46.506451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:46.506454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:46.506457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:46.506460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:46.506470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:46.506479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:46.506484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:46.506490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:46.506498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:46.506503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:46.506507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:46.506511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:46.506515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:46.506520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:46.506523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:46.506531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:46.506536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:46.506540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:46.506544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:46.506550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:46.506554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:46.506559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:46.506565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:46.506569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:46.506573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:46.506577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:46.506581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:46.506585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:46.506588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:46.506593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:46.506629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:46.509270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:46.510092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:46.510106Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:46.510108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:46.510112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:46.510119Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3100 [2:7559602802860656273:6103]
2025-10-10T14:39:46.510133Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:46.510152Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:46.510155Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:46.510159Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:46.510161Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:46.510180Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:46.510192Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:46.510202Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:46.510267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:46.510274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:46.510276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:46.510278Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:46.510350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:46.510358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:46.510370Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:46.510393Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:46.510413Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:46.510441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602803642901896:2438], now have 1 active actors on pipe
2025-10-10T14:39:46.510451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602803642902008:4628], now have 1 active actors on pipe
2025-10-10T14:39:46.510459Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602802860656268:6103]
2025-10-10T14:39:46.510461Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602802860656268:6103]
2025-10-10T14:39:46.510463Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602802860656268:6103]
2025-10-10T14:39:46.510477Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:46.510493Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:46.510509Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:46.510512Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:46.510541Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602802860656268:6103]
2025-10-10T14:39:46.510550Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:46.510708Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:46.510719Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:46.510721Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:46.510728Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:46.513441Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3100
2025-10-10T14:39:46.513456Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3100
2025-10-10T14:39:46.513798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:46.513834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:46.513886Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|20601c21-3aee7830-4c5ebf3a-ffd67b06_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:46.513904Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:46.513914Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:46.513916Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:46.513941Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:46.513964Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:46.513987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:46.515684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:46.515701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:46.515726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:46.515855Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3101 partition: 0 MaxSeqNo: 40 sessionId: src_id|20601c21-3aee7830-4c5ebf3a-ffd67b06_0
2025-10-10T14:39:46.517703Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6fc15d97-a36d68e-62149e5e-a1dff5de_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|20601c21-3aee7830-4c5ebf3a-ffd67b06_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:46.520433Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|20601c21-3aee7830-4c5ebf3a-ffd67b06_0] Write session: try to update token
2025-10-10T14:39:46.520456Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|20601c21-3aee7830-4c5ebf3a-ffd67b06_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:46.538014Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:46.538042Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:46.538046Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:46.538047Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:46.538059Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602802860656268:6103]
2025-10-10T14:39:46.538063Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602802860656268:6103]
2025-10-10T14:39:46.538072Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602802860656268:6103]
2025-10-10T14:39:46.538130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:46.538139Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:46.538147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:46.538316Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:46.540756Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:46.540771Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:46.540775Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:46.559122Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3101 sessionId: src_id|20601c21-3aee7830-4c5ebf3a-ffd67b06_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:46.561990Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:46.571986Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602803642902153:2572]
2025-10-10T14:39:46.572420Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 pipe creation result: OK TabletId: 72075186224037892 Generation: 3100, pipe: [1:7559602803642902153:2572]
2025-10-10T14:39:46.670122Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:46.670707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:46.670719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:46.670745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602803642902153:2572], now have 1 active actors on pipe
2025-10-10T14:39:46.671055Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:46.671632Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20601c21-3aee7830-4c5ebf3a-ffd67b06_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:46.671644Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20601c21-3aee7830-4c5ebf3a-ffd67b06_0] Write session will restart in 0.007228s
2025-10-10T14:39:46.671668Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20601c21-3aee7830-4c5ebf3a-ffd67b06_0] Write session: Do CDS request
2025-10-10T14:39:46.671674Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20601c21-3aee7830-4c5ebf3a-ffd67b06_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:46.671080Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 99 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602803642902153:2572]
2025-10-10T14:39:46.671118Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:46.671156Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:46.671159Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:46.671233Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3101 reason: error at write: Disconnected sessionId: src_id|20601c21-3aee7830-4c5ebf3a-ffd67b06_0
2025-10-10T14:39:46.671457Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3101 sessionId: src_id|20601c21-3aee7830-4c5ebf3a-ffd67b06_0 is DEAD
2025-10-10T14:39:46.671480Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1661: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 closed with error: reason# too much attempts to restart pipe
2025-10-10T14:39:46.671602Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 31 consumer shared/user session shared/user_1_31_11885534020854623286_v1 is DEAD
2025-10-10T14:39:46.671742Z :ERROR: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] Got error. Status: UNAVAILABLE. Description: <main>: Error: too much attempts to restart pipe, code: 500027 
2025-10-10T14:39:46.671872Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-10T14:39:46.671879Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-10T14:39:46.671885Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] Reconnecting session to cluster  in 0.008796s
2025-10-10T14:39:46.672023Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559602726333470566:2589] disconnected; active server actors: 1
2025-10-10T14:39:46.672037Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559602726333470566:2589] client user disconnected session shared/user_1_31_11885534020854623286_v1
2025-10-10T14:39:46.681785Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] Successfully connected. Initializing session
2025-10-10T14:39:46.681848Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|20601c21-3aee7830-4c5ebf3a-ffd67b06_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:46.681992Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:46.682012Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3102
2025-10-10T14:39:46.682076Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-10T14:39:46.682078Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 32
2025-10-10T14:39:46.682298Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3102 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:46.682309Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 32 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-10T14:39:46.682363Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3102 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:46.682363Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 read init: from# ipv6:[::1]:37328, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-10T14:39:46.682374Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3102 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:46.682379Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:46.682457Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 auth for : user
2025-10-10T14:39:46.682573Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 Handle describe topics response
2025-10-10T14:39:46.682600Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 auth is DEAD
2025-10-10T14:39:46.682624Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 auth ok: topics# 1, initDone# 0
2025-10-10T14:39:46.682831Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3102 sessionId:  describe result for acl check
2025-10-10T14:39:46.682859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:46.682861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:46.682863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:46.682870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602803642902192:4620] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:46.682913Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 register session: topic# rt3.dc1--test-topic
2025-10-10T14:39:46.683124Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559602803642902193:4615] connected; active server actors: 1
2025-10-10T14:39:46.683142Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7559602803642902193:4615] session shared/user_1_32_2377807763033062708_v1
2025-10-10T14:39:46.683152Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-10-10T14:39:46.683164Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-10-10T14:39:46.683170Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_32_2377807763033062708_v1" (Sender=[1:7559602803642902184:4615], Pipe=[1:7559602803642902193:4615], Partitions=[], ActiveFamilyCount=0)
2025-10-10T14:39:46.683175Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-10T14:39:46.683185Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-10-10T14:39:46.683194Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_32_2377807763033062708_v1" (Sender=[1:7559602803642902184:4615], Pipe=[1:7559602803642902193:4615], Partitions=[], ActiveFamilyCount=0)
2025-10-10T14:39:46.683205Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_32_2377807763033062708_v1" sender [1:7559602803642902184:4615] lock partition 0 for ReadingSession "shared/user_1_32_2377807763033062708_v1" (Sender=[1:7559602803642902184:4615], Pipe=[1:7559602803642902193:4615], Partitions=[], ActiveFamilyCount=1) generation 1 step 32
2025-10-10T14:39:46.683213Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-10-10T14:39:46.683218Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000030s
2025-10-10T14:39:46.683462Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 32 Session: "shared/user_1_32_2377807763033062708_v1" ClientId: "user" PipeClient { RawX1: 7559602803642902193 RawX2: 4503603922342407 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-10T14:39:46.683471Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602803642902192:4620] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:46.683495Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-10T14:39:46.685560Z :INFO: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] Got InitResponse. ReadSessionId: shared/user_1_32_2377807763033062708_v1
2025-10-10T14:39:46.685788Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602803642902192:4620] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:46.689994Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602803642902192:4620] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:46.690013Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602803642902192:4620] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:46.690017Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602803642902192:4620] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:46.690027Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3102 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:46.694030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:46.699567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:46.699863Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:46.699876Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:46.699890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:46.699958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:46.700004Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602802860656480:6100]
2025-10-10T14:39:46.700678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:46.701095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:46.701158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:46.701579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:46.701653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:46.701663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:46.701664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:46.701665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:46.701667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:46.701668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:46.701670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:46.701671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:46.701672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:46.701674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:46.701675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:46.701676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:46.701677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:46.701684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:46.701697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:46.701701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:46.701705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:46.701708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:46.701712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:46.701716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:46.701719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:46.701723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:46.701727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:46.701730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:46.701734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:46.701738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:46.701747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:46.701756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:46.701762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:46.701768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:46.701772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:46.701777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:46.701783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:46.701788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:46.701798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:46.701803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:46.701812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:46.701817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:46.701821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:46.701826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:46.701830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:46.701849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:46.701853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:46.701858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:46.701862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:46.701866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:46.701879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:46.701884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:46.701888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:46.701893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:46.701897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:46.701901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:46.701937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:46.704674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:46.705085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:46.705099Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:46.705102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:46.705107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:46.705114Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3101 [2:7559602802860656480:6100]
2025-10-10T14:39:46.705128Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:46.705145Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:46.705149Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:46.705153Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:46.705156Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:46.705174Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:46.705182Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:46.705191Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:46.705251Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:46.705253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:46.705256Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:46.705259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:46.705352Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:46.705355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:46.705367Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:46.705378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:46.705394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:46.705415Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602802860656474:6100]
2025-10-10T14:39:46.705418Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602802860656474:6100]
2025-10-10T14:39:46.705420Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602802860656474:6100]
2025-10-10T14:39:46.705436Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:46.705451Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:46.705469Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:46.705473Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:46.705501Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602802860656474:6100]
2025-10-10T14:39:46.705504Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:46.705805Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:46.705816Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:46.705818Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:46.705825Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:46.705998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602803642902211:4596], now have 1 active actors on pipe
2025-10-10T14:39:46.706012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602803642902397:4620], now have 1 active actors on pipe
2025-10-10T14:39:46.706017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602803642902156:2438], now have 1 active actors on pipe
2025-10-10T14:39:46.709544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:46.709562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:46.709579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_32_2377807763033062708_v1 on pipe: [1:7559602803642902211:4596]
2025-10-10T14:39:46.709530Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3101
2025-10-10T14:39:46.709599Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:46.709574Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3101
2025-10-10T14:39:46.709606Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:46.709626Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:46.709726Z node 2 :PERSQUEUE DEBUG: partition.cpp:3747: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_32_2377807763033062708_v1
2025-10-10T14:39:46.709735Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:46.709772Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:39:46.709714Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 3101, pipe: [1:7559602803642902211:4596]
2025-10-10T14:39:46.709975Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_32_2377807763033062708_v1:1 with generation 3101
2025-10-10T14:39:46.710099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:46.710129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:46.710167Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9899133a-7decb98c-24e07174-8f16eada_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:46.710190Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:39:46.718126Z node 2 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:39:46.718163Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:39:46.718178Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:46.718186Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:46.718189Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:46.718206Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:46.718225Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:46.718234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-10T14:39:46.718249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-10T14:39:46.718265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:46.721709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:46.721730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:46.721766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:46.721455Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 40 WriteTimestampMS: 1760106661000 SizeLag: 17206678 WriteTimestampEstimateMS: 1760107186705 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-10T14:39:46.721483Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 40 readOffset 0 committedOffset 0
2025-10-10T14:39:46.721569Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 sending to client partition status
2025-10-10T14:39:46.722027Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3102 partition: 0 MaxSeqNo: 40 sessionId: src_id|9899133a-7decb98c-24e07174-8f16eada_0
2025-10-10T14:39:46.722341Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20601c21-3aee7830-4c5ebf3a-ffd67b06_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|9899133a-7decb98c-24e07174-8f16eada_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:46.725187Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9899133a-7decb98c-24e07174-8f16eada_0] Write session: try to update token
2025-10-10T14:39:46.725204Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9899133a-7decb98c-24e07174-8f16eada_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:46.751559Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:39:46.751577Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:46.751594Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602802860656474:6100]
2025-10-10T14:39:46.751676Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:39:46.751870Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:39:46.752014Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:46.752154Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:46.752297Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:46.752500Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:39:46.754378Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:39:46.754417Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:46.754422Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:46.754503Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:46.754505Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:46.754515Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602802860656474:6100]
2025-10-10T14:39:46.754520Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602802860656474:6100]
2025-10-10T14:39:46.754524Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602802860656474:6100]
2025-10-10T14:39:46.754560Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:46.754567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:46.754569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:46.754707Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:46.757433Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:39:46.757445Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:46.757449Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:46.757453Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:46.769831Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3102 sessionId: src_id|9899133a-7decb98c-24e07174-8f16eada_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:46.772728Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:46.880858Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:46.881189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:46.881208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:46.881557Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 0 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602803642902211:4596]
2025-10-10T14:39:46.881596Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:46.881602Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:46.881606Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:46.881688Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3102 reason: error at write: Disconnected sessionId: src_id|9899133a-7decb98c-24e07174-8f16eada_0
2025-10-10T14:39:46.881927Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3102 sessionId: src_id|9899133a-7decb98c-24e07174-8f16eada_0 is DEAD
2025-10-10T14:39:46.882079Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9899133a-7decb98c-24e07174-8f16eada_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:46.882091Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9899133a-7decb98c-24e07174-8f16eada_0] Write session will restart in 0.005974s
2025-10-10T14:39:46.882116Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9899133a-7decb98c-24e07174-8f16eada_0] Write session: Do CDS request
2025-10-10T14:39:46.882123Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9899133a-7decb98c-24e07174-8f16eada_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:46.881520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_32_2377807763033062708_v1
2025-10-10T14:39:46.881543Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:46.881560Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_32_2377807763033062708_v1
2025-10-10T14:39:46.888998Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9899133a-7decb98c-24e07174-8f16eada_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:46.889102Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:46.889121Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3103
2025-10-10T14:39:46.889247Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3103 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:46.889278Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3103 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:46.889284Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3103 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:46.889288Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:46.889863Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3103 sessionId:  describe result for acl check
2025-10-10T14:39:46.889904Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:46.889907Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:46.889909Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:46.889916Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602803642902479:4578] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:46.890535Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602803642902479:4578] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:46.893155Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602803642902479:4578] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:46.895697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602803642902479:4578] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:46.895714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602803642902479:4578] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:46.895717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602803642902479:4578] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:46.895727Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3103 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:46.904974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:46.911679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:46.912653Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:46.912673Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:46.912690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:46.912787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:46.912841Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602802860656713:6081]
2025-10-10T14:39:46.913587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:46.914155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:46.914214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:46.914578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:46.914665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:46.914671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:46.914672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:46.914674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:46.914676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:46.914678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:46.914680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:46.914681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:46.914683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:46.914685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:46.914686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:46.914689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:46.914690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:46.914696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:46.914709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:46.914713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:46.914717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:46.914722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:46.914727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:46.914732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:46.914736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:46.914740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:46.914745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:46.914750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:46.914755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:46.914759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:46.914768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:46.914777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:46.914787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:46.914797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:46.914802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:46.914809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:46.914814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:46.914826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:46.914833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:46.914839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:46.914843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:46.914855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:46.914861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:46.914871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:46.914876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:46.914887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:46.914892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:46.914902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:46.914907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:46.914914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:46.914919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:46.914929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:46.914934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:46.914945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:46.914950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:46.914960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:46.915003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:46.918953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:46.919356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:46.919371Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:46.919375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:46.919380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:46.919388Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3102 [2:7559602802860656713:6081]
2025-10-10T14:39:46.919403Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:46.919422Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:46.919425Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:46.919429Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:46.919432Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:46.919448Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:46.919456Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:46.919463Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:46.919529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:46.919539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:46.919542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:46.919544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:46.919629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:46.919644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:46.919657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:46.919670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:46.919685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:46.919709Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602802860656708:6081]
2025-10-10T14:39:46.919717Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602802860656708:6081]
2025-10-10T14:39:46.919719Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602802860656708:6081]
2025-10-10T14:39:46.919731Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:46.919742Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:46.919746Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:46.919749Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:46.919753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602803642902601:4578], now have 1 active actors on pipe
2025-10-10T14:39:46.919758Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:46.919774Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:46.919785Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:46.919791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602803642902464:2438], now have 1 active actors on pipe
2025-10-10T14:39:46.919818Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602802860656708:6081]
2025-10-10T14:39:46.919831Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:46.919839Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:46.919978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:46.919988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:46.920015Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ca37a2f7-498693c6-7bb6bed3-4a47ffd6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:46.920029Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:46.920034Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:46.920037Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:46.920048Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:46.920059Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:46.920077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:46.920298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:46.920309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:46.920323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:46.920958Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9899133a-7decb98c-24e07174-8f16eada_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|ca37a2f7-498693c6-7bb6bed3-4a47ffd6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:46.919853Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3102
2025-10-10T14:39:46.919865Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3102
2025-10-10T14:39:46.920458Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3103 partition: 0 MaxSeqNo: 40 sessionId: src_id|ca37a2f7-498693c6-7bb6bed3-4a47ffd6_0
2025-10-10T14:39:46.924046Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ca37a2f7-498693c6-7bb6bed3-4a47ffd6_0] Write session: try to update token
2025-10-10T14:39:46.924066Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ca37a2f7-498693c6-7bb6bed3-4a47ffd6_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:46.945534Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3103 sessionId: src_id|ca37a2f7-498693c6-7bb6bed3-4a47ffd6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:46.947020Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:46.947053Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:46.947056Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:46.947059Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:46.947070Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602802860656708:6081]
2025-10-10T14:39:46.947077Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602802860656708:6081]
2025-10-10T14:39:46.947082Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602802860656708:6081]
2025-10-10T14:39:46.947149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:46.947164Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:46.947167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:46.947171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:46.947173Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:46.947178Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:46.947366Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:46.948565Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:46.981597Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602803642902726:4596]
2025-10-10T14:39:46.982012Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 pipe creation result: OK TabletId: 72075186224037892 Generation: 3102, pipe: [1:7559602803642902726:4596]
2025-10-10T14:39:47.091781Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:47.092617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:47.092638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:47.092684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602803642902726:4596], now have 1 active actors on pipe
2025-10-10T14:39:47.093080Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:47.093114Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 1 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602803642902726:4596]
2025-10-10T14:39:47.093114Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:47.093159Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:39:47.093271Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3103 reason: status is not ok: tablet will be restarted right now sessionId: src_id|ca37a2f7-498693c6-7bb6bed3-4a47ffd6_0
2025-10-10T14:39:47.093517Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3103 sessionId: src_id|ca37a2f7-498693c6-7bb6bed3-4a47ffd6_0 is DEAD
2025-10-10T14:39:47.097450Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca37a2f7-498693c6-7bb6bed3-4a47ffd6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:39:47.097467Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca37a2f7-498693c6-7bb6bed3-4a47ffd6_0] Write session will restart in 0.008659s
2025-10-10T14:39:47.097494Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca37a2f7-498693c6-7bb6bed3-4a47ffd6_0] Write session: Do CDS request
2025-10-10T14:39:47.097500Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca37a2f7-498693c6-7bb6bed3-4a47ffd6_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:47.107990Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ca37a2f7-498693c6-7bb6bed3-4a47ffd6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:47.108087Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:47.108115Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3104
2025-10-10T14:39:47.108736Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3104 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:47.108793Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3104 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:47.108803Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3104 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:47.108807Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:47.109293Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3104 sessionId:  describe result for acl check
2025-10-10T14:39:47.109353Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:47.109362Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:47.109364Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:47.109371Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602807937870107:4567] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:47.109980Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602807937870107:4567] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:47.112497Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602807937870107:4567] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:47.115467Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602807937870107:4567] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:47.115484Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602807937870107:4567] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:47.115488Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602807937870107:4567] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:47.115497Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3104 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:47.117162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:47.121976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:47.122588Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:47.122605Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:47.122623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:47.122712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:47.122763Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602807155624203:6076]
2025-10-10T14:39:47.123432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:47.123834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:47.123900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:47.124296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:47.124358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:47.124366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:47.124368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:47.124369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:47.124371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:47.124372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:47.124374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:47.124376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:47.124377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:47.124379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:47.124381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:47.124382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:47.124384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:47.124391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:47.124407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:47.124412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:47.124417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:47.124421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:47.124427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:47.124432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:47.124436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:47.124441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:47.124446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:47.124451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:47.124456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:47.124461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:47.124471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:47.124481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:47.124489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:47.124496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:47.124502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:47.124508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:47.124513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:47.124520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:47.124525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:47.124532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:47.124537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:47.124544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:47.124551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:47.124557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:47.124563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:47.124569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:47.124576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:47.124582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:47.124588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:47.124594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:47.124600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:47.124606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:47.124611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:47.124620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:47.124625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:47.124630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:47.124674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:47.127199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:47.127518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:47.127533Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:47.127536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:47.127541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:47.127548Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3103 [2:7559602807155624203:6076]
2025-10-10T14:39:47.127563Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:47.127581Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:47.127584Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:47.127588Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:47.127590Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:47.127609Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:47.127624Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:47.127632Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:47.127694Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:47.127705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:47.127708Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:47.127711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:47.127783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:47.127797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:47.127810Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:47.127824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:47.127850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:47.127880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602807937870024:2438], now have 1 active actors on pipe
2025-10-10T14:39:47.127890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602807937870270:4567], now have 1 active actors on pipe
2025-10-10T14:39:47.127899Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602807155624198:6076]
2025-10-10T14:39:47.127902Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602807155624198:6076]
2025-10-10T14:39:47.127907Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602807155624198:6076]
2025-10-10T14:39:47.127924Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:47.127939Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:47.127946Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:47.127953Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:47.127956Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:47.127963Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:47.127966Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:47.127989Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602807155624198:6076]
2025-10-10T14:39:47.127999Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:47.128017Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:47.128026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:47.127970Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3103
2025-10-10T14:39:47.127976Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3103
2025-10-10T14:39:47.128032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:47.128076Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ab21ee8e-d3a09aa6-8c7557e5-65c10251_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:47.128083Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:47.128087Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:47.128091Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:47.128103Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:47.128114Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:47.128142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:47.128429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:47.128444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:47.128470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:47.129110Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3104 partition: 0 MaxSeqNo: 40 sessionId: src_id|ab21ee8e-d3a09aa6-8c7557e5-65c10251_0
2025-10-10T14:39:47.129532Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca37a2f7-498693c6-7bb6bed3-4a47ffd6_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|ab21ee8e-d3a09aa6-8c7557e5-65c10251_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:47.132379Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ab21ee8e-d3a09aa6-8c7557e5-65c10251_0] Write session: try to update token
2025-10-10T14:39:47.132400Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ab21ee8e-d3a09aa6-8c7557e5-65c10251_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:47.148045Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3104 sessionId: src_id|ab21ee8e-d3a09aa6-8c7557e5-65c10251_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:47.148757Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:47.148782Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:47.148785Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:47.148788Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:47.148798Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602807155624198:6076]
2025-10-10T14:39:47.148804Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602807155624198:6076]
2025-10-10T14:39:47.148808Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602807155624198:6076]
2025-10-10T14:39:47.148868Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:47.148877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:47.148880Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:47.148883Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:47.148916Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:47.148920Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:47.149027Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:47.150876Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:47.193067Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602807937870284:4596]
2025-10-10T14:39:47.193408Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 pipe creation result: OK TabletId: 72075186224037892 Generation: 3103, pipe: [1:7559602807937870284:4596]
2025-10-10T14:39:47.271449Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:47.271758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:47.271777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:47.271830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602807937870284:4596], now have 1 active actors on pipe
2025-10-10T14:39:47.272233Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:47.272248Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:47.272253Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:47.272322Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 2 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602807937870284:4596]
2025-10-10T14:39:47.272325Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3104 reason: error at write: Disconnected sessionId: src_id|ab21ee8e-d3a09aa6-8c7557e5-65c10251_0
2025-10-10T14:39:47.272413Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:47.272591Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3104 sessionId: src_id|ab21ee8e-d3a09aa6-8c7557e5-65c10251_0 is DEAD
2025-10-10T14:39:47.272791Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab21ee8e-d3a09aa6-8c7557e5-65c10251_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:47.272800Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab21ee8e-d3a09aa6-8c7557e5-65c10251_0] Write session will restart in 0.007897s
2025-10-10T14:39:47.272838Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab21ee8e-d3a09aa6-8c7557e5-65c10251_0] Write session: Do CDS request
2025-10-10T14:39:47.272849Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab21ee8e-d3a09aa6-8c7557e5-65c10251_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:47.282056Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ab21ee8e-d3a09aa6-8c7557e5-65c10251_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:47.282192Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:47.282212Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3105
2025-10-10T14:39:47.282339Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3105 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:47.282377Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3105 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:47.282383Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3105 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:47.282395Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:47.282935Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3105 sessionId:  describe result for acl check
2025-10-10T14:39:47.282972Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:47.282979Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:47.282982Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:47.282988Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602807937870319:4561] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:47.283569Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602807937870319:4561] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:47.286151Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602807937870319:4561] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:47.289720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602807937870319:4561] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:47.289737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602807937870319:4561] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:47.289742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602807937870319:4561] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:47.289750Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3105 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:47.299999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:47.300938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:47.301177Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:47.301194Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:47.301205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:47.301274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:47.301324Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602807155624400:6072]
2025-10-10T14:39:47.302030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:47.302442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:47.302503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:47.302890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:47.302960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:47.302969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:47.302970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:47.302972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:47.302973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:47.302975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:47.302976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:47.302978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:47.302980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:47.302981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:47.302983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:47.302984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:47.302986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:47.302993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:47.303008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:47.303013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:47.303019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:47.303024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:47.303029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:47.303035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:47.303039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:47.303044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:47.303050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:47.303055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:47.303068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:47.303072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:47.303081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:47.303091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:47.303098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:47.303105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:47.303111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:47.303118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:47.303123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:47.303129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:47.303136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:47.303142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:47.303148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:47.303154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:47.303160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:47.303167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:47.303172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:47.303179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:47.303186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:47.303193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:47.303198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:47.303204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:47.303212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:47.303219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:47.303224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:47.303231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:47.303238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:47.303244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:47.303292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:47.306275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:47.307267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:47.307288Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:47.307291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:47.307295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:47.307302Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3104 [2:7559602807155624400:6072]
2025-10-10T14:39:47.307317Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:47.307338Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:47.307341Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:47.307345Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:47.307348Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:47.307367Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:47.307376Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:47.307385Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:47.307456Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:47.307468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:47.307470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:47.307473Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:47.307555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:47.307565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:47.307578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:47.307590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:47.307609Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:47.307638Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602807155624395:6072]
2025-10-10T14:39:47.307648Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602807155624395:6072]
2025-10-10T14:39:47.307651Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602807155624395:6072]
2025-10-10T14:39:47.307668Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:47.307682Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:47.307686Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:47.307688Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:47.307691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602807937870285:2438], now have 1 active actors on pipe
2025-10-10T14:39:47.307695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602807937870477:4561], now have 1 active actors on pipe
2025-10-10T14:39:47.307704Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:47.307721Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:47.307731Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:47.307715Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3104
2025-10-10T14:39:47.307773Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602807155624395:6072]
2025-10-10T14:39:47.307786Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3104
2025-10-10T14:39:47.307791Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:47.307809Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:47.307846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:47.307852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:47.307885Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|20d41f78-ee26247d-d74a88ee-bbd49ceb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:47.307895Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:47.307900Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:47.307903Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:47.307915Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:47.307927Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:47.307944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:47.308192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:47.308217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:47.308244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:47.308334Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3105 partition: 0 MaxSeqNo: 40 sessionId: src_id|20d41f78-ee26247d-d74a88ee-bbd49ceb_0
2025-10-10T14:39:47.308815Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab21ee8e-d3a09aa6-8c7557e5-65c10251_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|20d41f78-ee26247d-d74a88ee-bbd49ceb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:47.311659Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|20d41f78-ee26247d-d74a88ee-bbd49ceb_0] Write session: try to update token
2025-10-10T14:39:47.311680Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|20d41f78-ee26247d-d74a88ee-bbd49ceb_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:47.325317Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:39:47.325359Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:47.325370Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602807155624395:6072]
2025-10-10T14:39:47.325424Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:39:47.325423Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:39:47.325616Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:39:47.325784Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:47.325942Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:47.326103Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:47.326318Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:39:47.326370Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:39:47.330637Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3105 sessionId: src_id|20d41f78-ee26247d-d74a88ee-bbd49ceb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:47.333435Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:47.337562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:47.337600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:47.337670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:39:47.341531Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:39:47.347452Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:47.347474Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:47.347477Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:47.347479Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:47.347493Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602807155624395:6072]
2025-10-10T14:39:47.347498Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602807155624395:6072]
2025-10-10T14:39:47.347502Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602807155624395:6072]
2025-10-10T14:39:47.347558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:47.347567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:47.347570Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:47.347604Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:47.347620Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:47.347629Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:47.347723Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:47.372224Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602807937870547:4596]
2025-10-10T14:39:47.372512Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 pipe creation result: OK TabletId: 72075186224037892 Generation: 3104, pipe: [1:7559602807937870547:4596]
2025-10-10T14:39:47.469971Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:47.470810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602807937870547:4596], now have 1 active actors on pipe
2025-10-10T14:39:47.480961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:47.480996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:47.481190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:47.484680Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:47.484706Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:47.484715Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:47.484751Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3105 reason: error at write: Disconnected sessionId: src_id|20d41f78-ee26247d-d74a88ee-bbd49ceb_0
2025-10-10T14:39:47.484773Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 3 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602807937870547:4596]
2025-10-10T14:39:47.484960Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3105 sessionId: src_id|20d41f78-ee26247d-d74a88ee-bbd49ceb_0 is DEAD
2025-10-10T14:39:47.481272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:47.481371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:47.481439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:47.481484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:47.481489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:47.481565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:47.481627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:47.481688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:47.481758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:47.481802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:47.481805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:47.481881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:47.481941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:47.482010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:47.482078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:47.482120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:47.482123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:47.482193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:47.482261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:47.482323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:47.482388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:47.482432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:47.482435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:47.482509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:47.482574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:47.482639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:47.482705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:47.482752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:47.482755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:47.482828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:47.482889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:47.482952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:47.483016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:47.483064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:47.483068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:47.483141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:47.483205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:47.483270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:47.483337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:47.483383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:47.483386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:47.483459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:47.483523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:47.483587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:47.483649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:47.483699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:47.483703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:47.483777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:47.483840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:47.483904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:47.483972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:47.484017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:47.484021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:47.484097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:47.484159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:47.484224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:47.484293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:47.484339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:47.484342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:47.485988Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:47.486885Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20d41f78-ee26247d-d74a88ee-bbd49ceb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:47.486897Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20d41f78-ee26247d-d74a88ee-bbd49ceb_0] Write session will restart in 0.007813s
2025-10-10T14:39:47.486923Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20d41f78-ee26247d-d74a88ee-bbd49ceb_0] Write session: Do CDS request
2025-10-10T14:39:47.486930Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20d41f78-ee26247d-d74a88ee-bbd49ceb_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:47.495869Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|20d41f78-ee26247d-d74a88ee-bbd49ceb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:47.496156Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:47.496173Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3106
2025-10-10T14:39:47.496289Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3106 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:47.496328Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3106 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:47.496339Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3106 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:47.496343Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:47.496866Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3106 sessionId:  describe result for acl check
2025-10-10T14:39:47.496913Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:47.496923Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:47.496925Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:47.496933Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602807937870622:4557] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:47.497891Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602807937870622:4557] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:47.501810Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602807937870622:4557] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:47.505694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602807937870622:4557] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:47.505709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602807937870622:4557] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:47.505713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602807937870622:4557] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:47.505722Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3106 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:47.511485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:47.512275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:47.512528Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:47.512539Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:47.512551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:47.512605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:47.512654Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602807155624596:6069]
2025-10-10T14:39:47.513418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:47.513761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:47.513813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:47.514158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:47.514228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:47.514230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:47.514231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:47.514233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:47.514234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:47.514236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:47.514237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:47.514238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:47.514240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:47.514241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:47.514242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:47.514244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:47.514245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:47.514252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:47.514267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:47.514272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:47.514278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:47.514282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:47.514287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:47.514292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:47.514296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:47.514300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:47.514306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:47.514310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:47.514314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:47.514318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:47.514328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:47.514339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:47.514346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:47.514352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:47.514357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:47.514363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:47.514368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:47.514374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:47.514380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:47.514386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:47.514391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:47.514397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:47.514402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:47.514408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:47.514412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:47.514418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:47.514423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:47.514429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:47.514434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:47.514441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:47.514456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:47.514462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:47.514466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:47.514472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:47.514477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:47.514483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:47.514527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:47.517149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:47.518148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:47.518162Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:47.518165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:47.518169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:47.518176Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3105 [2:7559602807155624596:6069]
2025-10-10T14:39:47.518190Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:47.518208Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:47.518217Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:47.518220Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:47.518223Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:47.518240Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:47.518252Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:47.518259Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:47.518321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:47.518329Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:47.518331Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:47.518334Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:47.518405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:47.518412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:47.518425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:47.518443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:47.518462Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:47.518488Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602807155624591:6069]
2025-10-10T14:39:47.518495Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602807155624591:6069]
2025-10-10T14:39:47.518497Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602807155624591:6069]
2025-10-10T14:39:47.518512Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:47.518531Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:47.518551Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:47.518559Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:47.518571Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:47.518582Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:47.518584Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:47.518590Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602807155624591:6069]
2025-10-10T14:39:47.518594Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:47.518822Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3105
2025-10-10T14:39:47.518830Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3105
2025-10-10T14:39:47.518679Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:47.518737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602807937870550:2438], now have 1 active actors on pipe
2025-10-10T14:39:47.518741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602807937870798:4557], now have 1 active actors on pipe
2025-10-10T14:39:47.519074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:47.519084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:47.519116Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e1adda0e-72e95863-99e0a949-9b6f9f3d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:47.519129Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:47.519133Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:47.519136Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:47.519146Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:47.519157Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:47.519171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:47.519478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:47.519489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:47.519508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:47.519616Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3106 partition: 0 MaxSeqNo: 40 sessionId: src_id|e1adda0e-72e95863-99e0a949-9b6f9f3d_0
2025-10-10T14:39:47.520096Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20d41f78-ee26247d-d74a88ee-bbd49ceb_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|e1adda0e-72e95863-99e0a949-9b6f9f3d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:47.522991Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e1adda0e-72e95863-99e0a949-9b6f9f3d_0] Write session: try to update token
2025-10-10T14:39:47.523014Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e1adda0e-72e95863-99e0a949-9b6f9f3d_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:47.533140Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:39:47.533164Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:47.533177Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602807155624591:6069]
2025-10-10T14:39:47.533232Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:39:47.533235Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:39:47.533434Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:39:47.533580Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:47.533723Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:47.533868Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:47.534163Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:39:47.534217Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:39:47.541219Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3106 sessionId: src_id|e1adda0e-72e95863-99e0a949-9b6f9f3d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:47.544217Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:47.544432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:47.544457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:47.544500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:39:47.544613Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:39:47.552126Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:47.552145Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:47.552148Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:47.552150Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:47.552162Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602807155624591:6069]
2025-10-10T14:39:47.552166Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602807155624591:6069]
2025-10-10T14:39:47.552173Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602807155624591:6069]
2025-10-10T14:39:47.552224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:47.552226Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:47.552233Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:47.552238Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:47.552240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:47.552242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:47.552386Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:47.584994Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602807937870811:4596]
2025-10-10T14:39:47.585413Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 pipe creation result: OK TabletId: 72075186224037892 Generation: 3105, pipe: [1:7559602807937870811:4596]
2025-10-10T14:39:47.670403Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:47.679956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:47.679995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:47.680203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:47.680285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:47.680363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:47.680427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:47.680471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:47.680477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:47.680556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:47.680618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:47.680704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:47.680773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:47.680821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:47.680825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:47.680902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:47.680968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:47.681035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:47.681106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:47.681149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:47.681152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:47.681230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:47.681293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:47.681474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:47.681548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:47.681595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:47.681602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:47.681675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:47.681735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:47.681809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:47.681876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:47.681924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:47.681932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:47.682005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:47.682069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:47.682136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:47.682199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:47.682250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:47.682258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:47.682334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:47.682402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:47.682474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:47.682542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:47.682589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:47.682596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:47.682662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:47.682725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:47.682795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:47.682860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:47.682904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:47.682910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:47.682983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:47.683048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:47.683114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:47.683176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:47.683231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:47.683239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:47.683316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:47.683380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:47.683441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:47.683513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:47.683561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:47.683575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:47.683650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602807937870811:4596], now have 1 active actors on pipe
2025-10-10T14:39:47.683964Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:47.684025Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 4 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602807937870811:4596]
2025-10-10T14:39:47.684060Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:47.684068Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:47.684099Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3106 reason: error at write: Disconnected sessionId: src_id|e1adda0e-72e95863-99e0a949-9b6f9f3d_0
2025-10-10T14:39:47.684331Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3106 sessionId: src_id|e1adda0e-72e95863-99e0a949-9b6f9f3d_0 is DEAD
2025-10-10T14:39:47.685142Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:47.685592Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1adda0e-72e95863-99e0a949-9b6f9f3d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:47.685604Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1adda0e-72e95863-99e0a949-9b6f9f3d_0] Write session will restart in 0.006744s
2025-10-10T14:39:47.685632Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1adda0e-72e95863-99e0a949-9b6f9f3d_0] Write session: Do CDS request
2025-10-10T14:39:47.685639Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1adda0e-72e95863-99e0a949-9b6f9f3d_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:47.693926Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e1adda0e-72e95863-99e0a949-9b6f9f3d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:47.693973Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:47.693991Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3107
2025-10-10T14:39:47.694224Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3107 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:47.694277Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3107 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:47.694289Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3107 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:47.694293Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:47.694799Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3107 sessionId:  describe result for acl check
2025-10-10T14:39:47.694837Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:47.694846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:47.694849Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:47.694855Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602807937870827:4551] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:47.695430Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602807937870827:4551] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:47.698685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602807937870827:4551] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:47.702343Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602807937870827:4551] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:47.702368Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602807937870827:4551] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:47.702372Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602807937870827:4551] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:47.702380Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3107 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:47.713721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:47.717712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:47.718217Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:47.718237Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:47.718255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:47.718336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:47.718394Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602807155624806:6068]
2025-10-10T14:39:47.719056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:47.719486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:47.719542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:47.719883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:47.719959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:47.719960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:47.719961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:47.719963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:47.719964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:47.719965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:47.719967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:47.719968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:47.719970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:47.719971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:47.719972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:47.719973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:47.719975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:47.719982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:47.719996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:47.720001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:47.720005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:47.720011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:47.720015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:47.720019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:47.720023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:47.720027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:47.720032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:47.720036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:47.720040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:47.720045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:47.720053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:47.720063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:47.720070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:47.720076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:47.720106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:47.720114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:47.720119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:47.720125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:47.720130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:47.720136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:47.720140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:47.720146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:47.720151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:47.720168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:47.720173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:47.720179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:47.720184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:47.720189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:47.720194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:47.720200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:47.720204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:47.720210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:47.720216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:47.720233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:47.720238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:47.720243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:47.720284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:47.723648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:47.723984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:47.723990Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:47.723993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:47.723997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:47.724005Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3106 [2:7559602807155624806:6068]
2025-10-10T14:39:47.724019Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:47.724038Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:47.724042Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:47.724046Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:47.724049Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:47.724067Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:47.724076Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:47.724085Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:47.724149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:47.724151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:47.724155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:47.724158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:47.724236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:47.724238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:47.724250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:47.724263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:47.724283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:47.724306Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602807155624801:6068]
2025-10-10T14:39:47.724309Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602807155624801:6068]
2025-10-10T14:39:47.724312Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602807155624801:6068]
2025-10-10T14:39:47.724331Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:47.724335Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:47.724347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602807937870915:4551], now have 1 active actors on pipe
2025-10-10T14:39:47.724355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602807937870814:2438], now have 1 active actors on pipe
2025-10-10T14:39:47.724356Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:47.724358Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:47.724361Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:47.724378Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:47.724381Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:47.724410Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602807155624801:6068]
2025-10-10T14:39:47.724419Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:47.724428Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:47.724925Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3106
2025-10-10T14:39:47.724967Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3106
2025-10-10T14:39:47.725603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:47.725639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:47.725690Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a9dceb7d-199ca72c-4a3e251f-9bf96b5e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:47.725707Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:47.725717Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:47.725723Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:47.725741Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:47.725759Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:47.725782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:47.726012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:47.726027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:47.726053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:47.726163Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3107 partition: 0 MaxSeqNo: 40 sessionId: src_id|a9dceb7d-199ca72c-4a3e251f-9bf96b5e_0
2025-10-10T14:39:47.726614Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1adda0e-72e95863-99e0a949-9b6f9f3d_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|a9dceb7d-199ca72c-4a3e251f-9bf96b5e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:47.729587Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a9dceb7d-199ca72c-4a3e251f-9bf96b5e_0] Write session: try to update token
2025-10-10T14:39:47.729624Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a9dceb7d-199ca72c-4a3e251f-9bf96b5e_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:47.745208Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:47.745232Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:47.745235Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:47.745237Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:47.745248Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602807155624801:6068]
2025-10-10T14:39:47.745253Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602807155624801:6068]
2025-10-10T14:39:47.745257Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602807155624801:6068]
2025-10-10T14:39:47.745302Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:47.745309Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:47.745310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:47.745314Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:47.745318Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:47.745321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:47.745487Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:47.748816Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3107 sessionId: src_id|a9dceb7d-199ca72c-4a3e251f-9bf96b5e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:47.751593Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:47.783905Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602807937871089:4596]
2025-10-10T14:39:47.784264Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 pipe creation result: OK TabletId: 72075186224037892 Generation: 3106, pipe: [1:7559602807937871089:4596]
2025-10-10T14:39:47.867304Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:47.868113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:47.868132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:47.868202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602807937871089:4596], now have 1 active actors on pipe
2025-10-10T14:39:47.868415Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:47.868432Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:47.868504Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3107 reason: error at write: Disconnected sessionId: src_id|a9dceb7d-199ca72c-4a3e251f-9bf96b5e_0
2025-10-10T14:39:47.868891Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9dceb7d-199ca72c-4a3e251f-9bf96b5e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:47.868899Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9dceb7d-199ca72c-4a3e251f-9bf96b5e_0] Write session will restart in 0.008199s
2025-10-10T14:39:47.868928Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9dceb7d-199ca72c-4a3e251f-9bf96b5e_0] Write session: Do CDS request
2025-10-10T14:39:47.868935Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9dceb7d-199ca72c-4a3e251f-9bf96b5e_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:47.868735Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3107 sessionId: src_id|a9dceb7d-199ca72c-4a3e251f-9bf96b5e_0 is DEAD
2025-10-10T14:39:47.868896Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 5 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602807937871089:4596]
2025-10-10T14:39:47.868666Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:47.869236Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:47.877987Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a9dceb7d-199ca72c-4a3e251f-9bf96b5e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:47.878039Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:47.878060Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3108
2025-10-10T14:39:47.878234Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3108 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:47.878273Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3108 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:47.878283Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3108 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:47.878291Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:47.878835Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3108 sessionId:  describe result for acl check
2025-10-10T14:39:47.878870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:47.878873Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:47.878875Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:47.878882Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602807937871133:4512] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:47.879455Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602807937871133:4512] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:47.883162Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602807937871133:4512] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:47.889832Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602807937871133:4512] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:47.889865Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602807937871133:4512] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:47.889869Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602807937871133:4512] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:47.889880Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3108 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:47.905429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:47.909957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:47.910221Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:47.910234Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:47.910246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:47.910306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:47.910361Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602807155625043:6044]
2025-10-10T14:39:47.911041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:47.911417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:47.911466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:47.911806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:47.912380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:47.912390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:47.912392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:47.912393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:47.912394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:47.912396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:47.912397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:47.912399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:47.912400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:47.912402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:47.912403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:47.912404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:47.912406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:47.912415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:47.912429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:47.912433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:47.912437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:47.912441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:47.912446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:47.912450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:47.912454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:47.912458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:47.912464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:47.912468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:47.912473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:47.912477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:47.912487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:47.912497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:47.912504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:47.912510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:47.912514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:47.912520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:47.912524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:47.912529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:47.912535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:47.912540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:47.912545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:47.912551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:47.912556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:47.912561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:47.912565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:47.912571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:47.912575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:47.912582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:47.912589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:47.912594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:47.912598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:47.912603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:47.912611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:47.912617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:47.912621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:47.912626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:47.912667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:47.915715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:47.916045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:47.916058Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:47.916061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:47.916065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:47.916072Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3107 [2:7559602807155625043:6044]
2025-10-10T14:39:47.916085Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:47.916107Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:47.916110Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:47.916114Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:47.916117Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:47.916136Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:47.916150Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:47.916164Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:47.916227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:47.916235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:47.916237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:47.916240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:47.916316Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:47.916325Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:47.916337Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:47.916349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:47.916369Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:47.916390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602807937871182:4512], now have 1 active actors on pipe
2025-10-10T14:39:47.916394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602807937871124:2438], now have 1 active actors on pipe
2025-10-10T14:39:47.916403Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602807155625038:6044]
2025-10-10T14:39:47.916406Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602807155625038:6044]
2025-10-10T14:39:47.916409Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602807155625038:6044]
2025-10-10T14:39:47.916961Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3107
2025-10-10T14:39:47.917020Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3107
2025-10-10T14:39:47.916424Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:47.916441Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:47.916449Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:47.916452Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:47.916454Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:47.916456Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:47.916460Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:47.916484Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602807155625038:6044]
2025-10-10T14:39:47.916492Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:47.916498Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:47.917242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:47.917256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:47.917292Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8691c0b1-74cd7c8c-69bdb7f5-98b19526_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:47.917307Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:47.917311Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:47.917314Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:47.917359Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:47.917378Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:47.917398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:47.917605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:47.917614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:47.917852Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3108 partition: 0 MaxSeqNo: 40 sessionId: src_id|8691c0b1-74cd7c8c-69bdb7f5-98b19526_0
2025-10-10T14:39:47.917630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:47.918490Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9dceb7d-199ca72c-4a3e251f-9bf96b5e_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|8691c0b1-74cd7c8c-69bdb7f5-98b19526_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:47.921240Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8691c0b1-74cd7c8c-69bdb7f5-98b19526_0] Write session: try to update token
2025-10-10T14:39:47.921258Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8691c0b1-74cd7c8c-69bdb7f5-98b19526_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:47.938101Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3108 sessionId: src_id|8691c0b1-74cd7c8c-69bdb7f5-98b19526_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:47.940953Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:47.941221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:47.941245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:47.941290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:39:47.941489Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:39:47.950002Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:47.950026Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:47.950029Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:47.950031Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:47.950042Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602807155625038:6044]
2025-10-10T14:39:47.950050Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602807155625038:6044]
2025-10-10T14:39:47.950054Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602807155625038:6044]
2025-10-10T14:39:47.950111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:47.950119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:47.950118Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:47.950121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:47.950126Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:47.950131Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:47.950268Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:47.968690Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602807937871389:4596]
2025-10-10T14:39:47.969578Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 pipe creation result: OK TabletId: 72075186224037892 Generation: 3107, pipe: [1:7559602807937871389:4596]
2025-10-10T14:39:48.085857Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:48.094880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:48.094910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:48.095100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:48.095165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:48.095240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:48.095308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:48.095354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:48.095364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:48.095434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:48.095505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:48.095565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:48.095638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:48.095689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:48.095697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:48.095765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:48.095831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:48.095895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:48.095965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:48.096012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:48.096020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:48.096090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:48.096160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:48.096227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:48.096289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:48.096333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:48.096341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:48.096405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:48.096466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:48.096529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:48.096593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:48.096639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:48.096647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:48.096731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:48.096795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:48.096858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:48.096926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:48.096970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:48.096979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:48.097052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:48.097116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:48.097187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:48.097252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:48.097300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:48.097308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:48.097393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:48.097457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:48.097522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:48.097588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:48.097632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:48.097641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:48.097710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:48.097772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:48.097842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:48.097906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:48.097948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:48.097955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:48.098021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:48.098083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:48.098153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:48.098221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:48.098268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:48.098275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:48.098339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602807937871389:4596], now have 1 active actors on pipe
2025-10-10T14:39:48.099783Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:48.099850Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:48.099868Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:48.099903Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3108 reason: error at write: Disconnected sessionId: src_id|8691c0b1-74cd7c8c-69bdb7f5-98b19526_0
2025-10-10T14:39:48.100116Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:48.100147Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3108 sessionId: src_id|8691c0b1-74cd7c8c-69bdb7f5-98b19526_0 is DEAD
2025-10-10T14:39:48.100170Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 6 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602807937871389:4596]
2025-10-10T14:39:48.101534Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8691c0b1-74cd7c8c-69bdb7f5-98b19526_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:48.101550Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8691c0b1-74cd7c8c-69bdb7f5-98b19526_0] Write session will restart in 0.008582s
2025-10-10T14:39:48.101577Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8691c0b1-74cd7c8c-69bdb7f5-98b19526_0] Write session: Do CDS request
2025-10-10T14:39:48.101584Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8691c0b1-74cd7c8c-69bdb7f5-98b19526_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:48.111976Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8691c0b1-74cd7c8c-69bdb7f5-98b19526_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:48.112083Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:48.112100Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3109
2025-10-10T14:39:48.112238Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3109 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:48.112275Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3109 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:48.112289Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3109 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:48.112294Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:48.112878Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3109 sessionId:  describe result for acl check
2025-10-10T14:39:48.112924Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:48.112933Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:48.112935Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:48.112942Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602812232838832:4507] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:48.113578Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602812232838832:4507] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:48.116646Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602812232838832:4507] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:48.119113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:48.119613Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602812232838832:4507] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:48.119629Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602812232838832:4507] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:48.119633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602812232838832:4507] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:48.119644Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3109 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:48.123944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:48.124221Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:48.124234Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:48.124248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:48.124308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:48.124354Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602811450592539:6029]
2025-10-10T14:39:48.125000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:48.125351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:48.125397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:48.125725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:48.125785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:48.125792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:48.125793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:48.125794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:48.125796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:48.125797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:48.125799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:48.125800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:48.125801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:48.125802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:48.125804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:48.125805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:48.125806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:48.125812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:48.125825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:48.125830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:48.125834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:48.125839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:48.125843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:48.125848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:48.125852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:48.125856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:48.125861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:48.125865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:48.125870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:48.125874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:48.125882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:48.125892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:48.125899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:48.125906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:48.125911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:48.125917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:48.125922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:48.125927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:48.125932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:48.125938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:48.125942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:48.125948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:48.125953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:48.125958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:48.125963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:48.125968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:48.125973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:48.125979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:48.125985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:48.125990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:48.125995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:48.126001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:48.126005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:48.126011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:48.126015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:48.126020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:48.126062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:48.128626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:48.129554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:48.129570Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:48.129573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:48.129577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:48.129584Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3108 [2:7559602811450592539:6029]
2025-10-10T14:39:48.129599Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:48.129617Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:48.129620Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:48.129624Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:48.129626Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:48.129644Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:48.129658Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:48.129670Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:48.129734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:48.129742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:48.129744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:48.129747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:48.129816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:48.129823Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:48.129836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:48.129853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:48.129875Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:48.129902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602812232838940:4507], now have 1 active actors on pipe
2025-10-10T14:39:48.129911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602812232838687:2438], now have 1 active actors on pipe
2025-10-10T14:39:48.129918Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602811450592533:6029]
2025-10-10T14:39:48.129921Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602811450592533:6029]
2025-10-10T14:39:48.129924Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602811450592533:6029]
2025-10-10T14:39:48.129938Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:48.129957Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:48.129971Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:48.129974Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:48.129976Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:48.129978Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:48.129979Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:48.129987Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3108
2025-10-10T14:39:48.129990Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3108
2025-10-10T14:39:48.130006Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602811450592533:6029]
2025-10-10T14:39:48.130020Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:48.130046Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:48.130080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:48.130090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:48.130123Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8e21b096-f2d166f4-2523d159-5b2d89ac_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:48.130136Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:48.130139Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:48.130142Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:48.130153Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:48.130169Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:48.130182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:48.130291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:48.130300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:48.130317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:48.130415Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3109 partition: 0 MaxSeqNo: 40 sessionId: src_id|8e21b096-f2d166f4-2523d159-5b2d89ac_0
2025-10-10T14:39:48.130865Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8691c0b1-74cd7c8c-69bdb7f5-98b19526_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|8e21b096-f2d166f4-2523d159-5b2d89ac_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:48.133567Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8e21b096-f2d166f4-2523d159-5b2d89ac_0] Write session: try to update token
2025-10-10T14:39:48.133586Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8e21b096-f2d166f4-2523d159-5b2d89ac_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:48.142604Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:39:48.142628Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:48.142641Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602811450592533:6029]
2025-10-10T14:39:48.142701Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:39:48.142700Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:39:48.142925Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:39:48.143101Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:48.143276Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:48.143433Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:48.143660Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:39:48.143724Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:39:48.149001Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3109 sessionId: src_id|8e21b096-f2d166f4-2523d159-5b2d89ac_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:48.151881Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:48.152118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:48.152154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:48.152200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:39:48.152307Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:39:48.163445Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:48.163471Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:48.163474Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:48.163477Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:48.163492Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602811450592533:6029]
2025-10-10T14:39:48.163495Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602811450592533:6029]
2025-10-10T14:39:48.163502Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602811450592533:6029]
2025-10-10T14:39:48.163557Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:48.163563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:48.163565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:48.163566Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:48.163573Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:48.163577Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:48.163725Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:48.200162Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602812232838952:4596]
2025-10-10T14:39:48.200506Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 pipe creation result: OK TabletId: 72075186224037892 Generation: 3108, pipe: [1:7559602812232838952:4596]
2025-10-10T14:39:48.284141Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:48.293670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:48.293707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:48.293916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:48.293991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:48.294061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:48.294130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:48.294185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:48.294191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:48.294268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:48.294328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:48.294394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:48.294461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:48.294507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:48.294511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:48.294583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:48.294648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:48.294715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:48.294780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:48.294823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:48.294826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:48.294898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:48.294964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:48.295031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:48.295102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:48.295146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:48.295150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:48.295226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:48.295290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:48.295354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:48.295416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:48.295462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:48.295465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:48.295537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:48.295600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:48.295663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:48.295730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:48.295776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:48.295779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:48.295853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:48.295916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:48.295981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:48.296049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:48.296094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:48.296098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:48.296175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:48.296240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:48.296307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:48.296374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:48.296418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:48.296422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:48.296502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:48.296558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:48.296625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:48.296713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:48.296762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:48.296766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:48.296837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:48.296906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:48.296971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:48.297034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:48.297078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:48.297081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:48.297171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602812232838952:4596], now have 1 active actors on pipe
2025-10-10T14:39:48.297936Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e21b096-f2d166f4-2523d159-5b2d89ac_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:48.297949Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e21b096-f2d166f4-2523d159-5b2d89ac_0] Write session will restart in 0.005940s
2025-10-10T14:39:48.297974Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e21b096-f2d166f4-2523d159-5b2d89ac_0] Write session: Do CDS request
2025-10-10T14:39:48.297981Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e21b096-f2d166f4-2523d159-5b2d89ac_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:48.298893Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:48.297458Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:48.297475Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:48.297509Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3109 reason: error at write: Disconnected sessionId: src_id|8e21b096-f2d166f4-2523d159-5b2d89ac_0
2025-10-10T14:39:48.297743Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:48.297802Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 7 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602812232838952:4596]
2025-10-10T14:39:48.297964Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3109 sessionId: src_id|8e21b096-f2d166f4-2523d159-5b2d89ac_0 is DEAD
2025-10-10T14:39:48.304973Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8e21b096-f2d166f4-2523d159-5b2d89ac_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:48.307872Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:48.307898Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3110
2025-10-10T14:39:48.308103Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3110 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:48.308167Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3110 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:48.308179Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3110 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:48.308184Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:48.308780Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3110 sessionId:  describe result for acl check
2025-10-10T14:39:48.308821Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:48.308823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:48.308825Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:48.308832Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602812232838969:4486] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:48.309445Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602812232838969:4486] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:48.312535Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602812232838969:4486] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:48.317757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602812232838969:4486] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:48.317776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602812232838969:4486] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:48.317781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602812232838969:4486] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:48.317791Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3110 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:48.329590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:48.334246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:48.334554Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:48.334567Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:48.334582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:48.334652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:48.334706Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602811450592743:6030]
2025-10-10T14:39:48.335376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:48.335883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:48.335959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:48.336362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:48.336450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:48.336460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:48.336462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:48.336463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:48.336464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:48.336466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:48.336467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:48.336469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:48.336470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:48.336471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:48.336472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:48.336474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:48.336475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:48.336483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:48.336496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:48.336500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:48.336504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:48.336508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:48.336512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:48.336532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:48.336537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:48.336541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:48.336546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:48.336549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:48.336554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:48.336558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:48.336571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:48.336587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:48.336599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:48.336605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:48.336609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:48.336614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:48.336620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:48.336625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:48.336630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:48.336636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:48.336641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:48.336647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:48.336653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:48.336658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:48.336663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:48.336669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:48.336674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:48.336693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:48.336698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:48.336704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:48.336715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:48.336721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:48.336726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:48.336731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:48.336736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:48.336742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:48.336783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:48.339720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:48.340067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:48.340083Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:48.340086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:48.340091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:48.340099Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3109 [2:7559602811450592743:6030]
2025-10-10T14:39:48.340126Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:48.340148Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:48.340151Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:48.340155Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:48.340158Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:48.340177Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:48.340186Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:48.340194Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:48.340259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:48.340268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:48.340270Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:48.340273Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:48.340354Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:48.340364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:48.340376Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:48.340388Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:48.340404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:48.340428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602812232839034:4486], now have 1 active actors on pipe
2025-10-10T14:39:48.340439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602812232838954:2438], now have 1 active actors on pipe
2025-10-10T14:39:48.340447Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602811450592738:6030]
2025-10-10T14:39:48.340450Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602811450592738:6030]
2025-10-10T14:39:48.340452Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602811450592738:6030]
2025-10-10T14:39:48.340471Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:48.340492Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:48.340495Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:48.340500Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:48.340504Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:48.340509Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:48.340513Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:48.340548Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602811450592738:6030]
2025-10-10T14:39:48.340567Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:48.340580Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:48.340583Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3109
2025-10-10T14:39:48.340889Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3109
2025-10-10T14:39:48.340956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:48.340970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:48.341004Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|77d1e4ac-4a59a6bb-cfd03bad-d7ed9290_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:48.341014Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:48.341018Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:48.341021Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:48.341035Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:48.341054Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:48.341072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:48.341255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:48.341268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:48.341286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:48.341820Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3110 partition: 0 MaxSeqNo: 40 sessionId: src_id|77d1e4ac-4a59a6bb-cfd03bad-d7ed9290_0
2025-10-10T14:39:48.344008Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e21b096-f2d166f4-2523d159-5b2d89ac_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|77d1e4ac-4a59a6bb-cfd03bad-d7ed9290_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:48.347244Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|77d1e4ac-4a59a6bb-cfd03bad-d7ed9290_0] Write session: try to update token
2025-10-10T14:39:48.347269Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|77d1e4ac-4a59a6bb-cfd03bad-d7ed9290_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:48.353625Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:39:48.353653Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:48.353666Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602811450592738:6030]
2025-10-10T14:39:48.353721Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:39:48.353736Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:39:48.353956Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:39:48.354131Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:48.354313Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:48.354486Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:48.354742Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:39:48.354781Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:39:48.369720Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3110 sessionId: src_id|77d1e4ac-4a59a6bb-cfd03bad-d7ed9290_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:48.372930Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:48.373777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:48.373803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:48.373829Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:48.373833Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:48.373835Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:48.373836Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:48.373844Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602811450592738:6030]
2025-10-10T14:39:48.373847Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602811450592738:6030]
2025-10-10T14:39:48.373850Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602811450592738:6030]
2025-10-10T14:39:48.373892Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:48.373899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:48.373902Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:48.373904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:48.373906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:48.373907Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:48.374046Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:48.399637Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602812232839220:4596]
2025-10-10T14:39:48.400053Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 pipe creation result: OK TabletId: 72075186224037892 Generation: 3109, pipe: [1:7559602812232839220:4596]
2025-10-10T14:39:48.493325Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:48.493579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:39:48.493618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602812232839220:4596], now have 1 active actors on pipe
2025-10-10T14:39:48.494291Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:39:48.494962Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77d1e4ac-4a59a6bb-cfd03bad-d7ed9290_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:48.494422Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:48.494426Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:48.494520Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3110 reason: error at write: Disconnected sessionId: src_id|77d1e4ac-4a59a6bb-cfd03bad-d7ed9290_0
2025-10-10T14:39:48.494612Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:48.494989Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77d1e4ac-4a59a6bb-cfd03bad-d7ed9290_0] Write session will restart in 0.008333s
2025-10-10T14:39:48.494652Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 8 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602812232839220:4596]
2025-10-10T14:39:48.494720Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3110 sessionId: src_id|77d1e4ac-4a59a6bb-cfd03bad-d7ed9290_0 is DEAD
2025-10-10T14:39:48.495021Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77d1e4ac-4a59a6bb-cfd03bad-d7ed9290_0] Write session: Do CDS request
2025-10-10T14:39:48.495029Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77d1e4ac-4a59a6bb-cfd03bad-d7ed9290_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:48.504957Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|77d1e4ac-4a59a6bb-cfd03bad-d7ed9290_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:48.505105Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:48.505126Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3111
2025-10-10T14:39:48.505273Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3111 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:48.505310Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3111 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:48.505316Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3111 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:48.505320Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:48.506141Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3111 sessionId:  describe result for acl check
2025-10-10T14:39:48.506180Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:48.506187Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:48.506189Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:48.506196Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602812232839275:4485] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:48.506783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602812232839275:4485] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:48.510772Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602812232839275:4485] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:48.515428Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602812232839275:4485] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:48.515449Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602812232839275:4485] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:48.515452Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602812232839275:4485] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:48.515463Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3111 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:48.522180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:48.526999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:48.527296Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:48.527311Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:48.527324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:48.527386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:48.527435Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602811450592945:6040]
2025-10-10T14:39:48.528130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:48.528478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:48.528529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:48.528851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:48.528926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:48.528935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:48.528936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:48.528937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:48.528939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:48.528940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:48.528941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:48.528942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:48.528944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:48.528945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:48.528947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:48.528949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:48.528950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:48.528957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:48.528971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:48.528976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:48.528981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:48.528985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:48.528990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:48.528994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:48.528998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:48.529003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:48.529007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:48.529011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:48.529023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:48.529026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:48.529034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:48.529039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:48.529045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:48.529051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:48.529055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:48.529058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:48.529061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:48.529065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:48.529068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:48.529072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:48.529075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:48.529079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:48.529082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:48.529086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:48.529089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:48.529093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:48.529096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:48.529099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:48.529102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:48.529105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:48.529108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:48.529113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:48.529115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:48.529119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:48.529122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:48.529125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:48.529149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:48.532908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:48.533230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:48.533244Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:48.533247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:48.533251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:48.533261Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3110 [2:7559602811450592945:6040]
2025-10-10T14:39:48.533278Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:48.533299Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:48.533308Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:48.533311Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:48.533313Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:48.533711Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3110
2025-10-10T14:39:48.533723Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3110
2025-10-10T14:39:48.533347Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:48.533364Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:48.533372Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:48.533427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:48.533429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:48.533432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:48.533435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:48.533515Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:48.533519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:48.533529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:48.533541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:48.533557Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:48.533580Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602811450592940:6040]
2025-10-10T14:39:48.533583Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602811450592940:6040]
2025-10-10T14:39:48.533585Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602811450592940:6040]
2025-10-10T14:39:48.533595Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:48.533605Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:48.533607Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:48.533609Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:48.533610Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:48.533626Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:48.533630Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:48.533643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602812232839424:4485], now have 1 active actors on pipe
2025-10-10T14:39:48.533647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602812232839223:2438], now have 1 active actors on pipe
2025-10-10T14:39:48.533683Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602811450592940:6040]
2025-10-10T14:39:48.533693Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:48.533726Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:48.533972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:48.533981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:48.534018Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a10c7550-97696566-ff1425e6-e051b5f5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:48.534033Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:48.534038Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:48.534046Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:48.534058Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:48.534076Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:48.534094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:48.534482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:48.534500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:48.534530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:48.534759Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3111 partition: 0 MaxSeqNo: 40 sessionId: src_id|a10c7550-97696566-ff1425e6-e051b5f5_0
2025-10-10T14:39:48.535270Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77d1e4ac-4a59a6bb-cfd03bad-d7ed9290_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|a10c7550-97696566-ff1425e6-e051b5f5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:48.538259Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a10c7550-97696566-ff1425e6-e051b5f5_0] Write session: try to update token
2025-10-10T14:39:48.538278Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a10c7550-97696566-ff1425e6-e051b5f5_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:48.546569Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:39:48.546586Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:48.546597Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602811450592940:6040]
2025-10-10T14:39:48.546646Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:39:48.546650Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:39:48.546830Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:39:48.546988Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:48.547134Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:48.547278Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:48.547473Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:39:48.547520Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:39:48.554086Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3111 sessionId: src_id|a10c7550-97696566-ff1425e6-e051b5f5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:48.556777Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:48.559676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:48.559702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:48.559739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:39:48.563297Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:39:48.571677Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:48.571696Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:48.571699Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:48.571700Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:48.571710Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602811450592940:6040]
2025-10-10T14:39:48.571713Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602811450592940:6040]
2025-10-10T14:39:48.571717Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602811450592940:6040]
2025-10-10T14:39:48.571765Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:48.571770Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:48.571775Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:48.571776Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:48.571777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:48.571780Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:48.571918Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:48.594379Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602812232839489:4596]
2025-10-10T14:39:48.594716Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 pipe creation result: OK TabletId: 72075186224037892 Generation: 3110, pipe: [1:7559602812232839489:4596]
2025-10-10T14:39:48.696032Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:48.705221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:48.705258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:48.705469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:48.705537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:48.705609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:48.705676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:48.705724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:48.705735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:48.705808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:48.705872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:48.705937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:48.706007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:48.706056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:48.706064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:48.706130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:48.706193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:48.706259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:48.706323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:48.706366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:48.706378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:48.706443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:48.706503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:48.706570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:48.706630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:48.706677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:48.706685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:48.706750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:48.706810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:48.706876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:48.706940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:48.706985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:48.706996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:48.707061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:48.707124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:48.707187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:48.707251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:48.707294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:48.707302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:48.707370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:48.707436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:48.707503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:48.707568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:48.707611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:48.707619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:48.707682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:48.707741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:48.707813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:48.707876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:48.707921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:48.707929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:48.707995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:48.708056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:48.708117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:48.708184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:48.708229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:48.708237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:48.708301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:48.708363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:48.708439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:48.708504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:48.708549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:48.708565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:48.708632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602812232839489:4596], now have 1 active actors on pipe
2025-10-10T14:39:48.708936Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 9 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602812232839489:4596]
2025-10-10T14:39:48.708945Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:48.708949Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:48.708969Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:48.708982Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3111 reason: error at write: Disconnected sessionId: src_id|a10c7550-97696566-ff1425e6-e051b5f5_0
2025-10-10T14:39:48.709267Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3111 sessionId: src_id|a10c7550-97696566-ff1425e6-e051b5f5_0 is DEAD
2025-10-10T14:39:48.709458Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a10c7550-97696566-ff1425e6-e051b5f5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:48.709477Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a10c7550-97696566-ff1425e6-e051b5f5_0] Write session will restart in 0.005977s
2025-10-10T14:39:48.709503Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a10c7550-97696566-ff1425e6-e051b5f5_0] Write session: Do CDS request
2025-10-10T14:39:48.709509Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a10c7550-97696566-ff1425e6-e051b5f5_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:48.710298Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:48.716910Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a10c7550-97696566-ff1425e6-e051b5f5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:48.717002Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:48.717019Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3112
2025-10-10T14:39:48.717170Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3112 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:48.717212Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3112 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:48.717222Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3112 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:48.717226Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:48.717739Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3112 sessionId:  describe result for acl check
2025-10-10T14:39:48.717790Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:48.717796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:48.717798Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:48.717804Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602812232839507:4482] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:48.718355Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602812232839507:4482] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:48.721401Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602812232839507:4482] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:48.724110Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602812232839507:4482] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:48.724127Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602812232839507:4482] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:48.724130Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602812232839507:4482] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:48.724139Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3112 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:48.729593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:48.734798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:48.735086Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:48.735103Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:48.735118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:48.735194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:48.735247Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602811450593161:6036]
2025-10-10T14:39:48.735934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:48.736339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:48.736393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:48.736762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:48.736832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:48.736834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:48.736835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:48.736837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:48.736838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:48.736840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:48.736842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:48.736843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:48.736845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:48.736846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:48.736847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:48.736849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:48.736851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:48.736858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:48.736873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:48.736878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:48.736883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:48.736888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:48.736892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:48.736896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:48.736901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:48.736904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:48.736909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:48.736912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:48.736916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:48.736920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:48.736929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:48.736938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:48.736945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:48.736951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:48.736956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:48.736962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:48.736968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:48.736974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:48.736980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:48.736987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:48.736992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:48.736999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:48.737004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:48.737011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:48.737016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:48.737022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:48.737027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:48.737033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:48.737038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:48.737046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:48.737054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:48.737060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:48.737066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:48.737072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:48.737077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:48.737083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:48.737127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:48.739875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:48.740209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:48.740223Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:48.740226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:48.740231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:48.740239Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3111 [2:7559602811450593161:6036]
2025-10-10T14:39:48.740252Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:48.740270Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:48.740278Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:48.740282Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:48.740285Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:48.740302Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:48.740315Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:48.740323Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:48.740388Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:48.740396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:48.740398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:48.740401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:48.740471Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:48.740481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:48.740494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:48.740508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:48.740534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:48.740557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602812232839492:2438], now have 1 active actors on pipe
2025-10-10T14:39:48.740562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602812232839692:4482], now have 1 active actors on pipe
2025-10-10T14:39:48.740570Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602811450593156:6036]
2025-10-10T14:39:48.740572Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602811450593156:6036]
2025-10-10T14:39:48.740589Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602811450593156:6036]
2025-10-10T14:39:48.740605Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:48.740619Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:48.740640Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:48.740649Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:48.740691Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602811450593156:6036]
2025-10-10T14:39:48.740700Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:48.740735Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:48.740747Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:48.740749Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:48.740764Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:48.740818Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3111
2025-10-10T14:39:48.740878Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3111
2025-10-10T14:39:48.740944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:48.740976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:48.741014Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|195643f1-34f4ed8b-d51876ea-31b3a3b3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:48.741041Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:48.741046Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:48.741049Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:48.741063Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:48.741077Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:48.741094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:48.741579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:48.741591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:48.741613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:48.741708Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3112 partition: 0 MaxSeqNo: 40 sessionId: src_id|195643f1-34f4ed8b-d51876ea-31b3a3b3_0
2025-10-10T14:39:48.742152Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a10c7550-97696566-ff1425e6-e051b5f5_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|195643f1-34f4ed8b-d51876ea-31b3a3b3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:48.745179Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|195643f1-34f4ed8b-d51876ea-31b3a3b3_0] Write session: try to update token
2025-10-10T14:39:48.745200Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|195643f1-34f4ed8b-d51876ea-31b3a3b3_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:48.752713Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:39:48.752737Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:48.752748Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602811450593156:6036]
2025-10-10T14:39:48.752818Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:39:48.753004Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:39:48.753154Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:48.753298Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:48.753461Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:48.753657Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:39:48.753726Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:39:48.753808Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:39:48.760645Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3112 sessionId: src_id|195643f1-34f4ed8b-d51876ea-31b3a3b3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:48.763487Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:48.763833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:48.763858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:48.763913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:39:48.764014Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:39:48.771344Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:48.771366Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:48.771369Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:48.771372Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:48.771385Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602811450593156:6036]
2025-10-10T14:39:48.771390Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602811450593156:6036]
2025-10-10T14:39:48.771394Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602811450593156:6036]
2025-10-10T14:39:48.771447Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:48.771458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:48.771466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:48.771539Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:48.771561Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:48.771564Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:48.771604Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:48.809017Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602812232839759:4596]
2025-10-10T14:39:48.809373Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 pipe creation result: OK TabletId: 72075186224037892 Generation: 3111, pipe: [1:7559602812232839759:4596]
2025-10-10T14:39:48.892501Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:48.901657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:48.901683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:48.901866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:48.901930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:48.901994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:48.902059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:48.902103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:48.902116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:48.902182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:48.902247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:48.902317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:48.902386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:48.902431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:48.902439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:48.902504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:48.902567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:48.902632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:48.902696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:48.902739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:48.902746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:48.902814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:48.902878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:48.905215Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 10 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602812232839759:4596]
2025-10-10T14:39:48.905216Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:48.905270Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:48.905274Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:48.905307Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3112 reason: error at write: Disconnected sessionId: src_id|195643f1-34f4ed8b-d51876ea-31b3a3b3_0
2025-10-10T14:39:48.902944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:48.903014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:48.903053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:48.903056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:48.903122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:48.903182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:48.903245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:48.903305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:48.903349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:48.903353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:48.903423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:48.903484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:48.903547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:48.903608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:48.903649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:48.903652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:48.903721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:48.903780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:48.903849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:48.903912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:48.903952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:48.903958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:48.904028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:48.904086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:48.904147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:48.904209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:48.904251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:48.904254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:48.904323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:48.904380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:48.904448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:48.904512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:48.904555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:48.904558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:48.904625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:48.904701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:48.904761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:48.904821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:48.904862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:48.904866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:48.904939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602812232839759:4596], now have 1 active actors on pipe
2025-10-10T14:39:48.905566Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3112 sessionId: src_id|195643f1-34f4ed8b-d51876ea-31b3a3b3_0 is DEAD
2025-10-10T14:39:48.905985Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|195643f1-34f4ed8b-d51876ea-31b3a3b3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:48.905997Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|195643f1-34f4ed8b-d51876ea-31b3a3b3_0] Write session will restart in 0.007490s
2025-10-10T14:39:48.906025Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|195643f1-34f4ed8b-d51876ea-31b3a3b3_0] Write session: Do CDS request
2025-10-10T14:39:48.906031Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|195643f1-34f4ed8b-d51876ea-31b3a3b3_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:48.906652Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:48.915006Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|195643f1-34f4ed8b-d51876ea-31b3a3b3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:48.915110Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:48.915127Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3113
2025-10-10T14:39:48.915303Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3113 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:48.915351Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3113 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:48.915357Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3113 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:48.915361Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:48.915863Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3113 sessionId:  describe result for acl check
2025-10-10T14:39:48.915901Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:48.915908Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:48.915910Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:48.915918Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602812232839841:4434] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:48.916497Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602812232839841:4434] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:48.922360Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602812232839841:4434] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:48.931156Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602812232839841:4434] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:48.931180Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602812232839841:4434] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:48.931185Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602812232839841:4434] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:48.931196Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3113 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:48.934818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:48.940055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:48.940333Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:48.940339Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:48.940351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:48.940409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:48.940448Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602811450593403:6013]
2025-10-10T14:39:48.941104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:48.942213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:48.942272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:48.942634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:48.942685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:48.942687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:48.942688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:48.942690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:48.942691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:48.942693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:48.942695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:48.942696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:48.942697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:48.942699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:48.942701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:48.942702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:48.942704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:48.942711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:48.942726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:48.942731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:48.942736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:48.942741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:48.942746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:48.942751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:48.942757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:48.942762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:48.942767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:48.942771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:48.942776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:48.942780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:48.942792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:48.942803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:48.942809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:48.942814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:48.942819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:48.942824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:48.942829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:48.942835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:48.942841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:48.942847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:48.942852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:48.942859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:48.942864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:48.942870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:48.942875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:48.942881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:48.942886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:48.942895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:48.942900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:48.942906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:48.942911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:48.942916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:48.942921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:48.942927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:48.942932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:48.942938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:48.942985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:48.946868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:48.947725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:48.947737Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:48.947740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:48.947744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:48.947752Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3112 [2:7559602811450593403:6013]
2025-10-10T14:39:48.947766Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:48.947787Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:48.947790Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:48.947794Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:48.947796Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:48.947816Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:48.947824Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:48.947840Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:48.947907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:48.947909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:48.947911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:48.947914Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:48.947997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:48.948000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:48.948012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:48.948026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:48.948045Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:48.948068Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602811450593398:6013]
2025-10-10T14:39:48.948071Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602811450593398:6013]
2025-10-10T14:39:48.948073Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602811450593398:6013]
2025-10-10T14:39:48.948084Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:48.948099Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:48.948116Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:48.948120Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:48.948137Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:48.948141Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:48.948143Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:48.948153Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602811450593398:6013]
2025-10-10T14:39:48.948156Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:48.948162Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:48.948176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602812232839808:2438], now have 1 active actors on pipe
2025-10-10T14:39:48.948181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602812232840058:4434], now have 1 active actors on pipe
2025-10-10T14:39:48.948497Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3112
2025-10-10T14:39:48.948555Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3112
2025-10-10T14:39:48.948681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:48.948697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:48.948734Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|44e145a9-852c6651-5a56e666-e66afa7a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:48.948743Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:48.948747Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:48.948750Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:48.948767Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:48.948782Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:48.948799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:48.949951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:48.949964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:48.949989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:48.952306Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3113 partition: 0 MaxSeqNo: 40 sessionId: src_id|44e145a9-852c6651-5a56e666-e66afa7a_0
2025-10-10T14:39:48.952864Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|195643f1-34f4ed8b-d51876ea-31b3a3b3_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|44e145a9-852c6651-5a56e666-e66afa7a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:48.955913Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|44e145a9-852c6651-5a56e666-e66afa7a_0] Write session: try to update token
2025-10-10T14:39:48.955938Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|44e145a9-852c6651-5a56e666-e66afa7a_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:48.973549Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3113 sessionId: src_id|44e145a9-852c6651-5a56e666-e66afa7a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:48.976396Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:48.978028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:48.978058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:48.978101Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:48.978105Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:48.978109Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:48.978112Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:48.978122Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602811450593398:6013]
2025-10-10T14:39:48.978130Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602811450593398:6013]
2025-10-10T14:39:48.978135Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602811450593398:6013]
2025-10-10T14:39:48.978204Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:48.978212Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:48.978214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:48.978226Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:48.978234Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:48.978237Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:48.978359Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:49.005568Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602816527807370:4596]
2025-10-10T14:39:49.006019Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 pipe creation result: OK TabletId: 72075186224037892 Generation: 3112, pipe: [1:7559602816527807370:4596]
2025-10-10T14:39:49.103535Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:49.104334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:39:49.104403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602816527807370:4596], now have 1 active actors on pipe
2025-10-10T14:39:49.104717Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:39:49.104852Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:49.104874Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:49.104962Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3113 reason: error at write: Disconnected sessionId: src_id|44e145a9-852c6651-5a56e666-e66afa7a_0
2025-10-10T14:39:49.105082Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:49.105130Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 11 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602816527807370:4596]
2025-10-10T14:39:49.105146Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3113 sessionId: src_id|44e145a9-852c6651-5a56e666-e66afa7a_0 is DEAD
2025-10-10T14:39:49.105553Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|44e145a9-852c6651-5a56e666-e66afa7a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:49.105565Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|44e145a9-852c6651-5a56e666-e66afa7a_0] Write session will restart in 0.008480s
2025-10-10T14:39:49.105589Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|44e145a9-852c6651-5a56e666-e66afa7a_0] Write session: Do CDS request
2025-10-10T14:39:49.105594Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|44e145a9-852c6651-5a56e666-e66afa7a_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:49.115053Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|44e145a9-852c6651-5a56e666-e66afa7a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:49.115171Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:49.115198Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3114
2025-10-10T14:39:49.115417Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3114 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:49.115464Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3114 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:49.115474Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3114 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:49.115480Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:49.116227Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3114 sessionId:  describe result for acl check
2025-10-10T14:39:49.116268Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:49.116270Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:49.116272Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:49.116279Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602816527807457:4427] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:49.116845Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602816527807457:4427] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:49.119482Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602816527807457:4427] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:49.122575Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602816527807457:4427] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:49.122589Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602816527807457:4427] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:49.122592Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602816527807457:4427] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:49.122602Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3114 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:49.124109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:49.128587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:49.128868Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:49.128883Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:49.128897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:49.128971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:49.129021Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602815745560904:6012]
2025-10-10T14:39:49.129668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:49.130043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:49.130105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:49.130463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:49.130540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:49.130546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:49.130548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:49.130549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:49.130551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:49.130552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:49.130553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:49.130555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:49.130556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:49.130557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:49.130558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:49.130559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:49.130561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:49.130568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:49.130583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:49.130587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:49.130592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:49.130596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:49.130600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:49.130605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:49.130609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:49.130613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:49.130619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:49.130623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:49.130627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:49.130632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:49.130640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:49.130654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:49.130661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:49.130667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:49.130672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:49.130677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:49.130681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:49.130696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:49.130701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:49.130707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:49.130714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:49.130719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:49.130725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:49.130731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:49.130735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:49.130741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:49.130746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:49.130752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:49.130756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:49.130761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:49.130777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:49.130786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:49.130791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:49.130797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:49.130807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:49.130812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:49.130859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:49.133858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:49.134228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:49.134243Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:49.134245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:49.134250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:49.134257Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3113 [2:7559602815745560904:6012]
2025-10-10T14:39:49.134271Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:49.134295Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:49.134298Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:49.134302Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:49.134305Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:49.134326Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:49.134339Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:49.134350Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:49.134414Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:49.134421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:49.134423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:49.134426Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:49.134516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:49.134524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:49.134536Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:49.134546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:49.134568Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:49.134596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602816527807372:2438], now have 1 active actors on pipe
2025-10-10T14:39:49.134604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602816527807628:4427], now have 1 active actors on pipe
2025-10-10T14:39:49.134611Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602815745560899:6012]
2025-10-10T14:39:49.134614Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602815745560899:6012]
2025-10-10T14:39:49.134616Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602815745560899:6012]
2025-10-10T14:39:49.134631Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:49.134653Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:49.134654Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:49.134658Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:49.134660Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:49.134672Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3113
2025-10-10T14:39:49.134675Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:49.134678Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:49.134703Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602815745560899:6012]
2025-10-10T14:39:49.134673Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3113
2025-10-10T14:39:49.134707Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:49.134709Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:49.134723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:49.134728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:49.134782Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|99d8ec1-f00de9a2-346bfbf7-d6e8bf2e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:49.134794Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:49.134797Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:49.134800Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:49.134812Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:49.134829Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:49.134857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:49.134982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:49.134991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:49.135007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:49.135113Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3114 partition: 0 MaxSeqNo: 40 sessionId: src_id|99d8ec1-f00de9a2-346bfbf7-d6e8bf2e_0
2025-10-10T14:39:49.135530Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|44e145a9-852c6651-5a56e666-e66afa7a_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|99d8ec1-f00de9a2-346bfbf7-d6e8bf2e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:49.138336Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|99d8ec1-f00de9a2-346bfbf7-d6e8bf2e_0] Write session: try to update token
2025-10-10T14:39:49.138357Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|99d8ec1-f00de9a2-346bfbf7-d6e8bf2e_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:49.153499Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3114 sessionId: src_id|99d8ec1-f00de9a2-346bfbf7-d6e8bf2e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:49.155473Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:49.155496Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:49.155500Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:49.155503Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:49.155514Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602815745560899:6012]
2025-10-10T14:39:49.155520Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602815745560899:6012]
2025-10-10T14:39:49.155524Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602815745560899:6012]
2025-10-10T14:39:49.155576Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:49.155579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:49.155584Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:49.155588Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:49.155588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:49.155591Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:49.155751Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:49.156253Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:49.205196Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602816527807643:4596]
2025-10-10T14:39:49.205458Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 pipe creation result: OK TabletId: 72075186224037892 Generation: 3113, pipe: [1:7559602816527807643:4596]
2025-10-10T14:39:49.276229Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:49.276555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:49.276570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:49.276617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602816527807643:4596], now have 1 active actors on pipe
2025-10-10T14:39:49.276852Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:49.276877Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:49.276950Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 12 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602816527807643:4596]
2025-10-10T14:39:49.276972Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:39:49.277055Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3114 reason: status is not ok: tablet will be restarted right now sessionId: src_id|99d8ec1-f00de9a2-346bfbf7-d6e8bf2e_0
2025-10-10T14:39:49.277281Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3114 sessionId: src_id|99d8ec1-f00de9a2-346bfbf7-d6e8bf2e_0 is DEAD
2025-10-10T14:39:49.277449Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99d8ec1-f00de9a2-346bfbf7-d6e8bf2e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:39:49.277462Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99d8ec1-f00de9a2-346bfbf7-d6e8bf2e_0] Write session will restart in 0.006892s
2025-10-10T14:39:49.277489Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99d8ec1-f00de9a2-346bfbf7-d6e8bf2e_0] Write session: Do CDS request
2025-10-10T14:39:49.277496Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99d8ec1-f00de9a2-346bfbf7-d6e8bf2e_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:49.286979Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|99d8ec1-f00de9a2-346bfbf7-d6e8bf2e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:49.287258Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:49.287278Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3115
2025-10-10T14:39:49.287403Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3115 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:49.287449Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3115 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:49.287455Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3115 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:49.287458Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:49.288574Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3115 sessionId:  describe result for acl check
2025-10-10T14:39:49.288617Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:49.288626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:49.288628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:49.288634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602816527807730:4422] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:49.289256Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602816527807730:4422] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:49.292726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602816527807730:4422] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:49.295703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602816527807730:4422] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:49.295721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602816527807730:4422] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:49.295724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602816527807730:4422] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:49.295734Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3115 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:49.302037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:49.306743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:49.307040Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:49.307051Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:49.307065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:49.307133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:49.307200Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602815745561113:6002]
2025-10-10T14:39:49.307889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:49.308396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:49.308468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:49.308856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:49.308915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:49.308917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:49.308919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:49.308920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:49.308922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:49.308924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:49.308925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:49.308927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:49.308928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:49.308930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:49.308932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:49.308933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:49.308935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:49.308942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:49.308959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:49.308964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:49.308969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:49.308974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:49.308979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:49.308984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:49.308988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:49.308993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:49.308999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:49.309003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:49.309019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:49.309024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:49.309033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:49.309042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:49.309050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:49.309057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:49.309062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:49.309069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:49.309074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:49.309080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:49.309086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:49.309101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:49.309107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:49.309113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:49.309120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:49.309125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:49.309130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:49.309136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:49.309142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:49.309148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:49.309156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:49.309163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:49.309169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:49.309175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:49.309180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:49.309186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:49.309191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:49.309198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:49.309244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:49.312937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:49.314132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:49.314154Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:49.314161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:49.314170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:49.314178Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3114 [2:7559602815745561113:6002]
2025-10-10T14:39:49.314194Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:49.314215Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:49.314219Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:49.314224Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:49.314226Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:49.314247Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:49.314264Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:49.314272Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:49.314344Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:49.314352Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:49.314354Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:49.314357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:49.314431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:49.314439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:49.314454Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:49.314473Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:49.314498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:49.314521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602816527807853:4422], now have 1 active actors on pipe
2025-10-10T14:39:49.314530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602816527807644:2438], now have 1 active actors on pipe
2025-10-10T14:39:49.314540Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602815745561108:6002]
2025-10-10T14:39:49.314548Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602815745561108:6002]
2025-10-10T14:39:49.314550Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602815745561108:6002]
2025-10-10T14:39:49.314567Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:49.314583Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:49.314590Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:49.314594Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:49.314596Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:49.314608Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:49.314611Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:49.314609Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3114
2025-10-10T14:39:49.314655Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3114
2025-10-10T14:39:49.314652Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602815745561108:6002]
2025-10-10T14:39:49.314668Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:49.314704Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:49.314817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:49.314828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:49.314863Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ad0725e-32282e01-10cfbe05-f980edec_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:49.314876Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:49.314880Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:49.314883Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:49.314896Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:49.314907Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:49.314925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:49.315095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:49.315102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:49.315117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:49.315199Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3115 partition: 0 MaxSeqNo: 40 sessionId: src_id|ad0725e-32282e01-10cfbe05-f980edec_0
2025-10-10T14:39:49.315672Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99d8ec1-f00de9a2-346bfbf7-d6e8bf2e_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|ad0725e-32282e01-10cfbe05-f980edec_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:49.318809Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ad0725e-32282e01-10cfbe05-f980edec_0] Write session: try to update token
2025-10-10T14:39:49.318830Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ad0725e-32282e01-10cfbe05-f980edec_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:49.341739Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3115 sessionId: src_id|ad0725e-32282e01-10cfbe05-f980edec_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:49.341751Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:49.341774Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:49.341777Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:49.341780Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:49.341790Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602815745561108:6002]
2025-10-10T14:39:49.341796Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602815745561108:6002]
2025-10-10T14:39:49.341802Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602815745561108:6002]
2025-10-10T14:39:49.341856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:49.341866Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:49.341869Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:49.341869Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:49.341878Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:49.341884Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:49.342010Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:49.344460Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:49.379823Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602816527807916:4596]
2025-10-10T14:39:49.380139Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 pipe creation result: OK TabletId: 72075186224037892 Generation: 3114, pipe: [1:7559602816527807916:4596]
2025-10-10T14:39:49.495508Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:49.495791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:49.495802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:49.495847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602816527807916:4596], now have 1 active actors on pipe
2025-10-10T14:39:49.496105Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:49.497234Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad0725e-32282e01-10cfbe05-f980edec_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:39:49.497248Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad0725e-32282e01-10cfbe05-f980edec_0] Write session will restart in 0.005802s
2025-10-10T14:39:49.497273Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad0725e-32282e01-10cfbe05-f980edec_0] Write session: Do CDS request
2025-10-10T14:39:49.497280Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad0725e-32282e01-10cfbe05-f980edec_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:49.496508Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:49.496574Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:39:49.496656Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3115 reason: status is not ok: tablet will be restarted right now sessionId: src_id|ad0725e-32282e01-10cfbe05-f980edec_0
2025-10-10T14:39:49.496880Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3115 sessionId: src_id|ad0725e-32282e01-10cfbe05-f980edec_0 is DEAD
2025-10-10T14:39:49.496959Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 13 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602816527807916:4596]
2025-10-10T14:39:49.503888Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ad0725e-32282e01-10cfbe05-f980edec_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:49.504581Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:49.504600Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3116
2025-10-10T14:39:49.504924Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3116 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:49.504966Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3116 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:49.504973Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3116 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:49.504977Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:49.505433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3116 sessionId:  describe result for acl check
2025-10-10T14:39:49.505466Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:49.505469Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:49.505471Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:49.505477Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602816527807934:4407] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:49.506093Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602816527807934:4407] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:49.511833Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602816527807934:4407] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:49.515951Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602816527807934:4407] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:49.515969Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602816527807934:4407] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:49.515973Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602816527807934:4407] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:49.515983Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3116 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:49.527259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:49.527483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:49.527692Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:49.527698Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:49.527712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:49.527764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:49.527817Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602815745561321:6004]
2025-10-10T14:39:49.528415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:49.532485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:49.532565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:49.533005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:49.533075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:49.533082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:49.533083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:49.533085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:49.533086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:49.533087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:49.533089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:49.533091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:49.533092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:49.533094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:49.533095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:49.533097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:49.533098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:49.533106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:49.533121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:49.533126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:49.533131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:49.533136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:49.533140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:49.533145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:49.533149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:49.533154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:49.533159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:49.533163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:49.533168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:49.533172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:49.533181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:49.533192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:49.533199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:49.533206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:49.533212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:49.533218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:49.533223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:49.533229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:49.533235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:49.533241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:49.533246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:49.533252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:49.533258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:49.533264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:49.533269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:49.533275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:49.533282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:49.533288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:49.533293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:49.533306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:49.533311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:49.533317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:49.533321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:49.533342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:49.533348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:49.533354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:49.533399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:49.536818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:49.537170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:49.537184Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:49.537186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:49.537191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:49.537199Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3115 [2:7559602815745561321:6004]
2025-10-10T14:39:49.537215Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:49.537259Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:49.537269Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:49.537274Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:49.537276Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:49.537295Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:49.537318Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:49.537347Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:49.537416Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:49.537426Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:49.537428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:49.537431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:49.537509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:49.537517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:49.537531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:49.537549Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:49.537567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:49.537597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602816527807919:2438], now have 1 active actors on pipe
2025-10-10T14:39:49.537606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602816527808093:4407], now have 1 active actors on pipe
2025-10-10T14:39:49.537614Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602815745561316:6004]
2025-10-10T14:39:49.537617Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602815745561316:6004]
2025-10-10T14:39:49.537619Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602815745561316:6004]
2025-10-10T14:39:49.537635Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:49.537652Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:49.537676Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:49.537680Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:49.537711Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602815745561316:6004]
2025-10-10T14:39:49.537710Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:49.537715Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:49.537717Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:49.537718Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:49.537725Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:49.537678Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3115
2025-10-10T14:39:49.537733Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3115
2025-10-10T14:39:49.537979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:49.537995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:49.538031Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|86f1592f-4241968c-27c3ca12-c35701b4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:49.538046Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:49.538066Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:49.538073Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:49.538085Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:49.538099Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:49.538120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:49.538465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:49.538480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:49.538506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:49.538605Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3116 partition: 0 MaxSeqNo: 40 sessionId: src_id|86f1592f-4241968c-27c3ca12-c35701b4_0
2025-10-10T14:39:49.539041Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad0725e-32282e01-10cfbe05-f980edec_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|86f1592f-4241968c-27c3ca12-c35701b4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:49.541880Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|86f1592f-4241968c-27c3ca12-c35701b4_0] Write session: try to update token
2025-10-10T14:39:49.541900Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|86f1592f-4241968c-27c3ca12-c35701b4_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:49.560058Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:49.560086Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:49.560089Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:49.560092Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:49.560102Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602815745561316:6004]
2025-10-10T14:39:49.560108Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602815745561316:6004]
2025-10-10T14:39:49.560111Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602815745561316:6004]
2025-10-10T14:39:49.560165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:49.560166Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:49.560173Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:49.560173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:49.560176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:49.560178Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:49.560328Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:49.563298Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3116 sessionId: src_id|86f1592f-4241968c-27c3ca12-c35701b4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:49.565933Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:49.601411Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602816527808190:4596]
2025-10-10T14:39:49.605432Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 pipe creation result: OK TabletId: 72075186224037892 Generation: 3115, pipe: [1:7559602816527808190:4596]
2025-10-10T14:39:49.687266Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 14 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602816527808190:4596]
2025-10-10T14:39:49.687318Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:49.687321Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:49.687423Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3116 reason: error at write: Disconnected sessionId: src_id|86f1592f-4241968c-27c3ca12-c35701b4_0
2025-10-10T14:39:49.687780Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3116 sessionId: src_id|86f1592f-4241968c-27c3ca12-c35701b4_0 is DEAD
2025-10-10T14:39:49.687948Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|86f1592f-4241968c-27c3ca12-c35701b4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:49.687971Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|86f1592f-4241968c-27c3ca12-c35701b4_0] Write session will restart in 0.008284s
2025-10-10T14:39:49.688000Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|86f1592f-4241968c-27c3ca12-c35701b4_0] Write session: Do CDS request
2025-10-10T14:39:49.688007Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|86f1592f-4241968c-27c3ca12-c35701b4_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:49.688086Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:49.685825Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:49.686910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:49.686924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:49.686973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602816527808190:4596], now have 1 active actors on pipe
2025-10-10T14:39:49.688134Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:49.697925Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|86f1592f-4241968c-27c3ca12-c35701b4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:49.698029Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:49.698048Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3117
2025-10-10T14:39:49.698226Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3117 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:49.698286Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3117 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:49.698297Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3117 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:49.698302Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:49.698754Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3117 sessionId:  describe result for acl check
2025-10-10T14:39:49.698797Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:49.698804Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:49.698807Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:49.698815Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602816527808206:4402] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:49.699463Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602816527808206:4402] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:49.701888Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602816527808206:4402] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:49.705056Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602816527808206:4402] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:49.705074Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602816527808206:4402] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:49.705078Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602816527808206:4402] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:49.705088Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3117 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:49.720127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:49.725606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:49.725882Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:49.725895Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:49.725909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:49.725970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:49.726022Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602815745561542:5994]
2025-10-10T14:39:49.726728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:49.727125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:49.727171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:49.727526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:49.727588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:49.727595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:49.727596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:49.727598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:49.727600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:49.727601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:49.727603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:49.727604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:49.727606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:49.727607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:49.727609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:49.727610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:49.727612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:49.727618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:49.727633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:49.727638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:49.727643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:49.727648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:49.727653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:49.727658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:49.727661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:49.727666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:49.727671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:49.727676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:49.727680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:49.727685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:49.727693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:49.727703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:49.727711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:49.727718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:49.727723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:49.727730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:49.727735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:49.727741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:49.727746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:49.727753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:49.727757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:49.727763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:49.727773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:49.727784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:49.727789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:49.727795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:49.727800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:49.727807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:49.727812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:49.727818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:49.727824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:49.727830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:49.727841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:49.727847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:49.727857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:49.727874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:49.727917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:49.730649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:49.730981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:49.730994Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:49.730997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:49.731001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:49.731008Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3116 [2:7559602815745561542:5994]
2025-10-10T14:39:49.731023Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:49.731044Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:49.731047Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:49.731051Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:49.731055Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:49.731073Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:49.731083Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:49.731100Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:49.731171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:49.731180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:49.731182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:49.731185Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:49.731261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:49.731269Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:49.731282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:49.731300Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:49.731324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:49.731352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602816527808267:4402], now have 1 active actors on pipe
2025-10-10T14:39:49.731368Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602815745561537:5994]
2025-10-10T14:39:49.731376Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602815745561537:5994]
2025-10-10T14:39:49.731379Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602815745561537:5994]
2025-10-10T14:39:49.731395Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:49.731409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602816527808193:2438], now have 1 active actors on pipe
2025-10-10T14:39:49.731419Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:49.731438Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:49.731446Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:49.731474Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602815745561537:5994]
2025-10-10T14:39:49.731484Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:49.731540Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3116
2025-10-10T14:39:49.731594Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3116
2025-10-10T14:39:49.731748Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:49.731761Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:49.731763Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:49.731773Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:49.732089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:49.732103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:49.732140Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9766eea8-e1590772-33a6a8a6-2f0339e1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:49.732148Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:49.732152Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:49.732155Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:49.732168Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:49.732182Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:49.732199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:49.732486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:49.732497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:49.732515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:49.732637Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3117 partition: 0 MaxSeqNo: 40 sessionId: src_id|9766eea8-e1590772-33a6a8a6-2f0339e1_0
2025-10-10T14:39:49.733105Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|86f1592f-4241968c-27c3ca12-c35701b4_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|9766eea8-e1590772-33a6a8a6-2f0339e1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:49.735917Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9766eea8-e1590772-33a6a8a6-2f0339e1_0] Write session: try to update token
2025-10-10T14:39:49.735938Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9766eea8-e1590772-33a6a8a6-2f0339e1_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:49.756263Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3117 sessionId: src_id|9766eea8-e1590772-33a6a8a6-2f0339e1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:49.758927Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:49.759579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:49.759614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:49.759660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:39:49.759744Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:39:49.764751Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:49.764776Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:49.764779Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:49.764782Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:49.764793Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602815745561537:5994]
2025-10-10T14:39:49.764797Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602815745561537:5994]
2025-10-10T14:39:49.764801Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602815745561537:5994]
2025-10-10T14:39:49.764852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:49.764860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:49.764862Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:49.765021Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:49.766776Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:49.766799Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:49.766804Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:49.787526Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602816527808465:4596]
2025-10-10T14:39:49.787934Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 pipe creation result: OK TabletId: 72075186224037892 Generation: 3116, pipe: [1:7559602816527808465:4596]
2025-10-10T14:39:49.887856Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:49.895611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:49.895636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:49.895790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:49.895852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:49.895928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:49.895991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:49.896038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:49.896048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:49.896123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:49.896201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:49.896281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:49.896366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:49.896415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:49.896421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:49.896491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:49.896554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:49.896618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:49.896696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:49.896741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:49.896747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:49.896814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:49.896879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:49.896944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:49.897011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:49.897054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:49.897061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:49.897178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:49.897243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:49.897309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:49.897397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:49.897445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:49.897452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:49.897520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:49.897583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:49.897648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:49.897711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:49.897757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:49.897764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:49.897831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:49.897894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:49.897961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:49.898031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:49.898077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:49.898083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:49.898152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:49.898212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:49.898276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:49.898340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:49.898384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:49.898391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:49.898460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:49.898528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:49.898604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:49.898674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:49.898721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:49.898729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:49.898796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:49.898853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:49.898913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:49.898972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:49.899015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:49.899020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:49.899085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602816527808465:4596], now have 1 active actors on pipe
2025-10-10T14:39:49.899320Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:49.899340Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:49.899369Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3117 reason: error at write: Disconnected sessionId: src_id|9766eea8-e1590772-33a6a8a6-2f0339e1_0
2025-10-10T14:39:49.899614Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3117 sessionId: src_id|9766eea8-e1590772-33a6a8a6-2f0339e1_0 is DEAD
2025-10-10T14:39:49.899823Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 15 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602816527808465:4596]
2025-10-10T14:39:49.899847Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:49.900186Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:49.901433Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9766eea8-e1590772-33a6a8a6-2f0339e1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:49.901446Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9766eea8-e1590772-33a6a8a6-2f0339e1_0] Write session will restart in 0.005385s
2025-10-10T14:39:49.901471Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9766eea8-e1590772-33a6a8a6-2f0339e1_0] Write session: Do CDS request
2025-10-10T14:39:49.901477Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9766eea8-e1590772-33a6a8a6-2f0339e1_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:49.907916Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9766eea8-e1590772-33a6a8a6-2f0339e1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:49.908051Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:49.908069Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3118
2025-10-10T14:39:49.908222Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3118 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:49.908257Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3118 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:49.908266Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3118 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:49.908278Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:49.908719Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3118 sessionId:  describe result for acl check
2025-10-10T14:39:49.908759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:49.908766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:49.908768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:49.908774Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602816527808522:4364] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:49.909385Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602816527808522:4364] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:49.914929Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602816527808522:4364] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:49.919235Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602816527808522:4364] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:49.919252Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602816527808522:4364] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:49.919256Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602816527808522:4364] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:49.919265Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3118 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:49.922832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:49.927061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:49.927324Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:49.927336Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:49.927349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:49.927410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:49.927453Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602815745561765:5967]
2025-10-10T14:39:49.928142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:49.928552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:49.928602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:49.928956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:49.929009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:49.929015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:49.929017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:49.929018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:49.929019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:49.929021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:49.929022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:49.929023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:49.929025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:49.929026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:49.929027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:49.929029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:49.929030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:49.929036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:49.929048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:49.929053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:49.929058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:49.929062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:49.929066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:49.929071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:49.929076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:49.929080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:49.929085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:49.929090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:49.929094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:49.929099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:49.929106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:49.929117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:49.929125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:49.929149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:49.929159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:49.929165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:49.929170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:49.929181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:49.929186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:49.929196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:49.929202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:49.929212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:49.929217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:49.929223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:49.929228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:49.929233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:49.929240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:49.929250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:49.929254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:49.929261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:49.929270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:49.929276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:49.929284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:49.929290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:49.929299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:49.929305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:49.929369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:49.931913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:49.932378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:49.932395Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:49.932397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:49.932401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:49.932407Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3117 [2:7559602815745561765:5967]
2025-10-10T14:39:49.932418Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:49.932437Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:49.932440Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:49.932443Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:49.932446Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:49.932462Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:49.932470Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:49.932479Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:49.932529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:49.932542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:49.932544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:49.932547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:49.932613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:49.932623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:49.932637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:49.932651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:49.932680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:49.932700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602816527808755:4364], now have 1 active actors on pipe
2025-10-10T14:39:49.932709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602816527808500:2438], now have 1 active actors on pipe
2025-10-10T14:39:49.932717Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602815745561760:5967]
2025-10-10T14:39:49.932719Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602815745561760:5967]
2025-10-10T14:39:49.932721Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602815745561760:5967]
2025-10-10T14:39:49.932732Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:49.932750Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:49.932768Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:49.932778Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:49.932791Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:49.932795Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:49.932763Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3117
2025-10-10T14:39:49.932797Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:49.932803Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602815745561760:5967]
2025-10-10T14:39:49.932777Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3117
2025-10-10T14:39:49.932806Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:49.932812Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:49.932861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:49.932871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:49.932901Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1a3f3e03-e87f2119-b2ae2b67-f5b2ddf7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:49.932913Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:49.932917Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:49.932920Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:49.932931Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:49.932946Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:49.932963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:49.933173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:49.933180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:49.933193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:49.933289Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3118 partition: 0 MaxSeqNo: 40 sessionId: src_id|1a3f3e03-e87f2119-b2ae2b67-f5b2ddf7_0
2025-10-10T14:39:49.933713Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9766eea8-e1590772-33a6a8a6-2f0339e1_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|1a3f3e03-e87f2119-b2ae2b67-f5b2ddf7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:49.936256Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1a3f3e03-e87f2119-b2ae2b67-f5b2ddf7_0] Write session: try to update token
2025-10-10T14:39:49.936278Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1a3f3e03-e87f2119-b2ae2b67-f5b2ddf7_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:49.944331Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:39:49.944350Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:49.944365Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602815745561760:5967]
2025-10-10T14:39:49.944412Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:39:49.944415Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:39:49.944651Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:39:49.944801Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:49.944931Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:49.945062Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:49.945258Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:39:49.945303Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:39:49.951470Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3118 sessionId: src_id|1a3f3e03-e87f2119-b2ae2b67-f5b2ddf7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:49.954131Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:49.954358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:49.954384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:49.954431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:39:49.954504Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:39:49.962968Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:49.962987Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:49.962990Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:49.962991Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:49.963000Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602815745561760:5967]
2025-10-10T14:39:49.963003Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602815745561760:5967]
2025-10-10T14:39:49.963006Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602815745561760:5967]
2025-10-10T14:39:49.963048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:49.963056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:49.963059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:49.963063Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:49.963070Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:49.963075Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:49.963189Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:50.000333Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602816527808787:4596]
2025-10-10T14:39:50.000827Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 pipe creation result: OK TabletId: 72075186224037892 Generation: 3117, pipe: [1:7559602816527808787:4596]
2025-10-10T14:39:50.087620Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:50.096804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:50.096833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:50.097023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:50.097095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:50.097163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:50.097233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:50.097281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:50.097290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:50.097387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:50.097455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:50.097523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:50.097589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:50.097637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:50.097646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:50.097718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:50.097783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:50.097847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:50.097915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:50.097968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:50.097981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:50.098051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:50.098117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:50.098184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:50.098253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:50.098301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:50.098310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:50.098378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:50.098441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:50.098512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:50.098574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:50.098617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:50.098624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:50.098693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:50.098760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:50.098831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:50.098905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:50.098957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:50.098964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:50.099033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:50.099096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:50.099167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:50.099233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:50.099281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:50.099287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:50.099356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:50.099425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:50.099494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:50.099563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:50.099608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:50.099615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:50.099683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:50.099745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:50.099813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:50.099877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:50.099930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:50.099933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:50.100005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:50.100074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:50.100139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:50.100204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:50.100252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:50.100255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:50.100321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602816527808787:4596], now have 1 active actors on pipe
2025-10-10T14:39:50.100606Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 16 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602816527808787:4596]
2025-10-10T14:39:50.100633Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:50.100636Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:50.100638Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:50.100692Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3118 reason: error at write: Disconnected sessionId: src_id|1a3f3e03-e87f2119-b2ae2b67-f5b2ddf7_0
2025-10-10T14:39:50.100927Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3118 sessionId: src_id|1a3f3e03-e87f2119-b2ae2b67-f5b2ddf7_0 is DEAD
2025-10-10T14:39:50.101407Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:50.105170Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a3f3e03-e87f2119-b2ae2b67-f5b2ddf7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:50.105181Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a3f3e03-e87f2119-b2ae2b67-f5b2ddf7_0] Write session will restart in 0.005208s
2025-10-10T14:39:50.105207Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a3f3e03-e87f2119-b2ae2b67-f5b2ddf7_0] Write session: Do CDS request
2025-10-10T14:39:50.105213Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a3f3e03-e87f2119-b2ae2b67-f5b2ddf7_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:50.113982Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1a3f3e03-e87f2119-b2ae2b67-f5b2ddf7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:50.117585Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:50.117602Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3119
2025-10-10T14:39:50.117818Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3119 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:50.117856Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3119 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:50.117861Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3119 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:50.117867Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:50.118404Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3119 sessionId:  describe result for acl check
2025-10-10T14:39:50.118454Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:50.118461Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:50.118463Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:50.118471Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602820822776155:4347] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:50.119146Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602820822776155:4347] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:50.123273Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602820822776155:4347] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:50.127665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602820822776155:4347] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:50.127686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602820822776155:4347] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:50.127690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602820822776155:4347] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:50.127700Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3119 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:50.140817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:50.141581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:50.141842Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:50.141861Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:50.141876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:50.141956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:50.142011Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602820040529296:5947]
2025-10-10T14:39:50.142691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:50.143058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:50.143113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:50.143487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:50.143556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:50.143563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:50.143564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:50.143566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:50.143567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:50.143568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:50.143570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:50.143571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:50.143572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:50.143574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:50.143575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:50.143576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:50.143577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:50.143585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:50.143599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:50.143604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:50.143609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:50.143613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:50.143617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:50.143620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:50.143624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:50.143627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:50.143631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:50.143635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:50.143638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:50.143642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:50.143650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:50.143660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:50.143667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:50.143673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:50.143679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:50.143684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:50.143690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:50.143695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:50.143700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:50.143706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:50.143711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:50.143716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:50.143721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:50.143727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:50.143735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:50.143741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:50.143746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:50.143752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:50.143756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:50.143762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:50.143780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:50.143785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:50.143791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:50.143796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:50.143801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:50.143806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:50.143847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:50.146625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:50.147995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:50.148014Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:50.148017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:50.148021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:50.148029Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3118 [2:7559602820040529296:5947]
2025-10-10T14:39:50.148043Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:50.148064Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:50.148067Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:50.148069Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:50.148071Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:50.148088Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:50.148098Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:50.148108Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:50.148466Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3118
2025-10-10T14:39:50.148510Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3118
2025-10-10T14:39:50.148168Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:50.148169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:50.148171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:50.148172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:50.148239Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:50.148242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:50.148254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:50.148261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:50.148272Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:50.148293Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602820040529291:5947]
2025-10-10T14:39:50.148296Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602820040529291:5947]
2025-10-10T14:39:50.148298Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602820040529291:5947]
2025-10-10T14:39:50.148308Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:50.148323Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:50.148334Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:50.148337Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:50.148347Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:50.148351Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:50.148354Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:50.148374Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602820040529291:5947]
2025-10-10T14:39:50.148378Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:50.148387Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:50.148388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602820822776242:4347], now have 1 active actors on pipe
2025-10-10T14:39:50.148392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602820822776085:2438], now have 1 active actors on pipe
2025-10-10T14:39:50.148537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:50.148542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:50.148578Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ad642f0f-15de26ab-81dae7c2-28f1c04_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:50.148586Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:50.148591Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:50.148594Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:50.148607Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:50.148620Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:50.148637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:50.148779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:50.148791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:50.148807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:50.148980Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3119 partition: 0 MaxSeqNo: 40 sessionId: src_id|ad642f0f-15de26ab-81dae7c2-28f1c04_0
2025-10-10T14:39:50.149527Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a3f3e03-e87f2119-b2ae2b67-f5b2ddf7_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|ad642f0f-15de26ab-81dae7c2-28f1c04_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:50.152351Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ad642f0f-15de26ab-81dae7c2-28f1c04_0] Write session: try to update token
2025-10-10T14:39:50.152384Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ad642f0f-15de26ab-81dae7c2-28f1c04_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:50.160587Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:39:50.160610Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:50.160621Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602820040529291:5947]
2025-10-10T14:39:50.160685Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:39:50.160733Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:39:50.160863Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:39:50.161011Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:50.161157Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:50.161301Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:50.161516Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:39:50.161561Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:39:50.174121Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3119 sessionId: src_id|ad642f0f-15de26ab-81dae7c2-28f1c04_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:50.177161Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:50.177461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:50.177487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:50.177542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:39:50.179248Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:39:50.181120Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:50.181145Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:50.181149Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:50.181151Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:50.181162Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602820040529291:5947]
2025-10-10T14:39:50.181166Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602820040529291:5947]
2025-10-10T14:39:50.181171Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602820040529291:5947]
2025-10-10T14:39:50.181223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:50.181238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:50.181241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:50.181241Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:50.181248Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:50.181253Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:50.181400Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:50.200554Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602820822776360:4596]
2025-10-10T14:39:50.200935Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 pipe creation result: OK TabletId: 72075186224037892 Generation: 3118, pipe: [1:7559602820822776360:4596]
2025-10-10T14:39:50.303539Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:50.304122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602820822776360:4596], now have 1 active actors on pipe
2025-10-10T14:39:50.312770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:50.312802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:50.312990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:50.313060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:50.313129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:50.313199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:50.313247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:50.313258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:50.313349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:50.313417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:50.313491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:50.313558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:50.313602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:50.313605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:50.313676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:50.313735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:50.313797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:50.313861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:50.313907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:50.313910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:50.313977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:50.314042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:50.314105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:50.314170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:50.314211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:50.314215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:50.314287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:50.314346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:50.314409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:50.314475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:50.314519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:50.314522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:50.314596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:50.314655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:50.314717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:50.314782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:50.314828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:50.314831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:50.314899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:50.314958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:50.315024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:50.315086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:50.315129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:50.315132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:50.315199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:50.315255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:50.315314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:50.315374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:50.315416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:50.315419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:50.315487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:50.315548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:50.315605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:50.315665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:50.315705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:50.315708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:50.315773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:50.315831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:50.315891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:50.315952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:50.315993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:50.315996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:50.317654Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:50.317670Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:50.317715Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3119 reason: error at write: Disconnected sessionId: src_id|ad642f0f-15de26ab-81dae7c2-28f1c04_0
2025-10-10T14:39:50.317978Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3119 sessionId: src_id|ad642f0f-15de26ab-81dae7c2-28f1c04_0 is DEAD
2025-10-10T14:39:50.317639Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:50.318097Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 17 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602820822776360:4596]
2025-10-10T14:39:50.318134Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:50.320895Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad642f0f-15de26ab-81dae7c2-28f1c04_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:50.320909Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad642f0f-15de26ab-81dae7c2-28f1c04_0] Write session will restart in 0.007476s
2025-10-10T14:39:50.320939Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad642f0f-15de26ab-81dae7c2-28f1c04_0] Write session: Do CDS request
2025-10-10T14:39:50.320947Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad642f0f-15de26ab-81dae7c2-28f1c04_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:50.329953Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ad642f0f-15de26ab-81dae7c2-28f1c04_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:50.333466Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:50.333493Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3120
2025-10-10T14:39:50.337473Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3120 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:50.337527Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3120 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:50.337533Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3120 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:50.337538Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:50.338084Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3120 sessionId:  describe result for acl check
2025-10-10T14:39:50.338120Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:50.338121Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:50.338123Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:50.338131Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602820822776540:4331] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:50.338740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602820822776540:4331] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:50.343108Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602820822776540:4331] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:50.353215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:50.353289Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602820822776540:4331] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:50.353309Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602820822776540:4331] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:50.353313Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602820822776540:4331] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:50.353323Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3120 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:50.354156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:50.354400Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:50.354410Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:50.354422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:50.354482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:50.354538Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602820040529510:5940]
2025-10-10T14:39:50.355201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:50.355518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:50.355577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:50.355919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:50.355988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:50.355996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:50.355998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:50.356000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:50.356001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:50.356003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:50.356004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:50.356006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:50.356007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:50.356008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:50.356010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:50.356011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:50.356012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:50.356019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:50.356033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:50.356038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:50.356042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:50.356047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:50.356051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:50.356055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:50.356059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:50.356062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:50.356067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:50.356071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:50.356075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:50.356080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:50.356089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:50.356098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:50.356104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:50.356110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:50.356115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:50.356120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:50.356124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:50.356130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:50.356135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:50.356146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:50.356151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:50.356161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:50.356166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:50.356175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:50.356180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:50.356185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:50.356196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:50.356206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:50.356211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:50.356220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:50.356225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:50.356230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:50.356239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:50.356245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:50.356249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:50.356258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:50.356301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:50.359726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:50.360639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:50.360669Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:50.360672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:50.360676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:50.360683Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3119 [2:7559602820040529510:5940]
2025-10-10T14:39:50.360699Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:50.360718Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:50.360721Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:50.360725Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:50.360727Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:50.360746Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:50.360758Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:50.360766Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:50.360830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:50.360838Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:50.360840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:50.360843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:50.360922Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:50.360930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:50.360943Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:50.360960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:50.360982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:50.361008Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602820040529504:5940]
2025-10-10T14:39:50.361015Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602820040529504:5940]
2025-10-10T14:39:50.361017Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602820040529504:5940]
2025-10-10T14:39:50.361035Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:50.361053Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:50.361072Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:50.361075Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:50.361088Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:50.361099Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:50.361105Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:50.361111Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602820040529504:5940]
2025-10-10T14:39:50.361114Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:50.361174Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:50.361223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602820822776625:4331], now have 1 active actors on pipe
2025-10-10T14:39:50.361236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602820822776362:2438], now have 1 active actors on pipe
2025-10-10T14:39:50.361433Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3119
2025-10-10T14:39:50.361475Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3119
2025-10-10T14:39:50.361840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:50.361852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:50.361889Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|359fe501-a1ffd1ea-2c4b4cd3-21f810e4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:50.361898Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:50.361903Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:50.361905Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:50.361921Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:50.361933Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:50.361949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:50.362184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:50.362191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:50.362219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:50.362327Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3120 partition: 0 MaxSeqNo: 40 sessionId: src_id|359fe501-a1ffd1ea-2c4b4cd3-21f810e4_0
2025-10-10T14:39:50.362765Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad642f0f-15de26ab-81dae7c2-28f1c04_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|359fe501-a1ffd1ea-2c4b4cd3-21f810e4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:50.365684Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|359fe501-a1ffd1ea-2c4b4cd3-21f810e4_0] Write session: try to update token
2025-10-10T14:39:50.365708Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|359fe501-a1ffd1ea-2c4b4cd3-21f810e4_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:50.373707Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:39:50.373730Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:50.373741Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602820040529504:5940]
2025-10-10T14:39:50.373797Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:39:50.373880Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:39:50.373987Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:39:50.374144Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:50.374286Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:50.374423Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:50.374617Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:39:50.374658Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:39:50.388283Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3120 sessionId: src_id|359fe501-a1ffd1ea-2c4b4cd3-21f810e4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:50.391096Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:50.391357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:50.391383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:50.391441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:39:50.391547Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:39:50.393847Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:50.393867Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:50.393870Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:50.393872Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:50.393884Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602820040529504:5940]
2025-10-10T14:39:50.393888Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602820040529504:5940]
2025-10-10T14:39:50.393896Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602820040529504:5940]
2025-10-10T14:39:50.393944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:50.393957Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:50.393959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:50.393970Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:50.393975Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:50.393980Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:50.394100Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:50.418146Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602820822776637:4596]
2025-10-10T14:39:50.418489Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 pipe creation result: OK TabletId: 72075186224037892 Generation: 3119, pipe: [1:7559602820822776637:4596]
2025-10-10T14:39:50.511058Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:50.520386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:50.520420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:50.520601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:50.520680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:50.520743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:50.520806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:50.521222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:50.521237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:50.521308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:50.521473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:50.521544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:50.521616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:50.521666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:50.521675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:50.521743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:50.521806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:50.521878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:50.521947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:50.521998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:50.522006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:50.522084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:50.522155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:50.522222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:50.522289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:50.522338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:50.522347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:50.522419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:50.522489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:50.522558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:50.522631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:50.522678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:50.522686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:50.522759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:50.522826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:50.522899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:50.522971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:50.523023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:50.523032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:50.523104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:50.523171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:50.523245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:50.523313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:50.523364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:50.523373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:50.523445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:50.523510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:50.523579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:50.523650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:50.523911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:50.523922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:50.523995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:50.524060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:50.524135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:50.524197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:50.524235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:50.524238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:50.524307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:50.524385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:50.524448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:50.524512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:50.524557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:50.524560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:50.524657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602820822776637:4596], now have 1 active actors on pipe
2025-10-10T14:39:50.525256Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:50.525353Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:50.525372Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:50.525379Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 18 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602820822776637:4596]
2025-10-10T14:39:50.525402Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:50.525414Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3120 reason: error at write: Disconnected sessionId: src_id|359fe501-a1ffd1ea-2c4b4cd3-21f810e4_0
2025-10-10T14:39:50.525645Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3120 sessionId: src_id|359fe501-a1ffd1ea-2c4b4cd3-21f810e4_0 is DEAD
2025-10-10T14:39:50.525958Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|359fe501-a1ffd1ea-2c4b4cd3-21f810e4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:50.525976Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|359fe501-a1ffd1ea-2c4b4cd3-21f810e4_0] Write session will restart in 0.008342s
2025-10-10T14:39:50.526019Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|359fe501-a1ffd1ea-2c4b4cd3-21f810e4_0] Write session: Do CDS request
2025-10-10T14:39:50.526027Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|359fe501-a1ffd1ea-2c4b4cd3-21f810e4_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:50.535980Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|359fe501-a1ffd1ea-2c4b4cd3-21f810e4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:50.536130Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:50.536150Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3121
2025-10-10T14:39:50.536283Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3121 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:50.536338Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3121 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:50.536352Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3121 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:50.536358Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:50.536887Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3121 sessionId:  describe result for acl check
2025-10-10T14:39:50.536926Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:50.536935Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:50.536941Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:50.536949Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602820822776691:4324] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:50.537580Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602820822776691:4324] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:50.541029Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602820822776691:4324] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:50.544504Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602820822776691:4324] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:50.544523Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602820822776691:4324] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:50.544527Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602820822776691:4324] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:50.544535Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3121 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:50.555705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:50.556505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:50.556737Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:50.556753Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:50.556767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:50.556840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:50.556894Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602820040529723:5938]
2025-10-10T14:39:50.557579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:50.557930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:50.557990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:50.558340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:50.558416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:50.558418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:50.558419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:50.558420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:50.558421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:50.558423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:50.558424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:50.558425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:50.558426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:50.558427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:50.558428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:50.558429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:50.558431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:50.558438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:50.558452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:50.558455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:50.558460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:50.558463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:50.558467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:50.558471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:50.558476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:50.558480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:50.558485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:50.558489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:50.558493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:50.558496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:50.558505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:50.558514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:50.558522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:50.558528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:50.558532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:50.558538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:50.558543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:50.558548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:50.558554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:50.558560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:50.558564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:50.558571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:50.558577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:50.558583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:50.558587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:50.558594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:50.558599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:50.558604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:50.558610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:50.558615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:50.558621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:50.558627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:50.558632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:50.558638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:50.558643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:50.558649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:50.558687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:50.561372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:50.562080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:50.562097Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:50.562100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:50.562104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:50.562111Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3120 [2:7559602820040529723:5938]
2025-10-10T14:39:50.562126Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:50.562145Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:50.562154Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:50.562158Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:50.562160Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:50.562177Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:50.562190Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:50.562198Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:50.562261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:50.562269Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:50.562271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:50.562274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:50.562342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:50.562350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:50.562363Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:50.562381Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:50.562403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:50.562426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602820822776640:2438], now have 1 active actors on pipe
2025-10-10T14:39:50.562434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602820822776835:4324], now have 1 active actors on pipe
2025-10-10T14:39:50.562442Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602820040529718:5938]
2025-10-10T14:39:50.562450Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602820040529718:5938]
2025-10-10T14:39:50.562452Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602820040529718:5938]
2025-10-10T14:39:50.562509Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3120
2025-10-10T14:39:50.562517Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3120
2025-10-10T14:39:50.562473Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:50.562496Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:50.562515Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:50.562519Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:50.562530Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:50.562534Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:50.562536Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:50.562546Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602820040529718:5938]
2025-10-10T14:39:50.562549Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:50.562563Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:50.562607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:50.562613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:50.562645Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ed7592ca-768a8b82-c521e7f5-f2604b77_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:50.562654Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:50.562658Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:50.562660Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:50.562671Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:50.562683Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:50.562697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:50.563059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:50.563070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:50.563091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:50.563184Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3121 partition: 0 MaxSeqNo: 40 sessionId: src_id|ed7592ca-768a8b82-c521e7f5-f2604b77_0
2025-10-10T14:39:50.569540Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|359fe501-a1ffd1ea-2c4b4cd3-21f810e4_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|ed7592ca-768a8b82-c521e7f5-f2604b77_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:50.572292Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ed7592ca-768a8b82-c521e7f5-f2604b77_0] Write session: try to update token
2025-10-10T14:39:50.572315Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ed7592ca-768a8b82-c521e7f5-f2604b77_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:50.582301Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:50.582327Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:50.582331Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:50.582333Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:50.582344Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602820040529718:5938]
2025-10-10T14:39:50.582349Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602820040529718:5938]
2025-10-10T14:39:50.582353Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602820040529718:5938]
2025-10-10T14:39:50.582400Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:50.582406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:50.582407Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:50.582412Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:50.582414Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:50.582417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:50.582566Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:50.589185Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3121 sessionId: src_id|ed7592ca-768a8b82-c521e7f5-f2604b77_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:50.591995Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:50.625465Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602820822776916:4596]
2025-10-10T14:39:50.625874Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 pipe creation result: OK TabletId: 72075186224037892 Generation: 3120, pipe: [1:7559602820822776916:4596]
2025-10-10T14:39:50.704557Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:50.704922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:50.704942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:50.704969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602820822776916:4596], now have 1 active actors on pipe
2025-10-10T14:39:50.705206Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:50.705233Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 19 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602820822776916:4596]
2025-10-10T14:39:50.705260Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:50.705263Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:50.705360Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3121 reason: error at write: Disconnected sessionId: src_id|ed7592ca-768a8b82-c521e7f5-f2604b77_0
2025-10-10T14:39:50.705614Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3121 sessionId: src_id|ed7592ca-768a8b82-c521e7f5-f2604b77_0 is DEAD
2025-10-10T14:39:50.705227Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:50.706049Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed7592ca-768a8b82-c521e7f5-f2604b77_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:50.706060Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed7592ca-768a8b82-c521e7f5-f2604b77_0] Write session will restart in 0.006453s
2025-10-10T14:39:50.706097Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed7592ca-768a8b82-c521e7f5-f2604b77_0] Write session: Do CDS request
2025-10-10T14:39:50.706106Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed7592ca-768a8b82-c521e7f5-f2604b77_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:50.713985Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ed7592ca-768a8b82-c521e7f5-f2604b77_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:50.714138Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:50.714156Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3122
2025-10-10T14:39:50.714290Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3122 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:50.714337Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3122 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:50.714348Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3122 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:50.714353Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:50.714862Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3122 sessionId:  describe result for acl check
2025-10-10T14:39:50.714912Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:50.714919Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:50.714922Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:50.714929Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602820822776934:4312] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:50.715571Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602820822776934:4312] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:50.718678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602820822776934:4312] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:50.722919Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602820822776934:4312] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:50.722940Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602820822776934:4312] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:50.722944Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602820822776934:4312] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:50.722954Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3122 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:50.730352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:50.735364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:50.735651Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:50.735664Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:50.735679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:50.735757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:50.735808Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602820040529948:5933]
2025-10-10T14:39:50.736452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:50.743445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:50.743614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:50.744105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:50.744199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:50.744207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:50.744208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:50.744210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:50.744211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:50.744212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:50.744214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:50.744215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:50.744217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:50.744218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:50.744220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:50.744221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:50.744223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:50.744231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:50.744257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:50.744261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:50.744266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:50.744269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:50.744273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:50.744276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:50.744280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:50.744284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:50.744288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:50.744292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:50.744296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:50.744299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:50.744310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:50.744319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:50.744328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:50.744333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:50.744337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:50.744343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:50.744347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:50.744352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:50.744356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:50.744361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:50.744366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:50.744371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:50.744376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:50.744381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:50.744385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:50.744391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:50.744396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:50.744403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:50.744407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:50.744413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:50.744417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:50.744422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:50.744427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:50.744432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:50.744437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:50.744442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:50.744483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:50.749990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:50.750757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:50.750770Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:50.750772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:50.750775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:50.750782Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3121 [2:7559602820040529948:5933]
2025-10-10T14:39:50.750793Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:50.750811Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:50.750813Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:50.750815Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:50.750817Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:50.750836Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:50.750845Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:50.750853Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:50.750932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:50.750942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:50.750945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:50.750947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:50.751031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:50.751040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:50.751056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:50.751068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:50.751083Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:50.751111Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602820040529943:5933]
2025-10-10T14:39:50.751118Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602820040529943:5933]
2025-10-10T14:39:50.751119Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602820040529943:5933]
2025-10-10T14:39:50.751129Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:50.751139Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:50.751145Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:50.751161Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:50.751164Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:50.751165Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:50.751168Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:50.751178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602820822776918:2438], now have 1 active actors on pipe
2025-10-10T14:39:50.751183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602820822777093:4312], now have 1 active actors on pipe
2025-10-10T14:39:50.751228Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602820040529943:5933]
2025-10-10T14:39:50.751244Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:50.751250Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:50.751685Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3121
2025-10-10T14:39:50.751735Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3121
2025-10-10T14:39:50.751769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:50.751784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:50.751820Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9c58866f-6d3cc6a7-e5a42f8f-b786ea1e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:50.751831Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:50.751837Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:50.751839Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:50.751855Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:50.751875Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:50.751895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:50.752318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:50.752332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:50.752354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:50.752465Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3122 partition: 0 MaxSeqNo: 40 sessionId: src_id|9c58866f-6d3cc6a7-e5a42f8f-b786ea1e_0
2025-10-10T14:39:50.752954Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed7592ca-768a8b82-c521e7f5-f2604b77_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|9c58866f-6d3cc6a7-e5a42f8f-b786ea1e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:50.755868Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9c58866f-6d3cc6a7-e5a42f8f-b786ea1e_0] Write session: try to update token
2025-10-10T14:39:50.755887Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9c58866f-6d3cc6a7-e5a42f8f-b786ea1e_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:50.776385Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:50.776411Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:50.776414Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:50.776416Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:50.776426Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602820040529943:5933]
2025-10-10T14:39:50.776435Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602820040529943:5933]
2025-10-10T14:39:50.776440Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602820040529943:5933]
2025-10-10T14:39:50.776494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:50.776502Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:50.776510Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:50.776511Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:50.776516Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:50.776521Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:50.776676Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:50.777242Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3122 sessionId: src_id|9c58866f-6d3cc6a7-e5a42f8f-b786ea1e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:50.780129Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:50.804718Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602820822777196:4596]
2025-10-10T14:39:50.805143Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 pipe creation result: OK TabletId: 72075186224037892 Generation: 3121, pipe: [1:7559602820822777196:4596]
2025-10-10T14:39:50.899798Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:50.900550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:50.900571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:50.900623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602820822777196:4596], now have 1 active actors on pipe
2025-10-10T14:39:50.900913Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:50.904810Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c58866f-6d3cc6a7-e5a42f8f-b786ea1e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:39:50.904824Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c58866f-6d3cc6a7-e5a42f8f-b786ea1e_0] Write session will restart in 0.007129s
2025-10-10T14:39:50.904849Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c58866f-6d3cc6a7-e5a42f8f-b786ea1e_0] Write session: Do CDS request
2025-10-10T14:39:50.904855Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c58866f-6d3cc6a7-e5a42f8f-b786ea1e_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:50.904225Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:50.904297Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 20 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602820822777196:4596]
2025-10-10T14:39:50.904322Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:39:50.904397Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3122 reason: status is not ok: tablet will be restarted right now sessionId: src_id|9c58866f-6d3cc6a7-e5a42f8f-b786ea1e_0
2025-10-10T14:39:50.904636Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3122 sessionId: src_id|9c58866f-6d3cc6a7-e5a42f8f-b786ea1e_0 is DEAD
2025-10-10T14:39:50.913031Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9c58866f-6d3cc6a7-e5a42f8f-b786ea1e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:50.913408Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:50.913429Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3123
2025-10-10T14:39:50.913569Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3123 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:50.913612Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3123 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:50.913618Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3123 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:50.913621Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:50.914170Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3123 sessionId:  describe result for acl check
2025-10-10T14:39:50.914207Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:50.914208Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:50.914210Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:50.914217Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602820822777281:4307] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:50.914828Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602820822777281:4307] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:50.919805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602820822777281:4307] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:50.927249Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602820822777281:4307] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:50.927267Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602820822777281:4307] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:50.927271Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602820822777281:4307] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:50.927281Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3123 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:50.934150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:50.936238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:50.936537Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:50.936553Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:50.936567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:50.936633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:50.936705Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602820040530167:5916]
2025-10-10T14:39:50.937401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:50.937722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:50.937777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:50.938355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:50.938414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:50.938415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:50.938416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:50.938418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:50.938419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:50.938420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:50.938421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:50.938422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:50.938424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:50.938425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:50.938426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:50.938427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:50.938428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:50.938435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:50.938447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:50.938452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:50.938456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:50.938460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:50.938464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:50.938468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:50.938472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:50.938476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:50.938480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:50.938484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:50.938488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:50.938492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:50.938499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:50.938512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:50.938519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:50.938524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:50.938529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:50.938534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:50.938539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:50.938544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:50.938550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:50.938555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:50.938559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:50.938564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:50.938569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:50.938574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:50.938579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:50.938584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:50.938589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:50.938594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:50.938598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:50.938603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:50.938608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:50.938614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:50.938618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:50.938623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:50.938627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:50.938632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:50.938676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:50.941511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:50.941996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:50.942014Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:50.942017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:50.942020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:50.942027Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3122 [2:7559602820040530167:5916]
2025-10-10T14:39:50.942041Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:50.942061Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:50.942069Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:50.942073Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:50.942076Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:50.942095Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:50.942108Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:50.942117Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:50.942519Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3122
2025-10-10T14:39:50.942576Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3122
2025-10-10T14:39:50.942182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:50.942193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:50.942194Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:50.942197Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:50.942279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:50.942282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:50.942295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:50.942309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:50.942325Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:50.942348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602820822777227:2438], now have 1 active actors on pipe
2025-10-10T14:39:50.942352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602820822777483:4307], now have 1 active actors on pipe
2025-10-10T14:39:50.942360Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602820040530161:5916]
2025-10-10T14:39:50.942362Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602820040530161:5916]
2025-10-10T14:39:50.942364Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602820040530161:5916]
2025-10-10T14:39:50.942374Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:50.942382Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:50.942385Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:50.942387Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:50.942387Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:50.942407Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:50.942410Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:50.942441Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602820040530161:5916]
2025-10-10T14:39:50.942449Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:50.942457Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:50.942752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:50.942759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:50.942862Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|db0a472-176963f1-1d2e472d-41486403_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:50.942871Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:50.942876Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:50.942878Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:50.942891Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:50.942904Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:50.942920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:50.943498Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3123 partition: 0 MaxSeqNo: 40 sessionId: src_id|db0a472-176963f1-1d2e472d-41486403_0
2025-10-10T14:39:50.945629Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c58866f-6d3cc6a7-e5a42f8f-b786ea1e_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|db0a472-176963f1-1d2e472d-41486403_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:50.948373Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|db0a472-176963f1-1d2e472d-41486403_0] Write session: try to update token
2025-10-10T14:39:50.948395Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|db0a472-176963f1-1d2e472d-41486403_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:50.943292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:50.943310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:50.943340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:50.973069Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:50.973095Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:50.973099Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:50.973101Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:50.973111Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602820040530161:5916]
2025-10-10T14:39:50.973116Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602820040530161:5916]
2025-10-10T14:39:50.973122Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602820040530161:5916]
2025-10-10T14:39:50.973178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:50.973190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:50.973193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:50.973221Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:50.973228Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:50.973232Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:50.973366Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:50.984236Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3123 sessionId: src_id|db0a472-176963f1-1d2e472d-41486403_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:50.986996Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:51.004349Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602825117744824:4596]
2025-10-10T14:39:51.004627Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 pipe creation result: OK TabletId: 72075186224037892 Generation: 3122, pipe: [1:7559602825117744824:4596]
2025-10-10T14:39:51.129929Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:51.130358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:51.130391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:51.130418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602825117744824:4596], now have 1 active actors on pipe
2025-10-10T14:39:51.130686Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:51.130754Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 21 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602825117744824:4596]
2025-10-10T14:39:51.130763Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:51.130802Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:51.130805Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:51.130870Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3123 reason: error at write: Disconnected sessionId: src_id|db0a472-176963f1-1d2e472d-41486403_0
2025-10-10T14:39:51.131091Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3123 sessionId: src_id|db0a472-176963f1-1d2e472d-41486403_0 is DEAD
2025-10-10T14:39:51.131328Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db0a472-176963f1-1d2e472d-41486403_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:51.131446Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db0a472-176963f1-1d2e472d-41486403_0] Write session will restart in 0.007543s
2025-10-10T14:39:51.131473Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db0a472-176963f1-1d2e472d-41486403_0] Write session: Do CDS request
2025-10-10T14:39:51.131484Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db0a472-176963f1-1d2e472d-41486403_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:51.140066Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|db0a472-176963f1-1d2e472d-41486403_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:51.141664Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:51.141683Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3124
2025-10-10T14:39:51.144731Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3124 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:51.144798Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3124 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:51.144811Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3124 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:51.144816Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:51.145405Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3124 sessionId:  describe result for acl check
2025-10-10T14:39:51.145447Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:51.145452Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:51.145454Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:51.145461Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602825117744860:4262] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:51.146048Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602825117744860:4262] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:51.148579Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602825117744860:4262] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:51.158548Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602825117744860:4262] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:51.158570Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602825117744860:4262] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:51.158575Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602825117744860:4262] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:51.158585Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3124 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:51.183584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:51.184494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:51.184737Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:51.184748Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:51.184761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:51.184826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:51.184884Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602824335497713:5901]
2025-10-10T14:39:51.185515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:51.185889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:51.185945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:51.186298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:51.186372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:51.186379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:51.186380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:51.186382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:51.186383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:51.186385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:51.186386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:51.186388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:51.186390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:51.186391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:51.186392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:51.186393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:51.186394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:51.186402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:51.186415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:51.186418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:51.186422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:51.186426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:51.186431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:51.186436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:51.186440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:51.186443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:51.186448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:51.186452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:51.186456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:51.186460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:51.186468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:51.186476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:51.186484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:51.186490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:51.186495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:51.186500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:51.186504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:51.186509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:51.186514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:51.186519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:51.186524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:51.186529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:51.186533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:51.186538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:51.186542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:51.186549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:51.186555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:51.186561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:51.186565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:51.186571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:51.186577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:51.186582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:51.186587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:51.186593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:51.186598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:51.186604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:51.186643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:51.190586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:51.191589Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3123
2025-10-10T14:39:51.191118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:51.191135Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:51.191137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:51.191142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:51.191151Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3123 [2:7559602824335497713:5901]
2025-10-10T14:39:51.191166Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:51.191186Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:51.191190Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:51.191194Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:51.191197Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:51.191215Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:51.191224Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:51.191232Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:51.191312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:51.191315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:51.191317Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:51.191319Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:51.191386Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:51.191390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:51.191403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:51.191413Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:51.191428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:51.191450Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602824335497708:5901]
2025-10-10T14:39:51.191454Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602824335497708:5901]
2025-10-10T14:39:51.191456Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602824335497708:5901]
2025-10-10T14:39:51.191469Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:51.191483Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:51.191485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602825117744826:2438], now have 1 active actors on pipe
2025-10-10T14:39:51.191486Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:51.191489Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:51.191491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602825117744937:4262], now have 1 active actors on pipe
2025-10-10T14:39:51.191499Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:51.191514Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:51.191519Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:51.191553Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602824335497708:5901]
2025-10-10T14:39:51.191561Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:51.191602Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:51.192081Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3123
2025-10-10T14:39:51.192590Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3124 partition: 0 MaxSeqNo: 40 sessionId: src_id|97c5a61-67d9ceb4-4e648656-6547eb9d_0
2025-10-10T14:39:51.193041Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db0a472-176963f1-1d2e472d-41486403_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|97c5a61-67d9ceb4-4e648656-6547eb9d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:51.192154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:51.192181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:51.192216Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|97c5a61-67d9ceb4-4e648656-6547eb9d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:51.192225Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:51.192230Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:51.192233Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:51.192247Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:51.192260Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:51.192288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:51.192468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:51.192472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:51.192488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:51.195888Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|97c5a61-67d9ceb4-4e648656-6547eb9d_0] Write session: try to update token
2025-10-10T14:39:51.195910Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|97c5a61-67d9ceb4-4e648656-6547eb9d_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:51.203867Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:39:51.203889Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:51.203900Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602824335497708:5901]
2025-10-10T14:39:51.203952Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:39:51.203968Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:39:51.204138Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:39:51.204280Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:51.204412Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:51.204546Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:51.204750Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:39:51.204787Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:39:51.215932Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3124 sessionId: src_id|97c5a61-67d9ceb4-4e648656-6547eb9d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:51.219106Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:51.219377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:51.219405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:51.219460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:39:51.219591Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:39:51.222150Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:51.222169Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:51.222172Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:51.222174Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:51.222186Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602824335497708:5901]
2025-10-10T14:39:51.222191Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602824335497708:5901]
2025-10-10T14:39:51.222195Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602824335497708:5901]
2025-10-10T14:39:51.222241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:51.222255Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:51.222258Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:51.222263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:51.222264Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:51.222269Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:51.222409Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:51.231182Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602825117745106:4596]
2025-10-10T14:39:51.231670Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 pipe creation result: OK TabletId: 72075186224037892 Generation: 3123, pipe: [1:7559602825117745106:4596]
2025-10-10T14:39:51.339571Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:51.340341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602825117745106:4596], now have 1 active actors on pipe
2025-10-10T14:39:51.348509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:51.348535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:51.348709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:51.348766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:51.348828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:51.348890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:51.348935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:51.348943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:51.349011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:51.349072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:51.349146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:51.349219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:51.349262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:51.349272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:51.349377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:51.349440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:51.349520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:51.349588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:51.349630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:51.349636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:51.349701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:51.349759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:51.349818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:51.349877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:51.349921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:51.349927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:51.349988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:51.350043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:51.350105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:51.350163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:51.350207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:51.350214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:51.350274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:51.350325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:51.350387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:51.350446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:51.350489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:51.350496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:51.350555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:51.350610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:51.350670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:51.350729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:51.350777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:51.350783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:51.350841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:51.350897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:51.350953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:51.351009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:51.351051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:51.351056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:51.351114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:51.351169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:51.351230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:51.351288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:51.351331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:51.351338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:51.351395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:51.351451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:51.351507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:51.351565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:51.351610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:51.351616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:51.352390Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97c5a61-67d9ceb4-4e648656-6547eb9d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:51.352403Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97c5a61-67d9ceb4-4e648656-6547eb9d_0] Write session will restart in 0.009417s
2025-10-10T14:39:51.352429Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97c5a61-67d9ceb4-4e648656-6547eb9d_0] Write session: Do CDS request
2025-10-10T14:39:51.352435Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97c5a61-67d9ceb4-4e648656-6547eb9d_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:51.351954Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:51.351985Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:51.352022Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3124 reason: error at write: Disconnected sessionId: src_id|97c5a61-67d9ceb4-4e648656-6547eb9d_0
2025-10-10T14:39:51.352025Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 22 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602825117745106:4596]
2025-10-10T14:39:51.352060Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:51.352235Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3124 sessionId: src_id|97c5a61-67d9ceb4-4e648656-6547eb9d_0 is DEAD
2025-10-10T14:39:51.352734Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:51.366076Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|97c5a61-67d9ceb4-4e648656-6547eb9d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:51.366186Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:51.366205Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3125
2025-10-10T14:39:51.367580Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3125 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:51.367650Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3125 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:51.367660Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3125 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:51.367667Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:51.368258Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3125 sessionId:  describe result for acl check
2025-10-10T14:39:51.368317Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:51.368328Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:51.368331Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:51.368338Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602825117745298:4244] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:51.369028Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602825117745298:4244] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:51.372361Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602825117745298:4244] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:51.378393Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602825117745298:4244] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:51.378415Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602825117745298:4244] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:51.378418Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602825117745298:4244] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:51.378428Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3125 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:51.379162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:51.379998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:51.380234Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:51.380247Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:51.380260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:51.380323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:51.380374Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602824335497931:5888]
2025-10-10T14:39:51.381046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:51.381392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:51.381451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:51.381818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:51.381883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:51.381890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:51.381891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:51.381892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:51.381894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:51.381895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:51.381897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:51.381898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:51.381900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:51.381901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:51.381902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:51.381903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:51.381904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:51.381910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:51.381923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:51.381928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:51.381933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:51.381938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:51.381942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:51.381946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:51.381950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:51.381954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:51.381958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:51.381962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:51.381967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:51.381971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:51.381979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:51.381989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:51.381996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:51.382002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:51.382007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:51.382014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:51.382024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:51.382030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:51.382035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:51.382041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:51.382046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:51.382051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:51.382061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:51.382067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:51.382076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:51.382081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:51.382091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:51.382096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:51.382106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:51.382114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:51.382119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:51.382126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:51.382131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:51.382141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:51.382146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:51.382156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:51.382197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:51.402658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:51.403779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:51.403797Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:51.403800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:51.403804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:51.403812Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3124 [2:7559602824335497931:5888]
2025-10-10T14:39:51.403826Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:51.403844Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:51.403848Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:51.403852Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:51.403855Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:51.403876Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:51.403891Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:51.403899Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:51.403958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:51.403965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:51.403966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:51.403968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:51.404033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:51.404040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:51.404051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:51.404062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:51.404078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:51.404100Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602824335497926:5888]
2025-10-10T14:39:51.404110Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602824335497926:5888]
2025-10-10T14:39:51.404112Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602824335497926:5888]
2025-10-10T14:39:51.404127Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:51.404150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602825117745109:2438], now have 1 active actors on pipe
2025-10-10T14:39:51.404152Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:51.404156Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:51.404158Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:51.404159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602825117745383:4244], now have 1 active actors on pipe
2025-10-10T14:39:51.404168Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:51.404187Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:51.404191Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:51.404244Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602824335497926:5888]
2025-10-10T14:39:51.404257Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:51.404238Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3124
2025-10-10T14:39:51.404294Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:51.404246Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3124
2025-10-10T14:39:51.404431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:51.404443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:51.404481Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d8327e2f-384f3e77-3a0eb1b4-3f41426a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:51.404494Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:51.404513Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:51.404516Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:51.404531Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:51.404548Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:51.404566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:51.404805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:51.404819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:51.404845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:51.404963Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3125 partition: 0 MaxSeqNo: 40 sessionId: src_id|d8327e2f-384f3e77-3a0eb1b4-3f41426a_0
2025-10-10T14:39:51.405419Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97c5a61-67d9ceb4-4e648656-6547eb9d_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|d8327e2f-384f3e77-3a0eb1b4-3f41426a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:51.408116Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d8327e2f-384f3e77-3a0eb1b4-3f41426a_0] Write session: try to update token
2025-10-10T14:39:51.408135Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d8327e2f-384f3e77-3a0eb1b4-3f41426a_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:51.424451Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:39:51.424474Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:51.424489Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602824335497926:5888]
2025-10-10T14:39:51.424537Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:39:51.424825Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:39:51.425022Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:39:51.425170Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:51.425308Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:51.425468Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:51.425689Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:39:51.425747Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:39:51.429117Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3125 sessionId: src_id|d8327e2f-384f3e77-3a0eb1b4-3f41426a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:51.432144Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:51.432397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:51.432421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:51.432464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:39:51.432575Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:39:51.435426Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:51.435448Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:51.435451Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:51.435453Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:51.435466Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602824335497926:5888]
2025-10-10T14:39:51.435469Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602824335497926:5888]
2025-10-10T14:39:51.435476Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602824335497926:5888]
2025-10-10T14:39:51.435530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:51.435538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:51.435541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:51.435541Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:51.435549Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:51.435559Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:51.435691Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:51.452371Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602825117745397:4596]
2025-10-10T14:39:51.452685Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 pipe creation result: OK TabletId: 72075186224037892 Generation: 3124, pipe: [1:7559602825117745397:4596]
2025-10-10T14:39:51.576565Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:51.577395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602825117745397:4596], now have 1 active actors on pipe
2025-10-10T14:39:51.585603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:51.585638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:51.585836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:51.585904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:51.585971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:51.586035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:51.586078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:51.586091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:51.586162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:51.586227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:51.586297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:51.586365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:51.586412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:51.586425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:51.586497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:51.586563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:51.586626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:51.586691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:51.586733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:51.586737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:51.586806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:51.586870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:51.586933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:51.587010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:51.587051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:51.587055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:51.587128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:51.587190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:51.587251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:51.587312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:51.587354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:51.587357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:51.587425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:51.587489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:51.587552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:51.587618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:51.587659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:51.587663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:51.587733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:51.587800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:51.587866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:51.587926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:51.587968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:51.587971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:51.588039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:51.588100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:51.588160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:51.588223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:51.588265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:51.588271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:51.588340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:51.588395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:51.588512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:51.588611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:51.588680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:51.588685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:51.588768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:51.588827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:51.588888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:51.588952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:51.588994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:51.588997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:51.589504Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:51.590010Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8327e2f-384f3e77-3a0eb1b4-3f41426a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:51.590032Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8327e2f-384f3e77-3a0eb1b4-3f41426a_0] Write session will restart in 0.008995s
2025-10-10T14:39:51.590059Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8327e2f-384f3e77-3a0eb1b4-3f41426a_0] Write session: Do CDS request
2025-10-10T14:39:51.590065Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8327e2f-384f3e77-3a0eb1b4-3f41426a_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:51.589575Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:51.589594Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:51.589632Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3125 reason: error at write: Disconnected sessionId: src_id|d8327e2f-384f3e77-3a0eb1b4-3f41426a_0
2025-10-10T14:39:51.589828Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 23 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602825117745397:4596]
2025-10-10T14:39:51.589888Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3125 sessionId: src_id|d8327e2f-384f3e77-3a0eb1b4-3f41426a_0 is DEAD
2025-10-10T14:39:51.590902Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:51.600006Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d8327e2f-384f3e77-3a0eb1b4-3f41426a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:51.600474Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:51.600497Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3126
2025-10-10T14:39:51.601064Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3126 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:51.601108Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3126 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:51.601114Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3126 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:51.601118Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:51.601629Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3126 sessionId:  describe result for acl check
2025-10-10T14:39:51.601665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:51.601668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:51.601670Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:51.601676Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602825117745416:4236] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:51.602262Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602825117745416:4236] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:51.607392Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602825117745416:4236] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:51.610555Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602825117745416:4236] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:51.610575Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602825117745416:4236] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:51.610579Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602825117745416:4236] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:51.610589Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3126 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:51.622443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:51.627218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:51.627486Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:51.627512Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:51.627529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:51.627595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:51.627646Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602824335498149:5892]
2025-10-10T14:39:51.628333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:51.628723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:51.628794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:51.629170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:51.629248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:51.629255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:51.629257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:51.629258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:51.629260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:51.629261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:51.629263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:51.629264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:51.629266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:51.629267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:51.629269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:51.629271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:51.629272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:51.629281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:51.629296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:51.629301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:51.629306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:51.629311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:51.629316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:51.629321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:51.629326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:51.629350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:51.629355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:51.629360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:51.629373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:51.629377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:51.629387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:51.629396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:51.629404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:51.629409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:51.629413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:51.629418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:51.629422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:51.629427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:51.629432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:51.629437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:51.629442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:51.629447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:51.629452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:51.629457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:51.629461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:51.629466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:51.629471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:51.629479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:51.629484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:51.629490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:51.629495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:51.629501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:51.629506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:51.629512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:51.629518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:51.629524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:51.629568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:51.632230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:51.633138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:51.633156Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:51.633159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:51.633164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:51.633172Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3125 [2:7559602824335498149:5892]
2025-10-10T14:39:51.633188Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:51.633210Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:51.633220Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:51.633224Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:51.633226Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:51.633246Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:51.633254Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:51.633265Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:51.633358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:51.633367Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:51.633369Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:51.633372Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:51.633449Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:51.633459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:51.633472Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:51.633578Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3125
2025-10-10T14:39:51.633619Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3125
2025-10-10T14:39:51.633485Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:51.633511Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:51.633537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602825117745400:2438], now have 1 active actors on pipe
2025-10-10T14:39:51.633541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602825117745529:4236], now have 1 active actors on pipe
2025-10-10T14:39:51.633549Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602824335498144:5892]
2025-10-10T14:39:51.633552Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602824335498144:5892]
2025-10-10T14:39:51.633554Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602824335498144:5892]
2025-10-10T14:39:51.633569Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:51.633581Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:51.633584Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:51.633586Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:51.633587Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:51.633604Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:51.633607Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:51.633647Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602824335498144:5892]
2025-10-10T14:39:51.633656Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:51.633668Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:51.633691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:51.633697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:51.633733Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2ec8b989-51102e09-3ab2c970-a87a6ba2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:51.633741Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:51.633746Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:51.633749Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:51.633762Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:51.633774Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:51.633791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:51.633961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:51.633973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:51.633999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:51.634083Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3126 partition: 0 MaxSeqNo: 40 sessionId: src_id|2ec8b989-51102e09-3ab2c970-a87a6ba2_0
2025-10-10T14:39:51.634553Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8327e2f-384f3e77-3a0eb1b4-3f41426a_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|2ec8b989-51102e09-3ab2c970-a87a6ba2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:51.637557Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2ec8b989-51102e09-3ab2c970-a87a6ba2_0] Write session: try to update token
2025-10-10T14:39:51.637579Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2ec8b989-51102e09-3ab2c970-a87a6ba2_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:51.655582Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:51.655621Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:51.655624Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:51.655627Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:51.655637Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602824335498144:5892]
2025-10-10T14:39:51.655645Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602824335498144:5892]
2025-10-10T14:39:51.655650Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602824335498144:5892]
2025-10-10T14:39:51.655705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:51.655710Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:51.655713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:51.655716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:51.655718Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:51.655726Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:51.655872Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:51.662748Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3126 sessionId: src_id|2ec8b989-51102e09-3ab2c970-a87a6ba2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:51.665952Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:51.689982Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602825117745682:4596]
2025-10-10T14:39:51.690415Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 pipe creation result: OK TabletId: 72075186224037892 Generation: 3125, pipe: [1:7559602825117745682:4596]
2025-10-10T14:39:51.778665Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:51.779506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:51.779524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:51.779549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602825117745682:4596], now have 1 active actors on pipe
2025-10-10T14:39:51.779781Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:51.780369Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ec8b989-51102e09-3ab2c970-a87a6ba2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:39:51.779780Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:51.780390Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ec8b989-51102e09-3ab2c970-a87a6ba2_0] Write session will restart in 0.005642s
2025-10-10T14:39:51.779839Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 24 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602825117745682:4596]
2025-10-10T14:39:51.779858Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:39:51.779957Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3126 reason: status is not ok: tablet will be restarted right now sessionId: src_id|2ec8b989-51102e09-3ab2c970-a87a6ba2_0
2025-10-10T14:39:51.780203Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3126 sessionId: src_id|2ec8b989-51102e09-3ab2c970-a87a6ba2_0 is DEAD
2025-10-10T14:39:51.780416Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ec8b989-51102e09-3ab2c970-a87a6ba2_0] Write session: Do CDS request
2025-10-10T14:39:51.780422Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ec8b989-51102e09-3ab2c970-a87a6ba2_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:51.786897Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2ec8b989-51102e09-3ab2c970-a87a6ba2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:51.787039Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:51.787058Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3127
2025-10-10T14:39:51.787183Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3127 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:51.787220Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3127 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:51.787231Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3127 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:51.787235Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:51.787655Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3127 sessionId:  describe result for acl check
2025-10-10T14:39:51.787689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:51.787696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:51.787698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:51.787704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602825117745699:4237] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:51.788271Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602825117745699:4237] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:51.791450Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602825117745699:4237] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:51.795087Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602825117745699:4237] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:51.795105Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602825117745699:4237] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:51.795108Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602825117745699:4237] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:51.795117Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3127 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:51.803069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:51.807921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:51.808284Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:51.808296Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:51.808312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:51.808386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:51.808435Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602824335498379:5884]
2025-10-10T14:39:51.809102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:51.809543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:51.809615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:51.810021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:51.810084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:51.810090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:51.810092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:51.810093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:51.810095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:51.810097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:51.810099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:51.810100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:51.810102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:51.810103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:51.810105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:51.810106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:51.810108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:51.810116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:51.810130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:51.810135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:51.810141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:51.810146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:51.810151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:51.810155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:51.810160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:51.810165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:51.810172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:51.810177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:51.810182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:51.810192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:51.810204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:51.810218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:51.810225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:51.810232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:51.810238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:51.810244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:51.810249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:51.810256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:51.810261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:51.810268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:51.810273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:51.810285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:51.810291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:51.810297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:51.810337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:51.810349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:51.810354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:51.810361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:51.810366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:51.810372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:51.810382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:51.810389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:51.810394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:51.810405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:51.810410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:51.810422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:51.810470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:51.813243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:51.813607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:51.813624Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:51.813627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:51.813632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:51.813640Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3126 [2:7559602824335498379:5884]
2025-10-10T14:39:51.813658Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:51.813687Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:51.813695Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:51.813700Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:51.813703Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:51.813723Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:51.813736Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:51.813750Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:51.813817Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:51.813828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:51.813831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:51.813834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:51.813912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:51.813921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:51.813933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:51.813947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:51.813973Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:51.814001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602825117745684:2438], now have 1 active actors on pipe
2025-10-10T14:39:51.814005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602825117745842:4237], now have 1 active actors on pipe
2025-10-10T14:39:51.814014Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602824335498374:5884]
2025-10-10T14:39:51.814021Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602824335498374:5884]
2025-10-10T14:39:51.814024Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602824335498374:5884]
2025-10-10T14:39:51.814038Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:51.814091Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3126
2025-10-10T14:39:51.814141Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3126
2025-10-10T14:39:51.814057Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:51.814082Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:51.814086Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:51.814124Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602824335498374:5884]
2025-10-10T14:39:51.814126Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:51.814178Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:51.814181Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:51.814185Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:51.814193Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:51.814352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:51.814358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:51.814390Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ebfef958-b92a207c-baf8462e-e3bc9b46_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:51.814398Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:51.814402Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:51.814405Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:51.814418Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:51.814429Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:51.814447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:51.814715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:51.814726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:51.814743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:51.814849Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3127 partition: 0 MaxSeqNo: 40 sessionId: src_id|ebfef958-b92a207c-baf8462e-e3bc9b46_0
2025-10-10T14:39:51.815319Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ec8b989-51102e09-3ab2c970-a87a6ba2_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|ebfef958-b92a207c-baf8462e-e3bc9b46_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:51.818309Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ebfef958-b92a207c-baf8462e-e3bc9b46_0] Write session: try to update token
2025-10-10T14:39:51.818332Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ebfef958-b92a207c-baf8462e-e3bc9b46_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:51.827795Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:39:51.827824Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:51.827838Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602824335498374:5884]
2025-10-10T14:39:51.827896Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:39:51.827905Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:39:51.828251Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:39:51.828423Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:51.828705Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:51.828855Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:51.829131Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:39:51.829174Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:39:51.837742Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3127 sessionId: src_id|ebfef958-b92a207c-baf8462e-e3bc9b46_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:51.840808Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:51.841154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:51.841191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:51.841250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:39:51.841394Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:39:51.847860Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:51.847880Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:51.847884Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:51.847886Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:51.847897Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602824335498374:5884]
2025-10-10T14:39:51.847900Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602824335498374:5884]
2025-10-10T14:39:51.847902Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602824335498374:5884]
2025-10-10T14:39:51.847944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:51.847952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:51.847953Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:51.847962Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:51.847970Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:51.847975Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:51.848081Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:51.879879Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602825117745984:4596]
2025-10-10T14:39:51.880382Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 pipe creation result: OK TabletId: 72075186224037892 Generation: 3126, pipe: [1:7559602825117745984:4596]
2025-10-10T14:39:51.963534Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:51.973452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:51.973485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:51.973669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:51.973738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:51.973804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:51.973878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:51.973931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:51.973940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:51.974017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:51.974082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:51.974148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:51.974218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:51.974269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:51.974276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:51.974352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:51.974419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:51.974493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:51.974570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:51.974623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:51.974631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:51.974704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:51.974769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:51.974843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:51.974908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:51.974956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:51.974960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:51.975034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:51.975098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:51.975163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:51.975237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:51.975289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:51.975296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:51.975371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:51.975441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:51.975510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:51.975579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:51.975624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:51.975632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:51.975701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:51.975763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:51.975834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:51.975900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:51.975946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:51.975953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:51.976024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:51.976085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:51.976148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:51.976223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:51.976276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:51.977320Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:51.976278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:51.977365Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:51.977369Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:51.976349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:51.977405Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3127 reason: error at write: Disconnected sessionId: src_id|ebfef958-b92a207c-baf8462e-e3bc9b46_0
2025-10-10T14:39:51.976410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:51.976476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:51.976547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:51.976590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:51.976593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:51.976685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:51.977430Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 25 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602825117745984:4596]
2025-10-10T14:39:51.976747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:51.976807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:51.976866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:51.976911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:51.976914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:51.976994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602825117745984:4596], now have 1 active actors on pipe
2025-10-10T14:39:51.977737Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3127 sessionId: src_id|ebfef958-b92a207c-baf8462e-e3bc9b46_0 is DEAD
2025-10-10T14:39:51.977858Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ebfef958-b92a207c-baf8462e-e3bc9b46_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:51.977866Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ebfef958-b92a207c-baf8462e-e3bc9b46_0] Write session will restart in 0.007408s
2025-10-10T14:39:51.977898Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ebfef958-b92a207c-baf8462e-e3bc9b46_0] Write session: Do CDS request
2025-10-10T14:39:51.977905Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ebfef958-b92a207c-baf8462e-e3bc9b46_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:51.978488Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:51.989935Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ebfef958-b92a207c-baf8462e-e3bc9b46_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:51.990007Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:51.990032Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3128
2025-10-10T14:39:51.990311Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3128 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:51.990354Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3128 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:51.990366Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3128 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:51.990371Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:51.991157Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3128 sessionId:  describe result for acl check
2025-10-10T14:39:51.991202Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:51.991204Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:51.991206Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:51.991213Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602825117746065:4212] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:51.991766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602825117746065:4212] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:52.013567Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602825117746065:4212] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:52.019676Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602825117746065:4212] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:52.019698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602825117746065:4212] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:52.019702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602825117746065:4212] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:52.019712Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3128 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:52.020836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:52.025829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:52.026114Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:52.026127Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:52.026141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:52.026221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:52.026267Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602828630465907:5882]
2025-10-10T14:39:52.026906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:52.027316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:52.027369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:52.027709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:52.027787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:52.027793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:52.027794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:52.027795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:52.027797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:52.027798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:52.027800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:52.027801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:52.027802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:52.027804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:52.027805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:52.027806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:52.027807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:52.027814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:52.027826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:52.027831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:52.027835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:52.027838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:52.027842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:52.027856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:52.027861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:52.027864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:52.027870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:52.027873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:52.027876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:52.027879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:52.027886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:52.027896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:52.027903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:52.027908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:52.027912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:52.027916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:52.027920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:52.027924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:52.027929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:52.027933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:52.027937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:52.027942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:52.027947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:52.027951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:52.027955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:52.027960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:52.027964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:52.027969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:52.027973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:52.027979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:52.027983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:52.027988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:52.027992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:52.027998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:52.028001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:52.028007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:52.028062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:52.030898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:52.031479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:52.031493Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:52.031496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:52.031501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:52.031509Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3127 [2:7559602828630465907:5882]
2025-10-10T14:39:52.031522Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:52.031540Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:52.031544Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:52.031547Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:52.031550Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:52.031568Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:52.031576Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:52.031584Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:52.031651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:52.031661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:52.031664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:52.031667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:52.031753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:52.031763Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:52.031775Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:52.031787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:52.031803Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:52.031834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602829412713567:4212], now have 1 active actors on pipe
2025-10-10T14:39:52.031842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602825117745991:2438], now have 1 active actors on pipe
2025-10-10T14:39:52.031850Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602828630465902:5882]
2025-10-10T14:39:52.031857Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602828630465902:5882]
2025-10-10T14:39:52.031863Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602828630465902:5882]
2025-10-10T14:39:52.031876Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:52.031894Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:52.031895Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:52.031913Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:52.031915Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:52.031917Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:52.031918Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:52.031946Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602828630465902:5882]
2025-10-10T14:39:52.031959Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:52.031960Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:52.031995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:52.032005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:52.032041Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|af94c969-158b3f3d-40df6a22-b104b755_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:52.032054Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:52.032058Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:52.032060Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:52.032070Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:52.031940Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3127
2025-10-10T14:39:52.032086Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:52.031993Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3127
2025-10-10T14:39:52.032105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:52.032235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:52.032244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:52.032262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:52.032355Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3128 partition: 0 MaxSeqNo: 40 sessionId: src_id|af94c969-158b3f3d-40df6a22-b104b755_0
2025-10-10T14:39:52.032825Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ebfef958-b92a207c-baf8462e-e3bc9b46_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|af94c969-158b3f3d-40df6a22-b104b755_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:52.035721Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|af94c969-158b3f3d-40df6a22-b104b755_0] Write session: try to update token
2025-10-10T14:39:52.035743Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|af94c969-158b3f3d-40df6a22-b104b755_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:52.054801Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:52.054826Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:52.054831Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:52.054833Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:52.054845Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602828630465902:5882]
2025-10-10T14:39:52.054850Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602828630465902:5882]
2025-10-10T14:39:52.054854Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602828630465902:5882]
2025-10-10T14:39:52.054900Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:52.054908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:52.054916Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:52.054916Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:52.054920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:52.054921Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:52.055053Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:52.055103Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3128 sessionId: src_id|af94c969-158b3f3d-40df6a22-b104b755_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:52.057936Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:52.077528Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602829412713592:4596]
2025-10-10T14:39:52.077935Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 pipe creation result: OK TabletId: 72075186224037892 Generation: 3127, pipe: [1:7559602829412713592:4596]
2025-10-10T14:39:52.178177Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:52.179657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:52.179685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:52.179740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602829412713592:4596], now have 1 active actors on pipe
2025-10-10T14:39:52.180011Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:52.180067Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:52.180083Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 26 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602829412713592:4596]
2025-10-10T14:39:52.180087Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:52.180104Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:52.180166Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3128 reason: error at write: Disconnected sessionId: src_id|af94c969-158b3f3d-40df6a22-b104b755_0
2025-10-10T14:39:52.180433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3128 sessionId: src_id|af94c969-158b3f3d-40df6a22-b104b755_0 is DEAD
2025-10-10T14:39:52.180583Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af94c969-158b3f3d-40df6a22-b104b755_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:52.180596Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af94c969-158b3f3d-40df6a22-b104b755_0] Write session will restart in 0.009994s
2025-10-10T14:39:52.180632Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af94c969-158b3f3d-40df6a22-b104b755_0] Write session: Do CDS request
2025-10-10T14:39:52.180643Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af94c969-158b3f3d-40df6a22-b104b755_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:52.191941Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|af94c969-158b3f3d-40df6a22-b104b755_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:52.192378Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:52.192396Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3129
2025-10-10T14:39:52.192524Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3129 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:52.192556Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3129 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:52.192560Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3129 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:52.192563Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:52.193026Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3129 sessionId:  describe result for acl check
2025-10-10T14:39:52.193070Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:52.193077Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:52.193079Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:52.193086Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602829412713629:4190] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:52.193659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602829412713629:4190] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:52.196792Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602829412713629:4190] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:52.203389Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602829412713629:4190] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:52.203409Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602829412713629:4190] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:52.203412Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602829412713629:4190] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:52.203423Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3129 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:52.213408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:52.214379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:52.214598Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:52.214605Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:52.214617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:52.214682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:52.214723Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602828630466151:5862]
2025-10-10T14:39:52.215378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:52.218707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:52.218793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:52.219190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:52.219254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:52.219256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:52.219257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:52.219258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:52.219260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:52.219261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:52.219263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:52.219265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:52.219267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:52.219268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:52.219269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:52.219271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:52.219272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:52.219279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:52.219292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:52.219296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:52.219300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:52.219305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:52.219310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:52.219314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:52.219318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:52.219322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:52.219325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:52.219329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:52.219333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:52.219337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:52.219351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:52.219360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:52.219366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:52.219372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:52.219375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:52.219378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:52.219381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:52.219384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:52.219387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:52.219391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:52.219393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:52.219396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:52.219399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:52.219402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:52.219405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:52.219408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:52.219411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:52.219414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:52.219416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:52.219420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:52.219423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:52.219427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:52.219432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:52.219437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:52.219445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:52.219451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:52.219484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:52.222743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:52.223196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:52.223203Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:52.223206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:52.223210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:52.223217Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3128 [2:7559602828630466151:5862]
2025-10-10T14:39:52.223234Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:52.223259Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:52.223263Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:52.223267Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:52.223270Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:52.223291Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:52.223299Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:52.223307Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:52.223377Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:52.223379Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:52.223381Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:52.223384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:52.223478Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:52.223481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:52.223496Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:52.223507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:52.223524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:52.223549Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602828630466146:5862]
2025-10-10T14:39:52.223551Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602828630466146:5862]
2025-10-10T14:39:52.223553Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602828630466146:5862]
2025-10-10T14:39:52.223572Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:52.223589Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:52.223604Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:52.223608Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:52.223642Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602828630466146:5862]
2025-10-10T14:39:52.223645Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:52.224199Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:52.224210Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:52.224212Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:52.224220Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:52.224664Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3128
2025-10-10T14:39:52.224716Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3128
2025-10-10T14:39:52.226768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602829412713595:2438], now have 1 active actors on pipe
2025-10-10T14:39:52.226784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602829412713742:4190], now have 1 active actors on pipe
2025-10-10T14:39:52.226808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:52.226815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:52.226860Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c91f0f90-f2b59cf7-bba9b629-24499dd4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:52.226873Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:52.226880Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:52.226884Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:52.226904Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:52.226925Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:52.226949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:52.227380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:52.227397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:52.227427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:52.227604Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3129 partition: 0 MaxSeqNo: 40 sessionId: src_id|c91f0f90-f2b59cf7-bba9b629-24499dd4_0
2025-10-10T14:39:52.228687Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af94c969-158b3f3d-40df6a22-b104b755_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|c91f0f90-f2b59cf7-bba9b629-24499dd4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:52.231661Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c91f0f90-f2b59cf7-bba9b629-24499dd4_0] Write session: try to update token
2025-10-10T14:39:52.231683Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c91f0f90-f2b59cf7-bba9b629-24499dd4_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:52.237251Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:39:52.237276Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:52.237288Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602828630466146:5862]
2025-10-10T14:39:52.237364Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:39:52.237369Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:39:52.237563Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:39:52.237708Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:52.237861Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:52.238010Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:52.238210Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:39:52.238258Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:39:52.250846Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3129 sessionId: src_id|c91f0f90-f2b59cf7-bba9b629-24499dd4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:52.253870Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:52.254212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:52.254250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:52.256192Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:52.256213Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:52.256217Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:52.256219Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:52.256231Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602828630466146:5862]
2025-10-10T14:39:52.256235Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602828630466146:5862]
2025-10-10T14:39:52.256239Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602828630466146:5862]
2025-10-10T14:39:52.256297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:39:52.256301Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:52.256307Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:52.256311Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:52.256325Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:52.256334Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:52.256336Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:52.256423Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:39:52.256487Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:52.279738Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602829412713879:4596]
2025-10-10T14:39:52.280022Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 pipe creation result: OK TabletId: 72075186224037892 Generation: 3128, pipe: [1:7559602829412713879:4596]
2025-10-10T14:39:52.374072Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:52.375232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602829412713879:4596], now have 1 active actors on pipe
2025-10-10T14:39:52.383785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:52.383814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:52.384004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:52.384072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:52.384140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:52.384214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:52.384267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:52.384278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:52.384360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:52.384428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:52.384496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:52.384567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:52.384631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:52.384643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:52.384719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:52.384783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:52.384849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:52.384915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:52.384970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:52.384977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:52.385059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:52.385131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:52.385202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:52.385273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:52.385320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:52.385344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:52.385422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:52.385493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:52.385567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:52.385639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:52.385691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:52.385694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:52.385772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:52.385840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:52.385911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:52.385986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:52.386040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:52.386047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:52.386124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:52.386191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:52.386267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:52.386335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:52.386381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:52.386387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:52.386454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:52.386522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:52.386592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:52.386665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:52.386715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:52.386722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:52.386796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:52.386863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:52.386927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:52.387001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:52.387048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:52.387055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:52.387127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:52.387195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:52.387270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:52.387340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:52.387388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:52.387395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:52.388123Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:52.388199Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 27 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602829412713879:4596]
2025-10-10T14:39:52.388243Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:52.388250Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:52.388280Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3129 reason: error at write: Disconnected sessionId: src_id|c91f0f90-f2b59cf7-bba9b629-24499dd4_0
2025-10-10T14:39:52.388527Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3129 sessionId: src_id|c91f0f90-f2b59cf7-bba9b629-24499dd4_0 is DEAD
2025-10-10T14:39:52.388678Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c91f0f90-f2b59cf7-bba9b629-24499dd4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:52.388690Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c91f0f90-f2b59cf7-bba9b629-24499dd4_0] Write session will restart in 0.006550s
2025-10-10T14:39:52.388715Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c91f0f90-f2b59cf7-bba9b629-24499dd4_0] Write session: Do CDS request
2025-10-10T14:39:52.388722Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c91f0f90-f2b59cf7-bba9b629-24499dd4_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:52.388778Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:52.397032Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c91f0f90-f2b59cf7-bba9b629-24499dd4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:52.397067Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:52.397085Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3130
2025-10-10T14:39:52.397301Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3130 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:52.397363Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3130 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:52.397375Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3130 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:52.397379Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:52.397848Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3130 sessionId:  describe result for acl check
2025-10-10T14:39:52.397891Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:52.397899Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:52.397901Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:52.397908Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602829412713897:4165] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:52.398501Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602829412713897:4165] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:52.401770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602829412713897:4165] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:52.405811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602829412713897:4165] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:52.405830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602829412713897:4165] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:52.405834Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602829412713897:4165] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:52.405843Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3130 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:52.421181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:52.421843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:52.422060Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:52.422073Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:52.422085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:52.422133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:52.422179Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602828630466374:5861]
2025-10-10T14:39:52.422769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:52.423069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:52.423117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:52.423432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:52.423501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:52.423512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:52.423514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:52.423515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:52.423517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:52.423518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:52.423520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:52.423521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:52.423523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:52.423524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:52.423525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:52.423527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:52.423528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:52.423535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:52.423548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:52.423553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:52.423557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:52.423561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:52.423565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:52.423570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:52.423574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:52.423578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:52.423582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:52.423586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:52.423590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:52.423594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:52.423603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:52.423612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:52.423620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:52.423625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:52.423630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:52.423636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:52.423640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:52.423646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:52.423650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:52.423656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:52.423662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:52.423667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:52.423672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:52.423675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:52.423678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:52.423681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:52.423684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:52.423688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:52.423690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:52.423693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:52.423701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:52.423706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:52.423711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:52.423715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:52.423719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:52.423724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:52.423754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:52.426388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:52.426769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:52.426781Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:52.426784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:52.426788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:52.426795Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3129 [2:7559602828630466374:5861]
2025-10-10T14:39:52.426807Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:52.426825Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:52.426834Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:52.426838Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:52.426840Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:52.426870Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:52.426890Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:52.426899Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:52.427693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:52.427708Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:52.427710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:52.427713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:52.427799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:52.427809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:52.427823Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:52.427834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:52.427851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:52.427874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602829412713882:2438], now have 1 active actors on pipe
2025-10-10T14:39:52.427879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602829412714002:4165], now have 1 active actors on pipe
2025-10-10T14:39:52.427887Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602828630466369:5861]
2025-10-10T14:39:52.427889Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602828630466369:5861]
2025-10-10T14:39:52.427892Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602828630466369:5861]
2025-10-10T14:39:52.427908Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:52.427922Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:52.427925Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:52.427927Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:52.427930Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:52.427947Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:52.427950Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:52.427983Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602828630466369:5861]
2025-10-10T14:39:52.427992Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:52.428013Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:52.427990Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3129
2025-10-10T14:39:52.428047Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3129
2025-10-10T14:39:52.428163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:52.428178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:52.428227Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|65f4dada-7842ec16-15dd14f-515ad17b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:52.428241Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:52.428259Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:52.428267Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:52.428282Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:52.428297Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:52.428314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:52.428525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:52.428536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:52.428552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:52.428711Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3130 partition: 0 MaxSeqNo: 40 sessionId: src_id|65f4dada-7842ec16-15dd14f-515ad17b_0
2025-10-10T14:39:52.429139Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c91f0f90-f2b59cf7-bba9b629-24499dd4_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|65f4dada-7842ec16-15dd14f-515ad17b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:52.432126Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|65f4dada-7842ec16-15dd14f-515ad17b_0] Write session: try to update token
2025-10-10T14:39:52.432150Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|65f4dada-7842ec16-15dd14f-515ad17b_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:52.448793Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3130 sessionId: src_id|65f4dada-7842ec16-15dd14f-515ad17b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:52.449274Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:52.449304Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:52.449308Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:52.449311Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:52.449323Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602828630466369:5861]
2025-10-10T14:39:52.449327Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602828630466369:5861]
2025-10-10T14:39:52.449361Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602828630466369:5861]
2025-10-10T14:39:52.449421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:52.449423Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:52.449430Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:52.449435Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:52.449437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:52.449439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:52.449600Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:52.451881Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:52.488170Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602829412714167:4596]
2025-10-10T14:39:52.488535Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 pipe creation result: OK TabletId: 72075186224037892 Generation: 3129, pipe: [1:7559602829412714167:4596]
2025-10-10T14:39:52.570603Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:52.570939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:52.570958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:52.571010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602829412714167:4596], now have 1 active actors on pipe
2025-10-10T14:39:52.571280Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:52.571417Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:52.571437Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:52.571508Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3130 reason: error at write: Disconnected sessionId: src_id|65f4dada-7842ec16-15dd14f-515ad17b_0
2025-10-10T14:39:52.571768Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3130 sessionId: src_id|65f4dada-7842ec16-15dd14f-515ad17b_0 is DEAD
2025-10-10T14:39:52.571963Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:52.572022Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 28 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602829412714167:4596]
2025-10-10T14:39:52.572427Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65f4dada-7842ec16-15dd14f-515ad17b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:52.572439Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65f4dada-7842ec16-15dd14f-515ad17b_0] Write session will restart in 0.007293s
2025-10-10T14:39:52.572475Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65f4dada-7842ec16-15dd14f-515ad17b_0] Write session: Do CDS request
2025-10-10T14:39:52.572482Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65f4dada-7842ec16-15dd14f-515ad17b_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:52.581907Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|65f4dada-7842ec16-15dd14f-515ad17b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:52.581982Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:52.582002Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3131
2025-10-10T14:39:52.584663Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3131 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:52.584733Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3131 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:52.584745Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3131 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:52.584750Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:52.585242Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3131 sessionId:  describe result for acl check
2025-10-10T14:39:52.585283Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:52.585287Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:52.585289Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:52.585295Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602829412714233:4149] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:52.585904Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602829412714233:4149] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:52.589133Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602829412714233:4149] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:52.593735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602829412714233:4149] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:52.593757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602829412714233:4149] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:52.593760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602829412714233:4149] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:52.593770Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3131 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:52.600141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:52.606100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:52.606379Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:52.606391Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:52.606415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:52.606489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:52.606551Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602828630466595:5852]
2025-10-10T14:39:52.607177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:52.607639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:52.607705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:52.608060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:52.608136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:52.608142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:52.608143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:52.608145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:52.608146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:52.608147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:52.608149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:52.608150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:52.608151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:52.608153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:52.608154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:52.608156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:52.608157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:52.608163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:52.608176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:52.608181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:52.608185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:52.608189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:52.608193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:52.608198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:52.608202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:52.608206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:52.608211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:52.608215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:52.608219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:52.608223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:52.608232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:52.608241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:52.608249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:52.608255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:52.608260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:52.608266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:52.608271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:52.608276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:52.608284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:52.608290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:52.608295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:52.608301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:52.608323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:52.608336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:52.608341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:52.608346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:52.608352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:52.608357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:52.608377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:52.608388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:52.608392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:52.608404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:52.608410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:52.608417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:52.608422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:52.608428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:52.608472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:52.611243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:52.611685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:52.611699Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:52.611702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:52.611705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:52.611714Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3130 [2:7559602828630466595:5852]
2025-10-10T14:39:52.611726Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:52.611743Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:52.611750Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:52.611753Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:52.611755Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:52.611788Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:52.611801Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:52.611816Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:52.611871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:52.611877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:52.611878Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:52.611880Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:52.611941Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:52.611952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:52.611964Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:52.611974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:52.611992Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:52.612017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602829412714170:2438], now have 1 active actors on pipe
2025-10-10T14:39:52.612027Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602828630466590:5852]
2025-10-10T14:39:52.612030Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602828630466590:5852]
2025-10-10T14:39:52.612032Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602828630466590:5852]
2025-10-10T14:39:52.612051Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:52.612062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602829412714390:4149], now have 1 active actors on pipe
2025-10-10T14:39:52.612070Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:52.612082Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:52.612092Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:52.612118Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3130
2025-10-10T14:39:52.612149Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3130
2025-10-10T14:39:52.612128Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:52.612129Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602828630466590:5852]
2025-10-10T14:39:52.612132Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:52.612135Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:52.612138Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:52.612146Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:52.612248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:52.612256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:52.612306Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|241a6cf7-fb58ef26-f8dcbf0d-1fbb5c09_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:52.612315Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:52.612320Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:52.612323Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:52.612337Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:52.612352Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:52.612372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:52.612580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:52.612591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:52.612627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:52.612756Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3131 partition: 0 MaxSeqNo: 40 sessionId: src_id|241a6cf7-fb58ef26-f8dcbf0d-1fbb5c09_0
2025-10-10T14:39:52.613212Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65f4dada-7842ec16-15dd14f-515ad17b_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|241a6cf7-fb58ef26-f8dcbf0d-1fbb5c09_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:52.616101Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|241a6cf7-fb58ef26-f8dcbf0d-1fbb5c09_0] Write session: try to update token
2025-10-10T14:39:52.616123Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|241a6cf7-fb58ef26-f8dcbf0d-1fbb5c09_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:52.630837Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3131 sessionId: src_id|241a6cf7-fb58ef26-f8dcbf0d-1fbb5c09_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:52.633547Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:52.637843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:52.637882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:52.637911Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:39:52.637915Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:52.637926Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602828630466590:5852]
2025-10-10T14:39:52.637992Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:39:52.637996Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:39:52.638164Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:39:52.638319Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:52.638458Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:52.638592Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:52.638784Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:39:52.638824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:39:52.638843Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:39:52.638944Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:39:52.651134Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:52.651153Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:52.651156Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:52.651158Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:52.651166Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602828630466590:5852]
2025-10-10T14:39:52.651170Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602828630466590:5852]
2025-10-10T14:39:52.651173Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602828630466590:5852]
2025-10-10T14:39:52.651220Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:52.651228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:52.651230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:52.651233Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:52.651237Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:52.651241Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:52.651359Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:52.671956Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602829412714456:4596]
2025-10-10T14:39:52.672338Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 pipe creation result: OK TabletId: 72075186224037892 Generation: 3130, pipe: [1:7559602829412714456:4596]
2025-10-10T14:39:52.769651Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:52.777948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:52.777985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:52.778176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:52.778246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:52.778318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:52.778389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:52.778439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:52.778449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:52.778522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:52.778589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:52.778658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:52.778731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:52.778781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:52.778792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:52.778863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:52.778930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:52.778999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:52.779073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:52.779120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:52.779127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:52.779198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:52.779271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:52.779339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:52.779407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:52.779454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:52.779463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:52.779536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:52.779597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:52.779663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:52.779729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:52.779781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:52.779789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:52.779857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:52.779920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:52.779987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:52.780053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:52.780103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:52.780111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:52.780181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:52.780243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:52.780309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:52.780380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:52.780430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:52.780439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:52.780510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:52.780579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:52.780655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:52.780722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:52.780772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:52.780779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:52.780848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:52.780909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:52.780977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:52.781042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:52.781088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:52.781096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:52.781166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:52.781235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:52.781303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:52.781397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:52.781444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:52.781450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:52.781533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602829412714456:4596], now have 1 active actors on pipe
2025-10-10T14:39:52.781791Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:52.781827Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 29 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602829412714456:4596]
2025-10-10T14:39:52.781873Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:52.781883Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:52.781922Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3131 reason: error at write: Disconnected sessionId: src_id|241a6cf7-fb58ef26-f8dcbf0d-1fbb5c09_0
2025-10-10T14:39:52.782138Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3131 sessionId: src_id|241a6cf7-fb58ef26-f8dcbf0d-1fbb5c09_0 is DEAD
2025-10-10T14:39:52.782298Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|241a6cf7-fb58ef26-f8dcbf0d-1fbb5c09_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:52.782325Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|241a6cf7-fb58ef26-f8dcbf0d-1fbb5c09_0] Write session will restart in 0.008213s
2025-10-10T14:39:52.782352Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|241a6cf7-fb58ef26-f8dcbf0d-1fbb5c09_0] Write session: Do CDS request
2025-10-10T14:39:52.782358Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|241a6cf7-fb58ef26-f8dcbf0d-1fbb5c09_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:52.783390Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:52.791994Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|241a6cf7-fb58ef26-f8dcbf0d-1fbb5c09_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:52.792067Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:52.792086Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3132
2025-10-10T14:39:52.792302Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3132 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:52.792340Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3132 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:52.792346Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3132 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:52.792350Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:52.792838Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3132 sessionId:  describe result for acl check
2025-10-10T14:39:52.792881Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:52.792887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:52.792890Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:52.792897Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602829412714501:4140] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:52.793530Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602829412714501:4140] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:52.796791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602829412714501:4140] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:52.801318Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602829412714501:4140] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:52.801357Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602829412714501:4140] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:52.801361Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602829412714501:4140] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:52.801371Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3132 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:52.810641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:52.815625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:52.815933Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:52.815951Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:52.815965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:52.816036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:52.816084Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602828630466829:5848]
2025-10-10T14:39:52.816796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:52.817193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:52.817253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:52.817643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:52.817716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:52.817725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:52.817727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:52.817728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:52.817730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:52.817731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:52.817733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:52.817734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:52.817735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:52.817737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:52.817739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:52.817740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:52.817741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:52.817749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:52.817764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:52.817768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:52.817774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:52.817778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:52.817783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:52.817788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:52.817792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:52.817796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:52.817801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:52.817806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:52.817817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:52.817821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:52.817831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:52.817840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:52.817848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:52.817860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:52.817865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:52.817877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:52.817882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:52.817890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:52.817896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:52.817907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:52.817912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:52.817920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:52.817931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:52.817937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:52.817944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:52.817951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:52.817956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:52.817967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:52.817973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:52.817983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:52.817988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:52.818001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:52.818011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:52.818017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:52.818022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:52.818033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:52.818091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:52.820778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:52.821105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:52.821120Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:52.821123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:52.821127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:52.821134Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3131 [2:7559602828630466829:5848]
2025-10-10T14:39:52.821148Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:52.821185Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:52.821188Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:52.821191Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:52.821194Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:52.821212Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:52.821220Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:52.821229Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:52.821295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:52.821305Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:52.821307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:52.821310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:52.821400Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:52.821411Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:52.821423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:52.821436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:52.821468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:52.821498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602829412714634:4140], now have 1 active actors on pipe
2025-10-10T14:39:52.821509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602829412714459:2438], now have 1 active actors on pipe
2025-10-10T14:39:52.821518Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602828630466824:5848]
2025-10-10T14:39:52.821520Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602828630466824:5848]
2025-10-10T14:39:52.821523Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602828630466824:5848]
2025-10-10T14:39:52.821539Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:52.821549Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3131
2025-10-10T14:39:52.821571Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3131
2025-10-10T14:39:52.821554Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:52.821576Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:52.821580Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:52.821605Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602828630466824:5848]
2025-10-10T14:39:52.821612Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:52.821644Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:52.821654Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:52.821657Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:52.821664Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:52.821710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:52.821727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:52.821765Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6a195e85-9954c9f9-50cf6225-bcef809c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:52.821781Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:52.821788Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:52.821791Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:52.821803Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:52.821816Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:52.821841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:52.822037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:52.822063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:52.822086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:52.822196Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3132 partition: 0 MaxSeqNo: 40 sessionId: src_id|6a195e85-9954c9f9-50cf6225-bcef809c_0
2025-10-10T14:39:52.822656Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|241a6cf7-fb58ef26-f8dcbf0d-1fbb5c09_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|6a195e85-9954c9f9-50cf6225-bcef809c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:52.825518Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6a195e85-9954c9f9-50cf6225-bcef809c_0] Write session: try to update token
2025-10-10T14:39:52.825537Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6a195e85-9954c9f9-50cf6225-bcef809c_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:52.834752Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:39:52.834777Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:52.834788Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602828630466824:5848]
2025-10-10T14:39:52.834832Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:39:52.834839Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:39:52.835017Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:39:52.835523Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:52.835679Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:52.835825Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:52.836119Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:39:52.836167Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:39:52.840512Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3132 sessionId: src_id|6a195e85-9954c9f9-50cf6225-bcef809c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:52.843517Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:52.843751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:52.843784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:52.843840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:39:52.843932Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:39:52.856268Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:52.856293Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:52.856297Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:52.856300Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:52.856313Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602828630466824:5848]
2025-10-10T14:39:52.856318Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602828630466824:5848]
2025-10-10T14:39:52.856322Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602828630466824:5848]
2025-10-10T14:39:52.856390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:52.856404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:52.856406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:52.856414Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:52.856421Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:52.856426Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:52.856547Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:52.881848Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602829412714764:4596]
2025-10-10T14:39:52.882203Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 pipe creation result: OK TabletId: 72075186224037892 Generation: 3131, pipe: [1:7559602829412714764:4596]
2025-10-10T14:39:52.980978Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:52.990469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:52.990499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:52.990692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:52.990755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:52.990819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:52.990875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:52.990920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:52.990926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:52.990999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:52.991057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:52.991123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:52.991185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:52.991229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:52.991237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:52.991308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:52.991365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:52.991421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:52.991483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:52.991526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:52.991530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:52.991599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:52.991661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:52.991725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:52.991786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:52.991827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:52.991830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:52.991899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:52.991958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:52.992019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:52.992083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:52.992129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:52.992132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:52.992202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:52.992260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:52.992320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:52.992383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:52.992428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:52.992432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:52.992504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:52.992562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:52.992645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:52.992706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:52.992848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:52.992852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:52.992922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:52.992984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:52.993045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:52.993105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:52.993148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:52.993151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:52.993221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:52.993277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:52.993612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:52.993687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:52.993730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:52.993733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:52.993799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:52.993857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:52.993919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:52.993980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:52.994024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:52.994027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:52.994105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602829412714764:4596], now have 1 active actors on pipe
2025-10-10T14:39:52.995469Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:52.994907Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:52.994960Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 30 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602829412714764:4596]
2025-10-10T14:39:52.995019Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:52.995028Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:52.995060Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3132 reason: error at write: Disconnected sessionId: src_id|6a195e85-9954c9f9-50cf6225-bcef809c_0
2025-10-10T14:39:52.995316Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3132 sessionId: src_id|6a195e85-9954c9f9-50cf6225-bcef809c_0 is DEAD
2025-10-10T14:39:52.999453Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a195e85-9954c9f9-50cf6225-bcef809c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:52.999466Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a195e85-9954c9f9-50cf6225-bcef809c_0] Write session will restart in 0.007484s
2025-10-10T14:39:52.999495Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a195e85-9954c9f9-50cf6225-bcef809c_0] Write session: Do CDS request
2025-10-10T14:39:52.999501Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a195e85-9954c9f9-50cf6225-bcef809c_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:53.009938Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6a195e85-9954c9f9-50cf6225-bcef809c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:53.011176Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:53.011199Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3133
2025-10-10T14:39:53.013681Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3133 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:53.013742Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3133 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:53.013749Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3133 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:53.013755Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:53.014760Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3133 sessionId:  describe result for acl check
2025-10-10T14:39:53.014805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:53.014810Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:53.014812Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:53.014819Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602833707682120:4126] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:53.015439Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602833707682120:4126] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:53.021814Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602833707682120:4126] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:53.024639Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602833707682120:4126] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:53.024659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602833707682120:4126] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:53.024663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602833707682120:4126] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:53.024673Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3133 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:53.046968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:53.047927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:53.048161Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:53.048176Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:53.048190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:53.048253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:53.048293Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602832925434361:5843]
2025-10-10T14:39:53.049007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:53.049520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:53.049577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:53.049962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:53.050034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:53.050045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:53.050046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:53.050048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:53.050049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:53.050050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:53.050052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:53.050053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:53.050055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:53.050056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:53.050058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:53.050059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:53.050061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:53.050068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:53.050082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:53.050087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:53.050092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:53.050097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:53.050102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:53.050107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:53.050111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:53.050116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:53.050121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:53.050125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:53.050130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:53.050134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:53.050141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:53.050151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:53.050158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:53.050165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:53.050173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:53.050179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:53.050184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:53.050190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:53.050196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:53.050203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:53.050208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:53.050214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:53.050219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:53.050225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:53.050231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:53.050237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:53.050243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:53.050249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:53.050254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:53.050260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:53.050266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:53.050271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:53.050276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:53.050284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:53.050288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:53.050294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:53.050340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:53.053574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:53.053958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:53.053963Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:53.053965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:53.053970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:53.053978Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3132 [2:7559602832925434361:5843]
2025-10-10T14:39:53.053993Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:53.054014Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:53.054018Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:53.054024Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:53.054027Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:53.054048Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:53.054056Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:53.054064Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:53.054135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:53.054138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:53.054140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:53.054144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:53.054226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:53.054229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:53.054243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:53.054256Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:53.054292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:53.054315Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602832925434356:5843]
2025-10-10T14:39:53.054318Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602832925434356:5843]
2025-10-10T14:39:53.054320Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602832925434356:5843]
2025-10-10T14:39:53.054329Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:53.054350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602833707682200:4126], now have 1 active actors on pipe
2025-10-10T14:39:53.054350Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:53.054354Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:53.054356Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:53.054357Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:53.054376Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:53.054379Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:53.054386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602829412714771:2438], now have 1 active actors on pipe
2025-10-10T14:39:53.054423Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602832925434356:5843]
2025-10-10T14:39:53.054432Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:53.054660Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:53.055143Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3132
2025-10-10T14:39:53.055188Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3132
2025-10-10T14:39:53.059234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:53.059259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:53.059306Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|66878cef-da6a01c-d2cc15e3-5017c621_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:53.059321Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:53.059328Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:53.059331Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:53.059350Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:53.059372Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:53.059397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:53.063762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:53.063786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:53.063829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:53.064416Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3133 partition: 0 MaxSeqNo: 40 sessionId: src_id|66878cef-da6a01c-d2cc15e3-5017c621_0
2025-10-10T14:39:53.064919Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a195e85-9954c9f9-50cf6225-bcef809c_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|66878cef-da6a01c-d2cc15e3-5017c621_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:53.067738Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66878cef-da6a01c-d2cc15e3-5017c621_0] Write session: try to update token
2025-10-10T14:39:53.067761Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66878cef-da6a01c-d2cc15e3-5017c621_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:53.077382Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:53.077401Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:53.077405Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:53.077407Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:53.077417Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602832925434356:5843]
2025-10-10T14:39:53.077422Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602832925434356:5843]
2025-10-10T14:39:53.077426Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602832925434356:5843]
2025-10-10T14:39:53.077477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:53.077483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:53.077486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:53.077615Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:53.081475Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:53.081498Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:53.081502Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:53.089108Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3133 sessionId: src_id|66878cef-da6a01c-d2cc15e3-5017c621_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:53.091932Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:53.094362Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602833707682366:4596]
2025-10-10T14:39:53.094583Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 pipe creation result: OK TabletId: 72075186224037892 Generation: 3132, pipe: [1:7559602833707682366:4596]
2025-10-10T14:39:53.201356Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:53.202208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:53.202226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:53.202250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602833707682366:4596], now have 1 active actors on pipe
2025-10-10T14:39:53.202487Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:53.202547Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:53.202564Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:53.202630Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3133 reason: error at write: Disconnected sessionId: src_id|66878cef-da6a01c-d2cc15e3-5017c621_0
2025-10-10T14:39:53.202860Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3133 sessionId: src_id|66878cef-da6a01c-d2cc15e3-5017c621_0 is DEAD
2025-10-10T14:39:53.203066Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:53.203109Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 31 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602833707682366:4596]
2025-10-10T14:39:53.205582Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66878cef-da6a01c-d2cc15e3-5017c621_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:53.205597Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66878cef-da6a01c-d2cc15e3-5017c621_0] Write session will restart in 0.006161s
2025-10-10T14:39:53.205630Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66878cef-da6a01c-d2cc15e3-5017c621_0] Write session: Do CDS request
2025-10-10T14:39:53.205640Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66878cef-da6a01c-d2cc15e3-5017c621_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:53.212988Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66878cef-da6a01c-d2cc15e3-5017c621_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:53.213151Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:53.213172Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3134
2025-10-10T14:39:53.213355Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3134 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:53.213397Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3134 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:53.213407Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3134 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:53.213412Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:53.213926Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3134 sessionId:  describe result for acl check
2025-10-10T14:39:53.213966Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:53.213973Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:53.213976Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:53.213982Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602833707682397:4074] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:53.214575Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602833707682397:4074] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:53.217130Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602833707682397:4074] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:53.220421Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602833707682397:4074] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:53.220442Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602833707682397:4074] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:53.220446Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602833707682397:4074] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:53.220455Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3134 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:53.227785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:53.232134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:53.232414Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:53.232430Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:53.232444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:53.232539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:53.232616Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602832925434612:5808]
2025-10-10T14:39:53.233303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:53.233787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:53.233843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:53.234199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:53.234263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:53.234270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:53.234271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:53.234273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:53.234274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:53.234276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:53.234277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:53.234278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:53.234280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:53.234292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:53.234293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:53.234294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:53.234295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:53.234301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:53.234315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:53.234319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:53.234323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:53.234327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:53.234332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:53.234336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:53.234339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:53.234343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:53.234347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:53.234351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:53.234355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:53.234359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:53.234367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:53.234376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:53.234382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:53.234388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:53.234392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:53.234398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:53.234402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:53.234407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:53.234412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:53.234417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:53.234424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:53.234429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:53.234434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:53.234439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:53.234444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:53.234449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:53.234454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:53.234458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:53.234462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:53.234478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:53.234482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:53.234487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:53.234493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:53.234498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:53.234502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:53.234514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:53.234553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:53.238225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:53.238646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:53.238662Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:53.238666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:53.238670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:53.238678Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3133 [2:7559602832925434612:5808]
2025-10-10T14:39:53.238693Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:53.238714Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:53.238718Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:53.238721Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:53.238724Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:53.238745Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:53.238753Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:53.238763Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:53.238840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:53.238853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:53.238855Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:53.238858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:53.239062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:53.239078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:53.239092Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:53.239106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:53.239096Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3133
2025-10-10T14:39:53.239132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:53.239160Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3133
2025-10-10T14:39:53.239160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602833707682382:2438], now have 1 active actors on pipe
2025-10-10T14:39:53.239171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602833707682544:4074], now have 1 active actors on pipe
2025-10-10T14:39:53.239189Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602832925434607:5808]
2025-10-10T14:39:53.239193Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602832925434607:5808]
2025-10-10T14:39:53.239195Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602832925434607:5808]
2025-10-10T14:39:53.239206Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:53.239216Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:53.239219Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:53.239221Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:53.239226Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:53.239243Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:53.239248Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:53.239271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:53.239276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:53.239347Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602832925434607:5808]
2025-10-10T14:39:53.239368Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:53.239383Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:53.239394Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cf342281-8855b7f9-e1cdd1d-79777f0d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:53.239410Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:53.239421Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:53.239424Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:53.239437Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:53.239456Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:53.239525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:53.239921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:53.239933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:53.239959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:53.240105Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3134 partition: 0 MaxSeqNo: 40 sessionId: src_id|cf342281-8855b7f9-e1cdd1d-79777f0d_0
2025-10-10T14:39:53.240626Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66878cef-da6a01c-d2cc15e3-5017c621_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|cf342281-8855b7f9-e1cdd1d-79777f0d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:53.246135Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf342281-8855b7f9-e1cdd1d-79777f0d_0] Write session: try to update token
2025-10-10T14:39:53.246166Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf342281-8855b7f9-e1cdd1d-79777f0d_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:53.264233Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:53.264259Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:53.264262Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:53.264264Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:53.264274Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602832925434607:5808]
2025-10-10T14:39:53.264279Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602832925434607:5808]
2025-10-10T14:39:53.264284Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602832925434607:5808]
2025-10-10T14:39:53.264334Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:53.264338Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:53.264342Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:53.264346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:53.264347Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:53.264349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:53.264490Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:53.265490Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3134 sessionId: src_id|cf342281-8855b7f9-e1cdd1d-79777f0d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:53.268224Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:53.303283Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602833707682669:4596]
2025-10-10T14:39:53.303674Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 pipe creation result: OK TabletId: 72075186224037892 Generation: 3133, pipe: [1:7559602833707682669:4596]
2025-10-10T14:39:53.393094Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:53.394330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:53.394353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:53.394418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602833707682669:4596], now have 1 active actors on pipe
2025-10-10T14:39:53.394698Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:53.395540Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf342281-8855b7f9-e1cdd1d-79777f0d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:53.395551Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf342281-8855b7f9-e1cdd1d-79777f0d_0] Write session will restart in 0.005855s
2025-10-10T14:39:53.395578Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf342281-8855b7f9-e1cdd1d-79777f0d_0] Write session: Do CDS request
2025-10-10T14:39:53.395584Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf342281-8855b7f9-e1cdd1d-79777f0d_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:53.394842Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 32 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602833707682669:4596]
2025-10-10T14:39:53.394890Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:53.394933Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:53.394937Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:53.395000Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3134 reason: error at write: Disconnected sessionId: src_id|cf342281-8855b7f9-e1cdd1d-79777f0d_0
2025-10-10T14:39:53.395204Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3134 sessionId: src_id|cf342281-8855b7f9-e1cdd1d-79777f0d_0 is DEAD
2025-10-10T14:39:53.402967Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf342281-8855b7f9-e1cdd1d-79777f0d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:53.403386Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:53.403405Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3135
2025-10-10T14:39:53.403731Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3135 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:53.403783Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3135 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:53.403794Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3135 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:53.403799Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:53.404320Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3135 sessionId:  describe result for acl check
2025-10-10T14:39:53.404362Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:53.404369Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:53.404372Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:53.404378Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602833707682686:4067] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:53.405002Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602833707682686:4067] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:53.408433Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602833707682686:4067] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:53.413549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602833707682686:4067] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:53.413569Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602833707682686:4067] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:53.413572Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602833707682686:4067] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:53.413584Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3135 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:53.431514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:53.442326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:53.442619Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:53.442637Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:53.442651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:53.442716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:53.442766Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602832925434841:5806]
2025-10-10T14:39:53.443417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:53.443840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:53.443907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:53.444293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:53.444361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:53.444368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:53.444369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:53.444371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:53.444372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:53.444373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:53.444375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:53.444377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:53.444378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:53.444380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:53.444381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:53.444382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:53.444384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:53.444390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:53.444404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:53.444409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:53.444413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:53.444417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:53.444422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:53.444438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:53.444443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:53.444447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:53.444452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:53.444456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:53.444460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:53.444463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:53.444472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:53.444481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:53.444488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:53.444500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:53.444507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:53.444513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:53.444518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:53.444524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:53.444534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:53.444539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:53.444550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:53.444560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:53.444565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:53.444571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:53.444575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:53.444585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:53.444592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:53.444613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:53.444632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:53.444643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:53.444648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:53.444653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:53.444663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:53.444669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:53.444678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:53.444683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:53.444731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:53.447601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:53.447928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:53.447943Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:53.447946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:53.447950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:53.447957Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3134 [2:7559602832925434841:5806]
2025-10-10T14:39:53.447972Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:53.447993Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:53.448004Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:53.448007Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:53.448010Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:53.448031Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:53.448045Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:53.448058Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:53.448132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:53.448140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:53.448142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:53.448145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:53.448234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:53.448242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:53.448254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:53.448272Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:53.448289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:53.448314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602833707682822:4067], now have 1 active actors on pipe
2025-10-10T14:39:53.448323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602833707682671:2438], now have 1 active actors on pipe
2025-10-10T14:39:53.448400Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3134
2025-10-10T14:39:53.448437Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3134
2025-10-10T14:39:53.448332Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602832925434835:5806]
2025-10-10T14:39:53.448337Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602832925434835:5806]
2025-10-10T14:39:53.448339Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602832925434835:5806]
2025-10-10T14:39:53.448354Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:53.448369Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:53.448369Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:53.448373Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:53.448376Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:53.448386Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:53.448390Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:53.448425Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602832925434835:5806]
2025-10-10T14:39:53.448434Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:53.448439Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:53.448711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:53.448729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:53.448780Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|142ace48-946ffcb9-79223b68-14d132a8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:53.448792Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:53.448797Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:53.448800Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:53.448814Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:53.448828Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:53.448849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:53.449095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:53.449108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:53.449132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:53.449323Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3135 partition: 0 MaxSeqNo: 40 sessionId: src_id|142ace48-946ffcb9-79223b68-14d132a8_0
2025-10-10T14:39:53.449803Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf342281-8855b7f9-e1cdd1d-79777f0d_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|142ace48-946ffcb9-79223b68-14d132a8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:53.452658Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|142ace48-946ffcb9-79223b68-14d132a8_0] Write session: try to update token
2025-10-10T14:39:53.452684Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|142ace48-946ffcb9-79223b68-14d132a8_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:53.472097Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3135 sessionId: src_id|142ace48-946ffcb9-79223b68-14d132a8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:53.469946Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:53.469968Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:53.469980Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:53.469983Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:53.469993Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602832925434835:5806]
2025-10-10T14:39:53.470002Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602832925434835:5806]
2025-10-10T14:39:53.470006Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602832925434835:5806]
2025-10-10T14:39:53.470061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:53.470070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:53.470072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:53.470222Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:53.475398Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:53.475108Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:53.475128Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:53.475132Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:53.494730Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602833707682961:4596]
2025-10-10T14:39:53.495092Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 pipe creation result: OK TabletId: 72075186224037892 Generation: 3134, pipe: [1:7559602833707682961:4596]
2025-10-10T14:39:53.590177Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:53.590995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:53.591015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:53.591065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602833707682961:4596], now have 1 active actors on pipe
2025-10-10T14:39:53.591294Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:53.592287Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|142ace48-946ffcb9-79223b68-14d132a8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:39:53.592314Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|142ace48-946ffcb9-79223b68-14d132a8_0] Write session will restart in 0.006407s
2025-10-10T14:39:53.592342Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|142ace48-946ffcb9-79223b68-14d132a8_0] Write session: Do CDS request
2025-10-10T14:39:53.592348Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|142ace48-946ffcb9-79223b68-14d132a8_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:53.591736Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 33 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602833707682961:4596]
2025-10-10T14:39:53.591770Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:53.591822Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:39:53.591900Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3135 reason: status is not ok: tablet will be restarted right now sessionId: src_id|142ace48-946ffcb9-79223b68-14d132a8_0
2025-10-10T14:39:53.592124Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3135 sessionId: src_id|142ace48-946ffcb9-79223b68-14d132a8_0 is DEAD
2025-10-10T14:39:53.599978Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|142ace48-946ffcb9-79223b68-14d132a8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:53.600004Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:53.600022Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3136
2025-10-10T14:39:53.600242Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3136 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:53.600284Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3136 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:53.600303Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3136 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:53.600312Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:53.600764Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3136 sessionId:  describe result for acl check
2025-10-10T14:39:53.600801Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:53.600802Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:53.600805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:53.600811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602833707682982:4048] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:53.601413Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602833707682982:4048] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:53.608279Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602833707682982:4048] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:53.611363Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602833707682982:4048] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:53.611380Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602833707682982:4048] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:53.611384Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602833707682982:4048] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:53.611393Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3136 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:53.615084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:53.619321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:53.619561Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:53.619572Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:53.619584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:53.619642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:53.619688Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602832925435068:5804]
2025-10-10T14:39:53.620322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:53.620668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:53.620713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:53.621040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:53.621102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:53.621109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:53.621110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:53.621111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:53.621113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:53.621114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:53.621115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:53.621116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:53.621118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:53.621119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:53.621120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:53.621122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:53.621123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:53.621129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:53.621143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:53.621147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:53.621151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:53.621155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:53.621159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:53.621163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:53.621167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:53.621171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:53.621176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:53.621180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:53.621184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:53.621188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:53.621198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:53.621207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:53.621213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:53.621219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:53.621223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:53.621230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:53.621235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:53.621240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:53.621245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:53.621249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:53.621253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:53.621258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:53.621263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:53.621269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:53.621274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:53.621279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:53.621284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:53.621295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:53.621299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:53.621305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:53.621309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:53.621317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:53.621322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:53.621327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:53.621347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:53.621357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:53.621399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:53.623814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:53.624121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:53.624135Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:53.624137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:53.624141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:53.624147Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3135 [2:7559602832925435068:5804]
2025-10-10T14:39:53.624158Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:53.624175Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:53.624178Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:53.624182Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:53.624184Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:53.624201Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:53.624214Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:53.624227Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:53.624288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:53.624296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:53.624298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:53.624300Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:53.624451Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3135
2025-10-10T14:39:53.624466Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3135
2025-10-10T14:39:53.624740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:53.624751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:53.624766Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:53.624779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:53.624797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:53.624825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602833707682964:2438], now have 1 active actors on pipe
2025-10-10T14:39:53.624833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602833707683241:4048], now have 1 active actors on pipe
2025-10-10T14:39:53.624853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:53.624862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:53.624883Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602832925435063:5804]
2025-10-10T14:39:53.624889Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602832925435063:5804]
2025-10-10T14:39:53.624891Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602832925435063:5804]
2025-10-10T14:39:53.624905Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:53.624918Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:53.624921Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:53.624923Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:53.624923Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:53.624940Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:53.624946Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:53.624970Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dbf558ef-b6bc0a9c-fec202cd-c39735a3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:53.624983Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:53.624988Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:53.624990Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:53.625001Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:53.625018Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:53.625054Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602832925435063:5804]
2025-10-10T14:39:53.625065Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:53.625075Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:53.625076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:53.625238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:53.625248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:53.625265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:53.625380Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3136 partition: 0 MaxSeqNo: 40 sessionId: src_id|dbf558ef-b6bc0a9c-fec202cd-c39735a3_0
2025-10-10T14:39:53.625831Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|142ace48-946ffcb9-79223b68-14d132a8_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|dbf558ef-b6bc0a9c-fec202cd-c39735a3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:53.628651Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dbf558ef-b6bc0a9c-fec202cd-c39735a3_0] Write session: try to update token
2025-10-10T14:39:53.628667Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dbf558ef-b6bc0a9c-fec202cd-c39735a3_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:53.642912Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3136 sessionId: src_id|dbf558ef-b6bc0a9c-fec202cd-c39735a3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:53.643369Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:39:53.643392Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:53.643403Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602832925435063:5804]
2025-10-10T14:39:53.643466Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:39:53.643470Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:39:53.643660Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:39:53.643834Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:53.643986Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:53.644133Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:53.644370Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:39:53.644415Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:39:53.645677Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:53.645914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:53.645935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:53.645976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:39:53.646061Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:39:53.655297Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:53.655321Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:53.655325Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:53.655327Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:53.655338Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602832925435063:5804]
2025-10-10T14:39:53.655342Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602832925435063:5804]
2025-10-10T14:39:53.655346Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602832925435063:5804]
2025-10-10T14:39:53.655396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:53.655392Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:53.655408Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:53.655409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:53.655412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:53.655414Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:53.655547Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:53.691841Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602833707683256:4596]
2025-10-10T14:39:53.692131Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 pipe creation result: OK TabletId: 72075186224037892 Generation: 3135, pipe: [1:7559602833707683256:4596]
2025-10-10T14:39:53.779799Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:53.789248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:53.789283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:53.789487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:53.789563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:53.789633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:53.789707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:53.789756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:53.789766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:53.789835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:53.789899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:53.789966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:53.790031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:53.790077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:53.790084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:53.790150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:53.790210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:53.790300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:53.790380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:53.790423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:53.790432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:53.790499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:53.790565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:53.790629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:53.790696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:53.790743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:53.790751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:53.790814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:53.790876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:53.790939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:53.791008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:53.791054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:53.791061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:53.791128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:53.791194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:53.791258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:53.791322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:53.791366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:53.791374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:53.791792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:53.792218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:53.792290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:53.792356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:53.792416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:53.792424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:53.792495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:53.792558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:53.792633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:53.792696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:53.792738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:53.792741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:53.792808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:53.792864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:53.792920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:53.792979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:53.793021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:53.793025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:53.793093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:53.793153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:53.793213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:53.793275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:53.793316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:53.793319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:53.793550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602833707683256:4596], now have 1 active actors on pipe
2025-10-10T14:39:53.794842Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:53.795604Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dbf558ef-b6bc0a9c-fec202cd-c39735a3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:53.795615Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dbf558ef-b6bc0a9c-fec202cd-c39735a3_0] Write session will restart in 0.005124s
2025-10-10T14:39:53.795640Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dbf558ef-b6bc0a9c-fec202cd-c39735a3_0] Write session: Do CDS request
2025-10-10T14:39:53.795655Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dbf558ef-b6bc0a9c-fec202cd-c39735a3_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:53.793870Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:53.793888Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:53.793894Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:53.793950Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3136 reason: error at write: Disconnected sessionId: src_id|dbf558ef-b6bc0a9c-fec202cd-c39735a3_0
2025-10-10T14:39:53.793963Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 34 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602833707683256:4596]
2025-10-10T14:39:53.794248Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3136 sessionId: src_id|dbf558ef-b6bc0a9c-fec202cd-c39735a3_0 is DEAD
2025-10-10T14:39:53.802072Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dbf558ef-b6bc0a9c-fec202cd-c39735a3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:53.805544Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:53.805565Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3137
2025-10-10T14:39:53.805738Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3137 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:53.805796Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3137 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:53.805803Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3137 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:53.805809Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:53.806296Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3137 sessionId:  describe result for acl check
2025-10-10T14:39:53.806327Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:53.806329Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:53.806331Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:53.806337Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602833707683274:4043] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:53.806931Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602833707683274:4043] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:53.810106Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602833707683274:4043] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:53.814604Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602833707683274:4043] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:53.814622Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602833707683274:4043] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:53.814627Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602833707683274:4043] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:53.814637Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3137 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:53.822313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:53.826893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:53.827485Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:53.827501Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:53.827518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:53.827589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:53.827637Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602832925435308:5797]
2025-10-10T14:39:53.828275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:53.828640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:53.828686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:53.829022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:53.829089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:53.829096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:53.829098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:53.829099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:53.829100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:53.829102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:53.829103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:53.829104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:53.829105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:53.829106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:53.829108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:53.829109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:53.829110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:53.829116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:53.829131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:53.829135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:53.829140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:53.829144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:53.829148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:53.829152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:53.829156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:53.829161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:53.829165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:53.829169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:53.829173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:53.829178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:53.829188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:53.829197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:53.829209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:53.829215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:53.829221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:53.829226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:53.829230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:53.829242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:53.829247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:53.829253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:53.829259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:53.829265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:53.829269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:53.829274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:53.829278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:53.829284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:53.829288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:53.829295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:53.829300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:53.829305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:53.829314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:53.829319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:53.829323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:53.829328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:53.829345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:53.829351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:53.829391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:53.831927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:53.832827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:53.832839Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:53.832841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:53.832846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:53.832852Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3136 [2:7559602832925435308:5797]
2025-10-10T14:39:53.832867Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:53.832886Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:53.832895Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:53.832899Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:53.832901Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:53.832919Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:53.832927Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:53.832938Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:53.833006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:53.833026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:53.833028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:53.833031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:53.833119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:53.833128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:53.833140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:53.833152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:53.833175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:53.833204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602833707683258:2438], now have 1 active actors on pipe
2025-10-10T14:39:53.833214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602833707683438:4043], now have 1 active actors on pipe
2025-10-10T14:39:53.833222Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602832925435303:5797]
2025-10-10T14:39:53.833224Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602832925435303:5797]
2025-10-10T14:39:53.833226Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602832925435303:5797]
2025-10-10T14:39:53.833241Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:53.833260Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:53.833277Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:53.833281Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:53.833280Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:53.833284Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:53.833287Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:53.833311Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602832925435303:5797]
2025-10-10T14:39:53.833320Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:53.833326Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:53.833250Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3136
2025-10-10T14:39:53.833296Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3136
2025-10-10T14:39:53.833513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:53.833523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:53.833557Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2bc7b0fe-3e427c8d-6ff5e3ca-704d36f5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:53.833565Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:53.833570Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:53.833572Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:53.833586Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:53.833600Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:53.833614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:53.834096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:53.834107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:53.834131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:53.834250Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3137 partition: 0 MaxSeqNo: 40 sessionId: src_id|2bc7b0fe-3e427c8d-6ff5e3ca-704d36f5_0
2025-10-10T14:39:53.834702Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dbf558ef-b6bc0a9c-fec202cd-c39735a3_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|2bc7b0fe-3e427c8d-6ff5e3ca-704d36f5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:53.837434Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2bc7b0fe-3e427c8d-6ff5e3ca-704d36f5_0] Write session: try to update token
2025-10-10T14:39:53.837451Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2bc7b0fe-3e427c8d-6ff5e3ca-704d36f5_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:53.846150Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:39:53.846174Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:53.846188Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602832925435303:5797]
2025-10-10T14:39:53.846244Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:39:53.846250Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:39:53.846436Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:39:53.846600Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:53.846749Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:53.846900Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:53.847116Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:39:53.847168Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:39:53.858274Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3137 sessionId: src_id|2bc7b0fe-3e427c8d-6ff5e3ca-704d36f5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:53.861196Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:53.861496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:53.861527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:53.861572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:39:53.861703Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:39:53.870239Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:53.870264Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:53.870268Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:53.870270Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:53.870282Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602832925435303:5797]
2025-10-10T14:39:53.870287Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602832925435303:5797]
2025-10-10T14:39:53.870291Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602832925435303:5797]
2025-10-10T14:39:53.870347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:53.870355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:53.870361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:53.870416Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:53.870429Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:53.870434Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:53.870496Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:53.894098Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602833707683570:4596]
2025-10-10T14:39:53.894459Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 pipe creation result: OK TabletId: 72075186224037892 Generation: 3136, pipe: [1:7559602833707683570:4596]
2025-10-10T14:39:53.989374Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:53.998913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:53.998945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:53.999140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:53.999205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:53.999274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:53.999344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:53.999768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:53.999780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:53.999851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:53.999914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:53.999981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:54.000048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:54.000093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:54.000101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:54.000175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:54.000242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:54.000309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:54.000373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:54.000419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:54.000427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:54.000493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:54.000558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:54.000637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:54.000700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:54.000746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:54.000753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:54.000818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:54.000879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:54.000941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:54.001007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:54.001053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:54.001060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:54.001125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:54.001187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:54.001254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:54.001320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:54.001550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:54.001560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:54.001629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:54.001690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:54.001755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:54.001823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:54.002124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:54.002134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:54.002200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:54.002260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:54.002327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:54.002390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:54.002432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:54.002439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:54.002506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:54.002567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:54.002630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:54.002693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:54.002741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:54.002750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:54.002816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:54.002875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:54.002940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:54.003019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:54.003065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:54.003072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:54.003134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602833707683570:4596], now have 1 active actors on pipe
2025-10-10T14:39:54.005715Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 35 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602833707683570:4596]
2025-10-10T14:39:54.005755Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:54.005809Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:54.005818Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:54.005853Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3137 reason: error at write: Disconnected sessionId: src_id|2bc7b0fe-3e427c8d-6ff5e3ca-704d36f5_0
2025-10-10T14:39:54.006086Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3137 sessionId: src_id|2bc7b0fe-3e427c8d-6ff5e3ca-704d36f5_0 is DEAD
2025-10-10T14:39:54.005609Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:54.009568Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2bc7b0fe-3e427c8d-6ff5e3ca-704d36f5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:54.009584Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2bc7b0fe-3e427c8d-6ff5e3ca-704d36f5_0] Write session will restart in 0.009489s
2025-10-10T14:39:54.009611Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2bc7b0fe-3e427c8d-6ff5e3ca-704d36f5_0] Write session: Do CDS request
2025-10-10T14:39:54.009618Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2bc7b0fe-3e427c8d-6ff5e3ca-704d36f5_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:54.021855Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2bc7b0fe-3e427c8d-6ff5e3ca-704d36f5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:54.021949Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:54.021968Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3138
2025-10-10T14:39:54.025581Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3138 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:54.025632Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3138 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:54.025645Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3138 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:54.025649Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:54.026029Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3138 sessionId:  describe result for acl check
2025-10-10T14:39:54.026053Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:54.026054Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:54.026055Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:54.026060Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602838002650896:4017] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:54.026504Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602838002650896:4017] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:54.029623Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602838002650896:4017] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:54.034620Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602838002650896:4017] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:54.034637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602838002650896:4017] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:54.034641Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602838002650896:4017] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:54.034651Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3138 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:54.046065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:54.050767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:54.051056Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:54.051071Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:54.051084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:54.051148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:54.051200Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602837220402833:5795]
2025-10-10T14:39:54.051861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:54.052224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:54.052284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:54.052652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:54.052732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:54.052740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:54.052742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:54.052744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:54.052745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:54.052746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:54.052748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:54.052749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:54.052751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:54.052752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:54.052753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:54.052755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:54.052757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:54.052764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:54.052779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:54.052784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:54.052788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:54.052793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:54.052798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:54.052802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:54.052807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:54.052811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:54.052816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:54.052821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:54.052825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:54.052830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:54.052838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:54.052848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:54.052855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:54.052861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:54.052866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:54.052877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:54.052885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:54.052895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:54.052900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:54.052911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:54.052915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:54.052920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:54.052930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:54.052936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:54.052946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:54.052951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:54.052962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:54.052967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:54.052971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:54.052981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:54.052986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:54.052992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:54.053017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:54.053028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:54.053033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:54.053043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:54.053087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:54.056171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:54.056525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:54.056537Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:54.056540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:54.056544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:54.056551Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3137 [2:7559602837220402833:5795]
2025-10-10T14:39:54.056566Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:54.056601Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:54.056609Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:54.056613Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:54.056616Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:54.056634Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:54.056643Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:54.056656Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:54.056728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:54.056738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:54.056740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:54.056743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:54.056824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:54.056833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:54.056845Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:54.057021Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3137
2025-10-10T14:39:54.057064Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3137
2025-10-10T14:39:54.056864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:54.056893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:54.056916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602838002651042:4017], now have 1 active actors on pipe
2025-10-10T14:39:54.056922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602838002650873:2438], now have 1 active actors on pipe
2025-10-10T14:39:54.056930Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602837220402828:5795]
2025-10-10T14:39:54.056944Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602837220402828:5795]
2025-10-10T14:39:54.056947Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602837220402828:5795]
2025-10-10T14:39:54.056960Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:54.056975Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:54.056976Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:54.056979Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:54.056983Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:54.056994Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:54.056997Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:54.057022Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602837220402828:5795]
2025-10-10T14:39:54.057025Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:54.057045Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:54.057052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:54.057058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:54.057100Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2a5ab997-a8bf44d0-7da456fc-ffb48d55_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:54.057108Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:54.057112Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:54.057116Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:54.057130Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:54.057140Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:54.057167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:54.057430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:54.057443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:54.057477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:54.057596Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3138 partition: 0 MaxSeqNo: 40 sessionId: src_id|2a5ab997-a8bf44d0-7da456fc-ffb48d55_0
2025-10-10T14:39:54.058115Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2bc7b0fe-3e427c8d-6ff5e3ca-704d36f5_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|2a5ab997-a8bf44d0-7da456fc-ffb48d55_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:54.060849Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2a5ab997-a8bf44d0-7da456fc-ffb48d55_0] Write session: try to update token
2025-10-10T14:39:54.060865Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2a5ab997-a8bf44d0-7da456fc-ffb48d55_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:54.076347Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3138 sessionId: src_id|2a5ab997-a8bf44d0-7da456fc-ffb48d55_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:54.079320Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:54.076956Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:54.076982Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:54.076985Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:54.076988Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:54.076998Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602837220402828:5795]
2025-10-10T14:39:54.077003Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602837220402828:5795]
2025-10-10T14:39:54.077007Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602837220402828:5795]
2025-10-10T14:39:54.077064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:54.077072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:54.077075Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:54.077219Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:54.079494Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:54.079501Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:54.079505Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:54.109389Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602838002651164:4596]
2025-10-10T14:39:54.113413Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 pipe creation result: OK TabletId: 72075186224037892 Generation: 3137, pipe: [1:7559602838002651164:4596]
2025-10-10T14:39:54.201147Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:54.201517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:54.201535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:54.201584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602838002651164:4596], now have 1 active actors on pipe
2025-10-10T14:39:54.202517Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a5ab997-a8bf44d0-7da456fc-ffb48d55_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:39:54.202540Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a5ab997-a8bf44d0-7da456fc-ffb48d55_0] Write session will restart in 0.009977s
2025-10-10T14:39:54.202567Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a5ab997-a8bf44d0-7da456fc-ffb48d55_0] Write session: Do CDS request
2025-10-10T14:39:54.202574Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a5ab997-a8bf44d0-7da456fc-ffb48d55_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:54.201833Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:54.201985Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 36 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602838002651164:4596]
2025-10-10T14:39:54.202027Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:39:54.202126Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3138 reason: status is not ok: tablet will be restarted right now sessionId: src_id|2a5ab997-a8bf44d0-7da456fc-ffb48d55_0
2025-10-10T14:39:54.202351Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3138 sessionId: src_id|2a5ab997-a8bf44d0-7da456fc-ffb48d55_0 is DEAD
2025-10-10T14:39:54.202359Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:54.217967Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2a5ab997-a8bf44d0-7da456fc-ffb48d55_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:54.221708Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:54.221727Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3139
2025-10-10T14:39:54.225730Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3139 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:54.225807Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3139 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:54.225814Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3139 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:54.225819Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:54.226341Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3139 sessionId:  describe result for acl check
2025-10-10T14:39:54.226377Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:54.226379Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:54.226381Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:54.226388Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602838002651349:3993] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:54.226978Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602838002651349:3993] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:54.233235Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602838002651349:3993] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:54.236994Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602838002651349:3993] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:54.237020Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602838002651349:3993] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:54.237024Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602838002651349:3993] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:54.237036Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3139 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:54.244766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:54.250196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:54.250507Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:54.250519Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:54.250534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:54.250608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:54.250654Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602837220403102:5763]
2025-10-10T14:39:54.251282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:54.252392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:54.252475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:54.252839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:54.252916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:54.252925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:54.252926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:54.252928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:54.252929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:54.252931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:54.252932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:54.252934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:54.252935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:54.252936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:54.252938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:54.252939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:54.252940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:54.252947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:54.252961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:54.252965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:54.252969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:54.252972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:54.252976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:54.252980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:54.252984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:54.252988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:54.252995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:54.252999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:54.253003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:54.253007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:54.253019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:54.253028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:54.253035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:54.253041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:54.253049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:54.253054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:54.253059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:54.253065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:54.253071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:54.253077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:54.253082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:54.253088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:54.253094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:54.253100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:54.253105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:54.253111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:54.253116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:54.253131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:54.253141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:54.253148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:54.253153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:54.253158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:54.253163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:54.253168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:54.253173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:54.253178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:54.253213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:54.256412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:54.257520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:54.257538Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:54.257540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:54.257544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:54.257552Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3138 [2:7559602837220403102:5763]
2025-10-10T14:39:54.257566Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:54.257586Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:54.257590Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:54.257594Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:54.257596Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:54.257617Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:54.257625Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:54.257633Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:54.257706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:54.257708Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:54.257710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:54.257713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:54.257792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:54.257795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:54.257808Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:54.257820Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:54.257835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:54.257858Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602837220403097:5763]
2025-10-10T14:39:54.257861Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602837220403097:5763]
2025-10-10T14:39:54.257863Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602837220403097:5763]
2025-10-10T14:39:54.257873Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:54.257888Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:54.257897Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:54.257906Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:54.257909Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:54.257911Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:54.257914Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:54.257951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602838002651471:3993], now have 1 active actors on pipe
2025-10-10T14:39:54.257955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602838002651194:2438], now have 1 active actors on pipe
2025-10-10T14:39:54.257958Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602837220403097:5763]
2025-10-10T14:39:54.257968Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:54.258006Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:54.258426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:54.258443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:54.258491Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|78d45783-28d4fae7-bdfae174-da947aa_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:54.258508Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:54.258513Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:54.258522Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:54.258544Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:54.258561Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:54.258583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:54.258275Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3138
2025-10-10T14:39:54.258314Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3138
2025-10-10T14:39:54.261343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:54.261356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:54.261383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:54.261992Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a5ab997-a8bf44d0-7da456fc-ffb48d55_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|78d45783-28d4fae7-bdfae174-da947aa_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:54.265228Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|78d45783-28d4fae7-bdfae174-da947aa_0] Write session: try to update token
2025-10-10T14:39:54.265251Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|78d45783-28d4fae7-bdfae174-da947aa_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:54.261530Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3139 partition: 0 MaxSeqNo: 40 sessionId: src_id|78d45783-28d4fae7-bdfae174-da947aa_0
2025-10-10T14:39:54.279413Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:54.279436Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:54.279440Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:54.279443Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:54.279453Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602837220403097:5763]
2025-10-10T14:39:54.279458Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602837220403097:5763]
2025-10-10T14:39:54.279462Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602837220403097:5763]
2025-10-10T14:39:54.279513Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:54.279522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:54.279525Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:54.279699Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:54.281627Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:54.281643Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:54.281647Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:54.286078Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3139 sessionId: src_id|78d45783-28d4fae7-bdfae174-da947aa_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:54.289041Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:54.305449Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602838002651485:4596]
2025-10-10T14:39:54.305962Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 pipe creation result: OK TabletId: 72075186224037892 Generation: 3138, pipe: [1:7559602838002651485:4596]
2025-10-10T14:39:54.402730Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:54.402960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:54.402972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:54.403013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602838002651485:4596], now have 1 active actors on pipe
2025-10-10T14:39:54.403214Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:54.403374Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:39:54.403467Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3139 reason: status is not ok: tablet will be restarted right now sessionId: src_id|78d45783-28d4fae7-bdfae174-da947aa_0
2025-10-10T14:39:54.403704Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3139 sessionId: src_id|78d45783-28d4fae7-bdfae174-da947aa_0 is DEAD
2025-10-10T14:39:54.403715Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:54.403765Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 37 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602838002651485:4596]
2025-10-10T14:39:54.404439Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78d45783-28d4fae7-bdfae174-da947aa_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:39:54.404451Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78d45783-28d4fae7-bdfae174-da947aa_0] Write session will restart in 0.007022s
2025-10-10T14:39:54.404479Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78d45783-28d4fae7-bdfae174-da947aa_0] Write session: Do CDS request
2025-10-10T14:39:54.404486Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78d45783-28d4fae7-bdfae174-da947aa_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:54.413885Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|78d45783-28d4fae7-bdfae174-da947aa_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:54.414007Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:54.414026Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3140
2025-10-10T14:39:54.414205Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3140 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:54.414254Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3140 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:54.414264Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3140 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:54.414269Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:54.414808Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3140 sessionId:  describe result for acl check
2025-10-10T14:39:54.414846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:54.414848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:54.414850Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:54.414856Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602838002651521:3980] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:54.415512Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602838002651521:3980] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:54.418367Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602838002651521:3980] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:54.422872Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602838002651521:3980] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:54.422893Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602838002651521:3980] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:54.422897Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602838002651521:3980] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:54.422907Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3140 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:54.427752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:54.432912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:54.433201Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:54.433214Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:54.433227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:54.433286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:54.433354Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602837220403335:5760]
2025-10-10T14:39:54.433984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:54.434387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:54.434455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:54.434843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:54.434905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:54.434912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:54.434913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:54.434915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:54.434916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:54.434918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:54.434920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:54.434921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:54.434923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:54.434924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:54.434926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:54.434927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:54.434929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:54.434936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:54.434950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:54.434955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:54.434960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:54.434965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:54.434969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:54.434973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:54.434978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:54.434983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:54.434988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:54.434993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:54.434997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:54.435001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:54.435011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:54.435021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:54.435027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:54.435034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:54.435045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:54.435051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:54.435056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:54.435063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:54.435068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:54.435074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:54.435079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:54.435086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:54.435096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:54.435102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:54.435107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:54.435114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:54.435119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:54.435130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:54.435141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:54.435147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:54.435157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:54.435162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:54.435168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:54.435174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:54.435179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:54.435185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:54.435241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:54.438166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:54.439451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:54.439457Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:54.439459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:54.439464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:54.439472Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3139 [2:7559602837220403335:5760]
2025-10-10T14:39:54.439486Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:54.439508Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:54.439512Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:54.439516Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:54.439518Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:54.439540Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:54.439548Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:54.439556Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:54.439634Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:54.439636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:54.439639Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:54.439642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:54.439726Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:54.439729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:54.439741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:54.439751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:54.439769Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:54.439799Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602837220403330:5760]
2025-10-10T14:39:54.439802Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602837220403330:5760]
2025-10-10T14:39:54.439805Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602837220403330:5760]
2025-10-10T14:39:54.439816Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:54.439825Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:54.439829Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:54.439831Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:54.439837Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:54.439856Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:54.439861Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:54.439876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602838002651488:2438], now have 1 active actors on pipe
2025-10-10T14:39:54.439881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602838002651715:3980], now have 1 active actors on pipe
2025-10-10T14:39:54.439932Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602837220403330:5760]
2025-10-10T14:39:54.439950Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:54.439998Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:54.440336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:54.440347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:54.440393Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cddfc2b7-669b3ba2-93ee2af3-8ebfcf3e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:54.440403Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:54.440407Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:54.440410Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:54.440427Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:54.440442Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:54.440459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:54.440037Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3139
2025-10-10T14:39:54.440098Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3139
2025-10-10T14:39:54.440798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:54.440808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:54.440831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:54.440946Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3140 partition: 0 MaxSeqNo: 40 sessionId: src_id|cddfc2b7-669b3ba2-93ee2af3-8ebfcf3e_0
2025-10-10T14:39:54.441393Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78d45783-28d4fae7-bdfae174-da947aa_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|cddfc2b7-669b3ba2-93ee2af3-8ebfcf3e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:54.444516Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cddfc2b7-669b3ba2-93ee2af3-8ebfcf3e_0] Write session: try to update token
2025-10-10T14:39:54.444538Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cddfc2b7-669b3ba2-93ee2af3-8ebfcf3e_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:54.460077Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:54.460095Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:54.460099Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:54.460101Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:54.460111Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602837220403330:5760]
2025-10-10T14:39:54.460115Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602837220403330:5760]
2025-10-10T14:39:54.460119Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602837220403330:5760]
2025-10-10T14:39:54.460169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:54.460178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:54.460182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:54.460182Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:54.460188Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:54.460193Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:54.460344Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:54.460692Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3140 sessionId: src_id|cddfc2b7-669b3ba2-93ee2af3-8ebfcf3e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:54.463642Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:54.503373Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602838002651783:4596]
2025-10-10T14:39:54.506114Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 pipe creation result: OK TabletId: 72075186224037892 Generation: 3139, pipe: [1:7559602838002651783:4596]
2025-10-10T14:39:54.579952Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:54.580665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:54.580684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:54.580739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602838002651783:4596], now have 1 active actors on pipe
2025-10-10T14:39:54.581202Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:54.581267Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 38 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602838002651783:4596]
2025-10-10T14:39:54.581075Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:54.581576Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:39:54.581697Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3140 reason: status is not ok: tablet will be restarted right now sessionId: src_id|cddfc2b7-669b3ba2-93ee2af3-8ebfcf3e_0
2025-10-10T14:39:54.581958Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3140 sessionId: src_id|cddfc2b7-669b3ba2-93ee2af3-8ebfcf3e_0 is DEAD
2025-10-10T14:39:54.590815Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cddfc2b7-669b3ba2-93ee2af3-8ebfcf3e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:39:54.590831Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cddfc2b7-669b3ba2-93ee2af3-8ebfcf3e_0] Write session will restart in 0.008092s
2025-10-10T14:39:54.590857Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cddfc2b7-669b3ba2-93ee2af3-8ebfcf3e_0] Write session: Do CDS request
2025-10-10T14:39:54.590863Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cddfc2b7-669b3ba2-93ee2af3-8ebfcf3e_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:54.599968Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cddfc2b7-669b3ba2-93ee2af3-8ebfcf3e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:54.600253Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:54.600274Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3141
2025-10-10T14:39:54.600394Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3141 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:54.600435Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3141 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:54.600442Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3141 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:54.600447Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:54.600984Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3141 sessionId:  describe result for acl check
2025-10-10T14:39:54.601025Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:54.601034Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:54.601036Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:54.601043Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602838002651824:3985] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:54.601633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602838002651824:3985] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:54.604340Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602838002651824:3985] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:54.607296Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602838002651824:3985] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:54.607312Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602838002651824:3985] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:54.607316Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602838002651824:3985] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:54.607326Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3141 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:54.622616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:54.623225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:54.623429Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:54.623443Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:54.623457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:54.623510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:54.623550Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602837220403569:5745]
2025-10-10T14:39:54.624259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:54.624581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:54.624649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:54.625349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:54.625429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:54.625435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:54.625436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:54.625438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:54.625439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:54.625440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:54.625442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:54.625443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:54.625444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:54.625445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:54.625447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:54.625448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:54.625449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:54.625455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:54.625470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:54.625474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:54.625479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:54.625483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:54.625488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:54.625492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:54.625497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:54.625501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:54.625509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:54.625513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:54.625528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:54.625532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:54.625542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:54.625551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:54.625562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:54.625572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:54.625577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:54.625585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:54.625590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:54.625596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:54.625609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:54.625620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:54.625630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:54.625636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:54.625644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:54.625653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:54.625658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:54.625665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:54.625674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:54.625680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:54.625683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:54.625689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:54.625693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:54.625699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:54.625703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:54.625709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:54.625714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:54.625724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:54.625762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:54.628549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:54.628892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:54.628908Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:54.628911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:54.628915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:54.628921Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3140 [2:7559602837220403569:5745]
2025-10-10T14:39:54.628935Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:54.628953Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:54.628957Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:54.628960Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:54.628963Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:54.628981Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:54.628989Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:54.629003Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:54.629068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:54.629076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:54.629078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:54.629080Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:54.629149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:54.629156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:54.629167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:54.629183Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:54.629203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:54.629231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602838002651908:3985], now have 1 active actors on pipe
2025-10-10T14:39:54.629239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602838002651789:2438], now have 1 active actors on pipe
2025-10-10T14:39:54.629248Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602837220403564:5745]
2025-10-10T14:39:54.629250Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602837220403564:5745]
2025-10-10T14:39:54.629252Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602837220403564:5745]
2025-10-10T14:39:54.629267Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:54.629281Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:54.629282Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:54.629285Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:54.629287Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:54.629303Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:54.629306Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:54.629350Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602837220403564:5745]
2025-10-10T14:39:54.629364Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:54.629371Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:54.629493Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3140
2025-10-10T14:39:54.629529Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3140
2025-10-10T14:39:54.629651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:54.629665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:54.629700Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b1db6b3b-32b93bc6-597014d7-1ccfdf14_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:54.629716Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:54.629721Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:54.629724Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:54.629735Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:54.629747Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:54.629770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:54.630016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:54.630027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:54.630045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:54.630195Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3141 partition: 0 MaxSeqNo: 40 sessionId: src_id|b1db6b3b-32b93bc6-597014d7-1ccfdf14_0
2025-10-10T14:39:54.630677Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cddfc2b7-669b3ba2-93ee2af3-8ebfcf3e_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|b1db6b3b-32b93bc6-597014d7-1ccfdf14_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:54.633440Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b1db6b3b-32b93bc6-597014d7-1ccfdf14_0] Write session: try to update token
2025-10-10T14:39:54.633457Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b1db6b3b-32b93bc6-597014d7-1ccfdf14_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:54.642693Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:39:54.642715Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:54.642726Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602837220403564:5745]
2025-10-10T14:39:54.642781Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:39:54.642781Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:39:54.642970Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:39:54.643113Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:54.643251Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:54.643385Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:54.643581Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:39:54.643617Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:39:54.655822Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3141 sessionId: src_id|b1db6b3b-32b93bc6-597014d7-1ccfdf14_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:54.658705Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:54.659421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:54.659442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:54.659494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:39:54.659778Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:39:54.663260Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:54.663277Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:54.663281Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:54.663283Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:54.663295Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602837220403564:5745]
2025-10-10T14:39:54.663299Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602837220403564:5745]
2025-10-10T14:39:54.663304Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602837220403564:5745]
2025-10-10T14:39:54.663356Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:54.663365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:54.663368Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:54.663500Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:54.663641Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:54.663652Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:54.663656Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:54.681559Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602838002652088:4596]
2025-10-10T14:39:54.681809Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 pipe creation result: OK TabletId: 72075186224037892 Generation: 3140, pipe: [1:7559602838002652088:4596]
2025-10-10T14:39:54.785615Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:54.794378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:54.794402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:54.794582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:54.794637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:54.794696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:54.794754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:54.794797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:54.794802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:54.794875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:54.794932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:54.794990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:54.795050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:54.795089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:54.795092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:54.795159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:54.795214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:54.795274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:54.795332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:54.795369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:54.795373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:54.795437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:54.795495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:54.795551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:54.795618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:54.795657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:54.795660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:54.795729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:54.795786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:54.795842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:54.795902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:54.795942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:54.795945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:54.796009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:54.796064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:54.796122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:54.796183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:54.796222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:54.796225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:54.796294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:54.796347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:54.796408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:54.796463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:54.796502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:54.796505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:54.796569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:54.796637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:54.796692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:54.796752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:54.796791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:54.796794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:54.796856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:54.796909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:54.796965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:54.797019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:54.797059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:54.797062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:54.797124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:54.797179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:54.797235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:54.797292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:54.797956Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 39 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602838002652088:4596]
2025-10-10T14:39:54.797967Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:54.797998Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:54.798001Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:54.798032Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3141 reason: error at write: Disconnected sessionId: src_id|b1db6b3b-32b93bc6-597014d7-1ccfdf14_0
2025-10-10T14:39:54.798586Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1db6b3b-32b93bc6-597014d7-1ccfdf14_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:54.798236Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3141 sessionId: src_id|b1db6b3b-32b93bc6-597014d7-1ccfdf14_0 is DEAD
2025-10-10T14:39:54.798595Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1db6b3b-32b93bc6-597014d7-1ccfdf14_0] Write session will restart in 0.006908s
2025-10-10T14:39:54.798621Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1db6b3b-32b93bc6-597014d7-1ccfdf14_0] Write session: Do CDS request
2025-10-10T14:39:54.798637Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1db6b3b-32b93bc6-597014d7-1ccfdf14_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:54.797609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:54.797616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:54.797680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602838002652088:4596], now have 1 active actors on pipe
2025-10-10T14:39:54.798907Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:54.808014Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b1db6b3b-32b93bc6-597014d7-1ccfdf14_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:54.810141Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:54.810161Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3142
2025-10-10T14:39:54.810412Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3142 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:54.810478Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3142 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:54.810485Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3142 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:54.810491Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:54.810986Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3142 sessionId:  describe result for acl check
2025-10-10T14:39:54.811023Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:54.811025Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:54.811028Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:54.811034Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602838002652134:3957] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:54.811636Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602838002652134:3957] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:54.817836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602838002652134:3957] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:54.822299Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602838002652134:3957] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:54.822317Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602838002652134:3957] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:54.822321Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602838002652134:3957] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:54.822341Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3142 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:54.828306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:54.832273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:54.832505Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:54.832516Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:54.832530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:54.832607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:54.832661Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602837220403814:5736]
2025-10-10T14:39:54.833357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:54.833718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:54.833781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:54.834104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:54.834188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:54.834197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:54.834198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:54.834200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:54.834201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:54.834202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:54.834203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:54.834204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:54.834205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:54.834207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:54.834208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:54.834209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:54.834211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:54.834217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:54.834230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:54.834234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:54.834238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:54.834241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:54.834246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:54.834249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:54.834252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:54.834256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:54.834262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:54.834265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:54.834268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:54.834272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:54.834281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:54.834290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:54.834297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:54.834303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:54.834309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:54.834313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:54.834318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:54.834322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:54.834327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:54.834332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:54.834336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:54.834341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:54.834346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:54.834351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:54.834354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:54.834359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:54.834366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:54.834378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:54.834382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:54.834387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:54.834396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:54.834401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:54.834405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:54.834410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:54.834414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:54.834419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:54.834457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:54.836906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:54.837635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:54.837648Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:54.837651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:54.837655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:54.837661Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3141 [2:7559602837220403814:5736]
2025-10-10T14:39:54.837673Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:54.837691Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:54.837702Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:54.837706Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:54.837709Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:54.837727Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:54.837735Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:54.837742Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:54.837801Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:54.837809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:54.837811Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:54.837814Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:54.837882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:54.837890Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:54.837903Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:54.837920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:54.837937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:54.837967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602838002652323:3957], now have 1 active actors on pipe
2025-10-10T14:39:54.837975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602838002652092:2438], now have 1 active actors on pipe
2025-10-10T14:39:54.837983Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602837220403809:5736]
2025-10-10T14:39:54.837989Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602837220403809:5736]
2025-10-10T14:39:54.837991Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602837220403809:5736]
2025-10-10T14:39:54.838009Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:54.838028Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:54.838031Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:54.838037Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:54.838040Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:54.838050Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:54.838052Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:54.838025Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3141
2025-10-10T14:39:54.838076Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602837220403809:5736]
2025-10-10T14:39:54.838033Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3141
2025-10-10T14:39:54.838085Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:54.838087Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:54.838106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:54.838115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:54.838164Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|558e5fef-f6a5ec3-5c71fc99-a50b5836_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:54.838177Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:54.838181Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:54.838183Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:54.838195Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:54.838206Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:54.838228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:54.838389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:54.838404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:54.838428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:54.838569Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3142 partition: 0 MaxSeqNo: 40 sessionId: src_id|558e5fef-f6a5ec3-5c71fc99-a50b5836_0
2025-10-10T14:39:54.838964Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1db6b3b-32b93bc6-597014d7-1ccfdf14_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|558e5fef-f6a5ec3-5c71fc99-a50b5836_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:54.841688Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|558e5fef-f6a5ec3-5c71fc99-a50b5836_0] Write session: try to update token
2025-10-10T14:39:54.841708Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|558e5fef-f6a5ec3-5c71fc99-a50b5836_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:54.860326Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3142 sessionId: src_id|558e5fef-f6a5ec3-5c71fc99-a50b5836_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:54.857704Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:54.857722Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:54.857725Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:54.857728Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:54.857741Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602837220403809:5736]
2025-10-10T14:39:54.857746Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602837220403809:5736]
2025-10-10T14:39:54.857749Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602837220403809:5736]
2025-10-10T14:39:54.857803Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:54.857804Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:54.857811Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:54.857811Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:54.857814Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:54.857816Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:54.857954Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:54.862922Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:54.898298Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602838002652407:4596]
2025-10-10T14:39:54.898687Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 pipe creation result: OK TabletId: 72075186224037892 Generation: 3141, pipe: [1:7559602838002652407:4596]
2025-10-10T14:39:54.982349Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:54.983082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:54.983103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:54.983171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602838002652407:4596], now have 1 active actors on pipe
2025-10-10T14:39:54.983424Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:54.984020Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|558e5fef-f6a5ec3-5c71fc99-a50b5836_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:39:54.984033Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|558e5fef-f6a5ec3-5c71fc99-a50b5836_0] Write session will restart in 0.006095s
2025-10-10T14:39:54.984068Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|558e5fef-f6a5ec3-5c71fc99-a50b5836_0] Write session: Do CDS request
2025-10-10T14:39:54.984074Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|558e5fef-f6a5ec3-5c71fc99-a50b5836_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:54.983514Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:54.983572Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:39:54.983646Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3142 reason: status is not ok: tablet will be restarted right now sessionId: src_id|558e5fef-f6a5ec3-5c71fc99-a50b5836_0
2025-10-10T14:39:54.983862Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3142 sessionId: src_id|558e5fef-f6a5ec3-5c71fc99-a50b5836_0 is DEAD
2025-10-10T14:39:54.984008Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 40 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602838002652407:4596]
2025-10-10T14:39:54.991860Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|558e5fef-f6a5ec3-5c71fc99-a50b5836_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:54.991970Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:54.991987Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3143
2025-10-10T14:39:54.992134Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3143 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:54.992197Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3143 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:54.992212Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3143 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:54.992216Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:54.992748Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3143 sessionId:  describe result for acl check
2025-10-10T14:39:54.992812Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:54.992819Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:54.992821Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:54.992828Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602838002652438:3968] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:54.993487Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602838002652438:3968] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:54.996650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602838002652438:3968] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:55.000502Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602838002652438:3968] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:55.000519Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602838002652438:3968] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:55.000522Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602838002652438:3968] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:55.000531Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3143 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:55.007468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:55.012488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:55.012747Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:55.012758Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:55.012771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:55.012838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:55.012883Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602841515371344:5734]
2025-10-10T14:39:55.013528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:55.013865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:55.013923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:55.014292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:55.014370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:55.014378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:55.014380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:55.014382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:55.014383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:55.014385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:55.014386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:55.014388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:55.014389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:55.014390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:55.014392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:55.014393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:55.014394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:55.014402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:55.014415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:55.014419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:55.014423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:55.014427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:55.014431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:55.014435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:55.014439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:55.014444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:55.014448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:55.014452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:55.014456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:55.014460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:55.014480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:55.014489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:55.014497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:55.014503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:55.014508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:55.014513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:55.014518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:55.014522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:55.014527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:55.014531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:55.014535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:55.014541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:55.014546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:55.014550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:55.014555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:55.014560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:55.014567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:55.014572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:55.014577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:55.014582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:55.014586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:55.014596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:55.014600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:55.014611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:55.014615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:55.014620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:55.014660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:55.017208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:55.017655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:55.017679Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:55.017681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:55.017685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:55.017692Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3142 [2:7559602841515371344:5734]
2025-10-10T14:39:55.017706Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:55.017729Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:55.017737Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:55.017741Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:55.017743Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:55.017762Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:55.017774Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:55.017783Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:55.017846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:55.017857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:55.017859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:55.017863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:55.018086Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3142
2025-10-10T14:39:55.018093Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3142
2025-10-10T14:39:55.018481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:55.018492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:55.018505Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:55.018519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:55.018541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:55.018576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602842297619907:3968], now have 1 active actors on pipe
2025-10-10T14:39:55.018584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602838002652414:2438], now have 1 active actors on pipe
2025-10-10T14:39:55.018600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:55.018611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:55.018635Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602841515371339:5734]
2025-10-10T14:39:55.018642Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602841515371339:5734]
2025-10-10T14:39:55.018644Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602841515371339:5734]
2025-10-10T14:39:55.018660Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:55.018680Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:55.018682Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:55.018685Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:55.018687Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:55.018700Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:55.018704Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:55.018726Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4ab6a26a-a495fb24-a3293bea-c02d3926_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:55.018740Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:55.018744Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:55.018746Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:55.018759Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:55.018771Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:55.018806Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602841515371339:5734]
2025-10-10T14:39:55.018821Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:55.018827Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:55.018833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:55.019012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:55.019021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:55.019038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:55.019125Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3143 partition: 0 MaxSeqNo: 40 sessionId: src_id|4ab6a26a-a495fb24-a3293bea-c02d3926_0
2025-10-10T14:39:55.019566Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|558e5fef-f6a5ec3-5c71fc99-a50b5836_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|4ab6a26a-a495fb24-a3293bea-c02d3926_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:55.022422Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4ab6a26a-a495fb24-a3293bea-c02d3926_0] Write session: try to update token
2025-10-10T14:39:55.022440Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4ab6a26a-a495fb24-a3293bea-c02d3926_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:55.030561Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:39:55.030580Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:55.030592Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602841515371339:5734]
2025-10-10T14:39:55.030645Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:39:55.030650Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:39:55.030831Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:39:55.030967Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:55.031103Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:55.031234Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:55.031415Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:39:55.031455Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:39:55.036900Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3143 sessionId: src_id|4ab6a26a-a495fb24-a3293bea-c02d3926_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:55.039386Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:55.039770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:55.039791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:55.039846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:39:55.039939Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:39:55.049157Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:55.049178Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:55.049181Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:55.049183Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:55.049194Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602841515371339:5734]
2025-10-10T14:39:55.049198Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602841515371339:5734]
2025-10-10T14:39:55.049203Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602841515371339:5734]
2025-10-10T14:39:55.049254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:55.049263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:55.049266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:55.049432Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:55.050201Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:55.050212Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:55.050217Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:55.083991Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602842297620006:4596]
2025-10-10T14:39:55.084322Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 pipe creation result: OK TabletId: 72075186224037892 Generation: 3142, pipe: [1:7559602842297620006:4596]
2025-10-10T14:39:55.166747Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:55.175953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:55.175981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:55.176166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:55.176233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:55.176303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:55.176369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:55.176420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:55.176434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:55.176511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:55.176595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:55.176669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:55.176741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:55.176790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:55.176798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:55.176878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:55.176945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:55.177014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:55.177088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:55.177139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:55.177146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:55.177218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:55.177293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:55.178561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:55.178651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:55.178703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:55.178712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:55.178804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:55.178875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:55.178951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:55.179021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:55.179074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:55.179082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:55.179163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:55.179235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:55.179311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:55.179386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:55.179438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:55.179446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:55.179523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:55.179594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:55.179666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:55.179740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:55.179796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:55.179799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:55.179875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:55.179948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:55.180023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:55.180095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:55.180146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:55.180150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:55.180225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:55.180293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:55.180372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:55.180455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:55.180517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:55.180524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:55.180613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:55.180691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:55.180766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:55.180840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:55.180895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:55.180903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:55.180988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602842297620006:4596], now have 1 active actors on pipe
2025-10-10T14:39:55.181414Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:55.181432Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:55.181464Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3143 reason: error at write: Disconnected sessionId: src_id|4ab6a26a-a495fb24-a3293bea-c02d3926_0
2025-10-10T14:39:55.182613Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:55.183071Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ab6a26a-a495fb24-a3293bea-c02d3926_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:55.183082Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ab6a26a-a495fb24-a3293bea-c02d3926_0] Write session will restart in 0.006890s
2025-10-10T14:39:55.183108Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ab6a26a-a495fb24-a3293bea-c02d3926_0] Write session: Do CDS request
2025-10-10T14:39:55.183115Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ab6a26a-a495fb24-a3293bea-c02d3926_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:55.181724Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3143 sessionId: src_id|4ab6a26a-a495fb24-a3293bea-c02d3926_0 is DEAD
2025-10-10T14:39:55.182020Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:55.182059Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 41 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602842297620006:4596]
2025-10-10T14:39:55.190938Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4ab6a26a-a495fb24-a3293bea-c02d3926_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:55.193724Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:55.193746Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3144
2025-10-10T14:39:55.193923Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3144 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:55.193960Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3144 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:55.193965Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3144 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:55.193970Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:55.194575Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3144 sessionId:  describe result for acl check
2025-10-10T14:39:55.194607Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:55.194609Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:55.194611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:55.194618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602842297620029:3940] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:55.195244Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602842297620029:3940] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:55.198491Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602842297620029:3940] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:55.206399Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602842297620029:3940] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:55.206420Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602842297620029:3940] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:55.206424Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602842297620029:3940] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:55.213751Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3144 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:55.231232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:55.232180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:55.232393Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:55.232404Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:55.232418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:55.232474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:55.232522Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602841515371618:12292]
2025-10-10T14:39:55.233220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:55.236839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:55.236906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:55.237579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:55.237645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:55.237646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:55.237648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:55.237649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:55.237650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:55.237655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:55.237657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:55.237658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:55.237660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:55.237661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:55.237663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:55.237664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:55.237665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:55.237673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:55.237688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:55.237693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:55.237697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:55.237702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:55.237707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:55.237711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:55.237716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:55.237721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:55.237726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:55.237731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:55.237735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:55.237740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:55.237749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:55.237759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:55.237767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:55.237773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:55.237778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:55.237784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:55.237789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:55.237795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:55.237800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:55.237806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:55.237811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:55.237817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:55.237822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:55.237828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:55.237835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:55.237841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:55.237846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:55.237852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:55.237857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:55.237863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:55.237871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:55.237877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:55.237882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:55.237889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:55.237894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:55.237900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:55.237946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:55.240989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:55.241288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:55.241293Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:55.241295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:55.241300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:55.241306Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3143 [2:7559602841515371618:12292]
2025-10-10T14:39:55.241320Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:55.241357Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:55.241361Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:55.241365Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:55.241368Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:55.241385Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:55.241394Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:55.241402Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:55.241467Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:55.241477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:55.241479Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:55.241482Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:55.241557Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:55.241564Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:55.241579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:55.241597Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:55.241622Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:55.241647Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602841515371613:12292]
2025-10-10T14:39:55.241654Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602841515371613:12292]
2025-10-10T14:39:55.241656Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602841515371613:12292]
2025-10-10T14:39:55.241667Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:55.241676Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:55.241679Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:55.241683Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:55.241687Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:55.241704Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:55.241712Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:55.241724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602842297620067:3940], now have 1 active actors on pipe
2025-10-10T14:39:55.241732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602842297620022:2438], now have 1 active actors on pipe
2025-10-10T14:39:55.241758Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602841515371613:12292]
2025-10-10T14:39:55.241770Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:55.241803Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:55.241920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:55.241933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:55.241972Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|428ccab7-865b9258-872ad821-d3291953_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:55.241981Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:55.241986Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:55.241989Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:55.242001Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:55.242016Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:55.242032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:55.242359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:55.242369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:55.242388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:55.242916Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ab6a26a-a495fb24-a3293bea-c02d3926_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|428ccab7-865b9258-872ad821-d3291953_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:55.241803Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3143
2025-10-10T14:39:55.241804Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3143
2025-10-10T14:39:55.242491Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3144 partition: 0 MaxSeqNo: 40 sessionId: src_id|428ccab7-865b9258-872ad821-d3291953_0
2025-10-10T14:39:55.245717Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|428ccab7-865b9258-872ad821-d3291953_0] Write session: try to update token
2025-10-10T14:39:55.245735Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|428ccab7-865b9258-872ad821-d3291953_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:55.254857Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:39:55.254875Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:55.254886Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602841515371613:12292]
2025-10-10T14:39:55.254936Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:39:55.254938Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:39:55.255130Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:39:55.255267Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:55.255397Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:55.255546Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:55.255844Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:39:55.255889Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:39:55.260101Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3144 sessionId: src_id|428ccab7-865b9258-872ad821-d3291953_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:55.262730Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:55.263207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:55.263239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:55.263290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:39:55.263378Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:39:55.273952Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:55.273978Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:55.273981Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:55.273984Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:55.273995Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602841515371613:12292]
2025-10-10T14:39:55.273999Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602841515371613:12292]
2025-10-10T14:39:55.274003Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602841515371613:12292]
2025-10-10T14:39:55.274049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:55.274049Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:55.274056Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:55.274057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:55.274060Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:55.274060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:55.274197Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:55.281636Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602842297620332:4596]
2025-10-10T14:39:55.281884Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 pipe creation result: OK TabletId: 72075186224037892 Generation: 3143, pipe: [1:7559602842297620332:4596]
2025-10-10T14:39:55.390400Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:55.391031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602842297620332:4596], now have 1 active actors on pipe
2025-10-10T14:39:55.399023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:55.399049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:55.399235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:55.399304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:55.399373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:55.399437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:55.399840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:55.400034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:55.400114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:55.400198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:55.400265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:55.400337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:55.400379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:55.400388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:55.400458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:55.400513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:55.400582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:55.400641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:55.400680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:55.400682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:55.400751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:55.400813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:55.400877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:55.400941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:55.400982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:55.400985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:55.401068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:55.404481Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:39:55.404538Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3144 reason: status is not ok: tablet will be restarted right now sessionId: src_id|428ccab7-865b9258-872ad821-d3291953_0
2025-10-10T14:39:55.404768Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3144 sessionId: src_id|428ccab7-865b9258-872ad821-d3291953_0 is DEAD
2025-10-10T14:39:55.405410Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 42 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602842297620332:4596]
2025-10-10T14:39:55.405425Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:55.401126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:55.401184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:55.401242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:55.401281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:55.401284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:55.401371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:55.401435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:55.401498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:55.401559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:55.401599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:55.401602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:55.401669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:55.401730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:55.401797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:55.401866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:55.401905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:55.401907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:55.401976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:55.402035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:55.402097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:55.402159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:55.402201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:55.402203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:55.402273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:55.402333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:55.402394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:55.402456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:55.402496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:55.402499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:55.402566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:55.402622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:55.402684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:55.402748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:55.402790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:55.402792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:55.404106Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:55.409443Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|428ccab7-865b9258-872ad821-d3291953_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:39:55.409457Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|428ccab7-865b9258-872ad821-d3291953_0] Write session will restart in 0.005705s
2025-10-10T14:39:55.409484Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|428ccab7-865b9258-872ad821-d3291953_0] Write session: Do CDS request
2025-10-10T14:39:55.409491Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|428ccab7-865b9258-872ad821-d3291953_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:55.416973Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|428ccab7-865b9258-872ad821-d3291953_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:55.417052Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:55.417076Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3145
2025-10-10T14:39:55.417405Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3145 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:55.417468Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3145 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:55.417480Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3145 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:55.417485Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:55.417964Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3145 sessionId:  describe result for acl check
2025-10-10T14:39:55.418009Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:55.418011Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:55.418013Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:55.418019Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602842297620349:3925] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:55.418629Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602842297620349:3925] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:55.421687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602842297620349:3925] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:55.424649Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602842297620349:3925] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:55.424664Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602842297620349:3925] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:55.424668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602842297620349:3925] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:55.424676Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3145 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:55.435302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:55.440082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:55.440835Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:55.440849Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:55.440867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:55.440946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:55.440997Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602841515371857:12302]
2025-10-10T14:39:55.441677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:55.442015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:55.442060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:55.442400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:55.442467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:55.442474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:55.442475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:55.442476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:55.442477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:55.442479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:55.442480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:55.442482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:55.442483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:55.442485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:55.442486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:55.442488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:55.442489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:55.442495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:55.442509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:55.442513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:55.442517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:55.442522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:55.442526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:55.442530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:55.442534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:55.442539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:55.442543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:55.442547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:55.442551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:55.442555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:55.442562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:55.442571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:55.442578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:55.442584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:55.442593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:55.442599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:55.442608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:55.442614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:55.442620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:55.442626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:55.442630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:55.442636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:55.442641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:55.442647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:55.442656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:55.442661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:55.442666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:55.442675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:55.442682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:55.442692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:55.442697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:55.442703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:55.442708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:55.442715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:55.442720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:55.442730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:55.442771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:55.445358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:55.445701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:55.445712Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:55.445715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:55.445719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:55.445727Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3144 [2:7559602841515371857:12302]
2025-10-10T14:39:55.445740Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:55.445759Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:55.445769Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:55.445773Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:55.445776Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:55.445795Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:55.445808Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:55.445817Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:55.445884Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:55.445890Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:55.445892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:55.445895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:55.445966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:55.445973Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:55.445984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:55.445996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:55.446012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:55.446040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602842297620337:2438], now have 1 active actors on pipe
2025-10-10T14:39:55.446048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602842297620458:3925], now have 1 active actors on pipe
2025-10-10T14:39:55.446067Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602841515371851:12302]
2025-10-10T14:39:55.446079Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602841515371851:12302]
2025-10-10T14:39:55.446081Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602841515371851:12302]
2025-10-10T14:39:55.446095Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:55.446110Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:55.446130Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:55.446099Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3144
2025-10-10T14:39:55.446110Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3144
2025-10-10T14:39:55.446134Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:55.446142Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:55.446145Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:55.446147Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:55.446164Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602841515371851:12302]
2025-10-10T14:39:55.446167Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:55.446169Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:55.446360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:55.446371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:55.446403Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4ef88015-4b51e4b1-943a4909-a29f9ed6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:55.446417Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:55.446421Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:55.446424Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:55.446436Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:55.446448Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:55.446466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:55.446655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:55.446667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:55.446692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:55.446787Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3145 partition: 0 MaxSeqNo: 40 sessionId: src_id|4ef88015-4b51e4b1-943a4909-a29f9ed6_0
2025-10-10T14:39:55.453462Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|428ccab7-865b9258-872ad821-d3291953_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|4ef88015-4b51e4b1-943a4909-a29f9ed6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:55.456207Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4ef88015-4b51e4b1-943a4909-a29f9ed6_0] Write session: try to update token
2025-10-10T14:39:55.456234Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4ef88015-4b51e4b1-943a4909-a29f9ed6_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:55.470189Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:55.470209Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:55.470213Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:55.470215Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:55.470227Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602841515371851:12302]
2025-10-10T14:39:55.470231Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602841515371851:12302]
2025-10-10T14:39:55.470237Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602841515371851:12302]
2025-10-10T14:39:55.470289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:55.470299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:55.470298Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:55.470301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:55.470307Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:55.470312Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:55.470449Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:55.471285Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3145 sessionId: src_id|4ef88015-4b51e4b1-943a4909-a29f9ed6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:55.474211Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:55.505378Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602842297620635:4596]
2025-10-10T14:39:55.505727Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 pipe creation result: OK TabletId: 72075186224037892 Generation: 3144, pipe: [1:7559602842297620635:4596]
2025-10-10T14:39:55.585091Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:55.585627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:55.585647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:55.585712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602842297620635:4596], now have 1 active actors on pipe
2025-10-10T14:39:55.586361Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 43 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602842297620635:4596]
2025-10-10T14:39:55.586399Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:39:55.586474Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3145 reason: status is not ok: tablet will be restarted right now sessionId: src_id|4ef88015-4b51e4b1-943a4909-a29f9ed6_0
2025-10-10T14:39:55.586691Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3145 sessionId: src_id|4ef88015-4b51e4b1-943a4909-a29f9ed6_0 is DEAD
2025-10-10T14:39:55.586264Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:55.586896Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ef88015-4b51e4b1-943a4909-a29f9ed6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:39:55.586906Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ef88015-4b51e4b1-943a4909-a29f9ed6_0] Write session will restart in 0.006523s
2025-10-10T14:39:55.586932Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ef88015-4b51e4b1-943a4909-a29f9ed6_0] Write session: Do CDS request
2025-10-10T14:39:55.586938Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ef88015-4b51e4b1-943a4909-a29f9ed6_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:55.586815Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:55.594911Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4ef88015-4b51e4b1-943a4909-a29f9ed6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:55.595000Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:55.595021Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3146
2025-10-10T14:39:55.596828Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3146 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:55.596887Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3146 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:55.596893Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3146 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:55.596899Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:55.597414Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3146 sessionId:  describe result for acl check
2025-10-10T14:39:55.597460Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:55.597467Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:55.597469Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:55.597476Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602842297620672:3911] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:55.598089Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602842297620672:3911] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:55.600794Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602842297620672:3911] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:55.603784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602842297620672:3911] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:55.603800Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602842297620672:3911] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:55.603804Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602842297620672:3911] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:55.603813Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3146 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:55.610141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:55.610583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:55.610792Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:55.610808Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:55.610823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:55.610886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:55.611226Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602841515372095:12304]
2025-10-10T14:39:55.611872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:55.615361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:55.615430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:55.615810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:55.615900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:55.615908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:55.615909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:55.615910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:55.615912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:55.615913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:55.615914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:55.615915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:55.615917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:55.615918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:55.615919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:55.615921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:55.615922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:55.615930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:55.615944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:55.615948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:55.615953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:55.615957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:55.615961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:55.615964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:55.615968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:55.615972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:55.615976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:55.615981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:55.615985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:55.615989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:55.615998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:55.616006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:55.616013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:55.616019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:55.616024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:55.616029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:55.616034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:55.616040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:55.616045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:55.616050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:55.616061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:55.616067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:55.616072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:55.616077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:55.616082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:55.616087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:55.616093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:55.616098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:55.616104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:55.616109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:55.616114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:55.616120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:55.616124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:55.616131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:55.616144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:55.616150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:55.616196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:55.618694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:55.619307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:55.619320Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:55.619323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:55.619327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:55.619333Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3145 [2:7559602841515372095:12304]
2025-10-10T14:39:55.619346Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:55.619363Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:55.619367Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:55.619370Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:55.619373Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:55.619390Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:55.619406Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:55.619419Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:55.619479Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:55.619487Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:55.619489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:55.619492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:55.619565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:55.619573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:55.619585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:55.619596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:55.619618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:55.619644Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602841515372090:12304]
2025-10-10T14:39:55.619653Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602841515372090:12304]
2025-10-10T14:39:55.619655Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602841515372090:12304]
2025-10-10T14:39:55.619670Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:55.619685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602842297620833:3911], now have 1 active actors on pipe
2025-10-10T14:39:55.619688Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:55.619691Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:55.619693Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:55.619694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602842297620637:2438], now have 1 active actors on pipe
2025-10-10T14:39:55.619704Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:55.619719Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:55.619723Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:55.619746Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602841515372090:12304]
2025-10-10T14:39:55.619759Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:55.619764Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:55.619769Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3145
2025-10-10T14:39:55.619811Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3145
2025-10-10T14:39:55.619834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:55.619857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:55.619894Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ec77a503-dd9f017e-43d846ed-e10cc4bf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:55.619903Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:55.619907Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:55.619909Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:55.619921Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:55.619933Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:55.619950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:55.620194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:55.620205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:55.620225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:55.620364Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3146 partition: 0 MaxSeqNo: 40 sessionId: src_id|ec77a503-dd9f017e-43d846ed-e10cc4bf_0
2025-10-10T14:39:55.620816Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ef88015-4b51e4b1-943a4909-a29f9ed6_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|ec77a503-dd9f017e-43d846ed-e10cc4bf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:55.623577Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ec77a503-dd9f017e-43d846ed-e10cc4bf_0] Write session: try to update token
2025-10-10T14:39:55.623594Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ec77a503-dd9f017e-43d846ed-e10cc4bf_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:55.639247Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:55.639269Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:55.639273Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:55.639275Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:55.639286Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602841515372090:12304]
2025-10-10T14:39:55.639291Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602841515372090:12304]
2025-10-10T14:39:55.639297Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602841515372090:12304]
2025-10-10T14:39:55.639350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:55.639359Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:55.639363Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:55.639366Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:55.639377Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:55.639390Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:55.639507Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:55.638658Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3146 sessionId: src_id|ec77a503-dd9f017e-43d846ed-e10cc4bf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:55.641437Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:55.686603Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602842297620940:4596]
2025-10-10T14:39:55.686967Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 pipe creation result: OK TabletId: 72075186224037892 Generation: 3145, pipe: [1:7559602842297620940:4596]
2025-10-10T14:39:55.759484Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:55.759813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:55.759833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:55.759885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602842297620940:4596], now have 1 active actors on pipe
2025-10-10T14:39:55.760261Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:55.760280Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:55.760349Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3146 reason: error at write: Disconnected sessionId: src_id|ec77a503-dd9f017e-43d846ed-e10cc4bf_0
2025-10-10T14:39:55.760595Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 44 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602842297620940:4596]
2025-10-10T14:39:55.760623Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:55.760628Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3146 sessionId: src_id|ec77a503-dd9f017e-43d846ed-e10cc4bf_0 is DEAD
2025-10-10T14:39:55.760285Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:55.761055Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec77a503-dd9f017e-43d846ed-e10cc4bf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:55.761067Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec77a503-dd9f017e-43d846ed-e10cc4bf_0] Write session will restart in 0.009511s
2025-10-10T14:39:55.761095Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec77a503-dd9f017e-43d846ed-e10cc4bf_0] Write session: Do CDS request
2025-10-10T14:39:55.761101Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec77a503-dd9f017e-43d846ed-e10cc4bf_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:55.771982Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ec77a503-dd9f017e-43d846ed-e10cc4bf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:55.772093Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:55.772110Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3147
2025-10-10T14:39:55.772241Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3147 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:55.772272Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3147 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:55.772278Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3147 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:55.772282Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:55.772831Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3147 sessionId:  describe result for acl check
2025-10-10T14:39:55.772873Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:55.772880Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:55.772882Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:55.772889Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602842297620974:3906] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:55.773519Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602842297620974:3906] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:55.776181Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602842297620974:3906] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:55.781426Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602842297620974:3906] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:55.781444Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602842297620974:3906] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:55.781448Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602842297620974:3906] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:55.781457Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3147 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:55.799644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:55.805715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:55.806025Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:55.806040Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:55.806054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:55.806118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:55.806170Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602841515372345:12307]
2025-10-10T14:39:55.806767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:55.807235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:55.807291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:55.807631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:55.807701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:55.807711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:55.807712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:55.807713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:55.807715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:55.807716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:55.807717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:55.807719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:55.807720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:55.807721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:55.807723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:55.807724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:55.807725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:55.807731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:55.807744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:55.807747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:55.807751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:55.807755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:55.807759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:55.807763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:55.807767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:55.807771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:55.807774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:55.807778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:55.807781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:55.807785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:55.807804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:55.807814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:55.807821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:55.807826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:55.807832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:55.807837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:55.807840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:55.807848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:55.807852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:55.807857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:55.807862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:55.807866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:55.807870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:55.807875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:55.807879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:55.807884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:55.807889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:55.807893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:55.807897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:55.807902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:55.807906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:55.807920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:55.807924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:55.807928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:55.807932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:55.807937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:55.807972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:55.811459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:55.812197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:55.812203Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:55.812206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:55.812210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:55.812218Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3146 [2:7559602841515372345:12307]
2025-10-10T14:39:55.812236Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:55.812260Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:55.812264Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:55.812268Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:55.812270Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:55.812292Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:55.812300Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:55.812330Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:55.812408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:55.812410Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:55.812412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:55.812414Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:55.812495Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:55.812498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:55.812509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:55.812518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:55.812533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:55.812555Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602841515372340:12307]
2025-10-10T14:39:55.812557Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602841515372340:12307]
2025-10-10T14:39:55.812561Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602841515372340:12307]
2025-10-10T14:39:55.812593Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:55.812610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602842297621050:3906], now have 1 active actors on pipe
2025-10-10T14:39:55.812613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602842297620941:2438], now have 1 active actors on pipe
2025-10-10T14:39:55.812622Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:55.812637Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:55.812640Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:55.812686Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602841515372340:12307]
2025-10-10T14:39:55.812689Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:55.812738Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:55.812743Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:55.812745Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:55.812753Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:55.816322Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3146
2025-10-10T14:39:55.816364Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3146
2025-10-10T14:39:55.816868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:55.816888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:55.816934Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|430e44d8-7f95dfd7-65dde3d0-2480d302_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:55.816948Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:55.816954Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:55.816957Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:55.816974Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:55.816995Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:55.817029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:55.817284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:55.817288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:55.817305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:55.818051Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec77a503-dd9f017e-43d846ed-e10cc4bf_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|430e44d8-7f95dfd7-65dde3d0-2480d302_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:55.820986Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|430e44d8-7f95dfd7-65dde3d0-2480d302_0] Write session: try to update token
2025-10-10T14:39:55.821012Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|430e44d8-7f95dfd7-65dde3d0-2480d302_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:55.817571Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3147 partition: 0 MaxSeqNo: 40 sessionId: src_id|430e44d8-7f95dfd7-65dde3d0-2480d302_0
2025-10-10T14:39:55.833359Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:39:55.833375Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:55.833385Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602841515372340:12307]
2025-10-10T14:39:55.833414Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:39:55.833428Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:39:55.833599Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:39:55.833738Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:55.833876Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:55.834003Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:55.834202Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:39:55.834232Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:39:55.846071Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3147 sessionId: src_id|430e44d8-7f95dfd7-65dde3d0-2480d302_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:55.848633Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:55.849449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:55.849474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:55.849522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:39:55.849652Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:39:55.859254Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:55.859277Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:55.859280Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:55.859282Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:55.859294Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602841515372340:12307]
2025-10-10T14:39:55.859298Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602841515372340:12307]
2025-10-10T14:39:55.859302Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602841515372340:12307]
2025-10-10T14:39:55.859348Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:55.859351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:55.859361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:55.859363Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:55.859365Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:55.859370Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:55.859503Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:55.859637Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602842297621264:4596]
2025-10-10T14:39:55.859952Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 pipe creation result: OK TabletId: 72075186224037892 Generation: 3146, pipe: [1:7559602842297621264:4596]
2025-10-10T14:39:55.977466Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:55.977995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602842297621264:4596], now have 1 active actors on pipe
2025-10-10T14:39:55.986308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:55.986343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:55.986543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:55.986613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:55.986694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:55.986781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:55.986841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:55.986853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:55.986941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:55.987018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:55.987102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:55.987185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:55.987241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:55.987255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:55.987341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:55.987426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:55.987511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:55.987597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:55.987651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:55.987661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:55.987742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:55.987830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:55.987914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:55.987999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:55.988057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:55.988065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:55.988146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:55.988223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:55.988312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:55.988393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:55.988450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:55.988458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:55.988536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:55.988631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:55.988718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:55.988801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:55.988857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:55.988871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:55.988962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:55.989043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:55.989126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:55.989210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:55.989263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:55.989271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:55.989368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:55.989434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:55.989516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:55.989600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:55.989652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:55.989666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:55.989744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:55.989812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:55.989885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:55.989958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:55.990008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:55.990017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:55.990089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:55.990156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:55.990231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:55.990305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:55.990357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:55.990366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:55.990695Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 45 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602842297621264:4596]
2025-10-10T14:39:55.990704Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:55.990747Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:55.990758Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:55.990796Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3147 reason: error at write: Disconnected sessionId: src_id|430e44d8-7f95dfd7-65dde3d0-2480d302_0
2025-10-10T14:39:55.991034Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3147 sessionId: src_id|430e44d8-7f95dfd7-65dde3d0-2480d302_0 is DEAD
2025-10-10T14:39:55.991293Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|430e44d8-7f95dfd7-65dde3d0-2480d302_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:55.991305Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|430e44d8-7f95dfd7-65dde3d0-2480d302_0] Write session will restart in 0.005523s
2025-10-10T14:39:55.991333Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|430e44d8-7f95dfd7-65dde3d0-2480d302_0] Write session: Do CDS request
2025-10-10T14:39:55.991340Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|430e44d8-7f95dfd7-65dde3d0-2480d302_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:55.991790Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:55.997941Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|430e44d8-7f95dfd7-65dde3d0-2480d302_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:55.998009Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:55.998031Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3148
2025-10-10T14:39:55.998200Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3148 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:55.998245Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3148 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:55.998251Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3148 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:55.998258Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:55.998730Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3148 sessionId:  describe result for acl check
2025-10-10T14:39:55.998774Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:55.998776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:55.998778Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:55.998785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602842297621288:3877] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:55.999445Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602842297621288:3877] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:56.003778Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602842297621288:3877] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:56.007695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602842297621288:3877] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:56.007711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602842297621288:3877] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:56.007715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602842297621288:3877] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:56.007724Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3148 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:56.025714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:56.026853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:56.027080Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:56.027092Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:56.027104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:56.027153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:56.027193Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602845810339880:12309]
2025-10-10T14:39:56.027802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:56.028151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:56.028196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:56.028517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:56.028588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:56.028589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:56.028590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:56.028591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:56.028593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:56.028594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:56.028595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:56.028596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:56.028598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:56.028599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:56.028600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:56.028601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:56.028602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:56.028608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:56.028621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:56.028625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:56.028628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:56.028632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:56.028636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:56.028639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:56.028643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:56.028646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:56.028650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:56.028653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:56.028657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:56.028661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:56.028669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:56.028678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:56.028685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:56.028689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:56.028693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:56.028698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:56.028703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:56.028708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:56.028712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:56.028716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:56.028720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:56.028725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:56.028730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:56.028735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:56.028739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:56.028744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:56.028750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:56.028754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:56.028758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:56.028763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:56.028767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:56.028772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:56.028777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:56.028782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:56.028786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:56.028791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:56.028829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:56.031840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:56.032164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:56.032181Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:56.032184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:56.032188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:56.032195Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3147 [2:7559602845810339880:12309]
2025-10-10T14:39:56.032209Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:56.032230Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:56.032238Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:56.032242Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:56.032245Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:56.032265Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:56.032278Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:56.032294Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:56.032366Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:56.032377Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:56.032380Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:56.032383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:56.032459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:56.032468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:56.032481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:56.032495Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:56.032520Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:56.032621Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3147
2025-10-10T14:39:56.032638Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3147
2025-10-10T14:39:56.032545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602842297621273:2438], now have 1 active actors on pipe
2025-10-10T14:39:56.032553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602846592588711:3877], now have 1 active actors on pipe
2025-10-10T14:39:56.032575Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602845810339875:12309]
2025-10-10T14:39:56.032578Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602845810339875:12309]
2025-10-10T14:39:56.032580Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602845810339875:12309]
2025-10-10T14:39:56.032594Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:56.032610Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:56.032613Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:56.032613Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:56.032615Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:56.032644Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:56.032648Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:56.032693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:56.032699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:56.032715Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602845810339875:12309]
2025-10-10T14:39:56.032724Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:56.032731Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:56.032760Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b6dd6b72-a611c514-3810ae4e-47c354ce_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:56.032774Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:56.032778Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:56.032781Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:56.032796Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:56.032808Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:56.032835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:56.033005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:56.033016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:56.033032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:56.033147Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3148 partition: 0 MaxSeqNo: 40 sessionId: src_id|b6dd6b72-a611c514-3810ae4e-47c354ce_0
2025-10-10T14:39:56.033621Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|430e44d8-7f95dfd7-65dde3d0-2480d302_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|b6dd6b72-a611c514-3810ae4e-47c354ce_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:56.036507Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b6dd6b72-a611c514-3810ae4e-47c354ce_0] Write session: try to update token
2025-10-10T14:39:56.036526Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b6dd6b72-a611c514-3810ae4e-47c354ce_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:56.053478Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:56.053497Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:56.053501Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:56.053503Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:56.053513Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602845810339875:12309]
2025-10-10T14:39:56.053517Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602845810339875:12309]
2025-10-10T14:39:56.053521Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602845810339875:12309]
2025-10-10T14:39:56.053573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:56.053582Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:56.053585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:56.053610Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:56.053631Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:56.053639Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:56.053737Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:56.054982Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3148 sessionId: src_id|b6dd6b72-a611c514-3810ae4e-47c354ce_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:56.057912Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:56.091125Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602846592588870:4596]
2025-10-10T14:39:56.093850Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 pipe creation result: OK TabletId: 72075186224037892 Generation: 3147, pipe: [1:7559602846592588870:4596]
2025-10-10T14:39:56.165297Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:56.166044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:56.166064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:56.166114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602846592588870:4596], now have 1 active actors on pipe
2025-10-10T14:39:56.166465Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:56.170023Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6dd6b72-a611c514-3810ae4e-47c354ce_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:39:56.170036Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6dd6b72-a611c514-3810ae4e-47c354ce_0] Write session will restart in 0.008339s
2025-10-10T14:39:56.170072Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6dd6b72-a611c514-3810ae4e-47c354ce_0] Write session: Do CDS request
2025-10-10T14:39:56.170079Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6dd6b72-a611c514-3810ae4e-47c354ce_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:56.169459Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 46 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602846592588870:4596]
2025-10-10T14:39:56.169495Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:56.169549Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:39:56.169635Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3148 reason: status is not ok: tablet will be restarted right now sessionId: src_id|b6dd6b72-a611c514-3810ae4e-47c354ce_0
2025-10-10T14:39:56.169865Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3148 sessionId: src_id|b6dd6b72-a611c514-3810ae4e-47c354ce_0 is DEAD
2025-10-10T14:39:56.179949Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b6dd6b72-a611c514-3810ae4e-47c354ce_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:56.181529Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:56.181547Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3149
2025-10-10T14:39:56.181746Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3149 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:56.181780Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3149 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:56.181786Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3149 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:56.181789Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:56.182220Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3149 sessionId:  describe result for acl check
2025-10-10T14:39:56.182261Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:56.182263Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:56.182265Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:56.182272Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602846592588942:3862] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:56.182811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602846592588942:3862] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:56.186662Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602846592588942:3862] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:56.193952Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602846592588942:3862] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:56.193970Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602846592588942:3862] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:56.193974Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602846592588942:3862] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:56.193984Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3149 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:56.205130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:56.209617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:56.209907Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:56.209914Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:56.209929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:56.209999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:56.210042Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602845810340120:12311]
2025-10-10T14:39:56.210693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:56.211110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:56.211166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:56.211611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:56.211683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:56.211689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:56.211691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:56.211692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:56.211694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:56.211695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:56.211697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:56.211698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:56.211700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:56.211701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:56.211703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:56.211704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:56.211706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:56.211712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:56.211727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:56.211732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:56.211737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:56.211742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:56.211746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:56.211750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:56.211755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:56.211759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:56.211765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:56.211769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:56.211774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:56.211778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:56.211786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:56.211796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:56.211804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:56.211810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:56.211817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:56.211824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:56.211831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:56.211836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:56.211842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:56.211847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:56.211852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:56.211858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:56.211863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:56.211869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:56.211874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:56.211880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:56.211885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:56.211891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:56.211895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:56.211901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:56.211906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:56.211912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:56.211917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:56.211923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:56.211928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:56.211934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:56.211980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:56.214560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:56.215566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:56.215580Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:56.215583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:56.215587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:56.215594Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3148 [2:7559602845810340120:12311]
2025-10-10T14:39:56.215607Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:56.215625Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:56.215628Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:56.215632Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:56.215635Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:56.215652Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:56.215660Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:56.215668Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:56.215730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:56.215737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:56.215740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:56.215742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:56.215809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:56.215817Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:56.215830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:56.215848Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:56.215871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:56.215897Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602845810340115:12311]
2025-10-10T14:39:56.215906Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602845810340115:12311]
2025-10-10T14:39:56.215908Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602845810340115:12311]
2025-10-10T14:39:56.215919Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:56.215933Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:56.215944Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:56.215948Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:56.215950Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:56.215955Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:56.215959Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:56.215970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602846592588874:2438], now have 1 active actors on pipe
2025-10-10T14:39:56.215974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602846592589089:3862], now have 1 active actors on pipe
2025-10-10T14:39:56.215995Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602845810340115:12311]
2025-10-10T14:39:56.216007Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:56.216069Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:56.216431Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3148
2025-10-10T14:39:56.216480Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3148
2025-10-10T14:39:56.216843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:56.216852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:56.216884Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|741a6872-958f6f5f-c2da33ef-5fdcd306_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:56.216898Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:56.216909Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:56.216912Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:56.216926Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:56.216942Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:56.216962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:56.217322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:56.217347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:56.217370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:56.217493Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3149 partition: 0 MaxSeqNo: 40 sessionId: src_id|741a6872-958f6f5f-c2da33ef-5fdcd306_0
2025-10-10T14:39:56.217918Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6dd6b72-a611c514-3810ae4e-47c354ce_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|741a6872-958f6f5f-c2da33ef-5fdcd306_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:56.220522Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|741a6872-958f6f5f-c2da33ef-5fdcd306_0] Write session: try to update token
2025-10-10T14:39:56.220538Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|741a6872-958f6f5f-c2da33ef-5fdcd306_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:56.229473Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:39:56.229494Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:56.229505Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602845810340115:12311]
2025-10-10T14:39:56.229556Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:39:56.229602Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:39:56.229738Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:39:56.229879Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:56.230017Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:56.230159Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:56.230346Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:39:56.230380Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:39:56.245360Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3149 sessionId: src_id|741a6872-958f6f5f-c2da33ef-5fdcd306_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:56.247966Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:56.248458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:56.248479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:56.248518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:39:56.253395Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:39:56.256956Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:56.256974Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:56.256977Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:56.256980Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:56.256990Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602845810340115:12311]
2025-10-10T14:39:56.256995Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602845810340115:12311]
2025-10-10T14:39:56.256999Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602845810340115:12311]
2025-10-10T14:39:56.257049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:56.257062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:56.257064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:56.257195Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:56.257518Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:56.257524Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:56.257528Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:56.268812Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602846592589188:4596]
2025-10-10T14:39:56.272348Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 pipe creation result: OK TabletId: 72075186224037892 Generation: 3148, pipe: [1:7559602846592589188:4596]
2025-10-10T14:39:56.397401Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:56.398398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602846592589188:4596], now have 1 active actors on pipe
2025-10-10T14:39:56.407069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:56.407099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:56.407281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:56.407352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:56.407418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:56.407485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:56.407533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:56.407543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:56.407613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:56.407678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:56.407740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:56.407811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:56.407857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:56.407865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:56.407933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:56.407997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:56.408063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:56.408129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:56.408174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:56.408182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:56.408248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:56.408313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:56.408378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:56.408446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:56.408494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:56.408497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:56.408579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:56.408635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:56.408698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:56.408758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:56.408797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:56.408804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:56.408881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:56.408937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:56.408996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:56.409056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:56.409097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:56.409100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:56.409167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:56.409224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:56.409287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:56.409482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:56.409531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:56.409539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:56.409605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:56.409666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:56.409731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:56.411391Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:56.411446Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 47 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602846592589188:4596]
2025-10-10T14:39:56.411475Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:56.411480Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:56.411510Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3149 reason: error at write: Disconnected sessionId: src_id|741a6872-958f6f5f-c2da33ef-5fdcd306_0
2025-10-10T14:39:56.411722Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3149 sessionId: src_id|741a6872-958f6f5f-c2da33ef-5fdcd306_0 is DEAD
2025-10-10T14:39:56.412165Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|741a6872-958f6f5f-c2da33ef-5fdcd306_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:56.412180Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|741a6872-958f6f5f-c2da33ef-5fdcd306_0] Write session will restart in 0.007857s
2025-10-10T14:39:56.412217Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|741a6872-958f6f5f-c2da33ef-5fdcd306_0] Write session: Do CDS request
2025-10-10T14:39:56.412223Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|741a6872-958f6f5f-c2da33ef-5fdcd306_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:56.409793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:56.409840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:56.409843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:56.409911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:56.409965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:56.410023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:56.410086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:56.410156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:56.410159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:56.410228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:56.410285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:56.410342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:56.410401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:56.410442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:56.410445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:56.411802Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:56.421112Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|741a6872-958f6f5f-c2da33ef-5fdcd306_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:56.421233Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:56.421251Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3150
2025-10-10T14:39:56.421551Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3150 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:56.421613Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3150 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:56.421624Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3150 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:56.421630Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:56.422139Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3150 sessionId:  describe result for acl check
2025-10-10T14:39:56.422173Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:56.422175Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:56.422177Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:56.422183Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602846592589213:2605] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:56.422764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602846592589213:2605] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:56.425371Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602846592589213:2605] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:56.430418Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602846592589213:2605] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:56.430434Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602846592589213:2605] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:56.430437Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602846592589213:2605] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:56.430447Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3150 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:56.463703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:56.473210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:56.473515Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:56.473521Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:56.473533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:56.473599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:56.473638Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602845810340401:12327]
2025-10-10T14:39:56.474260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:56.474822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:56.474864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:56.475214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:56.475264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:56.475265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:56.475267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:56.475268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:56.475270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:56.475272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:56.475273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:56.475274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:56.475276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:56.475277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:56.475279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:56.475280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:56.475281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:56.475288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:56.475302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:56.475307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:56.475312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:56.475316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:56.475321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:56.475325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:56.475330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:56.475351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:56.475356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:56.475361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:56.475365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:56.475370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:56.475379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:56.475389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:56.475396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:56.475403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:56.475408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:56.475414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:56.475420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:56.475427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:56.475433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:56.475439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:56.475444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:56.475450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:56.475455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:56.475461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:56.475466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:56.475472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:56.475479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:56.475485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:56.475490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:56.475496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:56.475501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:56.475507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:56.475512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:56.475518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:56.475523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:56.475529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:56.475574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:56.480666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:56.481016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:56.481021Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:56.481025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:56.481030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:56.481038Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3149 [2:7559602845810340401:12327]
2025-10-10T14:39:56.481055Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:56.481077Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:56.481081Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:56.481085Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:56.481088Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:56.481108Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:56.481116Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:56.481125Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:56.481197Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:56.481200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:56.481203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:56.481206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:56.481286Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:56.481289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:56.481301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:56.481316Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:56.481355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:56.481378Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602845810340396:12327]
2025-10-10T14:39:56.481382Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602845810340396:12327]
2025-10-10T14:39:56.481384Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602845810340396:12327]
2025-10-10T14:39:56.481397Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:56.481414Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:56.481430Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:56.481433Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:56.481476Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602845810340396:12327]
2025-10-10T14:39:56.481479Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:56.482110Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3149
2025-10-10T14:39:56.482153Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3149
2025-10-10T14:39:56.483095Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3150 partition: 0 MaxSeqNo: 40 sessionId: src_id|3c9aee39-ffa0b4df-28e2755c-d013a92a_0
2025-10-10T14:39:56.483546Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|741a6872-958f6f5f-c2da33ef-5fdcd306_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|3c9aee39-ffa0b4df-28e2755c-d013a92a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:56.481680Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:56.481691Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:56.481693Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:56.481700Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:56.482565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602846592589205:2438], now have 1 active actors on pipe
2025-10-10T14:39:56.482571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602846592589250:2605], now have 1 active actors on pipe
2025-10-10T14:39:56.482585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:56.482591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:56.482629Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3c9aee39-ffa0b4df-28e2755c-d013a92a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:56.482640Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:56.482645Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:56.482652Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:56.482667Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:56.482695Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:56.482715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:56.482960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:56.482964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:56.482981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:56.486229Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3c9aee39-ffa0b4df-28e2755c-d013a92a_0] Write session: try to update token
2025-10-10T14:39:56.486248Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3c9aee39-ffa0b4df-28e2755c-d013a92a_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:56.505661Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:56.505691Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:56.505697Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:56.505701Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:56.505720Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602845810340396:12327]
2025-10-10T14:39:56.505729Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602845810340396:12327]
2025-10-10T14:39:56.505735Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602845810340396:12327]
2025-10-10T14:39:56.505800Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:56.505808Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:56.505811Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:56.505972Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:56.509762Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:56.509777Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:56.509782Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:56.514333Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602846592589510:4596]
2025-10-10T14:39:56.516977Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 pipe creation result: OK TabletId: 72075186224037892 Generation: 3149, pipe: [1:7559602846592589510:4596]
2025-10-10T14:39:56.519577Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3150 sessionId: src_id|3c9aee39-ffa0b4df-28e2755c-d013a92a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:56.522356Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:56.634550Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:56.635344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602846592589510:4596], now have 1 active actors on pipe
2025-10-10T14:39:56.635388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:56.635401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:56.635665Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:56.635935Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:56.635981Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:39:56.636010Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 48 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602846592589510:4596]
2025-10-10T14:39:56.636057Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3150 reason: status is not ok: tablet will be restarted right now sessionId: src_id|3c9aee39-ffa0b4df-28e2755c-d013a92a_0
2025-10-10T14:39:56.636443Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c9aee39-ffa0b4df-28e2755c-d013a92a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:39:56.636463Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c9aee39-ffa0b4df-28e2755c-d013a92a_0] Write session will restart in 0.008287s
2025-10-10T14:39:56.636255Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3150 sessionId: src_id|3c9aee39-ffa0b4df-28e2755c-d013a92a_0 is DEAD
2025-10-10T14:39:56.636488Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c9aee39-ffa0b4df-28e2755c-d013a92a_0] Write session: Do CDS request
2025-10-10T14:39:56.636494Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c9aee39-ffa0b4df-28e2755c-d013a92a_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:56.648711Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3c9aee39-ffa0b4df-28e2755c-d013a92a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:56.648751Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:56.648769Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3151
2025-10-10T14:39:56.648921Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3151 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:56.648978Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3151 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:56.648985Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3151 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:56.648990Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:56.649449Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3151 sessionId:  describe result for acl check
2025-10-10T14:39:56.649489Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:56.649491Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:56.649493Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:56.649499Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602846592589618:3815] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:56.650073Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602846592589618:3815] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:56.653650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602846592589618:3815] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:56.656875Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602846592589618:3815] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:56.656891Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602846592589618:3815] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:56.656894Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602846592589618:3815] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:56.656904Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3151 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:56.660136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:56.665719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:56.666015Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:56.666036Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:56.666050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:56.666133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:56.666182Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602845810340642:12329]
2025-10-10T14:39:56.666804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:56.667163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:56.667213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:56.667541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:56.667608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:56.667617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:56.667619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:56.667620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:56.667622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:56.667623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:56.667625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:56.667626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:56.667628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:56.667629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:56.667631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:56.667632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:56.667633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:56.667640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:56.667653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:56.667658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:56.667662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:56.667666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:56.667670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:56.667674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:56.667678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:56.667682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:56.667687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:56.667691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:56.667695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:56.667699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:56.667709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:56.667718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:56.667724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:56.667730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:56.667735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:56.667740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:56.667744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:56.667749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:56.667754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:56.667758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:56.667762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:56.667767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:56.667771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:56.667777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:56.667781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:56.667787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:56.667792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:56.667797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:56.667802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:56.667807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:56.667812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:56.667818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:56.667823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:56.667829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:56.667834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:56.667841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:56.667888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:56.670592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:56.671786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:56.671802Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:56.671805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:56.671810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:56.671818Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3150 [2:7559602845810340642:12329]
2025-10-10T14:39:56.671835Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:56.671858Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:56.671862Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:56.671866Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:56.671869Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:56.671891Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:56.671906Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:56.671915Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:56.671995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:56.672005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:56.672008Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:56.672011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:56.672094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:56.672105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:56.672119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:56.672131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:56.672147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:56.672172Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602845810340637:12329]
2025-10-10T14:39:56.672180Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602845810340637:12329]
2025-10-10T14:39:56.672182Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602845810340637:12329]
2025-10-10T14:39:56.672200Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:56.672213Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:56.672221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602846592589513:2438], now have 1 active actors on pipe
2025-10-10T14:39:56.672225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602846592589800:3815], now have 1 active actors on pipe
2025-10-10T14:39:56.672229Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:56.672231Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:56.672235Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:56.672252Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:56.672260Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:56.672300Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602845810340637:12329]
2025-10-10T14:39:56.672311Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:56.672314Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3150
2025-10-10T14:39:56.672319Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3150
2025-10-10T14:39:56.672320Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:56.672465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:56.672474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:56.672513Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5bc185ee-2afde64-540e3280-a142382e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:56.672523Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:56.672528Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:56.672531Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:56.672568Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:56.672581Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:56.672600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:56.672809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:56.672822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:56.672846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:56.672964Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3151 partition: 0 MaxSeqNo: 40 sessionId: src_id|5bc185ee-2afde64-540e3280-a142382e_0
2025-10-10T14:39:56.673443Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c9aee39-ffa0b4df-28e2755c-d013a92a_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|5bc185ee-2afde64-540e3280-a142382e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:56.676336Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5bc185ee-2afde64-540e3280-a142382e_0] Write session: try to update token
2025-10-10T14:39:56.676355Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5bc185ee-2afde64-540e3280-a142382e_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:56.684531Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:39:56.684550Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:56.684575Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602845810340637:12329]
2025-10-10T14:39:56.684629Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:39:56.684633Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:39:56.684826Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:39:56.684981Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:56.685132Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:56.685281Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:56.685512Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:39:56.685563Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:39:56.698432Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3151 sessionId: src_id|5bc185ee-2afde64-540e3280-a142382e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:56.701108Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:56.701356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:56.701382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:56.701429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:39:56.701512Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:39:56.704766Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:56.704787Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:56.704791Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:56.704793Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:56.704805Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602845810340637:12329]
2025-10-10T14:39:56.704809Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602845810340637:12329]
2025-10-10T14:39:56.704812Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602845810340637:12329]
2025-10-10T14:39:56.704862Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:56.704871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:56.704874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:56.704872Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:56.704879Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:56.704883Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:56.705020Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:56.736232Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602846592589820:4596]
2025-10-10T14:39:56.736646Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 pipe creation result: OK TabletId: 72075186224037892 Generation: 3150, pipe: [1:7559602846592589820:4596]
2025-10-10T14:39:56.821066Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:56.830449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:56.830476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:56.830667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:56.830737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:56.830803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:56.830871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:56.830916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:56.830926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:56.830997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:56.831063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:56.831128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:56.831197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:56.831243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:56.831250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:56.831321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:56.831388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:56.831458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:56.831527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:56.831574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:56.831582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:56.831653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:56.831725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:56.831793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:56.831856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:56.831909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:56.831918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:56.831983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:56.832050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:56.832118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:56.832185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:56.832233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:56.832241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:56.832310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:56.832375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:56.832438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:56.832510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:56.832566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:56.832568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:56.832641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:56.832699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:56.832784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:56.832864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:56.832906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:56.832910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:56.832980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:56.833041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:56.833100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:56.833158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:56.833199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:56.833202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:56.833279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:56.833454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:56.834318Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:56.834390Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 49 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602846592589820:4596]
2025-10-10T14:39:56.834434Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:56.834444Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:56.834479Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3151 reason: error at write: Disconnected sessionId: src_id|5bc185ee-2afde64-540e3280-a142382e_0
2025-10-10T14:39:56.834706Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3151 sessionId: src_id|5bc185ee-2afde64-540e3280-a142382e_0 is DEAD
2025-10-10T14:39:56.834861Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5bc185ee-2afde64-540e3280-a142382e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:56.834873Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5bc185ee-2afde64-540e3280-a142382e_0] Write session will restart in 0.007397s
2025-10-10T14:39:56.834907Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5bc185ee-2afde64-540e3280-a142382e_0] Write session: Do CDS request
2025-10-10T14:39:56.834913Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5bc185ee-2afde64-540e3280-a142382e_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:56.833523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:56.833592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:56.833633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:56.833636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:56.833705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:56.833762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:56.833851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:56.833931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:56.833971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:56.833974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:56.834039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602846592589820:4596], now have 1 active actors on pipe
2025-10-10T14:39:56.835331Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:56.846087Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5bc185ee-2afde64-540e3280-a142382e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:56.846231Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:56.846247Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3152
2025-10-10T14:39:56.846546Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3152 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:56.846580Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3152 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:56.846586Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3152 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:56.846590Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:56.847070Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3152 sessionId:  describe result for acl check
2025-10-10T14:39:56.847100Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:56.847101Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:56.847103Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:56.847120Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602846592589935:3810] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:56.847665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602846592589935:3810] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:56.854141Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602846592589935:3810] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:56.857351Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602846592589935:3810] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:56.857371Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602846592589935:3810] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:56.857375Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602846592589935:3810] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:56.857386Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3152 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:56.865469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:56.866295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:56.866530Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:56.866547Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:56.866563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:56.866652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:56.866706Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602845810340896:12332]
2025-10-10T14:39:56.867389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:56.867762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:56.867830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:56.868192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:56.868275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:56.868287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:56.868288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:56.868290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:56.868291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:56.868293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:56.868294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:56.868295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:56.868297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:56.868298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:56.868300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:56.868301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:56.868302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:56.868309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:56.868323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:56.868328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:56.868333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:56.868337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:56.868342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:56.868347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:56.868351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:56.868356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:56.868361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:56.868365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:56.868368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:56.868373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:56.868384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:56.868393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:56.868401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:56.868407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:56.868416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:56.868421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:56.868426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:56.868431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:56.868437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:56.868443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:56.868448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:56.868453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:56.868458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:56.868464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:56.868469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:56.868474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:56.868482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:56.868488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:56.868492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:56.868498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:56.868502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:56.868508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:56.868513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:56.868518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:56.868523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:56.868529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:56.868588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:56.871322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:56.871719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:56.871735Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:56.871738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:56.871743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:56.871751Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3151 [2:7559602845810340896:12332]
2025-10-10T14:39:56.871766Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:56.871788Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:56.871797Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:56.871801Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:56.871803Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:56.871823Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:56.871837Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:56.871848Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:56.871919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:56.871928Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:56.871930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:56.871934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:56.872015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:56.872027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:56.872040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:56.872052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:56.872071Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:56.872103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602846592590139:3810], now have 1 active actors on pipe
2025-10-10T14:39:56.872112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602846592589824:2438], now have 1 active actors on pipe
2025-10-10T14:39:56.872120Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602845810340891:12332]
2025-10-10T14:39:56.872123Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602845810340891:12332]
2025-10-10T14:39:56.872125Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602845810340891:12332]
2025-10-10T14:39:56.872143Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:56.872163Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:56.872174Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:56.872178Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:56.872179Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:56.872184Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:56.872190Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:56.872222Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602845810340891:12332]
2025-10-10T14:39:56.872159Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3151
2025-10-10T14:39:56.872238Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:56.872206Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3151
2025-10-10T14:39:56.872243Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:56.872404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:56.872415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:56.872453Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c4353b52-391001f1-8ae5ada7-9c587ff3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:56.872469Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:56.872479Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:56.872482Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:56.872506Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:56.872523Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:56.872544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:56.872758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:56.872769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:56.872789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:56.873441Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5bc185ee-2afde64-540e3280-a142382e_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|c4353b52-391001f1-8ae5ada7-9c587ff3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:56.872954Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3152 partition: 0 MaxSeqNo: 40 sessionId: src_id|c4353b52-391001f1-8ae5ada7-9c587ff3_0
2025-10-10T14:39:56.876307Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c4353b52-391001f1-8ae5ada7-9c587ff3_0] Write session: try to update token
2025-10-10T14:39:56.876325Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c4353b52-391001f1-8ae5ada7-9c587ff3_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:56.893411Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:56.893431Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:56.893435Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:56.893438Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:56.893452Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602845810340891:12332]
2025-10-10T14:39:56.893458Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602845810340891:12332]
2025-10-10T14:39:56.893462Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602845810340891:12332]
2025-10-10T14:39:56.893510Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:56.893517Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:56.893518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:56.893521Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:56.893527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:56.893530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:56.893681Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:56.901377Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3152 sessionId: src_id|c4353b52-391001f1-8ae5ada7-9c587ff3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:56.904280Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:56.934354Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602846592590160:4596]
2025-10-10T14:39:56.934657Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 pipe creation result: OK TabletId: 72075186224037892 Generation: 3151, pipe: [1:7559602846592590160:4596]
2025-10-10T14:39:57.017028Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:57.017662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:57.017679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:57.017706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602846592590160:4596], now have 1 active actors on pipe
2025-10-10T14:39:57.017943Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:57.018353Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:39:57.018423Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:57.018432Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3152 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c4353b52-391001f1-8ae5ada7-9c587ff3_0
2025-10-10T14:39:57.018473Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 50 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602846592590160:4596]
2025-10-10T14:39:57.018646Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3152 sessionId: src_id|c4353b52-391001f1-8ae5ada7-9c587ff3_0 is DEAD
2025-10-10T14:39:57.021566Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4353b52-391001f1-8ae5ada7-9c587ff3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:39:57.021582Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4353b52-391001f1-8ae5ada7-9c587ff3_0] Write session will restart in 0.007791s
2025-10-10T14:39:57.021609Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4353b52-391001f1-8ae5ada7-9c587ff3_0] Write session: Do CDS request
2025-10-10T14:39:57.021616Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4353b52-391001f1-8ae5ada7-9c587ff3_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:57.030976Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c4353b52-391001f1-8ae5ada7-9c587ff3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:57.031195Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:57.031213Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3153
2025-10-10T14:39:57.031396Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3153 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:57.031456Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3153 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:57.031467Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3153 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:57.031472Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:57.032052Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3153 sessionId:  describe result for acl check
2025-10-10T14:39:57.032091Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:57.032099Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:57.032102Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:57.032110Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602850887557475:3788] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:57.032760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602850887557475:3788] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:57.038372Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602850887557475:3788] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:57.044082Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602850887557475:3788] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:57.044105Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602850887557475:3788] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:57.044109Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602850887557475:3788] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:57.044120Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3153 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:57.057809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:57.067085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:57.067362Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:57.067375Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:57.067393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:57.067455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:57.068159Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602850105308436:12334]
2025-10-10T14:39:57.068769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:57.069196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:57.069246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:57.069591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:57.069670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:57.069676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:57.069678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:57.069679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:57.069680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:57.069681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:57.069683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:57.069684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:57.069686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:57.069687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:57.069688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:57.069689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:57.069690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:57.069696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:57.069710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:57.069714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:57.069718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:57.069721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:57.069724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:57.069728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:57.069733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:57.069737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:57.069740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:57.069744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:57.069748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:57.069752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:57.069762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:57.069771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:57.069778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:57.069783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:57.069788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:57.069793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:57.069798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:57.069803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:57.069808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:57.069813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:57.069817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:57.069824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:57.069829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:57.069833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:57.069837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:57.069842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:57.069849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:57.069854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:57.069860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:57.069874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:57.069879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:57.069883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:57.069888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:57.069892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:57.069896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:57.069901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:57.069938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:57.072795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:57.073129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:57.073140Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:57.073143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:57.073147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:57.073154Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3152 [2:7559602850105308436:12334]
2025-10-10T14:39:57.073169Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:57.073194Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:57.073201Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:57.073205Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:57.073208Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:57.073226Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:57.073239Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:57.073252Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:57.073316Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:57.073323Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:57.073325Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:57.073345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:57.073427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:57.073435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:57.073447Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:57.073458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:57.073478Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:57.073504Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602850105308429:12334]
2025-10-10T14:39:57.073511Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602850105308429:12334]
2025-10-10T14:39:57.073513Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602850105308429:12334]
2025-10-10T14:39:57.073528Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:57.073546Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:57.073566Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:57.073573Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:57.073602Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:57.073606Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602850105308429:12334]
2025-10-10T14:39:57.073609Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:57.073613Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:57.073615Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:57.073623Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:57.073893Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3152
2025-10-10T14:39:57.073929Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3152
2025-10-10T14:39:57.074057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602850887557637:3788], now have 1 active actors on pipe
2025-10-10T14:39:57.074067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602850887557458:2438], now have 1 active actors on pipe
2025-10-10T14:39:57.074080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:57.074085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:57.074119Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ec035cba-b413d139-82e5c69e-5ebaa20c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:57.074134Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:57.074139Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:57.074141Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:57.074155Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:57.074168Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:57.074184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:57.074447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:57.074455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:57.074470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:57.074600Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3153 partition: 0 MaxSeqNo: 40 sessionId: src_id|ec035cba-b413d139-82e5c69e-5ebaa20c_0
2025-10-10T14:39:57.075087Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4353b52-391001f1-8ae5ada7-9c587ff3_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|ec035cba-b413d139-82e5c69e-5ebaa20c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:57.077774Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ec035cba-b413d139-82e5c69e-5ebaa20c_0] Write session: try to update token
2025-10-10T14:39:57.077795Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ec035cba-b413d139-82e5c69e-5ebaa20c_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:57.092650Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:39:57.092669Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:57.092682Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602850105308429:12334]
2025-10-10T14:39:57.092734Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:39:57.092918Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:39:57.093066Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:57.093203Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:57.093366Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:57.093563Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:39:57.093616Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:39:57.093694Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:39:57.102009Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3153 sessionId: src_id|ec035cba-b413d139-82e5c69e-5ebaa20c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:57.104876Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:57.105271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:57.105291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:57.105352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:39:57.105536Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:39:57.119012Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:57.119029Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:57.119033Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:57.119035Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:57.119046Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602850105308429:12334]
2025-10-10T14:39:57.119050Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602850105308429:12334]
2025-10-10T14:39:57.119055Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602850105308429:12334]
2025-10-10T14:39:57.119103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:57.119110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:57.119113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:57.119248Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:57.121532Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602850887557767:4596]
2025-10-10T14:39:57.121749Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:57.121760Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:57.121764Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:57.122062Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 pipe creation result: OK TabletId: 72075186224037892 Generation: 3152, pipe: [1:7559602850887557767:4596]
2025-10-10T14:39:57.251149Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:57.251816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602850887557767:4596], now have 1 active actors on pipe
2025-10-10T14:39:57.259670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:57.259698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:57.259874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:57.259936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:57.260002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:57.260067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:57.260721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:57.260733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:57.260806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:57.260867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:57.260930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:57.260996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:57.261069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:57.261079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:57.261149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:57.261210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:57.261279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:57.261376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:57.261423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:57.261430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:57.261500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:57.261567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:57.261632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:57.261696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:57.261742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:57.261749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:57.261815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:57.261875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:57.261938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:57.262005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:57.262049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:57.262056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:57.262125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:57.262190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:57.262258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:57.262320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:57.262365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:57.262374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:57.262447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:57.262507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:57.262576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:57.262640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:57.262685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:57.262695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:57.262761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:57.262824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:57.262888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:57.262950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:57.262995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:57.263003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:57.263075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:57.263137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:57.263198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:57.263262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:57.263309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:57.263316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:57.263386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:57.263450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:57.263516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:57.263583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:57.263630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:57.263637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:57.263914Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:57.263917Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:57.263922Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:57.263956Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3153 reason: error at write: Disconnected sessionId: src_id|ec035cba-b413d139-82e5c69e-5ebaa20c_0
2025-10-10T14:39:57.263984Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 51 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602850887557767:4596]
2025-10-10T14:39:57.264250Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3153 sessionId: src_id|ec035cba-b413d139-82e5c69e-5ebaa20c_0 is DEAD
2025-10-10T14:39:57.264378Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec035cba-b413d139-82e5c69e-5ebaa20c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:57.264388Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec035cba-b413d139-82e5c69e-5ebaa20c_0] Write session will restart in 0.008646s
2025-10-10T14:39:57.264425Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec035cba-b413d139-82e5c69e-5ebaa20c_0] Write session: Do CDS request
2025-10-10T14:39:57.264432Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec035cba-b413d139-82e5c69e-5ebaa20c_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:57.264320Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:57.273954Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ec035cba-b413d139-82e5c69e-5ebaa20c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:57.274048Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:57.274066Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3154
2025-10-10T14:39:57.274206Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3154 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:57.274257Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3154 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:57.274271Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3154 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:57.274275Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:57.275212Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3154 sessionId:  describe result for acl check
2025-10-10T14:39:57.275253Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:57.275260Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:57.275262Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:57.275269Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602850887557803:3780] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:57.275890Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602850887557803:3780] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:57.279086Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602850887557803:3780] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:57.282999Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602850887557803:3780] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:57.283019Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602850887557803:3780] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:57.283023Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602850887557803:3780] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:57.283032Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3154 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:57.296537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:57.297208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:57.297429Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:57.297435Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:57.297448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:57.297501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:57.297978Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602850105308695:12336]
2025-10-10T14:39:57.298643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:57.299198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:57.299268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:57.299624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:57.299680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:57.299686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:57.299688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:57.299689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:57.299691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:57.299692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:57.299693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:57.299695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:57.299696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:57.299698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:57.299699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:57.299701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:57.299702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:57.299709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:57.299722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:57.299731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:57.299736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:57.299740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:57.299745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:57.299749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:57.299754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:57.299758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:57.299763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:57.299768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:57.299771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:57.299776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:57.299784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:57.299793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:57.299800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:57.299808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:57.299819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:57.299826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:57.299830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:57.299836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:57.299841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:57.299847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:57.299852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:57.299858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:57.299863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:57.299869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:57.299873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:57.299879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:57.299884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:57.299890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:57.299896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:57.299906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:57.299912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:57.299917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:57.299922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:57.299927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:57.299932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:57.299937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:57.299982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:57.302971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:57.303293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:57.303303Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:57.303305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:57.303309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:57.303315Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3153 [2:7559602850105308695:12336]
2025-10-10T14:39:57.303328Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:57.303345Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:57.303348Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:57.303352Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:57.303354Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:57.303371Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:57.303379Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:57.303387Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:57.303449Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:57.303458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:57.303463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:57.303466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:57.303694Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3153
2025-10-10T14:39:57.303747Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3153
2025-10-10T14:39:57.303766Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:57.303775Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:57.303789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:57.303819Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:57.303844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:57.303874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602850887557770:2438], now have 1 active actors on pipe
2025-10-10T14:39:57.303880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602850887557976:3780], now have 1 active actors on pipe
2025-10-10T14:39:57.303888Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602850105308690:12336]
2025-10-10T14:39:57.303890Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602850105308690:12336]
2025-10-10T14:39:57.303892Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602850105308690:12336]
2025-10-10T14:39:57.303901Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:57.303915Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:57.303930Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:57.303935Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:57.303937Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:57.303939Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:57.303943Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:57.303977Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602850105308690:12336]
2025-10-10T14:39:57.303986Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:57.303994Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:57.304001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:57.304006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:57.304059Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|40aa6250-a4ff16a5-ab489d6-9cf15e24_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:57.304071Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:57.304075Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:57.304078Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:57.304088Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:57.304100Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:57.304119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:57.304570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:57.304578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:57.304594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:57.304799Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3154 partition: 0 MaxSeqNo: 40 sessionId: src_id|40aa6250-a4ff16a5-ab489d6-9cf15e24_0
2025-10-10T14:39:57.305613Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec035cba-b413d139-82e5c69e-5ebaa20c_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|40aa6250-a4ff16a5-ab489d6-9cf15e24_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:57.308360Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|40aa6250-a4ff16a5-ab489d6-9cf15e24_0] Write session: try to update token
2025-10-10T14:39:57.308379Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|40aa6250-a4ff16a5-ab489d6-9cf15e24_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:57.330827Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:57.330847Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:57.330851Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:57.330857Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:57.330867Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602850105308690:12336]
2025-10-10T14:39:57.330872Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602850105308690:12336]
2025-10-10T14:39:57.330875Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602850105308690:12336]
2025-10-10T14:39:57.330929Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:57.330942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:57.330945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:57.330999Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:57.331010Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:57.331024Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:57.331079Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:57.342205Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3154 sessionId: src_id|40aa6250-a4ff16a5-ab489d6-9cf15e24_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:57.345015Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:57.363911Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602850887558104:4596]
2025-10-10T14:39:57.364323Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 pipe creation result: OK TabletId: 72075186224037892 Generation: 3153, pipe: [1:7559602850887558104:4596]
2025-10-10T14:39:57.455851Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:57.456330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:57.456348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:57.456376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602850887558104:4596], now have 1 active actors on pipe
2025-10-10T14:39:57.456694Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:57.457275Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40aa6250-a4ff16a5-ab489d6-9cf15e24_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:57.457289Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40aa6250-a4ff16a5-ab489d6-9cf15e24_0] Write session will restart in 0.005153s
2025-10-10T14:39:57.457314Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40aa6250-a4ff16a5-ab489d6-9cf15e24_0] Write session: Do CDS request
2025-10-10T14:39:57.457321Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40aa6250-a4ff16a5-ab489d6-9cf15e24_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:57.456705Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:57.456774Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 52 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602850887558104:4596]
2025-10-10T14:39:57.456797Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:57.456800Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:57.456879Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3154 reason: error at write: Disconnected sessionId: src_id|40aa6250-a4ff16a5-ab489d6-9cf15e24_0
2025-10-10T14:39:57.457106Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3154 sessionId: src_id|40aa6250-a4ff16a5-ab489d6-9cf15e24_0 is DEAD
2025-10-10T14:39:57.465574Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|40aa6250-a4ff16a5-ab489d6-9cf15e24_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:57.465654Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:57.465686Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3155
2025-10-10T14:39:57.465993Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3155 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:57.466038Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3155 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:57.466051Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3155 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:57.466055Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:57.466502Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3155 sessionId:  describe result for acl check
2025-10-10T14:39:57.466532Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:57.466533Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:57.466535Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:57.466542Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602850887558121:3731] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:57.467172Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602850887558121:3731] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:57.473526Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602850887558121:3731] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:57.476362Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602850887558121:3731] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:57.476380Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602850887558121:3731] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:57.476384Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602850887558121:3731] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:57.476394Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3155 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:57.495642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:57.502090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:57.502888Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:57.502908Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:57.502927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:57.503017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:57.503066Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602850105308966:12352]
2025-10-10T14:39:57.503914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:57.504319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:57.504377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:57.504764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:57.504836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:57.504838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:57.504839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:57.504841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:57.504842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:57.504844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:57.504845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:57.504847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:57.504848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:57.504849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:57.504850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:57.504852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:57.504853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:57.504861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:57.504875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:57.504879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:57.504884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:57.504889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:57.504894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:57.504898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:57.504903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:57.504907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:57.504913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:57.504917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:57.504922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:57.504926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:57.504935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:57.504947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:57.504955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:57.504962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:57.504968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:57.504974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:57.504979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:57.504986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:57.504991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:57.504998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:57.505002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:57.505008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:57.505013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:57.505018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:57.505023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:57.505029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:57.505034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:57.505041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:57.505046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:57.505053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:57.505059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:57.505064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:57.505070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:57.505075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:57.505080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:57.505085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:57.505129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:57.513741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:57.514102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:57.514108Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:57.514111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:57.514116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:57.514124Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3154 [2:7559602850105308966:12352]
2025-10-10T14:39:57.514141Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:57.514164Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:57.514169Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:57.514173Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:57.514176Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:57.514197Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:57.514205Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:57.514217Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:57.514293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:57.514296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:57.514298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:57.514301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:57.514386Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:57.514390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:57.514402Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:57.514416Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:57.514435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:57.514459Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602850105308961:12352]
2025-10-10T14:39:57.514463Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602850105308961:12352]
2025-10-10T14:39:57.514465Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602850105308961:12352]
2025-10-10T14:39:57.514483Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:57.514499Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:57.514517Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:57.514521Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:57.514565Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602850105308961:12352]
2025-10-10T14:39:57.514569Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:57.514841Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:57.514858Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:57.514860Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:57.514869Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:57.515222Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3154
2025-10-10T14:39:57.515248Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3154
2025-10-10T14:39:57.515177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602850887558251:3731], now have 1 active actors on pipe
2025-10-10T14:39:57.515217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602850887558106:2438], now have 1 active actors on pipe
2025-10-10T14:39:57.515361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:57.515373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:57.515412Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|594deb9f-55fe03b4-22d0ac2b-a73a9ae5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:57.515439Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:57.515448Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:57.515451Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:57.515464Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:57.515492Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:57.515519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:57.515814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:57.515821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:57.515839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:57.515940Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3155 partition: 0 MaxSeqNo: 40 sessionId: src_id|594deb9f-55fe03b4-22d0ac2b-a73a9ae5_0
2025-10-10T14:39:57.516466Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40aa6250-a4ff16a5-ab489d6-9cf15e24_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|594deb9f-55fe03b4-22d0ac2b-a73a9ae5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:57.519704Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|594deb9f-55fe03b4-22d0ac2b-a73a9ae5_0] Write session: try to update token
2025-10-10T14:39:57.519726Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|594deb9f-55fe03b4-22d0ac2b-a73a9ae5_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:57.542203Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:57.542224Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:57.542228Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:57.542231Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:57.542242Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602850105308961:12352]
2025-10-10T14:39:57.542249Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602850105308961:12352]
2025-10-10T14:39:57.542254Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602850105308961:12352]
2025-10-10T14:39:57.542313Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:57.542321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:57.542324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:57.542479Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:57.545448Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:57.545467Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:57.545473Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:57.543670Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3155 sessionId: src_id|594deb9f-55fe03b4-22d0ac2b-a73a9ae5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:57.546512Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:57.556436Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602850887558417:4596]
2025-10-10T14:39:57.556780Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 pipe creation result: OK TabletId: 72075186224037892 Generation: 3154, pipe: [1:7559602850887558417:4596]
2025-10-10T14:39:57.661562Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:57.662192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:57.662213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:57.662263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602850887558417:4596], now have 1 active actors on pipe
2025-10-10T14:39:57.662581Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:57.662596Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:39:57.662659Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 53 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602850887558417:4596]
2025-10-10T14:39:57.662691Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3155 reason: status is not ok: tablet will be restarted right now sessionId: src_id|594deb9f-55fe03b4-22d0ac2b-a73a9ae5_0
2025-10-10T14:39:57.662503Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:57.663004Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3155 sessionId: src_id|594deb9f-55fe03b4-22d0ac2b-a73a9ae5_0 is DEAD
2025-10-10T14:39:57.663178Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|594deb9f-55fe03b4-22d0ac2b-a73a9ae5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:39:57.663192Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|594deb9f-55fe03b4-22d0ac2b-a73a9ae5_0] Write session will restart in 0.009033s
2025-10-10T14:39:57.663222Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|594deb9f-55fe03b4-22d0ac2b-a73a9ae5_0] Write session: Do CDS request
2025-10-10T14:39:57.663230Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|594deb9f-55fe03b4-22d0ac2b-a73a9ae5_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:57.673951Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|594deb9f-55fe03b4-22d0ac2b-a73a9ae5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:57.674046Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:57.674066Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3156
2025-10-10T14:39:57.674230Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3156 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:57.674270Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3156 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:57.674276Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3156 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:57.674281Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:57.675013Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3156 sessionId:  describe result for acl check
2025-10-10T14:39:57.675051Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:57.675059Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:57.675061Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:57.675073Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602850887558507:3725] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:57.675657Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602850887558507:3725] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:57.678549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602850887558507:3725] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:57.682189Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602850887558507:3725] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:57.682214Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602850887558507:3725] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:57.682218Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602850887558507:3725] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:57.682229Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3156 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:57.690792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:57.697288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:57.697593Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:57.697605Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:57.697620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:57.697681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:57.697727Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602850105309226:12354]
2025-10-10T14:39:57.698319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:57.698669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:57.698722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:57.699034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:57.699103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:57.699109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:57.699111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:57.699112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:57.699114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:57.699115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:57.699116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:57.699118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:57.699119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:57.699120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:57.699122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:57.699123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:57.699124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:57.699131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:57.699144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:57.699148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:57.699152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:57.699156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:57.699160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:57.699164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:57.699168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:57.699172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:57.699176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:57.699181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:57.699185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:57.699189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:57.699198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:57.699206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:57.699213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:57.699219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:57.699224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:57.699229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:57.699233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:57.699239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:57.699243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:57.699249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:57.699253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:57.699258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:57.699266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:57.699271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:57.699276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:57.699281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:57.699285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:57.699290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:57.699300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:57.699305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:57.699310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:57.699320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:57.699324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:57.699330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:57.699339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:57.699343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:57.699380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:57.702077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:57.702449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:57.702460Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:57.702462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:57.702467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:57.702475Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3155 [2:7559602850105309226:12354]
2025-10-10T14:39:57.702489Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:57.702508Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:57.702517Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:57.702520Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:57.702523Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:57.702542Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:57.702554Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:57.702563Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:57.702642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:57.702649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:57.702651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:57.702653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:57.702724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:57.702732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:57.702744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:57.702760Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:57.702782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:57.702808Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602850105309221:12354]
2025-10-10T14:39:57.702815Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602850105309221:12354]
2025-10-10T14:39:57.702818Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602850105309221:12354]
2025-10-10T14:39:57.702830Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:57.702850Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:57.702852Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:57.702856Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:57.702859Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:57.702868Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:57.702871Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:57.702884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602850887558419:2438], now have 1 active actors on pipe
2025-10-10T14:39:57.702888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602850887558701:3725], now have 1 active actors on pipe
2025-10-10T14:39:57.702920Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602850105309221:12354]
2025-10-10T14:39:57.702927Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:57.702919Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3155
2025-10-10T14:39:57.702922Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3155
2025-10-10T14:39:57.702974Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:57.703131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:57.703141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:57.703176Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1e46d522-81f70698-fbe8acca-2b257bca_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:57.703191Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:57.703195Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:57.703198Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:57.703212Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:57.703224Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:57.703240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:57.703455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:57.703470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:57.703502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:57.703923Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3156 partition: 0 MaxSeqNo: 40 sessionId: src_id|1e46d522-81f70698-fbe8acca-2b257bca_0
2025-10-10T14:39:57.704405Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|594deb9f-55fe03b4-22d0ac2b-a73a9ae5_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|1e46d522-81f70698-fbe8acca-2b257bca_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:57.707288Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1e46d522-81f70698-fbe8acca-2b257bca_0] Write session: try to update token
2025-10-10T14:39:57.707309Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1e46d522-81f70698-fbe8acca-2b257bca_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:57.723269Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:57.723285Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:57.723289Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:57.723291Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:57.723302Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602850105309221:12354]
2025-10-10T14:39:57.723307Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602850105309221:12354]
2025-10-10T14:39:57.723311Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602850105309221:12354]
2025-10-10T14:39:57.723364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:57.723369Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:57.723372Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:57.723374Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:57.723376Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:57.723381Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:57.723526Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:57.725481Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3156 sessionId: src_id|1e46d522-81f70698-fbe8acca-2b257bca_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:57.728327Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:57.762786Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602850887558731:4596]
2025-10-10T14:39:57.763149Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 pipe creation result: OK TabletId: 72075186224037892 Generation: 3155, pipe: [1:7559602850887558731:4596]
2025-10-10T14:39:57.847729Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:57.848337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:57.848356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:57.848403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602850887558731:4596], now have 1 active actors on pipe
2025-10-10T14:39:57.848622Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:57.849110Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e46d522-81f70698-fbe8acca-2b257bca_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:57.849122Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e46d522-81f70698-fbe8acca-2b257bca_0] Write session will restart in 0.008791s
2025-10-10T14:39:57.848586Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 54 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602850887558731:4596]
2025-10-10T14:39:57.849159Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e46d522-81f70698-fbe8acca-2b257bca_0] Write session: Do CDS request
2025-10-10T14:39:57.848586Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:57.849168Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e46d522-81f70698-fbe8acca-2b257bca_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:57.848619Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:57.848622Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:57.848693Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3156 reason: error at write: Disconnected sessionId: src_id|1e46d522-81f70698-fbe8acca-2b257bca_0
2025-10-10T14:39:57.848936Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3156 sessionId: src_id|1e46d522-81f70698-fbe8acca-2b257bca_0 is DEAD
2025-10-10T14:39:57.858997Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1e46d522-81f70698-fbe8acca-2b257bca_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:57.859220Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:57.859247Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3157
2025-10-10T14:39:57.859466Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3157 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:57.859517Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3157 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:57.859529Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3157 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:57.859533Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:57.860050Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3157 sessionId:  describe result for acl check
2025-10-10T14:39:57.860092Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:57.860099Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:57.860101Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:57.860108Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602850887558775:3716] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:57.860707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602850887558775:3716] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:57.863487Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602850887558775:3716] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:57.866964Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602850887558775:3716] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:57.866980Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602850887558775:3716] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:57.866984Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602850887558775:3716] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:57.866993Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3157 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:57.878583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:57.882984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:57.883327Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:57.883342Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:57.883358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:57.883434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:57.883486Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602850105309474:12357]
2025-10-10T14:39:57.884120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:57.884518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:57.884630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:57.884994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:57.885085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:57.885092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:57.885093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:57.885095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:57.885096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:57.885097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:57.885099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:57.885100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:57.885102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:57.885103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:57.885104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:57.885106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:57.885107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:57.885113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:57.885128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:57.885132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:57.885136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:57.885151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:57.885156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:57.885160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:57.885165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:57.885169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:57.885174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:57.885179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:57.885184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:57.885188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:57.885197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:57.885206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:57.885218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:57.885223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:57.885227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:57.885232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:57.885237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:57.885243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:57.885247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:57.885252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:57.885256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:57.885261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:57.885267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:57.885272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:57.885276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:57.885281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:57.885285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:57.885297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:57.885305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:57.885310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:57.885314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:57.885320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:57.885324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:57.885345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:57.885351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:57.885358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:57.885397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:57.890496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:57.890843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:57.890858Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:57.890861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:57.890866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:57.890874Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3156 [2:7559602850105309474:12357]
2025-10-10T14:39:57.890895Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:57.890922Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:57.890925Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:57.890929Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:57.890932Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:57.890953Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:57.890967Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:57.890976Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:57.891045Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:57.891052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:57.891054Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:57.891057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:57.891151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:57.891158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:57.891171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:57.891182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:57.891200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:57.891231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602850887558747:2438], now have 1 active actors on pipe
2025-10-10T14:39:57.891240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602850887558926:3716], now have 1 active actors on pipe
2025-10-10T14:39:57.891249Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602850105309469:12357]
2025-10-10T14:39:57.891253Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602850105309469:12357]
2025-10-10T14:39:57.891255Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602850105309469:12357]
2025-10-10T14:39:57.891271Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:57.891288Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:57.891297Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:57.891301Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:57.891304Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:57.891309Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:57.891313Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:57.891296Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3156
2025-10-10T14:39:57.891359Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602850105309469:12357]
2025-10-10T14:39:57.891310Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3156
2025-10-10T14:39:57.891367Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:57.891378Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:57.891973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:57.891985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:57.892032Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6254a3d5-24e6a51e-44606356-8d359906_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:57.892045Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:57.892051Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:57.892054Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:57.892066Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:57.892085Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:57.892106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:57.892332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:57.892347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:57.892374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:57.892480Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3157 partition: 0 MaxSeqNo: 40 sessionId: src_id|6254a3d5-24e6a51e-44606356-8d359906_0
2025-10-10T14:39:57.892978Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e46d522-81f70698-fbe8acca-2b257bca_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|6254a3d5-24e6a51e-44606356-8d359906_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:57.895902Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6254a3d5-24e6a51e-44606356-8d359906_0] Write session: try to update token
2025-10-10T14:39:57.895923Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6254a3d5-24e6a51e-44606356-8d359906_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:57.914622Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:57.914641Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:57.914644Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:57.914646Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:57.914658Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602850105309469:12357]
2025-10-10T14:39:57.914663Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602850105309469:12357]
2025-10-10T14:39:57.914666Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602850105309469:12357]
2025-10-10T14:39:57.914718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:57.914716Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:57.914724Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:57.914730Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:57.914730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:57.914733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:57.914876Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:57.915722Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3157 sessionId: src_id|6254a3d5-24e6a51e-44606356-8d359906_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:57.918393Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:57.948639Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602850887559066:4596]
2025-10-10T14:39:57.948962Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 pipe creation result: OK TabletId: 72075186224037892 Generation: 3156, pipe: [1:7559602850887559066:4596]
2025-10-10T14:39:58.033135Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:58.033771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:58.033789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:58.033836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602850887559066:4596], now have 1 active actors on pipe
2025-10-10T14:39:58.034118Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 55 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602850887559066:4596]
2025-10-10T14:39:58.034136Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:58.034141Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:58.034154Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:58.034069Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:58.034623Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6254a3d5-24e6a51e-44606356-8d359906_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:58.034632Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6254a3d5-24e6a51e-44606356-8d359906_0] Write session will restart in 0.005673s
2025-10-10T14:39:58.034658Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6254a3d5-24e6a51e-44606356-8d359906_0] Write session: Do CDS request
2025-10-10T14:39:58.034665Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6254a3d5-24e6a51e-44606356-8d359906_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:58.034208Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3157 reason: error at write: Disconnected sessionId: src_id|6254a3d5-24e6a51e-44606356-8d359906_0
2025-10-10T14:39:58.034440Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3157 sessionId: src_id|6254a3d5-24e6a51e-44606356-8d359906_0 is DEAD
2025-10-10T14:39:58.041871Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6254a3d5-24e6a51e-44606356-8d359906_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:58.041921Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:58.041942Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3158
2025-10-10T14:39:58.042095Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3158 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:58.042151Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3158 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:58.042162Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3158 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:58.042166Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:58.042603Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3158 sessionId:  describe result for acl check
2025-10-10T14:39:58.042642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:58.042649Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:58.042651Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:58.042659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602855182526380:3701] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:58.043252Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602855182526380:3701] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:58.046050Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602855182526380:3701] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:58.049485Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602855182526380:3701] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:58.049503Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602855182526380:3701] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:58.049506Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602855182526380:3701] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:58.049517Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3158 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:58.064698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:58.065301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:58.065537Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:58.065549Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:58.065562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:58.065617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:58.065668Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602854400277020:12359]
2025-10-10T14:39:58.066337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:58.066696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:58.066736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:58.067100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:58.067165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:58.067172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:58.067173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:58.067174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:58.067186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:58.067188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:58.067189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:58.067190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:58.067192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:58.067193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:58.067194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:58.067196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:58.067197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:58.067202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:58.067217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:58.067221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:58.067225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:58.067229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:58.067234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:58.067238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:58.067242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:58.067247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:58.067251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:58.067255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:58.067259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:58.067263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:58.067271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:58.067281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:58.067287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:58.067294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:58.067298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:58.067304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:58.067309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:58.067315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:58.067320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:58.067325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:58.067330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:58.067335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:58.067341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:58.067346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:58.067351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:58.067356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:58.067362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:58.067367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:58.067372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:58.067377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:58.067382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:58.067387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:58.067397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:58.067402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:58.067408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:58.067413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:58.067454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:58.070059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:58.070373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:58.070388Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:58.070391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:58.070396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:58.070403Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3157 [2:7559602854400277020:12359]
2025-10-10T14:39:58.070432Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:58.070458Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:58.070466Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:58.070471Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:58.070473Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:58.070491Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:58.070506Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:58.070515Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:58.070580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:58.070587Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:58.070590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:58.070593Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:58.070666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:58.070674Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:58.070688Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:58.070700Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:58.070724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:58.070749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602855182526365:2438], now have 1 active actors on pipe
2025-10-10T14:39:58.070757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602855182526541:3701], now have 1 active actors on pipe
2025-10-10T14:39:58.070766Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602854400277015:12359]
2025-10-10T14:39:58.070774Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602854400277015:12359]
2025-10-10T14:39:58.070776Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602854400277015:12359]
2025-10-10T14:39:58.070792Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:58.070812Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:58.070827Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:58.070831Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:58.070836Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:58.070840Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:58.070843Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:58.070863Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602854400277015:12359]
2025-10-10T14:39:58.070852Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3157
2025-10-10T14:39:58.070873Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:58.070882Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:58.070854Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3157
2025-10-10T14:39:58.070913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:58.070919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:58.070951Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|242053d4-9668491-1eac050e-3fedceeb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:58.070965Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:58.070974Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:58.070976Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:58.070988Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:58.071000Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:58.071022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:58.071247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:58.071261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:58.071286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:58.071395Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3158 partition: 0 MaxSeqNo: 40 sessionId: src_id|242053d4-9668491-1eac050e-3fedceeb_0
2025-10-10T14:39:58.071874Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6254a3d5-24e6a51e-44606356-8d359906_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|242053d4-9668491-1eac050e-3fedceeb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:58.074795Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|242053d4-9668491-1eac050e-3fedceeb_0] Write session: try to update token
2025-10-10T14:39:58.074812Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|242053d4-9668491-1eac050e-3fedceeb_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:58.087287Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:39:58.087309Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:58.087322Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602854400277015:12359]
2025-10-10T14:39:58.087382Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:39:58.087452Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:39:58.087577Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:39:58.087731Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:58.087876Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:58.088023Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:58.088224Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:39:58.088265Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:39:58.094059Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3158 sessionId: src_id|242053d4-9668491-1eac050e-3fedceeb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:58.096761Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:58.097668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:58.097694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:58.097742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:39:58.097884Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:39:58.106407Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:58.106422Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:58.106425Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:58.106426Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:58.106436Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602854400277015:12359]
2025-10-10T14:39:58.106439Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602854400277015:12359]
2025-10-10T14:39:58.106442Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602854400277015:12359]
2025-10-10T14:39:58.106481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:58.106486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:58.106488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:58.106490Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:58.106497Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:58.106502Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:58.106618Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:58.133915Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602855182526678:4596]
2025-10-10T14:39:58.134265Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 pipe creation result: OK TabletId: 72075186224037892 Generation: 3157, pipe: [1:7559602855182526678:4596]
2025-10-10T14:39:58.223192Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:58.232183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:58.232215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:58.232401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:58.232482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:58.232567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:58.232644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:58.232693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:58.232702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:58.232772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:58.232843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:58.232914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:58.232984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:58.233032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:58.233040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:58.233115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:58.233182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:58.233249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:58.233320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:58.233384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:58.233390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:58.233461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:58.233542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:58.233609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:58.233685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:58.233732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:58.233740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:58.233814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:58.233879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:58.233949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:58.234016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:58.234065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:58.234072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:58.234150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:58.234218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:58.234286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:58.234356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:58.234401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:58.234412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:58.234482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:58.234549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:58.234620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:58.234692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:58.234744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:58.234746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:58.234819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:58.234886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:58.234953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:58.235021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:58.235069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:58.235077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:58.235150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:58.235216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:58.235284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:58.235359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:58.235410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:58.235416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:58.235491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:58.235562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:58.235635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:58.235706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:58.235755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:58.235762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:58.235831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602855182526678:4596], now have 1 active actors on pipe
2025-10-10T14:39:58.236080Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 56 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602855182526678:4596]
2025-10-10T14:39:58.236107Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:58.236113Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:58.236124Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:58.236148Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3158 reason: error at write: Disconnected sessionId: src_id|242053d4-9668491-1eac050e-3fedceeb_0
2025-10-10T14:39:58.236348Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3158 sessionId: src_id|242053d4-9668491-1eac050e-3fedceeb_0 is DEAD
2025-10-10T14:39:58.236539Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|242053d4-9668491-1eac050e-3fedceeb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:58.236551Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|242053d4-9668491-1eac050e-3fedceeb_0] Write session will restart in 0.005034s
2025-10-10T14:39:58.236577Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|242053d4-9668491-1eac050e-3fedceeb_0] Write session: Do CDS request
2025-10-10T14:39:58.236584Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|242053d4-9668491-1eac050e-3fedceeb_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:58.237256Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:58.242906Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|242053d4-9668491-1eac050e-3fedceeb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:58.243293Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:58.243322Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3159
2025-10-10T14:39:58.243467Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3159 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:58.243505Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3159 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:58.243514Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3159 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:58.243518Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:58.244066Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3159 sessionId:  describe result for acl check
2025-10-10T14:39:58.244114Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:58.244117Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:58.244119Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:58.244127Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602855182526696:3690] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:58.244715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602855182526696:3690] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:58.248259Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602855182526696:3690] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:58.253444Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602855182526696:3690] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:58.253467Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602855182526696:3690] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:58.253471Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602855182526696:3690] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:58.253483Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3159 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:58.267051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:58.267680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:58.267920Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:58.267932Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:58.267945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:58.268001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:58.268062Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602854400277270:12361]
2025-10-10T14:39:58.268713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:58.269039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:58.269087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:58.269438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:58.269514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:58.269523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:58.269525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:58.269527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:58.269528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:58.269530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:58.269531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:58.269532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:58.269534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:58.269535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:58.269536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:58.269537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:58.269539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:58.269544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:58.269558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:58.269562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:58.269566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:58.269570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:58.269574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:58.269577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:58.269581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:58.269585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:58.269592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:58.269596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:58.269600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:58.269604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:58.269613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:58.269622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:58.269630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:58.269636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:58.269640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:58.269646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:58.269653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:58.269658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:58.269663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:58.269668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:58.269673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:58.269678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:58.269683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:58.269688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:58.269692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:58.269698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:58.269703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:58.269708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:58.269713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:58.269719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:58.269724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:58.269729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:58.269733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:58.269739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:58.269743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:58.269749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:58.269789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:58.272306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:58.273210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:58.273222Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:58.273224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:58.273228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:58.273236Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3158 [2:7559602854400277270:12361]
2025-10-10T14:39:58.273249Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:58.273268Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:58.273274Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:58.273282Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:58.273285Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:58.273303Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:58.273317Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:58.273325Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:58.273401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:58.273409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:58.273411Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:58.273414Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:58.273486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:58.273492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:58.273505Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:58.273521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:58.273544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:58.273571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602855182526875:3690], now have 1 active actors on pipe
2025-10-10T14:39:58.273580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602855182526681:2438], now have 1 active actors on pipe
2025-10-10T14:39:58.273588Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602854400277265:12361]
2025-10-10T14:39:58.273590Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602854400277265:12361]
2025-10-10T14:39:58.273592Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602854400277265:12361]
2025-10-10T14:39:58.273605Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:58.273619Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:58.273620Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:58.273624Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:58.273626Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:58.273635Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:58.273638Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:58.273665Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602854400277265:12361]
2025-10-10T14:39:58.273677Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:58.273679Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:58.273628Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3158
2025-10-10T14:39:58.273665Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3158
2025-10-10T14:39:58.273720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:58.273730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:58.273765Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a81a71e-d2802cd6-d695678f-b2906d1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:58.273783Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:58.273788Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:58.273791Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:58.273803Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:58.273814Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:58.273829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:58.274284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:58.274294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:58.274327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:58.274441Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3159 partition: 0 MaxSeqNo: 40 sessionId: src_id|a81a71e-d2802cd6-d695678f-b2906d1_0
2025-10-10T14:39:58.274898Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|242053d4-9668491-1eac050e-3fedceeb_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|a81a71e-d2802cd6-d695678f-b2906d1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:58.277812Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a81a71e-d2802cd6-d695678f-b2906d1_0] Write session: try to update token
2025-10-10T14:39:58.277832Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a81a71e-d2802cd6-d695678f-b2906d1_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:58.285926Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:39:58.285947Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:58.285962Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602854400277265:12361]
2025-10-10T14:39:58.286018Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:39:58.286209Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:39:58.286374Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:58.286517Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:58.286525Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:39:58.286662Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:58.286864Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:39:58.286911Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:39:58.293710Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3159 sessionId: src_id|a81a71e-d2802cd6-d695678f-b2906d1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:58.296665Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:58.296913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:58.296943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:58.296986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:39:58.297107Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:39:58.310274Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:58.310295Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:58.310299Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:58.310301Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:58.310313Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602854400277265:12361]
2025-10-10T14:39:58.310317Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602854400277265:12361]
2025-10-10T14:39:58.310321Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602854400277265:12361]
2025-10-10T14:39:58.310380Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:58.310382Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:58.310388Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:58.310392Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:58.310395Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:58.310398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:58.310544Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:58.337202Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602855182526995:4596]
2025-10-10T14:39:58.337886Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 pipe creation result: OK TabletId: 72075186224037892 Generation: 3158, pipe: [1:7559602855182526995:4596]
2025-10-10T14:39:58.433214Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:58.443630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:58.443666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:58.443866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:58.443930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:58.443995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:58.444059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:58.444747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:58.444754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:58.444829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:58.444890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:58.444954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:58.445034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:58.445076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:58.445079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:58.445152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:58.445215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:58.445279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:58.445665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:58.445710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:58.445713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:58.445783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:58.445844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:58.445904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:58.445962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:58.446002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:58.446007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:58.446076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:58.446134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:58.446192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:58.446250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:58.446292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:58.446294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:58.446361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:58.446418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:58.446481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:58.446541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:58.446582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:58.446584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:58.446654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:58.446715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:58.446778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:58.446842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:58.446884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:58.446890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:58.446961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:58.447023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:58.447086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:58.447151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:58.447193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:58.447196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:58.447263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:58.447324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:58.447386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:58.447448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:58.447489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:58.447492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:58.447562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:58.447623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:58.447682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:58.447742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:58.447786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:58.447788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:58.447867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602855182526995:4596], now have 1 active actors on pipe
2025-10-10T14:39:58.448904Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:58.449671Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 57 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602855182526995:4596]
2025-10-10T14:39:58.449712Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:39:58.449760Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3159 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a81a71e-d2802cd6-d695678f-b2906d1_0
2025-10-10T14:39:58.449987Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3159 sessionId: src_id|a81a71e-d2802cd6-d695678f-b2906d1_0 is DEAD
2025-10-10T14:39:58.450131Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:58.453433Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a81a71e-d2802cd6-d695678f-b2906d1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:39:58.453447Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a81a71e-d2802cd6-d695678f-b2906d1_0] Write session will restart in 0.006595s
2025-10-10T14:39:58.453475Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a81a71e-d2802cd6-d695678f-b2906d1_0] Write session: Do CDS request
2025-10-10T14:39:58.453482Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a81a71e-d2802cd6-d695678f-b2906d1_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:58.461937Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a81a71e-d2802cd6-d695678f-b2906d1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:58.468444Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:58.468466Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3160
2025-10-10T14:39:58.468854Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3160 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:58.468895Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3160 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:58.468901Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3160 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:58.468905Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:58.473809Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3160 sessionId:  describe result for acl check
2025-10-10T14:39:58.473873Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:58.473875Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:58.473878Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:58.473886Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602855182527057:3077] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:58.474524Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602855182527057:3077] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:58.477177Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602855182527057:3077] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:58.485277Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602855182527057:3077] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:58.485300Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602855182527057:3077] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:58.485305Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602855182527057:3077] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:58.485315Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3160 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:58.513970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:58.517793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:58.518124Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:58.518129Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:58.518144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:58.518234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:58.518282Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602854400277561:12377]
2025-10-10T14:39:58.519006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:58.519512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:58.519586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:58.519989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:58.520053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:58.520054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:58.520056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:58.520057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:58.520058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:58.520059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:58.520060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:58.520062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:58.520063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:58.520064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:58.520065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:58.520066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:58.520067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:58.520072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:58.520080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:58.520083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:58.520086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:58.520089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:58.520091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:58.520094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:58.520097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:58.520100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:58.520103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:58.520106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:58.520108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:58.520111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:58.520118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:58.520126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:58.520137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:58.520143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:58.520148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:58.520154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:58.520160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:58.520166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:58.520172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:58.520178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:58.520182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:58.520189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:58.520212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:58.520218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:58.520224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:58.520229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:58.520235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:58.520241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:58.520247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:58.520252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:58.520258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:58.520264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:58.520269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:58.520275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:58.520281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:58.520287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:58.520322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:58.523297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:58.523692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:58.523708Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:58.523711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:58.523716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:58.523724Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3159 [2:7559602854400277561:12377]
2025-10-10T14:39:58.523740Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:58.523761Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:58.523764Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:58.523768Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:58.523771Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:58.523791Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:58.523799Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:58.523808Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:58.523878Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:58.523880Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:58.523882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:58.523885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:58.523962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:58.523974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:58.523987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:58.523997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:58.524011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:58.524145Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3159
2025-10-10T14:39:58.524040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602855182527024:2438], now have 1 active actors on pipe
2025-10-10T14:39:58.524043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602855182527193:3077], now have 1 active actors on pipe
2025-10-10T14:39:58.524170Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3159
2025-10-10T14:39:58.524052Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602854400277556:12377]
2025-10-10T14:39:58.524054Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602854400277556:12377]
2025-10-10T14:39:58.524056Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602854400277556:12377]
2025-10-10T14:39:58.524067Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:58.524078Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:58.524081Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:58.524083Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:58.524086Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:58.524102Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:58.524105Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:58.524147Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602854400277556:12377]
2025-10-10T14:39:58.524157Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:58.524197Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:58.524357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:58.524377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:58.524412Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|85194b22-d029814-cbe9dd36-9673675f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:58.524421Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:58.524425Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:58.524428Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:58.524442Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:58.524455Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:58.524470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:58.524744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:58.524754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:58.524772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:58.525354Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a81a71e-d2802cd6-d695678f-b2906d1_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|85194b22-d029814-cbe9dd36-9673675f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:58.524878Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3160 partition: 0 MaxSeqNo: 40 sessionId: src_id|85194b22-d029814-cbe9dd36-9673675f_0
2025-10-10T14:39:58.528501Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85194b22-d029814-cbe9dd36-9673675f_0] Write session: try to update token
2025-10-10T14:39:58.528522Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85194b22-d029814-cbe9dd36-9673675f_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:58.547500Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:58.547522Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:58.547526Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:58.547528Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:58.547541Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602854400277556:12377]
2025-10-10T14:39:58.547546Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602854400277556:12377]
2025-10-10T14:39:58.547551Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602854400277556:12377]
2025-10-10T14:39:58.547607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:58.547615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:58.547618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:58.547620Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:58.547629Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:58.547635Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:58.547774Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:58.549717Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602855182527336:4596]
2025-10-10T14:39:58.550231Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 pipe creation result: OK TabletId: 72075186224037892 Generation: 3159, pipe: [1:7559602855182527336:4596]
2025-10-10T14:39:58.558745Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3160 sessionId: src_id|85194b22-d029814-cbe9dd36-9673675f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:58.561976Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:58.669956Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:58.670569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602855182527336:4596], now have 1 active actors on pipe
2025-10-10T14:39:58.670626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:58.670635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:58.671093Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:58.671531Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85194b22-d029814-cbe9dd36-9673675f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:58.671545Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85194b22-d029814-cbe9dd36-9673675f_0] Write session will restart in 0.007312s
2025-10-10T14:39:58.671571Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85194b22-d029814-cbe9dd36-9673675f_0] Write session: Do CDS request
2025-10-10T14:39:58.671578Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85194b22-d029814-cbe9dd36-9673675f_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:58.671011Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:58.671030Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:58.671112Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3160 reason: error at write: Disconnected sessionId: src_id|85194b22-d029814-cbe9dd36-9673675f_0
2025-10-10T14:39:58.671349Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3160 sessionId: src_id|85194b22-d029814-cbe9dd36-9673675f_0 is DEAD
2025-10-10T14:39:58.671351Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:58.671392Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 58 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602855182527336:4596]
2025-10-10T14:39:58.679929Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85194b22-d029814-cbe9dd36-9673675f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:58.680068Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:58.680089Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3161
2025-10-10T14:39:58.680279Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3161 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:58.680318Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3161 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:58.680330Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3161 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:58.680335Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:58.680871Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3161 sessionId:  describe result for acl check
2025-10-10T14:39:58.680910Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:58.680917Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:58.680919Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:58.680925Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602855182527351:3637] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:58.681503Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602855182527351:3637] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:58.684940Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602855182527351:3637] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:58.689637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602855182527351:3637] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:58.689657Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602855182527351:3637] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:58.689660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602855182527351:3637] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:58.689670Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3161 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:58.710543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:58.716765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:58.717064Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:58.717078Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:58.717092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:58.717159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:58.717210Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602854400277825:12379]
2025-10-10T14:39:58.717927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:58.718402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:58.718461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:58.718811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:58.718875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:58.718876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:58.718878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:58.718879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:58.718881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:58.718883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:58.718884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:58.718886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:58.718887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:58.718889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:58.718890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:58.718892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:58.718893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:58.718900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:58.718915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:58.718920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:58.718924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:58.718928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:58.718932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:58.718936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:58.718943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:58.718946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:58.718950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:58.718954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:58.718958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:58.718962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:58.718971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:58.718981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:58.718988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:58.718993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:58.719001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:58.719006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:58.719011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:58.719016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:58.719020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:58.719025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:58.719030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:58.719035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:58.719040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:58.719044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:58.719048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:58.719053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:58.719059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:58.719066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:58.719071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:58.719077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:58.719082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:58.719089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:58.719093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:58.719099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:58.719103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:58.719109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:58.719156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:58.722314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:58.723359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:58.723374Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:58.723377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:58.723382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:58.723390Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3160 [2:7559602854400277825:12379]
2025-10-10T14:39:58.723409Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:58.723432Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:58.723436Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:58.723440Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:58.723442Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:58.723461Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:58.723474Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:58.723483Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:58.723561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:58.723568Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:58.723570Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:58.723573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:58.723652Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:58.723659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:58.723671Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:58.723684Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:58.723707Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:58.723734Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602854400277820:12379]
2025-10-10T14:39:58.723742Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602854400277820:12379]
2025-10-10T14:39:58.723744Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602854400277820:12379]
2025-10-10T14:39:58.723753Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:58.723763Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:58.723769Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:58.723774Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:58.723776Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:58.723785Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:58.723789Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:58.723801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602855182527338:2438], now have 1 active actors on pipe
2025-10-10T14:39:58.723804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602855182527400:3637], now have 1 active actors on pipe
2025-10-10T14:39:58.723843Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602854400277820:12379]
2025-10-10T14:39:58.723856Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:58.723881Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:58.723861Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3160
2025-10-10T14:39:58.723871Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3160
2025-10-10T14:39:58.724092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:58.724106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:58.724144Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6741c08e-74e22fd4-f7c79f0d-f3ee5071_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:58.724159Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:58.724169Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:58.724172Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:58.724187Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:58.724206Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:58.724223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:58.724475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:58.724489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:58.724514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:58.724681Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3161 partition: 0 MaxSeqNo: 40 sessionId: src_id|6741c08e-74e22fd4-f7c79f0d-f3ee5071_0
2025-10-10T14:39:58.725189Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85194b22-d029814-cbe9dd36-9673675f_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|6741c08e-74e22fd4-f7c79f0d-f3ee5071_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:58.728176Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6741c08e-74e22fd4-f7c79f0d-f3ee5071_0] Write session: try to update token
2025-10-10T14:39:58.728202Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6741c08e-74e22fd4-f7c79f0d-f3ee5071_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:58.744453Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:58.744474Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:58.744478Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:58.744479Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:58.744490Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602854400277820:12379]
2025-10-10T14:39:58.744497Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602854400277820:12379]
2025-10-10T14:39:58.744501Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602854400277820:12379]
2025-10-10T14:39:58.744567Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:58.744571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:58.744574Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:58.744580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:58.744581Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:58.744583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:58.744738Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:58.747203Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3161 sessionId: src_id|6741c08e-74e22fd4-f7c79f0d-f3ee5071_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:58.750612Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:58.770916Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602855182527655:4596]
2025-10-10T14:39:58.771199Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 pipe creation result: OK TabletId: 72075186224037892 Generation: 3160, pipe: [1:7559602855182527655:4596]
2025-10-10T14:39:58.861179Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:58.862032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:58.862056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:58.862103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602855182527655:4596], now have 1 active actors on pipe
2025-10-10T14:39:58.862331Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:58.862426Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 59 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602855182527655:4596]
2025-10-10T14:39:58.862472Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:58.862488Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:58.862501Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:58.862575Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3161 reason: error at write: Disconnected sessionId: src_id|6741c08e-74e22fd4-f7c79f0d-f3ee5071_0
2025-10-10T14:39:58.862806Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3161 sessionId: src_id|6741c08e-74e22fd4-f7c79f0d-f3ee5071_0 is DEAD
2025-10-10T14:39:58.862970Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6741c08e-74e22fd4-f7c79f0d-f3ee5071_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:58.862983Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6741c08e-74e22fd4-f7c79f0d-f3ee5071_0] Write session will restart in 0.005993s
2025-10-10T14:39:58.863007Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6741c08e-74e22fd4-f7c79f0d-f3ee5071_0] Write session: Do CDS request
2025-10-10T14:39:58.863016Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6741c08e-74e22fd4-f7c79f0d-f3ee5071_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:58.869897Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6741c08e-74e22fd4-f7c79f0d-f3ee5071_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:58.870036Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:58.870064Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3162
2025-10-10T14:39:58.870216Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3162 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:58.870267Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3162 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:58.870273Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3162 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:58.870278Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:58.870833Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3162 sessionId:  describe result for acl check
2025-10-10T14:39:58.870871Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:58.870873Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:58.870875Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:58.870881Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602855182527690:3627] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:58.871496Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602855182527690:3627] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:58.876128Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602855182527690:3627] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:58.879369Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602855182527690:3627] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:58.879389Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602855182527690:3627] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:58.879393Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602855182527690:3627] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:58.879402Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3162 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:58.888235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:58.894100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:58.894767Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:58.894781Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:58.894800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:58.894878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:58.894926Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602854400278078:12382]
2025-10-10T14:39:58.895555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:58.895885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:58.895944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:58.896282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:58.896351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:58.896357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:58.896358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:58.896360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:58.896361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:58.896362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:58.896364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:58.896365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:58.896366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:58.896367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:58.896369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:58.896370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:58.896372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:58.896378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:58.896391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:58.896395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:58.896399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:58.896403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:58.896408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:58.896412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:58.896416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:58.896420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:58.896425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:58.896429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:58.896433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:58.896437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:58.896445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:58.896454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:58.896461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:58.896465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:58.896470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:58.896476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:58.896481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:58.896487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:58.896492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:58.896503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:58.896508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:58.896513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:58.896529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:58.896535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:58.896540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:58.896546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:58.896551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:58.896556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:58.896560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:58.896566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:58.896571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:58.896576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:58.896580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:58.896585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:58.896590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:58.896594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:58.896634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:58.899152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:58.900036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:58.900046Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:58.900048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:58.900052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:58.900060Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3161 [2:7559602854400278078:12382]
2025-10-10T14:39:58.900074Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:58.900092Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:58.900098Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:58.900102Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:58.900105Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:58.900122Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:58.900134Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:58.900142Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:58.900204Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:58.900211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:58.900212Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:58.900214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:58.900291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:58.900300Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:58.900311Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:58.900322Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:58.900340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:58.900376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602855182527673:2438], now have 1 active actors on pipe
2025-10-10T14:39:58.900384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602855182527843:3627], now have 1 active actors on pipe
2025-10-10T14:39:58.900392Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602854400278073:12382]
2025-10-10T14:39:58.900394Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602854400278073:12382]
2025-10-10T14:39:58.900396Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602854400278073:12382]
2025-10-10T14:39:58.900409Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:58.900429Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:58.900430Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:58.900434Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:58.900436Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:58.900446Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:58.900450Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:58.900475Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602854400278073:12382]
2025-10-10T14:39:58.900486Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:58.900487Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:58.900459Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3161
2025-10-10T14:39:58.900518Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3161
2025-10-10T14:39:58.900562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:58.900572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:58.900606Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9a737492-2312f977-8cca480b-bb30c486_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:58.900617Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:58.900621Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:58.900623Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:58.900636Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:58.900652Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:58.900667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:58.900842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:58.900856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:58.900880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:58.900983Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3162 partition: 0 MaxSeqNo: 40 sessionId: src_id|9a737492-2312f977-8cca480b-bb30c486_0
2025-10-10T14:39:58.901438Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6741c08e-74e22fd4-f7c79f0d-f3ee5071_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|9a737492-2312f977-8cca480b-bb30c486_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:58.904096Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9a737492-2312f977-8cca480b-bb30c486_0] Write session: try to update token
2025-10-10T14:39:58.904114Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9a737492-2312f977-8cca480b-bb30c486_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:58.920248Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:58.920267Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:58.920272Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:58.920273Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:58.920284Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602854400278073:12382]
2025-10-10T14:39:58.920294Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602854400278073:12382]
2025-10-10T14:39:58.920297Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602854400278073:12382]
2025-10-10T14:39:58.920347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:58.920350Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:58.920357Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:58.920361Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:58.920363Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:58.920365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:58.920507Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:58.924650Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3162 sessionId: src_id|9a737492-2312f977-8cca480b-bb30c486_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:58.927359Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:58.962420Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602855182527995:4596]
2025-10-10T14:39:58.962771Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 pipe creation result: OK TabletId: 72075186224037892 Generation: 3161, pipe: [1:7559602855182527995:4596]
2025-10-10T14:39:59.035118Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:59.035410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:59.035429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:59.035475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602855182527995:4596], now have 1 active actors on pipe
2025-10-10T14:39:59.035709Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 60 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602855182527995:4596]
2025-10-10T14:39:59.035711Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:59.035728Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:59.035743Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:59.035803Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3162 reason: error at write: Disconnected sessionId: src_id|9a737492-2312f977-8cca480b-bb30c486_0
2025-10-10T14:39:59.036061Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3162 sessionId: src_id|9a737492-2312f977-8cca480b-bb30c486_0 is DEAD
2025-10-10T14:39:59.036253Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a737492-2312f977-8cca480b-bb30c486_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:59.036262Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a737492-2312f977-8cca480b-bb30c486_0] Write session will restart in 0.006690s
2025-10-10T14:39:59.036289Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a737492-2312f977-8cca480b-bb30c486_0] Write session: Do CDS request
2025-10-10T14:39:59.036296Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a737492-2312f977-8cca480b-bb30c486_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:59.035717Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:59.043924Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9a737492-2312f977-8cca480b-bb30c486_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:59.044013Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:59.044031Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3163
2025-10-10T14:39:59.044187Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3163 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:59.044250Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3163 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:59.044262Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3163 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:59.044266Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:59.044713Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3163 sessionId:  describe result for acl check
2025-10-10T14:39:59.044758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:59.044768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:59.044770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:59.044777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602859477495309:3617] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:59.045360Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602859477495309:3617] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:59.047594Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602859477495309:3617] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:59.051092Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602859477495309:3617] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:59.051109Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602859477495309:3617] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:59.051113Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602859477495309:3617] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:59.051122Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3163 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:59.061701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:59.067387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:59.067647Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:59.067665Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:59.067679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:59.067752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:59.067800Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602858695245630:12384]
2025-10-10T14:39:59.068502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:59.068822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:59.068871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:59.069248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:59.069315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:59.069326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:59.069327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:59.069345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:59.069346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:59.069347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:59.069348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:59.069350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:59.069351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:59.069353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:59.069354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:59.069355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:59.069356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:59.069362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:59.069375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:59.069379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:59.069384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:59.069388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:59.069392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:59.069395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:59.069399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:59.069403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:59.069407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:59.069410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:59.069414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:59.069418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:59.069427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:59.069436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:59.069443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:59.069449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:59.069456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:59.069461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:59.069465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:59.069470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:59.069475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:59.069480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:59.069485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:59.069490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:59.069494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:59.069501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:59.069504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:59.069509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:59.069513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:59.069518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:59.069523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:59.069535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:59.069541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:59.069551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:59.069556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:59.069566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:59.069571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:59.069582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:59.069625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:59.072237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:59.072574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:59.072585Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:59.072587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:59.072590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:59.072597Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3162 [2:7559602858695245630:12384]
2025-10-10T14:39:59.072609Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:59.072629Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:59.072647Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:59.072651Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:59.072659Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:59.072675Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:59.072688Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:59.072696Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:59.072759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:59.072766Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:59.072768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:59.072770Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:59.072842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:59.072849Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:59.072861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:59.072887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:59.072903Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:59.072924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602859477495293:2438], now have 1 active actors on pipe
2025-10-10T14:39:59.072928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602859477495461:3617], now have 1 active actors on pipe
2025-10-10T14:39:59.072935Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602858695245623:12384]
2025-10-10T14:39:59.072946Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602858695245623:12384]
2025-10-10T14:39:59.072948Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602858695245623:12384]
2025-10-10T14:39:59.072936Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3162
2025-10-10T14:39:59.072963Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3162
2025-10-10T14:39:59.072964Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:59.072983Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:59.072986Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:59.072989Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:59.072991Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:59.073000Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:59.073003Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:59.073042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:59.073047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:59.073062Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602858695245623:12384]
2025-10-10T14:39:59.073071Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:59.073081Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:59.073105Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|839995db-336342d9-502fa68a-3a6ebcc4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:59.073112Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:59.073118Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:59.073121Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:59.073132Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:59.073144Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:59.073164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:59.073374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:59.073381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:59.073397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:59.073507Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3163 partition: 0 MaxSeqNo: 40 sessionId: src_id|839995db-336342d9-502fa68a-3a6ebcc4_0
2025-10-10T14:39:59.073947Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a737492-2312f977-8cca480b-bb30c486_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|839995db-336342d9-502fa68a-3a6ebcc4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:59.076590Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|839995db-336342d9-502fa68a-3a6ebcc4_0] Write session: try to update token
2025-10-10T14:39:59.076605Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|839995db-336342d9-502fa68a-3a6ebcc4_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:59.095587Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3163 sessionId: src_id|839995db-336342d9-502fa68a-3a6ebcc4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:59.098240Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:59.100424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:59.100450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:59.100478Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:59.100482Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:59.100486Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:59.100489Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:59.100499Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602858695245623:12384]
2025-10-10T14:39:59.100503Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602858695245623:12384]
2025-10-10T14:39:59.100508Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602858695245623:12384]
2025-10-10T14:39:59.100589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:59.100597Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:59.100599Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:59.100742Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:59.102906Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:59.102919Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:59.102925Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:59.136003Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602859477495612:4596]
2025-10-10T14:39:59.136690Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 pipe creation result: OK TabletId: 72075186224037892 Generation: 3162, pipe: [1:7559602859477495612:4596]
2025-10-10T14:39:59.236854Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:59.237561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:39:59.237625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602859477495612:4596], now have 1 active actors on pipe
2025-10-10T14:39:59.238402Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|839995db-336342d9-502fa68a-3a6ebcc4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:59.238414Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|839995db-336342d9-502fa68a-3a6ebcc4_0] Write session will restart in 0.006430s
2025-10-10T14:39:59.237782Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:39:59.237910Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:59.238441Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|839995db-336342d9-502fa68a-3a6ebcc4_0] Write session: Do CDS request
2025-10-10T14:39:59.237914Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:59.237997Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3163 reason: error at write: Disconnected sessionId: src_id|839995db-336342d9-502fa68a-3a6ebcc4_0
2025-10-10T14:39:59.238448Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|839995db-336342d9-502fa68a-3a6ebcc4_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:59.238186Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3163 sessionId: src_id|839995db-336342d9-502fa68a-3a6ebcc4_0 is DEAD
2025-10-10T14:39:59.238342Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 61 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602859477495612:4596]
2025-10-10T14:39:59.238357Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:59.245923Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|839995db-336342d9-502fa68a-3a6ebcc4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:59.249488Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:59.249510Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3164
2025-10-10T14:39:59.249689Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3164 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:59.249720Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3164 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:59.249726Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3164 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:59.249730Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:59.250455Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3164 sessionId:  describe result for acl check
2025-10-10T14:39:59.250483Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:59.250485Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:59.250487Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:59.250494Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602859477495640:3582] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:59.251078Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602859477495640:3582] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:59.255248Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602859477495640:3582] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:59.259905Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602859477495640:3582] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:59.259928Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602859477495640:3582] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:59.259931Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602859477495640:3582] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:59.259941Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3164 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:59.268997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:59.269639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:59.269871Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:59.269885Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:59.269898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:59.269960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:59.270010Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602858695245885:12386]
2025-10-10T14:39:59.270687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:59.275471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:59.275554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:59.275955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:59.276045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:59.276053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:59.276054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:59.276055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:59.276057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:59.276059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:59.276060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:59.276062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:59.276063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:59.276064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:59.276066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:59.276067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:59.276068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:59.276076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:59.276090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:59.276094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:59.276098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:59.276102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:59.276106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:59.276109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:59.276112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:59.276116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:59.276120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:59.276123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:59.276128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:59.276132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:59.276142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:59.276151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:59.276159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:59.276164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:59.276169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:59.276174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:59.276178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:59.276182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:59.276186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:59.276192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:59.276197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:59.276202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:59.276207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:59.276212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:59.276216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:59.276221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:59.276225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:59.276230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:59.276236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:59.276240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:59.276245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:59.276249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:59.276253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:59.276258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:59.276262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:59.276266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:59.276305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:59.279455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:59.279796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:59.279812Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:59.279816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:59.279821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:59.279828Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3163 [2:7559602858695245885:12386]
2025-10-10T14:39:59.279842Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:59.279862Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:59.279866Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:59.279870Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:59.279872Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:59.279891Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:59.279916Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:59.279925Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:59.280090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:59.280100Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:59.280102Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:59.280106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:59.280196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:59.280204Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:59.280218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:59.280232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:59.280255Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:59.280283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602859477495789:3582], now have 1 active actors on pipe
2025-10-10T14:39:59.280291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602859477495615:2438], now have 1 active actors on pipe
2025-10-10T14:39:59.280300Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602858695245880:12386]
2025-10-10T14:39:59.280303Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602858695245880:12386]
2025-10-10T14:39:59.280305Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602858695245880:12386]
2025-10-10T14:39:59.280318Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:59.280334Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:59.280344Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:59.280349Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:59.280351Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:59.280356Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:59.280359Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:59.280387Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602858695245880:12386]
2025-10-10T14:39:59.280394Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:59.280428Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:59.280528Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3163
2025-10-10T14:39:59.280573Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3163
2025-10-10T14:39:59.280772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:59.280784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:59.280821Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2f1fa019-22e3b651-b360760e-39251d33_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:59.280834Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:59.280839Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:59.280841Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:59.280856Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:59.280869Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:59.280885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:59.281085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:59.281093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:59.281117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:59.281233Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3164 partition: 0 MaxSeqNo: 40 sessionId: src_id|2f1fa019-22e3b651-b360760e-39251d33_0
2025-10-10T14:39:59.285443Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|839995db-336342d9-502fa68a-3a6ebcc4_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|2f1fa019-22e3b651-b360760e-39251d33_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:59.288232Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2f1fa019-22e3b651-b360760e-39251d33_0] Write session: try to update token
2025-10-10T14:39:59.288253Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2f1fa019-22e3b651-b360760e-39251d33_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:59.293524Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:39:59.293543Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:59.293554Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602858695245880:12386]
2025-10-10T14:39:59.293603Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:39:59.293609Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:39:59.293788Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:39:59.293929Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:59.294057Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:59.294187Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:59.294379Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:39:59.294420Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:39:59.310913Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3164 sessionId: src_id|2f1fa019-22e3b651-b360760e-39251d33_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:59.313866Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:59.314233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:59.314260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:59.314287Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:59.314290Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:59.314294Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:59.314296Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:59.314307Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602858695245880:12386]
2025-10-10T14:39:59.314313Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602858695245880:12386]
2025-10-10T14:39:59.314317Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602858695245880:12386]
2025-10-10T14:39:59.314360Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:59.314381Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:59.314385Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:59.314397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:59.314407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:59.314410Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:59.314575Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:59.338692Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602859477495934:4596]
2025-10-10T14:39:59.341656Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 pipe creation result: OK TabletId: 72075186224037892 Generation: 3163, pipe: [1:7559602859477495934:4596]
2025-10-10T14:39:59.431475Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:59.433068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:39:59.433116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602859477495934:4596], now have 1 active actors on pipe
2025-10-10T14:39:59.433245Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:39:59.447169Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:59.447303Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:59.447315Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:59.447344Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3164 reason: error at write: Disconnected sessionId: src_id|2f1fa019-22e3b651-b360760e-39251d33_0
2025-10-10T14:39:59.447561Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3164 sessionId: src_id|2f1fa019-22e3b651-b360760e-39251d33_0 is DEAD
2025-10-10T14:39:59.447732Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 62 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602859477495934:4596]
2025-10-10T14:39:59.449160Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f1fa019-22e3b651-b360760e-39251d33_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:59.449172Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f1fa019-22e3b651-b360760e-39251d33_0] Write session will restart in 0.007495s
2025-10-10T14:39:59.449198Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f1fa019-22e3b651-b360760e-39251d33_0] Write session: Do CDS request
2025-10-10T14:39:59.449204Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f1fa019-22e3b651-b360760e-39251d33_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:59.457950Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2f1fa019-22e3b651-b360760e-39251d33_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:59.458490Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:59.458511Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3165
2025-10-10T14:39:59.458625Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3165 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:59.458659Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3165 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:59.458667Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3165 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:59.458672Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:59.459067Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3165 sessionId:  describe result for acl check
2025-10-10T14:39:59.459107Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:59.459113Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:59.459115Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:59.459121Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602859477495964:3548] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:59.459765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602859477495964:3548] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:59.465503Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602859477495964:3548] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:59.469478Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602859477495964:3548] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:59.469499Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602859477495964:3548] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:59.469504Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602859477495964:3548] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:59.469526Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3165 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:59.483364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:59.486328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:59.486533Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:59.486543Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:59.486553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:59.486604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:59.486642Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602858695246181:12395]
2025-10-10T14:39:59.487085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:59.487432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:59.487484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:59.487766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:59.487813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:59.487820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:59.487821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:59.487823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:59.487824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:59.487825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:59.487826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:59.487828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:59.487829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:59.487831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:59.487832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:59.487833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:59.487835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:59.487841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:59.487855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:59.487859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:59.487863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:59.487867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:59.487871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:59.487875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:59.487879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:59.487886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:59.487890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:59.487893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:59.487896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:59.487900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:59.487908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:59.487916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:59.487923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:59.487929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:59.487933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:59.487938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:59.487943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:59.487950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:59.487956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:59.487965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:59.487970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:59.487975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:59.487980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:59.487985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:59.487989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:59.487994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:59.487999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:59.488004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:59.488010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:59.488023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:59.488028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:59.488032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:59.488037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:59.488041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:59.488046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:59.488051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:59.488089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:59.490624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:59.491270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:59.491281Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:59.491282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:59.491285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:59.491290Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3164 [2:7559602858695246181:12395]
2025-10-10T14:39:59.491299Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:59.491314Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:59.491316Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:59.491319Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:59.491320Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:59.491333Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:59.491339Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:59.491345Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:59.491390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:59.491396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:59.491397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:59.491399Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:59.491467Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:59.491473Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:59.491480Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:59.491487Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:59.491502Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:59.491522Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602858695246176:12395]
2025-10-10T14:39:59.491529Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602858695246176:12395]
2025-10-10T14:39:59.491530Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602858695246176:12395]
2025-10-10T14:39:59.491537Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:59.491547Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:59.491557Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:59.491559Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:59.491560Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:59.491564Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:59.491569Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:59.491577Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602858695246176:12395]
2025-10-10T14:39:59.491579Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:59.491586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602859477496139:3548], now have 1 active actors on pipe
2025-10-10T14:39:59.491589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602859477495960:2438], now have 1 active actors on pipe
2025-10-10T14:39:59.491590Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:59.491762Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3164
2025-10-10T14:39:59.491801Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3164
2025-10-10T14:39:59.491890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:59.491898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:59.491924Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2c7ddf09-2297e640-b729d8b2-3dd81e83_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:59.491930Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:59.491933Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:59.491935Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:59.491944Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:59.491954Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:59.491965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:59.492205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:59.492213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:59.492227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:59.494857Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3165 partition: 0 MaxSeqNo: 40 sessionId: src_id|2c7ddf09-2297e640-b729d8b2-3dd81e83_0
2025-10-10T14:39:59.495339Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f1fa019-22e3b651-b360760e-39251d33_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|2c7ddf09-2297e640-b729d8b2-3dd81e83_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:59.498265Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2c7ddf09-2297e640-b729d8b2-3dd81e83_0] Write session: try to update token
2025-10-10T14:39:59.498285Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2c7ddf09-2297e640-b729d8b2-3dd81e83_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:59.508474Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:39:59.508493Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:59.508506Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602858695246176:12395]
2025-10-10T14:39:59.508568Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:39:59.508575Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:39:59.508751Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:39:59.508892Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:59.509026Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:59.509162Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:39:59.509364Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:39:59.509403Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:39:59.522926Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3165 sessionId: src_id|2c7ddf09-2297e640-b729d8b2-3dd81e83_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:59.526057Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:59.526324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:59.526350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:59.526407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:39:59.526510Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:39:59.530079Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:59.530099Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:59.530102Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:59.530104Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:59.530116Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602858695246176:12395]
2025-10-10T14:39:59.530120Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602858695246176:12395]
2025-10-10T14:39:59.530129Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602858695246176:12395]
2025-10-10T14:39:59.530185Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:59.530193Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:59.530199Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:59.530201Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:59.530202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:59.530206Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:59.530362Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:59.548137Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602859477496278:4596]
2025-10-10T14:39:59.548526Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 pipe creation result: OK TabletId: 72075186224037892 Generation: 3164, pipe: [1:7559602859477496278:4596]
2025-10-10T14:39:59.648843Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:59.649981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602859477496278:4596], now have 1 active actors on pipe
2025-10-10T14:39:59.658373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:59.658404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:59.658590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:59.658658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:59.658729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:59.658798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:59.658850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:59.658858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:59.658929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:59.658996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:59.659061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:59.659143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:59.659199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:59.659202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:59.659274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:59.659331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:59.659398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:59.659472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:59.659522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:59.659524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:59.659606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:59.659669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:59.659736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:59.659795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:59.659836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:59.659838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:59.659906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:59.659965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:59.660025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:59.660085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:59.660126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:59.660129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:59.660196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:59.660258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:59.660319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:59.660376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:59.660421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:59.660424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:59.660492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:59.660562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:59.660621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:59.660686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:59.660731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:59.660736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:59.660809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:59.660867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:59.660929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:59.660990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:59.661031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:59.661034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:59.661111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:59.661172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:59.661231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:59.661293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:59.661358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:59.661361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:59.661434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:39:59.661495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:39:59.661559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:39:59.661624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:39:59.661675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:39:59.661682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:39:59.662062Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:59.662125Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:59.662128Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:59.662162Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3165 reason: error at write: Disconnected sessionId: src_id|2c7ddf09-2297e640-b729d8b2-3dd81e83_0
2025-10-10T14:39:59.662406Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3165 sessionId: src_id|2c7ddf09-2297e640-b729d8b2-3dd81e83_0 is DEAD
2025-10-10T14:39:59.662601Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 63 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602859477496278:4596]
2025-10-10T14:39:59.663080Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:59.665822Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c7ddf09-2297e640-b729d8b2-3dd81e83_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:59.665833Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c7ddf09-2297e640-b729d8b2-3dd81e83_0] Write session will restart in 0.006998s
2025-10-10T14:39:59.665861Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c7ddf09-2297e640-b729d8b2-3dd81e83_0] Write session: Do CDS request
2025-10-10T14:39:59.665867Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c7ddf09-2297e640-b729d8b2-3dd81e83_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:59.673980Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2c7ddf09-2297e640-b729d8b2-3dd81e83_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:59.677713Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:59.677733Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3166
2025-10-10T14:39:59.681550Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3166 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:59.681624Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3166 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:59.681635Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3166 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:59.681642Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:59.685893Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3166 sessionId:  describe result for acl check
2025-10-10T14:39:59.685945Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:59.685949Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:59.685950Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:59.685956Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602859477496500:3551] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:59.686457Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602859477496500:3551] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:59.691126Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602859477496500:3551] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:59.694080Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602859477496500:3551] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:59.694101Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602859477496500:3551] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:59.694105Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602859477496500:3551] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:59.694114Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3166 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:59.695135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:59.700418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:59.700691Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:59.700703Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:59.700716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:59.700771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:59.700823Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602858695246450:12404]
2025-10-10T14:39:59.701450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:59.701872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:59.701920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:59.702240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:59.702299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:59.702305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:59.702307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:59.702308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:59.702309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:59.702311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:59.702312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:59.702313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:59.702315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:59.702316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:59.702317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:59.702319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:59.702320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:59.702327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:59.702341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:59.702345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:59.702348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:59.702352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:59.702356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:59.702359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:59.702363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:59.702367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:59.702371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:59.702375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:59.702379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:59.702382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:59.702389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:59.702400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:59.702411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:59.702417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:59.702425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:59.702430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:59.702435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:59.702440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:59.702448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:59.702453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:59.702463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:59.702468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:59.702478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:59.702483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:59.702491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:59.702496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:59.702500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:59.702509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:59.702514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:59.702519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:59.702523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:59.702534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:59.702539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:59.702544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:59.702548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:59.702553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:59.702592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:59.705280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:59.705655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:59.705670Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:59.705673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:59.705678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:59.705685Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3165 [2:7559602858695246450:12404]
2025-10-10T14:39:59.705700Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:59.705726Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:59.705734Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:59.705738Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:59.705741Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:59.705762Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:59.705776Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:59.705785Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:59.705861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:59.705869Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:59.705871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:59.705874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:59.705954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:59.705962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:59.705974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:59.705986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:59.706028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:59.706057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602859477496280:2438], now have 1 active actors on pipe
2025-10-10T14:39:59.706066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602859477496588:3551], now have 1 active actors on pipe
2025-10-10T14:39:59.706071Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3165
2025-10-10T14:39:59.706086Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3165
2025-10-10T14:39:59.706074Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602858695246445:12404]
2025-10-10T14:39:59.706081Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602858695246445:12404]
2025-10-10T14:39:59.706084Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602858695246445:12404]
2025-10-10T14:39:59.706100Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:59.706115Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:59.706126Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:59.706129Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:59.706131Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:59.706131Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:59.706135Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:59.706200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:59.706210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:59.706226Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602858695246445:12404]
2025-10-10T14:39:59.706239Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:59.706255Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:59.706279Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2fe69bfe-abdfda61-23e6a691-d4ae3b86_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:59.706288Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:59.706292Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:59.706294Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:59.706306Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:59.706318Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:59.706340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:59.706523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:59.706534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:59.706550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:59.706641Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3166 partition: 0 MaxSeqNo: 40 sessionId: src_id|2fe69bfe-abdfda61-23e6a691-d4ae3b86_0
2025-10-10T14:39:59.707088Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c7ddf09-2297e640-b729d8b2-3dd81e83_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|2fe69bfe-abdfda61-23e6a691-d4ae3b86_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:59.710103Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2fe69bfe-abdfda61-23e6a691-d4ae3b86_0] Write session: try to update token
2025-10-10T14:39:59.710127Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2fe69bfe-abdfda61-23e6a691-d4ae3b86_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:59.728226Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:59.728251Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:59.728256Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:59.728259Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:59.728271Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602858695246445:12404]
2025-10-10T14:39:59.728276Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602858695246445:12404]
2025-10-10T14:39:59.728281Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602858695246445:12404]
2025-10-10T14:39:59.728343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:59.728352Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:59.728353Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:59.728356Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:59.728360Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:59.728365Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:59.728568Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:59.725261Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3166 sessionId: src_id|2fe69bfe-abdfda61-23e6a691-d4ae3b86_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:59.728951Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:59.762666Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602859477496602:4596]
2025-10-10T14:39:59.763011Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 pipe creation result: OK TabletId: 72075186224037892 Generation: 3165, pipe: [1:7559602859477496602:4596]
2025-10-10T14:39:59.844492Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:39:59.845165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:59.845177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:59.845227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602859477496602:4596], now have 1 active actors on pipe
2025-10-10T14:39:59.845507Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:39:59.846246Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2fe69bfe-abdfda61-23e6a691-d4ae3b86_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:39:59.846258Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2fe69bfe-abdfda61-23e6a691-d4ae3b86_0] Write session will restart in 0.007595s
2025-10-10T14:39:59.846288Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2fe69bfe-abdfda61-23e6a691-d4ae3b86_0] Write session: Do CDS request
2025-10-10T14:39:59.846295Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2fe69bfe-abdfda61-23e6a691-d4ae3b86_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:39:59.845717Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:39:59.845744Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:39:59.845815Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3166 reason: error at write: Disconnected sessionId: src_id|2fe69bfe-abdfda61-23e6a691-d4ae3b86_0
2025-10-10T14:39:59.846069Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3166 sessionId: src_id|2fe69bfe-abdfda61-23e6a691-d4ae3b86_0 is DEAD
2025-10-10T14:39:59.846219Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:39:59.846256Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 64 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602859477496602:4596]
2025-10-10T14:39:59.854980Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2fe69bfe-abdfda61-23e6a691-d4ae3b86_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:59.855163Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:39:59.855184Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3167
2025-10-10T14:39:59.855309Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3167 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:39:59.855343Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3167 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:39:59.855349Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3167 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:39:59.855353Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:39:59.856122Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3167 sessionId:  describe result for acl check
2025-10-10T14:39:59.856165Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:39:59.856167Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:39:59.856169Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:39:59.856175Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602859477496653:3507] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:39:59.856740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602859477496653:3507] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:39:59.859996Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602859477496653:3507] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:39:59.866359Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602859477496653:3507] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:39:59.866377Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602859477496653:3507] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:39:59.866381Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602859477496653:3507] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:39:59.866392Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3167 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:39:59.878214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:39:59.878988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:39:59.879261Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:39:59.879269Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:39:59.879288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:39:59.879371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:39:59.880054Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602858695246708:12407]
2025-10-10T14:39:59.880795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:39:59.882020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:39:59.882077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:39:59.882435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:39:59.882487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:59.882488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:59.882489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:59.882491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:59.882492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:59.882494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:59.882496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:59.882497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:59.882498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:59.882499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:59.882501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:59.882502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:59.882503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:59.882510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:59.882523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:59.882527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:59.882531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:59.882535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:59.882538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:59.882542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:59.882545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:59.882549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:59.882552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:59.882556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:59.882559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:59.882565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:59.882573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:59.882582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:39:59.882588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:59.882593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:39:59.882597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:59.882602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:39:59.882607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:59.882611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:39:59.882617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:59.882622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:39:59.882626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:59.882630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:39:59.882634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:59.882639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:39:59.882643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:59.882647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:39:59.882651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:59.882655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:39:59.882659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:59.882663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:39:59.882667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:59.882672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:59.882675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:59.882680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:59.882684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:59.882688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:59.882726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:39:59.886427Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3166
2025-10-10T14:39:59.886429Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3166
2025-10-10T14:39:59.885653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:39:59.885974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:39:59.885977Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:39:59.885980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:39:59.885987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:39:59.885995Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3166 [2:7559602858695246708:12407]
2025-10-10T14:39:59.886010Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:39:59.886030Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:39:59.886033Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:59.886037Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:59.886040Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:59.886058Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:39:59.886066Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:39:59.886074Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:39:59.886139Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:59.886141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:59.886143Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:59.886146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:39:59.886241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:39:59.886245Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:59.886257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:39:59.886270Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:39:59.886287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:39:59.886312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602859477496607:2438], now have 1 active actors on pipe
2025-10-10T14:39:59.886316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602859477496865:3507], now have 1 active actors on pipe
2025-10-10T14:39:59.886324Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602858695246703:12407]
2025-10-10T14:39:59.886329Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602858695246703:12407]
2025-10-10T14:39:59.886331Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602858695246703:12407]
2025-10-10T14:39:59.886349Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:39:59.886364Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:39:59.886380Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:39:59.886383Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:39:59.886415Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602858695246703:12407]
2025-10-10T14:39:59.886417Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:39:59.886491Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:39:59.886495Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:39:59.886497Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:39:59.886504Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:39:59.886735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:59.886751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:59.886794Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|858b7c78-35758ecc-28f2dee0-fd4fc433_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:39:59.886810Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:39:59.886815Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:39:59.886818Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:39:59.886831Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:39:59.886850Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:39:59.886875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:59.887124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:39:59.887133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:39:59.887156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:39:59.887272Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3167 partition: 0 MaxSeqNo: 40 sessionId: src_id|858b7c78-35758ecc-28f2dee0-fd4fc433_0
2025-10-10T14:39:59.887784Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2fe69bfe-abdfda61-23e6a691-d4ae3b86_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|858b7c78-35758ecc-28f2dee0-fd4fc433_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:39:59.890827Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|858b7c78-35758ecc-28f2dee0-fd4fc433_0] Write session: try to update token
2025-10-10T14:39:59.890851Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|858b7c78-35758ecc-28f2dee0-fd4fc433_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:39:59.909031Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:39:59.909051Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:39:59.909054Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:39:59.909056Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:39:59.909067Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602858695246703:12407]
2025-10-10T14:39:59.909071Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602858695246703:12407]
2025-10-10T14:39:59.909075Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602858695246703:12407]
2025-10-10T14:39:59.909127Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:39:59.909140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:39:59.909142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:39:59.909284Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:39:59.909555Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:39:59.909562Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:39:59.909565Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:39:59.913206Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3167 sessionId: src_id|858b7c78-35758ecc-28f2dee0-fd4fc433_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:39:59.916254Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:39:59.948425Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602859477496949:4596]
2025-10-10T14:39:59.948898Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 pipe creation result: OK TabletId: 72075186224037892 Generation: 3166, pipe: [1:7559602859477496949:4596]
2025-10-10T14:40:00.036103Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:00.036894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:00.036905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:00.036952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602859477496949:4596], now have 1 active actors on pipe
2025-10-10T14:40:00.037190Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:00.040929Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|858b7c78-35758ecc-28f2dee0-fd4fc433_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:40:00.040944Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|858b7c78-35758ecc-28f2dee0-fd4fc433_0] Write session will restart in 0.007271s
2025-10-10T14:40:00.040971Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|858b7c78-35758ecc-28f2dee0-fd4fc433_0] Write session: Do CDS request
2025-10-10T14:40:00.040977Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|858b7c78-35758ecc-28f2dee0-fd4fc433_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:00.037346Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:40:00.037364Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:40:00.037411Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:00.037447Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3167 reason: error at write: Disconnected sessionId: src_id|858b7c78-35758ecc-28f2dee0-fd4fc433_0
2025-10-10T14:40:00.037682Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 65 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602859477496949:4596]
2025-10-10T14:40:00.037700Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3167 sessionId: src_id|858b7c78-35758ecc-28f2dee0-fd4fc433_0 is DEAD
2025-10-10T14:40:00.054019Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|858b7c78-35758ecc-28f2dee0-fd4fc433_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:00.054031Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:00.054050Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3168
2025-10-10T14:40:00.057680Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3168 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:00.057747Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3168 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:00.057759Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3168 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:00.057775Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:00.058299Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3168 sessionId:  describe result for acl check
2025-10-10T14:40:00.058341Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:00.058349Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:00.058351Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:00.058359Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602863772464347:3502] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:00.059010Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602863772464347:3502] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:00.063627Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602863772464347:3502] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:00.070702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602863772464347:3502] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:00.070724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602863772464347:3502] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:00.070728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602863772464347:3502] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:00.070739Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3168 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:00.071979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:00.077092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:00.077369Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:00.077382Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:00.077395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:00.077458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:00.077503Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602862990214265:12409]
2025-10-10T14:40:00.078138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:00.078521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:00.078596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:00.078955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:00.079022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:00.079028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:00.079030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:00.079031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:00.079032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:00.079033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:00.079035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:00.079036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:00.079037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:00.079038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:00.079039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:00.079040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:00.079042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:00.079048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:00.079064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:00.079069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:00.079074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:00.079078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:00.079082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:00.079087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:00.079090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:00.079095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:00.079101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:00.079105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:00.079110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:00.079114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:00.079124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:00.079133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:00.079140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:00.079145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:00.079152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:00.079157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:00.079162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:00.079166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:00.079172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:00.079177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:00.079183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:00.079188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:00.079193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:00.079206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:00.079214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:00.079219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:00.079224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:00.079229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:00.079238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:00.079242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:00.079247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:00.079255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:00.079259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:00.079268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:00.079273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:00.079278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:00.079327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:00.082502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:00.083308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:00.083327Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:00.083329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:00.083333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:00.083341Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3167 [2:7559602862990214265:12409]
2025-10-10T14:40:00.083356Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:00.083379Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:00.083383Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:00.083387Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:00.083390Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:00.083409Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:00.083418Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:00.083427Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:00.083512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:00.083522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:00.083523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:00.083526Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:00.083600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:00.083608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:00.083733Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3167
2025-10-10T14:40:00.083751Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3167
2025-10-10T14:40:00.083622Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:00.083641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:00.083657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:00.083683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602863772464248:2438], now have 1 active actors on pipe
2025-10-10T14:40:00.083688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602863772464557:3502], now have 1 active actors on pipe
2025-10-10T14:40:00.083696Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602862990214260:12409]
2025-10-10T14:40:00.083698Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602862990214260:12409]
2025-10-10T14:40:00.083700Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602862990214260:12409]
2025-10-10T14:40:00.083722Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:00.083740Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:00.083756Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:00.083759Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:00.083759Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:00.083764Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:00.083766Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:00.083799Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602862990214260:12409]
2025-10-10T14:40:00.083810Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:00.083830Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:00.083968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:00.083976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:00.084015Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|18fff4fa-e2481551-3f9c7692-b45c453a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:00.084024Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:00.084034Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:00.084036Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:00.084049Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:00.084068Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:00.084091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:00.089520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:00.089541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:00.089585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:00.089789Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3168 partition: 0 MaxSeqNo: 40 sessionId: src_id|18fff4fa-e2481551-3f9c7692-b45c453a_0
2025-10-10T14:40:00.090215Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|858b7c78-35758ecc-28f2dee0-fd4fc433_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|18fff4fa-e2481551-3f9c7692-b45c453a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:00.092921Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|18fff4fa-e2481551-3f9c7692-b45c453a_0] Write session: try to update token
2025-10-10T14:40:00.092944Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|18fff4fa-e2481551-3f9c7692-b45c453a_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:00.095939Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:40:00.095959Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:00.095970Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602862990214260:12409]
2025-10-10T14:40:00.096020Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:40:00.096019Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:40:00.096198Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:40:00.096341Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:00.096481Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:00.096630Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:00.096813Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:40:00.096860Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:40:00.107515Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3168 sessionId: src_id|18fff4fa-e2481551-3f9c7692-b45c453a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:00.110282Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:00.110546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:00.110569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:00.110624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:40:00.110755Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:40:00.120774Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:00.120794Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:00.120798Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:00.120800Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:00.120811Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602862990214260:12409]
2025-10-10T14:40:00.120816Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602862990214260:12409]
2025-10-10T14:40:00.120820Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602862990214260:12409]
2025-10-10T14:40:00.120877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:00.120891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:00.120898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:00.121042Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:00.123898Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:00.123926Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:00.123932Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:00.137465Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:155: [72075186224037893][rt3.dc1--test-topic] TPersQueueReadBalancer::HandleWakeup
2025-10-10T14:40:00.137499Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 18
2025-10-10T14:40:00.137891Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602863772464571:4596]
2025-10-10T14:40:00.138819Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 pipe creation result: OK TabletId: 72075186224037892 Generation: 3167, pipe: [1:7559602863772464571:4596]
2025-10-10T14:40:00.241662Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:00.251434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:00.251464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:00.251632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:00.251702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:00.251773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:00.251841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:00.251889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:00.251898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:00.251968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:00.252033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:00.252102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:00.252168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:00.252214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:00.252226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:00.252297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:00.252362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:00.252436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:00.252514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:00.252562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:00.252565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:00.252633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:00.252702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:00.252767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:00.252836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:00.252879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:00.252881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:00.252954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:00.253016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:00.253078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:00.253142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:00.253185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:00.253188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:00.253254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:00.253310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:00.253470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:00.253543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:00.253594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:00.253603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:00.253673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:00.253733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:00.253802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:00.253860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:00.253899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:00.253901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:00.253964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:00.254017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:00.254073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:00.254132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:00.254170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:00.254174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:00.254236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:00.254290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:00.254347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:00.254404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:00.254442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:00.254443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:00.254504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:00.254556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:00.254622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:00.254688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:00.254731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:00.254733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:00.254944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602863772464571:4596], now have 1 active actors on pipe
2025-10-10T14:40:00.255369Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:00.255563Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:00.255588Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 18
2025-10-10T14:40:00.255627Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 66 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602863772464571:4596]
2025-10-10T14:40:00.255650Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:40:00.255653Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:40:00.255682Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3168 reason: error at write: Disconnected sessionId: src_id|18fff4fa-e2481551-3f9c7692-b45c453a_0
2025-10-10T14:40:00.255920Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3168 sessionId: src_id|18fff4fa-e2481551-3f9c7692-b45c453a_0 is DEAD
2025-10-10T14:40:00.257572Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18fff4fa-e2481551-3f9c7692-b45c453a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:40:00.257595Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18fff4fa-e2481551-3f9c7692-b45c453a_0] Write session will restart in 0.006345s
2025-10-10T14:40:00.257622Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18fff4fa-e2481551-3f9c7692-b45c453a_0] Write session: Do CDS request
2025-10-10T14:40:00.257629Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18fff4fa-e2481551-3f9c7692-b45c453a_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:00.265872Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|18fff4fa-e2481551-3f9c7692-b45c453a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:00.268961Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:00.268980Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3169
2025-10-10T14:40:00.269124Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3169 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:00.269188Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3169 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:00.269202Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3169 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:00.269206Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:00.269688Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3169 sessionId:  describe result for acl check
2025-10-10T14:40:00.269735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:00.269742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:00.269744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:00.269750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602863772464592:3493] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:00.270402Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602863772464592:3493] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:00.273910Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602863772464592:3493] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:00.277919Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602863772464592:3493] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:00.277940Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602863772464592:3493] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:00.277944Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602863772464592:3493] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:00.277955Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3169 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:00.289023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:00.294937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:00.295223Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:00.295229Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:00.295243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:00.295321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:00.295365Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602862990214528:12412]
2025-10-10T14:40:00.296026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:00.296429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:00.296496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:00.296851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:00.296930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:00.296932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:00.296933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:00.296935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:00.296936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:00.296937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:00.296938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:00.296940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:00.296941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:00.296943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:00.296944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:00.296945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:00.296946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:00.296954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:00.296969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:00.296973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:00.296980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:00.296985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:00.296989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:00.296993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:00.296997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:00.297002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:00.297007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:00.297012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:00.297016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:00.297020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:00.297031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:00.297041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:00.297049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:00.297054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:00.297059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:00.297065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:00.297070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:00.297075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:00.297080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:00.297085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:00.297090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:00.297096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:00.297101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:00.297107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:00.297112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:00.297120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:00.297124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:00.297129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:00.297134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:00.297139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:00.297143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:00.297149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:00.297153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:00.297159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:00.297164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:00.297169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:00.297212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:00.300243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:00.301099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:00.301120Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:00.301123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:00.301127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:00.301137Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3168 [2:7559602862990214528:12412]
2025-10-10T14:40:00.301152Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:00.301171Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:00.301181Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:00.301185Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:00.301187Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:00.301205Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:00.301219Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:00.301227Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:00.301297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:00.301307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:00.301309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:00.301311Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:00.301995Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3168
2025-10-10T14:40:00.302037Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3168
2025-10-10T14:40:00.301407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:00.301433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:00.301447Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:00.301459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:00.301477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:00.301501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602863772464753:3493], now have 1 active actors on pipe
2025-10-10T14:40:00.301506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602863772464576:2438], now have 1 active actors on pipe
2025-10-10T14:40:00.301514Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602862990214523:12412]
2025-10-10T14:40:00.301516Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602862990214523:12412]
2025-10-10T14:40:00.301518Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602862990214523:12412]
2025-10-10T14:40:00.301534Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:00.301547Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:00.301550Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:00.301552Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:00.301561Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:00.301570Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:00.301574Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:00.301607Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602862990214523:12412]
2025-10-10T14:40:00.301615Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:00.301621Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:00.302105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:00.302125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:00.302186Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|36aa5af8-9ad526c-6dce6185-1181ef53_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:00.302196Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:00.302201Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:00.302203Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:00.302218Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:00.302231Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:00.302307Z node 2 :PERSQUEUE DEBUG: partition.cpp:1000: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 80296142 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-10-10T14:40:00.302332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:00.302645Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 9 Generation: 1 StatsReportRound: 23 DataSize: 80296142 UsedReserveSize: 0
2025-10-10T14:40:00.302691Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-10-10T14:40:00.302682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:00.302694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:00.302714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:00.303233Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3169 partition: 0 MaxSeqNo: 40 sessionId: src_id|36aa5af8-9ad526c-6dce6185-1181ef53_0
2025-10-10T14:40:00.303700Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18fff4fa-e2481551-3f9c7692-b45c453a_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|36aa5af8-9ad526c-6dce6185-1181ef53_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:00.306487Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|36aa5af8-9ad526c-6dce6185-1181ef53_0] Write session: try to update token
2025-10-10T14:40:00.306509Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|36aa5af8-9ad526c-6dce6185-1181ef53_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:00.331853Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:40:00.331873Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:00.331885Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602862990214523:12412]
2025-10-10T14:40:00.331937Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:40:00.332120Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:40:00.332260Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:00.332398Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:00.332548Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:00.332739Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:40:00.332785Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:40:00.332899Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:40:00.341233Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3169 sessionId: src_id|36aa5af8-9ad526c-6dce6185-1181ef53_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:00.344708Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:00.345044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:00.345069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:00.345111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:40:00.346916Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:40:00.356269Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:00.356293Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:00.356296Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:00.356298Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:00.356310Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602862990214523:12412]
2025-10-10T14:40:00.356315Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602862990214523:12412]
2025-10-10T14:40:00.356318Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602862990214523:12412]
2025-10-10T14:40:00.356374Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:00.356382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:00.356384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:00.357471Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602863772464904:4596]
2025-10-10T14:40:00.356531Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:00.357516Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:00.357521Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:00.357526Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:00.358006Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 pipe creation result: OK TabletId: 72075186224037892 Generation: 3168, pipe: [1:7559602863772464904:4596]
2025-10-10T14:40:00.480828Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:00.481252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602863772464904:4596], now have 1 active actors on pipe
2025-10-10T14:40:00.490016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:00.490043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:00.490228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:00.490290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:00.490356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:00.490422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:00.490468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:00.490473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:00.490554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:00.490614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:00.490676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:00.490744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:00.490787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:00.490790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:00.490862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:00.490922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:00.490993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:00.491060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:00.491104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:00.491107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:00.491180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:00.491242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:00.491302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:00.491368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:00.491418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:00.491420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:00.491490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:00.491553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:00.491617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:00.491679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:00.491723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:00.491726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:00.491798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:00.491857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:00.491919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:00.491987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:00.492032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:00.492035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:00.492106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:00.492169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:00.492234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:00.492298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:00.492346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:00.492349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:00.492425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:00.492484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:00.492563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:00.492649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:00.492696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:00.492699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:00.492769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:00.492828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:00.492889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:00.492953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:00.493398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:00.493411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:00.493487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:00.493547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:00.493612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:00.493674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:00.493717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:00.493720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:00.497593Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:00.499145Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|36aa5af8-9ad526c-6dce6185-1181ef53_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:40:00.499155Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|36aa5af8-9ad526c-6dce6185-1181ef53_0] Write session will restart in 0.008097s
2025-10-10T14:40:00.499173Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|36aa5af8-9ad526c-6dce6185-1181ef53_0] Write session: Do CDS request
2025-10-10T14:40:00.499177Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|36aa5af8-9ad526c-6dce6185-1181ef53_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:00.498382Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:40:00.498437Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3169 reason: status is not ok: tablet will be restarted right now sessionId: src_id|36aa5af8-9ad526c-6dce6185-1181ef53_0
2025-10-10T14:40:00.498633Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3169 sessionId: src_id|36aa5af8-9ad526c-6dce6185-1181ef53_0 is DEAD
2025-10-10T14:40:00.498960Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 67 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602863772464904:4596]
2025-10-10T14:40:00.498977Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:00.508955Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|36aa5af8-9ad526c-6dce6185-1181ef53_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:00.509423Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:00.509445Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3170
2025-10-10T14:40:00.509712Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3170 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:00.509756Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3170 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:00.509761Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3170 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:00.509766Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:00.510160Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3170 sessionId:  describe result for acl check
2025-10-10T14:40:00.510196Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:00.510203Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:00.510205Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:00.510210Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602863772464930:3473] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:00.510649Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602863772464930:3473] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:00.515796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602863772464930:3473] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:00.522874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602863772464930:3473] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:00.522897Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602863772464930:3473] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:00.522901Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602863772464930:3473] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:00.522910Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3170 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:00.554530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:00.561377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:00.561677Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:00.561696Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:00.561711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:00.561790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:00.561830Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602862990214829:12422]
2025-10-10T14:40:00.562429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:00.563146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:00.563215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:00.563579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:00.563659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:00.563661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:00.563662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:00.563663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:00.563665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:00.563666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:00.563668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:00.563669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:00.563670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:00.563672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:00.563673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:00.563675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:00.563676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:00.563683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:00.563697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:00.563701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:00.563706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:00.563710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:00.563714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:00.563718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:00.563721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:00.563724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:00.563729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:00.563732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:00.563736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:00.563739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:00.563748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:00.563757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:00.563764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:00.563770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:00.563775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:00.563780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:00.563784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:00.563790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:00.563795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:00.563800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:00.563805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:00.563810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:00.563815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:00.563820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:00.563826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:00.563831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:00.563836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:00.563841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:00.563846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:00.563852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:00.563857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:00.563862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:00.563867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:00.563871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:00.563876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:00.563881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:00.563917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:00.566995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:00.567804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:00.567817Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:00.567819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:00.567823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:00.567830Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3169 [2:7559602862990214829:12422]
2025-10-10T14:40:00.567845Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:00.567864Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:00.567867Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:00.567871Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:00.567874Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:00.567892Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:00.567899Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:00.567918Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:00.567981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:00.567990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:00.567992Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:00.567995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:00.568062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:00.568066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:00.568077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:00.568088Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:00.568173Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3169
2025-10-10T14:40:00.568234Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3169
2025-10-10T14:40:00.568104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:00.568137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602863772464923:2438], now have 1 active actors on pipe
2025-10-10T14:40:00.568141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602863772464989:3473], now have 1 active actors on pipe
2025-10-10T14:40:00.568149Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602862990214823:12422]
2025-10-10T14:40:00.568152Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602862990214823:12422]
2025-10-10T14:40:00.568154Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602862990214823:12422]
2025-10-10T14:40:00.568163Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:00.568178Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:00.568183Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:00.568186Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:00.568194Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:00.568197Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:00.568200Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:00.568227Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602862990214823:12422]
2025-10-10T14:40:00.568230Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:00.568232Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:00.568269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:00.568274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:00.568310Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a8f94b69-861e7e8a-fbfda113-1be107e6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:00.568319Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:00.568322Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:00.568324Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:00.568336Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:00.568346Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:00.568360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:00.568562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:00.568570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:00.568588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:00.568678Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3170 partition: 0 MaxSeqNo: 40 sessionId: src_id|a8f94b69-861e7e8a-fbfda113-1be107e6_0
2025-10-10T14:40:00.569134Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|36aa5af8-9ad526c-6dce6185-1181ef53_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|a8f94b69-861e7e8a-fbfda113-1be107e6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:00.571896Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a8f94b69-861e7e8a-fbfda113-1be107e6_0] Write session: try to update token
2025-10-10T14:40:00.571915Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a8f94b69-861e7e8a-fbfda113-1be107e6_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:00.592630Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:00.592654Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:00.592658Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:00.592661Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:00.592674Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602862990214823:12422]
2025-10-10T14:40:00.592680Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602862990214823:12422]
2025-10-10T14:40:00.592685Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602862990214823:12422]
2025-10-10T14:40:00.592750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:00.592755Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:00.592762Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:00.592768Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:00.592774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:00.592777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:00.592949Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:00.596422Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3170 sessionId: src_id|a8f94b69-861e7e8a-fbfda113-1be107e6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:00.598292Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602863772465259:4596]
2025-10-10T14:40:00.598914Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 pipe creation result: OK TabletId: 72075186224037892 Generation: 3169, pipe: [1:7559602863772465259:4596]
2025-10-10T14:40:00.599275Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:00.710969Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:00.711859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602863772465259:4596], now have 1 active actors on pipe
2025-10-10T14:40:00.711905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:00.711912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:00.712199Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:00.712172Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:00.712176Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:40:00.712180Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:40:00.712242Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 68 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602863772465259:4596]
2025-10-10T14:40:00.712247Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3170 reason: error at write: Disconnected sessionId: src_id|a8f94b69-861e7e8a-fbfda113-1be107e6_0
2025-10-10T14:40:00.712475Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3170 sessionId: src_id|a8f94b69-861e7e8a-fbfda113-1be107e6_0 is DEAD
2025-10-10T14:40:00.712782Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8f94b69-861e7e8a-fbfda113-1be107e6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:40:00.712794Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8f94b69-861e7e8a-fbfda113-1be107e6_0] Write session will restart in 0.007159s
2025-10-10T14:40:00.712819Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8f94b69-861e7e8a-fbfda113-1be107e6_0] Write session: Do CDS request
2025-10-10T14:40:00.712829Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8f94b69-861e7e8a-fbfda113-1be107e6_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:00.721016Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a8f94b69-861e7e8a-fbfda113-1be107e6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:00.721637Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:00.721667Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3171
2025-10-10T14:40:00.721805Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3171 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:00.721845Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3171 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:00.721858Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3171 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:00.721862Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:00.722396Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3171 sessionId:  describe result for acl check
2025-10-10T14:40:00.722437Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:00.722448Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:00.722451Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:00.722458Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602863772465275:3454] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:00.723055Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602863772465275:3454] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:00.725957Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602863772465275:3454] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:00.730256Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602863772465275:3454] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:00.730278Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602863772465275:3454] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:00.730283Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602863772465275:3454] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:00.730293Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3171 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:00.741114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:00.747074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:00.747370Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:00.747384Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:00.747398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:00.747477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:00.747538Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602862990215105:12432]
2025-10-10T14:40:00.748184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:00.748649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:00.748700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:00.749068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:00.749142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:00.749150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:00.749151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:00.749152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:00.749153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:00.749155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:00.749156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:00.749158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:00.749159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:00.749160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:00.749161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:00.749162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:00.749163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:00.749171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:00.749183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:00.749187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:00.749190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:00.749193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:00.749197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:00.749201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:00.749204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:00.749207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:00.749212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:00.749216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:00.749220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:00.749223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:00.749232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:00.749241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:00.749247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:00.749252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:00.749256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:00.749261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:00.749265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:00.749270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:00.749275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:00.749279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:00.749283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:00.749288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:00.749295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:00.749300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:00.749309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:00.749315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:00.749320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:00.749345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:00.749350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:00.749355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:00.749360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:00.749372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:00.749376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:00.749381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:00.749386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:00.749393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:00.749430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:00.752218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:00.753369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:00.753382Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:00.753385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:00.753389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:00.753397Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3170 [2:7559602862990215105:12432]
2025-10-10T14:40:00.753414Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:00.753435Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:00.753446Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:00.753450Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:00.753453Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:00.753473Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:00.753481Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:00.753491Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:00.753569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:00.753577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:00.753579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:00.753582Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:00.753663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:00.753672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:00.753685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:00.753702Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:00.753731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:00.753765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602863772465400:3454], now have 1 active actors on pipe
2025-10-10T14:40:00.753771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602863772465262:2438], now have 1 active actors on pipe
2025-10-10T14:40:00.753780Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602862990215100:12432]
2025-10-10T14:40:00.753788Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602862990215100:12432]
2025-10-10T14:40:00.753790Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602862990215100:12432]
2025-10-10T14:40:00.753805Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:00.753826Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:00.753833Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:00.753836Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:00.753839Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:00.753848Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:00.753852Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:00.753888Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602862990215100:12432]
2025-10-10T14:40:00.753896Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:00.753885Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3170
2025-10-10T14:40:00.753899Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:00.753924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:00.753933Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3170
2025-10-10T14:40:00.753930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:00.753973Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8a83d8fd-bc6939ac-b107f919-c6e058bb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:00.753981Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:00.753986Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:00.753988Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:00.754000Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:00.754011Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:00.754033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:00.754520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:00.754545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:00.754570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:00.757937Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3171 partition: 0 MaxSeqNo: 40 sessionId: src_id|8a83d8fd-bc6939ac-b107f919-c6e058bb_0
2025-10-10T14:40:00.758430Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8f94b69-861e7e8a-fbfda113-1be107e6_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|8a83d8fd-bc6939ac-b107f919-c6e058bb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:00.761709Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8a83d8fd-bc6939ac-b107f919-c6e058bb_0] Write session: try to update token
2025-10-10T14:40:00.761748Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8a83d8fd-bc6939ac-b107f919-c6e058bb_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:00.775819Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:00.775840Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:00.775843Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:00.775846Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:00.775856Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602862990215100:12432]
2025-10-10T14:40:00.775861Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602862990215100:12432]
2025-10-10T14:40:00.775866Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602862990215100:12432]
2025-10-10T14:40:00.775919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:00.775930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:00.775930Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:00.775933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:00.775938Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:00.775943Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:00.776077Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:00.778574Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3171 sessionId: src_id|8a83d8fd-bc6939ac-b107f919-c6e058bb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:00.781771Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:00.809669Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602863772465588:4596]
2025-10-10T14:40:00.810005Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 pipe creation result: OK TabletId: 72075186224037892 Generation: 3170, pipe: [1:7559602863772465588:4596]
2025-10-10T14:40:00.895156Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:00.895993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:00.896004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:00.896058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602863772465588:4596], now have 1 active actors on pipe
2025-10-10T14:40:00.896511Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 69 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602863772465588:4596]
2025-10-10T14:40:00.896534Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:40:00.896538Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:40:00.896548Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:00.896605Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3171 reason: error at write: Disconnected sessionId: src_id|8a83d8fd-bc6939ac-b107f919-c6e058bb_0
2025-10-10T14:40:00.896843Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3171 sessionId: src_id|8a83d8fd-bc6939ac-b107f919-c6e058bb_0 is DEAD
2025-10-10T14:40:00.897309Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a83d8fd-bc6939ac-b107f919-c6e058bb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:40:00.897323Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a83d8fd-bc6939ac-b107f919-c6e058bb_0] Write session will restart in 0.005875s
2025-10-10T14:40:00.897366Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a83d8fd-bc6939ac-b107f919-c6e058bb_0] Write session: Do CDS request
2025-10-10T14:40:00.897375Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a83d8fd-bc6939ac-b107f919-c6e058bb_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:00.896596Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:00.906030Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8a83d8fd-bc6939ac-b107f919-c6e058bb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:00.906613Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:00.906637Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3172
2025-10-10T14:40:00.906878Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3172 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:00.906934Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3172 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:00.906940Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3172 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:00.906945Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:00.907526Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3172 sessionId:  describe result for acl check
2025-10-10T14:40:00.907562Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:00.907565Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:00.907567Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:00.907574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602863772465615:3438] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:00.908269Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602863772465615:3438] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:00.910962Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602863772465615:3438] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:00.922440Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602863772465615:3438] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:00.922476Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602863772465615:3438] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:00.922481Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602863772465615:3438] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:00.922492Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3172 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:00.953006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:00.957726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:00.958619Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:00.958632Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:00.958651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:00.958736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:00.958788Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602862990215368:12434]
2025-10-10T14:40:00.959484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:00.959933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:00.959988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:00.960346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:00.960411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:00.960418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:00.960420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:00.960421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:00.960423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:00.960424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:00.960425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:00.960427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:00.960428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:00.960429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:00.960430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:00.960432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:00.960433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:00.960440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:00.960453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:00.960458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:00.960463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:00.960467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:00.960472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:00.960476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:00.960480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:00.960484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:00.960500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:00.960504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:00.960508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:00.960512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:00.960520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:00.960529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:00.960536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:00.960541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:00.960548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:00.960554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:00.960558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:00.960564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:00.960569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:00.960575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:00.960580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:00.960585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:00.960590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:00.960595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:00.960599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:00.960606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:00.960611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:00.960616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:00.960620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:00.960626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:00.960632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:00.960648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:00.960654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:00.960659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:00.960664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:00.960669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:00.960711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:00.963842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:00.964798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:00.964803Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:00.964807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:00.964811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:00.964819Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3171 [2:7559602862990215368:12434]
2025-10-10T14:40:00.964834Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:00.964855Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:00.964858Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:00.964862Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:00.964864Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:00.964884Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:00.964891Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:00.964900Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:00.964961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:00.964963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:00.964966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:00.964969Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:00.965039Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:00.965042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:00.965054Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:00.965066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:00.965083Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:00.965106Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602862990215363:12434]
2025-10-10T14:40:00.965109Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602862990215363:12434]
2025-10-10T14:40:00.965111Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602862990215363:12434]
2025-10-10T14:40:00.965124Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:00.965139Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:00.965155Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:00.965158Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:00.965193Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602862990215363:12434]
2025-10-10T14:40:00.965197Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:00.965486Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:00.965496Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:00.965498Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:00.965504Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:00.965788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602863772465655:3438], now have 1 active actors on pipe
2025-10-10T14:40:00.965810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602863772465608:2438], now have 1 active actors on pipe
2025-10-10T14:40:00.965864Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3171
2025-10-10T14:40:00.965926Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3171
2025-10-10T14:40:00.966101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:00.966113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:00.966153Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|466a6640-ef3e5086-ca2989c6-f40b9322_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:00.966169Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:00.966174Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:00.966178Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:00.966192Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:00.966218Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:00.966237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:00.969731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:00.969753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:00.969794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:00.969974Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3172 partition: 0 MaxSeqNo: 40 sessionId: src_id|466a6640-ef3e5086-ca2989c6-f40b9322_0
2025-10-10T14:40:00.970748Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a83d8fd-bc6939ac-b107f919-c6e058bb_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|466a6640-ef3e5086-ca2989c6-f40b9322_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:00.973719Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|466a6640-ef3e5086-ca2989c6-f40b9322_0] Write session: try to update token
2025-10-10T14:40:00.973745Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|466a6640-ef3e5086-ca2989c6-f40b9322_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:00.987832Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:00.987854Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:00.987857Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:00.987859Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:00.987871Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602862990215363:12434]
2025-10-10T14:40:00.987876Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602862990215363:12434]
2025-10-10T14:40:00.987881Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602862990215363:12434]
2025-10-10T14:40:00.987935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:00.987944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:00.987946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:00.988086Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:00.989852Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:00.989875Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:00.989883Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:00.996709Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602863772465939:4596]
2025-10-10T14:40:00.997128Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 pipe creation result: OK TabletId: 72075186224037892 Generation: 3171, pipe: [1:7559602863772465939:4596]
2025-10-10T14:40:01.004003Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3172 sessionId: src_id|466a6640-ef3e5086-ca2989c6-f40b9322_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:01.006895Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:01.119105Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:01.119418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602863772465939:4596], now have 1 active actors on pipe
2025-10-10T14:40:01.119493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:01.119502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:01.119861Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:01.120555Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 70 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602863772465939:4596]
2025-10-10T14:40:01.120603Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:40:01.120688Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3172 reason: status is not ok: tablet will be restarted right now sessionId: src_id|466a6640-ef3e5086-ca2989c6-f40b9322_0
2025-10-10T14:40:01.120933Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3172 sessionId: src_id|466a6640-ef3e5086-ca2989c6-f40b9322_0 is DEAD
2025-10-10T14:40:01.121081Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:01.121356Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|466a6640-ef3e5086-ca2989c6-f40b9322_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:40:01.121369Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|466a6640-ef3e5086-ca2989c6-f40b9322_0] Write session will restart in 0.008711s
2025-10-10T14:40:01.121398Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|466a6640-ef3e5086-ca2989c6-f40b9322_0] Write session: Do CDS request
2025-10-10T14:40:01.121405Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|466a6640-ef3e5086-ca2989c6-f40b9322_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:01.131564Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|466a6640-ef3e5086-ca2989c6-f40b9322_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:01.132243Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:01.132265Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3173
2025-10-10T14:40:01.133209Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3173 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:01.133256Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3173 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:01.133263Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3173 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:01.133268Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:01.133947Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3173 sessionId:  describe result for acl check
2025-10-10T14:40:01.134006Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:01.134014Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:01.134017Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:01.134024Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602868067433249:3413] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:01.134716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602868067433249:3413] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:01.140378Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602868067433249:3413] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:01.152046Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602868067433249:3413] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:01.152073Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602868067433249:3413] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:01.152077Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602868067433249:3413] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:01.152088Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3173 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:01.181262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:01.182299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:01.182540Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:01.182556Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:01.182571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:01.182636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:01.182696Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602867285182928:12436]
2025-10-10T14:40:01.183393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:01.183815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:01.183883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:01.184260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:01.184327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:01.184333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:01.184335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:01.184337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:01.184338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:01.184340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:01.184342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:01.184343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:01.184345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:01.184346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:01.184347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:01.184349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:01.184350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:01.184357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:01.184372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:01.184376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:01.184381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:01.184385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:01.184390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:01.184395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:01.184400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:01.184404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:01.184409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:01.184413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:01.184418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:01.184422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:01.184430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:01.184440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:01.184448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:01.184455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:01.184467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:01.184473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:01.184484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:01.184502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:01.184511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:01.184517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:01.184530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:01.184541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:01.184546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:01.184553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:01.184559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:01.184565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:01.184574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:01.184580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:01.184584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:01.184590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:01.184595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:01.184606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:01.184611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:01.184622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:01.184627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:01.184633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:01.184680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:01.187584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:01.188574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:01.188592Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:01.188595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:01.188600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:01.188608Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3172 [2:7559602867285182928:12436]
2025-10-10T14:40:01.188622Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:01.188647Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:01.188656Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:01.188660Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:01.188662Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:01.188682Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:01.188695Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:01.188710Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:01.188788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:01.188796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:01.188798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:01.188801Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:01.188887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:01.188896Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:01.188912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:01.188929Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:01.188950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:01.188985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602868067433308:3413], now have 1 active actors on pipe
2025-10-10T14:40:01.188989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602868067433237:2438], now have 1 active actors on pipe
2025-10-10T14:40:01.188998Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602867285182923:12436]
2025-10-10T14:40:01.189001Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602867285182923:12436]
2025-10-10T14:40:01.189003Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602867285182923:12436]
2025-10-10T14:40:01.189021Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:01.189041Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:01.189045Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:01.189050Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:01.189052Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:01.189064Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:01.189068Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:01.189054Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3172
2025-10-10T14:40:01.189101Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3172
2025-10-10T14:40:01.189115Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602867285182923:12436]
2025-10-10T14:40:01.189124Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:01.189129Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:01.189145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:01.189157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:01.189226Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|330caa55-a68fcc00-1328109c-ae3f09b9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:01.189240Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:01.189251Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:01.189254Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:01.189265Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:01.189283Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:01.189311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:01.189544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:01.189558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:01.189581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:01.189694Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3173 partition: 0 MaxSeqNo: 40 sessionId: src_id|330caa55-a68fcc00-1328109c-ae3f09b9_0
2025-10-10T14:40:01.193324Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|466a6640-ef3e5086-ca2989c6-f40b9322_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|330caa55-a68fcc00-1328109c-ae3f09b9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:01.196189Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|330caa55-a68fcc00-1328109c-ae3f09b9_0] Write session: try to update token
2025-10-10T14:40:01.196216Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|330caa55-a68fcc00-1328109c-ae3f09b9_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:01.213285Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3173 sessionId: src_id|330caa55-a68fcc00-1328109c-ae3f09b9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:01.214836Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:01.214857Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:01.214861Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:01.214863Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:01.214874Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602867285182923:12436]
2025-10-10T14:40:01.214879Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602867285182923:12436]
2025-10-10T14:40:01.214884Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602867285182923:12436]
2025-10-10T14:40:01.214938Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:01.214941Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:01.214949Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:01.214951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:01.214954Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:01.214954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:01.215123Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:01.216577Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:01.220825Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602868067433566:4596]
2025-10-10T14:40:01.221122Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 pipe creation result: OK TabletId: 72075186224037892 Generation: 3172, pipe: [1:7559602868067433566:4596]
2025-10-10T14:40:01.334439Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:01.334808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:01.334831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:01.334861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602868067433566:4596], now have 1 active actors on pipe
2025-10-10T14:40:01.335186Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:01.335245Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:40:01.335316Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 71 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602868067433566:4596]
2025-10-10T14:40:01.335325Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3173 reason: status is not ok: tablet will be restarted right now sessionId: src_id|330caa55-a68fcc00-1328109c-ae3f09b9_0
2025-10-10T14:40:01.335175Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:01.335566Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3173 sessionId: src_id|330caa55-a68fcc00-1328109c-ae3f09b9_0 is DEAD
2025-10-10T14:40:01.335946Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|330caa55-a68fcc00-1328109c-ae3f09b9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:40:01.335960Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|330caa55-a68fcc00-1328109c-ae3f09b9_0] Write session will restart in 0.006262s
2025-10-10T14:40:01.336002Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|330caa55-a68fcc00-1328109c-ae3f09b9_0] Write session: Do CDS request
2025-10-10T14:40:01.336009Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|330caa55-a68fcc00-1328109c-ae3f09b9_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:01.345917Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|330caa55-a68fcc00-1328109c-ae3f09b9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:01.346887Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:01.346909Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3174
2025-10-10T14:40:01.347056Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3174 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:01.347093Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3174 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:01.347105Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3174 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:01.347109Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:01.347776Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3174 sessionId:  describe result for acl check
2025-10-10T14:40:01.347835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:01.347843Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:01.347846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:01.347854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602868067433623:3408] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:01.348549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602868067433623:3408] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:01.352373Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602868067433623:3408] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:01.357630Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602868067433623:3408] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:01.357662Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602868067433623:3408] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:01.357668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602868067433623:3408] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:01.357682Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3174 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:01.365126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:01.371278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:01.371580Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:01.371597Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:01.371611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:01.371687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:01.371741Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602867285183195:12439]
2025-10-10T14:40:01.372382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:01.372778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:01.372844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:01.373187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:01.373260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:01.373267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:01.373269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:01.373270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:01.373271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:01.373273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:01.373274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:01.373275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:01.373276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:01.373277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:01.373278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:01.373280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:01.373281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:01.373288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:01.373303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:01.373308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:01.373312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:01.373316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:01.373321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:01.373325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:01.373345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:01.373349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:01.373354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:01.373358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:01.373362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:01.373366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:01.373377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:01.373386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:01.373393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:01.373399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:01.373404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:01.373409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:01.373414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:01.373420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:01.373426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:01.373431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:01.373436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:01.373442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:01.373447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:01.373453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:01.373458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:01.373464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:01.373469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:01.373475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:01.373480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:01.373486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:01.373497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:01.373503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:01.373507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:01.373513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:01.373522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:01.373543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:01.373585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:01.376372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:01.376734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:01.376748Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:01.376751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:01.376755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:01.376763Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3173 [2:7559602867285183195:12439]
2025-10-10T14:40:01.376777Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:01.376797Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:01.376804Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:01.376809Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:01.376812Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:01.376832Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:01.376840Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:01.376851Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:01.376922Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:01.376930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:01.376932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:01.376946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:01.377023Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:01.377031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:01.377044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:01.377058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:01.377078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:01.377116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602868067433788:3408], now have 1 active actors on pipe
2025-10-10T14:40:01.377125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602868067433569:2438], now have 1 active actors on pipe
2025-10-10T14:40:01.377133Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602867285183190:12439]
2025-10-10T14:40:01.377136Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602867285183190:12439]
2025-10-10T14:40:01.377138Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602867285183190:12439]
2025-10-10T14:40:01.377154Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:01.377170Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:01.377173Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:01.377181Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:01.377189Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:01.377189Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:01.377192Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:01.377222Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602867285183190:12439]
2025-10-10T14:40:01.377231Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:01.377233Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:01.377257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:01.377267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:01.377312Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a71c95e9-828e58be-e4b37a94-d8bbb833_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:01.377325Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:01.377343Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:01.377345Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:01.377357Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:01.377369Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:01.377393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:01.377191Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3173
2025-10-10T14:40:01.377202Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3173
2025-10-10T14:40:01.377551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:01.377562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:01.377580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:01.377672Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3174 partition: 0 MaxSeqNo: 40 sessionId: src_id|a71c95e9-828e58be-e4b37a94-d8bbb833_0
2025-10-10T14:40:01.377959Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|330caa55-a68fcc00-1328109c-ae3f09b9_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|a71c95e9-828e58be-e4b37a94-d8bbb833_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:01.380967Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a71c95e9-828e58be-e4b37a94-d8bbb833_0] Write session: try to update token
2025-10-10T14:40:01.380985Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a71c95e9-828e58be-e4b37a94-d8bbb833_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:01.398417Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:01.398446Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:01.398449Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:01.398452Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:01.398464Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602867285183190:12439]
2025-10-10T14:40:01.398470Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602867285183190:12439]
2025-10-10T14:40:01.398476Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602867285183190:12439]
2025-10-10T14:40:01.398539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:01.398553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:01.398556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:01.398562Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:01.398573Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:01.398584Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:01.398734Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:01.402132Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3174 sessionId: src_id|a71c95e9-828e58be-e4b37a94-d8bbb833_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:01.404847Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:01.435374Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602868067433911:4596]
2025-10-10T14:40:01.435765Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 pipe creation result: OK TabletId: 72075186224037892 Generation: 3173, pipe: [1:7559602868067433911:4596]
2025-10-10T14:40:01.527773Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:01.529589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:01.529621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:01.529666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602868067433911:4596], now have 1 active actors on pipe
2025-10-10T14:40:01.530102Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:40:01.530128Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:40:01.530175Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:01.530204Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:01.530642Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a71c95e9-828e58be-e4b37a94-d8bbb833_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:40:01.530654Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a71c95e9-828e58be-e4b37a94-d8bbb833_0] Write session will restart in 0.009026s
2025-10-10T14:40:01.530210Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3174 reason: error at write: Disconnected sessionId: src_id|a71c95e9-828e58be-e4b37a94-d8bbb833_0
2025-10-10T14:40:01.530693Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a71c95e9-828e58be-e4b37a94-d8bbb833_0] Write session: Do CDS request
2025-10-10T14:40:01.530700Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a71c95e9-828e58be-e4b37a94-d8bbb833_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:01.530222Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 72 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602868067433911:4596]
2025-10-10T14:40:01.530446Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3174 sessionId: src_id|a71c95e9-828e58be-e4b37a94-d8bbb833_0 is DEAD
2025-10-10T14:40:01.541045Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a71c95e9-828e58be-e4b37a94-d8bbb833_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:01.541403Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:01.541429Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3175
2025-10-10T14:40:01.541616Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3175 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:01.541683Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3175 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:01.541700Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3175 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:01.541706Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:01.542200Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3175 sessionId:  describe result for acl check
2025-10-10T14:40:01.542250Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:01.542252Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:01.542260Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:01.542266Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602868067433937:3363] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:01.542853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602868067433937:3363] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:01.546604Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602868067433937:3363] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:01.550073Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602868067433937:3363] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:01.550095Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602868067433937:3363] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:01.550099Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602868067433937:3363] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:01.550108Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3175 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:01.570038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:01.570928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:01.571384Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:01.571398Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:01.571413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:01.571483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:01.571533Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602867285183475:12443]
2025-10-10T14:40:01.572141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:01.572567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:01.572623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:01.572995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:01.573059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:01.573065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:01.573070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:01.573071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:01.573073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:01.573074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:01.573075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:01.573076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:01.573077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:01.573079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:01.573080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:01.573081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:01.573082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:01.573089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:01.573102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:01.573106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:01.573110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:01.573114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:01.573118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:01.573123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:01.573127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:01.573131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:01.573135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:01.573140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:01.573144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:01.573148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:01.573156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:01.573165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:01.573173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:01.573180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:01.573185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:01.573190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:01.573195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:01.573200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:01.573204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:01.573209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:01.573213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:01.573218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:01.573223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:01.573228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:01.573231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:01.573236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:01.573242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:01.573247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:01.573251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:01.573256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:01.573260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:01.573265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:01.573270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:01.573275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:01.573279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:01.573284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:01.573323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:01.576021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:01.576579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:01.576601Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:01.576604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:01.576608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:01.576615Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3174 [2:7559602867285183475:12443]
2025-10-10T14:40:01.576629Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:01.576649Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:01.576656Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:01.576659Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:01.576661Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:01.576679Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:01.576694Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:01.576702Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:01.576766Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:01.576773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:01.576775Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:01.576779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:01.576848Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:01.576855Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:01.576867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:01.576881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:01.576902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:01.577065Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3174
2025-10-10T14:40:01.577134Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3174
2025-10-10T14:40:01.576927Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602867285183470:12443]
2025-10-10T14:40:01.576934Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602867285183470:12443]
2025-10-10T14:40:01.576936Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602867285183470:12443]
2025-10-10T14:40:01.576946Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:01.576961Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:01.576966Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:01.576972Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:01.576974Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:01.576977Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:01.576980Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:01.576991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602868067433914:2438], now have 1 active actors on pipe
2025-10-10T14:40:01.576994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602868067434069:3363], now have 1 active actors on pipe
2025-10-10T14:40:01.577024Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602867285183470:12443]
2025-10-10T14:40:01.577033Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:01.577044Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:01.577273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:01.577279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:01.577322Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dd326e34-10c919b4-ea449a80-ea1e3b59_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:01.577342Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:01.577348Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:01.577350Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:01.577365Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:01.577376Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:01.577390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:01.577621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:01.577630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:01.577645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:01.577724Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3175 partition: 0 MaxSeqNo: 40 sessionId: src_id|dd326e34-10c919b4-ea449a80-ea1e3b59_0
2025-10-10T14:40:01.578196Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a71c95e9-828e58be-e4b37a94-d8bbb833_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|dd326e34-10c919b4-ea449a80-ea1e3b59_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:01.580937Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dd326e34-10c919b4-ea449a80-ea1e3b59_0] Write session: try to update token
2025-10-10T14:40:01.580955Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dd326e34-10c919b4-ea449a80-ea1e3b59_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:01.607050Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:01.607073Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:01.607076Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:01.607078Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:01.607089Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602867285183470:12443]
2025-10-10T14:40:01.607094Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602867285183470:12443]
2025-10-10T14:40:01.607098Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602867285183470:12443]
2025-10-10T14:40:01.607147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:01.607155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:01.607157Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:01.607165Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:01.607175Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:01.607180Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:01.607314Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:01.607359Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3175 sessionId: src_id|dd326e34-10c919b4-ea449a80-ea1e3b59_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:01.610226Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:01.630489Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602868067434268:4596]
2025-10-10T14:40:01.630990Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 pipe creation result: OK TabletId: 72075186224037892 Generation: 3174, pipe: [1:7559602868067434268:4596]
2025-10-10T14:40:01.726454Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:01.726744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:01.726760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:01.726807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602868067434268:4596], now have 1 active actors on pipe
2025-10-10T14:40:01.727048Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:01.727078Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 73 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602868067434268:4596]
2025-10-10T14:40:01.727052Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:01.727110Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:40:01.727123Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:40:01.727185Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3175 reason: error at write: Disconnected sessionId: src_id|dd326e34-10c919b4-ea449a80-ea1e3b59_0
2025-10-10T14:40:01.727415Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3175 sessionId: src_id|dd326e34-10c919b4-ea449a80-ea1e3b59_0 is DEAD
2025-10-10T14:40:01.728032Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd326e34-10c919b4-ea449a80-ea1e3b59_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:40:01.728043Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd326e34-10c919b4-ea449a80-ea1e3b59_0] Write session will restart in 0.009370s
2025-10-10T14:40:01.728068Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd326e34-10c919b4-ea449a80-ea1e3b59_0] Write session: Do CDS request
2025-10-10T14:40:01.728096Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd326e34-10c919b4-ea449a80-ea1e3b59_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:01.738985Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dd326e34-10c919b4-ea449a80-ea1e3b59_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:01.739097Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:01.739118Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3176
2025-10-10T14:40:01.739241Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3176 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:01.739280Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3176 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:01.739287Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3176 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:01.739291Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:01.739902Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3176 sessionId:  describe result for acl check
2025-10-10T14:40:01.739943Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:01.739945Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:01.739947Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:01.739954Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602868067434355:3334] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:01.740647Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602868067434355:3334] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:01.747618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602868067434355:3334] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:01.750604Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602868067434355:3334] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:01.750626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602868067434355:3334] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:01.750630Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602868067434355:3334] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:01.750641Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3176 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:01.753776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:01.759569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:01.759864Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:01.759879Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:01.759895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:01.759966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:01.760015Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602867285183779:12457]
2025-10-10T14:40:01.760641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:01.761020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:01.761068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:01.761430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:01.761497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:01.761504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:01.761505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:01.761506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:01.761508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:01.761509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:01.761511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:01.761512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:01.761514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:01.761515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:01.761516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:01.761518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:01.761519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:01.761526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:01.761539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:01.761544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:01.761549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:01.761553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:01.761558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:01.761562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:01.761566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:01.761570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:01.761575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:01.761579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:01.761584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:01.761588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:01.761597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:01.761605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:01.761614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:01.761621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:01.761626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:01.761631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:01.761636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:01.761640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:01.761645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:01.761651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:01.761659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:01.761664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:01.761669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:01.761673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:01.761677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:01.761683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:01.761694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:01.761699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:01.761703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:01.761713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:01.761718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:01.761723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:01.761732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:01.761737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:01.761742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:01.761748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:01.761788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:01.764530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:01.765715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:01.765726Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:01.765728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:01.765732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:01.765741Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3175 [2:7559602867285183779:12457]
2025-10-10T14:40:01.765758Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:01.765777Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:01.765780Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:01.765784Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:01.765786Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:01.765804Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:01.765811Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:01.765819Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:01.765897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:01.765905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:01.765907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:01.765909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:01.765986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:01.765993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:01.766006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:01.766022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:01.766044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:01.766070Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602867285183774:12457]
2025-10-10T14:40:01.766077Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602867285183774:12457]
2025-10-10T14:40:01.766079Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602867285183774:12457]
2025-10-10T14:40:01.766088Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:01.766106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602868067434588:3334], now have 1 active actors on pipe
2025-10-10T14:40:01.766123Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:01.766139Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:01.766138Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:01.766142Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:01.766142Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:01.766144Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:01.766172Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602867285183774:12457]
2025-10-10T14:40:01.766175Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:01.766180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602868067434271:2438], now have 1 active actors on pipe
2025-10-10T14:40:01.766171Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3175
2025-10-10T14:40:01.766190Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:01.766219Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3175
2025-10-10T14:40:01.766393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:01.766403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:01.766437Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|daf0c087-4216d549-c5909eec-140cee20_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:01.766449Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:01.766455Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:01.766457Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:01.766468Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:01.766484Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:01.766503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:01.766734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:01.766740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:01.766754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:01.766870Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3176 partition: 0 MaxSeqNo: 40 sessionId: src_id|daf0c087-4216d549-c5909eec-140cee20_0
2025-10-10T14:40:01.767331Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd326e34-10c919b4-ea449a80-ea1e3b59_0] Counters: { Errors: 0 CurrentSessionLifetimeMs: 189 BytesWritten: 90112070 MessagesWritten: 40 BytesWrittenCompressed: 0 BytesInflightUncompressed: 22528020 BytesInflightCompressed: 0 BytesInflightTotal: 20275218 MessagesInflight: 10 }
2025-10-10T14:40:01.767380Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd326e34-10c919b4-ea449a80-ea1e3b59_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|daf0c087-4216d549-c5909eec-140cee20_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:01.770217Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|daf0c087-4216d549-c5909eec-140cee20_0] Write session: try to update token
2025-10-10T14:40:01.770242Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|daf0c087-4216d549-c5909eec-140cee20_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:01.786518Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3176 sessionId: src_id|daf0c087-4216d549-c5909eec-140cee20_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:01.787026Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:01.787049Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:01.787053Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:01.787055Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:01.787067Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602867285183774:12457]
2025-10-10T14:40:01.787072Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602867285183774:12457]
2025-10-10T14:40:01.787076Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602867285183774:12457]
2025-10-10T14:40:01.787132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:01.787137Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:01.787144Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:01.787146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:01.787148Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:01.787149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:01.787311Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:01.789246Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:01.827008Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602868067434605:4596]
2025-10-10T14:40:01.827353Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 pipe creation result: OK TabletId: 72075186224037892 Generation: 3175, pipe: [1:7559602868067434605:4596]
2025-10-10T14:40:01.910802Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:01.911110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:01.911132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:01.911190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602868067434605:4596], now have 1 active actors on pipe
2025-10-10T14:40:01.911450Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:01.911447Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:40:01.911454Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:01.911464Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:40:01.911516Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 74 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602868067434605:4596]
2025-10-10T14:40:01.911538Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3176 reason: error at write: Disconnected sessionId: src_id|daf0c087-4216d549-c5909eec-140cee20_0
2025-10-10T14:40:01.911752Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3176 sessionId: src_id|daf0c087-4216d549-c5909eec-140cee20_0 is DEAD
2025-10-10T14:40:01.911904Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|daf0c087-4216d549-c5909eec-140cee20_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:40:01.911916Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|daf0c087-4216d549-c5909eec-140cee20_0] Write session will restart in 0.006292s
2025-10-10T14:40:01.911955Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|daf0c087-4216d549-c5909eec-140cee20_0] Write session: Do CDS request
2025-10-10T14:40:01.911966Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|daf0c087-4216d549-c5909eec-140cee20_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:01.919993Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|daf0c087-4216d549-c5909eec-140cee20_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:01.920106Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:01.920128Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3177
2025-10-10T14:40:01.920351Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3177 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:01.920398Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3177 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:01.920405Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3177 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:01.920415Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:01.920988Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3177 sessionId:  describe result for acl check
2025-10-10T14:40:01.921029Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:01.921037Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:01.921039Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:01.921046Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602868067434640:3322] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:01.921660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602868067434640:3322] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:01.924018Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602868067434640:3322] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:01.928496Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602868067434640:3322] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:01.928520Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602868067434640:3322] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:01.928525Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602868067434640:3322] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:01.928535Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3177 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:01.962516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:01.969567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:01.969850Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:01.969868Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:01.969882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:01.969965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:01.970015Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602867285184046:12459]
2025-10-10T14:40:01.970618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:01.971041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:01.971094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:01.971450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:01.971511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:01.971518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:01.971520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:01.971522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:01.971523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:01.971525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:01.971527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:01.971529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:01.971530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:01.971532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:01.971533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:01.971535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:01.971537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:01.971544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:01.971558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:01.971563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:01.971568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:01.971571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:01.971576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:01.971581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:01.971586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:01.971590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:01.971596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:01.971604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:01.971609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:01.971614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:01.971624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:01.971638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:01.971649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:01.971660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:01.971669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:01.971677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:01.971685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:01.971693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:01.971698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:01.971704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:01.971713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:01.971720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:01.971727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:01.971737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:01.971742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:01.971763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:01.971768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:01.971774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:01.971778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:01.971783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:01.971786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:01.971789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:01.971791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:01.971795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:01.971798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:01.971801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:01.971825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:01.975338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:01.976300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:01.976318Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:01.976321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:01.976326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:01.976335Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3176 [2:7559602867285184046:12459]
2025-10-10T14:40:01.976350Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:01.976372Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:01.976376Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:01.976380Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:01.976391Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:01.976411Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:01.976420Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:01.976429Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:01.976512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:01.976519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:01.976521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:01.976523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:01.976620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:01.976628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:01.976642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:01.976657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:01.976673Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:01.976707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602868067434623:2438], now have 1 active actors on pipe
2025-10-10T14:40:01.976710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602868067434726:3322], now have 1 active actors on pipe
2025-10-10T14:40:01.976719Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602867285184041:12459]
2025-10-10T14:40:01.976721Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602867285184041:12459]
2025-10-10T14:40:01.976723Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602867285184041:12459]
2025-10-10T14:40:01.976736Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:01.976752Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:01.976753Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:01.976757Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:01.976759Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:01.976769Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:01.976772Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:01.976811Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602867285184041:12459]
2025-10-10T14:40:01.976824Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:01.976831Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:01.976837Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3176
2025-10-10T14:40:01.976889Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3176
2025-10-10T14:40:01.977043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:01.977055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:01.977092Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fcf885ff-2a74f30c-91434b70-4d50c0a7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:01.977110Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:01.977114Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:01.977117Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:01.977131Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:01.977143Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:01.977159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:01.977430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:01.977441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:01.977461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:01.978083Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|daf0c087-4216d549-c5909eec-140cee20_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|fcf885ff-2a74f30c-91434b70-4d50c0a7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:01.977578Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3177 partition: 0 MaxSeqNo: 40 sessionId: src_id|fcf885ff-2a74f30c-91434b70-4d50c0a7_0
2025-10-10T14:40:01.981071Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fcf885ff-2a74f30c-91434b70-4d50c0a7_0] Write session: try to update token
2025-10-10T14:40:01.981088Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fcf885ff-2a74f30c-91434b70-4d50c0a7_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:01.996625Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3177 sessionId: src_id|fcf885ff-2a74f30c-91434b70-4d50c0a7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:01.998138Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:40:01.998160Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:01.998171Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602867285184041:12459]
2025-10-10T14:40:01.998223Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:40:01.998230Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:40:01.998410Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:40:01.998556Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:01.998702Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:01.998848Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:01.999056Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:40:01.999103Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:40:01.999371Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:01.999539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:01.999552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:01.999588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:40:01.999678Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:40:02.010374Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602872362402257:4596]
2025-10-10T14:40:02.010744Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 pipe creation result: OK TabletId: 72075186224037892 Generation: 3176, pipe: [1:7559602872362402257:4596]
2025-10-10T14:40:02.010647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602872362402257:4596], now have 1 active actors on pipe
2025-10-10T14:40:02.023484Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:02.023508Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:02.023512Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:02.023515Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:02.023527Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602867285184041:12459]
2025-10-10T14:40:02.023532Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602867285184041:12459]
2025-10-10T14:40:02.023536Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602867285184041:12459]
2025-10-10T14:40:02.023592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:02.023597Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:02.023605Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:02.023605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:02.023608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:02.023610Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:02.023746Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:02.146276Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:02.156211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:02.156361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:02.156584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:02.156658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:02.156724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:02.156789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:02.156833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:02.156838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:02.156914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:02.156984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:02.157051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:02.157124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:02.157171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:02.157175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:02.157247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:02.157311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:02.157402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:02.157468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:02.157513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:02.157519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:02.157596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:02.157664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:02.157729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:02.157795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:02.157838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:02.157841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:02.157917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:02.157978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:02.158043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:02.158107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:02.158149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:02.158152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:02.158226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:02.158288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:02.158352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:02.158419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:02.158463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:02.158467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:02.158542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:02.158602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:02.158666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:02.158731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:02.158775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:02.158779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:02.158853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:02.158916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:02.158977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:02.159040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:02.159085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:02.159089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:02.159160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:02.159227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:02.159294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:02.159359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:02.159403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:02.159406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:02.159481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:02.159551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:02.159616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:02.159684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:02.159727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:02.159731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:02.161162Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:02.161197Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 75 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602872362402257:4596]
2025-10-10T14:40:02.161208Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:02.161243Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:40:02.161246Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:40:02.161284Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3177 reason: error at write: Disconnected sessionId: src_id|fcf885ff-2a74f30c-91434b70-4d50c0a7_0
2025-10-10T14:40:02.161579Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3177 sessionId: src_id|fcf885ff-2a74f30c-91434b70-4d50c0a7_0 is DEAD
2025-10-10T14:40:02.169448Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fcf885ff-2a74f30c-91434b70-4d50c0a7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:40:02.169464Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fcf885ff-2a74f30c-91434b70-4d50c0a7_0] Write session will restart in 0.007316s
2025-10-10T14:40:02.169492Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fcf885ff-2a74f30c-91434b70-4d50c0a7_0] Write session: Do CDS request
2025-10-10T14:40:02.169498Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fcf885ff-2a74f30c-91434b70-4d50c0a7_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:02.187785Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fcf885ff-2a74f30c-91434b70-4d50c0a7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:02.187910Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:02.187931Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3178
2025-10-10T14:40:02.188084Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3178 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:02.188124Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3178 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:02.188139Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3178 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:02.188143Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:02.188638Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3178 sessionId:  describe result for acl check
2025-10-10T14:40:02.188683Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:02.188691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:02.188697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:02.188704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602872362402506:3298] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:02.189272Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602872362402506:3298] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:02.198240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:02.204353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:02.204958Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:02.204964Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:02.204979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:02.205047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:02.205088Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602871580151609:12461]
2025-10-10T14:40:02.205771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:02.206836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602872362402506:3298] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:02.215790Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602872362402506:3298] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:02.215811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602872362402506:3298] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:02.215815Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602872362402506:3298] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:02.215825Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3178 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:02.216719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:02.216819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:02.217190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:02.217285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:02.217287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:02.217288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:02.217290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:02.217291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:02.217293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:02.217295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:02.217296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:02.217297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:02.217299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:02.217300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:02.217302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:02.217303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:02.217312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:02.217326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:02.217342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:02.217346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:02.217350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:02.217355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:02.217359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:02.217363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:02.217367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:02.217374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:02.217379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:02.217383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:02.217387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:02.217399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:02.217408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:02.217416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:02.217423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:02.217428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:02.217434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:02.217440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:02.217446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:02.217451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:02.217458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:02.217463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:02.217468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:02.217474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:02.217479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:02.217484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:02.217489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:02.217497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:02.217502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:02.217506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:02.217510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:02.217513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:02.217516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:02.217519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:02.217523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:02.217527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:02.217530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:02.217555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:02.226998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:02.227825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:02.227843Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:02.227847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:02.227851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:02.227859Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3177 [2:7559602871580151609:12461]
2025-10-10T14:40:02.227874Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:02.227899Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:02.227913Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:02.227917Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:02.227920Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:02.227941Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:02.227950Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:02.227959Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:02.228040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:02.228048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:02.228050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:02.228053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:02.228137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:02.228147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:02.228161Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:02.228172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:02.228190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:02.228213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602872362402260:2438], now have 1 active actors on pipe
2025-10-10T14:40:02.228222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602872362402581:3298], now have 1 active actors on pipe
2025-10-10T14:40:02.228230Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602871580151604:12461]
2025-10-10T14:40:02.228232Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602871580151604:12461]
2025-10-10T14:40:02.228235Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602871580151604:12461]
2025-10-10T14:40:02.228249Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:02.228267Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:02.228272Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:02.228276Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:02.228279Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:02.228283Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:02.228286Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:02.228331Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602871580151604:12461]
2025-10-10T14:40:02.228339Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:02.228345Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:02.228981Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3177
2025-10-10T14:40:02.229038Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3177
2025-10-10T14:40:02.229160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:02.229175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:02.229210Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|27bff09d-abe33dc6-5373a866-5376a088_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:02.229225Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:02.229231Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:02.229234Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:02.229248Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:02.229267Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:02.229292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:02.229506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:02.229518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:02.229536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:02.229737Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3178 partition: 0 MaxSeqNo: 40 sessionId: src_id|27bff09d-abe33dc6-5373a866-5376a088_0
2025-10-10T14:40:02.230171Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fcf885ff-2a74f30c-91434b70-4d50c0a7_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|27bff09d-abe33dc6-5373a866-5376a088_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:02.232936Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|27bff09d-abe33dc6-5373a866-5376a088_0] Write session: try to update token
2025-10-10T14:40:02.232956Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|27bff09d-abe33dc6-5373a866-5376a088_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:02.255041Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3178 sessionId: src_id|27bff09d-abe33dc6-5373a866-5376a088_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:02.257876Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:02.258135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:02.258160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:02.258219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:40:02.259199Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:40:02.261380Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:02.261398Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:02.261403Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:02.261405Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:02.261418Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602871580151604:12461]
2025-10-10T14:40:02.261423Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602871580151604:12461]
2025-10-10T14:40:02.261427Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602871580151604:12461]
2025-10-10T14:40:02.261480Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:02.261488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:02.261491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:02.261634Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:02.265317Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:02.265344Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:02.265349Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:02.268714Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602872362402593:4596]
2025-10-10T14:40:02.269116Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 pipe creation result: OK TabletId: 72075186224037892 Generation: 3177, pipe: [1:7559602872362402593:4596]
2025-10-10T14:40:02.385450Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:02.385964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602872362402593:4596], now have 1 active actors on pipe
2025-10-10T14:40:02.395579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:02.395614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:02.395813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:02.395875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:02.395940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:02.396003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:02.396046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:02.396052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:02.396127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:02.396191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:02.396259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:02.396333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:02.396376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:02.396380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:02.396450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:02.396525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:02.396588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:02.396655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:02.396696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:02.396698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:02.396769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:02.396838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:02.396903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:02.396964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:02.397004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:02.397007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:02.397078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:02.397137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:02.397197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:02.397256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:02.397299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:02.397302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:02.397574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:02.397648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:02.397717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:02.397784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:02.397834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:02.397842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:02.397914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:02.397978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:02.399393Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:02.399407Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 76 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602872362402593:4596]
2025-10-10T14:40:02.399452Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:40:02.399454Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:40:02.399487Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3178 reason: error at write: Disconnected sessionId: src_id|27bff09d-abe33dc6-5373a866-5376a088_0
2025-10-10T14:40:02.399725Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3178 sessionId: src_id|27bff09d-abe33dc6-5373a866-5376a088_0 is DEAD
2025-10-10T14:40:02.399923Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|27bff09d-abe33dc6-5373a866-5376a088_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:40:02.399946Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|27bff09d-abe33dc6-5373a866-5376a088_0] Write session will restart in 0.009339s
2025-10-10T14:40:02.399974Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|27bff09d-abe33dc6-5373a866-5376a088_0] Write session: Do CDS request
2025-10-10T14:40:02.399980Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|27bff09d-abe33dc6-5373a866-5376a088_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:02.398046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:02.398116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:02.398165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:02.398170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:02.398239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:02.398296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:02.398355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:02.398417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:02.398456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:02.398461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:02.398531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:02.398589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:02.398650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:02.398711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:02.398761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:02.398765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:02.398833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:02.398893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:02.398956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:02.399019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:02.399058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:02.399060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:02.400403Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:02.413841Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|27bff09d-abe33dc6-5373a866-5376a088_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:02.413919Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:02.413940Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3179
2025-10-10T14:40:02.414403Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3179 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:02.414446Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3179 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:02.414452Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3179 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:02.414457Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:02.414992Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3179 sessionId:  describe result for acl check
2025-10-10T14:40:02.415034Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:02.415036Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:02.415040Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:02.415047Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602872362402693:3291] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:02.415744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602872362402693:3291] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:02.418779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602872362402693:3291] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:02.422576Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602872362402693:3291] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:02.422597Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602872362402693:3291] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:02.422601Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602872362402693:3291] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:02.422610Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3179 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:02.428503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:02.436316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:02.436656Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:02.436675Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:02.436691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:02.436784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:02.436843Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602871580151882:12464]
2025-10-10T14:40:02.437543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:02.437961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:02.438036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:02.438404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:02.438500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:02.438516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:02.438517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:02.438519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:02.438520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:02.438522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:02.438524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:02.438525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:02.438527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:02.438528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:02.438530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:02.438531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:02.438532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:02.438540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:02.438554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:02.438557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:02.438561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:02.438565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:02.438568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:02.438572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:02.438575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:02.438578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:02.438582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:02.438586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:02.438589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:02.438593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:02.438603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:02.438612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:02.438618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:02.438623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:02.438628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:02.438633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:02.438637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:02.438642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:02.438647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:02.438655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:02.438659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:02.438665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:02.438672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:02.438680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:02.438686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:02.438692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:02.438698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:02.438703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:02.438711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:02.438716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:02.438721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:02.438725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:02.438730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:02.438735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:02.438740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:02.438745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:02.438790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:02.445887Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3178
2025-10-10T14:40:02.445897Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3178
2025-10-10T14:40:02.445061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:02.445456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:02.445462Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:02.445464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:02.445469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:02.445477Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3178 [2:7559602871580151882:12464]
2025-10-10T14:40:02.445494Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:02.445518Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:02.445523Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:02.445528Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:02.445531Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:02.445559Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:02.445567Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:02.445576Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:02.445659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:02.445662Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:02.445664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:02.445666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:02.445766Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:02.445770Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:02.445785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:02.445796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:02.445811Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:02.445837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602872362402889:3291], now have 1 active actors on pipe
2025-10-10T14:40:02.445841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602872362402596:2438], now have 1 active actors on pipe
2025-10-10T14:40:02.445850Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602871580151877:12464]
2025-10-10T14:40:02.445853Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602871580151877:12464]
2025-10-10T14:40:02.445855Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602871580151877:12464]
2025-10-10T14:40:02.445873Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:02.445888Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:02.445889Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:02.445891Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:02.445894Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:02.445907Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:02.445911Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:02.445961Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602871580151877:12464]
2025-10-10T14:40:02.445979Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:02.445997Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:02.446322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:02.446340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:02.446390Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|62f8114d-ac4d563a-8450cd8-f479e319_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:02.446406Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:02.446416Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:02.446418Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:02.446432Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:02.446451Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:02.446469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:02.446665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:02.446681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:02.446702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:02.446838Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3179 partition: 0 MaxSeqNo: 40 sessionId: src_id|62f8114d-ac4d563a-8450cd8-f479e319_0
2025-10-10T14:40:02.447289Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|27bff09d-abe33dc6-5373a866-5376a088_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|62f8114d-ac4d563a-8450cd8-f479e319_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:02.450521Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|62f8114d-ac4d563a-8450cd8-f479e319_0] Write session: try to update token
2025-10-10T14:40:02.450550Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|62f8114d-ac4d563a-8450cd8-f479e319_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:02.465892Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:40:02.465913Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:02.465925Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602871580151877:12464]
2025-10-10T14:40:02.465981Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:40:02.466166Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:40:02.466480Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3179 sessionId: src_id|62f8114d-ac4d563a-8450cd8-f479e319_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:02.466837Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:02.466972Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:02.467100Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:02.467132Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:40:02.467280Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:40:02.467319Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:40:02.469587Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:02.469821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:02.469853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:02.469895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:40:02.470021Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:40:02.498630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:02.498655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:02.498824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:02.498880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:02.498940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:02.499010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:02.499054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:02.499059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:02.499124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:02.499180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:02.499240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:02.499321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:02.499367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:02.499376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:02.499440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:02.499507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:02.499573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:02.499635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:02.499678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:02.499684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:02.499756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:02.499822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:02.500339Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602872362402931:4596]
2025-10-10T14:40:02.499883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:02.499941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:02.499986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:02.499990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:02.500066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:02.500124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:02.500181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:02.500237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:02.500285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:02.500289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:02.500360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:02.500426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:02.500509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:02.500585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:02.500639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:02.500648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:02.500722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:02.500791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:02.500859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:02.500922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:02.500967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:02.500973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:02.501003Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 pipe creation result: OK TabletId: 72075186224037892 Generation: 3178, pipe: [1:7559602872362402931:4596]
2025-10-10T14:40:02.501047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:02.501119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:02.501180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:02.501242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:02.501281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:02.501284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:02.501373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:02.501436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:02.501500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:02.501566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:02.501611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:02.501617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:02.501681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:02.501749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:02.501818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:02.501888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:02.501934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:02.501937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:02.502034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602872362402931:4596], now have 1 active actors on pipe
2025-10-10T14:40:02.502044Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:40:02.502116Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:02.502142Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:02.502144Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-10T14:40:02.502182Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 41 partNo 0
2025-10-10T14:40:02.502198Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 41 partNo 1
2025-10-10T14:40:02.502201Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 41 partNo 2
2025-10-10T14:40:02.502204Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 41 partNo 3
2025-10-10T14:40:02.502208Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 41 partNo 4
2025-10-10T14:40:02.502608Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 41 partNo 4 FormedBlobsCount 0 NewHead: Offset 40 PartNo 0 PackedSize 2253230 count 1 nextOffset 41 batches 5
2025-10-10T14:40:02.502621Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 42 partNo 0
2025-10-10T14:40:02.502626Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 42 partNo 1
2025-10-10T14:40:02.502628Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 42 partNo 2
2025-10-10T14:40:02.502631Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 42 partNo 3
2025-10-10T14:40:02.502633Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 42 partNo 4
2025-10-10T14:40:02.503547Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 42 partNo 4 FormedBlobsCount 0 NewHead: Offset 40 PartNo 0 PackedSize 4506428 count 2 nextOffset 42 batches 9
2025-10-10T14:40:02.503574Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 43 partNo 0
2025-10-10T14:40:02.503582Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 43 partNo 1
2025-10-10T14:40:02.503585Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 43 partNo 2
2025-10-10T14:40:02.503588Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 43 partNo 3
2025-10-10T14:40:02.503592Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 43 partNo 4
2025-10-10T14:40:02.504077Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 43 partNo 4 FormedBlobsCount 0 NewHead: Offset 40 PartNo 0 PackedSize 6759626 count 3 nextOffset 43 batches 13
2025-10-10T14:40:02.504106Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 44 partNo 0
2025-10-10T14:40:02.504112Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 44 partNo 1
2025-10-10T14:40:02.504116Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 44 partNo 2
2025-10-10T14:40:02.504118Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 44 partNo 3
2025-10-10T14:40:02.505773Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 44 partNo 3 result is x0000000000_00000000000000000040_00000_0000000003_00015? size 8295638
2025-10-10T14:40:02.505791Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 44 partNo 4
2025-10-10T14:40:02.505806Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000040_00000_0000000003_00015? new key d0000000000_00000000000000000040_00000_0000000003_00015? size 8295638 WTime 1760107202505
2025-10-10T14:40:02.505917Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 44 partNo 4 FormedBlobsCount 1 NewHead: Offset 43 PartNo 3 PackedSize 717145 count 1 nextOffset 44 batches 2
2025-10-10T14:40:02.505926Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 45 partNo 0
2025-10-10T14:40:02.505929Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 45 partNo 1
2025-10-10T14:40:02.505932Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 45 partNo 2
2025-10-10T14:40:02.505935Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 45 partNo 3
2025-10-10T14:40:02.505937Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 45 partNo 4
2025-10-10T14:40:02.506685Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 45 partNo 4 FormedBlobsCount 0 NewHead: Offset 43 PartNo 3 PackedSize 2970343 count 2 nextOffset 45 batches 6
2025-10-10T14:40:02.506703Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 0
2025-10-10T14:40:02.506707Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 1
2025-10-10T14:40:02.506712Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 2
2025-10-10T14:40:02.506714Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 3
2025-10-10T14:40:02.506717Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 4
2025-10-10T14:40:02.507188Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 46 partNo 4 FormedBlobsCount 0 NewHead: Offset 43 PartNo 3 PackedSize 5223541 count 3 nextOffset 46 batches 10
2025-10-10T14:40:02.507200Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 0
2025-10-10T14:40:02.507206Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 1
2025-10-10T14:40:02.507210Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 2
2025-10-10T14:40:02.507218Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 3
2025-10-10T14:40:02.507221Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 4
2025-10-10T14:40:02.507820Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 47 partNo 4 FormedBlobsCount 0 NewHead: Offset 43 PartNo 3 PackedSize 7476739 count 4 nextOffset 47 batches 14
2025-10-10T14:40:02.507849Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 0
2025-10-10T14:40:02.507855Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 1
2025-10-10T14:40:02.508950Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 48 partNo 1 result is x0000000000_00000000000000000043_00003_0000000004_00014? size 7988760
2025-10-10T14:40:02.508958Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 2
2025-10-10T14:40:02.508964Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 3
2025-10-10T14:40:02.508968Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 4
2025-10-10T14:40:02.508979Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000043_00003_0000000004_00014? new key d0000000000_00000000000000000043_00003_0000000004_00014? size 7988760 WTime 1760107202508
2025-10-10T14:40:02.509378Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 48 partNo 4 FormedBlobsCount 1 NewHead: Offset 47 PartNo 1 PackedSize 1741199 count 1 nextOffset 48 batches 4
2025-10-10T14:40:02.509392Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 49 partNo 0
2025-10-10T14:40:02.509402Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 49 partNo 1
2025-10-10T14:40:02.509405Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 49 partNo 2
2025-10-10T14:40:02.509408Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 49 partNo 3
2025-10-10T14:40:02.509412Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 49 partNo 4
2025-10-10T14:40:02.509867Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 49 partNo 4 FormedBlobsCount 0 NewHead: Offset 47 PartNo 1 PackedSize 3994397 count 2 nextOffset 49 batches 8
2025-10-10T14:40:02.509892Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 50 partNo 0
2025-10-10T14:40:02.509898Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 50 partNo 1
2025-10-10T14:40:02.509902Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 50 partNo 2
2025-10-10T14:40:02.509906Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 50 partNo 3
2025-10-10T14:40:02.509911Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 50 partNo 4
2025-10-10T14:40:02.510360Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 50 partNo 4 FormedBlobsCount 0 NewHead: Offset 47 PartNo 1 PackedSize 6247595 count 3 nextOffset 50 batches 12
2025-10-10T14:40:02.510382Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:02.510498Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 47,3 HeadOffset 40 endOffset 40 curOffset 50 d0000000000_00000000000000000047_00001_0000000003_00011? size 6247585 WTime 1760107202510
2025-10-10T14:40:02.513200Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:40:02.513230Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 40 partNo 0 count 3 size 8295638
2025-10-10T14:40:02.513237Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 43 partNo 3 count 4 size 7988760
2025-10-10T14:40:02.513244Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 47 partNo 1 count 3 size 6247585
2025-10-10T14:40:02.513260Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:02.513267Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:02.513271Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:02.513273Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:02.513282Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602871580151877:12464]
2025-10-10T14:40:02.513290Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602871580151877:12464]
2025-10-10T14:40:02.513294Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602871580151877:12464]
2025-10-10T14:40:02.513407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:02.513413Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:02.513415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:02.513563Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:02.516114Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:02.516130Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:02.516135Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:02.631897Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:02.634156Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:40:02.634176Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:40:02.634210Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3179 reason: error at write: Disconnected sessionId: src_id|62f8114d-ac4d563a-8450cd8-f479e319_0
2025-10-10T14:40:02.634439Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3179 sessionId: src_id|62f8114d-ac4d563a-8450cd8-f479e319_0 is DEAD
2025-10-10T14:40:02.634604Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|62f8114d-ac4d563a-8450cd8-f479e319_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:40:02.634612Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|62f8114d-ac4d563a-8450cd8-f479e319_0] Write session will restart in 0.007239s
2025-10-10T14:40:02.634640Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|62f8114d-ac4d563a-8450cd8-f479e319_0] Write session: Do CDS request
2025-10-10T14:40:02.634647Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|62f8114d-ac4d563a-8450cd8-f479e319_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:02.634635Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:02.634676Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 77 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602872362402931:4596]
2025-10-10T14:40:02.634962Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:02.638196Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:3178:1:2:1:8295638:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-10T14:40:02.639040Z node 2 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [9ce72515c9215b2d] Result# TEvPutResult {Id# [72075186224037892:3178:1:2:1:8295638:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-10T14:40:02.639283Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:3178:1:2:2:7988760:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-10T14:40:02.642930Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|62f8114d-ac4d563a-8450cd8-f479e319_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:02.643028Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:02.643045Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3180
2025-10-10T14:40:02.643178Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3180 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:02.643224Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3180 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:02.643236Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3180 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:02.643240Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:02.643615Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3180 sessionId:  describe result for acl check
2025-10-10T14:40:02.643651Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:02.643658Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:02.643659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:02.643666Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602872362402965:3264] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:02.644193Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602872362402965:3264] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:02.645847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602872362402965:3264] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:02.650791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602872362402965:3264] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:02.650813Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602872362402965:3264] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:02.650817Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602872362402965:3264] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:02.650826Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3180 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:02.662337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:02.669593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:02.669923Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:02.669940Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:02.669957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:02.670043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:02.670098Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602871580152195:12472]
2025-10-10T14:40:02.670746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:02.671418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:02.671487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:02.671848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:02.671944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:02.671953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:02.671955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:02.671956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:02.671958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:02.671959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:02.671961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:02.671962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:02.671963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:02.671965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:02.671966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:02.671968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:02.671969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:02.671976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:02.671991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:02.671996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:02.672000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:02.672005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:02.672009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:02.672014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:02.672018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:02.672022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:02.672027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:02.672031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:02.672035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:02.672039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:02.672048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:02.672057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:02.672064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:02.672070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:02.672075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:02.672080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:02.672084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:02.672091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:02.672096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:02.672101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:02.672107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:02.672113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:02.672118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:02.672125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:02.672130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:02.672136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:02.672141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:02.672147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:02.672152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:02.672158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:02.672163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:02.672169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:02.672174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:02.672181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:02.672187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:02.672193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:02.672239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:02.675888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:02.676265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:02.676279Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:02.676283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:02.676287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:02.676295Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3179 [2:7559602871580152195:12472]
2025-10-10T14:40:02.676323Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:02.676351Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:02.676360Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:02.676364Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:02.676366Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:02.676386Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:02.676399Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:02.676408Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:02.676499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:02.676505Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:02.676507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:02.676509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:02.676587Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:02.676595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:02.676608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:02.676631Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:02.676653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:02.676678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602872362402947:2438], now have 1 active actors on pipe
2025-10-10T14:40:02.676688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602872362403107:3264], now have 1 active actors on pipe
2025-10-10T14:40:02.676696Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602871580152190:12472]
2025-10-10T14:40:02.676699Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602871580152190:12472]
2025-10-10T14:40:02.676701Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602871580152190:12472]
2025-10-10T14:40:02.676715Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:02.676728Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:02.676730Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:02.676732Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:02.676737Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:02.676746Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:02.676750Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:02.676737Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3179
2025-10-10T14:40:02.676803Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3179
2025-10-10T14:40:02.676790Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602871580152190:12472]
2025-10-10T14:40:02.676818Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:02.676841Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:02.676883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:02.676894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:02.676925Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ca26d6e0-1200d90e-57994e4b-2cdf7459_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:02.676934Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:02.676939Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:02.676942Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:02.676955Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:02.676967Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:02.676983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:02.677160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:02.677164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:02.677184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:02.677271Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3180 partition: 0 MaxSeqNo: 40 sessionId: src_id|ca26d6e0-1200d90e-57994e4b-2cdf7459_0
2025-10-10T14:40:02.677721Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|62f8114d-ac4d563a-8450cd8-f479e319_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|ca26d6e0-1200d90e-57994e4b-2cdf7459_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:02.680698Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ca26d6e0-1200d90e-57994e4b-2cdf7459_0] Write session: try to update token
2025-10-10T14:40:02.680720Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ca26d6e0-1200d90e-57994e4b-2cdf7459_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:02.691595Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:40:02.691619Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:02.691632Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602871580152190:12472]
2025-10-10T14:40:02.691689Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:40:02.691690Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:40:02.691876Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:40:02.692026Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:02.692164Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:02.692309Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:02.692526Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:40:02.692566Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:40:02.695915Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3180 sessionId: src_id|ca26d6e0-1200d90e-57994e4b-2cdf7459_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:02.698740Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:02.699184Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:40:02.698954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:02.698993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:02.699039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:40:02.712524Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:02.712548Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:02.712552Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:02.712554Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:02.712566Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602871580152190:12472]
2025-10-10T14:40:02.712571Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602871580152190:12472]
2025-10-10T14:40:02.712575Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602871580152190:12472]
2025-10-10T14:40:02.712628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:02.712637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:02.712639Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:02.712734Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:02.712741Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:02.712745Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:02.712776Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:02.734824Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602872362403294:4596]
2025-10-10T14:40:02.735246Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 pipe creation result: OK TabletId: 72075186224037892 Generation: 3179, pipe: [1:7559602872362403294:4596]
2025-10-10T14:40:02.838544Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:02.847205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:02.847231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:02.847415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:02.847481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:02.847550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:02.847608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:02.847647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:02.847653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:02.847722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:02.847783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:02.847842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:02.847906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:02.847947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:02.847951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:02.848019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:02.848075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:02.848132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:02.848191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:02.848230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:02.848234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:02.848302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:02.848363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:02.848422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:02.848498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:02.848539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:02.848542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:02.848608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:02.848667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:02.848728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:02.848786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:02.848827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:02.848831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:02.848897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:02.848970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:02.849030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:02.849092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:02.849133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:02.849136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:02.849203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:02.849259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:02.849320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:02.851057Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:40:02.851076Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:40:02.851079Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 78 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602872362403294:4596]
2025-10-10T14:40:02.851102Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:02.851109Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3180 reason: error at write: Disconnected sessionId: src_id|ca26d6e0-1200d90e-57994e4b-2cdf7459_0
2025-10-10T14:40:02.851336Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3180 sessionId: src_id|ca26d6e0-1200d90e-57994e4b-2cdf7459_0 is DEAD
2025-10-10T14:40:02.851493Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca26d6e0-1200d90e-57994e4b-2cdf7459_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:40:02.851507Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca26d6e0-1200d90e-57994e4b-2cdf7459_0] Write session will restart in 0.009588s
2025-10-10T14:40:02.851535Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca26d6e0-1200d90e-57994e4b-2cdf7459_0] Write session: Do CDS request
2025-10-10T14:40:02.851542Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca26d6e0-1200d90e-57994e4b-2cdf7459_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:02.849594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:02.849643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:02.849646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:02.849713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:02.849767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:02.849824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:02.849880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:02.849923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:02.849927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:02.849995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:02.850053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:02.850112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:02.850175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:02.850216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:02.850219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:02.850288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:02.850345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:02.850407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:02.850469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:02.850509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:02.850513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:02.850588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602872362403294:4596], now have 1 active actors on pipe
2025-10-10T14:40:02.852168Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:02.861943Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ca26d6e0-1200d90e-57994e4b-2cdf7459_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:02.862050Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:02.862072Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3181
2025-10-10T14:40:02.862257Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3181 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:02.862296Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3181 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:02.862306Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3181 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:02.862310Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:02.862975Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3181 sessionId:  describe result for acl check
2025-10-10T14:40:02.863014Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:02.863025Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:02.863027Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:02.863034Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602872362403373:3246] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:02.863636Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602872362403373:3246] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:02.865650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602872362403373:3246] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:02.870416Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602872362403373:3246] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:02.870436Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602872362403373:3246] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:02.870441Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602872362403373:3246] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:02.870450Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3181 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:02.878956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:02.884544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:02.885238Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:02.885255Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:02.885272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:02.885376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:02.885431Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602871580152479:12482]
2025-10-10T14:40:02.886086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:02.886493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:02.886546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:02.886900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:02.886962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:02.886969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:02.886971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:02.886972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:02.886974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:02.886975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:02.886977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:02.886978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:02.886980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:02.886981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:02.886983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:02.886984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:02.886985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:02.886992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:02.887006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:02.887010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:02.887015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:02.887019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:02.887023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:02.887028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:02.887032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:02.887037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:02.887041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:02.887045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:02.887049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:02.887053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:02.887064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:02.887074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:02.887081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:02.887088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:02.887092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:02.887098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:02.887103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:02.887108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:02.887113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:02.887119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:02.887123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:02.887128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:02.887139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:02.887145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:02.887151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:02.887158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:02.887163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:02.887168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:02.887173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:02.887179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:02.887192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:02.887197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:02.887206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:02.887212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:02.887217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:02.887227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:02.887268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:02.890057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:02.890410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:02.890426Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:02.890429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:02.890434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:02.890441Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3180 [2:7559602871580152479:12482]
2025-10-10T14:40:02.890457Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:02.890478Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:02.890487Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:02.890491Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:02.890494Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:02.890515Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:02.890529Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:02.890539Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:02.890604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:02.890612Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:02.890614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:02.890618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:02.890704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:02.890712Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:02.890726Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:02.890737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:02.890758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:02.890789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602872362403527:3246], now have 1 active actors on pipe
2025-10-10T14:40:02.890799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602872362403301:2438], now have 1 active actors on pipe
2025-10-10T14:40:02.890807Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602871580152474:12482]
2025-10-10T14:40:02.890810Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602871580152474:12482]
2025-10-10T14:40:02.890812Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602871580152474:12482]
2025-10-10T14:40:02.890826Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:02.890834Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3180
2025-10-10T14:40:02.890840Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:02.890846Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:02.890851Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:02.890836Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3180
2025-10-10T14:40:02.890853Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:02.890863Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:02.890867Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:02.890914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:02.890926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:02.890946Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602871580152474:12482]
2025-10-10T14:40:02.890956Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:02.890974Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:02.890992Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6ed580e7-93123227-6ad07330-561723c8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:02.891001Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:02.891005Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:02.891008Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:02.891021Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:02.891033Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:02.891059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:02.891264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:02.891275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:02.891290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:02.891405Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3181 partition: 0 MaxSeqNo: 40 sessionId: src_id|6ed580e7-93123227-6ad07330-561723c8_0
2025-10-10T14:40:02.891862Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca26d6e0-1200d90e-57994e4b-2cdf7459_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|6ed580e7-93123227-6ad07330-561723c8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:02.894763Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6ed580e7-93123227-6ad07330-561723c8_0] Write session: try to update token
2025-10-10T14:40:02.894783Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6ed580e7-93123227-6ad07330-561723c8_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:02.910679Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3181 sessionId: src_id|6ed580e7-93123227-6ad07330-561723c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:02.912952Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:02.912976Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:02.912980Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:02.912982Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:02.912993Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602871580152474:12482]
2025-10-10T14:40:02.913012Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602871580152474:12482]
2025-10-10T14:40:02.913015Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602871580152474:12482]
2025-10-10T14:40:02.913062Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:02.913068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:02.913076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:02.913078Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:02.913078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:02.913081Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:02.913234Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:02.913650Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:02.951450Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602872362403655:4596]
2025-10-10T14:40:02.952109Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 pipe creation result: OK TabletId: 72075186224037892 Generation: 3180, pipe: [1:7559602872362403655:4596]
2025-10-10T14:40:02.979504Z :INFO: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] Counters: { Errors: 31 CurrentSessionLifetimeMs: 541732 BytesRead: 33792020 MessagesRead: 15 BytesReadCompressed: 33792020 BytesInflightUncompressed: 2252802 BytesInflightCompressed: 6758406 BytesInflightTotal: 9011208 MessagesInflight: 4 }
2025-10-10T14:40:03.030794Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:03.031743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:03.031759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:03.031808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602872362403655:4596], now have 1 active actors on pipe
2025-10-10T14:40:03.032022Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:03.033173Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6ed580e7-93123227-6ad07330-561723c8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:40:03.033182Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6ed580e7-93123227-6ad07330-561723c8_0] Write session will restart in 0.008501s
2025-10-10T14:40:03.033201Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6ed580e7-93123227-6ad07330-561723c8_0] Write session: Do CDS request
2025-10-10T14:40:03.033206Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6ed580e7-93123227-6ad07330-561723c8_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:03.032724Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:40:03.032842Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3181 reason: status is not ok: tablet will be restarted right now sessionId: src_id|6ed580e7-93123227-6ad07330-561723c8_0
2025-10-10T14:40:03.033035Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3181 sessionId: src_id|6ed580e7-93123227-6ad07330-561723c8_0 is DEAD
2025-10-10T14:40:03.033180Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:03.033236Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 79 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602872362403655:4596]
2025-10-10T14:40:03.045066Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6ed580e7-93123227-6ad07330-561723c8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:03.045459Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:03.045480Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3182
2025-10-10T14:40:03.045623Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3182 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:03.045681Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3182 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:03.045687Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3182 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:03.045691Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:03.048412Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3182 sessionId:  describe result for acl check
2025-10-10T14:40:03.048454Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:03.048468Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:03.048472Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:03.048479Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602876657370980:3225] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:03.049091Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602876657370980:3225] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:03.054201Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602876657370980:3225] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:03.057514Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602876657370980:3225] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:03.057535Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602876657370980:3225] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:03.057539Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602876657370980:3225] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:03.057549Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3182 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:03.082217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:03.087377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:03.087647Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:03.087660Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:03.087673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:03.087743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:03.087792Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602875875120049:12484]
2025-10-10T14:40:03.088482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:03.088852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:03.088906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:03.089249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:03.089309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:03.089310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:03.089312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:03.089313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:03.089314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:03.089316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:03.089317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:03.089318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:03.089319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:03.089321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:03.089322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:03.089323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:03.089324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:03.089343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:03.089356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:03.089360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:03.089364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:03.089368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:03.089371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:03.089375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:03.089378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:03.089381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:03.089385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:03.089388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:03.089392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:03.089396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:03.089404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:03.089413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:03.089419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:03.089424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:03.089427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:03.089432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:03.089436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:03.089441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:03.089445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:03.089449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:03.089453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:03.089458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:03.089463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:03.089468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:03.089472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:03.089477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:03.089481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:03.089485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:03.089490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:03.089495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:03.089499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:03.089504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:03.089508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:03.089512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:03.089518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:03.089523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:03.089559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:03.092241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:03.094012Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3181
2025-10-10T14:40:03.093533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:03.094065Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3181
2025-10-10T14:40:03.093541Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:03.093544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:03.093548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:03.093557Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3181 [2:7559602875875120049:12484]
2025-10-10T14:40:03.093571Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:03.093589Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:03.093593Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:03.093597Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:03.093599Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:03.093618Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:03.093627Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:03.093635Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:03.093701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:03.093703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:03.093705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:03.093708Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:03.093785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:03.093788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:03.093800Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:03.093812Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:03.093829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:03.093852Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602875875120044:12484]
2025-10-10T14:40:03.093855Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602875875120044:12484]
2025-10-10T14:40:03.093856Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602875875120044:12484]
2025-10-10T14:40:03.093869Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:03.093884Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:03.093887Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:03.093890Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:03.093892Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:03.093901Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:03.093904Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:03.093915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602876657370954:2438], now have 1 active actors on pipe
2025-10-10T14:40:03.093919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602876657371120:3225], now have 1 active actors on pipe
2025-10-10T14:40:03.093948Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602875875120044:12484]
2025-10-10T14:40:03.093958Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:03.093968Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:03.094184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:03.094190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:03.094224Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|384d99df-13ef4c63-839aae83-a2dfb88c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:03.094236Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:03.094240Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:03.094242Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:03.094255Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:03.094267Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:03.094282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:03.094693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:03.094719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:03.094745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:03.094851Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3182 partition: 0 MaxSeqNo: 40 sessionId: src_id|384d99df-13ef4c63-839aae83-a2dfb88c_0
2025-10-10T14:40:03.095302Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6ed580e7-93123227-6ad07330-561723c8_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|384d99df-13ef4c63-839aae83-a2dfb88c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:03.098009Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|384d99df-13ef4c63-839aae83-a2dfb88c_0] Write session: try to update token
2025-10-10T14:40:03.098029Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|384d99df-13ef4c63-839aae83-a2dfb88c_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:03.120973Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3182 sessionId: src_id|384d99df-13ef4c63-839aae83-a2dfb88c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:03.123527Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:03.123549Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:03.123553Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:03.123554Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:03.123565Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602875875120044:12484]
2025-10-10T14:40:03.123570Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602875875120044:12484]
2025-10-10T14:40:03.123574Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602875875120044:12484]
2025-10-10T14:40:03.123627Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:03.123642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:03.123645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:03.123762Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:03.123795Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:03.123890Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:03.123902Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:03.123907Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:03.133641Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602876657371291:4596]
2025-10-10T14:40:03.134075Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 pipe creation result: OK TabletId: 72075186224037892 Generation: 3181, pipe: [1:7559602876657371291:4596]
2025-10-10T14:40:03.241168Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:03.241438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:03.241453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:03.241492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602876657371291:4596], now have 1 active actors on pipe
2025-10-10T14:40:03.241654Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:03.242216Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:40:03.242308Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3182 reason: status is not ok: tablet will be restarted right now sessionId: src_id|384d99df-13ef4c63-839aae83-a2dfb88c_0
2025-10-10T14:40:03.242514Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3182 sessionId: src_id|384d99df-13ef4c63-839aae83-a2dfb88c_0 is DEAD
2025-10-10T14:40:03.242546Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:03.242592Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 80 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602876657371291:4596]
2025-10-10T14:40:03.243064Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|384d99df-13ef4c63-839aae83-a2dfb88c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:40:03.243074Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|384d99df-13ef4c63-839aae83-a2dfb88c_0] Write session will restart in 0.008384s
2025-10-10T14:40:03.243100Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|384d99df-13ef4c63-839aae83-a2dfb88c_0] Write session: Do CDS request
2025-10-10T14:40:03.243107Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|384d99df-13ef4c63-839aae83-a2dfb88c_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:03.253954Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|384d99df-13ef4c63-839aae83-a2dfb88c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:03.254082Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:03.254102Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3183
2025-10-10T14:40:03.254463Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3183 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:03.254531Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3183 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:03.254544Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3183 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:03.254550Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:03.255545Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3183 sessionId:  describe result for acl check
2025-10-10T14:40:03.255584Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:03.255586Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:03.255587Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:03.255593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602876657371310:3215] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:03.256142Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602876657371310:3215] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:03.259171Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602876657371310:3215] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:03.266640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602876657371310:3215] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:03.266660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602876657371310:3215] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:03.266664Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602876657371310:3215] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:03.266674Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3183 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:03.281597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:03.283814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:03.284058Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:03.284064Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:03.284078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:03.284134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:03.284191Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602875875120325:12486]
2025-10-10T14:40:03.284902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:03.285492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:03.285555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:03.285915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:03.285979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:03.285986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:03.285988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:03.285990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:03.285992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:03.285993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:03.285995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:03.285996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:03.285998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:03.286000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:03.286002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:03.286004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:03.286005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:03.286012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:03.286026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:03.286031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:03.286036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:03.286040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:03.286046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:03.286051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:03.286055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:03.286060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:03.286065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:03.286070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:03.286075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:03.286079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:03.286087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:03.286097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:03.286122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:03.286128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:03.286134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:03.286140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:03.286145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:03.286152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:03.286158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:03.286170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:03.286175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:03.286181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:03.286191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:03.286197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:03.286202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:03.286213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:03.286218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:03.286231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:03.286237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:03.286243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:03.286248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:03.286253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:03.286256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:03.286261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:03.286266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:03.286272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:03.286320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:03.289280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:03.290988Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3182
2025-10-10T14:40:03.291027Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3182
2025-10-10T14:40:03.290563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:03.290580Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:03.290584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:03.290589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:03.290596Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3182 [2:7559602875875120325:12486]
2025-10-10T14:40:03.290611Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:03.290633Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:03.290637Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:03.290641Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:03.290644Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:03.290664Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:03.290672Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:03.290681Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:03.290748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:03.290751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:03.290753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:03.290756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:03.290838Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:03.290841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:03.290855Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:03.290869Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:03.290888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:03.290911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602876657371485:3215], now have 1 active actors on pipe
2025-10-10T14:40:03.290916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602876657371294:2438], now have 1 active actors on pipe
2025-10-10T14:40:03.290924Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602875875120318:12486]
2025-10-10T14:40:03.290928Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602875875120318:12486]
2025-10-10T14:40:03.290931Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602875875120318:12486]
2025-10-10T14:40:03.290947Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:03.290962Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:03.290980Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:03.290984Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:03.291022Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602875875120318:12486]
2025-10-10T14:40:03.291025Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:03.291066Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:03.291070Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:03.291073Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:03.291081Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:03.291546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:03.291566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:03.291604Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8063ae69-14fbb18c-14f82f7a-b7104ca6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:03.291624Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:03.291630Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:03.291632Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:03.291645Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:03.291658Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:03.291677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:03.291962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:03.291966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:03.291983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:03.292101Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3183 partition: 0 MaxSeqNo: 40 sessionId: src_id|8063ae69-14fbb18c-14f82f7a-b7104ca6_0
2025-10-10T14:40:03.292646Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|384d99df-13ef4c63-839aae83-a2dfb88c_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|8063ae69-14fbb18c-14f82f7a-b7104ca6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:03.295610Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8063ae69-14fbb18c-14f82f7a-b7104ca6_0] Write session: try to update token
2025-10-10T14:40:03.295634Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8063ae69-14fbb18c-14f82f7a-b7104ca6_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:03.313148Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3183 sessionId: src_id|8063ae69-14fbb18c-14f82f7a-b7104ca6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:03.316204Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:03.317096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:03.317131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:03.317159Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:03.317163Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:03.317167Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:03.317169Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:03.317181Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602875875120318:12486]
2025-10-10T14:40:03.317185Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602875875120318:12486]
2025-10-10T14:40:03.317190Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602875875120318:12486]
2025-10-10T14:40:03.317228Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:03.317243Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:03.317252Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:03.317260Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:03.317269Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:03.317272Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:03.317449Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:03.342531Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602876657371633:4596]
2025-10-10T14:40:03.342912Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 pipe creation result: OK TabletId: 72075186224037892 Generation: 3182, pipe: [1:7559602876657371633:4596]
2025-10-10T14:40:03.442876Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:03.443352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:40:03.443423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602876657371633:4596], now have 1 active actors on pipe
2025-10-10T14:40:03.443526Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:40:03.443771Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 81 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602876657371633:4596]
2025-10-10T14:40:03.443809Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:03.457014Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:40:03.457035Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:40:03.457065Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3183 reason: error at write: Disconnected sessionId: src_id|8063ae69-14fbb18c-14f82f7a-b7104ca6_0
2025-10-10T14:40:03.457263Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3183 sessionId: src_id|8063ae69-14fbb18c-14f82f7a-b7104ca6_0 is DEAD
2025-10-10T14:40:03.457436Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8063ae69-14fbb18c-14f82f7a-b7104ca6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:40:03.457449Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8063ae69-14fbb18c-14f82f7a-b7104ca6_0] Write session will restart in 0.006330s
2025-10-10T14:40:03.457486Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8063ae69-14fbb18c-14f82f7a-b7104ca6_0] Write session: Do CDS request
2025-10-10T14:40:03.457493Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8063ae69-14fbb18c-14f82f7a-b7104ca6_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:03.465000Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8063ae69-14fbb18c-14f82f7a-b7104ca6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:03.465067Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:03.465088Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3184
2025-10-10T14:40:03.465316Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3184 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:03.465411Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3184 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:03.465424Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3184 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:03.465429Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:03.466134Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3184 sessionId:  describe result for acl check
2025-10-10T14:40:03.466177Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:03.466184Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:03.466186Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:03.466193Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602876657371721:3203] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:03.466797Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602876657371721:3203] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:03.470047Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602876657371721:3203] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:03.473735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602876657371721:3203] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:03.473754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602876657371721:3203] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:03.473758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602876657371721:3203] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:03.473768Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3184 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:03.489681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:03.496062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:03.496343Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:03.496348Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:03.496361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:03.496421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:03.496475Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602875875120601:12489]
2025-10-10T14:40:03.497141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:03.498070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:03.498144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:03.498414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:03.498468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:03.498477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:03.498478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:03.498479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:03.498479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:03.498480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:03.498481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:03.498482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:03.498483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:03.498484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:03.498485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:03.498486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:03.498487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:03.498492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:03.498501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:03.498504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:03.498506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:03.498508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:03.498511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:03.498513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:03.498516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:03.498518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:03.498521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:03.498523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:03.498525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:03.498527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:03.498534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:03.498540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:03.498545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:03.498549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:03.498553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:03.498556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:03.498559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:03.498562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:03.498567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:03.498571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:03.498574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:03.498578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:03.498583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:03.498588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:03.498593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:03.498598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:03.498603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:03.498608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:03.498613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:03.498617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:03.498620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:03.498623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:03.498628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:03.498631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:03.498635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:03.498638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:03.498662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:03.502093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:03.502660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:03.502671Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:03.502675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:03.502678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:03.502685Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3183 [2:7559602875875120601:12489]
2025-10-10T14:40:03.502700Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:03.502722Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:03.502730Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:03.502734Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:03.502737Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:03.502756Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:03.502765Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:03.502773Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:03.502857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:03.502866Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:03.502868Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:03.502870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:03.502960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:03.502968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:03.502981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:03.502996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:03.503015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:03.503044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602876657371809:3203], now have 1 active actors on pipe
2025-10-10T14:40:03.503054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602876657371635:2438], now have 1 active actors on pipe
2025-10-10T14:40:03.503062Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602875875120596:12489]
2025-10-10T14:40:03.503067Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602875875120596:12489]
2025-10-10T14:40:03.503069Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602875875120596:12489]
2025-10-10T14:40:03.503083Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:03.503098Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:03.503097Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:03.503101Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:03.503104Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:03.503115Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:03.503118Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:03.503156Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602875875120596:12489]
2025-10-10T14:40:03.503121Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3183
2025-10-10T14:40:03.503126Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3183
2025-10-10T14:40:03.503164Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:03.503171Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:03.503363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:03.503378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:03.503418Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7f599e24-74027485-3c0abdb7-777ddd83_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:03.503432Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:03.503441Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:03.503444Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:03.503458Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:03.503474Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:03.503496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:03.503669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:03.503679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:03.503696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:03.503793Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3184 partition: 0 MaxSeqNo: 40 sessionId: src_id|7f599e24-74027485-3c0abdb7-777ddd83_0
2025-10-10T14:40:03.504233Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8063ae69-14fbb18c-14f82f7a-b7104ca6_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|7f599e24-74027485-3c0abdb7-777ddd83_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:03.507124Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7f599e24-74027485-3c0abdb7-777ddd83_0] Write session: try to update token
2025-10-10T14:40:03.507147Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7f599e24-74027485-3c0abdb7-777ddd83_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:03.523371Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:03.523389Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:03.523393Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:03.523396Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:03.523406Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602875875120596:12489]
2025-10-10T14:40:03.523411Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602875875120596:12489]
2025-10-10T14:40:03.523415Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602875875120596:12489]
2025-10-10T14:40:03.523461Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:03.523468Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:03.523468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:03.523474Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:03.523477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:03.523479Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:03.523624Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:03.522360Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3184 sessionId: src_id|7f599e24-74027485-3c0abdb7-777ddd83_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:03.525130Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:03.543791Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602876657371975:4596]
2025-10-10T14:40:03.544221Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 pipe creation result: OK TabletId: 72075186224037892 Generation: 3183, pipe: [1:7559602876657371975:4596]
2025-10-10T14:40:03.638953Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:03.639859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:03.639873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:03.639925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602876657371975:4596], now have 1 active actors on pipe
2025-10-10T14:40:03.641453Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f599e24-74027485-3c0abdb7-777ddd83_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:40:03.641466Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f599e24-74027485-3c0abdb7-777ddd83_0] Write session will restart in 0.008320s
2025-10-10T14:40:03.641491Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f599e24-74027485-3c0abdb7-777ddd83_0] Write session: Do CDS request
2025-10-10T14:40:03.641498Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f599e24-74027485-3c0abdb7-777ddd83_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:03.640963Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 82 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602876657371975:4596]
2025-10-10T14:40:03.641008Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:40:03.641010Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:40:03.641071Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3184 reason: error at write: Disconnected sessionId: src_id|7f599e24-74027485-3c0abdb7-777ddd83_0
2025-10-10T14:40:03.641285Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3184 sessionId: src_id|7f599e24-74027485-3c0abdb7-777ddd83_0 is DEAD
2025-10-10T14:40:03.641431Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:03.642227Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:03.650842Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7f599e24-74027485-3c0abdb7-777ddd83_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:03.651105Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:03.651123Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3185
2025-10-10T14:40:03.651295Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3185 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:03.651325Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3185 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:03.651345Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3185 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:03.651350Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:03.652994Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3185 sessionId:  describe result for acl check
2025-10-10T14:40:03.653024Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:03.653027Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:03.653029Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:03.653036Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602876657372010:3206] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:03.653626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602876657372010:3206] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:03.656379Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602876657372010:3206] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:03.662832Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602876657372010:3206] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:03.662859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602876657372010:3206] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:03.662862Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602876657372010:3206] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:03.662873Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3185 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:03.694706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:03.700115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:03.700385Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:03.700401Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:03.700416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:03.700509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:03.700553Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602875875120905:12491]
2025-10-10T14:40:03.701101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:03.701608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:03.701658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:03.701955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:03.702022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:03.702030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:03.702032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:03.702032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:03.702034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:03.702035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:03.702036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:03.702037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:03.702038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:03.702040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:03.702041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:03.702042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:03.702043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:03.702050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:03.702062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:03.702065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:03.702069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:03.702072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:03.702076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:03.702079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:03.702083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:03.702087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:03.702091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:03.702095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:03.702098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:03.702102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:03.702109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:03.702119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:03.702126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:03.702145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:03.702149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:03.702154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:03.702157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:03.702162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:03.702172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:03.702177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:03.702181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:03.702185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:03.702190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:03.702199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:03.702203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:03.702208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:03.702212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:03.702217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:03.702221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:03.702226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:03.702230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:03.702235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:03.702239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:03.702244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:03.702248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:03.702253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:03.702291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:03.704897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:03.705584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:03.705598Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:03.705600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:03.705604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:03.705611Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3184 [2:7559602875875120905:12491]
2025-10-10T14:40:03.705624Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:03.705641Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:03.705644Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:03.705648Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:03.705650Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:03.705668Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:03.705681Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:03.705689Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:03.705750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:03.705756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:03.705758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:03.705761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:03.705824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:03.705834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:03.705903Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3184
2025-10-10T14:40:03.705846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:03.705858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:03.705875Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:03.705900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602876657372088:3206], now have 1 active actors on pipe
2025-10-10T14:40:03.705908Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602875875120885:12491]
2025-10-10T14:40:03.705911Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602875875120885:12491]
2025-10-10T14:40:03.705913Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602875875120885:12491]
2025-10-10T14:40:03.705928Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:03.705937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602876657371977:2438], now have 1 active actors on pipe
2025-10-10T14:40:03.705942Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:03.705944Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:03.705946Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:03.705946Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:03.705962Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:03.705966Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:03.705993Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602875875120885:12491]
2025-10-10T14:40:03.705996Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:03.705998Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:03.706011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:03.706016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:03.706044Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3184
2025-10-10T14:40:03.706065Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7afaf371-f2c4bee4-66a8b830-1b02da61_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:03.706088Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:03.706092Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:03.706094Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:03.706116Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:03.706127Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:03.706145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:03.706381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:03.706390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:03.706409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:03.706494Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3185 partition: 0 MaxSeqNo: 40 sessionId: src_id|7afaf371-f2c4bee4-66a8b830-1b02da61_0
2025-10-10T14:40:03.706934Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f599e24-74027485-3c0abdb7-777ddd83_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|7afaf371-f2c4bee4-66a8b830-1b02da61_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:03.709654Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7afaf371-f2c4bee4-66a8b830-1b02da61_0] Write session: try to update token
2025-10-10T14:40:03.709670Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7afaf371-f2c4bee4-66a8b830-1b02da61_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:03.724780Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3185 sessionId: src_id|7afaf371-f2c4bee4-66a8b830-1b02da61_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:03.727656Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:03.729259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:03.729292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:03.729319Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:03.729323Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:03.729379Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:03.729389Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:03.729399Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602875875120885:12491]
2025-10-10T14:40:03.729402Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602875875120885:12491]
2025-10-10T14:40:03.729405Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602875875120885:12491]
2025-10-10T14:40:03.729454Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:03.729472Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:03.729472Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:03.729477Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:03.729480Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:03.729482Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:03.729637Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:03.740892Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602876657372341:4596]
2025-10-10T14:40:03.741195Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 pipe creation result: OK TabletId: 72075186224037892 Generation: 3184, pipe: [1:7559602876657372341:4596]
2025-10-10T14:40:03.847241Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:03.847769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:40:03.847836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602876657372341:4596], now have 1 active actors on pipe
2025-10-10T14:40:03.847953Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:40:03.849050Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 83 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602876657372341:4596]
2025-10-10T14:40:03.849070Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:03.863273Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7afaf371-f2c4bee4-66a8b830-1b02da61_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:40:03.863289Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7afaf371-f2c4bee4-66a8b830-1b02da61_0] Write session will restart in 0.005952s
2025-10-10T14:40:03.863328Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7afaf371-f2c4bee4-66a8b830-1b02da61_0] Write session: Do CDS request
2025-10-10T14:40:03.863335Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7afaf371-f2c4bee4-66a8b830-1b02da61_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:03.862890Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:40:03.862908Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:40:03.862939Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3185 reason: error at write: Disconnected sessionId: src_id|7afaf371-f2c4bee4-66a8b830-1b02da61_0
2025-10-10T14:40:03.863128Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3185 sessionId: src_id|7afaf371-f2c4bee4-66a8b830-1b02da61_0 is DEAD
2025-10-10T14:40:03.870959Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7afaf371-f2c4bee4-66a8b830-1b02da61_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:03.871046Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:03.871066Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3186
2025-10-10T14:40:03.871195Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3186 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:03.871614Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3186 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:03.871620Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3186 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:03.871624Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:03.872216Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3186 sessionId:  describe result for acl check
2025-10-10T14:40:03.872253Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:03.872260Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:03.872262Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:03.872269Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602876657372412:3158] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:03.872852Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602876657372412:3158] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:03.875484Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602876657372412:3158] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:03.879864Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602876657372412:3158] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:03.879883Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602876657372412:3158] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:03.879887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602876657372412:3158] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:03.879897Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3186 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:03.896414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:03.897150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:03.897398Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:03.897414Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:03.897430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:03.897504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:03.897555Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602875875121204:12507]
2025-10-10T14:40:03.898252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:03.898591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:03.898643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:03.898978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:03.899033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:03.899035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:03.899036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:03.899038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:03.899039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:03.899040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:03.899042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:03.899043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:03.899044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:03.899046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:03.899047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:03.899048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:03.899049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:03.899056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:03.899069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:03.899073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:03.899076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:03.899080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:03.899083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:03.899087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:03.899090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:03.899094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:03.899101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:03.899104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:03.899108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:03.899111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:03.899119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:03.899127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:03.899133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:03.899138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:03.899144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:03.899149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:03.899153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:03.899158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:03.899162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:03.899167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:03.899170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:03.899175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:03.899181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:03.899186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:03.899190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:03.899195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:03.899199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:03.899204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:03.899210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:03.899215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:03.899219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:03.899223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:03.899227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:03.899232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:03.899236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:03.899241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:03.899277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:03.901881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:03.902758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:03.902770Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:03.902773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:03.902777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:03.902783Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3185 [2:7559602875875121204:12507]
2025-10-10T14:40:03.902797Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:03.902816Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:03.902824Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:03.902828Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:03.902831Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:03.902850Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:03.902862Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:03.902870Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:03.902936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:03.902944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:03.902946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:03.902949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:03.903030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:03.903038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:03.903050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:03.903060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:03.903075Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:03.903105Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602875875121199:12507]
2025-10-10T14:40:03.903113Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602875875121199:12507]
2025-10-10T14:40:03.903115Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602875875121199:12507]
2025-10-10T14:40:03.903129Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:03.903144Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:03.903161Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:03.903169Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:03.903183Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:03.903193Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:03.903198Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:03.903200Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602875875121199:12507]
2025-10-10T14:40:03.903203Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:03.903205Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:03.903288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602876657372544:3158], now have 1 active actors on pipe
2025-10-10T14:40:03.903314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602876657372346:2438], now have 1 active actors on pipe
2025-10-10T14:40:03.903509Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3185
2025-10-10T14:40:03.903549Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3185
2025-10-10T14:40:03.903617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:03.903627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:03.903665Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3614fc8f-c04c3674-fca9e8cb-1f1fc884_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:03.903692Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:03.903702Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:03.903705Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:03.903719Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:03.903735Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:03.903758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:03.904335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:03.904349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:03.904371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:03.904506Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3186 partition: 0 MaxSeqNo: 40 sessionId: src_id|3614fc8f-c04c3674-fca9e8cb-1f1fc884_0
2025-10-10T14:40:03.904986Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7afaf371-f2c4bee4-66a8b830-1b02da61_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|3614fc8f-c04c3674-fca9e8cb-1f1fc884_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:03.908011Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3614fc8f-c04c3674-fca9e8cb-1f1fc884_0] Write session: try to update token
2025-10-10T14:40:03.908034Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3614fc8f-c04c3674-fca9e8cb-1f1fc884_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:03.923482Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:40:03.923502Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:03.923515Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602875875121199:12507]
2025-10-10T14:40:03.923567Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:40:03.923757Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:40:03.923906Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:03.924051Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:03.924187Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:03.924375Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:40:03.924416Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:40:03.924587Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:40:03.939053Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:03.939078Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:03.939082Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:03.939085Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:03.939096Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602875875121199:12507]
2025-10-10T14:40:03.939101Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602875875121199:12507]
2025-10-10T14:40:03.939105Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602875875121199:12507]
2025-10-10T14:40:03.939161Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:03.939160Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:03.939166Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:03.939169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:03.939170Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:03.939172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:03.939314Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:03.941558Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3186 sessionId: src_id|3614fc8f-c04c3674-fca9e8cb-1f1fc884_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:03.944349Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:03.949274Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602876657372705:4596]
2025-10-10T14:40:03.949631Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 pipe creation result: OK TabletId: 72075186224037892 Generation: 3185, pipe: [1:7559602876657372705:4596]
2025-10-10T14:40:04.073762Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:04.074283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:04.074293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:04.074314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602876657372705:4596], now have 1 active actors on pipe
2025-10-10T14:40:04.077545Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:04.078136Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3614fc8f-c04c3674-fca9e8cb-1f1fc884_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:40:04.078145Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3614fc8f-c04c3674-fca9e8cb-1f1fc884_0] Write session will restart in 0.008563s
2025-10-10T14:40:04.078170Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3614fc8f-c04c3674-fca9e8cb-1f1fc884_0] Write session: Do CDS request
2025-10-10T14:40:04.078176Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3614fc8f-c04c3674-fca9e8cb-1f1fc884_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:04.077616Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:40:04.077643Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:40:04.077714Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3186 reason: error at write: Disconnected sessionId: src_id|3614fc8f-c04c3674-fca9e8cb-1f1fc884_0
2025-10-10T14:40:04.077948Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3186 sessionId: src_id|3614fc8f-c04c3674-fca9e8cb-1f1fc884_0 is DEAD
2025-10-10T14:40:04.078144Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 84 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602876657372705:4596]
2025-10-10T14:40:04.078165Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:04.090045Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3614fc8f-c04c3674-fca9e8cb-1f1fc884_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:04.090099Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:04.090117Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3187
2025-10-10T14:40:04.093624Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3187 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:04.093685Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3187 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:04.093692Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3187 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:04.093696Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:04.094251Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3187 sessionId:  describe result for acl check
2025-10-10T14:40:04.094290Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:04.094292Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:04.094294Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:04.094302Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602880952340056:3149] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:04.094916Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602880952340056:3149] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:04.100036Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602880952340056:3149] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:04.107557Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602880952340056:3149] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:04.107587Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602880952340056:3149] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:04.107591Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602880952340056:3149] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:04.107601Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3187 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:04.120031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:04.120698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:04.120910Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:04.120920Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:04.120930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:04.120973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:04.121009Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602880170088779:12509]
2025-10-10T14:40:04.121515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:04.121855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:04.121909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:04.122226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:04.122276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:04.122278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:04.122280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:04.122281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:04.122282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:04.122284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:04.122285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:04.122287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:04.122288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:04.122289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:04.122291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:04.122292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:04.122293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:04.122299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:04.122313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:04.122318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:04.122322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:04.122326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:04.122331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:04.122335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:04.122339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:04.122343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:04.122348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:04.122352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:04.122356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:04.122361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:04.122368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:04.122377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:04.122384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:04.122390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:04.122396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:04.122401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:04.122406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:04.122411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:04.122416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:04.122421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:04.122426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:04.122432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:04.122437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:04.122442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:04.122447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:04.122452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:04.122459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:04.122464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:04.122468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:04.122474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:04.122479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:04.122484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:04.122488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:04.122493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:04.122497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:04.122503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:04.122544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:04.128891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:04.129833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:04.129848Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:04.129850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:04.129860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:04.129868Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3186 [2:7559602880170088779:12509]
2025-10-10T14:40:04.129885Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:04.129908Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:04.131067Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3186
2025-10-10T14:40:04.129920Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:04.129925Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:04.129927Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:04.129948Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:04.129956Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:04.131084Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3186
2025-10-10T14:40:04.129964Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:04.130037Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:04.130039Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:04.130041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:04.130044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:04.130125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:04.130128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:04.130143Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:04.130154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:04.130171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:04.130196Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602880170088774:12509]
2025-10-10T14:40:04.130199Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602880170088774:12509]
2025-10-10T14:40:04.130201Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602880170088774:12509]
2025-10-10T14:40:04.130218Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:04.130234Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:04.130251Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:04.130255Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:04.130302Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602880170088774:12509]
2025-10-10T14:40:04.130304Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:04.130744Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:04.130747Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:04.130749Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:04.130755Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:04.130957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602880952340244:3149], now have 1 active actors on pipe
2025-10-10T14:40:04.130963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602880952340004:2438], now have 1 active actors on pipe
2025-10-10T14:40:04.131317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:04.131331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:04.131364Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8f68b716-aaf94471-74ed813-461725c4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:04.131377Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:04.131382Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:04.131384Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:04.131400Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:04.131413Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:04.131432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:04.131663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:04.131672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:04.131694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:04.131797Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3187 partition: 0 MaxSeqNo: 40 sessionId: src_id|8f68b716-aaf94471-74ed813-461725c4_0
2025-10-10T14:40:04.132238Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3614fc8f-c04c3674-fca9e8cb-1f1fc884_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|8f68b716-aaf94471-74ed813-461725c4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:04.135119Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8f68b716-aaf94471-74ed813-461725c4_0] Write session: try to update token
2025-10-10T14:40:04.135138Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8f68b716-aaf94471-74ed813-461725c4_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:04.152908Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3187 sessionId: src_id|8f68b716-aaf94471-74ed813-461725c4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:04.153587Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:04.153607Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:04.153611Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:04.153613Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:04.153624Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602880170088774:12509]
2025-10-10T14:40:04.153628Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602880170088774:12509]
2025-10-10T14:40:04.153632Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602880170088774:12509]
2025-10-10T14:40:04.153683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:04.153684Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:04.153689Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:04.153693Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:04.153700Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:04.153702Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:04.153846Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:04.155628Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:04.178586Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602880952340347:4596]
2025-10-10T14:40:04.178991Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 pipe creation result: OK TabletId: 72075186224037892 Generation: 3186, pipe: [1:7559602880952340347:4596]
2025-10-10T14:40:04.270722Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:04.271020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:04.271031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:04.271081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602880952340347:4596], now have 1 active actors on pipe
2025-10-10T14:40:04.271607Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:04.271885Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:04.271937Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:40:04.272014Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3187 reason: status is not ok: tablet will be restarted right now sessionId: src_id|8f68b716-aaf94471-74ed813-461725c4_0
2025-10-10T14:40:04.272230Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3187 sessionId: src_id|8f68b716-aaf94471-74ed813-461725c4_0 is DEAD
2025-10-10T14:40:04.272377Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 85 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602880952340347:4596]
2025-10-10T14:40:04.273612Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f68b716-aaf94471-74ed813-461725c4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:40:04.273625Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f68b716-aaf94471-74ed813-461725c4_0] Write session will restart in 0.007424s
2025-10-10T14:40:04.273651Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f68b716-aaf94471-74ed813-461725c4_0] Write session: Do CDS request
2025-10-10T14:40:04.273662Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f68b716-aaf94471-74ed813-461725c4_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:04.285865Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8f68b716-aaf94471-74ed813-461725c4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:04.289696Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:04.289713Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3188
2025-10-10T14:40:04.293506Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3188 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:04.293568Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3188 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:04.293580Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3188 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:04.293585Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:04.294295Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3188 sessionId:  describe result for acl check
2025-10-10T14:40:04.294338Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:04.294342Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:04.294344Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:04.294351Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602880952340612:3124] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:04.294946Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602880952340612:3124] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:04.298137Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602880952340612:3124] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:04.300994Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602880952340612:3124] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:04.301013Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602880952340612:3124] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:04.301017Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602880952340612:3124] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:04.301026Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3188 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:04.308411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:04.311627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:04.311930Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:04.311945Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:04.311960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:04.312040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:04.312089Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602880170089060:12511]
2025-10-10T14:40:04.312755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:04.313184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:04.313244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:04.313610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:04.313691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:04.313692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:04.313693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:04.313695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:04.313696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:04.313698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:04.313699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:04.313700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:04.313702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:04.313703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:04.313704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:04.313706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:04.313707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:04.313715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:04.313729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:04.313734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:04.313739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:04.313743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:04.313747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:04.313751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:04.313755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:04.313759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:04.313763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:04.313766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:04.313770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:04.313774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:04.313782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:04.313792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:04.313800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:04.313806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:04.313813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:04.313818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:04.313823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:04.313829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:04.313834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:04.313840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:04.313845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:04.313851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:04.313856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:04.313861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:04.313866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:04.313872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:04.313877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:04.313882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:04.313887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:04.313892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:04.313916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:04.313923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:04.313927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:04.313933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:04.313938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:04.313943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:04.313985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:04.322549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:04.323654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:04.323675Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:04.323678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:04.323683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:04.323692Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3187 [2:7559602880170089060:12511]
2025-10-10T14:40:04.323709Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:04.323731Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:04.323736Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:04.323739Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:04.323742Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:04.323764Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:04.323783Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:04.323792Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:04.323869Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:04.323872Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:04.323874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:04.323877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:04.323949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:04.323952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:04.323970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:04.323983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:04.324002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:04.324025Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602880170089055:12511]
2025-10-10T14:40:04.324028Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602880170089055:12511]
2025-10-10T14:40:04.324030Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602880170089055:12511]
2025-10-10T14:40:04.324050Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:04.324069Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:04.324085Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:04.324089Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:04.324111Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:04.324115Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:04.324116Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:04.324136Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602880170089055:12511]
2025-10-10T14:40:04.324140Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:04.324216Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:04.324525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602880952340679:3124], now have 1 active actors on pipe
2025-10-10T14:40:04.324541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602880952340349:2438], now have 1 active actors on pipe
2025-10-10T14:40:04.326020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:04.326041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:04.326087Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7f177b58-25e3336a-bca36b1a-1e0232ab_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:04.326107Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:04.326113Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:04.326116Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:04.326133Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:04.326164Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:04.326189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:04.327009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:04.327024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:04.327052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:04.325647Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3187
2025-10-10T14:40:04.325690Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3187
2025-10-10T14:40:04.327695Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3188 partition: 0 MaxSeqNo: 40 sessionId: src_id|7f177b58-25e3336a-bca36b1a-1e0232ab_0
2025-10-10T14:40:04.328151Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f68b716-aaf94471-74ed813-461725c4_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|7f177b58-25e3336a-bca36b1a-1e0232ab_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:04.331140Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7f177b58-25e3336a-bca36b1a-1e0232ab_0] Write session: try to update token
2025-10-10T14:40:04.331166Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7f177b58-25e3336a-bca36b1a-1e0232ab_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:04.351124Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3188 sessionId: src_id|7f177b58-25e3336a-bca36b1a-1e0232ab_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:04.354084Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:04.354473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:04.354500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:04.354543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:40:04.354655Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:40:04.359955Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:04.359979Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:04.359983Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:04.359985Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:04.359996Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602880170089055:12511]
2025-10-10T14:40:04.360002Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602880170089055:12511]
2025-10-10T14:40:04.360005Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602880170089055:12511]
2025-10-10T14:40:04.360062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:04.360069Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:04.360077Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:04.360079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:04.360082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:04.360082Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:04.360232Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:04.372695Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602880952340693:4596]
2025-10-10T14:40:04.373162Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 pipe creation result: OK TabletId: 72075186224037892 Generation: 3187, pipe: [1:7559602880952340693:4596]
2025-10-10T14:40:04.494909Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:04.495579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602880952340693:4596], now have 1 active actors on pipe
2025-10-10T14:40:04.504244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:04.504283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:04.504491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:04.504563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:04.504634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:04.504708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:04.504761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:04.504772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:04.504852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:04.504921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:04.504989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:04.505074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:04.505123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:04.505130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:04.505208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:04.505280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:04.505368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:04.505442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:04.505491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:04.505500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:04.505576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:04.505644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:04.505716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:04.505788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:04.505834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:04.505841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:04.505912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:04.505982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:04.506049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:04.506120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:04.506168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:04.506176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:04.506244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:04.506306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:04.506378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:04.506451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:04.506500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:04.506509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:04.506583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:04.506646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:04.506717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:04.506786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:04.506831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:04.506838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:04.506915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:04.506983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:04.507048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:04.507118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:04.507164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:04.507174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:04.507246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:04.507309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:04.507376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:04.507443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:04.507490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:04.507497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:04.507564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:04.507626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:04.507690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:04.507753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:04.508181Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:40:04.508215Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:40:04.508250Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3188 reason: error at write: Disconnected sessionId: src_id|7f177b58-25e3336a-bca36b1a-1e0232ab_0
2025-10-10T14:40:04.508542Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3188 sessionId: src_id|7f177b58-25e3336a-bca36b1a-1e0232ab_0 is DEAD
2025-10-10T14:40:04.508558Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:04.508611Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 86 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602880952340693:4596]
2025-10-10T14:40:04.508950Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f177b58-25e3336a-bca36b1a-1e0232ab_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:40:04.508970Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f177b58-25e3336a-bca36b1a-1e0232ab_0] Write session will restart in 0.006277s
2025-10-10T14:40:04.508996Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f177b58-25e3336a-bca36b1a-1e0232ab_0] Write session: Do CDS request
2025-10-10T14:40:04.509003Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f177b58-25e3336a-bca36b1a-1e0232ab_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:04.507799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:04.507810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:04.509315Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:04.516985Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7f177b58-25e3336a-bca36b1a-1e0232ab_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:04.517063Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:04.517082Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3189
2025-10-10T14:40:04.517268Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3189 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:04.517314Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3189 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:04.517342Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3189 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:04.517352Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:04.517991Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3189 sessionId:  describe result for acl check
2025-10-10T14:40:04.518040Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:04.518047Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:04.518050Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:04.518057Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602880952340713:3120] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:04.519022Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602880952340713:3120] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:04.522903Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602880952340713:3120] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:04.528368Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602880952340713:3120] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:04.528388Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602880952340713:3120] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:04.528392Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602880952340713:3120] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:04.528404Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3189 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:04.535360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:04.541594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:04.541867Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:04.541873Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:04.541886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:04.541949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:04.541988Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602880170089342:12514]
2025-10-10T14:40:04.542629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:04.542959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:04.542999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:04.543342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:04.543396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:04.543397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:04.543399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:04.543400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:04.543402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:04.543403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:04.543404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:04.543406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:04.543407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:04.543408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:04.543410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:04.543411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:04.543412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:04.543419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:04.543433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:04.543437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:04.543441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:04.543445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:04.543449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:04.543453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:04.543457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:04.543461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:04.543466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:04.543470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:04.543474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:04.543478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:04.543486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:04.543494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:04.543502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:04.543507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:04.543512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:04.543518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:04.543522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:04.543528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:04.543532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:04.543538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:04.543542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:04.543547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:04.543551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:04.543556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:04.543560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:04.543566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:04.543570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:04.543575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:04.543581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:04.543586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:04.543591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:04.543595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:04.543599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:04.543604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:04.543609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:04.543614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:04.543652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:04.547178Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3188
2025-10-10T14:40:04.547247Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3188
2025-10-10T14:40:04.547757Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3189 partition: 0 MaxSeqNo: 40 sessionId: src_id|361936da-ebe5e912-597eb72e-65262320_0
2025-10-10T14:40:04.548218Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f177b58-25e3336a-bca36b1a-1e0232ab_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|361936da-ebe5e912-597eb72e-65262320_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:04.546367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:04.546715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:04.546719Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:04.546722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:04.546727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:04.546734Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3188 [2:7559602880170089342:12514]
2025-10-10T14:40:04.546748Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:04.546766Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:04.546770Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:04.546773Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:04.546776Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:04.546796Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:04.546805Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:04.546812Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:04.546885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:04.546887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:04.546890Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:04.546893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:04.546966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:04.546969Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:04.546979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:04.546990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:04.547005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:04.547038Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602880170089336:12514]
2025-10-10T14:40:04.547041Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602880170089336:12514]
2025-10-10T14:40:04.547043Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602880170089336:12514]
2025-10-10T14:40:04.547053Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:04.547059Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:04.547061Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:04.547063Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:04.547068Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:04.547083Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:04.547086Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:04.547099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602880952340696:2438], now have 1 active actors on pipe
2025-10-10T14:40:04.547103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602880952340962:3120], now have 1 active actors on pipe
2025-10-10T14:40:04.547128Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602880170089336:12514]
2025-10-10T14:40:04.547136Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:04.547146Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:04.547319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:04.547324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:04.547356Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|361936da-ebe5e912-597eb72e-65262320_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:04.547365Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:04.547370Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:04.547373Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:04.547386Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:04.547397Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:04.547411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:04.547612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:04.547620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:04.547647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:04.551545Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|361936da-ebe5e912-597eb72e-65262320_0] Write session: try to update token
2025-10-10T14:40:04.551565Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|361936da-ebe5e912-597eb72e-65262320_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:04.568783Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:04.568810Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:04.568814Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:04.568817Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:04.568827Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602880170089336:12514]
2025-10-10T14:40:04.568832Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602880170089336:12514]
2025-10-10T14:40:04.568839Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602880170089336:12514]
2025-10-10T14:40:04.568895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:04.568903Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:04.568906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:04.569051Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:04.571881Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:04.571897Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:04.571902Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:04.571998Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3189 sessionId: src_id|361936da-ebe5e912-597eb72e-65262320_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:04.574561Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:04.608676Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602880952341044:4596]
2025-10-10T14:40:04.610109Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 pipe creation result: OK TabletId: 72075186224037892 Generation: 3188, pipe: [1:7559602880952341044:4596]
2025-10-10T14:40:04.705143Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:04.705567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:04.705585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:04.705631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602880952341044:4596], now have 1 active actors on pipe
2025-10-10T14:40:04.706246Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 87 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602880952341044:4596]
2025-10-10T14:40:04.706407Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:40:04.706484Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3189 reason: status is not ok: tablet will be restarted right now sessionId: src_id|361936da-ebe5e912-597eb72e-65262320_0
2025-10-10T14:40:04.706698Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3189 sessionId: src_id|361936da-ebe5e912-597eb72e-65262320_0 is DEAD
2025-10-10T14:40:04.706858Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:04.705997Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:04.711453Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|361936da-ebe5e912-597eb72e-65262320_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:40:04.711468Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|361936da-ebe5e912-597eb72e-65262320_0] Write session will restart in 0.008919s
2025-10-10T14:40:04.711495Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|361936da-ebe5e912-597eb72e-65262320_0] Write session: Do CDS request
2025-10-10T14:40:04.711502Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|361936da-ebe5e912-597eb72e-65262320_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:04.721969Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|361936da-ebe5e912-597eb72e-65262320_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:04.722452Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:04.722471Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3190
2025-10-10T14:40:04.722631Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3190 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:04.722681Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3190 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:04.722692Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3190 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:04.722696Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:04.723204Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3190 sessionId:  describe result for acl check
2025-10-10T14:40:04.723242Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:04.723250Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:04.723252Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:04.723259Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602880952341184:3088] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:04.723831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602880952341184:3088] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:04.726743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602880952341184:3088] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:04.730534Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602880952341184:3088] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:04.730555Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602880952341184:3088] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:04.730558Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602880952341184:3088] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:04.730567Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3190 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:04.737075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:04.742984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:04.743235Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:04.743248Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:04.743260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:04.743322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:04.743366Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602880170089648:12523]
2025-10-10T14:40:04.743937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:04.744338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:04.744392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:04.744756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:04.744823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:04.744827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:04.744828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:04.744829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:04.744830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:04.744831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:04.744833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:04.744834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:04.744835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:04.744837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:04.744838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:04.744839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:04.744841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:04.744847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:04.744861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:04.744865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:04.744871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:04.744875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:04.744880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:04.744884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:04.744888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:04.744892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:04.744896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:04.744900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:04.744904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:04.744908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:04.744916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:04.744925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:04.744933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:04.744940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:04.744944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:04.744957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:04.744963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:04.744968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:04.744973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:04.744978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:04.744982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:04.744988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:04.744992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:04.744997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:04.745002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:04.745007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:04.745016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:04.745021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:04.745028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:04.745033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:04.745043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:04.745049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:04.745053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:04.745060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:04.745068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:04.745077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:04.745117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:04.747604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:04.748147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:04.748161Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:04.748164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:04.748168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:04.748175Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3189 [2:7559602880170089648:12523]
2025-10-10T14:40:04.748192Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:04.748217Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:04.748221Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:04.748230Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:04.748232Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:04.748264Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:04.748278Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:04.748287Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:04.748343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:04.748350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:04.748352Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:04.748357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:04.748426Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:04.748443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:04.748458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:04.748472Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:04.748492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:04.748522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602880952341048:2438], now have 1 active actors on pipe
2025-10-10T14:40:04.748529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602880952341326:3088], now have 1 active actors on pipe
2025-10-10T14:40:04.748537Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602880170089643:12523]
2025-10-10T14:40:04.748539Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602880170089643:12523]
2025-10-10T14:40:04.748541Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602880170089643:12523]
2025-10-10T14:40:04.748555Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:04.748569Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:04.748571Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:04.748573Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:04.748587Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:04.748588Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:04.748591Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:04.748617Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602880170089643:12523]
2025-10-10T14:40:04.748621Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:04.748624Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:04.748600Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3189
2025-10-10T14:40:04.748660Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3189
2025-10-10T14:40:04.748804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:04.748818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:04.748849Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6b3242db-69ce0b57-3c0f9bc5-5e5f7840_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:04.748870Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:04.748879Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:04.748881Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:04.748892Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:04.748903Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:04.748922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:04.749737Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|361936da-ebe5e912-597eb72e-65262320_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|6b3242db-69ce0b57-3c0f9bc5-5e5f7840_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:04.752622Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6b3242db-69ce0b57-3c0f9bc5-5e5f7840_0] Write session: try to update token
2025-10-10T14:40:04.752643Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6b3242db-69ce0b57-3c0f9bc5-5e5f7840_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:04.749212Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3190 partition: 0 MaxSeqNo: 40 sessionId: src_id|6b3242db-69ce0b57-3c0f9bc5-5e5f7840_0
2025-10-10T14:40:04.749086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:04.749094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:04.749111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:04.768822Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:04.768849Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:04.768853Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:04.768855Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:04.768867Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602880170089643:12523]
2025-10-10T14:40:04.768872Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602880170089643:12523]
2025-10-10T14:40:04.768876Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602880170089643:12523]
2025-10-10T14:40:04.768922Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:04.768929Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:04.768933Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:04.768935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:04.768943Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:04.768946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:04.769099Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:04.774862Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3190 sessionId: src_id|6b3242db-69ce0b57-3c0f9bc5-5e5f7840_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:04.777749Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:04.805823Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602880952341417:4596]
2025-10-10T14:40:04.806157Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 pipe creation result: OK TabletId: 72075186224037892 Generation: 3189, pipe: [1:7559602880952341417:4596]
2025-10-10T14:40:04.887126Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:04.888010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:04.888029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:04.888077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602880952341417:4596], now have 1 active actors on pipe
2025-10-10T14:40:04.888325Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:04.888322Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:04.888381Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 88 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602880952341417:4596]
2025-10-10T14:40:04.888411Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:40:04.888503Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3190 reason: status is not ok: tablet will be restarted right now sessionId: src_id|6b3242db-69ce0b57-3c0f9bc5-5e5f7840_0
2025-10-10T14:40:04.888765Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3190 sessionId: src_id|6b3242db-69ce0b57-3c0f9bc5-5e5f7840_0 is DEAD
2025-10-10T14:40:04.888911Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b3242db-69ce0b57-3c0f9bc5-5e5f7840_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:40:04.888919Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b3242db-69ce0b57-3c0f9bc5-5e5f7840_0] Write session will restart in 0.005193s
2025-10-10T14:40:04.888943Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b3242db-69ce0b57-3c0f9bc5-5e5f7840_0] Write session: Do CDS request
2025-10-10T14:40:04.888949Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b3242db-69ce0b57-3c0f9bc5-5e5f7840_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:04.895046Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6b3242db-69ce0b57-3c0f9bc5-5e5f7840_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:04.895071Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:04.895088Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3191
2025-10-10T14:40:04.895318Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3191 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:04.895362Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3191 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:04.895374Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3191 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:04.895379Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:04.895863Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3191 sessionId:  describe result for acl check
2025-10-10T14:40:04.895913Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:04.895920Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:04.895922Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:04.895928Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602880952341450:3052] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:04.896547Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602880952341450:3052] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:04.899848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602880952341450:3052] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:04.903953Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602880952341450:3052] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:04.903980Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602880952341450:3052] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:04.903984Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602880952341450:3052] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:04.903993Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3191 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:04.921183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:04.921884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:04.922126Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:04.922145Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:04.922161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:04.922228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:04.922963Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602880170089956:12532]
2025-10-10T14:40:04.923598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:04.923973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:04.924034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:04.924385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:04.924492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:04.924500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:04.924502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:04.924503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:04.924504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:04.924505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:04.924506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:04.924507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:04.924509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:04.924510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:04.924511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:04.924512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:04.924513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:04.924520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:04.924533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:04.924537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:04.924541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:04.924544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:04.924547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:04.924551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:04.924554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:04.924558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:04.924562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:04.924566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:04.924570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:04.924574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:04.924584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:04.924593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:04.924600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:04.924606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:04.924611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:04.924617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:04.924621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:04.924626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:04.924631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:04.924637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:04.924643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:04.924649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:04.924654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:04.924659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:04.924664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:04.924669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:04.924676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:04.924680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:04.924685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:04.924691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:04.924696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:04.924702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:04.924706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:04.924713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:04.924718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:04.924723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:04.924760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:04.927317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:04.927656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:04.927673Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:04.927675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:04.927680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:04.927688Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3190 [2:7559602880170089956:12532]
2025-10-10T14:40:04.927703Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:04.927724Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:04.927727Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:04.927731Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:04.927733Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:04.927753Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:04.927770Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:04.927783Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:04.927851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:04.927861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:04.927863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:04.927865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:04.927941Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:04.927948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:04.927958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:04.927968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:04.927993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:04.928018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602880952341436:2438], now have 1 active actors on pipe
2025-10-10T14:40:04.928027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602880952341579:3052], now have 1 active actors on pipe
2025-10-10T14:40:04.928036Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602880170089951:12532]
2025-10-10T14:40:04.928039Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602880170089951:12532]
2025-10-10T14:40:04.928041Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602880170089951:12532]
2025-10-10T14:40:04.928056Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:04.928072Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:04.928078Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:04.928082Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:04.928084Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:04.928095Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:04.928103Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:04.928095Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3190
2025-10-10T14:40:04.928096Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3190
2025-10-10T14:40:04.928130Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602880170089951:12532]
2025-10-10T14:40:04.928142Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:04.928145Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:04.928175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:04.928186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:04.928231Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d02af467-7a528bbe-3fc28689-23aebbaa_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:04.928245Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:04.928254Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:04.928256Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:04.928269Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:04.928286Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:04.928314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:04.928514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:04.928525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:04.928545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:04.928669Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3191 partition: 0 MaxSeqNo: 40 sessionId: src_id|d02af467-7a528bbe-3fc28689-23aebbaa_0
2025-10-10T14:40:04.929163Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b3242db-69ce0b57-3c0f9bc5-5e5f7840_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|d02af467-7a528bbe-3fc28689-23aebbaa_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:04.932033Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d02af467-7a528bbe-3fc28689-23aebbaa_0] Write session: try to update token
2025-10-10T14:40:04.932059Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d02af467-7a528bbe-3fc28689-23aebbaa_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:04.948466Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:04.948485Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:04.948489Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:04.948491Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:04.948501Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602880170089951:12532]
2025-10-10T14:40:04.948505Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602880170089951:12532]
2025-10-10T14:40:04.948509Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602880170089951:12532]
2025-10-10T14:40:04.948560Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:04.948577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:04.948579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:04.948717Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:04.948835Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3191 sessionId: src_id|d02af467-7a528bbe-3fc28689-23aebbaa_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:04.950859Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:04.950878Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:04.950883Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:04.951505Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:04.988611Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602880952341786:4596]
2025-10-10T14:40:04.988894Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 pipe creation result: OK TabletId: 72075186224037892 Generation: 3190, pipe: [1:7559602880952341786:4596]
2025-10-10T14:40:05.067583Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:05.068658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:05.068679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:05.068727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602880952341786:4596], now have 1 active actors on pipe
2025-10-10T14:40:05.068975Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:05.069378Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:05.069378Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 89 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602880952341786:4596]
2025-10-10T14:40:05.069404Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:40:05.069478Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3191 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d02af467-7a528bbe-3fc28689-23aebbaa_0
2025-10-10T14:40:05.069685Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3191 sessionId: src_id|d02af467-7a528bbe-3fc28689-23aebbaa_0 is DEAD
2025-10-10T14:40:05.069829Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d02af467-7a528bbe-3fc28689-23aebbaa_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:40:05.069838Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d02af467-7a528bbe-3fc28689-23aebbaa_0] Write session will restart in 0.008452s
2025-10-10T14:40:05.069861Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d02af467-7a528bbe-3fc28689-23aebbaa_0] Write session: Do CDS request
2025-10-10T14:40:05.069867Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d02af467-7a528bbe-3fc28689-23aebbaa_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:05.080001Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d02af467-7a528bbe-3fc28689-23aebbaa_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:05.081667Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:05.081694Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3192
2025-10-10T14:40:05.081826Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3192 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:05.081873Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3192 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:05.081883Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3192 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:05.081887Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:05.082637Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3192 sessionId:  describe result for acl check
2025-10-10T14:40:05.082675Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:05.082682Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:05.082684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:05.082691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602885247309171:3036] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:05.083272Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602885247309171:3036] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:05.085882Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602885247309171:3036] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:05.089461Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602885247309171:3036] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:05.089475Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602885247309171:3036] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:05.089478Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602885247309171:3036] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:05.089487Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3192 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:05.106416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:05.107105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:05.107339Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:05.107351Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:05.107365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:05.107427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:05.107475Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602884465057535:12534]
2025-10-10T14:40:05.108154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:05.108478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:05.108542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:05.108871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:05.108944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:05.108951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:05.108952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:05.108954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:05.108955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:05.108957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:05.108958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:05.108959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:05.108961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:05.108963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:05.108964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:05.108965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:05.108967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:05.108973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:05.108987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:05.108991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:05.108995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:05.109000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:05.109004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:05.109008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:05.109012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:05.109016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:05.109020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:05.109024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:05.109028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:05.109033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:05.109043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:05.109052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:05.109059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:05.109065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:05.109069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:05.109075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:05.109079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:05.109085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:05.109090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:05.109101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:05.109106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:05.109110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:05.109115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:05.109121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:05.109131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:05.109137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:05.109146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:05.109152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:05.109156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:05.109166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:05.109171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:05.109181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:05.109185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:05.109256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:05.109270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:05.109289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:05.109362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:05.112299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:05.112638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:05.112652Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:05.112655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:05.112659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:05.112666Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3191 [2:7559602884465057535:12534]
2025-10-10T14:40:05.112680Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:05.112698Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:05.112702Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:05.112706Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:05.112708Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:05.112727Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:05.112743Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:05.112754Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:05.112813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:05.112822Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:05.112825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:05.112828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:05.113062Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3191
2025-10-10T14:40:05.113062Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3191
2025-10-10T14:40:05.113570Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:05.113583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:05.113597Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:05.113611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:05.113635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:05.113666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602885247309289:3036], now have 1 active actors on pipe
2025-10-10T14:40:05.113674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602885247309085:2438], now have 1 active actors on pipe
2025-10-10T14:40:05.113700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:05.113712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:05.113733Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602884465057530:12534]
2025-10-10T14:40:05.113740Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602884465057530:12534]
2025-10-10T14:40:05.113742Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602884465057530:12534]
2025-10-10T14:40:05.113758Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:05.113771Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:05.113774Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:05.113778Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:05.113780Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:05.113797Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:05.113800Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:05.113823Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6aa774d5-971d5b36-4df49836-be595d3e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:05.113837Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:05.113842Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:05.113844Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:05.113858Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:05.113872Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:05.113909Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602884465057530:12534]
2025-10-10T14:40:05.113918Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:05.113924Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:05.113931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:05.114425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:05.114443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:05.114470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:05.117107Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3192 partition: 0 MaxSeqNo: 40 sessionId: src_id|6aa774d5-971d5b36-4df49836-be595d3e_0
2025-10-10T14:40:05.117612Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d02af467-7a528bbe-3fc28689-23aebbaa_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|6aa774d5-971d5b36-4df49836-be595d3e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:05.120495Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6aa774d5-971d5b36-4df49836-be595d3e_0] Write session: try to update token
2025-10-10T14:40:05.120518Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6aa774d5-971d5b36-4df49836-be595d3e_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:05.136483Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:05.136506Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:05.136510Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:05.136512Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:05.136522Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602884465057530:12534]
2025-10-10T14:40:05.136528Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602884465057530:12534]
2025-10-10T14:40:05.136532Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602884465057530:12534]
2025-10-10T14:40:05.136584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:05.136586Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:05.136593Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:05.136593Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:05.136595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:05.136597Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:05.136739Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:05.147067Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3192 sessionId: src_id|6aa774d5-971d5b36-4df49836-be595d3e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:05.150055Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:05.169538Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602885247309433:4596]
2025-10-10T14:40:05.169946Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 pipe creation result: OK TabletId: 72075186224037892 Generation: 3191, pipe: [1:7559602885247309433:4596]
2025-10-10T14:40:05.247364Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:05.248143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:05.248164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:05.248189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602885247309433:4596], now have 1 active actors on pipe
2025-10-10T14:40:05.248384Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:05.252146Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:40:05.252245Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3192 reason: status is not ok: tablet will be restarted right now sessionId: src_id|6aa774d5-971d5b36-4df49836-be595d3e_0
2025-10-10T14:40:05.252506Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3192 sessionId: src_id|6aa774d5-971d5b36-4df49836-be595d3e_0 is DEAD
2025-10-10T14:40:05.252676Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6aa774d5-971d5b36-4df49836-be595d3e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:40:05.252699Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6aa774d5-971d5b36-4df49836-be595d3e_0] Write session will restart in 0.007109s
2025-10-10T14:40:05.252725Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6aa774d5-971d5b36-4df49836-be595d3e_0] Write session: Do CDS request
2025-10-10T14:40:05.252732Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6aa774d5-971d5b36-4df49836-be595d3e_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:05.252790Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 90 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602885247309433:4596]
2025-10-10T14:40:05.252811Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:05.260998Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6aa774d5-971d5b36-4df49836-be595d3e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:05.261081Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:05.261102Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3193
2025-10-10T14:40:05.261244Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3193 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:05.261282Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3193 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:05.261294Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3193 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:05.261298Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:05.261870Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3193 sessionId:  describe result for acl check
2025-10-10T14:40:05.261911Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:05.261918Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:05.261923Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:05.261930Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602885247309442:3030] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:05.262547Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602885247309442:3030] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:05.266101Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602885247309442:3030] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:05.268874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602885247309442:3030] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:05.268894Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602885247309442:3030] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:05.268897Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602885247309442:3030] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:05.268907Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3193 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:05.297857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:05.305223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:05.305961Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:05.305979Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:05.305995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:05.306081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:05.306140Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602884465057821:12536]
2025-10-10T14:40:05.306845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:05.308057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:05.308123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:05.308510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:05.308587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:05.308598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:05.308600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:05.308601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:05.308603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:05.308604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:05.308606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:05.308607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:05.308609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:05.308610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:05.308612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:05.308613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:05.308615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:05.308622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:05.308637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:05.308642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:05.308647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:05.308652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:05.308657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:05.308662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:05.308667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:05.308672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:05.308677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:05.308681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:05.308686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:05.308691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:05.308700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:05.308710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:05.308720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:05.308726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:05.308731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:05.308737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:05.308742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:05.308748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:05.308754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:05.308761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:05.308766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:05.308772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:05.308777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:05.308783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:05.308788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:05.308796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:05.308801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:05.308807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:05.308813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:05.308819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:05.308824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:05.308831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:05.308838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:05.308844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:05.308849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:05.308856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:05.308904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:05.311935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:05.312825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:05.312856Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:05.312858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:05.312863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:05.312871Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3192 [2:7559602884465057821:12536]
2025-10-10T14:40:05.312886Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:05.312915Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:05.312924Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:05.312928Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:05.312930Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:05.312950Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:05.312959Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:05.312970Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:05.313043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:05.313052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:05.313055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:05.313058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:05.313140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:05.313149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:05.313163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:05.313182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:05.313207Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:05.313236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602885247309435:2438], now have 1 active actors on pipe
2025-10-10T14:40:05.313245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602885247309480:3030], now have 1 active actors on pipe
2025-10-10T14:40:05.313255Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602884465057816:12536]
2025-10-10T14:40:05.313266Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602884465057816:12536]
2025-10-10T14:40:05.313269Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602884465057816:12536]
2025-10-10T14:40:05.313347Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3192
2025-10-10T14:40:05.313286Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:05.313354Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3192
2025-10-10T14:40:05.313301Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:05.313320Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:05.313323Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:05.313374Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602884465057816:12536]
2025-10-10T14:40:05.313377Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:05.313475Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:05.313483Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:05.313486Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:05.313493Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:05.313829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:05.313844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:05.313880Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|20c4fcff-23ce2043-33bed2dc-bac91752_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:05.313894Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:05.313898Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:05.313901Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:05.313914Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:05.313932Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:05.313951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:05.315779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:05.315794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:05.315821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:05.315984Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3193 partition: 0 MaxSeqNo: 40 sessionId: src_id|20c4fcff-23ce2043-33bed2dc-bac91752_0
2025-10-10T14:40:05.316475Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6aa774d5-971d5b36-4df49836-be595d3e_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|20c4fcff-23ce2043-33bed2dc-bac91752_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:05.319241Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|20c4fcff-23ce2043-33bed2dc-bac91752_0] Write session: try to update token
2025-10-10T14:40:05.319263Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|20c4fcff-23ce2043-33bed2dc-bac91752_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:05.344089Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3193 sessionId: src_id|20c4fcff-23ce2043-33bed2dc-bac91752_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:05.343701Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:05.343727Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:05.343731Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:05.343733Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:05.343745Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602884465057816:12536]
2025-10-10T14:40:05.343750Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602884465057816:12536]
2025-10-10T14:40:05.343755Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602884465057816:12536]
2025-10-10T14:40:05.343814Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:05.343823Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:05.343826Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:05.344008Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:05.345541Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:05.345566Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:05.345573Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:05.346924Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:05.352655Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602885247309784:4596]
2025-10-10T14:40:05.353217Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 pipe creation result: OK TabletId: 72075186224037892 Generation: 3192, pipe: [1:7559602885247309784:4596]
2025-10-10T14:40:05.461259Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:05.461865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:05.461883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:05.461910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602885247309784:4596], now have 1 active actors on pipe
2025-10-10T14:40:05.462336Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:05.462341Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:40:05.462346Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:40:05.462402Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 91 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602885247309784:4596]
2025-10-10T14:40:05.462412Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3193 reason: error at write: Disconnected sessionId: src_id|20c4fcff-23ce2043-33bed2dc-bac91752_0
2025-10-10T14:40:05.462394Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:05.462983Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20c4fcff-23ce2043-33bed2dc-bac91752_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:40:05.462637Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3193 sessionId: src_id|20c4fcff-23ce2043-33bed2dc-bac91752_0 is DEAD
2025-10-10T14:40:05.462997Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20c4fcff-23ce2043-33bed2dc-bac91752_0] Write session will restart in 0.009856s
2025-10-10T14:40:05.463021Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20c4fcff-23ce2043-33bed2dc-bac91752_0] Write session: Do CDS request
2025-10-10T14:40:05.463044Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20c4fcff-23ce2043-33bed2dc-bac91752_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:05.473906Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|20c4fcff-23ce2043-33bed2dc-bac91752_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:05.474034Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:05.474076Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3194
2025-10-10T14:40:05.474266Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3194 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:05.474307Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3194 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:05.474313Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3194 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:05.474317Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:05.474960Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3194 sessionId:  describe result for acl check
2025-10-10T14:40:05.475020Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:05.475038Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:05.475040Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:05.475048Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602885247309820:3021] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:05.475701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602885247309820:3021] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:05.478796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602885247309820:3021] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:05.484655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602885247309820:3021] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:05.484673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602885247309820:3021] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:05.484677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602885247309820:3021] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:05.484689Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3194 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:05.508346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:05.509348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:05.509581Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:05.509594Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:05.509608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:05.509666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:05.509715Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602884465058107:12539]
2025-10-10T14:40:05.510362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:05.510990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:05.511044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:05.511393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:05.511457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:05.511458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:05.511460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:05.511461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:05.511463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:05.511464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:05.511466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:05.511467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:05.511468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:05.511470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:05.511472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:05.511473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:05.511475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:05.511481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:05.511495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:05.511499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:05.511503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:05.511508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:05.511512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:05.511516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:05.511520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:05.511524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:05.511528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:05.511533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:05.511537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:05.511541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:05.511549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:05.511558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:05.511565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:05.511572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:05.511577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:05.511583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:05.511588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:05.511593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:05.511598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:05.511604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:05.511608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:05.511614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:05.511620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:05.511626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:05.511631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:05.511636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:05.511643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:05.511649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:05.511653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:05.511659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:05.511664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:05.511670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:05.511674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:05.511680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:05.511684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:05.511690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:05.511732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:05.514546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:05.515398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:05.515405Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:05.515407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:05.515411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:05.515419Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3193 [2:7559602884465058107:12539]
2025-10-10T14:40:05.515434Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:05.515478Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:05.515483Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:05.515486Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:05.515488Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:05.515509Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:05.515518Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:05.515527Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:05.515595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:05.515598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:05.515601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:05.515603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:05.515682Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:05.515686Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:05.515698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:05.515710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:05.515728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:05.515751Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602884465058102:12539]
2025-10-10T14:40:05.515987Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3193
2025-10-10T14:40:05.516026Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3193
2025-10-10T14:40:05.515754Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602884465058102:12539]
2025-10-10T14:40:05.515756Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602884465058102:12539]
2025-10-10T14:40:05.515766Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:05.515782Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:05.515795Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:05.515798Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:05.515799Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:05.515801Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:05.515801Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:05.515842Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602884465058102:12539]
2025-10-10T14:40:05.515851Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:05.515862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602885247309963:3021], now have 1 active actors on pipe
2025-10-10T14:40:05.515867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602885247309786:2438], now have 1 active actors on pipe
2025-10-10T14:40:05.516358Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:05.516558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:05.516579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:05.516621Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d4655991-d8d50ea4-dac7f0a2-44010041_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:05.516639Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:05.516649Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:05.516652Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:05.516667Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:05.516688Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:05.516713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:05.517582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:05.517598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:05.517622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:05.517777Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3194 partition: 0 MaxSeqNo: 40 sessionId: src_id|d4655991-d8d50ea4-dac7f0a2-44010041_0
2025-10-10T14:40:05.518247Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20c4fcff-23ce2043-33bed2dc-bac91752_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|d4655991-d8d50ea4-dac7f0a2-44010041_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:05.520985Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4655991-d8d50ea4-dac7f0a2-44010041_0] Write session: try to update token
2025-10-10T14:40:05.521008Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4655991-d8d50ea4-dac7f0a2-44010041_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:05.542060Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3194 sessionId: src_id|d4655991-d8d50ea4-dac7f0a2-44010041_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:05.544781Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:05.541944Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:05.541968Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:05.541973Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:05.541975Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:05.541987Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602884465058102:12539]
2025-10-10T14:40:05.541995Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602884465058102:12539]
2025-10-10T14:40:05.542000Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602884465058102:12539]
2025-10-10T14:40:05.542057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:05.542067Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:05.542069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:05.542261Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:05.545224Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:05.545231Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:05.545239Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:05.562594Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602885247310136:4596]
2025-10-10T14:40:05.565589Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 pipe creation result: OK TabletId: 72075186224037892 Generation: 3193, pipe: [1:7559602885247310136:4596]
2025-10-10T14:40:05.664623Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:05.665179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:05.665192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:05.665244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602885247310136:4596], now have 1 active actors on pipe
2025-10-10T14:40:05.665723Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:05.666119Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4655991-d8d50ea4-dac7f0a2-44010041_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:40:05.666130Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4655991-d8d50ea4-dac7f0a2-44010041_0] Write session will restart in 0.006373s
2025-10-10T14:40:05.666154Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4655991-d8d50ea4-dac7f0a2-44010041_0] Write session: Do CDS request
2025-10-10T14:40:05.666160Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4655991-d8d50ea4-dac7f0a2-44010041_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:05.665631Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 92 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602885247310136:4596]
2025-10-10T14:40:05.665671Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:40:05.665677Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:40:05.665738Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3194 reason: error at write: Disconnected sessionId: src_id|d4655991-d8d50ea4-dac7f0a2-44010041_0
2025-10-10T14:40:05.665969Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3194 sessionId: src_id|d4655991-d8d50ea4-dac7f0a2-44010041_0 is DEAD
2025-10-10T14:40:05.666115Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:05.673942Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4655991-d8d50ea4-dac7f0a2-44010041_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:05.674051Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:05.674077Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3195
2025-10-10T14:40:05.677579Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3195 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:05.677649Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3195 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:05.677661Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3195 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:05.677666Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:05.678177Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3195 sessionId:  describe result for acl check
2025-10-10T14:40:05.678234Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:05.678236Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:05.678238Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:05.678244Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602885247310211:3016] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:05.678845Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602885247310211:3016] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:05.681779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602885247310211:3016] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:05.687084Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602885247310211:3016] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:05.687105Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602885247310211:3016] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:05.687109Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602885247310211:3016] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:05.687119Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3195 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:05.693049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:05.698938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:05.699231Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:05.699246Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:05.699260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:05.699331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:05.699379Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602884465058393:12541]
2025-10-10T14:40:05.699965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:05.700288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:05.700322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:05.700659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:05.700723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:05.700729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:05.700731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:05.700732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:05.700733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:05.700734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:05.700736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:05.700737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:05.700739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:05.700740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:05.700742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:05.700743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:05.700744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:05.700750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:05.700764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:05.700768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:05.700773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:05.700777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:05.700781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:05.700785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:05.700790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:05.700794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:05.700798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:05.700802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:05.700806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:05.700811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:05.700819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:05.700828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:05.700835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:05.700841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:05.700848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:05.700853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:05.700857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:05.700865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:05.700870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:05.700875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:05.700879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:05.700884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:05.700896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:05.700901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:05.700906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:05.700911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:05.700930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:05.700940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:05.700944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:05.700950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:05.700958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:05.700963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:05.700968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:05.700978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:05.700982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:05.700987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:05.701036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:05.703732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:05.704485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:05.704490Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:05.704495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:05.704500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:05.704517Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3194 [2:7559602884465058393:12541]
2025-10-10T14:40:05.704531Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:05.704551Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:05.704555Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:05.704558Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:05.704560Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:05.704578Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:05.704586Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:05.704595Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:05.704664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:05.704667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:05.704669Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:05.704671Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:05.704747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:05.704750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:05.704762Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:05.704772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:05.704786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:05.704806Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602884465058388:12541]
2025-10-10T14:40:05.704808Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602884465058388:12541]
2025-10-10T14:40:05.704810Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602884465058388:12541]
2025-10-10T14:40:05.704823Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:05.704837Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:05.704838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602885247310407:3016], now have 1 active actors on pipe
2025-10-10T14:40:05.704841Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:05.704841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602885247310138:2438], now have 1 active actors on pipe
2025-10-10T14:40:05.704843Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:05.704850Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:05.704864Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:05.704866Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:05.704897Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602884465058388:12541]
2025-10-10T14:40:05.704900Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:05.704911Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:05.705099Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3194
2025-10-10T14:40:05.705108Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3194
2025-10-10T14:40:05.705269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:05.705285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:05.705323Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|62b04cef-8548c974-3682a5a7-3371ee04_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:05.705355Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:05.705364Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:05.705366Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:05.705383Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:05.705402Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:05.705424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:05.705622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:05.705633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:05.705656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:05.705757Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3195 partition: 0 MaxSeqNo: 40 sessionId: src_id|62b04cef-8548c974-3682a5a7-3371ee04_0
2025-10-10T14:40:05.706231Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4655991-d8d50ea4-dac7f0a2-44010041_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|62b04cef-8548c974-3682a5a7-3371ee04_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:05.709146Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|62b04cef-8548c974-3682a5a7-3371ee04_0] Write session: try to update token
2025-10-10T14:40:05.709165Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|62b04cef-8548c974-3682a5a7-3371ee04_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:05.725357Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3195 sessionId: src_id|62b04cef-8548c974-3682a5a7-3371ee04_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:05.725038Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:40:05.725060Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:05.725072Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602884465058388:12541]
2025-10-10T14:40:05.725129Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:40:05.725134Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:40:05.725380Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:40:05.725539Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:05.725694Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:05.725849Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:05.726396Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:40:05.726454Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:40:05.728126Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:05.728404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:05.728437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:05.728481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:40:05.728576Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:40:05.739175Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:05.739198Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:05.739201Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:05.739203Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:05.739215Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602884465058388:12541]
2025-10-10T14:40:05.739219Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602884465058388:12541]
2025-10-10T14:40:05.739226Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602884465058388:12541]
2025-10-10T14:40:05.739273Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:05.739281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:05.739283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:05.739283Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:05.739290Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:05.739295Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:05.739421Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:05.769212Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602885247310489:4596]
2025-10-10T14:40:05.769799Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 pipe creation result: OK TabletId: 72075186224037892 Generation: 3194, pipe: [1:7559602885247310489:4596]
2025-10-10T14:40:05.850126Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:05.858686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:05.858720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:05.858909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:05.858970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:05.859033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:05.859095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:05.859136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:05.859141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:05.859227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:05.859285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:05.859349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:05.859413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:05.859454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:05.859457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:05.859530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:05.859592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:05.859655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:05.859713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:05.859755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:05.859759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:05.859830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:05.859891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:05.859951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:05.860015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:05.860055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:05.860058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:05.860127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:05.860193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:05.860256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:05.860318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:05.860360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:05.860363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:05.860477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:05.860540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:05.860602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:05.860662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:05.860703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:05.860705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:05.860772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:05.860830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:05.860893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:05.860958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:05.860999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:05.861002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:05.861074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:05.861133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:05.861193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:05.861251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:05.861292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:05.861295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:05.861729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:05.861799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:05.861858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:05.861920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:05.861960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:05.861963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:05.862032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:05.862092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:05.862153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:05.862220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:05.862262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:05.862265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:05.862336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602885247310489:4596], now have 1 active actors on pipe
2025-10-10T14:40:05.863532Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:05.862665Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:05.862741Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:40:05.862744Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:40:05.862777Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3195 reason: error at write: Disconnected sessionId: src_id|62b04cef-8548c974-3682a5a7-3371ee04_0
2025-10-10T14:40:05.862979Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 93 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602885247310489:4596]
2025-10-10T14:40:05.863056Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3195 sessionId: src_id|62b04cef-8548c974-3682a5a7-3371ee04_0 is DEAD
2025-10-10T14:40:05.866306Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|62b04cef-8548c974-3682a5a7-3371ee04_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:40:05.866318Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|62b04cef-8548c974-3682a5a7-3371ee04_0] Write session will restart in 0.007787s
2025-10-10T14:40:05.866346Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|62b04cef-8548c974-3682a5a7-3371ee04_0] Write session: Do CDS request
2025-10-10T14:40:05.866352Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|62b04cef-8548c974-3682a5a7-3371ee04_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:05.878154Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|62b04cef-8548c974-3682a5a7-3371ee04_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:05.881680Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:05.881697Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3196
2025-10-10T14:40:05.881955Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3196 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:05.882003Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3196 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:05.882009Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3196 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:05.882020Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:05.882677Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3196 sessionId:  describe result for acl check
2025-10-10T14:40:05.882707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:05.882710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:05.882711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:05.882717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602885247310606:2981] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:05.883998Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602885247310606:2981] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:05.887741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602885247310606:2981] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:05.896961Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602885247310606:2981] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:05.896984Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602885247310606:2981] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:05.896988Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602885247310606:2981] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:05.896999Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3196 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:05.905577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:05.911197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:05.911777Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:05.911794Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:05.911812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:05.911897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:05.911944Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602884465058729:12557]
2025-10-10T14:40:05.912591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:05.913079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:05.913137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:05.913466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:05.913535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:05.913543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:05.913544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:05.913545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:05.913546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:05.913548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:05.913549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:05.913550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:05.913551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:05.913552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:05.913553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:05.913554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:05.913555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:05.913562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:05.913576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:05.913579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:05.913583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:05.913586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:05.913590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:05.913592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:05.913596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:05.913599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:05.913602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:05.913605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:05.913608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:05.913611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:05.913619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:05.913628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:05.913634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:05.913639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:05.913647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:05.913651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:05.913668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:05.913672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:05.913677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:05.913682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:05.913686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:05.913690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:05.913694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:05.913699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:05.913703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:05.913710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:05.913715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:05.913720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:05.913724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:05.913729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:05.913732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:05.913736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:05.913740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:05.913744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:05.913748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:05.913752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:05.913785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:05.916685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:05.917512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:05.917531Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:05.917537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:05.917541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:05.917548Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3195 [2:7559602884465058729:12557]
2025-10-10T14:40:05.917561Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:05.917580Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:05.917583Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:05.917587Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:05.917589Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:05.917607Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:05.917615Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:05.917622Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:05.917689Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:05.917698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:05.917700Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:05.917702Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:05.917769Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:05.917777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:05.917787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:05.917799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:05.917817Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:05.917843Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602884465058724:12557]
2025-10-10T14:40:05.917849Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602884465058724:12557]
2025-10-10T14:40:05.917852Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602884465058724:12557]
2025-10-10T14:40:05.917869Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:05.917882Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:05.917901Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:05.917908Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:05.917923Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:05.917927Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:05.917930Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:05.917941Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602884465058724:12557]
2025-10-10T14:40:05.917953Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:05.918013Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:05.918427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602885247310522:2438], now have 1 active actors on pipe
2025-10-10T14:40:05.918438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602885247310799:2981], now have 1 active actors on pipe
2025-10-10T14:40:05.918456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:05.918470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:05.918504Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|eac26522-5002f1b-dfc8e6ee-5c323e05_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:05.918518Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:05.918522Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:05.918525Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:05.918537Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:05.918554Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:05.918573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:05.921208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:05.921225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:05.921268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:05.918143Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3195
2025-10-10T14:40:05.918195Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3195
2025-10-10T14:40:05.921421Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3196 partition: 0 MaxSeqNo: 40 sessionId: src_id|eac26522-5002f1b-dfc8e6ee-5c323e05_0
2025-10-10T14:40:05.925957Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|62b04cef-8548c974-3682a5a7-3371ee04_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|eac26522-5002f1b-dfc8e6ee-5c323e05_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:05.928615Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eac26522-5002f1b-dfc8e6ee-5c323e05_0] Write session: try to update token
2025-10-10T14:40:05.928636Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eac26522-5002f1b-dfc8e6ee-5c323e05_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:05.931376Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:40:05.931400Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:05.931412Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602884465058724:12557]
2025-10-10T14:40:05.931466Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:40:05.931470Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:40:05.931669Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:40:05.931834Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:05.932023Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:05.932231Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:05.932567Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:40:05.932644Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:40:05.951012Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:05.951038Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:05.951042Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:05.951048Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:05.951060Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602884465058724:12557]
2025-10-10T14:40:05.951065Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602884465058724:12557]
2025-10-10T14:40:05.951068Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602884465058724:12557]
2025-10-10T14:40:05.951124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:05.951133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:05.951136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:05.951237Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:05.951250Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:05.951254Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:05.951292Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:05.951810Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3196 sessionId: src_id|eac26522-5002f1b-dfc8e6ee-5c323e05_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:05.954607Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:05.962965Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602885247310891:4596]
2025-10-10T14:40:05.963226Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 pipe creation result: OK TabletId: 72075186224037892 Generation: 3195, pipe: [1:7559602885247310891:4596]
2025-10-10T14:40:06.069982Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:06.070626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:06.070642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:06.070669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602885247310891:4596], now have 1 active actors on pipe
2025-10-10T14:40:06.071003Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:06.071019Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 94 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602885247310891:4596]
2025-10-10T14:40:06.070963Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:06.071067Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:40:06.071086Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:40:06.071176Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3196 reason: error at write: Disconnected sessionId: src_id|eac26522-5002f1b-dfc8e6ee-5c323e05_0
2025-10-10T14:40:06.071378Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3196 sessionId: src_id|eac26522-5002f1b-dfc8e6ee-5c323e05_0 is DEAD
2025-10-10T14:40:06.071610Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eac26522-5002f1b-dfc8e6ee-5c323e05_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:40:06.071635Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eac26522-5002f1b-dfc8e6ee-5c323e05_0] Write session will restart in 0.006855s
2025-10-10T14:40:06.071667Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eac26522-5002f1b-dfc8e6ee-5c323e05_0] Write session: Do CDS request
2025-10-10T14:40:06.071677Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eac26522-5002f1b-dfc8e6ee-5c323e05_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:06.079972Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eac26522-5002f1b-dfc8e6ee-5c323e05_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:06.080146Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:06.080166Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3197
2025-10-10T14:40:06.080336Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3197 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:06.080372Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3197 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:06.080383Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3197 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:06.080388Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:06.080950Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3197 sessionId:  describe result for acl check
2025-10-10T14:40:06.081014Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:06.081026Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:06.081030Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:06.081036Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602889542278204:2968] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:06.081866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602889542278204:2968] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:06.084284Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602889542278204:2968] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:06.088026Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602889542278204:2968] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:06.088045Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602889542278204:2968] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:06.088049Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602889542278204:2968] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:06.088068Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3197 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:06.107975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:06.116232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:06.116536Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:06.116557Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:06.116570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:06.116642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:06.116694Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602888760026313:12559]
2025-10-10T14:40:06.117375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:06.117782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:06.117849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:06.118190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:06.118260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:06.118270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:06.118271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:06.118273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:06.118274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:06.118275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:06.118277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:06.118278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:06.118280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:06.118282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:06.118283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:06.118285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:06.118286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:06.118293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:06.118305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:06.118309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:06.118314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:06.118318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:06.118322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:06.118327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:06.118331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:06.118336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:06.118341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:06.118345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:06.118349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:06.118353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:06.118361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:06.118369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:06.118376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:06.118381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:06.118387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:06.118393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:06.118399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:06.118404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:06.118409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:06.118413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:06.118417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:06.118422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:06.118427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:06.118432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:06.118438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:06.118444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:06.118449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:06.118455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:06.118459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:06.118465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:06.118470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:06.118474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:06.118479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:06.118484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:06.118489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:06.118494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:06.118537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:06.121297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:06.122568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:06.122586Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:06.122589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:06.122594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:06.122602Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3196 [2:7559602888760026313:12559]
2025-10-10T14:40:06.122616Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:06.122636Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:06.122639Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:06.122642Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:06.122645Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:06.122662Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:06.122670Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:06.122677Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:06.122749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:06.122762Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:06.122767Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:06.122770Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:06.122855Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:06.122864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:06.122878Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:06.122896Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:06.122921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:06.122947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602889542278283:2968], now have 1 active actors on pipe
2025-10-10T14:40:06.122957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602889542278189:2438], now have 1 active actors on pipe
2025-10-10T14:40:06.122964Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602888760026308:12559]
2025-10-10T14:40:06.122967Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602888760026308:12559]
2025-10-10T14:40:06.122970Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602888760026308:12559]
2025-10-10T14:40:06.122987Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:06.123000Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:06.123003Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:06.123007Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:06.123010Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:06.123021Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:06.123025Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:06.123059Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602888760026308:12559]
2025-10-10T14:40:06.123073Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:06.123083Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:06.123231Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3196
2025-10-10T14:40:06.123279Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3196
2025-10-10T14:40:06.123374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:06.123393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:06.123424Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|52e5db73-d5865d0a-7ee48633-fb9ba683_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:06.123433Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:06.123440Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:06.123443Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:06.123456Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:06.123476Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:06.123513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:06.123686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:06.123700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:06.123722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:06.123850Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3197 partition: 0 MaxSeqNo: 40 sessionId: src_id|52e5db73-d5865d0a-7ee48633-fb9ba683_0
2025-10-10T14:40:06.124351Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eac26522-5002f1b-dfc8e6ee-5c323e05_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|52e5db73-d5865d0a-7ee48633-fb9ba683_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:06.127280Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|52e5db73-d5865d0a-7ee48633-fb9ba683_0] Write session: try to update token
2025-10-10T14:40:06.127302Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|52e5db73-d5865d0a-7ee48633-fb9ba683_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:06.135827Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:40:06.135862Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:06.135874Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602888760026308:12559]
2025-10-10T14:40:06.135932Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:40:06.135951Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:40:06.136164Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:40:06.136351Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:06.136547Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:06.136744Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:06.137019Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:40:06.137078Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:40:06.154653Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3197 sessionId: src_id|52e5db73-d5865d0a-7ee48633-fb9ba683_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:06.157326Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:06.157386Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:06.157392Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:06.157394Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:06.157407Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602888760026308:12559]
2025-10-10T14:40:06.157413Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602888760026308:12559]
2025-10-10T14:40:06.157421Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602888760026308:12559]
2025-10-10T14:40:06.157492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:06.157501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:06.157513Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:06.157708Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:06.158120Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:06.158351Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:06.158367Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:06.158374Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:06.168462Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602889542278541:4596]
2025-10-10T14:40:06.168969Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 pipe creation result: OK TabletId: 72075186224037892 Generation: 3196, pipe: [1:7559602889542278541:4596]
2025-10-10T14:40:06.290086Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:06.290991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:06.291015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:06.291036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602889542278541:4596], now have 1 active actors on pipe
2025-10-10T14:40:06.291316Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:06.291948Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|52e5db73-d5865d0a-7ee48633-fb9ba683_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:40:06.291964Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|52e5db73-d5865d0a-7ee48633-fb9ba683_0] Write session will restart in 0.009188s
2025-10-10T14:40:06.291990Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|52e5db73-d5865d0a-7ee48633-fb9ba683_0] Write session: Do CDS request
2025-10-10T14:40:06.291996Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|52e5db73-d5865d0a-7ee48633-fb9ba683_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:06.291405Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:40:06.291431Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:40:06.291519Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3197 reason: error at write: Disconnected sessionId: src_id|52e5db73-d5865d0a-7ee48633-fb9ba683_0
2025-10-10T14:40:06.291754Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3197 sessionId: src_id|52e5db73-d5865d0a-7ee48633-fb9ba683_0 is DEAD
2025-10-10T14:40:06.291967Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 95 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602889542278541:4596]
2025-10-10T14:40:06.291984Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:06.304745Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|52e5db73-d5865d0a-7ee48633-fb9ba683_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:06.305124Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:06.305152Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3198
2025-10-10T14:40:06.305583Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3198 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:06.305625Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3198 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:06.305637Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3198 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:06.305642Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:06.306481Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3198 sessionId:  describe result for acl check
2025-10-10T14:40:06.306523Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:06.306525Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:06.306527Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:06.306538Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602889542278596:2957] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:06.307249Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602889542278596:2957] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:06.309847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602889542278596:2957] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:06.316074Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602889542278596:2957] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:06.316100Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602889542278596:2957] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:06.316104Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602889542278596:2957] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:06.316114Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3198 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:06.342346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:06.343346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:06.344089Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:06.344109Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:06.344127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:06.344220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:06.344289Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602888760026603:12562]
2025-10-10T14:40:06.344938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:06.345431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:06.345493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:06.345831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:06.345900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:06.345901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:06.345903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:06.345904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:06.345906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:06.345907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:06.345908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:06.345910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:06.345911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:06.345912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:06.345914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:06.345915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:06.345917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:06.345924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:06.345937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:06.345941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:06.345946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:06.345950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:06.345954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:06.345958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:06.345962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:06.345965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:06.345970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:06.345974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:06.345978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:06.345983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:06.345994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:06.346004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:06.346011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:06.346017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:06.346026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:06.346032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:06.346037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:06.346044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:06.346048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:06.346053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:06.346058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:06.346064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:06.346069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:06.346075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:06.346080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:06.346114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:06.346120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:06.346126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:06.346131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:06.346136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:06.346141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:06.346147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:06.346152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:06.346157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:06.346162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:06.346168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:06.346212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:06.349253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:06.349651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:06.349675Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:06.349678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:06.349683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:06.349692Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3197 [2:7559602888760026603:12562]
2025-10-10T14:40:06.349709Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:06.349733Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:06.349737Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:06.349742Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:06.349745Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:06.349765Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:06.349781Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:06.349790Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:06.349875Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:06.349883Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:06.349886Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:06.349889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:06.349968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:06.349976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:06.349990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:06.350002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:06.350020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:06.350047Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602888760026598:12562]
2025-10-10T14:40:06.350052Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602888760026598:12562]
2025-10-10T14:40:06.350055Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602888760026598:12562]
2025-10-10T14:40:06.350072Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:06.350091Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:06.350107Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:06.350111Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:06.350122Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:06.350134Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:06.350136Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:06.350154Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602888760026598:12562]
2025-10-10T14:40:06.350159Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:06.350218Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:06.350546Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3197
2025-10-10T14:40:06.350563Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3197
2025-10-10T14:40:06.354456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602889542278544:2438], now have 1 active actors on pipe
2025-10-10T14:40:06.354477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602889542278739:2957], now have 1 active actors on pipe
2025-10-10T14:40:06.354503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:06.354513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:06.354565Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|63532a44-caf2540d-7682ba7a-2e58c22_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:06.354579Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:06.354585Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:06.354588Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:06.354604Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:06.354625Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:06.354647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:06.356641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:06.356661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:06.356697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:06.356879Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3198 partition: 0 MaxSeqNo: 40 sessionId: src_id|63532a44-caf2540d-7682ba7a-2e58c22_0
2025-10-10T14:40:06.357388Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|52e5db73-d5865d0a-7ee48633-fb9ba683_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|63532a44-caf2540d-7682ba7a-2e58c22_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:06.360148Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|63532a44-caf2540d-7682ba7a-2e58c22_0] Write session: try to update token
2025-10-10T14:40:06.360171Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|63532a44-caf2540d-7682ba7a-2e58c22_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:06.372748Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:06.372771Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:06.372776Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:06.372777Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:06.372787Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602888760026598:12562]
2025-10-10T14:40:06.372792Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602888760026598:12562]
2025-10-10T14:40:06.372800Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602888760026598:12562]
2025-10-10T14:40:06.372851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:06.372864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:06.372866Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:06.372943Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:06.372957Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:06.372962Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:06.373006Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:06.376641Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3198 sessionId: src_id|63532a44-caf2540d-7682ba7a-2e58c22_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:06.379944Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:06.392016Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602889542278901:4596]
2025-10-10T14:40:06.392357Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 pipe creation result: OK TabletId: 72075186224037892 Generation: 3197, pipe: [1:7559602889542278901:4596]
2025-10-10T14:40:06.501077Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:06.501832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:06.501851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:06.501899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602889542278901:4596], now have 1 active actors on pipe
2025-10-10T14:40:06.502328Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:06.502349Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 96 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602889542278901:4596]
2025-10-10T14:40:06.502363Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:06.502402Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:40:06.502406Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:40:06.502496Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3198 reason: error at write: Disconnected sessionId: src_id|63532a44-caf2540d-7682ba7a-2e58c22_0
2025-10-10T14:40:06.502711Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3198 sessionId: src_id|63532a44-caf2540d-7682ba7a-2e58c22_0 is DEAD
2025-10-10T14:40:06.505051Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63532a44-caf2540d-7682ba7a-2e58c22_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:40:06.505064Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63532a44-caf2540d-7682ba7a-2e58c22_0] Write session will restart in 0.007389s
2025-10-10T14:40:06.505091Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63532a44-caf2540d-7682ba7a-2e58c22_0] Write session: Do CDS request
2025-10-10T14:40:06.505101Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63532a44-caf2540d-7682ba7a-2e58c22_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:06.517907Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|63532a44-caf2540d-7682ba7a-2e58c22_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:06.521549Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:06.521573Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3199
2025-10-10T14:40:06.525529Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3199 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:06.525603Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3199 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:06.525616Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3199 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:06.525621Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:06.526113Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3199 sessionId:  describe result for acl check
2025-10-10T14:40:06.526160Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:06.526167Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:06.526170Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:06.526177Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602889542279043:2944] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:06.526922Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602889542279043:2944] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:06.540261Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602889542279043:2944] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:06.544874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602889542279043:2944] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:06.544899Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602889542279043:2944] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:06.544903Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602889542279043:2944] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:06.544913Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3199 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:06.546376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:06.555326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:06.555619Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:06.555631Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:06.555644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:06.555717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:06.555767Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602888760026892:12564]
2025-10-10T14:40:06.556421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:06.556914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:06.556965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:06.557349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:06.557433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:06.557441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:06.557443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:06.557444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:06.557446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:06.557447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:06.557449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:06.557450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:06.557451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:06.557453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:06.557454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:06.557456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:06.557457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:06.557464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:06.557476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:06.557480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:06.557484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:06.557487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:06.557491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:06.557495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:06.557499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:06.557502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:06.557509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:06.557513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:06.557517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:06.557521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:06.557531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:06.557540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:06.557548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:06.557554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:06.557559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:06.557564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:06.557569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:06.557575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:06.557580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:06.557598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:06.557608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:06.557614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:06.557623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:06.557633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:06.557638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:06.557649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:06.557657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:06.557667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:06.557671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:06.557677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:06.557682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:06.557693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:06.557697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:06.557703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:06.557712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:06.557718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:06.557761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:06.560668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:06.562217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:06.562233Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:06.562236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:06.562240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:06.562247Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3198 [2:7559602888760026892:12564]
2025-10-10T14:40:06.562262Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:06.562282Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:06.562287Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:06.562291Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:06.562293Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:06.562313Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:06.562322Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:06.562330Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:06.562396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:06.562405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:06.562408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:06.562410Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:06.562489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:06.562495Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:06.562508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:06.562521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:06.562539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:06.562561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602889542278903:2438], now have 1 active actors on pipe
2025-10-10T14:40:06.562567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602889542279245:2944], now have 1 active actors on pipe
2025-10-10T14:40:06.562575Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602888760026887:12564]
2025-10-10T14:40:06.562578Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602888760026887:12564]
2025-10-10T14:40:06.562580Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602888760026887:12564]
2025-10-10T14:40:06.562589Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:06.562600Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:06.562603Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:06.562604Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:06.562606Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:06.562620Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:06.562625Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:06.562658Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602888760026887:12564]
2025-10-10T14:40:06.562665Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:06.562788Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:06.562897Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3198
2025-10-10T14:40:06.562989Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3198
2025-10-10T14:40:06.563109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:06.563119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:06.563156Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b21c01f0-6fe5fc5e-4b35aebe-95e51e9a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:06.563166Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:06.563171Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:06.563174Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:06.563186Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:06.563198Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:06.563213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:06.563567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:06.563574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:06.563591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:06.564180Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63532a44-caf2540d-7682ba7a-2e58c22_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|b21c01f0-6fe5fc5e-4b35aebe-95e51e9a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:06.563708Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3199 partition: 0 MaxSeqNo: 40 sessionId: src_id|b21c01f0-6fe5fc5e-4b35aebe-95e51e9a_0
2025-10-10T14:40:06.566914Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b21c01f0-6fe5fc5e-4b35aebe-95e51e9a_0] Write session: try to update token
2025-10-10T14:40:06.566934Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b21c01f0-6fe5fc5e-4b35aebe-95e51e9a_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:06.586135Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:06.586170Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:06.586173Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:06.586176Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:06.586187Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602888760026887:12564]
2025-10-10T14:40:06.586193Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602888760026887:12564]
2025-10-10T14:40:06.586200Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602888760026887:12564]
2025-10-10T14:40:06.586261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:06.586270Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:06.586273Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:06.586277Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:06.586287Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:06.586292Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:06.586443Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:06.600231Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3199 sessionId: src_id|b21c01f0-6fe5fc5e-4b35aebe-95e51e9a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:06.602463Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602889542279258:4596]
2025-10-10T14:40:06.602784Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 pipe creation result: OK TabletId: 72075186224037892 Generation: 3198, pipe: [1:7559602889542279258:4596]
2025-10-10T14:40:06.603497Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:06.712773Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:06.713160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602889542279258:4596], now have 1 active actors on pipe
2025-10-10T14:40:06.713194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:06.713209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:06.713473Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:06.713913Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:06.713990Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 97 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602889542279258:4596]
2025-10-10T14:40:06.714020Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:40:06.714113Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3199 reason: status is not ok: tablet will be restarted right now sessionId: src_id|b21c01f0-6fe5fc5e-4b35aebe-95e51e9a_0
2025-10-10T14:40:06.714357Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3199 sessionId: src_id|b21c01f0-6fe5fc5e-4b35aebe-95e51e9a_0 is DEAD
2025-10-10T14:40:06.717608Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b21c01f0-6fe5fc5e-4b35aebe-95e51e9a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:40:06.717623Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b21c01f0-6fe5fc5e-4b35aebe-95e51e9a_0] Write session will restart in 0.007775s
2025-10-10T14:40:06.717661Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b21c01f0-6fe5fc5e-4b35aebe-95e51e9a_0] Write session: Do CDS request
2025-10-10T14:40:06.717667Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b21c01f0-6fe5fc5e-4b35aebe-95e51e9a_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:06.733863Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b21c01f0-6fe5fc5e-4b35aebe-95e51e9a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:06.737789Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:06.737810Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3200
2025-10-10T14:40:06.738026Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3200 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:06.738089Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3200 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:06.738100Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3200 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:06.738106Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:06.738703Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3200 sessionId:  describe result for acl check
2025-10-10T14:40:06.738757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:06.738765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:06.738768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:06.738776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602889542279497:2916] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:06.739437Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602889542279497:2916] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:06.742353Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602889542279497:2916] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:06.745124Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602889542279497:2916] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:06.745143Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602889542279497:2916] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:06.745148Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602889542279497:2916] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:06.745158Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3200 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:06.747380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:06.756824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:06.757310Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:06.757347Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:06.757365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:06.757464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:06.757525Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602888760027196:12567]
2025-10-10T14:40:06.758363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:06.758885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:06.758951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:06.759318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:06.760177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:06.760179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:06.760181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:06.760183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:06.760184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:06.760186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:06.760188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:06.760190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:06.760191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:06.760192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:06.760194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:06.760196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:06.760197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:06.760207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:06.760221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:06.760225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:06.760230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:06.760235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:06.760239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:06.760243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:06.760247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:06.760255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:06.760260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:06.760264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:06.760268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:06.760272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:06.760285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:06.760295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:06.760303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:06.760310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:06.760315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:06.760322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:06.760327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:06.760334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:06.760339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:06.760347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:06.760353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:06.760359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:06.760366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:06.760372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:06.760377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:06.760382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:06.760388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:06.760393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:06.760398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:06.760419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:06.760428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:06.760435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:06.760441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:06.760446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:06.760451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:06.760457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:06.760500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:06.765554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:06.765943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:06.765961Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:06.765964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:06.765969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:06.765977Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3199 [2:7559602888760027196:12567]
2025-10-10T14:40:06.765992Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:06.766015Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:06.766019Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:06.766024Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:06.766027Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:06.766048Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:06.766064Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:06.766072Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:06.766166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:06.766176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:06.766179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:06.766182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:06.766266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:06.766277Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:06.766290Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:06.766303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:06.766327Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:06.766359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602889542279261:2438], now have 1 active actors on pipe
2025-10-10T14:40:06.766369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602889542279602:2916], now have 1 active actors on pipe
2025-10-10T14:40:06.766378Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602888760027189:12567]
2025-10-10T14:40:06.766384Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602888760027189:12567]
2025-10-10T14:40:06.766389Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602888760027189:12567]
2025-10-10T14:40:06.766406Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:06.766425Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:06.766428Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:06.766440Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:06.766445Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:06.766447Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:06.766448Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:06.766459Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3199
2025-10-10T14:40:06.766469Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3199
2025-10-10T14:40:06.766490Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602888760027189:12567]
2025-10-10T14:40:06.766504Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:06.766517Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:06.766551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:06.766556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:06.766598Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|50162b50-68b789e5-24a65ff4-264c7778_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:06.766613Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:06.766617Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:06.766620Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:06.766631Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:06.766656Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:06.766686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:06.766939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:06.766953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:06.766975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:06.767125Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3200 partition: 0 MaxSeqNo: 40 sessionId: src_id|50162b50-68b789e5-24a65ff4-264c7778_0
2025-10-10T14:40:06.767618Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b21c01f0-6fe5fc5e-4b35aebe-95e51e9a_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|50162b50-68b789e5-24a65ff4-264c7778_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:06.770393Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|50162b50-68b789e5-24a65ff4-264c7778_0] Write session: try to update token
2025-10-10T14:40:06.770415Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|50162b50-68b789e5-24a65ff4-264c7778_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:06.789077Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:06.789104Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:06.789108Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:06.789111Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:06.789123Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602888760027189:12567]
2025-10-10T14:40:06.789128Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602888760027189:12567]
2025-10-10T14:40:06.789136Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602888760027189:12567]
2025-10-10T14:40:06.789191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:06.789200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:06.789202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:06.789204Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:06.789216Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:06.789226Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:06.789375Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:06.797166Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3200 sessionId: src_id|50162b50-68b789e5-24a65ff4-264c7778_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:06.800963Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:06.813911Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602889542279615:4596]
2025-10-10T14:40:06.814294Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 pipe creation result: OK TabletId: 72075186224037892 Generation: 3199, pipe: [1:7559602889542279615:4596]
2025-10-10T14:40:06.917537Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:06.918115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:06.918135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:06.918164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602889542279615:4596], now have 1 active actors on pipe
2025-10-10T14:40:06.918441Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:40:06.918486Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:06.918464Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:40:06.918501Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:06.918544Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3200 reason: error at write: Disconnected sessionId: src_id|50162b50-68b789e5-24a65ff4-264c7778_0
2025-10-10T14:40:06.918546Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 98 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602889542279615:4596]
2025-10-10T14:40:06.918777Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3200 sessionId: src_id|50162b50-68b789e5-24a65ff4-264c7778_0 is DEAD
2025-10-10T14:40:06.921625Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50162b50-68b789e5-24a65ff4-264c7778_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:40:06.921643Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50162b50-68b789e5-24a65ff4-264c7778_0] Write session will restart in 0.006241s
2025-10-10T14:40:06.921669Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50162b50-68b789e5-24a65ff4-264c7778_0] Write session: Do CDS request
2025-10-10T14:40:06.921679Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50162b50-68b789e5-24a65ff4-264c7778_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:06.928976Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|50162b50-68b789e5-24a65ff4-264c7778_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:06.929661Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:06.929693Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3201
2025-10-10T14:40:06.930810Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3201 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:06.930871Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3201 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:06.930882Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3201 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:06.930887Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:06.932206Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3201 sessionId:  describe result for acl check
2025-10-10T14:40:06.932256Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:06.932264Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:06.932267Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:06.932273Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602889542279698:2882] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:06.932985Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602889542279698:2882] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:06.940344Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602889542279698:2882] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:06.946337Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602889542279698:2882] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:06.946368Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602889542279698:2882] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:06.946372Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602889542279698:2882] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:06.946384Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3201 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:06.968163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:06.968947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:06.969189Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:06.969204Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:06.969217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:06.969275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:06.969326Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602888760027526:12582]
2025-10-10T14:40:06.969987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:06.970447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:06.970502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:06.970873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:06.970955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:06.970964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:06.970965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:06.970966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:06.970969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:06.970970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:06.970971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:06.970973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:06.970974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:06.970975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:06.970977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:06.970978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:06.970979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:06.970985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:06.970998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:06.971003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:06.971007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:06.971011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:06.971015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:06.971019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:06.971023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:06.971026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:06.971031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:06.971037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:06.971040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:06.971044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:06.971052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:06.971062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:06.971069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:06.971075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:06.971079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:06.971084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:06.971091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:06.971096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:06.971103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:06.971108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:06.971113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:06.971118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:06.971122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:06.971127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:06.971131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:06.971149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:06.971153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:06.971162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:06.971166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:06.971171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:06.971175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:06.971180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:06.971184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:06.971189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:06.971193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:06.971198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:06.971236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:06.977042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:06.977603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:06.977622Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:06.977625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:06.977629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:06.977639Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3200 [2:7559602888760027526:12582]
2025-10-10T14:40:06.977657Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:06.977682Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:06.977695Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:06.977700Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:06.977702Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:06.977725Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:06.977733Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:06.977742Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:06.977810Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:06.977821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:06.977826Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:06.977829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:06.977912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:06.977923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:06.977942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:06.977955Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:06.977980Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:06.978010Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602888760027521:12582]
2025-10-10T14:40:06.978019Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602888760027521:12582]
2025-10-10T14:40:06.978021Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602888760027521:12582]
2025-10-10T14:40:06.978031Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:06.978044Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:06.978047Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:06.978048Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:06.978050Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:06.978065Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:06.978069Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:06.978081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602889542279664:2438], now have 1 active actors on pipe
2025-10-10T14:40:06.978085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602889542279859:2882], now have 1 active actors on pipe
2025-10-10T14:40:06.978129Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602888760027521:12582]
2025-10-10T14:40:06.978143Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:06.978183Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3200
2025-10-10T14:40:06.978222Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:06.978257Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3200
2025-10-10T14:40:06.978525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:06.978545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:06.978585Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cc7c33fe-371067d8-57198c5-9a293bde_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:06.978602Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:06.978607Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:06.978610Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:06.978625Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:06.978639Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:06.978657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:06.978956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:06.978967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:06.978985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:06.979093Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3201 partition: 0 MaxSeqNo: 40 sessionId: src_id|cc7c33fe-371067d8-57198c5-9a293bde_0
2025-10-10T14:40:06.981840Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50162b50-68b789e5-24a65ff4-264c7778_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|cc7c33fe-371067d8-57198c5-9a293bde_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:06.984673Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cc7c33fe-371067d8-57198c5-9a293bde_0] Write session: try to update token
2025-10-10T14:40:06.984699Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cc7c33fe-371067d8-57198c5-9a293bde_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:07.006766Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:07.006795Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:07.006798Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:07.006800Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:07.006813Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602888760027521:12582]
2025-10-10T14:40:07.006819Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602888760027521:12582]
2025-10-10T14:40:07.006824Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602888760027521:12582]
2025-10-10T14:40:07.006887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:07.006896Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:07.006899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:07.006947Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:07.006968Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:07.006973Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:07.007063Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:07.019281Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602893837247314:4596]
2025-10-10T14:40:07.019841Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 pipe creation result: OK TabletId: 72075186224037892 Generation: 3200, pipe: [1:7559602893837247314:4596]
2025-10-10T14:40:07.024266Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3201 sessionId: src_id|cc7c33fe-371067d8-57198c5-9a293bde_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:07.027585Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:07.137608Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:07.138521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602893837247314:4596], now have 1 active actors on pipe
2025-10-10T14:40:07.138558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:07.138572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:07.138915Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:07.139539Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc7c33fe-371067d8-57198c5-9a293bde_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:40:07.139551Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc7c33fe-371067d8-57198c5-9a293bde_0] Write session will restart in 0.006876s
2025-10-10T14:40:07.139578Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc7c33fe-371067d8-57198c5-9a293bde_0] Write session: Do CDS request
2025-10-10T14:40:07.139585Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc7c33fe-371067d8-57198c5-9a293bde_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:07.138907Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:07.138992Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 99 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602893837247314:4596]
2025-10-10T14:40:07.139029Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:40:07.139032Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:40:07.139137Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3201 reason: error at write: Disconnected sessionId: src_id|cc7c33fe-371067d8-57198c5-9a293bde_0
2025-10-10T14:40:07.139342Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1661: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 closed with error: reason# too much attempts to restart pipe
2025-10-10T14:40:07.139360Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3201 sessionId: src_id|cc7c33fe-371067d8-57198c5-9a293bde_0 is DEAD
2025-10-10T14:40:07.139499Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 32 consumer shared/user session shared/user_1_32_2377807763033062708_v1 is DEAD
2025-10-10T14:40:07.139626Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559602803642902193:4615] disconnected; active server actors: 1
2025-10-10T14:40:07.139630Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559602803642902193:4615] client user disconnected session shared/user_1_32_2377807763033062708_v1
2025-10-10T14:40:07.139821Z :ERROR: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] Got error. Status: UNAVAILABLE. Description: <main>: Error: too much attempts to restart pipe, code: 500027 
2025-10-10T14:40:07.139934Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-10T14:40:07.139939Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-10T14:40:07.139945Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] Reconnecting session to cluster  in 0.005080s
2025-10-10T14:40:07.145743Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] Successfully connected. Initializing session
2025-10-10T14:40:07.147222Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-10T14:40:07.147240Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 33
2025-10-10T14:40:07.147383Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 33 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-10T14:40:07.147446Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 read init: from# ipv6:[::1]:37328, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-10T14:40:07.147556Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 auth for : user
2025-10-10T14:40:07.147706Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cc7c33fe-371067d8-57198c5-9a293bde_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:07.147969Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 Handle describe topics response
2025-10-10T14:40:07.147991Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:07.147996Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3202
2025-10-10T14:40:07.148026Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 auth is DEAD
2025-10-10T14:40:07.148054Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 auth ok: topics# 1, initDone# 0
2025-10-10T14:40:07.148080Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3202 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:07.148113Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3202 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:07.148119Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3202 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:07.148123Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:07.148364Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 register session: topic# rt3.dc1--test-topic
2025-10-10T14:40:07.148412Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3202 sessionId:  describe result for acl check
2025-10-10T14:40:07.148445Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:07.148453Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:07.148455Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:07.148461Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602893837247336:2857] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:07.148471Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559602893837247335:2867] connected; active server actors: 1
2025-10-10T14:40:07.148483Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7559602893837247335:2867] session shared/user_1_33_1104800769444553160_v1
2025-10-10T14:40:07.148492Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-10-10T14:40:07.148511Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-10-10T14:40:07.148531Z :INFO: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] Got InitResponse. ReadSessionId: shared/user_1_33_1104800769444553160_v1
2025-10-10T14:40:07.148537Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_33_1104800769444553160_v1" (Sender=[1:7559602893837247330:2867], Pipe=[1:7559602893837247335:2867], Partitions=[], ActiveFamilyCount=0)
2025-10-10T14:40:07.148549Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-10T14:40:07.148564Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-10-10T14:40:07.148574Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_33_1104800769444553160_v1" (Sender=[1:7559602893837247330:2867], Pipe=[1:7559602893837247335:2867], Partitions=[], ActiveFamilyCount=0)
2025-10-10T14:40:07.148586Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_33_1104800769444553160_v1" sender [1:7559602893837247330:2867] lock partition 0 for ReadingSession "shared/user_1_33_1104800769444553160_v1" (Sender=[1:7559602893837247330:2867], Pipe=[1:7559602893837247335:2867], Partitions=[], ActiveFamilyCount=1) generation 1 step 33
2025-10-10T14:40:07.148603Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-10-10T14:40:07.148609Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000041s
2025-10-10T14:40:07.148828Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 33 Session: "shared/user_1_33_1104800769444553160_v1" ClientId: "user" PipeClient { RawX1: 7559602893837247335 RawX2: 4503603922340659 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-10T14:40:07.148853Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-10T14:40:07.149022Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602893837247336:2857] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:07.151768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602893837247336:2857] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:07.155588Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602893837247336:2857] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:07.155610Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602893837247336:2857] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:07.155614Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602893837247336:2857] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:07.155624Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3202 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:07.176264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:07.177022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:07.177246Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:07.177259Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:07.177273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:07.177344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:07.177387Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602893054995116:12584]
2025-10-10T14:40:07.178158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:07.178519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:07.178568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:07.178926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:07.178995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:07.179001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:07.179002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:07.179003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:07.179005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:07.179006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:07.179007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:07.179009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:07.179010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:07.179012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:07.179013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:07.179015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:07.179016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:07.179023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:07.179037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:07.179041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:07.179045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:07.179050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:07.179054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:07.179058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:07.179062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:07.179065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:07.179070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:07.179074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:07.179078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:07.179082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:07.179091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:07.179100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:07.179106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:07.179111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:07.179116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:07.179121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:07.179126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:07.179131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:07.179136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:07.179141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:07.179145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:07.179150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:07.179158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:07.179175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:07.179179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:07.179187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:07.179191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:07.179196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:07.179200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:07.179205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:07.179210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:07.179215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:07.179219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:07.179224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:07.179228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:07.179232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:07.179270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:07.182237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:07.183233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:07.183238Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:07.183241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:07.183245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:07.183252Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3201 [2:7559602893054995116:12584]
2025-10-10T14:40:07.183268Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:07.183289Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:07.183294Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:07.183298Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:07.183301Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:07.183319Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:07.183327Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:07.183336Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:07.183407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:07.183409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:07.183410Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:07.183413Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:07.183493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:07.183496Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:07.183508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:07.183519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:07.183536Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:07.183560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602893837247339:2851], now have 1 active actors on pipe
2025-10-10T14:40:07.183563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602893837247428:2857], now have 1 active actors on pipe
2025-10-10T14:40:07.183566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602893837247317:2438], now have 1 active actors on pipe
2025-10-10T14:40:07.183575Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602893054995111:12584]
2025-10-10T14:40:07.183577Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602893054995111:12584]
2025-10-10T14:40:07.183580Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602893054995111:12584]
2025-10-10T14:40:07.183594Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:07.183608Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:07.183610Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:07.183611Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:07.183614Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:07.183627Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:07.183630Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:07.183661Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602893054995111:12584]
2025-10-10T14:40:07.183668Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:07.183674Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:07.183902Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 3201, pipe: [1:7559602893837247339:2851]
2025-10-10T14:40:07.183963Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3201
2025-10-10T14:40:07.183986Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3201
2025-10-10T14:40:07.184104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:07.184116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:07.184132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_33_1104800769444553160_v1 on pipe: [1:7559602893837247339:2851]
2025-10-10T14:40:07.184150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:07.184152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:07.184174Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:07.184180Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:07.184182Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:07.184205Z node 2 :PERSQUEUE DEBUG: partition.cpp:3747: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_33_1104800769444553160_v1
2025-10-10T14:40:07.184208Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:07.184247Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ed3f8e2a-ee0f1bf1-adbc8307-2604e46b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:07.184253Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:40:07.184259Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:40:07.184386Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_33_1104800769444553160_v1:1 with generation 3201
2025-10-10T14:40:07.188940Z node 2 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:40:07.188984Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:40:07.188994Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:07.189009Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:07.189012Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:07.189030Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:07.189062Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:07.189075Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-10T14:40:07.189090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-10T14:40:07.189106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:07.189326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:07.189349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:07.189373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:07.189464Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 40 WriteTimestampMS: 1760106661000 SizeLag: 17206678 WriteTimestampEstimateMS: 1760107207182 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-10T14:40:07.189495Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 40 readOffset 0 committedOffset 0
2025-10-10T14:40:07.189499Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3202 partition: 0 MaxSeqNo: 40 sessionId: src_id|ed3f8e2a-ee0f1bf1-adbc8307-2604e46b_0
2025-10-10T14:40:07.189525Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 sending to client partition status
2025-10-10T14:40:07.189962Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc7c33fe-371067d8-57198c5-9a293bde_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|ed3f8e2a-ee0f1bf1-adbc8307-2604e46b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:07.192755Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ed3f8e2a-ee0f1bf1-adbc8307-2604e46b_0] Write session: try to update token
2025-10-10T14:40:07.192776Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ed3f8e2a-ee0f1bf1-adbc8307-2604e46b_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:07.195499Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:40:07.195528Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:07.195539Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602893054995111:12584]
2025-10-10T14:40:07.195581Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:40:07.195591Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:40:07.195775Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:40:07.195929Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:07.196092Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:07.196237Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:07.196460Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:40:07.196512Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:40:07.210506Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3202 sessionId: src_id|ed3f8e2a-ee0f1bf1-adbc8307-2604e46b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:07.213296Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:07.213590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:07.213615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:07.213658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:40:07.215841Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:07.215879Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:07.215883Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:07.215885Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:07.215896Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602893054995111:12584]
2025-10-10T14:40:07.215900Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602893054995111:12584]
2025-10-10T14:40:07.215904Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602893054995111:12584]
2025-10-10T14:40:07.215951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:07.215967Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:07.215970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:07.216108Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:07.216543Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:07.216568Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:07.216574Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:07.213756Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:40:07.332781Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:07.341715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:07.341750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:07.341936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:07.342007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:07.342078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:07.342150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:07.342199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:07.342210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:07.342286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:07.342353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:07.342422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:07.342501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:07.342720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:07.342732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:07.343257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:07.343337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:07.343411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:07.343484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:07.343532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:07.343539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:07.343611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:07.343680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:07.343750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:07.343820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:07.343866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:07.343874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:07.343946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:07.344012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:07.344079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:07.344149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:07.344197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:07.344210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:07.344284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:07.344346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:07.344464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:07.344527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:07.344574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:07.344577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:07.344651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:07.344716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:07.344784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:07.344846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:07.344893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:07.344895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:07.344968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:07.345029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:07.345097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:07.345161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:07.345202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:07.345205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:07.345278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:07.345470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:07.345543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:07.345612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:07.346949Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed3f8e2a-ee0f1bf1-adbc8307-2604e46b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:40:07.346961Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed3f8e2a-ee0f1bf1-adbc8307-2604e46b_0] Write session will restart in 0.008839s
2025-10-10T14:40:07.346417Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:40:07.346435Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:40:07.346468Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3202 reason: error at write: Disconnected sessionId: src_id|ed3f8e2a-ee0f1bf1-adbc8307-2604e46b_0
2025-10-10T14:40:07.346736Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3202 sessionId: src_id|ed3f8e2a-ee0f1bf1-adbc8307-2604e46b_0 is DEAD
2025-10-10T14:40:07.346987Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed3f8e2a-ee0f1bf1-adbc8307-2604e46b_0] Write session: Do CDS request
2025-10-10T14:40:07.346747Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 0 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602893837247339:2851]
2025-10-10T14:40:07.346994Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed3f8e2a-ee0f1bf1-adbc8307-2604e46b_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:07.346771Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:07.345661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:07.345670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:07.345742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:07.345804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:07.345869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:07.345932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:07.345976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:07.345979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:07.346673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_33_1104800769444553160_v1
2025-10-10T14:40:07.346686Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:07.346708Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_33_1104800769444553160_v1
2025-10-10T14:40:07.356927Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ed3f8e2a-ee0f1bf1-adbc8307-2604e46b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:07.357027Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:07.357046Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3203
2025-10-10T14:40:07.357184Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3203 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:07.357221Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3203 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:07.357227Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3203 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:07.357231Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:07.357783Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3203 sessionId:  describe result for acl check
2025-10-10T14:40:07.357824Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:07.357842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:07.357848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:07.357855Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602893837247728:2840] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:07.358470Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602893837247728:2840] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:07.361804Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602893837247728:2840] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:07.368160Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602893837247728:2840] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:07.368182Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602893837247728:2840] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:07.368186Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602893837247728:2840] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:07.368197Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3203 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:07.384291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:07.385116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:07.385369Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:07.385383Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:07.385397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:07.385462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:07.385517Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602893054995414:12587]
2025-10-10T14:40:07.386233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:07.386554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:07.386608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:07.386953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:07.387023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:07.387030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:07.387032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:07.387033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:07.387034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:07.387035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:07.387036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:07.387037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:07.387040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:07.387041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:07.387042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:07.387043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:07.387045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:07.387051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:07.387063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:07.387068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:07.387071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:07.387075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:07.387078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:07.387081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:07.387085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:07.387089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:07.387093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:07.387097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:07.387100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:07.387104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:07.387113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:07.387123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:07.387130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:07.387136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:07.387142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:07.387148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:07.387153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:07.387159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:07.387164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:07.387170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:07.387190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:07.387198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:07.387204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:07.387210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:07.387215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:07.387222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:07.387228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:07.387239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:07.387245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:07.387251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:07.387257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:07.387263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:07.387269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:07.387275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:07.387282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:07.387287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:07.387348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:07.389969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:07.391358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:07.391375Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:07.391378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:07.391382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:07.391388Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3202 [2:7559602893054995414:12587]
2025-10-10T14:40:07.391403Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:07.391426Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:07.391429Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:07.391438Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:07.391441Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:07.391459Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:07.391472Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:07.391480Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:07.391549Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:07.391557Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:07.391560Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:07.391562Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:07.391637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:07.391645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:07.391658Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:07.391676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:07.391695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:07.391719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602893837247685:2438], now have 1 active actors on pipe
2025-10-10T14:40:07.391724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602893837247918:2840], now have 1 active actors on pipe
2025-10-10T14:40:07.391732Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602893054995409:12587]
2025-10-10T14:40:07.391735Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602893054995409:12587]
2025-10-10T14:40:07.391737Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602893054995409:12587]
2025-10-10T14:40:07.391754Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:07.391769Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:07.391768Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:07.391772Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:07.391774Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:07.391785Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:07.391796Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3202
2025-10-10T14:40:07.391789Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:07.391820Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602893054995409:12587]
2025-10-10T14:40:07.391827Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:07.391834Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:07.391945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:07.391963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:07.391991Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3202
2025-10-10T14:40:07.392002Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|485cbc8f-9a7a8dd4-1f0072c6-1f8849ca_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:07.392017Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:07.392022Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:07.392025Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:07.392038Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:07.392056Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:07.392084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:07.392252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:07.392259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:07.392274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:07.392377Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3203 partition: 0 MaxSeqNo: 40 sessionId: src_id|485cbc8f-9a7a8dd4-1f0072c6-1f8849ca_0
2025-10-10T14:40:07.392823Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed3f8e2a-ee0f1bf1-adbc8307-2604e46b_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|485cbc8f-9a7a8dd4-1f0072c6-1f8849ca_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:07.395657Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|485cbc8f-9a7a8dd4-1f0072c6-1f8849ca_0] Write session: try to update token
2025-10-10T14:40:07.395674Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|485cbc8f-9a7a8dd4-1f0072c6-1f8849ca_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:07.404036Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:40:07.404058Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:07.404069Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602893054995409:12587]
2025-10-10T14:40:07.404117Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:40:07.404295Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:40:07.404462Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:07.404599Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:07.404740Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:07.404933Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:40:07.404981Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:40:07.409422Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:40:07.423494Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3203 sessionId: src_id|485cbc8f-9a7a8dd4-1f0072c6-1f8849ca_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:07.424662Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:07.424691Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:07.424694Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:07.424697Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:07.424708Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602893054995409:12587]
2025-10-10T14:40:07.424713Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602893054995409:12587]
2025-10-10T14:40:07.424718Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602893054995409:12587]
2025-10-10T14:40:07.424765Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:07.424771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:07.424779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:07.424781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:07.424784Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:07.424789Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:07.424924Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:07.426258Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:07.446203Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602893837248043:2851]
2025-10-10T14:40:07.446632Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 pipe creation result: OK TabletId: 72075186224037892 Generation: 3202, pipe: [1:7559602893837248043:2851]
2025-10-10T14:40:07.546094Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:07.546389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:07.546404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:07.546432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602893837248043:2851], now have 1 active actors on pipe
2025-10-10T14:40:07.546678Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:07.546712Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:07.546778Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:40:07.546875Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3203 reason: status is not ok: tablet will be restarted right now sessionId: src_id|485cbc8f-9a7a8dd4-1f0072c6-1f8849ca_0
2025-10-10T14:40:07.547285Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|485cbc8f-9a7a8dd4-1f0072c6-1f8849ca_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:40:07.547296Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|485cbc8f-9a7a8dd4-1f0072c6-1f8849ca_0] Write session will restart in 0.009009s
2025-10-10T14:40:07.547323Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|485cbc8f-9a7a8dd4-1f0072c6-1f8849ca_0] Write session: Do CDS request
2025-10-10T14:40:07.547329Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|485cbc8f-9a7a8dd4-1f0072c6-1f8849ca_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:07.547132Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3203 sessionId: src_id|485cbc8f-9a7a8dd4-1f0072c6-1f8849ca_0 is DEAD
2025-10-10T14:40:07.547172Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 1 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602893837248043:2851]
2025-10-10T14:40:07.558022Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|485cbc8f-9a7a8dd4-1f0072c6-1f8849ca_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:07.558131Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:07.558151Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3204
2025-10-10T14:40:07.558305Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3204 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:07.558344Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3204 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:07.558361Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3204 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:07.558367Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:07.558879Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3204 sessionId:  describe result for acl check
2025-10-10T14:40:07.558916Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:07.558919Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:07.558921Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:07.558928Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602893837248062:2836] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:07.559590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602893837248062:2836] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:07.562535Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602893837248062:2836] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:07.567110Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602893837248062:2836] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:07.567129Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602893837248062:2836] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:07.567133Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602893837248062:2836] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:07.567143Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3204 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:07.599816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:07.600692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:07.600956Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:07.600972Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:07.600988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:07.601069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:07.601138Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602893054995712:12589]
2025-10-10T14:40:07.601853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:07.602644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:07.602713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:07.603099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:07.603214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:07.603221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:07.603223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:07.603224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:07.603225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:07.603227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:07.603228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:07.603230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:07.603232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:07.603233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:07.603235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:07.603236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:07.603238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:07.603246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:07.603261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:07.603266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:07.603271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:07.603274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:07.603279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:07.603283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:07.603288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:07.603292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:07.603296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:07.603301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:07.603305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:07.603308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:07.603318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:07.603328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:07.603336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:07.603342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:07.603348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:07.603354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:07.603358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:07.603365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:07.603370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:07.603377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:07.603382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:07.603387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:07.603393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:07.603407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:07.603413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:07.603419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:07.603425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:07.603432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:07.603436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:07.603442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:07.603448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:07.603454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:07.603458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:07.603464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:07.603470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:07.603480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:07.603522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:07.608721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:07.609916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:07.609936Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:07.609939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:07.609943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:07.609951Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3203 [2:7559602893054995712:12589]
2025-10-10T14:40:07.609968Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:07.609990Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:07.610003Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:07.610007Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:07.610010Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:07.610031Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:07.610040Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:07.610050Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:07.610124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:07.610136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:07.610139Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:07.610142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:07.610225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:07.610236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:07.610250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:07.610269Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:07.610292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:07.610327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602893837248046:2438], now have 1 active actors on pipe
2025-10-10T14:40:07.610339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602893837248109:2836], now have 1 active actors on pipe
2025-10-10T14:40:07.610348Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602893054995707:12589]
2025-10-10T14:40:07.610351Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602893054995707:12589]
2025-10-10T14:40:07.610353Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602893054995707:12589]
2025-10-10T14:40:07.610370Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:07.610388Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:07.610412Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:07.610421Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:07.610463Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602893054995707:12589]
2025-10-10T14:40:07.610472Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:07.610540Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:07.610553Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:07.610555Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:07.610564Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:07.610397Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3203
2025-10-10T14:40:07.610449Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3203
2025-10-10T14:40:07.610832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:07.610846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:07.610882Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d91d53e8-b3e6f3c-483d2ace-f670dece_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:07.610908Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:07.610918Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:07.610920Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:07.610935Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:07.610953Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:07.610978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:07.611207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:07.611221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:07.611244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:07.611854Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|485cbc8f-9a7a8dd4-1f0072c6-1f8849ca_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|d91d53e8-b3e6f3c-483d2ace-f670dece_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:07.611385Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3204 partition: 0 MaxSeqNo: 40 sessionId: src_id|d91d53e8-b3e6f3c-483d2ace-f670dece_0
2025-10-10T14:40:07.615080Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d91d53e8-b3e6f3c-483d2ace-f670dece_0] Write session: try to update token
2025-10-10T14:40:07.615097Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d91d53e8-b3e6f3c-483d2ace-f670dece_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:07.634768Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:07.634794Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:07.634798Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:07.634800Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:07.634812Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602893054995707:12589]
2025-10-10T14:40:07.634821Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602893054995707:12589]
2025-10-10T14:40:07.634824Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602893054995707:12589]
2025-10-10T14:40:07.632967Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3204 sessionId: src_id|d91d53e8-b3e6f3c-483d2ace-f670dece_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:07.635780Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:07.634875Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:07.634891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:07.634890Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:07.634894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:07.634899Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:07.634918Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:07.635030Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:07.649714Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602893837248405:2851]
2025-10-10T14:40:07.650154Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 pipe creation result: OK TabletId: 72075186224037892 Generation: 3203, pipe: [1:7559602893837248405:2851]
2025-10-10T14:40:07.760195Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:07.760856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:07.760871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:07.760920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602893837248405:2851], now have 1 active actors on pipe
2025-10-10T14:40:07.761123Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:07.761348Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:40:07.761368Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:40:07.761846Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d91d53e8-b3e6f3c-483d2ace-f670dece_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:40:07.761858Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d91d53e8-b3e6f3c-483d2ace-f670dece_0] Write session will restart in 0.005453s
2025-10-10T14:40:07.761884Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d91d53e8-b3e6f3c-483d2ace-f670dece_0] Write session: Do CDS request
2025-10-10T14:40:07.761890Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d91d53e8-b3e6f3c-483d2ace-f670dece_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:07.761451Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3204 reason: error at write: Disconnected sessionId: src_id|d91d53e8-b3e6f3c-483d2ace-f670dece_0
2025-10-10T14:40:07.761682Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:07.761688Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3204 sessionId: src_id|d91d53e8-b3e6f3c-483d2ace-f670dece_0 is DEAD
2025-10-10T14:40:07.761732Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 2 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602893837248405:2851]
2025-10-10T14:40:07.769004Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d91d53e8-b3e6f3c-483d2ace-f670dece_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:07.769111Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:07.769140Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3205
2025-10-10T14:40:07.769285Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3205 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:07.769350Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3205 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:07.769363Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3205 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:07.769368Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:07.769793Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3205 sessionId:  describe result for acl check
2025-10-10T14:40:07.769834Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:07.769837Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:07.769840Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:07.769848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602893837248423:2822] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:07.770446Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602893837248423:2822] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:07.779100Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602893837248423:2822] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:07.783131Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602893837248423:2822] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:07.783156Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602893837248423:2822] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:07.783167Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602893837248423:2822] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:07.783177Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3205 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:07.807461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:07.809996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:07.810217Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:07.810229Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:07.810242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:07.810294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:07.810342Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602893054996020:12592]
2025-10-10T14:40:07.811020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:07.811497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:07.811562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:07.811949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:07.812791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:07.812800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:07.812802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:07.812803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:07.812805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:07.812806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:07.812807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:07.812809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:07.812811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:07.812812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:07.812813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:07.812815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:07.812816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:07.812824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:07.812838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:07.812843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:07.812847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:07.812852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:07.812857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:07.812861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:07.812865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:07.812870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:07.812875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:07.812879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:07.812883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:07.812888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:07.812897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:07.812906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:07.812914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:07.812920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:07.812925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:07.812932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:07.812936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:07.812942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:07.812947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:07.812953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:07.812958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:07.812964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:07.812969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:07.812975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:07.812979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:07.812985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:07.812994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:07.812999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:07.813004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:07.813010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:07.813023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:07.813029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:07.813034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:07.813040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:07.813045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:07.813050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:07.813093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:07.816032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:07.816342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:07.816357Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:07.816360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:07.816364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:07.816371Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3204 [2:7559602893054996020:12592]
2025-10-10T14:40:07.816385Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:07.816450Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:07.816458Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:07.816463Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:07.816465Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:07.816482Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:07.816493Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:07.816501Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:07.816564Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:07.816567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:07.816569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:07.816572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:07.817124Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3204
2025-10-10T14:40:07.817172Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3204
2025-10-10T14:40:07.816639Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:07.816647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:07.816659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:07.816672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:07.816691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:07.816712Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602893054996015:12592]
2025-10-10T14:40:07.816714Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602893054996015:12592]
2025-10-10T14:40:07.816717Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602893054996015:12592]
2025-10-10T14:40:07.816737Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:07.816751Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:07.816768Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:07.816772Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:07.816776Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:07.816779Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:07.816782Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:07.816803Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602893054996015:12592]
2025-10-10T14:40:07.816806Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:07.816867Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:07.817391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602893837248522:2822], now have 1 active actors on pipe
2025-10-10T14:40:07.817401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602893837248408:2438], now have 1 active actors on pipe
2025-10-10T14:40:07.817415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:07.817421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:07.817456Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|20cb54fa-b4ff4247-91483cfd-c14044a3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:07.817463Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:07.817468Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:07.817471Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:07.817482Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:07.817495Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:07.817512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:07.817794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:07.817799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:07.817814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:07.818026Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3205 partition: 0 MaxSeqNo: 40 sessionId: src_id|20cb54fa-b4ff4247-91483cfd-c14044a3_0
2025-10-10T14:40:07.818895Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d91d53e8-b3e6f3c-483d2ace-f670dece_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|20cb54fa-b4ff4247-91483cfd-c14044a3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:07.821543Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|20cb54fa-b4ff4247-91483cfd-c14044a3_0] Write session: try to update token
2025-10-10T14:40:07.821561Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|20cb54fa-b4ff4247-91483cfd-c14044a3_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:07.840705Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:07.840730Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:07.840733Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:07.840735Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:07.840746Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602893054996015:12592]
2025-10-10T14:40:07.840751Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602893054996015:12592]
2025-10-10T14:40:07.840755Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602893054996015:12592]
2025-10-10T14:40:07.840802Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:07.840806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:07.840808Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:07.840812Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:07.840815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:07.840821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:07.840998Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:07.842957Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3205 sessionId: src_id|20cb54fa-b4ff4247-91483cfd-c14044a3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:07.845649Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:07.861450Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602893837248773:2851]
2025-10-10T14:40:07.862108Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 pipe creation result: OK TabletId: 72075186224037892 Generation: 3204, pipe: [1:7559602893837248773:2851]
2025-10-10T14:40:07.961075Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:07.962097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:07.962122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:07.962163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602893837248773:2851], now have 1 active actors on pipe
2025-10-10T14:40:07.963647Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:07.963491Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:40:07.963506Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:40:07.963565Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3205 reason: error at write: Disconnected sessionId: src_id|20cb54fa-b4ff4247-91483cfd-c14044a3_0
2025-10-10T14:40:07.963774Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3205 sessionId: src_id|20cb54fa-b4ff4247-91483cfd-c14044a3_0 is DEAD
2025-10-10T14:40:07.963947Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 3 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602893837248773:2851]
2025-10-10T14:40:07.963962Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:07.965546Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20cb54fa-b4ff4247-91483cfd-c14044a3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:40:07.965559Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20cb54fa-b4ff4247-91483cfd-c14044a3_0] Write session will restart in 0.008630s
2025-10-10T14:40:07.965586Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20cb54fa-b4ff4247-91483cfd-c14044a3_0] Write session: Do CDS request
2025-10-10T14:40:07.965606Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20cb54fa-b4ff4247-91483cfd-c14044a3_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:07.975993Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|20cb54fa-b4ff4247-91483cfd-c14044a3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:07.976107Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:07.976126Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3206
2025-10-10T14:40:07.976424Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3206 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:07.976461Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3206 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:07.976467Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3206 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:07.976470Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:07.977427Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3206 sessionId:  describe result for acl check
2025-10-10T14:40:07.977463Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:07.977466Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:07.977468Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:07.977475Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602893837248854:2773] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:07.978050Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602893837248854:2773] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:07.981114Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602893837248854:2773] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:07.984248Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602893837248854:2773] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:07.984270Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602893837248854:2773] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:07.984274Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602893837248854:2773] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:07.984283Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3206 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:08.006398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:08.007009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:08.007215Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:08.007226Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:08.007238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:08.007287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:08.007330Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602897349963651:12607]
2025-10-10T14:40:08.008042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:08.008308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:08.008361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:08.008713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:08.008768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:08.008770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:08.008771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:08.008772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:08.008774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:08.008776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:08.008778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:08.008780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:08.008781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:08.008783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:08.008784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:08.008785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:08.008787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:08.008793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:08.008808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:08.008813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:08.008818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:08.008823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:08.008828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:08.008832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:08.008837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:08.008842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:08.008847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:08.008852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:08.008856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:08.008861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:08.008869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:08.008879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:08.008886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:08.008893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:08.008898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:08.008904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:08.008910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:08.008916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:08.008922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:08.008928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:08.008933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:08.008939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:08.008944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:08.008951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:08.008956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:08.008963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:08.008968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:08.008974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:08.008979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:08.008986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:08.008992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:08.008998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:08.009003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:08.009009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:08.009014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:08.009020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:08.009064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:08.014060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:08.015079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:08.015094Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:08.015097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:08.015101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:08.015109Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3205 [2:7559602897349963651:12607]
2025-10-10T14:40:08.015124Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:08.015145Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:08.015155Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:08.015159Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:08.015161Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:08.015181Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:08.015195Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:08.015206Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:08.015279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:08.015293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:08.015296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:08.015299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:08.015375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:08.015383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:08.015397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:08.015416Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:08.015436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:08.015464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602893837248819:2438], now have 1 active actors on pipe
2025-10-10T14:40:08.015473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602893837248942:2773], now have 1 active actors on pipe
2025-10-10T14:40:08.015482Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602897349963646:12607]
2025-10-10T14:40:08.015490Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602897349963646:12607]
2025-10-10T14:40:08.015492Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602897349963646:12607]
2025-10-10T14:40:08.015507Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:08.015524Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:08.015526Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:08.015526Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:08.015528Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:08.015544Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:08.015547Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:08.015515Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3205
2025-10-10T14:40:08.015561Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3205
2025-10-10T14:40:08.015592Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602897349963646:12607]
2025-10-10T14:40:08.015604Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:08.015637Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:08.015814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:08.015827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:08.015861Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fae1aec8-caa3cc24-80205adc-6dec9af0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:08.015874Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:08.015879Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:08.015887Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:08.015900Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:08.015917Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:08.015937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:08.016179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:08.016188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:08.016203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:08.016351Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3206 partition: 0 MaxSeqNo: 40 sessionId: src_id|fae1aec8-caa3cc24-80205adc-6dec9af0_0
2025-10-10T14:40:08.016785Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20cb54fa-b4ff4247-91483cfd-c14044a3_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|fae1aec8-caa3cc24-80205adc-6dec9af0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:08.019448Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fae1aec8-caa3cc24-80205adc-6dec9af0_0] Write session: try to update token
2025-10-10T14:40:08.019467Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fae1aec8-caa3cc24-80205adc-6dec9af0_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:08.037408Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:08.037429Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:08.037433Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:08.037435Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:08.037455Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602897349963646:12607]
2025-10-10T14:40:08.037461Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602897349963646:12607]
2025-10-10T14:40:08.037465Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602897349963646:12607]
2025-10-10T14:40:08.037514Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:08.037514Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:08.037521Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:08.037523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:08.037525Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:08.037526Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:08.037661Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:08.042135Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3206 sessionId: src_id|fae1aec8-caa3cc24-80205adc-6dec9af0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:08.044875Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:08.064230Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602898132216475:2851]
2025-10-10T14:40:08.064568Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 pipe creation result: OK TabletId: 72075186224037892 Generation: 3205, pipe: [1:7559602898132216475:2851]
2025-10-10T14:40:08.161449Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:08.162156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:08.162169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:08.162218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602898132216475:2851], now have 1 active actors on pipe
2025-10-10T14:40:08.162510Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:08.162620Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 4 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602898132216475:2851]
2025-10-10T14:40:08.162681Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:40:08.162684Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:40:08.162762Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3206 reason: error at write: Disconnected sessionId: src_id|fae1aec8-caa3cc24-80205adc-6dec9af0_0
2025-10-10T14:40:08.162960Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3206 sessionId: src_id|fae1aec8-caa3cc24-80205adc-6dec9af0_0 is DEAD
2025-10-10T14:40:08.163149Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:08.165669Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fae1aec8-caa3cc24-80205adc-6dec9af0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:40:08.165679Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fae1aec8-caa3cc24-80205adc-6dec9af0_0] Write session will restart in 0.007260s
2025-10-10T14:40:08.165720Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fae1aec8-caa3cc24-80205adc-6dec9af0_0] Write session: Do CDS request
2025-10-10T14:40:08.165729Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fae1aec8-caa3cc24-80205adc-6dec9af0_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:08.174042Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fae1aec8-caa3cc24-80205adc-6dec9af0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:08.174329Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:08.174348Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3207
2025-10-10T14:40:08.177627Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3207 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:08.177694Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3207 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:08.177700Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3207 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:08.177706Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:08.178183Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3207 sessionId:  describe result for acl check
2025-10-10T14:40:08.178218Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:08.178226Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:08.178228Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:08.178234Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602898132216530:2765] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:08.178806Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602898132216530:2765] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:08.180901Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602898132216530:2765] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:08.184345Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602898132216530:2765] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:08.184360Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602898132216530:2765] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:08.184363Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602898132216530:2765] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:08.184370Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3207 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:08.220285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:08.221087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:08.221344Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:08.221357Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:08.221372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:08.221451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:08.221501Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602897349963949:12609]
2025-10-10T14:40:08.222157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:08.222542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:08.222597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:08.222938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:08.223004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:08.223011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:08.223013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:08.223014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:08.223015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:08.223016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:08.223017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:08.223019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:08.223020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:08.223021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:08.223023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:08.223024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:08.223025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:08.223031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:08.223045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:08.223050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:08.223054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:08.223058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:08.223062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:08.223067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:08.223071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:08.223075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:08.223080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:08.223084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:08.223088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:08.223092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:08.223103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:08.223112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:08.223119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:08.223125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:08.223130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:08.223135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:08.223139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:08.223145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:08.223151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:08.223157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:08.223168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:08.223174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:08.223179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:08.223184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:08.223189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:08.223201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:08.223206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:08.223212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:08.223217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:08.223227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:08.223232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:08.223243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:08.223247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:08.223252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:08.223257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:08.223268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:08.223312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:08.226130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:08.226509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:08.226525Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:08.226528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:08.226532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:08.226539Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3206 [2:7559602897349963949:12609]
2025-10-10T14:40:08.226553Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:08.226571Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:08.226575Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:08.226579Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:08.226582Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:08.226601Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:08.226614Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:08.226623Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:08.226685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:08.226693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:08.226695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:08.226702Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:08.226775Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:08.226781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:08.226793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:08.226806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:08.226824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:08.226845Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602897349963944:12609]
2025-10-10T14:40:08.226847Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602897349963944:12609]
2025-10-10T14:40:08.226849Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602897349963944:12609]
2025-10-10T14:40:08.226858Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:08.226871Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:08.226873Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:08.226874Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:08.226877Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:08.226888Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:08.226892Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:08.226905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602898132216580:2765], now have 1 active actors on pipe
2025-10-10T14:40:08.226909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602898132216477:2438], now have 1 active actors on pipe
2025-10-10T14:40:08.226935Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602897349963944:12609]
2025-10-10T14:40:08.226944Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:08.226962Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:08.227207Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3206
2025-10-10T14:40:08.227269Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3206
2025-10-10T14:40:08.227525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:08.227538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:08.227570Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|13caf55b-37b4ee4f-94a350a7-7be2af1c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:08.227578Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:08.227583Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:08.227585Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:08.227597Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:08.227611Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:08.227626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:08.227819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:08.227831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:08.227850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:08.228011Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3207 partition: 0 MaxSeqNo: 40 sessionId: src_id|13caf55b-37b4ee4f-94a350a7-7be2af1c_0
2025-10-10T14:40:08.228451Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fae1aec8-caa3cc24-80205adc-6dec9af0_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|13caf55b-37b4ee4f-94a350a7-7be2af1c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:08.231139Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|13caf55b-37b4ee4f-94a350a7-7be2af1c_0] Write session: try to update token
2025-10-10T14:40:08.231157Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|13caf55b-37b4ee4f-94a350a7-7be2af1c_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:08.249973Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:08.249997Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:08.250002Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:08.250005Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:08.250020Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602897349963944:12609]
2025-10-10T14:40:08.250026Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602897349963944:12609]
2025-10-10T14:40:08.250033Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602897349963944:12609]
2025-10-10T14:40:08.250091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:08.250099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:08.250098Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:08.250102Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:08.250106Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:08.250116Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:08.250247Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:08.253413Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3207 sessionId: src_id|13caf55b-37b4ee4f-94a350a7-7be2af1c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:08.256173Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:08.262859Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602898132216840:2851]
2025-10-10T14:40:08.263146Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 pipe creation result: OK TabletId: 72075186224037892 Generation: 3206, pipe: [1:7559602898132216840:2851]
2025-10-10T14:40:08.373003Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:08.373637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:08.373654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:08.373702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602898132216840:2851], now have 1 active actors on pipe
2025-10-10T14:40:08.374325Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 5 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602898132216840:2851]
2025-10-10T14:40:08.374370Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:40:08.374373Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:40:08.374435Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3207 reason: error at write: Disconnected sessionId: src_id|13caf55b-37b4ee4f-94a350a7-7be2af1c_0
2025-10-10T14:40:08.374664Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3207 sessionId: src_id|13caf55b-37b4ee4f-94a350a7-7be2af1c_0 is DEAD
2025-10-10T14:40:08.374720Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:08.374388Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:08.374984Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|13caf55b-37b4ee4f-94a350a7-7be2af1c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:40:08.374992Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|13caf55b-37b4ee4f-94a350a7-7be2af1c_0] Write session will restart in 0.007817s
2025-10-10T14:40:08.375017Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|13caf55b-37b4ee4f-94a350a7-7be2af1c_0] Write session: Do CDS request
2025-10-10T14:40:08.375026Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|13caf55b-37b4ee4f-94a350a7-7be2af1c_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:08.385513Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|13caf55b-37b4ee4f-94a350a7-7be2af1c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:08.385642Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:08.385663Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3208
2025-10-10T14:40:08.385809Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3208 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:08.385852Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3208 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:08.385858Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3208 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:08.385863Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:08.387009Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3208 sessionId:  describe result for acl check
2025-10-10T14:40:08.387061Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:08.387064Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:08.387066Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:08.387073Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602898132216894:2743] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:08.387787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602898132216894:2743] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:08.390170Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602898132216894:2743] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:08.396841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602898132216894:2743] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:08.396861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602898132216894:2743] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:08.396865Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602898132216894:2743] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:08.396874Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3208 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:08.418823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:08.425388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:08.425684Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:08.425700Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:08.425714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:08.425779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:08.425831Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602897349964251:12612]
2025-10-10T14:40:08.426421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:08.426852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:08.426907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:08.427233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:08.427306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:08.427314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:08.427315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:08.427316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:08.427318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:08.427319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:08.427320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:08.427321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:08.427323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:08.427324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:08.427325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:08.427326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:08.427328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:08.427333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:08.427346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:08.427350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:08.427354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:08.427357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:08.427361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:08.427365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:08.427368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:08.427372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:08.427376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:08.427380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:08.427384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:08.427387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:08.427396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:08.427406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:08.427413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:08.427419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:08.427424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:08.427429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:08.427433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:08.427439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:08.427443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:08.427448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:08.427452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:08.427463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:08.427469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:08.427474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:08.427483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:08.427488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:08.427493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:08.427498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:08.427502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:08.427507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:08.427512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:08.427518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:08.427522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:08.427532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:08.427536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:08.427545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:08.427583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:08.430352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:08.431422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:08.431442Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:08.431445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:08.431449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:08.431456Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3207 [2:7559602897349964251:12612]
2025-10-10T14:40:08.431471Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:08.431494Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:08.431503Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:08.431507Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:08.431510Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:08.431529Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:08.431544Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:08.431557Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:08.431625Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:08.431634Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:08.431636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:08.431639Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:08.431724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:08.431732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:08.431744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:08.431759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:08.431779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:08.431812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602898132217002:2743], now have 1 active actors on pipe
2025-10-10T14:40:08.431822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602898132216843:2438], now have 1 active actors on pipe
2025-10-10T14:40:08.431831Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602897349964246:12612]
2025-10-10T14:40:08.431833Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602897349964246:12612]
2025-10-10T14:40:08.431835Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602897349964246:12612]
2025-10-10T14:40:08.431852Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:08.431870Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:08.431873Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:08.431874Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:08.431876Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:08.431892Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:08.431896Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:08.431932Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602897349964246:12612]
2025-10-10T14:40:08.431941Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:08.431943Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:08.431885Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3207
2025-10-10T14:40:08.431901Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3207
2025-10-10T14:40:08.431978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:08.431988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:08.432043Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8e0044d7-3e81b4bd-4b5bd7c3-a7e1a4b0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:08.432056Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:08.432061Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:08.432064Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:08.432077Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:08.432089Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:08.432110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:08.432319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:08.432331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:08.432490Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3208 partition: 0 MaxSeqNo: 40 sessionId: src_id|8e0044d7-3e81b4bd-4b5bd7c3-a7e1a4b0_0
2025-10-10T14:40:08.432351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:08.433431Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|13caf55b-37b4ee4f-94a350a7-7be2af1c_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|8e0044d7-3e81b4bd-4b5bd7c3-a7e1a4b0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:08.436207Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8e0044d7-3e81b4bd-4b5bd7c3-a7e1a4b0_0] Write session: try to update token
2025-10-10T14:40:08.436225Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8e0044d7-3e81b4bd-4b5bd7c3-a7e1a4b0_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:08.453322Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:08.453356Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:08.453361Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:08.453363Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:08.453373Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602897349964246:12612]
2025-10-10T14:40:08.453378Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602897349964246:12612]
2025-10-10T14:40:08.453382Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602897349964246:12612]
2025-10-10T14:40:08.453432Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:08.453436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:08.453438Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:08.453442Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:08.453446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:08.453448Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:08.453589Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:08.463180Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3208 sessionId: src_id|8e0044d7-3e81b4bd-4b5bd7c3-a7e1a4b0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:08.465942Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:08.474359Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602898132217205:2851]
2025-10-10T14:40:08.474664Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 pipe creation result: OK TabletId: 72075186224037892 Generation: 3207, pipe: [1:7559602898132217205:2851]
2025-10-10T14:40:08.572503Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:08.573212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:08.573228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:08.573252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602898132217205:2851], now have 1 active actors on pipe
2025-10-10T14:40:08.573483Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:08.574321Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e0044d7-3e81b4bd-4b5bd7c3-a7e1a4b0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:40:08.574333Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e0044d7-3e81b4bd-4b5bd7c3-a7e1a4b0_0] Write session will restart in 0.006845s
2025-10-10T14:40:08.574359Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e0044d7-3e81b4bd-4b5bd7c3-a7e1a4b0_0] Write session: Do CDS request
2025-10-10T14:40:08.574366Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e0044d7-3e81b4bd-4b5bd7c3-a7e1a4b0_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:08.573810Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:40:08.573838Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:40:08.573903Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3208 reason: error at write: Disconnected sessionId: src_id|8e0044d7-3e81b4bd-4b5bd7c3-a7e1a4b0_0
2025-10-10T14:40:08.574134Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3208 sessionId: src_id|8e0044d7-3e81b4bd-4b5bd7c3-a7e1a4b0_0 is DEAD
2025-10-10T14:40:08.574382Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:08.574417Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 6 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602898132217205:2851]
2025-10-10T14:40:08.585932Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8e0044d7-3e81b4bd-4b5bd7c3-a7e1a4b0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:08.586038Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:08.586059Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3209
2025-10-10T14:40:08.588779Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3209 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:08.588854Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3209 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:08.588860Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3209 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:08.588865Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:08.589746Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3209 sessionId:  describe result for acl check
2025-10-10T14:40:08.589785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:08.589787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:08.589788Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:08.589795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602898132217280:2735] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:08.590389Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602898132217280:2735] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:08.592608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602898132217280:2735] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:08.596651Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602898132217280:2735] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:08.596670Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602898132217280:2735] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:08.596674Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602898132217280:2735] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:08.596683Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3209 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:08.615034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:08.615764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:08.616003Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:08.616018Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:08.616032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:08.616088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:08.616140Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602897349964551:12614]
2025-10-10T14:40:08.616772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:08.617103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:08.617154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:08.617511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:08.617578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:08.617585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:08.617586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:08.617588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:08.617589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:08.617591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:08.617593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:08.617594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:08.617595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:08.617597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:08.617598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:08.617600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:08.617601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:08.617607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:08.617620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:08.617624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:08.617628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:08.617632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:08.617637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:08.617640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:08.617644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:08.617647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:08.617651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:08.617656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:08.617659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:08.617663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:08.617672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:08.617680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:08.617688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:08.617694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:08.617698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:08.617704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:08.617708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:08.617713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:08.617718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:08.617723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:08.617729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:08.617734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:08.617739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:08.617744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:08.617748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:08.617754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:08.617759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:08.617764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:08.617770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:08.617775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:08.617780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:08.617793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:08.617798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:08.617808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:08.617813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:08.617823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:08.617861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:08.620370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:08.621285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:08.621300Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:08.621302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:08.621306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:08.621312Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3208 [2:7559602897349964551:12614]
2025-10-10T14:40:08.621344Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:08.621363Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:08.621367Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:08.621370Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:08.621372Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:08.621388Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:08.621395Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:08.621403Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:08.621466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:08.621474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:08.621476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:08.621478Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:08.621553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:08.621562Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:08.621574Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:08.621587Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:08.621605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:08.621633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602898132217387:2735], now have 1 active actors on pipe
2025-10-10T14:40:08.621641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602898132217208:2438], now have 1 active actors on pipe
2025-10-10T14:40:08.621650Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602897349964546:12614]
2025-10-10T14:40:08.621656Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602897349964546:12614]
2025-10-10T14:40:08.621659Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602897349964546:12614]
2025-10-10T14:40:08.621673Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:08.621685Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:08.621687Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:08.621702Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:08.621703Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:08.621705Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:08.621707Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:08.621731Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602897349964546:12614]
2025-10-10T14:40:08.621745Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:08.621769Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:08.621793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:08.621798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:08.621834Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e5571600-43de0b27-166e4b08-88f2d8fe_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:08.621853Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:08.621857Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:08.621860Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:08.621872Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:08.621883Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:08.621898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:08.622009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:08.622018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:08.622034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:08.622596Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e0044d7-3e81b4bd-4b5bd7c3-a7e1a4b0_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|e5571600-43de0b27-166e4b08-88f2d8fe_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:08.621663Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3208
2025-10-10T14:40:08.621671Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3208
2025-10-10T14:40:08.622111Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3209 partition: 0 MaxSeqNo: 40 sessionId: src_id|e5571600-43de0b27-166e4b08-88f2d8fe_0
2025-10-10T14:40:08.625622Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e5571600-43de0b27-166e4b08-88f2d8fe_0] Write session: try to update token
2025-10-10T14:40:08.625642Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e5571600-43de0b27-166e4b08-88f2d8fe_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:08.636885Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:40:08.636914Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:08.636927Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602897349964546:12614]
2025-10-10T14:40:08.636981Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:40:08.636986Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:40:08.637191Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:40:08.637379Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:08.637544Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:08.637704Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:08.637923Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:40:08.637968Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:40:08.642054Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3209 sessionId: src_id|e5571600-43de0b27-166e4b08-88f2d8fe_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:08.644930Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:08.645181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:08.645220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:08.645276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:40:08.645392Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:40:08.657799Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:08.657828Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:08.657831Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:08.657833Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:08.657844Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602897349964546:12614]
2025-10-10T14:40:08.657847Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602897349964546:12614]
2025-10-10T14:40:08.657852Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602897349964546:12614]
2025-10-10T14:40:08.657892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:08.657895Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:08.657899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:08.657901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:08.657911Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:08.657915Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:08.658048Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:08.674501Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602898132217572:2851]
2025-10-10T14:40:08.674839Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 pipe creation result: OK TabletId: 72075186224037892 Generation: 3208, pipe: [1:7559602898132217572:2851]
2025-10-10T14:40:08.780513Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:08.789695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:08.789735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:08.789942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:08.790011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:08.790081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:08.790152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:08.790210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:08.790216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:08.790295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:08.790360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:08.790427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:08.790502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:08.790547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:08.790554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:08.790639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:08.790706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:08.790779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:08.790847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:08.790895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:08.790903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:08.790980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:08.791051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:08.791117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:08.791190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:08.791236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:08.791240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:08.791315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:08.791378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:08.791441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:08.791507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:08.791551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:08.791554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:08.791628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:08.791691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:08.791756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:08.791821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:08.791873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:08.791877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:08.791950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:08.792014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:08.792082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:08.792146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:08.792188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:08.792191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:08.792266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:08.792334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:08.792417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:08.792483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:08.792531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:08.792535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:08.792610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:08.792675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:08.792737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:08.792800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:08.792845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:08.792848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:08.792925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:08.792990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:08.793055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:08.793123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:08.793168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:08.793171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:08.793258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602898132217572:2851], now have 1 active actors on pipe
2025-10-10T14:40:08.794348Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:08.794284Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:40:08.794303Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:40:08.794337Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3209 reason: error at write: Disconnected sessionId: src_id|e5571600-43de0b27-166e4b08-88f2d8fe_0
2025-10-10T14:40:08.794559Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3209 sessionId: src_id|e5571600-43de0b27-166e4b08-88f2d8fe_0 is DEAD
2025-10-10T14:40:08.794592Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:08.794635Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 7 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602898132217572:2851]
2025-10-10T14:40:08.794804Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e5571600-43de0b27-166e4b08-88f2d8fe_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:40:08.794816Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e5571600-43de0b27-166e4b08-88f2d8fe_0] Write session will restart in 0.009905s
2025-10-10T14:40:08.794842Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e5571600-43de0b27-166e4b08-88f2d8fe_0] Write session: Do CDS request
2025-10-10T14:40:08.794849Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e5571600-43de0b27-166e4b08-88f2d8fe_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:08.805989Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e5571600-43de0b27-166e4b08-88f2d8fe_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:08.807271Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:08.807291Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3210
2025-10-10T14:40:08.807540Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3210 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:08.807575Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3210 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:08.807581Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3210 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:08.807585Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:08.808572Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3210 sessionId:  describe result for acl check
2025-10-10T14:40:08.808608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:08.808610Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:08.808612Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:08.808619Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602898132217609:2742] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:08.809229Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602898132217609:2742] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:08.812622Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602898132217609:2742] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:08.819079Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602898132217609:2742] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:08.819101Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602898132217609:2742] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:08.819106Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602898132217609:2742] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:08.819116Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3210 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:08.842829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:08.845357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:08.845617Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:08.845634Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:08.845648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:08.845721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:08.845782Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602897349964865:12617]
2025-10-10T14:40:08.846453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:08.846817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:08.846879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:08.847209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:08.847267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:08.847269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:08.847270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:08.847271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:08.847273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:08.847274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:08.847276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:08.847277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:08.847278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:08.847280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:08.847281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:08.847283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:08.847284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:08.847291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:08.847305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:08.847310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:08.847314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:08.847318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:08.847323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:08.847327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:08.847332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:08.847336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:08.847340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:08.847344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:08.847349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:08.847353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:08.847362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:08.847372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:08.847378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:08.847384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:08.847391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:08.847398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:08.847403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:08.847408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:08.847414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:08.847419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:08.847426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:08.847431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:08.847437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:08.847443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:08.847448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:08.847453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:08.847458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:08.847466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:08.847470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:08.847476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:08.847480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:08.847486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:08.847491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:08.847496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:08.847501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:08.847507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:08.847572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:08.850337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:08.851627Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3209
2025-10-10T14:40:08.851630Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3209
2025-10-10T14:40:08.851147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:08.851153Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:08.851157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:08.851161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:08.851169Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3209 [2:7559602897349964865:12617]
2025-10-10T14:40:08.851184Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:08.851203Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:08.851206Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:08.851210Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:08.851213Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:08.851231Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:08.851241Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:08.851250Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:08.851319Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:08.851322Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:08.851324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:08.851330Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:08.851407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:08.851411Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:08.851425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:08.851438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:08.851458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:08.851483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602898132217741:2742], now have 1 active actors on pipe
2025-10-10T14:40:08.851492Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602897349964860:12617]
2025-10-10T14:40:08.851495Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602897349964860:12617]
2025-10-10T14:40:08.851497Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602897349964860:12617]
2025-10-10T14:40:08.851514Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:08.851524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602898132217575:2438], now have 1 active actors on pipe
2025-10-10T14:40:08.851531Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:08.851534Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:08.851535Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:08.851538Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:08.851552Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:08.851557Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:08.851591Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602897349964860:12617]
2025-10-10T14:40:08.851603Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:08.851685Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:08.851923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:08.851937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:08.851970Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e45c6c2c-33d9db03-665e48b5-feb69f30_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:08.851979Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:08.851984Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:08.851987Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:08.852000Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:08.852013Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:08.852027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:08.852183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:08.852192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:08.852209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:08.852479Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3210 partition: 0 MaxSeqNo: 40 sessionId: src_id|e45c6c2c-33d9db03-665e48b5-feb69f30_0
2025-10-10T14:40:08.852880Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e5571600-43de0b27-166e4b08-88f2d8fe_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|e45c6c2c-33d9db03-665e48b5-feb69f30_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:08.856028Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e45c6c2c-33d9db03-665e48b5-feb69f30_0] Write session: try to update token
2025-10-10T14:40:08.856047Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e45c6c2c-33d9db03-665e48b5-feb69f30_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:08.873561Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:08.873586Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:08.873590Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:08.873593Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:08.873607Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602897349964860:12617]
2025-10-10T14:40:08.873614Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602897349964860:12617]
2025-10-10T14:40:08.873617Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602897349964860:12617]
2025-10-10T14:40:08.873667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:08.873675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:08.873677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:08.873698Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:08.873705Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:08.873709Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:08.873822Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:08.879303Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3210 sessionId: src_id|e45c6c2c-33d9db03-665e48b5-feb69f30_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:08.882187Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:08.894604Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602898132217951:2851]
2025-10-10T14:40:08.894844Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 pipe creation result: OK TabletId: 72075186224037892 Generation: 3209, pipe: [1:7559602898132217951:2851]
2025-10-10T14:40:08.996335Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 8 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602898132217951:2851]
2025-10-10T14:40:08.994856Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:08.996367Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:08.996406Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:40:08.995557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:08.995569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:08.995620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602898132217951:2851], now have 1 active actors on pipe
2025-10-10T14:40:08.995826Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:08.996829Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e45c6c2c-33d9db03-665e48b5-feb69f30_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:40:08.996840Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e45c6c2c-33d9db03-665e48b5-feb69f30_0] Write session will restart in 0.009988s
2025-10-10T14:40:08.996859Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e45c6c2c-33d9db03-665e48b5-feb69f30_0] Write session: Do CDS request
2025-10-10T14:40:08.996864Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e45c6c2c-33d9db03-665e48b5-feb69f30_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:08.996477Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3210 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e45c6c2c-33d9db03-665e48b5-feb69f30_0
2025-10-10T14:40:08.996690Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3210 sessionId: src_id|e45c6c2c-33d9db03-665e48b5-feb69f30_0 is DEAD
2025-10-10T14:40:09.008044Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e45c6c2c-33d9db03-665e48b5-feb69f30_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:09.010221Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:09.010240Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3211
2025-10-10T14:40:09.010476Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3211 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:09.010514Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3211 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:09.010519Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3211 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:09.010523Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:09.011401Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3211 sessionId:  describe result for acl check
2025-10-10T14:40:09.011435Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:09.011437Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:09.011439Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:09.011446Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602902427185290:2705] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:09.012164Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602902427185290:2705] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:09.020595Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602902427185290:2705] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:09.031039Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602902427185290:2705] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:09.031059Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602902427185290:2705] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:09.031063Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602902427185290:2705] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:09.031071Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3211 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:09.058737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:09.059926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:09.060151Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:09.060158Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:09.060170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:09.060220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:09.060260Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602901644932501:12625]
2025-10-10T14:40:09.060954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:09.065575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:09.065658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:09.066069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:09.066133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:09.066140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:09.066141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:09.066143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:09.066145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:09.066146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:09.066148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:09.066150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:09.066151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:09.066152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:09.066154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:09.066156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:09.066157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:09.066165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:09.066180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:09.066185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:09.066190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:09.066195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:09.066200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:09.066205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:09.066209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:09.066214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:09.066219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:09.066224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:09.066229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:09.066233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:09.066242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:09.066252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:09.066259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:09.066266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:09.066271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:09.066277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:09.066282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:09.066288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:09.066294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:09.066300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:09.066305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:09.066311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:09.066317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:09.066323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:09.066328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:09.066334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:09.066340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:09.066346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:09.066362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:09.066369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:09.066377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:09.066383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:09.066388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:09.066394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:09.066401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:09.066407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:09.066451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:09.070590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:09.071573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:09.071593Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:09.071596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:09.071600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:09.071608Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3210 [2:7559602901644932501:12625]
2025-10-10T14:40:09.071624Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:09.071644Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:09.071656Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:09.071660Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:09.071663Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:09.071683Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:09.071697Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:09.071713Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:09.071788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:09.071795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:09.071797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:09.071800Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:09.071881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:09.071890Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:09.071904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:09.071921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:09.071946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:09.071975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602898132217980:2438], now have 1 active actors on pipe
2025-10-10T14:40:09.071984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602902427185347:2705], now have 1 active actors on pipe
2025-10-10T14:40:09.071993Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602901644932496:12625]
2025-10-10T14:40:09.071996Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602901644932496:12625]
2025-10-10T14:40:09.071998Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602901644932496:12625]
2025-10-10T14:40:09.072017Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:09.072033Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:09.072055Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:09.072063Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:09.072106Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602901644932496:12625]
2025-10-10T14:40:09.072115Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:09.072187Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:09.072191Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:09.072194Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:09.072201Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:09.072177Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3210
2025-10-10T14:40:09.072243Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3210
2025-10-10T14:40:09.073008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:09.073028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:09.073064Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bfa79279-31cdd552-9a59fd51-8396b359_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:09.073080Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:09.073089Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:09.073091Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:09.073104Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:09.073124Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:09.073141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:09.076311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:09.076330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:09.076361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:09.076544Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3211 partition: 0 MaxSeqNo: 40 sessionId: src_id|bfa79279-31cdd552-9a59fd51-8396b359_0
2025-10-10T14:40:09.077178Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e45c6c2c-33d9db03-665e48b5-feb69f30_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|bfa79279-31cdd552-9a59fd51-8396b359_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:09.080261Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bfa79279-31cdd552-9a59fd51-8396b359_0] Write session: try to update token
2025-10-10T14:40:09.080280Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bfa79279-31cdd552-9a59fd51-8396b359_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:09.095023Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:09.095052Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:09.095056Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:09.095058Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:09.095069Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602901644932496:12625]
2025-10-10T14:40:09.095074Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602901644932496:12625]
2025-10-10T14:40:09.095079Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602901644932496:12625]
2025-10-10T14:40:09.095129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:09.095129Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:09.095135Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:09.095141Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:09.095145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:09.095148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:09.095290Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:09.097398Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602902427185651:2851]
2025-10-10T14:40:09.103435Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 pipe creation result: OK TabletId: 72075186224037892 Generation: 3210, pipe: [1:7559602902427185651:2851]
2025-10-10T14:40:09.103465Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3211 sessionId: src_id|bfa79279-31cdd552-9a59fd51-8396b359_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:09.106616Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:09.234338Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:09.235243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602902427185651:2851], now have 1 active actors on pipe
2025-10-10T14:40:09.235278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:09.235287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:09.235628Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:09.235725Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:09.235788Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:40:09.235791Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:40:09.235851Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3211 reason: error at write: Disconnected sessionId: src_id|bfa79279-31cdd552-9a59fd51-8396b359_0
2025-10-10T14:40:09.236052Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3211 sessionId: src_id|bfa79279-31cdd552-9a59fd51-8396b359_0 is DEAD
2025-10-10T14:40:09.236198Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 9 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602902427185651:2851]
2025-10-10T14:40:09.236291Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bfa79279-31cdd552-9a59fd51-8396b359_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:40:09.236301Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bfa79279-31cdd552-9a59fd51-8396b359_0] Write session will restart in 0.008680s
2025-10-10T14:40:09.236327Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bfa79279-31cdd552-9a59fd51-8396b359_0] Write session: Do CDS request
2025-10-10T14:40:09.236344Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bfa79279-31cdd552-9a59fd51-8396b359_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:09.245960Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bfa79279-31cdd552-9a59fd51-8396b359_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:09.248658Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:09.248677Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3212
2025-10-10T14:40:09.248983Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3212 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:09.249032Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3212 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:09.249039Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3212 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:09.249044Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:09.249570Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3212 sessionId:  describe result for acl check
2025-10-10T14:40:09.249601Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:09.249606Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:09.249608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:09.249615Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602902427185694:2688] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:09.250277Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602902427185694:2688] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:09.264960Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602902427185694:2688] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:09.275431Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602902427185694:2688] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:09.275454Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602902427185694:2688] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:09.275459Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602902427185694:2688] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:09.275469Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3212 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:09.287319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:09.296292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:09.296784Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:09.296796Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:09.296808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:09.296872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:09.296922Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602901644932808:12634]
2025-10-10T14:40:09.297416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:09.297896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:09.297979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:09.298376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:09.298460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:09.298468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:09.298469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:09.298471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:09.298472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:09.298474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:09.298475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:09.298477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:09.298479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:09.298481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:09.298482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:09.298484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:09.298486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:09.298493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:09.298508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:09.298513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:09.298518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:09.298523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:09.298527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:09.298531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:09.298535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:09.298540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:09.298546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:09.298551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:09.298555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:09.298559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:09.298569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:09.298580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:09.298590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:09.298596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:09.298603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:09.298609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:09.298614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:09.298621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:09.298627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:09.298634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:09.298650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:09.298657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:09.298662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:09.298668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:09.298674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:09.298680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:09.298688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:09.298696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:09.298701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:09.298708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:09.298713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:09.298719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:09.298723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:09.298729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:09.298734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:09.298740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:09.298783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:09.302373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:09.303376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:09.303391Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:09.303394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:09.303398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:09.303405Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3211 [2:7559602901644932808:12634]
2025-10-10T14:40:09.303421Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:09.303444Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:09.303454Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:09.303458Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:09.303464Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:09.303483Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:09.303497Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:09.303506Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:09.303571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:09.303579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:09.303581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:09.303584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:09.303659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:09.303667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:09.303679Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:09.303691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:09.303708Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:09.303732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602902427185654:2438], now have 1 active actors on pipe
2025-10-10T14:40:09.303736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602902427185933:2688], now have 1 active actors on pipe
2025-10-10T14:40:09.303744Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602901644932801:12634]
2025-10-10T14:40:09.303746Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602901644932801:12634]
2025-10-10T14:40:09.303749Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602901644932801:12634]
2025-10-10T14:40:09.303765Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:09.303780Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:09.303782Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:09.303786Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:09.303789Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:09.303798Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:09.303802Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:09.304274Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3211
2025-10-10T14:40:09.304327Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3211
2025-10-10T14:40:09.303835Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602901644932801:12634]
2025-10-10T14:40:09.303848Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:09.303870Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:09.304611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:09.304622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:09.304656Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4cd45029-d7e71296-c694a34-912b20e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:09.304665Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:09.304669Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:09.304672Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:09.304686Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:09.304699Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:09.304723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:09.305062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:09.305073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:09.305092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:09.305258Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3212 partition: 0 MaxSeqNo: 40 sessionId: src_id|4cd45029-d7e71296-c694a34-912b20e_0
2025-10-10T14:40:09.305810Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bfa79279-31cdd552-9a59fd51-8396b359_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|4cd45029-d7e71296-c694a34-912b20e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:09.308826Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4cd45029-d7e71296-c694a34-912b20e_0] Write session: try to update token
2025-10-10T14:40:09.308847Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4cd45029-d7e71296-c694a34-912b20e_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:09.328394Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:09.328417Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:09.328420Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:09.328422Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:09.328438Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602901644932801:12634]
2025-10-10T14:40:09.328442Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602901644932801:12634]
2025-10-10T14:40:09.328448Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602901644932801:12634]
2025-10-10T14:40:09.328502Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:09.328500Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:09.328507Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:09.328511Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:09.328513Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:09.328516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:09.328656Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:09.337048Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602902427186021:2851]
2025-10-10T14:40:09.337880Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 pipe creation result: OK TabletId: 72075186224037892 Generation: 3211, pipe: [1:7559602902427186021:2851]
2025-10-10T14:40:09.342516Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3212 sessionId: src_id|4cd45029-d7e71296-c694a34-912b20e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:09.345400Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:09.461945Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:09.462674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602902427186021:2851], now have 1 active actors on pipe
2025-10-10T14:40:09.462736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:09.462752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:09.463003Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:09.463068Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 10 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602902427186021:2851]
2025-10-10T14:40:09.463117Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:09.463172Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:40:09.463253Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3212 reason: status is not ok: tablet will be restarted right now sessionId: src_id|4cd45029-d7e71296-c694a34-912b20e_0
2025-10-10T14:40:09.463470Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3212 sessionId: src_id|4cd45029-d7e71296-c694a34-912b20e_0 is DEAD
2025-10-10T14:40:09.463704Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4cd45029-d7e71296-c694a34-912b20e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:40:09.463744Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4cd45029-d7e71296-c694a34-912b20e_0] Write session will restart in 0.007229s
2025-10-10T14:40:09.463782Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4cd45029-d7e71296-c694a34-912b20e_0] Write session: Do CDS request
2025-10-10T14:40:09.463789Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4cd45029-d7e71296-c694a34-912b20e_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:09.472004Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4cd45029-d7e71296-c694a34-912b20e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:09.472580Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:09.472600Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3213
2025-10-10T14:40:09.472760Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3213 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:09.472797Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3213 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:09.472804Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3213 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:09.472809Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:09.473709Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3213 sessionId:  describe result for acl check
2025-10-10T14:40:09.473760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:09.473768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:09.473770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:09.473777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602902427186057:2681] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:09.474423Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602902427186057:2681] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:09.477246Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602902427186057:2681] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:09.482404Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602902427186057:2681] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:09.482425Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602902427186057:2681] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:09.482429Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602902427186057:2681] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:09.482439Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3213 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:09.513165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:09.520456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:09.520684Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:09.520693Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:09.520703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:09.520748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:09.520780Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602901644933117:12637]
2025-10-10T14:40:09.521208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:09.521859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:09.521912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:09.522219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:09.522342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:09.522343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:09.522344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:09.522345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:09.522346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:09.522347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:09.522348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:09.522350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:09.522351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:09.522352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:09.522354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:09.522355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:09.522356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:09.522363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:09.522377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:09.522381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:09.522385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:09.522389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:09.522393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:09.522396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:09.522400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:09.522404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:09.522408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:09.522412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:09.522415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:09.522419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:09.522427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:09.522435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:09.522441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:09.522446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:09.522450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:09.522455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:09.522459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:09.522464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:09.522468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:09.522473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:09.522477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:09.522482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:09.522489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:09.522494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:09.522499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:09.522504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:09.522508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:09.522513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:09.522517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:09.522524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:09.522531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:09.522536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:09.522540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:09.522545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:09.522549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:09.522555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:09.522594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:09.526173Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3212
2025-10-10T14:40:09.526178Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3212
2025-10-10T14:40:09.524981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:09.525797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:09.525802Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:09.525804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:09.525811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:09.525819Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3212 [2:7559602901644933117:12637]
2025-10-10T14:40:09.525832Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:09.525850Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:09.525854Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:09.525858Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:09.525860Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:09.525874Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:09.525880Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:09.525887Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:09.525944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:09.525945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:09.525946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:09.525948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:09.526014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:09.526016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:09.526027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:09.526038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:09.526054Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:09.526077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602902427186086:2681], now have 1 active actors on pipe
2025-10-10T14:40:09.526084Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602901644933107:12637]
2025-10-10T14:40:09.526087Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602901644933107:12637]
2025-10-10T14:40:09.526088Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602901644933107:12637]
2025-10-10T14:40:09.526107Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:09.526107Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:09.526109Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:09.526111Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:09.526114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602902427186024:2438], now have 1 active actors on pipe
2025-10-10T14:40:09.526123Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:09.526138Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:09.526141Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:09.526167Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602901644933107:12637]
2025-10-10T14:40:09.526169Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:09.526218Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:09.526387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:09.526398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:09.526434Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|53f7b834-1aea6153-4cb6aac3-19329fa4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:09.526442Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:09.526446Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:09.526448Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:09.526461Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:09.526472Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:09.526486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:09.526764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:09.526771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:09.526787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:09.526926Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3213 partition: 0 MaxSeqNo: 40 sessionId: src_id|53f7b834-1aea6153-4cb6aac3-19329fa4_0
2025-10-10T14:40:09.527357Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4cd45029-d7e71296-c694a34-912b20e_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|53f7b834-1aea6153-4cb6aac3-19329fa4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:09.530168Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|53f7b834-1aea6153-4cb6aac3-19329fa4_0] Write session: try to update token
2025-10-10T14:40:09.530197Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|53f7b834-1aea6153-4cb6aac3-19329fa4_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:09.538540Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:40:09.538562Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:09.538573Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602901644933107:12637]
2025-10-10T14:40:09.538624Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:40:09.538676Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:40:09.538793Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:40:09.538929Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:09.539069Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:09.539210Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:09.539399Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:40:09.539444Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:40:09.547728Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3213 sessionId: src_id|53f7b834-1aea6153-4cb6aac3-19329fa4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:09.550478Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:09.550716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:09.550742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:09.550793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:40:09.550977Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:40:09.560972Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:09.560995Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:09.560998Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:09.561000Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:09.561013Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602901644933107:12637]
2025-10-10T14:40:09.561017Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602901644933107:12637]
2025-10-10T14:40:09.561021Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602901644933107:12637]
2025-10-10T14:40:09.561074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:09.561091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:09.561094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:09.561095Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:09.561107Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:09.561111Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:09.561232Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:09.563552Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602902427186396:2851]
2025-10-10T14:40:09.567694Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 pipe creation result: OK TabletId: 72075186224037892 Generation: 3212, pipe: [1:7559602902427186396:2851]
2025-10-10T14:40:09.674727Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:09.675429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602902427186396:2851], now have 1 active actors on pipe
2025-10-10T14:40:09.683067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:09.683101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:09.683280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:09.683351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:09.683424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:09.683493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:09.683549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:09.683557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:09.683625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:09.683684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:09.683759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:09.683839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:09.683895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:09.683906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:09.683988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:09.684064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:09.684136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:09.684205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:09.684257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:09.684268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:09.684342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:09.684425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:09.684494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:09.684563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:09.684611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:09.684618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:09.684686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:09.684746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:09.684808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:09.684871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:09.684914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:09.684927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:09.684993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:09.685050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:09.685109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:09.685180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:09.685223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:09.685229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:09.685295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:09.685394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:09.685465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:09.685532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:09.685577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:09.685582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:09.685654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:09.685716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:09.685776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:09.685832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:09.685875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:09.685877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:09.685942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:09.686015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:09.686088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:09.686167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:09.686216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:09.686224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:09.686293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:09.686349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:09.686407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:09.686483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:09.686545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:09.686553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:09.686956Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:40:09.686990Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:40:09.687025Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3213 reason: error at write: Disconnected sessionId: src_id|53f7b834-1aea6153-4cb6aac3-19329fa4_0
2025-10-10T14:40:09.687246Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3213 sessionId: src_id|53f7b834-1aea6153-4cb6aac3-19329fa4_0 is DEAD
2025-10-10T14:40:09.687449Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53f7b834-1aea6153-4cb6aac3-19329fa4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:40:09.687461Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53f7b834-1aea6153-4cb6aac3-19329fa4_0] Write session will restart in 0.008612s
2025-10-10T14:40:09.687448Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:09.687486Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53f7b834-1aea6153-4cb6aac3-19329fa4_0] Write session: Do CDS request
2025-10-10T14:40:09.687492Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53f7b834-1aea6153-4cb6aac3-19329fa4_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:09.687499Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 11 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602902427186396:2851]
2025-10-10T14:40:09.687877Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:09.697997Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|53f7b834-1aea6153-4cb6aac3-19329fa4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:09.698175Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:09.698198Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3214
2025-10-10T14:40:09.698354Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3214 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:09.698389Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3214 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:09.698394Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3214 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:09.698399Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:09.698943Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3214 sessionId:  describe result for acl check
2025-10-10T14:40:09.698991Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:09.699000Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:09.699003Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:09.699010Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602902427186416:2658] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:09.699660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602902427186416:2658] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:09.703072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:09.703936Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602902427186416:2658] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:09.705728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:09.706016Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:09.706033Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:09.706050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:09.706139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:09.706201Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602901644933179:12639]
2025-10-10T14:40:09.706848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:09.707281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:09.707361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:09.707743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:09.707830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:09.707838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:09.707839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:09.707841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:09.707842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:09.707843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:09.707845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:09.707847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:09.707848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:09.707849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:09.707851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:09.707852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:09.707853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:09.707861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:09.707875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:09.707880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:09.707884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:09.707889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:09.707894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:09.707898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:09.707903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:09.707910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:09.707915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:09.707919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:09.707923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:09.707927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:09.707936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:09.707945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:09.707969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:09.707981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:09.707986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:09.707992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:09.707998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:09.708003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:09.708014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:09.708020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:09.708037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:09.708047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:09.708053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:09.708063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:09.708068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:09.708073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:09.708078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:09.708084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:09.708088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:09.708093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:09.708105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:09.708110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:09.708115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:09.708120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:09.708125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:09.708131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:09.708173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:09.710783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:09.710784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602902427186416:2658] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:09.710802Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602902427186416:2658] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:09.710806Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602902427186416:2658] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:09.710816Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3214 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:09.711854Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3213
2025-10-10T14:40:09.711890Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3213
2025-10-10T14:40:09.713118Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3214 partition: 0 MaxSeqNo: 40 sessionId: src_id|f52dd2d9-822b47f2-8db44840-a94eb229_0
2025-10-10T14:40:09.717446Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53f7b834-1aea6153-4cb6aac3-19329fa4_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|f52dd2d9-822b47f2-8db44840-a94eb229_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:09.711130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:09.711150Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:09.711155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:09.711158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:09.711166Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3213 [2:7559602901644933179:12639]
2025-10-10T14:40:09.711179Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:09.711200Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:09.711203Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:09.711207Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:09.711210Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:09.711228Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:09.711236Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:09.711262Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:09.711324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:09.711326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:09.711328Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:09.711331Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:09.711406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:09.711409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:09.711422Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:09.711435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:09.711454Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:09.711477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602902427186455:2658], now have 1 active actors on pipe
2025-10-10T14:40:09.711481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602902427186399:2438], now have 1 active actors on pipe
2025-10-10T14:40:09.711489Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602901644933174:12639]
2025-10-10T14:40:09.711493Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602901644933174:12639]
2025-10-10T14:40:09.711495Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602901644933174:12639]
2025-10-10T14:40:09.711512Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:09.711528Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:09.711545Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:09.711550Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:09.711551Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:09.711554Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:09.711556Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:09.711578Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602901644933174:12639]
2025-10-10T14:40:09.711583Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:09.711583Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:09.712410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:09.712422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:09.712461Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f52dd2d9-822b47f2-8db44840-a94eb229_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:09.712471Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:09.712476Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:09.712479Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:09.712492Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:09.712506Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:09.712524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:09.712762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:09.712767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:09.712785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:09.720315Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f52dd2d9-822b47f2-8db44840-a94eb229_0] Write session: try to update token
2025-10-10T14:40:09.720337Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f52dd2d9-822b47f2-8db44840-a94eb229_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:09.737841Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:09.737873Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:09.737877Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:09.737879Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:09.737891Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602901644933174:12639]
2025-10-10T14:40:09.737897Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602901644933174:12639]
2025-10-10T14:40:09.737903Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602901644933174:12639]
2025-10-10T14:40:09.737966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:09.737983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:09.737985Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:09.738021Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:09.738050Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:09.738056Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:09.738154Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:09.751839Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3214 sessionId: src_id|f52dd2d9-822b47f2-8db44840-a94eb229_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:09.754680Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:09.789420Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602902427186462:2851]
2025-10-10T14:40:09.789800Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 pipe creation result: OK TabletId: 72075186224037892 Generation: 3213, pipe: [1:7559602902427186462:2851]
2025-10-10T14:40:09.865264Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:09.865852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:09.865874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:09.865896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602902427186462:2851], now have 1 active actors on pipe
2025-10-10T14:40:09.866213Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:40:09.866248Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:09.866242Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:40:09.866257Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:09.866317Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 12 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602902427186462:2851]
2025-10-10T14:40:09.866527Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3214 reason: error at write: Disconnected sessionId: src_id|f52dd2d9-822b47f2-8db44840-a94eb229_0
2025-10-10T14:40:09.866734Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3214 sessionId: src_id|f52dd2d9-822b47f2-8db44840-a94eb229_0 is DEAD
2025-10-10T14:40:09.866944Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f52dd2d9-822b47f2-8db44840-a94eb229_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:40:09.866956Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f52dd2d9-822b47f2-8db44840-a94eb229_0] Write session will restart in 0.008836s
2025-10-10T14:40:09.866984Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f52dd2d9-822b47f2-8db44840-a94eb229_0] Write session: Do CDS request
2025-10-10T14:40:09.866990Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f52dd2d9-822b47f2-8db44840-a94eb229_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:09.874706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:09.876643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:09.876884Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:09.876897Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:09.876910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:09.876982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:09.877008Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f52dd2d9-822b47f2-8db44840-a94eb229_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:09.877037Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602901644933248:12642]
2025-10-10T14:40:09.877173Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:09.877199Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3215
2025-10-10T14:40:09.877442Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3215 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:09.877481Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3215 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:09.877494Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3215 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:09.877499Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:09.877788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:09.878010Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3215 sessionId:  describe result for acl check
2025-10-10T14:40:09.878050Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:09.878063Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:09.878068Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:09.878074Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602902427186491:2639] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:09.878106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:09.878173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:09.878525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:09.878592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:09.878603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:09.878605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:09.878606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:09.878608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:09.878610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:09.878612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:09.878613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:09.878615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:09.878618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:09.878619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:09.878621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:09.878622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:09.878628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:09.878640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:09.878644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:09.878649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:09.878653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:09.878657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:09.878662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:09.878666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:09.878670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:09.878675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:09.878680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:09.878684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:09.878689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:09.878697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:09.878705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:09.878712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:09.878718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:09.878725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:09.878732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:09.878739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:09.878727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602902427186491:2639] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:09.878744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:09.878750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:09.878756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:09.878761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:09.878767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:09.878778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:09.878783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:09.878793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:09.878800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:09.878810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:09.878815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:09.878820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:09.878825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:09.878831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:09.878836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:09.878842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:09.878848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:09.878859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:09.878865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:09.878915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:09.880672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602902427186491:2639] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:09.881653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:09.882066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:09.882080Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:09.882083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:09.882087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:09.882094Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3214 [2:7559602901644933248:12642]
2025-10-10T14:40:09.882110Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:09.882125Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:09.882129Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:09.882132Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:09.882135Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:09.882152Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:09.882164Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:09.882176Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:09.882237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:09.882245Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:09.882247Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:09.882250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:09.882317Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:09.882326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:09.882339Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:09.882357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:09.882372Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:09.882389Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602901644933243:12642]
2025-10-10T14:40:09.882391Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602901644933243:12642]
2025-10-10T14:40:09.882393Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602901644933243:12642]
2025-10-10T14:40:09.882404Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:09.882414Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:09.882417Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:09.882431Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:09.882434Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:09.882436Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:09.882439Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:09.882443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602902427186466:2438], now have 1 active actors on pipe
2025-10-10T14:40:09.882467Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602901644933243:12642]
2025-10-10T14:40:09.882475Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:09.882507Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:09.882546Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3214
2025-10-10T14:40:09.888077Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602902427186491:2639] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:09.888099Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602902427186491:2639] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:09.888102Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602902427186491:2639] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:09.888112Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3215 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:09.888436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602902427186528:2639], now have 1 active actors on pipe
2025-10-10T14:40:09.888530Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3214
2025-10-10T14:40:09.888647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:09.888663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:09.888694Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d256c9da-6468a982-f5893c2b-fb2394d9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:09.888710Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:09.888724Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:09.888728Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:09.888742Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:09.888776Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:09.888800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:09.888999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:09.889008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:09.889022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:09.889137Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3215 partition: 0 MaxSeqNo: 40 sessionId: src_id|d256c9da-6468a982-f5893c2b-fb2394d9_0
2025-10-10T14:40:09.889562Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f52dd2d9-822b47f2-8db44840-a94eb229_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|d256c9da-6468a982-f5893c2b-fb2394d9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:09.892515Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d256c9da-6468a982-f5893c2b-fb2394d9_0] Write session: try to update token
2025-10-10T14:40:09.892536Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d256c9da-6468a982-f5893c2b-fb2394d9_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:09.901165Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:40:09.901468Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:09.901484Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602901644933243:12642]
2025-10-10T14:40:09.901551Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:40:09.901554Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:40:09.901740Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:40:09.901900Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:09.902043Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:09.902172Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:09.902362Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:40:09.902401Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:40:09.907939Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3215 sessionId: src_id|d256c9da-6468a982-f5893c2b-fb2394d9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:09.910736Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:09.911064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:09.911091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:09.911135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:40:09.911365Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:40:09.913145Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:09.913166Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:09.913169Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:09.913171Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:09.913181Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602901644933243:12642]
2025-10-10T14:40:09.913188Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602901644933243:12642]
2025-10-10T14:40:09.913192Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602901644933243:12642]
2025-10-10T14:40:09.913242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:09.913255Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:09.913257Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:09.913262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:09.913264Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:09.913268Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:09.913422Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:09.966287Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602902427186546:2851]
2025-10-10T14:40:09.966534Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 pipe creation result: OK TabletId: 72075186224037892 Generation: 3214, pipe: [1:7559602902427186546:2851]
2025-10-10T14:40:10.036784Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:10.045388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:10.045421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:10.048904Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 13 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602902427186546:2851]
2025-10-10T14:40:10.048958Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:40:10.048962Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:40:10.049000Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3215 reason: error at write: Disconnected sessionId: src_id|d256c9da-6468a982-f5893c2b-fb2394d9_0
2025-10-10T14:40:10.049270Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3215 sessionId: src_id|d256c9da-6468a982-f5893c2b-fb2394d9_0 is DEAD
2025-10-10T14:40:10.045612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:10.045676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:10.045735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:10.045799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:10.045842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:10.045850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:10.045920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:10.045976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:10.046039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:10.046105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:10.046143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:10.046146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:10.046212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:10.046269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:10.046329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:10.046388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:10.046426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:10.046429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:10.046494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:10.046554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:10.046628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:10.046689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:10.046729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:10.046731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:10.046798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:10.046867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:10.046951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:10.047010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:10.047049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:10.047052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:10.047119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:10.047175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:10.047246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:10.047306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:10.047343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:10.047345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:10.047412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:10.047468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:10.047533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:10.047593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:10.047650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:10.047654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:10.047720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:10.047774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:10.047830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:10.047887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:10.047930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:10.047933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:10.047996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:10.048048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:10.048108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:10.048165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:10.048211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:10.048214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:10.048295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:10.048351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:10.048422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:10.048480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:10.048517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:10.048520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:10.048594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602902427186546:2851], now have 1 active actors on pipe
2025-10-10T14:40:10.049574Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d256c9da-6468a982-f5893c2b-fb2394d9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:40:10.049586Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d256c9da-6468a982-f5893c2b-fb2394d9_0] Write session will restart in 0.009343s
2025-10-10T14:40:10.049615Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d256c9da-6468a982-f5893c2b-fb2394d9_0] Write session: Do CDS request
2025-10-10T14:40:10.049622Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d256c9da-6468a982-f5893c2b-fb2394d9_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:10.049802Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:10.049922Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:10.061530Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d256c9da-6468a982-f5893c2b-fb2394d9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:10.064676Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:10.064704Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3216
2025-10-10T14:40:10.065049Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3216 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:10.065104Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3216 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:10.065118Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3216 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:10.065125Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:10.065786Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3216 sessionId:  describe result for acl check
2025-10-10T14:40:10.065828Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:10.065838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:10.065840Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:10.065847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602906722153879:2608] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:10.066704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602906722153879:2608] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:10.067749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:10.071871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:10.072126Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:10.072139Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:10.072156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:10.072225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:10.072270Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602905939900617:12650]
2025-10-10T14:40:10.072923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:10.073350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:10.073403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:10.073751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:10.073807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:10.073808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:10.073810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:10.073812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:10.073813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:10.073815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:10.073816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:10.073819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:10.073820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:10.073821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:10.073823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:10.073824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:10.073825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:10.073831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:10.073847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:10.073851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:10.073856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:10.073860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:10.073864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:10.073868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:10.073872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:10.073877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:10.073882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:10.073886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:10.073890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:10.073894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:10.073902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:10.073910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:10.073917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:10.073923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:10.073927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:10.073933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:10.073938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:10.073944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:10.074190Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602906722153879:2608] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:10.073948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:10.073954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:10.073960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:10.073966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:10.073972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:10.073979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:10.073984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:10.073990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:10.073995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:10.074000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:10.074005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:10.074011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:10.074019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:10.074024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:10.074028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:10.074034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:10.074038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:10.074043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:10.074084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:10.079695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602906722153879:2608] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:10.079723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602906722153879:2608] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:10.079727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602906722153879:2608] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:10.079737Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3216 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:10.079197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:10.079527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:10.079532Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:10.079535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:10.079539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:10.079555Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3215 [2:7559602905939900617:12650]
2025-10-10T14:40:10.079570Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:10.079592Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:10.079595Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:10.079599Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:10.079601Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:10.079620Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:10.079630Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:10.079638Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:10.079701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:10.079715Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:10.079717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:10.079719Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:10.079796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:10.079799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:10.079811Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:10.079824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:10.079841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:10.079863Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602905939900611:12650]
2025-10-10T14:40:10.079866Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602905939900611:12650]
2025-10-10T14:40:10.079868Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602905939900611:12650]
2025-10-10T14:40:10.079882Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:10.079897Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:10.079912Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:10.079915Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:10.079948Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602905939900611:12650]
2025-10-10T14:40:10.079951Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:10.080159Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:10.080168Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:10.080171Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:10.080177Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:10.080561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602906722153858:2438], now have 1 active actors on pipe
2025-10-10T14:40:10.081073Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3215
2025-10-10T14:40:10.082067Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3215
2025-10-10T14:40:10.084033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602906722153912:2608], now have 1 active actors on pipe
2025-10-10T14:40:10.084061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:10.084071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:10.084121Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6fc9dfbe-5ab776fb-5b861170-21273059_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:10.084134Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:10.084140Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:10.084143Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:10.084159Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:10.084186Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:10.084204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:10.084936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:10.084962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:10.084992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:10.085177Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3216 partition: 0 MaxSeqNo: 40 sessionId: src_id|6fc9dfbe-5ab776fb-5b861170-21273059_0
2025-10-10T14:40:10.089645Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d256c9da-6468a982-f5893c2b-fb2394d9_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|6fc9dfbe-5ab776fb-5b861170-21273059_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:10.092442Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6fc9dfbe-5ab776fb-5b861170-21273059_0] Write session: try to update token
2025-10-10T14:40:10.092461Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6fc9dfbe-5ab776fb-5b861170-21273059_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:10.104442Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:10.104472Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:10.104475Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:10.104477Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:10.104485Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602905939900611:12650]
2025-10-10T14:40:10.104489Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602905939900611:12650]
2025-10-10T14:40:10.104492Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602905939900611:12650]
2025-10-10T14:40:10.104546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:10.104554Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:10.104559Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:10.104561Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:10.104561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:10.104565Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:10.104749Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:10.109955Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3216 sessionId: src_id|6fc9dfbe-5ab776fb-5b861170-21273059_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:10.112779Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:10.149571Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602906722153931:2851]
2025-10-10T14:40:10.157503Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 pipe creation result: OK TabletId: 72075186224037892 Generation: 3215, pipe: [1:7559602906722153931:2851]
2025-10-10T14:40:10.235933Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:10.236303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:10.236319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:10.236372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602906722153931:2851], now have 1 active actors on pipe
2025-10-10T14:40:10.237395Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6fc9dfbe-5ab776fb-5b861170-21273059_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:40:10.237412Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6fc9dfbe-5ab776fb-5b861170-21273059_0] Write session will restart in 0.008754s
2025-10-10T14:40:10.237438Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6fc9dfbe-5ab776fb-5b861170-21273059_0] Write session: Do CDS request
2025-10-10T14:40:10.237445Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6fc9dfbe-5ab776fb-5b861170-21273059_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:10.236898Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:10.236802Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:40:10.236819Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 14 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602906722153931:2851]
2025-10-10T14:40:10.236824Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:40:10.236843Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:10.236900Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3216 reason: error at write: Disconnected sessionId: src_id|6fc9dfbe-5ab776fb-5b861170-21273059_0
2025-10-10T14:40:10.237087Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3216 sessionId: src_id|6fc9dfbe-5ab776fb-5b861170-21273059_0 is DEAD
2025-10-10T14:40:10.250474Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6fc9dfbe-5ab776fb-5b861170-21273059_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:10.250963Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:10.250983Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3217
2025-10-10T14:40:10.251229Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3217 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:10.251261Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3217 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:10.251268Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3217 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:10.251272Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:10.251771Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3217 sessionId:  describe result for acl check
2025-10-10T14:40:10.251802Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:10.251804Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:10.251806Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:10.251813Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602906722153954:2583] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:10.252425Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602906722153954:2583] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:10.256147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:10.257621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602906722153954:2583] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:10.258283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:10.258535Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:10.258550Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:10.258564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:10.258629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:10.258679Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602905939900701:12659]
2025-10-10T14:40:10.259303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:10.259762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:10.259816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:10.260134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:10.260198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:10.260208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:10.260210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:10.260211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:10.260213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:10.260214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:10.260218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:10.260219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:10.260221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:10.260222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:10.260223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:10.260224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:10.260225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:10.260232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:10.260246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:10.260250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:10.260254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:10.260258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:10.260263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:10.260268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:10.260272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:10.260276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:10.260280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:10.260284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:10.260288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:10.260292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:10.260301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:10.260309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:10.260316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:10.260320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:10.260325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:10.260329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:10.260333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:10.260338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:10.260343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:10.260348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:10.260351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:10.260370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:10.260376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:10.260381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:10.260387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:10.260392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:10.260397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:10.260402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:10.260406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:10.260411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:10.260415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:10.260420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:10.260425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:10.260431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:10.260436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:10.260442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:10.260483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:10.261996Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602906722153954:2583] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:10.262018Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602906722153954:2583] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:10.262022Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602906722153954:2583] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:10.262033Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3217 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:10.263328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:10.263757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:10.263774Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:10.263777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:10.263782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:10.263789Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3216 [2:7559602905939900701:12659]
2025-10-10T14:40:10.263805Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:10.263824Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:10.263827Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:10.263830Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:10.263833Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:10.263849Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:10.263861Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:10.263868Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:10.263947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:10.263957Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:10.263960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:10.263962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:10.264037Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:10.264045Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:10.264056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:10.264067Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:10.264087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:10.264110Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602905939900696:12659]
2025-10-10T14:40:10.264116Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602905939900696:12659]
2025-10-10T14:40:10.264118Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602905939900696:12659]
2025-10-10T14:40:10.264129Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:10.264141Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:10.264142Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:10.264154Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:10.264157Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:10.264157Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:10.264160Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:10.264169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602906722153934:2438], now have 1 active actors on pipe
2025-10-10T14:40:10.264173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602906722153989:2583], now have 1 active actors on pipe
2025-10-10T14:40:10.264206Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602905939900696:12659]
2025-10-10T14:40:10.264218Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:10.264228Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:10.264236Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3216
2025-10-10T14:40:10.264291Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3216
2025-10-10T14:40:10.264467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:10.264484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:10.264514Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e5588cd4-fe4ba33c-6c401c02-7c8fae17_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:10.264534Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:10.264546Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:10.264548Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:10.264563Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:10.264580Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:10.264599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:10.264763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:10.264771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:10.264785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:10.264875Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3217 partition: 0 MaxSeqNo: 40 sessionId: src_id|e5588cd4-fe4ba33c-6c401c02-7c8fae17_0
2025-10-10T14:40:10.265400Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6fc9dfbe-5ab776fb-5b861170-21273059_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|e5588cd4-fe4ba33c-6c401c02-7c8fae17_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:10.268121Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e5588cd4-fe4ba33c-6c401c02-7c8fae17_0] Write session: try to update token
2025-10-10T14:40:10.268140Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e5588cd4-fe4ba33c-6c401c02-7c8fae17_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:10.286969Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:10.286999Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:10.287003Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:10.287005Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:10.287018Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602905939900696:12659]
2025-10-10T14:40:10.287024Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602905939900696:12659]
2025-10-10T14:40:10.287029Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602905939900696:12659]
2025-10-10T14:40:10.287084Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:10.287087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:10.287097Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:10.287100Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:10.287108Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:10.287113Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:10.287285Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:10.291101Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3217 sessionId: src_id|e5588cd4-fe4ba33c-6c401c02-7c8fae17_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:10.293875Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:10.336978Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602906722153997:2851]
2025-10-10T14:40:10.344390Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 pipe creation result: OK TabletId: 72075186224037892 Generation: 3216, pipe: [1:7559602906722153997:2851]
2025-10-10T14:40:10.417195Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:10.418291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:10.418313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:10.418360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602906722153997:2851], now have 1 active actors on pipe
2025-10-10T14:40:10.418736Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:10.419111Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 15 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602906722153997:2851]
2025-10-10T14:40:10.419154Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:10.419201Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:40:10.419295Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3217 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e5588cd4-fe4ba33c-6c401c02-7c8fae17_0
2025-10-10T14:40:10.419512Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3217 sessionId: src_id|e5588cd4-fe4ba33c-6c401c02-7c8fae17_0 is DEAD
2025-10-10T14:40:10.419709Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e5588cd4-fe4ba33c-6c401c02-7c8fae17_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:40:10.419718Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e5588cd4-fe4ba33c-6c401c02-7c8fae17_0] Write session will restart in 0.009418s
2025-10-10T14:40:10.419746Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e5588cd4-fe4ba33c-6c401c02-7c8fae17_0] Write session: Do CDS request
2025-10-10T14:40:10.419753Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e5588cd4-fe4ba33c-6c401c02-7c8fae17_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:10.429577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:10.431147Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e5588cd4-fe4ba33c-6c401c02-7c8fae17_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:10.431213Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:10.431234Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3218
2025-10-10T14:40:10.431360Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3218 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:10.431390Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3218 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:10.431403Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3218 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:10.431408Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:10.432021Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3218 sessionId:  describe result for acl check
2025-10-10T14:40:10.432062Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:10.432069Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:10.432071Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:10.432079Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602906722154024:2577] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:10.432653Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602906722154024:2577] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:10.431892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:10.432138Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:10.432143Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:10.432155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:10.432211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:10.432251Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602905939900762:12662]
2025-10-10T14:40:10.432821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:10.433636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:10.433715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:10.434148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:10.434229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:10.434230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:10.434231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:10.434234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:10.434235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:10.434237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:10.434239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:10.434240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:10.434242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:10.434243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:10.434245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:10.434246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:10.434247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:10.434255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:10.434268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:10.434273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:10.434278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:10.434283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:10.434288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:10.434295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:10.434299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:10.434303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:10.434308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:10.434313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:10.434317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:10.434321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:10.434329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:10.434338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:10.434346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:10.434352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:10.434358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:10.434364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:10.434369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:10.434375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:10.434382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:10.434389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:10.434394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:10.434415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:10.434422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:10.434428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:10.434433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:10.434438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:10.434443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:10.434449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:10.434455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:10.434460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:10.434465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:10.434472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:10.434477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:10.434482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:10.434488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:10.434494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:10.434538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:10.437701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:10.438033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:10.438039Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:10.438041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:10.438045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:10.438051Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3217 [2:7559602905939900762:12662]
2025-10-10T14:40:10.438070Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:10.438090Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:10.438093Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:10.438098Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:10.438102Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:10.438120Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:10.438128Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:10.438135Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:10.438203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:10.438205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:10.438207Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:10.438210Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:10.438292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:10.438295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:10.438304Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:10.438315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:10.438333Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:10.438364Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602905939900757:12662]
2025-10-10T14:40:10.438367Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602905939900757:12662]
2025-10-10T14:40:10.438370Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602905939900757:12662]
2025-10-10T14:40:10.438378Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:10.438396Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:10.438412Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:10.438415Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:10.438452Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602905939900757:12662]
2025-10-10T14:40:10.438455Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:10.438537Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:10.438551Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:10.438553Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:10.438559Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:10.439283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602906722153999:2438], now have 1 active actors on pipe
2025-10-10T14:40:10.437228Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602906722154024:2577] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:10.438946Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3217
2025-10-10T14:40:10.446849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602906722154061:2577], now have 1 active actors on pipe
2025-10-10T14:40:10.448278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:10.448310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:10.448368Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|63ebf493-4c41f890-88984c71-ac8c4fe2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:10.448389Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:10.448415Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:10.448418Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:10.448437Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:10.448461Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:10.448503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:10.448735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:10.448761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:10.448790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:10.444735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602906722154024:2577] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:10.449401Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e5588cd4-fe4ba33c-6c401c02-7c8fae17_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|63ebf493-4c41f890-88984c71-ac8c4fe2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:10.444756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602906722154024:2577] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:10.444760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602906722154024:2577] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:10.444769Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3218 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:10.448167Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3217
2025-10-10T14:40:10.448915Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3218 partition: 0 MaxSeqNo: 40 sessionId: src_id|63ebf493-4c41f890-88984c71-ac8c4fe2_0
2025-10-10T14:40:10.452259Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|63ebf493-4c41f890-88984c71-ac8c4fe2_0] Write session: try to update token
2025-10-10T14:40:10.452283Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|63ebf493-4c41f890-88984c71-ac8c4fe2_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:10.464865Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:10.464889Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:10.464894Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:10.464896Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:10.464906Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602905939900757:12662]
2025-10-10T14:40:10.464915Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602905939900757:12662]
2025-10-10T14:40:10.464919Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602905939900757:12662]
2025-10-10T14:40:10.464976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:10.464989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:10.464991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:10.465130Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:10.468036Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:10.468058Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:10.468062Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:10.478812Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3218 sessionId: src_id|63ebf493-4c41f890-88984c71-ac8c4fe2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:10.481951Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:10.518687Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602906722154065:2851]
2025-10-10T14:40:10.519138Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 pipe creation result: OK TabletId: 72075186224037892 Generation: 3217, pipe: [1:7559602906722154065:2851]
2025-10-10T14:40:10.581295Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:10.581804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:10.581827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:10.581851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602906722154065:2851], now have 1 active actors on pipe
2025-10-10T14:40:10.583356Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:10.583573Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:40:10.583666Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3218 reason: status is not ok: tablet will be restarted right now sessionId: src_id|63ebf493-4c41f890-88984c71-ac8c4fe2_0
2025-10-10T14:40:10.583874Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3218 sessionId: src_id|63ebf493-4c41f890-88984c71-ac8c4fe2_0 is DEAD
2025-10-10T14:40:10.584012Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:10.584079Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 16 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602906722154065:2851]
2025-10-10T14:40:10.584437Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63ebf493-4c41f890-88984c71-ac8c4fe2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:40:10.584445Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63ebf493-4c41f890-88984c71-ac8c4fe2_0] Write session will restart in 0.006672s
2025-10-10T14:40:10.584472Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63ebf493-4c41f890-88984c71-ac8c4fe2_0] Write session: Do CDS request
2025-10-10T14:40:10.584480Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63ebf493-4c41f890-88984c71-ac8c4fe2_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:10.591962Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|63ebf493-4c41f890-88984c71-ac8c4fe2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:10.592074Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:10.592094Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3219
2025-10-10T14:40:10.592425Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3219 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:10.592481Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3219 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:10.592493Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3219 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:10.592498Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:10.593534Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3219 sessionId:  describe result for acl check
2025-10-10T14:40:10.593576Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:10.593578Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:10.593579Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:10.593586Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602906722154089:2566] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:10.594173Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602906722154089:2566] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:10.594326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:10.594911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:10.595151Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:10.595166Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:10.595180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:10.595244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:10.595295Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602905939900823:12664]
2025-10-10T14:40:10.595914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:10.596338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:10.596406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:10.596810Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602906722154089:2566] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:10.596760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:10.596843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:10.596844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:10.596846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:10.596847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:10.596849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:10.596851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:10.596855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:10.596856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:10.596858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:10.596859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:10.596860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:10.596861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:10.596863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:10.596871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:10.596884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:10.596889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:10.596893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:10.596897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:10.596901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:10.596905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:10.596909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:10.596914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:10.596918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:10.596922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:10.596927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:10.596931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:10.596938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:10.596946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:10.596953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:10.596959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:10.596964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:10.596969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:10.596973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:10.596977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:10.596982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:10.596986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:10.596992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:10.596998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:10.597003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:10.597008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:10.597012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:10.597017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:10.597031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:10.597036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:10.597040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:10.597046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:10.597050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:10.597055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:10.597079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:10.597090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:10.597094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:10.597100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:10.597141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:10.599876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:10.599886Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602906722154089:2566] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:10.599904Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602906722154089:2566] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:10.599909Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602906722154089:2566] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:10.599919Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3219 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:10.600377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:10.600410Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:10.600412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:10.600418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:10.600425Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3218 [2:7559602905939900823:12664]
2025-10-10T14:40:10.600440Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:10.600459Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:10.600465Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:10.600469Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:10.600471Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:10.600489Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:10.600502Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:10.600514Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:10.600578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:10.600586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:10.600588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:10.600590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:10.600660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:10.600668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:10.600680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:10.600697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:10.600720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:10.600749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602906722154066:2438], now have 1 active actors on pipe
2025-10-10T14:40:10.600757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602906722154127:2566], now have 1 active actors on pipe
2025-10-10T14:40:10.600766Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602905939900818:12664]
2025-10-10T14:40:10.600769Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602905939900818:12664]
2025-10-10T14:40:10.600771Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602905939900818:12664]
2025-10-10T14:40:10.600792Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:10.600812Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:10.600836Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:10.600803Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3218
2025-10-10T14:40:10.600843Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:10.600808Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3218
2025-10-10T14:40:10.600855Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:10.600868Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:10.600871Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602905939900818:12664]
2025-10-10T14:40:10.600871Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:10.600877Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:10.600884Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:10.600899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:10.600909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:10.600964Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cfbc648b-12081ace-a9e184cb-e7ff80d6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:10.600976Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:10.600984Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:10.600987Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:10.600998Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:10.601014Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:10.601036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:10.601244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:10.601252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:10.601270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:10.601362Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3219 partition: 0 MaxSeqNo: 40 sessionId: src_id|cfbc648b-12081ace-a9e184cb-e7ff80d6_0
2025-10-10T14:40:10.601749Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63ebf493-4c41f890-88984c71-ac8c4fe2_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|cfbc648b-12081ace-a9e184cb-e7ff80d6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:10.604534Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfbc648b-12081ace-a9e184cb-e7ff80d6_0] Write session: try to update token
2025-10-10T14:40:10.604554Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfbc648b-12081ace-a9e184cb-e7ff80d6_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:10.623293Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3219 sessionId: src_id|cfbc648b-12081ace-a9e184cb-e7ff80d6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:10.626498Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:10.625907Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:10.625932Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:10.625936Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:10.625939Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:10.625950Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602905939900818:12664]
2025-10-10T14:40:10.625955Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602905939900818:12664]
2025-10-10T14:40:10.625959Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602905939900818:12664]
2025-10-10T14:40:10.626013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:10.626022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:10.626025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:10.626188Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:10.627889Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:10.627898Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:10.627904Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:10.684110Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602906722154135:2851]
2025-10-10T14:40:10.689434Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 pipe creation result: OK TabletId: 72075186224037892 Generation: 3218, pipe: [1:7559602906722154135:2851]
2025-10-10T14:40:10.747350Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:10.747702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:10.747715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:10.747762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602906722154135:2851], now have 1 active actors on pipe
2025-10-10T14:40:10.748030Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:10.748398Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:40:10.748495Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3219 reason: status is not ok: tablet will be restarted right now sessionId: src_id|cfbc648b-12081ace-a9e184cb-e7ff80d6_0
2025-10-10T14:40:10.748518Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 17 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602906722154135:2851]
2025-10-10T14:40:10.748907Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cfbc648b-12081ace-a9e184cb-e7ff80d6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:40:10.748930Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cfbc648b-12081ace-a9e184cb-e7ff80d6_0] Write session will restart in 0.008273s
2025-10-10T14:40:10.748542Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:10.748959Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cfbc648b-12081ace-a9e184cb-e7ff80d6_0] Write session: Do CDS request
2025-10-10T14:40:10.748734Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3219 sessionId: src_id|cfbc648b-12081ace-a9e184cb-e7ff80d6_0 is DEAD
2025-10-10T14:40:10.748966Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cfbc648b-12081ace-a9e184cb-e7ff80d6_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:10.758067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:10.758997Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfbc648b-12081ace-a9e184cb-e7ff80d6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:10.759088Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:10.759107Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3220
2025-10-10T14:40:10.759199Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3220 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:10.759237Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3220 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:10.759248Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3220 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:10.759253Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:10.759836Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3220 sessionId:  describe result for acl check
2025-10-10T14:40:10.759889Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:10.759897Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:10.759899Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:10.759906Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602906722154161:2563] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:10.760623Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602906722154161:2563] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:10.759915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:10.760109Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:10.760113Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:10.760124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:10.760170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:10.760204Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602905939900897:12667]
2025-10-10T14:40:10.760749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:10.761094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:10.761150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:10.761441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:10.761511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:10.761517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:10.761519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:10.761520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:10.761521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:10.761523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:10.761525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:10.761526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:10.761527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:10.761529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:10.761531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:10.761532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:10.761534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:10.761540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:10.761554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:10.761558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:10.761562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:10.761567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:10.761572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:10.761577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:10.761581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:10.761585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:10.761590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:10.761596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:10.761600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:10.761604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:10.761613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:10.761622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:10.761629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:10.761642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:10.761646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:10.761651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:10.761656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:10.761661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:10.761666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:10.761669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:10.761673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:10.761678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:10.761682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:10.761686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:10.761690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:10.761694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:10.761699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:10.761704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:10.761707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:10.761712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:10.761717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:10.761721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:10.761726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:10.761730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:10.761735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:10.761741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:10.761783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:10.764131Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602906722154161:2563] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:10.765363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:10.766126Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3219
2025-10-10T14:40:10.765709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:10.765722Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:10.765725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:10.765732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:10.765739Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3219 [2:7559602905939900897:12667]
2025-10-10T14:40:10.765753Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:10.765773Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:10.765777Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:10.765781Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:10.765783Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:10.765801Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:10.765809Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:10.765816Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:10.765881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:10.765884Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:10.765886Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:10.765888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:10.765977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:10.765982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:10.765993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:10.766004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:10.766020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:10.766056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602906722154136:2438], now have 1 active actors on pipe
2025-10-10T14:40:10.766066Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602905939900891:12667]
2025-10-10T14:40:10.766068Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602905939900891:12667]
2025-10-10T14:40:10.766070Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602905939900891:12667]
2025-10-10T14:40:10.766082Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:10.766098Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:10.766099Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:10.766101Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:10.766103Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:10.766113Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:10.766119Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:10.766161Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602905939900891:12667]
2025-10-10T14:40:10.766169Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:10.766183Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:10.773858Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602906722154161:2563] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:10.773881Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602906722154161:2563] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:10.773885Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602906722154161:2563] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:10.773896Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3220 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:10.774194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602906722154201:2563], now have 1 active actors on pipe
2025-10-10T14:40:10.774258Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3219
2025-10-10T14:40:10.774429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:10.774446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:10.774476Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4e3bb798-52114790-6f903266-93fb8810_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:10.774492Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:10.774497Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:10.774499Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:10.774511Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:10.774530Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:10.774573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:10.774867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:10.774881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:10.774899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:10.775029Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3220 partition: 0 MaxSeqNo: 40 sessionId: src_id|4e3bb798-52114790-6f903266-93fb8810_0
2025-10-10T14:40:10.775499Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cfbc648b-12081ace-a9e184cb-e7ff80d6_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|4e3bb798-52114790-6f903266-93fb8810_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:10.778712Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4e3bb798-52114790-6f903266-93fb8810_0] Write session: try to update token
2025-10-10T14:40:10.778734Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4e3bb798-52114790-6f903266-93fb8810_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:10.787588Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:10.787614Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:10.787622Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:10.787624Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:10.787636Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602905939900891:12667]
2025-10-10T14:40:10.787641Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602905939900891:12667]
2025-10-10T14:40:10.787645Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602905939900891:12667]
2025-10-10T14:40:10.787704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:10.787724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:10.787727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:10.787880Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:10.789498Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:10.789516Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:10.789520Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:10.802143Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3220 sessionId: src_id|4e3bb798-52114790-6f903266-93fb8810_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:10.804944Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:10.848439Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602906722154204:2851]
2025-10-10T14:40:10.848943Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 pipe creation result: OK TabletId: 72075186224037892 Generation: 3219, pipe: [1:7559602906722154204:2851]
2025-10-10T14:40:10.917185Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:10.917669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:10.917699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:10.917727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602906722154204:2851], now have 1 active actors on pipe
2025-10-10T14:40:10.918025Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:10.918394Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:40:10.918498Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3220 reason: status is not ok: tablet will be restarted right now sessionId: src_id|4e3bb798-52114790-6f903266-93fb8810_0
2025-10-10T14:40:10.918573Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 18 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602906722154204:2851]
2025-10-10T14:40:10.918592Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:10.918740Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3220 sessionId: src_id|4e3bb798-52114790-6f903266-93fb8810_0 is DEAD
2025-10-10T14:40:10.925446Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e3bb798-52114790-6f903266-93fb8810_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:40:10.925464Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e3bb798-52114790-6f903266-93fb8810_0] Write session will restart in 0.008995s
2025-10-10T14:40:10.925507Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e3bb798-52114790-6f903266-93fb8810_0] Write session: Do CDS request
2025-10-10T14:40:10.925514Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e3bb798-52114790-6f903266-93fb8810_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:10.929501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:10.931237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:10.931498Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:10.931512Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:10.931525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:10.931584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:10.931638Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602905939900961:12669]
2025-10-10T14:40:10.932343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:10.932760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:10.932834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:10.933207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:10.933286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:10.933293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:10.933295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:10.933296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:10.933298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:10.933299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:10.933301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:10.933303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:10.933304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:10.933306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:10.933307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:10.933308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:10.933310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:10.933316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:10.933351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:10.933356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:10.933361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:10.933364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:10.933369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:10.933374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:10.933379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:10.933383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:10.933389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:10.933394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:10.933400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:10.933404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:10.933413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:10.933422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:10.933428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:10.933434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:10.933439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:10.933445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:10.933457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:10.933463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:10.933467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:10.933471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:10.933495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:10.933500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:10.933504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:10.933509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:10.933515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:10.933519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:10.933524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:10.933528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:10.933533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:10.933538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:10.933543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:10.933548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:10.933551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:10.933556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:10.933561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:10.933566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:10.933619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:10.937506Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3220
2025-10-10T14:40:10.936583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:10.937034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:10.937042Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:10.937046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:10.937051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:10.937059Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3220 [2:7559602905939900961:12669]
2025-10-10T14:40:10.937076Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:10.937097Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:10.937101Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:10.937105Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:10.937109Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:10.937129Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:10.937137Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:10.937147Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:10.937217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:10.937219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:10.937222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:10.937225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:10.937314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:10.937318Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:10.937354Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:10.937368Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:10.937388Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:10.937410Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602905939900955:12669]
2025-10-10T14:40:10.937412Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602905939900955:12669]
2025-10-10T14:40:10.937415Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602905939900955:12669]
2025-10-10T14:40:10.937433Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:10.937449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602906722154222:2438], now have 1 active actors on pipe
2025-10-10T14:40:10.937461Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:10.937478Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:10.937482Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:10.937863Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4e3bb798-52114790-6f903266-93fb8810_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:10.937927Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:10.937939Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3221
2025-10-10T14:40:10.937517Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602905939900955:12669]
2025-10-10T14:40:10.937519Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:10.937522Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:10.937526Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:10.937528Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:10.937536Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:10.941644Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3221 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:10.941722Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3221 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:10.941734Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3221 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:10.941739Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:10.942244Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3221 sessionId:  describe result for acl check
2025-10-10T14:40:10.942284Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:10.942287Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:10.942289Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:10.942295Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602906722154262:2560] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:10.942936Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602906722154262:2560] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:10.946075Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602906722154262:2560] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:10.952450Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602906722154262:2560] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:10.952470Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602906722154262:2560] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:10.952474Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602906722154262:2560] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:10.952483Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3221 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:10.952853Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3220
2025-10-10T14:40:10.956121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602906722154293:2560], now have 1 active actors on pipe
2025-10-10T14:40:10.956162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:10.956172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:10.956197Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:40:10.956201Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:10.956211Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602905939900955:12669]
2025-10-10T14:40:10.956260Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:40:10.956265Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|41dd0cb4-e414c5a4-3fd733e0-eae06792_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:10.956277Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:10.956281Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:10.956284Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:10.956297Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:10.956319Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:10.956338Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:40:10.956542Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:40:10.956692Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:10.956834Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:10.956977Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:10.957172Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:40:10.957220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:10.957249Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:40:10.957470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:10.957485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:10.957512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:10.957632Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3221 partition: 0 MaxSeqNo: 40 sessionId: src_id|41dd0cb4-e414c5a4-3fd733e0-eae06792_0
2025-10-10T14:40:10.958096Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e3bb798-52114790-6f903266-93fb8810_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|41dd0cb4-e414c5a4-3fd733e0-eae06792_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:10.961445Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|41dd0cb4-e414c5a4-3fd733e0-eae06792_0] Write session: try to update token
2025-10-10T14:40:10.961466Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|41dd0cb4-e414c5a4-3fd733e0-eae06792_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:10.968804Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:10.968828Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:10.968832Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:10.968835Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:10.968848Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602905939900955:12669]
2025-10-10T14:40:10.968853Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602905939900955:12669]
2025-10-10T14:40:10.968861Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602905939900955:12669]
2025-10-10T14:40:10.968911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:10.968917Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:10.968924Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:10.968926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:10.968929Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:10.968932Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:10.969070Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:10.975667Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3221 sessionId: src_id|41dd0cb4-e414c5a4-3fd733e0-eae06792_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:10.978515Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:11.018970Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602911017121590:2851]
2025-10-10T14:40:11.019243Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 pipe creation result: OK TabletId: 72075186224037892 Generation: 3220, pipe: [1:7559602911017121590:2851]
2025-10-10T14:40:11.096980Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:11.097376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:11.097395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:11.097421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602911017121590:2851], now have 1 active actors on pipe
2025-10-10T14:40:11.097649Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:11.097669Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 19 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602911017121590:2851]
2025-10-10T14:40:11.097680Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:11.097726Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:40:11.097729Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:40:11.097792Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3221 reason: error at write: Disconnected sessionId: src_id|41dd0cb4-e414c5a4-3fd733e0-eae06792_0
2025-10-10T14:40:11.098032Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3221 sessionId: src_id|41dd0cb4-e414c5a4-3fd733e0-eae06792_0 is DEAD
2025-10-10T14:40:11.098385Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|41dd0cb4-e414c5a4-3fd733e0-eae06792_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:40:11.098397Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|41dd0cb4-e414c5a4-3fd733e0-eae06792_0] Write session will restart in 0.008245s
2025-10-10T14:40:11.098430Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|41dd0cb4-e414c5a4-3fd733e0-eae06792_0] Write session: Do CDS request
2025-10-10T14:40:11.098439Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|41dd0cb4-e414c5a4-3fd733e0-eae06792_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:11.108028Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|41dd0cb4-e414c5a4-3fd733e0-eae06792_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:11.108121Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:11.108151Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3222
2025-10-10T14:40:11.108387Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3222 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:11.108461Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3222 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:11.108469Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3222 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:11.108473Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:11.109785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:11.109206Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3222 sessionId:  describe result for acl check
2025-10-10T14:40:11.109243Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:11.109245Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:11.109247Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:11.109254Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602911017121632:2513] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:11.110194Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602911017121632:2513] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:11.112962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:11.113283Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:11.113303Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:11.113353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:11.113427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:11.113468Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602910234868330:12671]
2025-10-10T14:40:11.114221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:11.114578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:11.114632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:11.114967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:11.115024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:11.115028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:11.115030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:11.115031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:11.115033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:11.115034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:11.115036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:11.115037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:11.115039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:11.115040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:11.115042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:11.115043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:11.115045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:11.115051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:11.115064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:11.115068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:11.115074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:11.115079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:11.115084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:11.115089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:11.115093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:11.115098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:11.115103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:11.115108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:11.115112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:11.115117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:11.115124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:11.115133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:11.115145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:11.115159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:11.115164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:11.115170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:11.115174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:11.115182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:11.115187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:11.115193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:11.115198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:11.115204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:11.115209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:11.115216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:11.115226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:11.115232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:11.115241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:11.115249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:11.115254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:11.115266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:11.115271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:11.115276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:11.115287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:11.115293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:11.115302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:11.115308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:11.115365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:11.114403Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602911017121632:2513] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:11.118421Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602911017121632:2513] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:11.118440Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602911017121632:2513] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:11.118444Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602911017121632:2513] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:11.118454Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3222 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:11.119548Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3221
2025-10-10T14:40:11.119586Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3221
2025-10-10T14:40:11.118599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:11.119135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:11.119141Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:11.119143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:11.119148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:11.119156Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3221 [2:7559602910234868330:12671]
2025-10-10T14:40:11.119169Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:11.119191Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:11.119195Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:11.119199Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:11.119201Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:11.119218Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:11.119226Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:11.119233Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:11.119295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:11.119297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:11.119299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:11.119302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:11.119379Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:11.119382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:11.119395Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:11.119408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:11.119427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:11.119450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602911017121666:2513], now have 1 active actors on pipe
2025-10-10T14:40:11.119454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602911017121591:2438], now have 1 active actors on pipe
2025-10-10T14:40:11.119462Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602910234868319:12671]
2025-10-10T14:40:11.119465Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602910234868319:12671]
2025-10-10T14:40:11.119467Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602910234868319:12671]
2025-10-10T14:40:11.119482Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:11.119496Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:11.119496Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:11.119500Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:11.119503Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:11.119514Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:11.119517Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:11.119547Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602910234868319:12671]
2025-10-10T14:40:11.119557Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:11.119563Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:11.119854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:11.119867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:11.119904Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|252c41e3-7425e9d9-d76fb552-55d735b9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:11.119913Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:11.119917Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:11.119919Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:11.119931Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:11.119943Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:11.119959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:11.120197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:11.120202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:11.120217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:11.120316Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3222 partition: 0 MaxSeqNo: 40 sessionId: src_id|252c41e3-7425e9d9-d76fb552-55d735b9_0
2025-10-10T14:40:11.120845Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|41dd0cb4-e414c5a4-3fd733e0-eae06792_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|252c41e3-7425e9d9-d76fb552-55d735b9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:11.132977Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|252c41e3-7425e9d9-d76fb552-55d735b9_0] Write session: try to update token
2025-10-10T14:40:11.133004Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|252c41e3-7425e9d9-d76fb552-55d735b9_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:11.133481Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:40:11.133502Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:11.133513Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602910234868319:12671]
2025-10-10T14:40:11.133571Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:40:11.133576Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:40:11.133762Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:40:11.133934Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:11.134079Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:11.134226Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:11.134753Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:40:11.134801Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:40:11.157543Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:11.157568Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:11.157572Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:11.157575Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:11.157586Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602910234868319:12671]
2025-10-10T14:40:11.157590Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602910234868319:12671]
2025-10-10T14:40:11.157593Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602910234868319:12671]
2025-10-10T14:40:11.157645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:11.157652Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:11.157658Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:11.157659Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:11.157661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:11.157664Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:11.157816Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:11.158313Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3222 sessionId: src_id|252c41e3-7425e9d9-d76fb552-55d735b9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:11.161505Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:11.199766Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602911017121685:2851]
2025-10-10T14:40:11.200432Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 pipe creation result: OK TabletId: 72075186224037892 Generation: 3221, pipe: [1:7559602911017121685:2851]
2025-10-10T14:40:11.277716Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:11.278042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:11.278054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:11.278077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602911017121685:2851], now have 1 active actors on pipe
2025-10-10T14:40:11.278305Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:11.278662Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 20 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602911017121685:2851]
2025-10-10T14:40:11.278701Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:40:11.278773Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3222 reason: status is not ok: tablet will be restarted right now sessionId: src_id|252c41e3-7425e9d9-d76fb552-55d735b9_0
2025-10-10T14:40:11.278974Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3222 sessionId: src_id|252c41e3-7425e9d9-d76fb552-55d735b9_0 is DEAD
2025-10-10T14:40:11.279143Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:11.279375Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|252c41e3-7425e9d9-d76fb552-55d735b9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:40:11.279387Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|252c41e3-7425e9d9-d76fb552-55d735b9_0] Write session will restart in 0.009761s
2025-10-10T14:40:11.279427Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|252c41e3-7425e9d9-d76fb552-55d735b9_0] Write session: Do CDS request
2025-10-10T14:40:11.279433Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|252c41e3-7425e9d9-d76fb552-55d735b9_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:11.287163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:11.288726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:11.288975Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:11.288985Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:11.288998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:11.289072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:11.289125Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602910234868427:12686]
2025-10-10T14:40:11.289871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:11.290199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:11.290246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:11.291058Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|252c41e3-7425e9d9-d76fb552-55d735b9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:11.291605Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:11.291627Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3223
2025-10-10T14:40:11.291801Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3223 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:11.291862Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3223 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:11.291873Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3223 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:11.291879Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:11.292392Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3223 sessionId:  describe result for acl check
2025-10-10T14:40:11.292430Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:11.292437Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:11.292439Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:11.292446Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602911017121720:2491] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:11.290623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:11.290689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:11.290690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:11.290691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:11.290693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:11.290694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:11.290695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:11.290697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:11.290698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:11.290699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:11.290700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:11.290701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:11.290703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:11.290704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:11.290710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:11.290732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:11.290738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:11.290743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:11.290747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:11.290751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:11.290755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:11.290759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:11.290763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:11.290771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:11.290775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:11.290778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:11.290782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:11.290794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:11.290803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:11.290809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:11.290818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:11.290823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:11.290828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:11.290833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:11.290838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:11.290843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:11.290848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:11.290852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:11.290858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:11.290862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:11.290867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:11.290871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:11.290877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:11.290883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:11.290890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:11.290894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:11.290899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:11.290904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:11.290908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:11.293046Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602911017121720:2491] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:11.290913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:11.290918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:11.290922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:11.290928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:11.290969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:11.294772Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3222
2025-10-10T14:40:11.296110Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602911017121720:2491] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:11.294002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:11.294404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:11.294409Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:11.294413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:11.294417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:11.294424Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3222 [2:7559602910234868427:12686]
2025-10-10T14:40:11.294438Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:11.294456Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:11.294459Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:11.294463Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:11.294466Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:11.294483Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:11.294491Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:11.294499Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:11.294561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:11.294565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:11.294567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:11.294569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:11.294639Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:11.294642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:11.294655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:11.294666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:11.294683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:11.294704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602911017121689:2438], now have 1 active actors on pipe
2025-10-10T14:40:11.294712Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602910234868422:12686]
2025-10-10T14:40:11.294715Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602910234868422:12686]
2025-10-10T14:40:11.294718Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602910234868422:12686]
2025-10-10T14:40:11.294733Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:11.294746Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:11.294750Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:11.294752Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:11.294759Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:11.294774Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:11.294777Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:11.294804Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602910234868422:12686]
2025-10-10T14:40:11.294811Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:11.294818Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:11.302586Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602911017121720:2491] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:11.302608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602911017121720:2491] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:11.302612Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602911017121720:2491] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:11.302622Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3223 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:11.302941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602911017121753:2491], now have 1 active actors on pipe
2025-10-10T14:40:11.303109Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3222
2025-10-10T14:40:11.303183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:11.303199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:11.303237Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ef63a98d-a4c5ac9a-8ce5c75c-253dc4f5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:11.303257Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:11.303268Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:11.303271Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:11.303292Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:11.303319Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:11.303347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:11.303600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:11.303624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:11.303659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:11.303862Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3223 partition: 0 MaxSeqNo: 40 sessionId: src_id|ef63a98d-a4c5ac9a-8ce5c75c-253dc4f5_0
2025-10-10T14:40:11.304410Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|252c41e3-7425e9d9-d76fb552-55d735b9_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|ef63a98d-a4c5ac9a-8ce5c75c-253dc4f5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:11.307530Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ef63a98d-a4c5ac9a-8ce5c75c-253dc4f5_0] Write session: try to update token
2025-10-10T14:40:11.307551Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ef63a98d-a4c5ac9a-8ce5c75c-253dc4f5_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:11.316806Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:11.316836Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:11.316840Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:11.316843Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:11.316854Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602910234868422:12686]
2025-10-10T14:40:11.316860Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602910234868422:12686]
2025-10-10T14:40:11.316868Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602910234868422:12686]
2025-10-10T14:40:11.316929Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:11.316943Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:11.316946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:11.317090Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:11.317842Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:11.317874Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:11.317881Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:11.340479Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3223 sessionId: src_id|ef63a98d-a4c5ac9a-8ce5c75c-253dc4f5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:11.343404Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:11.378837Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602911017121759:2851]
2025-10-10T14:40:11.379257Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 pipe creation result: OK TabletId: 72075186224037892 Generation: 3222, pipe: [1:7559602911017121759:2851]
2025-10-10T14:40:11.445837Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:11.446240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:11.446259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:11.446290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602911017121759:2851], now have 1 active actors on pipe
2025-10-10T14:40:11.446681Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:11.447124Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef63a98d-a4c5ac9a-8ce5c75c-253dc4f5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:40:11.447139Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef63a98d-a4c5ac9a-8ce5c75c-253dc4f5_0] Write session will restart in 0.007890s
2025-10-10T14:40:11.447166Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef63a98d-a4c5ac9a-8ce5c75c-253dc4f5_0] Write session: Do CDS request
2025-10-10T14:40:11.446599Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 21 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602911017121759:2851]
2025-10-10T14:40:11.446608Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:11.446637Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:40:11.446640Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:40:11.446709Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3223 reason: error at write: Disconnected sessionId: src_id|ef63a98d-a4c5ac9a-8ce5c75c-253dc4f5_0
2025-10-10T14:40:11.446937Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3223 sessionId: src_id|ef63a98d-a4c5ac9a-8ce5c75c-253dc4f5_0 is DEAD
2025-10-10T14:40:11.447172Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef63a98d-a4c5ac9a-8ce5c75c-253dc4f5_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:11.455977Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ef63a98d-a4c5ac9a-8ce5c75c-253dc4f5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:11.456133Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:11.456154Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3224
2025-10-10T14:40:11.456315Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3224 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:11.456384Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3224 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:11.456396Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3224 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:11.456406Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:11.456658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:11.456942Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3224 sessionId:  describe result for acl check
2025-10-10T14:40:11.456992Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:11.456998Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:11.457000Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:11.457009Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602911017121789:2476] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:11.457645Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602911017121789:2476] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:11.459834Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602911017121789:2476] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:11.461791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:11.462055Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:11.462067Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:11.462079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:11.462151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:11.462201Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602910234868495:12689]
2025-10-10T14:40:11.462841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:11.463202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:11.463288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:11.463658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:11.463743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:11.463751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:11.463753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:11.463754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:11.463756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:11.463757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:11.463758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:11.463760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:11.463761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:11.463763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:11.463765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:11.463766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:11.463767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:11.463774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:11.463787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:11.463795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:11.463800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:11.463804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:11.463807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:11.463811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:11.463815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:11.463819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:11.463824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:11.463827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:11.463831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:11.463834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:11.463842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:11.463852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:11.463859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:11.463864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:11.463869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:11.463873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:11.463877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:11.463882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:11.463886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:11.463891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:11.463895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:11.463900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:11.463904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:11.463911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:11.463915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:11.463920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:11.463925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:11.463930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:11.463934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:11.463939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:11.463943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:11.463948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:11.463952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:11.463956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:11.463960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:11.463964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:11.464002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:11.464950Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602911017121789:2476] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:11.464969Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602911017121789:2476] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:11.464974Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602911017121789:2476] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:11.464983Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3224 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:11.466927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:11.467270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:11.467285Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:11.467288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:11.467292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:11.467299Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3223 [2:7559602910234868495:12689]
2025-10-10T14:40:11.467313Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:11.467331Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:11.467339Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:11.467344Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:11.467347Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:11.467364Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:11.467379Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:11.467387Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:11.467452Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:11.467461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:11.467465Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:11.467468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:11.467666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:11.467667Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3223
2025-10-10T14:40:11.467676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:11.467687Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:11.467700Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:11.467717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:11.467716Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3223
2025-10-10T14:40:11.467741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602911017121761:2438], now have 1 active actors on pipe
2025-10-10T14:40:11.467750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602911017121824:2476], now have 1 active actors on pipe
2025-10-10T14:40:11.467765Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602910234868488:12689]
2025-10-10T14:40:11.467767Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602910234868488:12689]
2025-10-10T14:40:11.467769Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602910234868488:12689]
2025-10-10T14:40:11.467783Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:11.467799Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:11.467803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:11.467809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:11.467811Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:11.467814Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:11.467830Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:11.467847Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:11.467851Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:11.467903Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f05c3e1c-3d85523f-7db1b80c-e0d1963b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:11.467911Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:11.467917Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:11.467921Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:11.467932Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:11.467944Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:11.467952Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602910234868488:12689]
2025-10-10T14:40:11.467968Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:11.467975Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:11.467993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:11.468271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:11.468284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:11.468305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:11.468430Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3224 partition: 0 MaxSeqNo: 40 sessionId: src_id|f05c3e1c-3d85523f-7db1b80c-e0d1963b_0
2025-10-10T14:40:11.468872Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef63a98d-a4c5ac9a-8ce5c75c-253dc4f5_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|f05c3e1c-3d85523f-7db1b80c-e0d1963b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:11.477198Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f05c3e1c-3d85523f-7db1b80c-e0d1963b_0] Write session: try to update token
2025-10-10T14:40:11.477232Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f05c3e1c-3d85523f-7db1b80c-e0d1963b_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:11.494768Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:11.494799Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:11.494803Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:11.494812Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:11.494823Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602910234868488:12689]
2025-10-10T14:40:11.494830Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602910234868488:12689]
2025-10-10T14:40:11.494835Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602910234868488:12689]
2025-10-10T14:40:11.494895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:11.494900Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:11.494908Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:11.494911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:11.494913Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:11.494914Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:11.495080Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:11.498395Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3224 sessionId: src_id|f05c3e1c-3d85523f-7db1b80c-e0d1963b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:11.507742Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:11.546827Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602911017121831:2851]
2025-10-10T14:40:11.547295Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 pipe creation result: OK TabletId: 72075186224037892 Generation: 3223, pipe: [1:7559602911017121831:2851]
2025-10-10T14:40:11.614660Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:11.615057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:11.615073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:11.615097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602911017121831:2851], now have 1 active actors on pipe
2025-10-10T14:40:11.615352Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:11.615675Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:11.615731Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 22 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602911017121831:2851]
2025-10-10T14:40:11.615754Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:40:11.615761Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:40:11.615814Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3224 reason: error at write: Disconnected sessionId: src_id|f05c3e1c-3d85523f-7db1b80c-e0d1963b_0
2025-10-10T14:40:11.616010Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3224 sessionId: src_id|f05c3e1c-3d85523f-7db1b80c-e0d1963b_0 is DEAD
2025-10-10T14:40:11.617552Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f05c3e1c-3d85523f-7db1b80c-e0d1963b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:40:11.617566Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f05c3e1c-3d85523f-7db1b80c-e0d1963b_0] Write session will restart in 0.009200s
2025-10-10T14:40:11.617591Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f05c3e1c-3d85523f-7db1b80c-e0d1963b_0] Write session: Do CDS request
2025-10-10T14:40:11.617601Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f05c3e1c-3d85523f-7db1b80c-e0d1963b_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:11.627949Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f05c3e1c-3d85523f-7db1b80c-e0d1963b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:11.628018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:11.628252Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:11.628273Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3225
2025-10-10T14:40:11.628394Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3225 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:11.628443Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3225 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:11.628449Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3225 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:11.628453Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:11.628907Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3225 sessionId:  describe result for acl check
2025-10-10T14:40:11.628937Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:11.628939Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:11.628940Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:11.628947Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602911017121865:2461] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:11.629558Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602911017121865:2461] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:11.629766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:11.630040Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:11.630053Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:11.630065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:11.630135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:11.630180Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602910234868563:12691]
2025-10-10T14:40:11.630776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:11.631083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:11.631132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:11.631473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:11.631538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:11.631545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:11.631547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:11.631548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:11.631549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:11.631551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:11.631552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:11.631553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:11.631557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:11.631558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:11.631560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:11.631561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:11.631562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:11.631568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:11.631581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:11.631585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:11.631589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:11.631593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:11.631597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:11.631602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:11.631605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:11.631609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:11.631613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:11.631617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:11.631621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:11.631625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:11.631634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:11.631645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:11.631656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:11.631662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:11.631667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:11.631672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:11.631682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:11.631687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:11.631694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:11.631704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:11.631709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:11.631714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:11.631718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:11.631724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:11.631735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:11.631740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:11.631750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:11.631756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:11.631764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:11.631769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:11.631774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:11.631779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:11.631784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:11.631789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:11.631795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:11.631804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:11.631846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:11.631939Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602911017121865:2461] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:11.634102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:11.634534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:11.634547Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:11.634551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:11.634554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:11.634559Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3224 [2:7559602910234868563:12691]
2025-10-10T14:40:11.634568Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:11.634580Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:11.634583Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:11.634585Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:11.634586Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:11.634599Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:11.634604Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:11.634611Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:11.634590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602911017121865:2461] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:11.634615Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602911017121865:2461] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:11.634618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602911017121865:2461] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:11.634627Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3225 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:11.634677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:11.634685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:11.634687Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:11.634689Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:11.634764Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:11.634771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:11.634782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:11.634800Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:11.634820Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:11.634850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602911017121833:2438], now have 1 active actors on pipe
2025-10-10T14:40:11.634860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602911017121898:2461], now have 1 active actors on pipe
2025-10-10T14:40:11.634867Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602910234868558:12691]
2025-10-10T14:40:11.634871Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602910234868558:12691]
2025-10-10T14:40:11.634872Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602910234868558:12691]
2025-10-10T14:40:11.634886Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:11.634900Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:11.634891Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3224
2025-10-10T14:40:11.634911Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:11.634893Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3224
2025-10-10T14:40:11.634914Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:11.634917Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:11.634921Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:11.634924Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:11.634942Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602910234868558:12691]
2025-10-10T14:40:11.634945Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:11.634947Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:11.634965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:11.634978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:11.635025Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a5362f13-b2106183-debf7b95-83e93699_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:11.635041Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:11.635045Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:11.635047Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:11.635058Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:11.635068Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:11.635088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:11.635405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:11.635416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:11.635434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:11.635544Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3225 partition: 0 MaxSeqNo: 40 sessionId: src_id|a5362f13-b2106183-debf7b95-83e93699_0
2025-10-10T14:40:11.635937Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f05c3e1c-3d85523f-7db1b80c-e0d1963b_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|a5362f13-b2106183-debf7b95-83e93699_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:11.638768Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a5362f13-b2106183-debf7b95-83e93699_0] Write session: try to update token
2025-10-10T14:40:11.638786Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a5362f13-b2106183-debf7b95-83e93699_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:11.654209Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3225 sessionId: src_id|a5362f13-b2106183-debf7b95-83e93699_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:11.657561Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:11.663941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:11.663973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:11.663997Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:11.664000Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:11.664002Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:11.664003Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:11.664010Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602910234868558:12691]
2025-10-10T14:40:11.664013Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602910234868558:12691]
2025-10-10T14:40:11.664016Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602910234868558:12691]
2025-10-10T14:40:11.664068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:11.664077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:11.664079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:11.664088Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:11.664095Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:11.664099Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:11.664225Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:11.717406Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602911017121905:2851]
2025-10-10T14:40:11.717836Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 pipe creation result: OK TabletId: 72075186224037892 Generation: 3224, pipe: [1:7559602911017121905:2851]
2025-10-10T14:40:11.781682Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:11.782034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:40:11.782100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602911017121905:2851], now have 1 active actors on pipe
2025-10-10T14:40:11.782178Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:40:11.785271Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 23 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602911017121905:2851]
2025-10-10T14:40:11.785320Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:11.791483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:11.793317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:11.793597Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:11.793610Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:11.793624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:11.793696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:11.793747Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602910234868643:12694]
2025-10-10T14:40:11.794396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:11.794823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:11.794890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:11.795247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:11.795320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:11.795329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:11.795329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:11.795330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:11.795331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:11.795333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:11.795334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:11.795335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:11.795336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:11.795337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:11.795339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:11.795340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:11.795341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:11.795349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:11.795373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:11.795377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:11.795381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:11.795385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:11.795389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:11.795393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:11.795397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:11.795401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:11.795405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:11.795409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:11.795412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:11.795416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:11.795425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:11.795434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:11.795446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:11.795451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:11.795457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:11.795465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:11.795471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:11.795476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:11.795481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:11.795487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:11.795490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:11.795496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:11.795500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:11.795506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:11.795510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:11.795515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:11.795520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:11.795525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:11.795529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:11.795534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:11.795539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:11.795544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:11.795548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:11.795553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:11.795559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:11.795563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:11.795601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:11.796011Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:40:11.796028Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:40:11.796052Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3225 reason: error at write: Disconnected sessionId: src_id|a5362f13-b2106183-debf7b95-83e93699_0
2025-10-10T14:40:11.796271Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3225 sessionId: src_id|a5362f13-b2106183-debf7b95-83e93699_0 is DEAD
2025-10-10T14:40:11.796350Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a5362f13-b2106183-debf7b95-83e93699_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:40:11.796363Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a5362f13-b2106183-debf7b95-83e93699_0] Write session will restart in 0.006831s
2025-10-10T14:40:11.796390Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a5362f13-b2106183-debf7b95-83e93699_0] Write session: Do CDS request
2025-10-10T14:40:11.796396Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a5362f13-b2106183-debf7b95-83e93699_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:11.802113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:11.802559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:11.802574Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:11.802577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:11.802582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:11.802590Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3225 [2:7559602910234868643:12694]
2025-10-10T14:40:11.802613Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:11.802635Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:11.802643Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:11.802647Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:11.802649Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:11.802668Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:11.802676Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:11.802689Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:11.802761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:11.802768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:11.802770Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:11.802773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:11.802848Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:11.802856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:11.802868Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:11.802881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:11.802898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:11.802923Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602910234868638:12694]
2025-10-10T14:40:11.802927Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602910234868638:12694]
2025-10-10T14:40:11.802929Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602910234868638:12694]
2025-10-10T14:40:11.802948Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:11.802955Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:11.802958Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:11.802960Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:11.802969Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:11.802990Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:11.802999Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:11.803010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602911017121910:2438], now have 1 active actors on pipe
2025-10-10T14:40:11.803027Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3225
2025-10-10T14:40:11.803056Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602910234868638:12694]
2025-10-10T14:40:11.803068Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:11.803081Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:11.804996Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a5362f13-b2106183-debf7b95-83e93699_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:11.805063Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:11.805076Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3226
2025-10-10T14:40:11.805252Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3226 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:11.805287Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3226 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:11.805297Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3226 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:11.805302Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:11.805843Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3226 sessionId:  describe result for acl check
2025-10-10T14:40:11.805883Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:11.805885Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:11.805887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:11.805894Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602911017121946:2436] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:11.806479Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602911017121946:2436] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:11.811087Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602911017121946:2436] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:11.816106Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602911017121946:2436] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:11.816135Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602911017121946:2436] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:11.816139Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602911017121946:2436] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:11.816149Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3226 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:11.816552Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3225
2025-10-10T14:40:11.823789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602911017121977:2436], now have 1 active actors on pipe
2025-10-10T14:40:11.823835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:11.823843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:11.823869Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:40:11.823879Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:11.823889Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602910234868638:12694]
2025-10-10T14:40:11.823941Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:40:11.823948Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|16ff49df-e5bcacc4-a73e9baa-84af1b00_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:11.823963Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:11.823969Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:11.823972Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:11.823988Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:11.824013Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:11.824034Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:40:11.824225Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:40:11.824401Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:11.824546Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:11.824694Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:11.824890Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:40:11.824940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:11.824964Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:40:11.825624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:11.825636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:11.825663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:11.825763Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3226 partition: 0 MaxSeqNo: 40 sessionId: src_id|16ff49df-e5bcacc4-a73e9baa-84af1b00_0
2025-10-10T14:40:11.826224Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a5362f13-b2106183-debf7b95-83e93699_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|16ff49df-e5bcacc4-a73e9baa-84af1b00_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:11.829208Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|16ff49df-e5bcacc4-a73e9baa-84af1b00_0] Write session: try to update token
2025-10-10T14:40:11.829229Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|16ff49df-e5bcacc4-a73e9baa-84af1b00_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:11.842820Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:11.842841Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:11.842843Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:11.842847Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:11.842856Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602910234868638:12694]
2025-10-10T14:40:11.842860Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602910234868638:12694]
2025-10-10T14:40:11.842862Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602910234868638:12694]
2025-10-10T14:40:11.842904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:11.842910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:11.842910Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:11.842912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:11.842917Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:11.842922Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:11.843041Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:11.855002Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3226 sessionId: src_id|16ff49df-e5bcacc4-a73e9baa-84af1b00_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:11.857965Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:11.885272Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602911017121985:2851]
2025-10-10T14:40:11.885676Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 pipe creation result: OK TabletId: 72075186224037892 Generation: 3225, pipe: [1:7559602911017121985:2851]
2025-10-10T14:40:11.959017Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:11.959322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:11.959337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:11.959362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602911017121985:2851], now have 1 active actors on pipe
2025-10-10T14:40:11.959583Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:11.959710Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:40:11.959723Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 24 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602911017121985:2851]
2025-10-10T14:40:11.959725Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:40:11.959749Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:11.959802Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3226 reason: error at write: Disconnected sessionId: src_id|16ff49df-e5bcacc4-a73e9baa-84af1b00_0
2025-10-10T14:40:11.960055Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3226 sessionId: src_id|16ff49df-e5bcacc4-a73e9baa-84af1b00_0 is DEAD
2025-10-10T14:40:11.960214Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|16ff49df-e5bcacc4-a73e9baa-84af1b00_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:40:11.960225Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|16ff49df-e5bcacc4-a73e9baa-84af1b00_0] Write session will restart in 0.007998s
2025-10-10T14:40:11.960250Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|16ff49df-e5bcacc4-a73e9baa-84af1b00_0] Write session: Do CDS request
2025-10-10T14:40:11.960257Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|16ff49df-e5bcacc4-a73e9baa-84af1b00_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:11.968944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:11.969994Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|16ff49df-e5bcacc4-a73e9baa-84af1b00_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:11.970112Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:11.970137Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3227
2025-10-10T14:40:11.970306Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3227 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:11.970356Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3227 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:11.970367Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3227 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:11.970371Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:11.970629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:11.970846Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3227 sessionId:  describe result for acl check
2025-10-10T14:40:11.970852Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:11.970863Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:11.970876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:11.970887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:11.970903Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:11.970906Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:11.970912Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602911017122037:2411] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:11.970930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:11.970976Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602910234868713:12696]
2025-10-10T14:40:11.971464Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602911017122037:2411] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:11.971572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:11.971853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:11.971899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:11.972224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:11.972282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:11.972288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:11.972290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:11.972291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:11.972292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:11.972293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:11.972294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:11.972296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:11.972298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:11.972299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:11.972300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:11.972301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:11.972302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:11.972308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:11.972320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:11.972324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:11.972339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:11.972345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:11.972349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:11.972353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:11.972356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:11.972359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:11.972365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:11.972370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:11.972373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:11.972377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:11.972384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:11.972392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:11.972398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:11.972404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:11.972409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:11.972415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:11.972420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:11.972424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:11.972428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:11.972433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:11.972436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:11.972440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:11.972444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:11.972449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:11.972452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:11.972457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:11.972461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:11.972465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:11.972470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:11.972475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:11.972479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:11.972484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:11.972489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:11.972493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:11.972499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:11.972503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:11.972540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:11.973808Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602911017122037:2411] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:11.975206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:11.975682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:11.975697Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:11.975701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:11.975706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:11.975713Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3226 [2:7559602910234868713:12696]
2025-10-10T14:40:11.975726Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:11.975745Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:11.975753Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:11.975757Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:11.975759Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:11.975778Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:11.975793Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:11.975800Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:11.975872Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:11.975879Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:11.975883Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:11.975886Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:11.975957Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:11.975966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:11.975977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:11.975989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:11.976005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:11.976028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602911017122005:2438], now have 1 active actors on pipe
2025-10-10T14:40:11.976036Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602910234868708:12696]
2025-10-10T14:40:11.976038Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602910234868708:12696]
2025-10-10T14:40:11.976040Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602910234868708:12696]
2025-10-10T14:40:11.976054Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:11.976068Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:11.976068Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:11.976071Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:11.976074Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:11.976087Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:11.976090Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:11.976122Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602910234868708:12696]
2025-10-10T14:40:11.976136Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:11.976143Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:11.976082Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3226
2025-10-10T14:40:11.976831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602911017122037:2411] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:11.976846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602911017122037:2411] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:11.976849Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602911017122037:2411] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:11.976909Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3227 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:11.977118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602911017122072:2411], now have 1 active actors on pipe
2025-10-10T14:40:11.977219Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3226
2025-10-10T14:40:11.977285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:11.977298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:11.977342Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e9362229-def8a6f9-1d097363-af2969f5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:11.977357Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:11.977364Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:11.977366Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:11.977378Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:11.977393Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:11.977410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:11.977586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:11.977599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:11.977618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:11.977738Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3227 partition: 0 MaxSeqNo: 40 sessionId: src_id|e9362229-def8a6f9-1d097363-af2969f5_0
2025-10-10T14:40:11.978202Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|16ff49df-e5bcacc4-a73e9baa-84af1b00_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|e9362229-def8a6f9-1d097363-af2969f5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:11.981073Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e9362229-def8a6f9-1d097363-af2969f5_0] Write session: try to update token
2025-10-10T14:40:11.981097Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e9362229-def8a6f9-1d097363-af2969f5_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:11.988634Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:40:11.988661Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:11.988677Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602910234868708:12696]
2025-10-10T14:40:11.988733Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:40:11.988743Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:40:11.988976Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:40:11.989122Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:11.989271Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:11.989430Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:11.989638Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:40:11.989677Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:40:11.997675Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3227 sessionId: src_id|e9362229-def8a6f9-1d097363-af2969f5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:12.000590Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:12.000824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:12.000862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:12.000907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:40:12.001781Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:40:12.007307Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:12.007335Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:12.007339Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:12.007341Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:12.007354Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602910234868708:12696]
2025-10-10T14:40:12.007359Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602910234868708:12696]
2025-10-10T14:40:12.007364Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602910234868708:12696]
2025-10-10T14:40:12.007421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:12.007422Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:12.007430Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:12.007434Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:12.007435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:12.007439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:12.007585Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:12.061452Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602915312089371:2851]
2025-10-10T14:40:12.061946Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 pipe creation result: OK TabletId: 72075186224037892 Generation: 3226, pipe: [1:7559602915312089371:2851]
2025-10-10T14:40:12.128948Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:12.138327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:12.138369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:12.138572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:12.138656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:12.138724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:12.138791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:12.138845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:12.138849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:12.138930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:12.139003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:12.139077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:12.139351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:12.139396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:12.139400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:12.139477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:12.139547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:12.139615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:12.139684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:12.139730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:12.139733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:12.139814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:12.139884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:12.139950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:12.140021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:12.140067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:12.140070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:12.140151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:12.140258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:12.140320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:12.140403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:12.140475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:12.140479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:12.140555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:12.140622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:12.140691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:12.140758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:12.140810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:12.140814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:12.140901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:12.140965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:12.141040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:12.141137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:12.141738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:12.141764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:12.141847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:12.141925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:12.142006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:12.142086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:12.142145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:12.142154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:12.142235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:12.142305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:12.142381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:12.142459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:12.142514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:12.142523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:12.142603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:12.142672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:12.142745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:12.142820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:12.142874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:12.142883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:12.142962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602915312089371:2851], now have 1 active actors on pipe
2025-10-10T14:40:12.143179Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 25 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602915312089371:2851]
2025-10-10T14:40:12.143211Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:40:12.143216Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:40:12.143220Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:12.143263Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3227 reason: error at write: Disconnected sessionId: src_id|e9362229-def8a6f9-1d097363-af2969f5_0
2025-10-10T14:40:12.143491Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3227 sessionId: src_id|e9362229-def8a6f9-1d097363-af2969f5_0 is DEAD
2025-10-10T14:40:12.143601Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:12.143663Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9362229-def8a6f9-1d097363-af2969f5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:40:12.143676Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9362229-def8a6f9-1d097363-af2969f5_0] Write session will restart in 0.008468s
2025-10-10T14:40:12.143711Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9362229-def8a6f9-1d097363-af2969f5_0] Write session: Do CDS request
2025-10-10T14:40:12.143717Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9362229-def8a6f9-1d097363-af2969f5_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:12.153942Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e9362229-def8a6f9-1d097363-af2969f5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:12.154098Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:12.154120Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3228
2025-10-10T14:40:12.154288Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3228 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:12.154342Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3228 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:12.154354Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3228 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:12.154358Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:12.154813Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3228 sessionId:  describe result for acl check
2025-10-10T14:40:12.154853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:12.154855Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:12.154857Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:12.154865Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602915312089404:2403] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:12.155470Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602915312089404:2403] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:12.156513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:12.158911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:12.159165Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:12.159178Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:12.159190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:12.159256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:12.159305Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602914529836081:12698]
2025-10-10T14:40:12.159861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:12.159647Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602915312089404:2403] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:12.160284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:12.160367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:12.160709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:12.160774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:12.160783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:12.160784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:12.160785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:12.160786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:12.160788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:12.160789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:12.160790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:12.160792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:12.160793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:12.160794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:12.160795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:12.160796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:12.160803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:12.160816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:12.160820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:12.160823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:12.160825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:12.160828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:12.160830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:12.160832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:12.160834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:12.160837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:12.160839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:12.160841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:12.160843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:12.160849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:12.160854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:12.160859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:12.160862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:12.160865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:12.160868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:12.160874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:12.160878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:12.160881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:12.160884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:12.160887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:12.160890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:12.160893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:12.160897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:12.160899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:12.160903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:12.160905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:12.160909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:12.160911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:12.160914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:12.160917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:12.160920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:12.160923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:12.160926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:12.160930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:12.160933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:12.160955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:12.163782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:12.163666Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602915312089404:2403] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:12.163685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602915312089404:2403] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:12.163689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602915312089404:2403] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:12.163699Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3228 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:12.164260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:12.164273Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:12.164275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:12.164279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:12.164285Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3227 [2:7559602914529836081:12698]
2025-10-10T14:40:12.164299Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:12.164317Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:12.164696Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3227
2025-10-10T14:40:12.164701Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3227
2025-10-10T14:40:12.164320Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:12.164343Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:12.164347Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:12.164363Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:12.164371Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:12.164378Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:12.164445Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:12.164449Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:12.164451Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:12.164453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:12.164530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:12.164533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:12.164545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:12.164556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:12.164574Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:12.164596Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602914529836076:12698]
2025-10-10T14:40:12.164598Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602914529836076:12698]
2025-10-10T14:40:12.164600Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602914529836076:12698]
2025-10-10T14:40:12.164613Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:12.164629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602915312089440:2403], now have 1 active actors on pipe
2025-10-10T14:40:12.164632Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:12.164633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602915312089374:2438], now have 1 active actors on pipe
2025-10-10T14:40:12.164635Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:12.164637Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:12.164642Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:12.164658Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:12.164661Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:12.164689Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602914529836076:12698]
2025-10-10T14:40:12.164695Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:12.164703Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:12.165004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:12.165018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:12.165059Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4b27dc8d-41ff1b82-fb98bbc3-ebf258c6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:12.165072Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:12.165081Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:12.165083Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:12.165096Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:12.165107Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:12.165123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:12.165397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:12.165412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:12.165428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:12.165556Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3228 partition: 0 MaxSeqNo: 40 sessionId: src_id|4b27dc8d-41ff1b82-fb98bbc3-ebf258c6_0
2025-10-10T14:40:12.169642Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9362229-def8a6f9-1d097363-af2969f5_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|4b27dc8d-41ff1b82-fb98bbc3-ebf258c6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:12.172549Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4b27dc8d-41ff1b82-fb98bbc3-ebf258c6_0] Write session: try to update token
2025-10-10T14:40:12.172568Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4b27dc8d-41ff1b82-fb98bbc3-ebf258c6_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:12.188980Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:12.189002Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:12.189006Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:12.189008Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:12.189019Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602914529836076:12698]
2025-10-10T14:40:12.189026Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602914529836076:12698]
2025-10-10T14:40:12.189030Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602914529836076:12698]
2025-10-10T14:40:12.189086Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:12.189089Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:12.189096Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:12.189101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:12.189101Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:12.189103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:12.189248Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:12.193985Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3228 sessionId: src_id|4b27dc8d-41ff1b82-fb98bbc3-ebf258c6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:12.196817Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:12.243147Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602915312089461:2851]
2025-10-10T14:40:12.243544Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 pipe creation result: OK TabletId: 72075186224037892 Generation: 3227, pipe: [1:7559602915312089461:2851]
2025-10-10T14:40:12.316669Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:12.316974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:12.316989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:12.317036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602915312089461:2851], now have 1 active actors on pipe
2025-10-10T14:40:12.317274Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:12.317364Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 26 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602915312089461:2851]
2025-10-10T14:40:12.317387Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:40:12.317269Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:12.317475Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3228 reason: status is not ok: tablet will be restarted right now sessionId: src_id|4b27dc8d-41ff1b82-fb98bbc3-ebf258c6_0
2025-10-10T14:40:12.317702Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3228 sessionId: src_id|4b27dc8d-41ff1b82-fb98bbc3-ebf258c6_0 is DEAD
2025-10-10T14:40:12.317941Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b27dc8d-41ff1b82-fb98bbc3-ebf258c6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:40:12.317952Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b27dc8d-41ff1b82-fb98bbc3-ebf258c6_0] Write session will restart in 0.009739s
2025-10-10T14:40:12.317978Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b27dc8d-41ff1b82-fb98bbc3-ebf258c6_0] Write session: Do CDS request
2025-10-10T14:40:12.317984Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b27dc8d-41ff1b82-fb98bbc3-ebf258c6_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:12.328976Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4b27dc8d-41ff1b82-fb98bbc3-ebf258c6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:12.329144Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:12.329167Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3229
2025-10-10T14:40:12.329322Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3229 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:12.329384Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3229 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:12.329391Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3229 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:12.329395Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:12.329947Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3229 sessionId:  describe result for acl check
2025-10-10T14:40:12.329990Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:12.329997Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:12.329999Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:12.330006Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602915312089508:2358] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:12.331004Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602915312089508:2358] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:12.332417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:12.333089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:12.333342Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:12.333357Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:12.333372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:12.333449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:12.333497Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602914529836193:12714]
2025-10-10T14:40:12.333852Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602915312089508:2358] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:12.334158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:12.334485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:12.334558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:12.334927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:12.334999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:12.335007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:12.335008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:12.335009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:12.335010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:12.335012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:12.335013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:12.335014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:12.335016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:12.335017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:12.335018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:12.335019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:12.335021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:12.335028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:12.335041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:12.335046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:12.335051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:12.335055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:12.335059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:12.335066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:12.335070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:12.335074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:12.335078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:12.335083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:12.335087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:12.335092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:12.335100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:12.335110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:12.335122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:12.335129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:12.335133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:12.335138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:12.335147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:12.335152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:12.335159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:12.335164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:12.335168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:12.335179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:12.335189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:12.335195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:12.335204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:12.335210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:12.335219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:12.335225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:12.335234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:12.335240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:12.335245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:12.335250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:12.335254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:12.335259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:12.335270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:12.335276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:12.335332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:12.338277Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602915312089508:2358] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:12.338294Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602915312089508:2358] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:12.338297Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602915312089508:2358] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:12.338305Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3229 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:12.339139Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3228
2025-10-10T14:40:12.339143Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3228
2025-10-10T14:40:12.338333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:12.338777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:12.338782Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:12.338785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:12.338791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:12.338797Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3228 [2:7559602914529836193:12714]
2025-10-10T14:40:12.338811Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:12.338830Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:12.338833Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:12.338837Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:12.338840Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:12.338858Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:12.338866Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:12.338874Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:12.338930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:12.338933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:12.338935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:12.338939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:12.339012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:12.339015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:12.339029Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:12.339043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:12.339062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:12.339085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602915312089474:2438], now have 1 active actors on pipe
2025-10-10T14:40:12.339089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602915312089542:2358], now have 1 active actors on pipe
2025-10-10T14:40:12.339098Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602914529836188:12714]
2025-10-10T14:40:12.339101Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602914529836188:12714]
2025-10-10T14:40:12.339103Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602914529836188:12714]
2025-10-10T14:40:12.339119Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:12.339138Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:12.339152Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:12.339154Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:12.339156Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:12.339157Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:12.339160Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:12.339197Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602914529836188:12714]
2025-10-10T14:40:12.339200Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:12.339202Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:12.339220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:12.339225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:12.339276Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|141e1d61-e5b3e238-d039c686-dc98c35b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:12.339284Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:12.339288Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:12.339291Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:12.339304Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:12.339315Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:12.339338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:12.339625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:12.339634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:12.339649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:12.339791Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3229 partition: 0 MaxSeqNo: 40 sessionId: src_id|141e1d61-e5b3e238-d039c686-dc98c35b_0
2025-10-10T14:40:12.340394Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b27dc8d-41ff1b82-fb98bbc3-ebf258c6_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|141e1d61-e5b3e238-d039c686-dc98c35b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:12.343233Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|141e1d61-e5b3e238-d039c686-dc98c35b_0] Write session: try to update token
2025-10-10T14:40:12.343256Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|141e1d61-e5b3e238-d039c686-dc98c35b_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:12.359303Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3229 sessionId: src_id|141e1d61-e5b3e238-d039c686-dc98c35b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:12.359779Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:12.359803Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:12.359809Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:12.359811Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:12.359820Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602914529836188:12714]
2025-10-10T14:40:12.359825Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602914529836188:12714]
2025-10-10T14:40:12.359828Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602914529836188:12714]
2025-10-10T14:40:12.359880Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:12.359880Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:12.359890Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:12.359894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:12.359894Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:12.359897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:12.360047Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:12.362096Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:12.417780Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602915312089550:2851]
2025-10-10T14:40:12.418138Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 pipe creation result: OK TabletId: 72075186224037892 Generation: 3228, pipe: [1:7559602915312089550:2851]
2025-10-10T14:40:12.479507Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:12.479935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:12.479953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:12.480004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602915312089550:2851], now have 1 active actors on pipe
2025-10-10T14:40:12.481368Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:40:12.481389Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:40:12.481456Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3229 reason: error at write: Disconnected sessionId: src_id|141e1d61-e5b3e238-d039c686-dc98c35b_0
2025-10-10T14:40:12.481688Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3229 sessionId: src_id|141e1d61-e5b3e238-d039c686-dc98c35b_0 is DEAD
2025-10-10T14:40:12.481854Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:12.481914Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 27 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602915312089550:2851]
2025-10-10T14:40:12.482163Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|141e1d61-e5b3e238-d039c686-dc98c35b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:40:12.482171Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|141e1d61-e5b3e238-d039c686-dc98c35b_0] Write session will restart in 0.009721s
2025-10-10T14:40:12.482196Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|141e1d61-e5b3e238-d039c686-dc98c35b_0] Write session: Do CDS request
2025-10-10T14:40:12.482202Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|141e1d61-e5b3e238-d039c686-dc98c35b_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:12.484570Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:12.490587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:12.492480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:12.492736Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:12.492749Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:12.492762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:12.492818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:12.492867Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602914529836265:12716]
2025-10-10T14:40:12.492919Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|141e1d61-e5b3e238-d039c686-dc98c35b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:12.493275Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:12.493301Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3230
2025-10-10T14:40:12.493475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:12.493461Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3230 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:12.493497Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3230 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:12.493503Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3230 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:12.493507Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:12.493869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:12.493938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:12.493936Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3230 sessionId:  describe result for acl check
2025-10-10T14:40:12.493976Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:12.493978Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:12.493983Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:12.493988Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602915312089590:2361] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:12.494297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:12.494362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:12.494368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:12.494369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:12.494371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:12.494372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:12.494374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:12.494376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:12.494378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:12.494380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:12.494381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:12.494385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:12.494386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:12.494387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:12.494393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:12.494406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:12.494411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:12.494415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:12.494420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:12.494424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:12.494429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:12.494434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:12.494438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:12.494444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:12.494448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:12.494452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:12.494456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:12.494464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:12.494475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:12.494487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:12.494493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:12.494498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:12.494504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:12.494509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:12.494514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:12.494519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:12.494526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:12.494530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:12.494536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:12.494548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:12.494555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:12.494560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:12.494566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:12.494571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:12.494577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:12.494581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:12.494586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:12.494591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:12.494596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:12.494601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:12.494614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:12.494618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:12.494624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:12.494666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:12.494568Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602915312089590:2361] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:12.497368Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602915312089590:2361] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:12.498173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:12.498558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:12.498579Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:12.498581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:12.498585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:12.498592Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3229 [2:7559602914529836265:12716]
2025-10-10T14:40:12.498605Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:12.498623Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:12.498626Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:12.498632Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:12.498635Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:12.498654Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:12.498667Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:12.498674Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:12.498740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:12.498747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:12.498748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:12.498751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:12.498833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:12.498841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:12.498853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:12.498872Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:12.498893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:12.498920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602915312089552:2438], now have 1 active actors on pipe
2025-10-10T14:40:12.498934Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602914529836260:12716]
2025-10-10T14:40:12.498940Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602914529836260:12716]
2025-10-10T14:40:12.498942Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602914529836260:12716]
2025-10-10T14:40:12.498955Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:12.498974Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:12.498978Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:12.498982Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:12.498985Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:12.498993Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:12.498996Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:12.499030Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602914529836260:12716]
2025-10-10T14:40:12.499041Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:12.499048Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:12.499043Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3229
2025-10-10T14:40:12.505037Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602915312089590:2361] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:12.505059Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602915312089590:2361] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:12.505063Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602915312089590:2361] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:12.505072Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3230 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:12.505375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602915312089625:2361], now have 1 active actors on pipe
2025-10-10T14:40:12.505702Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3229
2025-10-10T14:40:12.505788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:12.505805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:12.505843Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|58041b85-a3eeedf9-615ae43a-4c622ee3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:12.505858Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:12.505865Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:12.505868Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:12.505883Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:12.505904Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:12.506428Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3230 partition: 0 MaxSeqNo: 40 sessionId: src_id|58041b85-a3eeedf9-615ae43a-4c622ee3_0
2025-10-10T14:40:12.505928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:12.506198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:12.506206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:12.506222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:12.507017Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|141e1d61-e5b3e238-d039c686-dc98c35b_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|58041b85-a3eeedf9-615ae43a-4c622ee3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:12.510100Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|58041b85-a3eeedf9-615ae43a-4c622ee3_0] Write session: try to update token
2025-10-10T14:40:12.510124Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|58041b85-a3eeedf9-615ae43a-4c622ee3_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:12.518129Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:40:12.518140Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:12.518150Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602914529836260:12716]
2025-10-10T14:40:12.518198Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:40:12.518202Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:40:12.518388Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:40:12.518548Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:12.518706Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:12.518863Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:12.519079Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:40:12.519126Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:40:12.533675Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3230 sessionId: src_id|58041b85-a3eeedf9-615ae43a-4c622ee3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:12.534773Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:12.534790Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:12.534794Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:12.534795Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:12.534806Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602914529836260:12716]
2025-10-10T14:40:12.534813Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602914529836260:12716]
2025-10-10T14:40:12.534817Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602914529836260:12716]
2025-10-10T14:40:12.534869Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:12.534877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:12.534880Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:12.535031Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:12.535222Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:12.535236Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:12.535241Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:12.536515Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:12.582094Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602915312089629:2851]
2025-10-10T14:40:12.582446Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 pipe creation result: OK TabletId: 72075186224037892 Generation: 3229, pipe: [1:7559602915312089629:2851]
2025-10-10T14:40:12.658172Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:12.658631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:12.658652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:12.658680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602915312089629:2851], now have 1 active actors on pipe
2025-10-10T14:40:12.658914Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:12.658972Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:12.659000Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 28 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602915312089629:2851]
2025-10-10T14:40:12.659028Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:40:12.659124Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3230 reason: status is not ok: tablet will be restarted right now sessionId: src_id|58041b85-a3eeedf9-615ae43a-4c622ee3_0
2025-10-10T14:40:12.659343Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3230 sessionId: src_id|58041b85-a3eeedf9-615ae43a-4c622ee3_0 is DEAD
2025-10-10T14:40:12.659524Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58041b85-a3eeedf9-615ae43a-4c622ee3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:40:12.659535Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58041b85-a3eeedf9-615ae43a-4c622ee3_0] Write session will restart in 0.006938s
2025-10-10T14:40:12.659560Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58041b85-a3eeedf9-615ae43a-4c622ee3_0] Write session: Do CDS request
2025-10-10T14:40:12.659567Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58041b85-a3eeedf9-615ae43a-4c622ee3_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:12.667971Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|58041b85-a3eeedf9-615ae43a-4c622ee3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:12.668074Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:12.668094Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3231
2025-10-10T14:40:12.668271Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3231 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:12.668309Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3231 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:12.668340Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3231 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:12.668349Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:12.668801Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3231 sessionId:  describe result for acl check
2025-10-10T14:40:12.668837Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:12.668845Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:12.668847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:12.668862Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602915312089666:2333] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:12.669481Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602915312089666:2333] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:12.669759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:12.671496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:12.671735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602915312089666:2333] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:12.671800Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:12.671810Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:12.671822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:12.671882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:12.671923Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602914529836340:12718]
2025-10-10T14:40:12.672638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:12.672955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:12.672992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:12.673348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:12.673400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:12.673406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:12.673408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:12.673409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:12.673410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:12.673412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:12.673413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:12.673415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:12.673416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:12.673417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:12.673419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:12.673420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:12.673421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:12.673427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:12.673440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:12.673445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:12.673449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:12.673453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:12.673458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:12.673463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:12.673467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:12.673472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:12.673477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:12.673481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:12.673485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:12.673488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:12.673495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:12.673504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:12.673511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:12.673517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:12.673523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:12.673532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:12.673537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:12.673542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:12.673551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:12.673557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:12.673562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:12.673568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:12.673578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:12.673583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:12.673591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:12.673596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:12.673602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:12.673611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:12.673616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:12.673620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:12.673629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:12.673634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:12.673639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:12.673648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:12.673653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:12.673663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:12.673702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:12.676435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:12.676767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:12.676778Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:12.676780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:12.676784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:12.676790Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3230 [2:7559602914529836340:12718]
2025-10-10T14:40:12.676803Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:12.676823Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:12.676831Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:12.676835Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:12.676838Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:12.676855Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:12.676862Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:12.676869Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:12.676927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:12.676934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:12.676936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:12.676939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:12.677009Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:12.677020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:12.677031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:12.677057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:12.677082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:12.677103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602915312089631:2438], now have 1 active actors on pipe
2025-10-10T14:40:12.677112Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602914529836334:12718]
2025-10-10T14:40:12.677115Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602914529836334:12718]
2025-10-10T14:40:12.677117Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602914529836334:12718]
2025-10-10T14:40:12.677132Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:12.677146Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:12.677163Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:12.677167Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:12.677190Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602914529836334:12718]
2025-10-10T14:40:12.677198Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:12.677216Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:12.677223Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:12.677225Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:12.677233Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:12.677172Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3230
2025-10-10T14:40:12.682538Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602915312089666:2333] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:12.682557Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602915312089666:2333] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:12.682561Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602915312089666:2333] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:12.682572Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3231 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:12.682835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602915312089705:2333], now have 1 active actors on pipe
2025-10-10T14:40:12.682924Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3230
2025-10-10T14:40:12.683091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:12.683102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:12.683135Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|82ed37ab-bcbdaff3-47a53b99-58300935_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:12.683146Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:12.683152Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:12.683155Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:12.683168Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:12.683187Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:12.683205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:12.683438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:12.683444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:12.683459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:12.683594Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3231 partition: 0 MaxSeqNo: 40 sessionId: src_id|82ed37ab-bcbdaff3-47a53b99-58300935_0
2025-10-10T14:40:12.684140Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58041b85-a3eeedf9-615ae43a-4c622ee3_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|82ed37ab-bcbdaff3-47a53b99-58300935_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:12.687047Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|82ed37ab-bcbdaff3-47a53b99-58300935_0] Write session: try to update token
2025-10-10T14:40:12.687068Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|82ed37ab-bcbdaff3-47a53b99-58300935_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:12.702240Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:12.702256Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:12.702259Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:12.702261Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:12.702271Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602914529836334:12718]
2025-10-10T14:40:12.702277Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602914529836334:12718]
2025-10-10T14:40:12.702280Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602914529836334:12718]
2025-10-10T14:40:12.702332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:12.702340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:12.702343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:12.702474Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:12.705441Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:12.705450Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:12.705454Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:12.717658Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3231 sessionId: src_id|82ed37ab-bcbdaff3-47a53b99-58300935_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:12.720535Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:12.759305Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602915312089709:2851]
2025-10-10T14:40:12.759707Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 pipe creation result: OK TabletId: 72075186224037892 Generation: 3230, pipe: [1:7559602915312089709:2851]
2025-10-10T14:40:12.841596Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:12.842016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:12.842033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:12.842060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602915312089709:2851], now have 1 active actors on pipe
2025-10-10T14:40:12.842560Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:12.842996Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:40:12.843013Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:40:12.843088Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3231 reason: error at write: Disconnected sessionId: src_id|82ed37ab-bcbdaff3-47a53b99-58300935_0
2025-10-10T14:40:12.843195Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:12.843242Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 29 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602915312089709:2851]
2025-10-10T14:40:12.843307Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3231 sessionId: src_id|82ed37ab-bcbdaff3-47a53b99-58300935_0 is DEAD
2025-10-10T14:40:12.843792Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82ed37ab-bcbdaff3-47a53b99-58300935_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:40:12.843814Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82ed37ab-bcbdaff3-47a53b99-58300935_0] Write session will restart in 0.009752s
2025-10-10T14:40:12.843840Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82ed37ab-bcbdaff3-47a53b99-58300935_0] Write session: Do CDS request
2025-10-10T14:40:12.843849Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82ed37ab-bcbdaff3-47a53b99-58300935_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:12.853643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:12.854997Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|82ed37ab-bcbdaff3-47a53b99-58300935_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:12.855134Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:12.855153Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3232
2025-10-10T14:40:12.855320Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3232 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:12.855368Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3232 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:12.855379Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3232 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:12.855383Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:12.855383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:12.855617Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:12.855629Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:12.855642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:12.855702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:12.855749Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602914529836427:12721]
2025-10-10T14:40:12.855819Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3232 sessionId:  describe result for acl check
2025-10-10T14:40:12.855854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:12.855862Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:12.855865Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:12.855890Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602915312089752:8197] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:12.856424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:12.856495Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602915312089752:8197] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:12.856985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:12.857041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:12.857421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:12.857486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:12.857487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:12.857489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:12.857490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:12.857492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:12.857493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:12.857495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:12.857496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:12.857500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:12.857501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:12.857503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:12.857504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:12.857505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:12.857513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:12.857525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:12.857530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:12.857534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:12.857538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:12.857543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:12.857548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:12.857552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:12.857570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:12.857574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:12.857578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:12.857583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:12.857587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:12.857594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:12.857604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:12.857611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:12.857618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:12.857623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:12.857629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:12.857633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:12.857639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:12.857644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:12.857649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:12.857654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:12.857660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:12.857665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:12.857672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:12.857680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:12.857686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:12.857691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:12.857696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:12.857701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:12.857706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:12.857711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:12.857718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:12.857724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:12.857729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:12.857733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:12.857738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:12.857781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:12.859465Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602915312089752:8197] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:12.860728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:12.861259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:12.861274Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:12.861286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:12.861290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:12.861296Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3231 [2:7559602914529836427:12721]
2025-10-10T14:40:12.861310Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:12.861327Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:12.861347Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:12.861352Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:12.861356Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:12.861373Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:12.861381Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:12.861388Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:12.861451Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:12.861452Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:12.861454Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:12.861457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:12.861527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:12.861530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:12.861542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:12.861554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:12.861570Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:12.861592Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602914529836421:12721]
2025-10-10T14:40:12.861594Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602914529836421:12721]
2025-10-10T14:40:12.861596Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602914529836421:12721]
2025-10-10T14:40:12.861610Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:12.861624Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:12.861640Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:12.861643Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:12.861669Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602914529836421:12721]
2025-10-10T14:40:12.861672Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:12.861759Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:12.861772Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:12.861775Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:12.861781Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:12.861986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602915312089712:2438], now have 1 active actors on pipe
2025-10-10T14:40:12.862170Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3231
2025-10-10T14:40:12.869905Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602915312089752:8197] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:12.869927Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602915312089752:8197] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:12.869931Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602915312089752:8197] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:12.869942Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3232 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:12.870494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602915312089790:8197], now have 1 active actors on pipe
2025-10-10T14:40:12.870542Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3231
2025-10-10T14:40:12.870598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:12.870612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:12.870652Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2215b183-edfe5ac8-5a703081-5f57de29_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:12.870684Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:12.870694Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:12.870697Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:12.870712Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:12.870731Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:12.870757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:12.871016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:12.871024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:12.871042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:12.871160Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3232 partition: 0 MaxSeqNo: 40 sessionId: src_id|2215b183-edfe5ac8-5a703081-5f57de29_0
2025-10-10T14:40:12.871580Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82ed37ab-bcbdaff3-47a53b99-58300935_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|2215b183-edfe5ac8-5a703081-5f57de29_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:12.874444Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2215b183-edfe5ac8-5a703081-5f57de29_0] Write session: try to update token
2025-10-10T14:40:12.874465Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2215b183-edfe5ac8-5a703081-5f57de29_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:12.884093Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:12.884113Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:12.884117Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:12.884119Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:12.884132Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602914529836421:12721]
2025-10-10T14:40:12.884140Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602914529836421:12721]
2025-10-10T14:40:12.884144Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602914529836421:12721]
2025-10-10T14:40:12.884196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:12.884204Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:12.884207Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:12.884214Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:12.884221Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:12.884226Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:12.884363Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:12.897240Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3232 sessionId: src_id|2215b183-edfe5ac8-5a703081-5f57de29_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:12.900102Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:12.943586Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602915312089811:2851]
2025-10-10T14:40:12.944062Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 pipe creation result: OK TabletId: 72075186224037892 Generation: 3231, pipe: [1:7559602915312089811:2851]
2025-10-10T14:40:13.007610Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:13.007946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:13.007966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:13.007991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602915312089811:2851], now have 1 active actors on pipe
2025-10-10T14:40:13.008258Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:13.008836Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2215b183-edfe5ac8-5a703081-5f57de29_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:40:13.008848Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2215b183-edfe5ac8-5a703081-5f57de29_0] Write session will restart in 0.009345s
2025-10-10T14:40:13.008874Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2215b183-edfe5ac8-5a703081-5f57de29_0] Write session: Do CDS request
2025-10-10T14:40:13.008882Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2215b183-edfe5ac8-5a703081-5f57de29_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:13.008387Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 30 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602915312089811:2851]
2025-10-10T14:40:13.008390Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:40:13.008419Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:13.008466Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3232 reason: status is not ok: tablet will be restarted right now sessionId: src_id|2215b183-edfe5ac8-5a703081-5f57de29_0
2025-10-10T14:40:13.008681Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3232 sessionId: src_id|2215b183-edfe5ac8-5a703081-5f57de29_0 is DEAD
2025-10-10T14:40:13.017215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:13.018980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:13.019214Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:13.019231Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:13.019244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:13.019305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:13.019370Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602918824803798:12723]
2025-10-10T14:40:13.019977Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2215b183-edfe5ac8-5a703081-5f57de29_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:13.020032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:13.020395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:13.020445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:13.020777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:13.020852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:13.020860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:13.020861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:13.020862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:13.020864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:13.020865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:13.020866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:13.020868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:13.020869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:13.020870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:13.020871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:13.020873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:13.020874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:13.020881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:13.020894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:13.020899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:13.020903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:13.020908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:13.020912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:13.020917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:13.020921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:13.020925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:13.020929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:13.020933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:13.020937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:13.020941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:13.020949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:13.020958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:13.020965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:13.020971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:13.020976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:13.020982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:13.020987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:13.020992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:13.020999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:13.021005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:13.021009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:13.021015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:13.021020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:13.021026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:13.021030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:13.021036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:13.021041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:13.021047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:13.021052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:13.021057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:13.021061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:13.021067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:13.021073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:13.021077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:13.021081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:13.021086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:13.021127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:13.021470Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:13.021489Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3233
2025-10-10T14:40:13.024050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:13.024518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:13.024531Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:13.024533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:13.024537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:13.024543Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3232 [2:7559602918824803798:12723]
2025-10-10T14:40:13.024556Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:13.024575Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:13.024580Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:13.024584Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:13.024587Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:13.024605Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:13.024612Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:13.024622Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:13.024691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:13.024698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:13.024700Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:13.024703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:13.024778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:13.024786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:13.024799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:13.024818Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:13.024838Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:13.024862Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602918824803793:12723]
2025-10-10T14:40:13.024870Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602918824803793:12723]
2025-10-10T14:40:13.024872Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602918824803793:12723]
2025-10-10T14:40:13.024886Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:13.024903Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:13.024905Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:13.024907Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:13.024909Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:13.024922Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:13.024936Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:13.024971Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602918824803793:12723]
2025-10-10T14:40:13.024979Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:13.024986Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:13.025006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602919607057108:2438], now have 1 active actors on pipe
2025-10-10T14:40:13.021639Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3233 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:13.021713Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3233 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:13.021720Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3233 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:13.021724Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:13.022230Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3233 sessionId:  describe result for acl check
2025-10-10T14:40:13.022263Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:13.022265Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:13.022267Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:13.022273Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602919607057151:8200] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:13.022876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602919607057151:8200] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:13.025093Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3232
2025-10-10T14:40:13.025158Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602919607057151:8200] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:13.031001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602919607057184:8200], now have 1 active actors on pipe
2025-10-10T14:40:13.031157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:13.031174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:13.031228Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|927ef7b6-4f40bee7-4fd08de8-62a0053d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:13.031246Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:13.031257Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:13.031262Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:13.031288Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:13.031315Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:13.031353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:13.031562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:13.031572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:13.031592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:13.032142Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2215b183-edfe5ac8-5a703081-5f57de29_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|927ef7b6-4f40bee7-4fd08de8-62a0053d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:13.030508Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602919607057151:8200] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:13.030532Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602919607057151:8200] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:13.030536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602919607057151:8200] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:13.030546Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3233 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:13.031072Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3232
2025-10-10T14:40:13.031667Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3233 partition: 0 MaxSeqNo: 40 sessionId: src_id|927ef7b6-4f40bee7-4fd08de8-62a0053d_0
2025-10-10T14:40:13.035221Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|927ef7b6-4f40bee7-4fd08de8-62a0053d_0] Write session: try to update token
2025-10-10T14:40:13.035246Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|927ef7b6-4f40bee7-4fd08de8-62a0053d_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:13.045497Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:13.045514Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:13.045516Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:13.045518Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:13.045527Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602918824803793:12723]
2025-10-10T14:40:13.045533Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602918824803793:12723]
2025-10-10T14:40:13.045536Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602918824803793:12723]
2025-10-10T14:40:13.045578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:13.045584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:13.045586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:13.045591Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:13.045599Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:13.045605Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:13.045740Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:13.057647Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3233 sessionId: src_id|927ef7b6-4f40bee7-4fd08de8-62a0053d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:13.060421Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:13.108463Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602919607057188:2851]
2025-10-10T14:40:13.109553Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 pipe creation result: OK TabletId: 72075186224037892 Generation: 3232, pipe: [1:7559602919607057188:2851]
2025-10-10T14:40:13.172447Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:13.172826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:13.172842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:13.172867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602919607057188:2851], now have 1 active actors on pipe
2025-10-10T14:40:13.173120Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:13.173137Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:40:13.173155Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:40:13.173166Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 31 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602919607057188:2851]
2025-10-10T14:40:13.173189Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:13.173233Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3233 reason: error at write: Disconnected sessionId: src_id|927ef7b6-4f40bee7-4fd08de8-62a0053d_0
2025-10-10T14:40:13.173474Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3233 sessionId: src_id|927ef7b6-4f40bee7-4fd08de8-62a0053d_0 is DEAD
2025-10-10T14:40:13.177609Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|927ef7b6-4f40bee7-4fd08de8-62a0053d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:40:13.177627Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|927ef7b6-4f40bee7-4fd08de8-62a0053d_0] Write session will restart in 0.009757s
2025-10-10T14:40:13.177655Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|927ef7b6-4f40bee7-4fd08de8-62a0053d_0] Write session: Do CDS request
2025-10-10T14:40:13.177662Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|927ef7b6-4f40bee7-4fd08de8-62a0053d_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:13.187087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:13.188838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:13.189187Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:13.189206Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:13.189224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:13.189309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:13.189387Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602918824803876:12725]
2025-10-10T14:40:13.189878Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|927ef7b6-4f40bee7-4fd08de8-62a0053d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:13.189991Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:13.190010Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3234
2025-10-10T14:40:13.190120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:13.190442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:13.190479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:13.190723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:13.190768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:13.190774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:13.190774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:13.190777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:13.190778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:13.190779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:13.190779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:13.190780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:13.190781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:13.190781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:13.190782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:13.190783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:13.190783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:13.190789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:13.190797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:13.190800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:13.190803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:13.190805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:13.190808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:13.190812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:13.190815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:13.190819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:13.190824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:13.190828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:13.190832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:13.190836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:13.190844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:13.190850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:13.190854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:13.190858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:13.190860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:13.190864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:13.190868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:13.190874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:13.190880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:13.190885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:13.190889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:13.190894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:13.190899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:13.190906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:13.190911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:13.190916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:13.190923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:13.190927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:13.190931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:13.190935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:13.190939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:13.190944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:13.190949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:13.190954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:13.190962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:13.190966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:13.191010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:13.193656Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3234 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:13.193732Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3234 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:13.193739Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3234 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:13.193745Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:13.194238Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3234 sessionId:  describe result for acl check
2025-10-10T14:40:13.194273Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:13.194275Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:13.194279Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:13.194287Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602919607057234:8210] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:13.194917Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602919607057234:8210] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:13.196712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:13.197259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:13.197272Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:13.197275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:13.197279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:13.197286Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3233 [2:7559602918824803876:12725]
2025-10-10T14:40:13.197303Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:13.197349Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:13.197353Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:13.197357Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:13.197359Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:13.197379Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:13.197388Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:13.197403Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:13.197477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:13.197479Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:13.197481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:13.197484Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:13.197557Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:13.197569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:13.197583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:13.197599Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:13.197616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:13.197644Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602918824803871:12725]
2025-10-10T14:40:13.197653Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602918824803871:12725]
2025-10-10T14:40:13.197283Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602919607057234:8210] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:13.197655Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602918824803871:12725]
2025-10-10T14:40:13.197673Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:13.197689Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:13.197705Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:13.197708Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:13.197751Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602918824803871:12725]
2025-10-10T14:40:13.197762Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:13.197873Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:13.197881Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:13.197884Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:13.197898Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:13.198227Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3233
2025-10-10T14:40:13.198507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602919607057189:2438], now have 1 active actors on pipe
2025-10-10T14:40:13.203216Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602919607057234:8210] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:13.203237Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602919607057234:8210] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:13.203241Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602919607057234:8210] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:13.203251Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3234 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:13.203537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602919607057267:8210], now have 1 active actors on pipe
2025-10-10T14:40:13.203635Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3233
2025-10-10T14:40:13.203715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:13.203733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:13.203775Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|42cf680e-e4a42e75-fb0fa88f-34bac7d2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:13.203793Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:13.203801Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:13.203804Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:13.203819Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:13.203844Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:13.203890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:13.204129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:13.204142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:13.204167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:13.204271Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3234 partition: 0 MaxSeqNo: 40 sessionId: src_id|42cf680e-e4a42e75-fb0fa88f-34bac7d2_0
2025-10-10T14:40:13.204806Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|927ef7b6-4f40bee7-4fd08de8-62a0053d_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|42cf680e-e4a42e75-fb0fa88f-34bac7d2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:13.207713Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|42cf680e-e4a42e75-fb0fa88f-34bac7d2_0] Write session: try to update token
2025-10-10T14:40:13.207739Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|42cf680e-e4a42e75-fb0fa88f-34bac7d2_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:13.218696Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:13.218713Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:13.218717Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:13.218722Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:13.218732Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602918824803871:12725]
2025-10-10T14:40:13.218736Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602918824803871:12725]
2025-10-10T14:40:13.218740Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602918824803871:12725]
2025-10-10T14:40:13.218789Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:13.218790Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:13.218794Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:13.218799Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:13.218799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:13.218802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:13.219107Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:13.224989Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3234 sessionId: src_id|42cf680e-e4a42e75-fb0fa88f-34bac7d2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:13.227833Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:13.275733Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602919607057284:2851]
2025-10-10T14:40:13.281756Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 pipe creation result: OK TabletId: 72075186224037892 Generation: 3233, pipe: [1:7559602919607057284:2851]
2025-10-10T14:40:13.339322Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:13.339706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:13.339720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:13.339778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602919607057284:2851], now have 1 active actors on pipe
2025-10-10T14:40:13.340052Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:13.340034Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 32 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602919607057284:2851]
2025-10-10T14:40:13.340078Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:13.340115Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:40:13.340120Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:40:13.340196Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3234 reason: error at write: Disconnected sessionId: src_id|42cf680e-e4a42e75-fb0fa88f-34bac7d2_0
2025-10-10T14:40:13.340442Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3234 sessionId: src_id|42cf680e-e4a42e75-fb0fa88f-34bac7d2_0 is DEAD
2025-10-10T14:40:13.340992Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|42cf680e-e4a42e75-fb0fa88f-34bac7d2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:40:13.341004Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|42cf680e-e4a42e75-fb0fa88f-34bac7d2_0] Write session will restart in 0.005196s
2025-10-10T14:40:13.341032Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|42cf680e-e4a42e75-fb0fa88f-34bac7d2_0] Write session: Do CDS request
2025-10-10T14:40:13.341043Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|42cf680e-e4a42e75-fb0fa88f-34bac7d2_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:13.349919Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|42cf680e-e4a42e75-fb0fa88f-34bac7d2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:13.349980Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:13.350001Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3235
2025-10-10T14:40:13.350159Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3235 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:13.350197Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3235 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:13.350203Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3235 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:13.350207Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:13.350732Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3235 sessionId:  describe result for acl check
2025-10-10T14:40:13.350778Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:13.350785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:13.350788Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:13.350794Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602919607057331:8238] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:13.351381Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602919607057331:8238] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:13.351945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:13.354036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:13.354396Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:13.354404Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:13.354419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:13.354497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:13.354542Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602918824803987:12739]
2025-10-10T14:40:13.355121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:13.355476Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602919607057331:8238] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:13.355559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:13.355638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:13.356003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:13.356079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:13.356087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:13.356088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:13.356089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:13.356090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:13.356092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:13.356094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:13.356095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:13.356096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:13.356097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:13.356098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:13.356099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:13.356101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:13.356108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:13.356120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:13.356125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:13.356129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:13.356132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:13.356136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:13.356141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:13.356145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:13.356149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:13.356154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:13.356159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:13.356164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:13.356168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:13.356176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:13.356185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:13.356192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:13.356197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:13.356201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:13.356206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:13.356211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:13.356216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:13.356221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:13.356227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:13.356231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:13.356237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:13.356243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:13.356248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:13.356252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:13.356257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:13.356262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:13.356266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:13.356270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:13.356274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:13.356280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:13.356286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:13.356291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:13.356297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:13.356301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:13.356306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:13.356358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:13.358930Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602919607057331:8238] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:13.358949Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602919607057331:8238] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:13.358953Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602919607057331:8238] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:13.358962Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3235 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:13.359129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:13.359513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:13.359530Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:13.359533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:13.359537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:13.359543Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3234 [2:7559602918824803987:12739]
2025-10-10T14:40:13.359556Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:13.359574Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:13.359583Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:13.359588Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:13.359591Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:13.359608Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:13.359621Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:13.359633Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:13.359702Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:13.359709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:13.359712Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:13.359715Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:13.359794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:13.359802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:13.359814Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:13.359831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:13.359855Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:13.359885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602919607057288:2438], now have 1 active actors on pipe
2025-10-10T14:40:13.359894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602919607057368:8238], now have 1 active actors on pipe
2025-10-10T14:40:13.359901Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602918824803981:12739]
2025-10-10T14:40:13.359904Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602918824803981:12739]
2025-10-10T14:40:13.359906Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602918824803981:12739]
2025-10-10T14:40:13.359920Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:13.359932Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:13.359935Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:13.359937Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:13.359943Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3234
2025-10-10T14:40:13.359944Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:13.359968Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:13.359972Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:13.360011Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602918824803981:12739]
2025-10-10T14:40:13.359979Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3234
2025-10-10T14:40:13.360019Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:13.360035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:13.360046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:13.360045Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:13.360092Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9cc58b10-b2ed49e1-2fa80f4-d1e56036_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:13.360105Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:13.360109Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:13.360112Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:13.360125Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:13.360140Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:13.360168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:13.360384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:13.360396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:13.360421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:13.360583Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3235 partition: 0 MaxSeqNo: 40 sessionId: src_id|9cc58b10-b2ed49e1-2fa80f4-d1e56036_0
2025-10-10T14:40:13.361044Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|42cf680e-e4a42e75-fb0fa88f-34bac7d2_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|9cc58b10-b2ed49e1-2fa80f4-d1e56036_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:13.363876Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9cc58b10-b2ed49e1-2fa80f4-d1e56036_0] Write session: try to update token
2025-10-10T14:40:13.363899Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9cc58b10-b2ed49e1-2fa80f4-d1e56036_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:13.383652Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3235 sessionId: src_id|9cc58b10-b2ed49e1-2fa80f4-d1e56036_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:13.383960Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:13.383980Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:13.383984Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:13.383986Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:13.383996Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602918824803981:12739]
2025-10-10T14:40:13.384000Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602918824803981:12739]
2025-10-10T14:40:13.384004Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602918824803981:12739]
2025-10-10T14:40:13.384044Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:13.384051Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:13.384055Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:13.384057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:13.384065Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:13.384068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:13.384210Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:13.386456Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:13.440222Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602919607057376:2851]
2025-10-10T14:40:13.440616Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 pipe creation result: OK TabletId: 72075186224037892 Generation: 3234, pipe: [1:7559602919607057376:2851]
2025-10-10T14:40:13.507830Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:13.508265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:13.508276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:13.508339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602919607057376:2851], now have 1 active actors on pipe
2025-10-10T14:40:13.508792Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 33 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602919607057376:2851]
2025-10-10T14:40:13.508841Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:40:13.508844Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:40:13.508783Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:13.508917Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3235 reason: error at write: Disconnected sessionId: src_id|9cc58b10-b2ed49e1-2fa80f4-d1e56036_0
2025-10-10T14:40:13.509158Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3235 sessionId: src_id|9cc58b10-b2ed49e1-2fa80f4-d1e56036_0 is DEAD
2025-10-10T14:40:13.509636Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9cc58b10-b2ed49e1-2fa80f4-d1e56036_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:40:13.509238Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:13.509670Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9cc58b10-b2ed49e1-2fa80f4-d1e56036_0] Write session will restart in 0.008551s
2025-10-10T14:40:13.509701Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9cc58b10-b2ed49e1-2fa80f4-d1e56036_0] Write session: Do CDS request
2025-10-10T14:40:13.509709Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9cc58b10-b2ed49e1-2fa80f4-d1e56036_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:13.519928Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9cc58b10-b2ed49e1-2fa80f4-d1e56036_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:13.520103Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:13.520122Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3236
2025-10-10T14:40:13.520269Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3236 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:13.520304Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3236 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:13.520340Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3236 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:13.520345Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:13.520497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:13.520949Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3236 sessionId:  describe result for acl check
2025-10-10T14:40:13.520996Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:13.520998Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:13.520999Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:13.521006Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602919607057419:8252] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:13.521698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602919607057419:8252] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:13.522318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:13.522561Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:13.522585Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:13.522603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:13.522675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:13.522720Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602918824804073:12743]
2025-10-10T14:40:13.523356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:13.523670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:13.523721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:13.524442Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602919607057419:8252] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:13.524059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:13.524119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:13.524120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:13.524121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:13.524123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:13.524124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:13.524125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:13.524127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:13.524128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:13.524129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:13.524130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:13.524131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:13.524133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:13.524134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:13.524140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:13.524155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:13.524158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:13.524162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:13.524165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:13.524169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:13.524173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:13.524177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:13.524181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:13.524186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:13.524189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:13.524193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:13.524197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:13.524205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:13.524214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:13.524224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:13.524230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:13.524233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:13.524238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:13.524244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:13.524249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:13.524253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:13.524258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:13.524262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:13.524268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:13.524276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:13.524281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:13.524286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:13.524291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:13.524296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:13.524301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:13.524319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:13.524325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:13.524330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:13.524335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:13.524339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:13.524346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:13.524351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:13.524358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:13.524399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:13.527043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:13.527681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602919607057419:8252] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:13.527701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602919607057419:8252] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:13.527705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602919607057419:8252] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:13.527714Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3236 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:13.527946Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3235
2025-10-10T14:40:13.528282Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3235
2025-10-10T14:40:13.528770Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3236 partition: 0 MaxSeqNo: 40 sessionId: src_id|e90a0de8-fe4e762c-fcc79da2-d6d86919_0
2025-10-10T14:40:13.529169Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9cc58b10-b2ed49e1-2fa80f4-d1e56036_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|e90a0de8-fe4e762c-fcc79da2-d6d86919_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:13.527459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:13.527473Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:13.527475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:13.527479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:13.527488Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3235 [2:7559602918824804073:12743]
2025-10-10T14:40:13.527503Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:13.527524Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:13.527528Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:13.527532Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:13.527534Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:13.527552Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:13.527559Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:13.527566Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:13.527633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:13.527635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:13.527637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:13.527639Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:13.527717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:13.527720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:13.527732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:13.527745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:13.527761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:13.527784Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602918824804067:12743]
2025-10-10T14:40:13.527786Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602918824804067:12743]
2025-10-10T14:40:13.527799Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602918824804067:12743]
2025-10-10T14:40:13.527815Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:13.527832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602919607057378:2438], now have 1 active actors on pipe
2025-10-10T14:40:13.527841Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:13.527859Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:13.527865Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:13.527894Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602918824804067:12743]
2025-10-10T14:40:13.527900Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:13.527940Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:13.527944Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:13.527946Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:13.527953Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:13.528212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602919607057452:8252], now have 1 active actors on pipe
2025-10-10T14:40:13.528383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:13.528391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:13.528424Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e90a0de8-fe4e762c-fcc79da2-d6d86919_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:13.528434Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:13.528442Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:13.528445Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:13.528458Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:13.528471Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:13.528488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:13.528660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:13.528665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:13.528696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:13.531969Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e90a0de8-fe4e762c-fcc79da2-d6d86919_0] Write session: try to update token
2025-10-10T14:40:13.531988Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e90a0de8-fe4e762c-fcc79da2-d6d86919_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:13.550988Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:13.551006Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:13.551013Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:13.551016Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:13.551026Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602918824804067:12743]
2025-10-10T14:40:13.551031Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602918824804067:12743]
2025-10-10T14:40:13.551036Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602918824804067:12743]
2025-10-10T14:40:13.551091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:13.551102Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:13.551117Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:13.551142Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:13.551149Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:13.551154Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:13.551370Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:13.551479Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3236 sessionId: src_id|e90a0de8-fe4e762c-fcc79da2-d6d86919_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:13.554429Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:13.608660Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602919607057461:2851]
2025-10-10T14:40:13.609018Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 pipe creation result: OK TabletId: 72075186224037892 Generation: 3235, pipe: [1:7559602919607057461:2851]
2025-10-10T14:40:13.684740Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:13.685092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:13.685108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:13.685157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602919607057461:2851], now have 1 active actors on pipe
2025-10-10T14:40:13.685498Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:13.687142Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e90a0de8-fe4e762c-fcc79da2-d6d86919_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:40:13.687157Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e90a0de8-fe4e762c-fcc79da2-d6d86919_0] Write session will restart in 0.007854s
2025-10-10T14:40:13.687185Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e90a0de8-fe4e762c-fcc79da2-d6d86919_0] Write session: Do CDS request
2025-10-10T14:40:13.687189Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e90a0de8-fe4e762c-fcc79da2-d6d86919_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:13.686496Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:13.686705Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 34 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602919607057461:2851]
2025-10-10T14:40:13.686730Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:40:13.686817Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3236 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e90a0de8-fe4e762c-fcc79da2-d6d86919_0
2025-10-10T14:40:13.687012Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3236 sessionId: src_id|e90a0de8-fe4e762c-fcc79da2-d6d86919_0 is DEAD
2025-10-10T14:40:13.695918Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e90a0de8-fe4e762c-fcc79da2-d6d86919_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:13.697691Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:13.697712Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3237
2025-10-10T14:40:13.697882Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3237 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:13.697927Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3237 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:13.697939Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3237 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:13.697943Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:13.698412Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3237 sessionId:  describe result for acl check
2025-10-10T14:40:13.698446Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:13.698453Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:13.698455Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:13.698461Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602919607057476:8261] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:13.699030Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602919607057476:8261] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:13.702849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:13.702946Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602919607057476:8261] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:13.704545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:13.704790Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:13.704810Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:13.704822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:13.704878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:13.704926Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602918824804155:12745]
2025-10-10T14:40:13.705577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:13.705558Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602919607057476:8261] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:13.705575Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602919607057476:8261] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:13.705579Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602919607057476:8261] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:13.705588Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3237 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:13.705872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:13.705920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:13.706251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:13.706318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:13.706324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:13.706325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:13.706326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:13.706327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:13.706328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:13.706329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:13.706330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:13.706331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:13.706332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:13.706333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:13.706334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:13.706335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:13.706341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:13.706354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:13.706358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:13.706361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:13.706365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:13.706368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:13.706372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:13.706375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:13.706380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:13.706384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:13.706387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:13.706390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:13.706394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:13.706404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:13.706413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:13.706419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:13.706424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:13.706428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:13.706433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:13.706438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:13.706444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:13.706449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:13.706454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:13.706458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:13.706463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:13.706467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:13.706471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:13.706475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:13.706480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:13.706484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:13.706489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:13.706493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:13.706497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:13.706503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:13.706507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:13.706522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:13.706526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:13.706533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:13.706537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:13.706572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:13.709235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:13.709846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:13.709860Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:13.709862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:13.709872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:13.709879Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3236 [2:7559602918824804155:12745]
2025-10-10T14:40:13.709893Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:13.709923Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:13.709932Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:13.709937Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:13.709939Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:13.709957Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:13.709965Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:13.709973Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:13.710037Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:13.710044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:13.710047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:13.710049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:13.710122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:13.710131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:13.710143Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:13.710154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:13.710169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:13.710193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602919607057462:2438], now have 1 active actors on pipe
2025-10-10T14:40:13.710197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602919607057534:8261], now have 1 active actors on pipe
2025-10-10T14:40:13.710206Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602918824804150:12745]
2025-10-10T14:40:13.710208Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602918824804150:12745]
2025-10-10T14:40:13.710211Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602918824804150:12745]
2025-10-10T14:40:13.710228Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:13.710248Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:13.710262Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:13.710265Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:13.710300Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602918824804150:12745]
2025-10-10T14:40:13.710307Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:13.710416Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:13.710422Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:13.710425Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:13.710432Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:13.710533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:13.710547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:13.710584Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8741ae6e-b5eb5d90-3e0bbaf2-744b2b2f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:13.710599Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:13.710604Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:13.710606Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:13.710619Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:13.710636Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:13.710656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:13.710802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:13.710812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:13.710830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:13.711461Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e90a0de8-fe4e762c-fcc79da2-d6d86919_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|8741ae6e-b5eb5d90-3e0bbaf2-744b2b2f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:13.710254Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3236
2025-10-10T14:40:13.710265Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3236
2025-10-10T14:40:13.710931Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3237 partition: 0 MaxSeqNo: 40 sessionId: src_id|8741ae6e-b5eb5d90-3e0bbaf2-744b2b2f_0
2025-10-10T14:40:13.714384Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8741ae6e-b5eb5d90-3e0bbaf2-744b2b2f_0] Write session: try to update token
2025-10-10T14:40:13.714404Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8741ae6e-b5eb5d90-3e0bbaf2-744b2b2f_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:13.729903Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3237 sessionId: src_id|8741ae6e-b5eb5d90-3e0bbaf2-744b2b2f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:13.732829Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:13.733064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:13.733087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:13.733143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:40:13.733228Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:40:13.742015Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:13.742037Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:13.742040Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:13.742042Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:13.742052Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602918824804150:12745]
2025-10-10T14:40:13.742058Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602918824804150:12745]
2025-10-10T14:40:13.742061Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602918824804150:12745]
2025-10-10T14:40:13.742112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:13.742120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:13.742123Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:13.742261Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:13.743156Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:13.743172Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:13.743177Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:13.786318Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602919607057546:2851]
2025-10-10T14:40:13.786576Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 pipe creation result: OK TabletId: 72075186224037892 Generation: 3236, pipe: [1:7559602919607057546:2851]
2025-10-10T14:40:13.865214Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:13.874776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:13.874809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:13.875003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:13.875073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:13.875139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:13.875213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:13.875731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:13.875748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:13.875825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:13.875887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:13.875954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:13.876026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:13.876072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:13.876080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:13.876151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:13.876216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:13.876282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:13.876369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:13.876411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:13.876421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:13.876491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:13.876559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:13.876628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:13.876694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:13.876742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:13.876751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:13.876825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:13.876891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:13.876958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:13.877024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:13.877081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:13.877085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:13.877153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:13.877222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:13.877287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:13.877419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:13.877467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:13.877471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:13.877545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:13.877611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:13.877682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:13.877746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:13.877794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:13.877803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:13.877870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:13.877939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:13.878004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:13.878072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:13.878123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:13.878131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:13.878198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:13.878267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:13.878330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:13.878402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:13.878450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:13.878459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:13.878524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:13.878588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:13.878653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:13.878720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:13.878765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:13.878772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:13.878848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602919607057546:2851], now have 1 active actors on pipe
2025-10-10T14:40:13.879157Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:13.879210Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:40:13.879214Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:40:13.879226Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 35 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602919607057546:2851]
2025-10-10T14:40:13.879254Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3237 reason: error at write: Disconnected sessionId: src_id|8741ae6e-b5eb5d90-3e0bbaf2-744b2b2f_0
2025-10-10T14:40:13.879478Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:13.879513Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3237 sessionId: src_id|8741ae6e-b5eb5d90-3e0bbaf2-744b2b2f_0 is DEAD
2025-10-10T14:40:13.881651Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8741ae6e-b5eb5d90-3e0bbaf2-744b2b2f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:40:13.881663Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8741ae6e-b5eb5d90-3e0bbaf2-744b2b2f_0] Write session will restart in 0.008050s
2025-10-10T14:40:13.881691Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8741ae6e-b5eb5d90-3e0bbaf2-744b2b2f_0] Write session: Do CDS request
2025-10-10T14:40:13.881697Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8741ae6e-b5eb5d90-3e0bbaf2-744b2b2f_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:13.890859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:13.893075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:13.893316Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:13.893345Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:13.893362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:13.893441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:13.893491Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602918824804248:12748]
2025-10-10T14:40:13.893842Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8741ae6e-b5eb5d90-3e0bbaf2-744b2b2f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:13.893938Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:13.893958Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3238
2025-10-10T14:40:13.894105Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3238 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:13.894137Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3238 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:13.894149Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3238 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:13.894153Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:13.894207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:13.894566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:13.894594Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3238 sessionId:  describe result for acl check
2025-10-10T14:40:13.894620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:13.894634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:13.894642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:13.894647Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:13.894653Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602919607057601:8265] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:13.894992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:13.895062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:13.895068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:13.895069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:13.895070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:13.895072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:13.895073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:13.895074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:13.895075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:13.895077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:13.895078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:13.895080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:13.895081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:13.895082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:13.895089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:13.895101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:13.895105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:13.895110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:13.895114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:13.895118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:13.895122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:13.895126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:13.895130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:13.895135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:13.895139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:13.895143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:13.895147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:13.895157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:13.895165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:13.895173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:13.895178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:13.895183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:13.895188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:13.895193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:13.895198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:13.895204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:13.895209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:13.895213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:13.895219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:13.895224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:13.895229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:13.895234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:13.895240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:13.895244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:13.895250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:13.895255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:13.895261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:13.895266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:13.895272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:13.895276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:13.895282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:13.895286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:13.895291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:13.895366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:13.895647Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602919607057601:8265] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:13.897882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:13.898224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:13.898236Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:13.898239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:13.898259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:13.898270Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3237 [2:7559602918824804248:12748]
2025-10-10T14:40:13.898285Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:13.898303Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:13.898310Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:13.898314Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:13.898316Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:13.898333Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:13.898344Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:13.898351Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:13.898286Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602919607057601:8265] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:13.898415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:13.898422Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:13.898426Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:13.898428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:13.898497Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:13.898507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:13.898518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:13.898530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:13.898551Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:13.898576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602919607057554:2438], now have 1 active actors on pipe
2025-10-10T14:40:13.898589Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602918824804242:12748]
2025-10-10T14:40:13.898595Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602918824804242:12748]
2025-10-10T14:40:13.898597Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602918824804242:12748]
2025-10-10T14:40:13.898613Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:13.898627Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:13.898631Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:13.898634Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:13.898637Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:13.898656Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:13.898666Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:13.898690Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602918824804242:12748]
2025-10-10T14:40:13.898703Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:13.898737Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:13.898652Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3237
2025-10-10T14:40:13.903772Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602919607057601:8265] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:13.903789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602919607057601:8265] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:13.903792Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602919607057601:8265] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:13.903810Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3238 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:13.904270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602919607057636:8265], now have 1 active actors on pipe
2025-10-10T14:40:13.904394Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3237
2025-10-10T14:40:13.904485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:13.904500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:13.904534Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d4fa6072-a7d13cb1-d68b6f03-e6180964_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:13.904565Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:13.904573Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:13.904576Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:13.904592Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:13.904624Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:13.904649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:13.905018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:13.905028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:13.905059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:13.905178Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3238 partition: 0 MaxSeqNo: 40 sessionId: src_id|d4fa6072-a7d13cb1-d68b6f03-e6180964_0
2025-10-10T14:40:13.905578Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8741ae6e-b5eb5d90-3e0bbaf2-744b2b2f_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|d4fa6072-a7d13cb1-d68b6f03-e6180964_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:13.908349Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4fa6072-a7d13cb1-d68b6f03-e6180964_0] Write session: try to update token
2025-10-10T14:40:13.908368Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4fa6072-a7d13cb1-d68b6f03-e6180964_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:13.912085Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:40:13.912106Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:13.912116Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602918824804242:12748]
2025-10-10T14:40:13.912165Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:40:13.912358Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:40:13.912495Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:13.912646Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:13.912782Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:13.912970Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:40:13.913006Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:40:13.913237Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:40:13.922890Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3238 sessionId: src_id|d4fa6072-a7d13cb1-d68b6f03-e6180964_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:13.925745Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:13.926111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:13.926133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:13.926184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:40:13.926299Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:40:13.931070Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:13.931090Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:13.931093Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:13.931098Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:13.931109Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602918824804242:12748]
2025-10-10T14:40:13.931113Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602918824804242:12748]
2025-10-10T14:40:13.931116Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602918824804242:12748]
2025-10-10T14:40:13.931161Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:13.931167Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:13.931174Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:13.931175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:13.931178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:13.931179Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:13.931317Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:13.980913Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602919607057656:2851]
2025-10-10T14:40:13.981612Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 pipe creation result: OK TabletId: 72075186224037892 Generation: 3237, pipe: [1:7559602919607057656:2851]
2025-10-10T14:40:14.046953Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:14.056615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:14.056642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:14.056831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:14.056897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:14.056963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:14.057031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:14.057526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:14.057543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:14.057617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:14.057689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:14.057761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:14.057834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:14.057879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:14.057886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:14.057975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:14.058041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:14.058110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:14.058178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:14.058223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:14.058231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:14.058372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:14.058528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:14.058618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:14.058692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:14.058742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:14.058751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:14.058822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:14.058887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:14.058952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:14.059022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:14.059069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:14.059077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:14.059143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:14.059210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:14.059276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:14.059342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:14.059386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:14.059392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:14.059462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:14.059533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:14.059599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:14.059666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:14.059709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:14.059716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:14.059780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:14.059842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:14.059906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:14.059970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:14.060016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:14.060022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:14.060090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:14.060155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:14.060223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:14.060291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:14.060349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:14.060356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:14.060423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:14.060487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:14.060554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:14.060619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:14.060679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:14.060690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:14.060756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602919607057656:2851], now have 1 active actors on pipe
2025-10-10T14:40:14.061389Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:14.061386Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:40:14.061401Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:14.061405Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:40:14.061437Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3238 reason: error at write: Disconnected sessionId: src_id|d4fa6072-a7d13cb1-d68b6f03-e6180964_0
2025-10-10T14:40:14.061448Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 36 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602919607057656:2851]
2025-10-10T14:40:14.061729Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3238 sessionId: src_id|d4fa6072-a7d13cb1-d68b6f03-e6180964_0 is DEAD
2025-10-10T14:40:14.064366Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4fa6072-a7d13cb1-d68b6f03-e6180964_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:40:14.064379Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4fa6072-a7d13cb1-d68b6f03-e6180964_0] Write session will restart in 0.006097s
2025-10-10T14:40:14.064408Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4fa6072-a7d13cb1-d68b6f03-e6180964_0] Write session: Do CDS request
2025-10-10T14:40:14.064414Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4fa6072-a7d13cb1-d68b6f03-e6180964_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:14.073890Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4fa6072-a7d13cb1-d68b6f03-e6180964_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:14.073986Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:14.074007Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3239
2025-10-10T14:40:14.077629Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3239 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:14.077686Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3239 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:14.077693Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3239 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:14.077698Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:14.078236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:14.078363Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3239 sessionId:  describe result for acl check
2025-10-10T14:40:14.078408Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:14.078409Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:14.078411Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:14.078418Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602923902024998:8287] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:14.079417Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602923902024998:8287] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:14.082497Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602923902024998:8287] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:14.083161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:14.083428Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:14.083441Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:14.083455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:14.083527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:14.083567Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602923119771627:12750]
2025-10-10T14:40:14.084136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:14.084523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:14.084584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:14.084935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:14.084989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:14.084991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:14.084993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:14.084994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:14.084995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:14.084997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:14.084998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:14.085001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:14.085002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:14.085004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:14.085005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:14.085006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:14.085008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:14.085014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:14.085027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:14.085032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:14.085036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:14.085040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:14.085045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:14.085049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:14.085053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:14.085057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:14.085061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:14.085065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:14.085069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:14.085073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:14.085080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:14.085089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:14.085096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:14.085102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:14.085106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:14.085112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:14.085116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:14.085122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:14.085127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:14.085132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:14.085137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:14.085142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:14.085151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:14.085157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:14.085161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:14.085167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:14.085172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:14.085177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:14.085182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:14.085187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:14.085193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:14.085198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:14.085202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:14.085208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:14.085212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:14.085217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:14.085263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:14.086436Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602923902024998:8287] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:14.086454Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602923902024998:8287] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:14.086458Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602923902024998:8287] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:14.086468Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3239 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:14.088186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:14.088523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:14.088535Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:14.088538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:14.088542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:14.088549Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3238 [2:7559602923119771627:12750]
2025-10-10T14:40:14.088565Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:14.088591Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:14.088599Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:14.088602Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:14.088604Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:14.088621Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:14.088633Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:14.088645Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:14.088710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:14.088717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:14.088719Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:14.088721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:14.088898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:14.088906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:14.088918Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:14.088933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:14.088954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:14.088971Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3238
2025-10-10T14:40:14.088981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602923902024953:2438], now have 1 active actors on pipe
2025-10-10T14:40:14.088989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602923902025032:8287], now have 1 active actors on pipe
2025-10-10T14:40:14.088997Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602923119771621:12750]
2025-10-10T14:40:14.088999Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602923119771621:12750]
2025-10-10T14:40:14.089001Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602923119771621:12750]
2025-10-10T14:40:14.089009Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:14.089024Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:14.089004Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3238
2025-10-10T14:40:14.089041Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:14.089051Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:14.089079Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602923119771621:12750]
2025-10-10T14:40:14.089082Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:14.089219Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:14.089227Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:14.089229Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:14.089237Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:14.089454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:14.089467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:14.089498Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c8a91bb0-3d15e83a-512bc934-377ee6ac_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:14.089511Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:14.089515Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:14.089518Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:14.089533Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:14.089545Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:14.089569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:14.089727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:14.089735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:14.089750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:14.089847Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3239 partition: 0 MaxSeqNo: 40 sessionId: src_id|c8a91bb0-3d15e83a-512bc934-377ee6ac_0
2025-10-10T14:40:14.090335Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4fa6072-a7d13cb1-d68b6f03-e6180964_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|c8a91bb0-3d15e83a-512bc934-377ee6ac_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:14.093228Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c8a91bb0-3d15e83a-512bc934-377ee6ac_0] Write session: try to update token
2025-10-10T14:40:14.093250Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c8a91bb0-3d15e83a-512bc934-377ee6ac_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:14.114814Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:14.114835Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:14.114839Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:14.114843Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:14.114854Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602923119771621:12750]
2025-10-10T14:40:14.114859Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602923119771621:12750]
2025-10-10T14:40:14.114864Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602923119771621:12750]
2025-10-10T14:40:14.114917Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:14.114925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:14.114926Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:14.114929Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:14.114934Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:14.114939Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:14.115065Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:14.123762Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3239 sessionId: src_id|c8a91bb0-3d15e83a-512bc934-377ee6ac_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:14.126692Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:14.161691Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602923902025040:2851]
2025-10-10T14:40:14.162275Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 pipe creation result: OK TabletId: 72075186224037892 Generation: 3238, pipe: [1:7559602923902025040:2851]
2025-10-10T14:40:14.246146Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:14.246445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:14.246455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:14.246502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602923902025040:2851], now have 1 active actors on pipe
2025-10-10T14:40:14.246818Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:14.247246Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 37 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602923902025040:2851]
2025-10-10T14:40:14.247282Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:14.247332Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:40:14.247421Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3239 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c8a91bb0-3d15e83a-512bc934-377ee6ac_0
2025-10-10T14:40:14.247631Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3239 sessionId: src_id|c8a91bb0-3d15e83a-512bc934-377ee6ac_0 is DEAD
2025-10-10T14:40:14.249463Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8a91bb0-3d15e83a-512bc934-377ee6ac_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:40:14.249477Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8a91bb0-3d15e83a-512bc934-377ee6ac_0] Write session will restart in 0.005096s
2025-10-10T14:40:14.249501Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8a91bb0-3d15e83a-512bc934-377ee6ac_0] Write session: Do CDS request
2025-10-10T14:40:14.249508Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8a91bb0-3d15e83a-512bc934-377ee6ac_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:14.255938Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c8a91bb0-3d15e83a-512bc934-377ee6ac_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:14.257980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:14.260191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:14.260476Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:14.260489Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:14.260503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:14.260579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:14.260629Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602923119771710:12752]
2025-10-10T14:40:14.261301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:14.261924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:14.261979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:14.262346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:14.262457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:14.262463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:14.262465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:14.262466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:14.262468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:14.262469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:14.262470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:14.262471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:14.262473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:14.262474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:14.262475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:14.262477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:14.262478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:14.262485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:14.262504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:14.262509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:14.262514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:14.262519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:14.262523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:14.262536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:14.262540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:14.262544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:14.262548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:14.262552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:14.262556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:14.262560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:14.262569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:14.262578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:14.262586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:14.262592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:14.262597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:14.262603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:14.262608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:14.262613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:14.262619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:14.262624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:14.262630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:14.262636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:14.262641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:14.262646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:14.262652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:14.262658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:14.262663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:14.262669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:14.262673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:14.262682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:14.262687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:14.262693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:14.262697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:14.262703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:14.262708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:14.262714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:14.262759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:14.261624Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:14.261643Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3240
2025-10-10T14:40:14.265510Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3240 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:14.265558Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3240 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:14.265564Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3240 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:14.265568Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:14.266070Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3240 sessionId:  describe result for acl check
2025-10-10T14:40:14.266102Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:14.266104Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:14.266109Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:14.266115Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602923902025092:8297] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:14.266693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602923902025092:8297] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:14.270107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:14.270568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:14.270579Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:14.270582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:14.270587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:14.270597Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3239 [2:7559602923119771710:12752]
2025-10-10T14:40:14.270612Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:14.270631Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:14.270642Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:14.270646Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:14.270649Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:14.270682Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:14.270694Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:14.270702Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:14.270772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:14.270781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:14.270783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:14.270786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:14.270856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:14.270865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:14.270877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:14.270890Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:14.270910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:14.270935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602923902025041:2438], now have 1 active actors on pipe
2025-10-10T14:40:14.270943Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602923119771704:12752]
2025-10-10T14:40:14.270945Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602923119771704:12752]
2025-10-10T14:40:14.270947Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602923119771704:12752]
2025-10-10T14:40:14.270960Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:14.270971Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:14.270974Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:14.270974Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:14.270977Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:14.270992Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:14.270996Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:14.271035Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602923119771704:12752]
2025-10-10T14:40:14.271042Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:14.271157Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:14.271190Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3239
2025-10-10T14:40:14.271238Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602923902025092:8297] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:14.282256Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602923902025092:8297] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:14.282276Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602923902025092:8297] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:14.282281Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602923902025092:8297] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:14.282292Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3240 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:14.283037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602923902025125:8297], now have 1 active actors on pipe
2025-10-10T14:40:14.283055Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3239
2025-10-10T14:40:14.286509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:14.286533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:14.286579Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d5430f72-ff28536-1ccbb4e7-16815d9c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:14.286593Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:14.286600Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:14.286604Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:14.286621Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:14.286644Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:14.286666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:14.287188Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3240 partition: 0 MaxSeqNo: 40 sessionId: src_id|d5430f72-ff28536-1ccbb4e7-16815d9c_0
2025-10-10T14:40:14.287013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:14.287026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:14.287051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:14.291225Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8a91bb0-3d15e83a-512bc934-377ee6ac_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|d5430f72-ff28536-1ccbb4e7-16815d9c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:14.294174Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5430f72-ff28536-1ccbb4e7-16815d9c_0] Write session: try to update token
2025-10-10T14:40:14.294195Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5430f72-ff28536-1ccbb4e7-16815d9c_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:14.294961Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:14.294984Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:14.294988Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:14.294990Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:14.295008Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602923119771704:12752]
2025-10-10T14:40:14.295012Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602923119771704:12752]
2025-10-10T14:40:14.295016Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602923119771704:12752]
2025-10-10T14:40:14.295071Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:14.295078Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:14.295085Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:14.295089Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:14.295089Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:14.295092Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:14.295246Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:14.322483Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3240 sessionId: src_id|d5430f72-ff28536-1ccbb4e7-16815d9c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:14.325078Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:14.347474Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602923902025129:2851]
2025-10-10T14:40:14.347982Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 pipe creation result: OK TabletId: 72075186224037892 Generation: 3239, pipe: [1:7559602923902025129:2851]
2025-10-10T14:40:14.411916Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:14.412283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:14.412314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:14.412339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602923902025129:2851], now have 1 active actors on pipe
2025-10-10T14:40:14.412684Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:14.413155Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d5430f72-ff28536-1ccbb4e7-16815d9c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:40:14.413167Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d5430f72-ff28536-1ccbb4e7-16815d9c_0] Write session will restart in 0.007210s
2025-10-10T14:40:14.413193Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d5430f72-ff28536-1ccbb4e7-16815d9c_0] Write session: Do CDS request
2025-10-10T14:40:14.412614Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 38 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602923902025129:2851]
2025-10-10T14:40:14.412662Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:40:14.412665Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:40:14.413199Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d5430f72-ff28536-1ccbb4e7-16815d9c_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:14.412745Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3240 reason: error at write: Disconnected sessionId: src_id|d5430f72-ff28536-1ccbb4e7-16815d9c_0
2025-10-10T14:40:14.412979Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3240 sessionId: src_id|d5430f72-ff28536-1ccbb4e7-16815d9c_0 is DEAD
2025-10-10T14:40:14.413181Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:14.421892Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5430f72-ff28536-1ccbb4e7-16815d9c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:14.422015Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:14.422039Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3241
2025-10-10T14:40:14.422605Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3241 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:14.422644Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3241 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:14.422650Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3241 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:14.422653Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:14.423148Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3241 sessionId:  describe result for acl check
2025-10-10T14:40:14.423198Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:14.423200Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:14.423202Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:14.423207Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602923902025171:8305] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:14.423735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602923902025171:8305] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:14.426473Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602923902025171:8305] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:14.431582Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602923902025171:8305] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:14.431603Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602923902025171:8305] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:14.431607Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602923902025171:8305] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:14.431616Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3241 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:14.433053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:14.435030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:14.435293Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:14.435306Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:14.435320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:14.435384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:14.435435Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602923119771834:12766]
2025-10-10T14:40:14.436130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:14.436499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:14.436544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:14.436890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:14.436959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:14.436960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:14.436961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:14.436963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:14.436964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:14.436965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:14.436966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:14.436968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:14.436969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:14.436970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:14.436972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:14.436973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:14.436974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:14.436981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:14.436997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:14.437001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:14.437006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:14.437010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:14.437014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:14.437019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:14.437023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:14.437027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:14.437032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:14.437036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:14.437040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:14.437046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:14.437055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:14.437065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:14.437072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:14.437078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:14.437082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:14.437088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:14.437093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:14.437099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:14.437104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:14.437109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:14.437114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:14.437120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:14.437126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:14.437132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:14.437137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:14.437143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:14.437149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:14.437155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:14.437160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:14.437165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:14.437170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:14.437176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:14.437180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:14.437184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:14.437189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:14.437194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:14.437235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:14.440370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:14.440765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:14.440770Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:14.440773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:14.440779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:14.440787Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3240 [2:7559602923119771834:12766]
2025-10-10T14:40:14.440803Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:14.440822Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:14.440826Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:14.440829Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:14.440831Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:14.440851Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:14.440859Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:14.440870Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:14.440927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:14.440929Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:14.440931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:14.440935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:14.441015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:14.441018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:14.441031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:14.441043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:14.441062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:14.441083Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602923119771829:12766]
2025-10-10T14:40:14.441085Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602923119771829:12766]
2025-10-10T14:40:14.441087Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602923119771829:12766]
2025-10-10T14:40:14.441101Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:14.441109Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:14.441115Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:14.441253Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3240
2025-10-10T14:40:14.441316Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3240
2025-10-10T14:40:14.441132Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:14.441135Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:14.441139Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:14.441142Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:14.441146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602923902025143:2438], now have 1 active actors on pipe
2025-10-10T14:40:14.441150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602923902025228:8305], now have 1 active actors on pipe
2025-10-10T14:40:14.441176Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602923119771829:12766]
2025-10-10T14:40:14.441188Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:14.441392Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:14.441683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:14.441696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:14.441731Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2a9f8508-ef957e9-3a06f18f-748cf171_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:14.441740Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:14.441744Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:14.441749Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:14.441763Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:14.441781Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:14.441795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:14.442028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:14.442043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:14.442071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:14.442182Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3241 partition: 0 MaxSeqNo: 40 sessionId: src_id|2a9f8508-ef957e9-3a06f18f-748cf171_0
2025-10-10T14:40:14.442631Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d5430f72-ff28536-1ccbb4e7-16815d9c_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|2a9f8508-ef957e9-3a06f18f-748cf171_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:14.445544Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2a9f8508-ef957e9-3a06f18f-748cf171_0] Write session: try to update token
2025-10-10T14:40:14.445565Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2a9f8508-ef957e9-3a06f18f-748cf171_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:14.462140Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:14.462159Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:14.462163Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:14.462165Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:14.462177Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602923119771829:12766]
2025-10-10T14:40:14.462182Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602923119771829:12766]
2025-10-10T14:40:14.462185Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602923119771829:12766]
2025-10-10T14:40:14.462240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:14.462248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:14.462251Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:14.462254Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:14.462262Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:14.462267Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:14.462394Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:14.462891Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3241 sessionId: src_id|2a9f8508-ef957e9-3a06f18f-748cf171_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:14.465567Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:14.512850Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602923902025242:2851]
2025-10-10T14:40:14.513243Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 pipe creation result: OK TabletId: 72075186224037892 Generation: 3240, pipe: [1:7559602923902025242:2851]
2025-10-10T14:40:14.582900Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:14.583266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:14.583283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:14.583328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602923902025242:2851], now have 1 active actors on pipe
2025-10-10T14:40:14.583554Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:14.584530Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a9f8508-ef957e9-3a06f18f-748cf171_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:40:14.584543Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a9f8508-ef957e9-3a06f18f-748cf171_0] Write session will restart in 0.008079s
2025-10-10T14:40:14.584570Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a9f8508-ef957e9-3a06f18f-748cf171_0] Write session: Do CDS request
2025-10-10T14:40:14.584578Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a9f8508-ef957e9-3a06f18f-748cf171_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:14.583990Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 39 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602923902025242:2851]
2025-10-10T14:40:14.584050Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:14.584093Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:40:14.584184Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3241 reason: status is not ok: tablet will be restarted right now sessionId: src_id|2a9f8508-ef957e9-3a06f18f-748cf171_0
2025-10-10T14:40:14.584399Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3241 sessionId: src_id|2a9f8508-ef957e9-3a06f18f-748cf171_0 is DEAD
2025-10-10T14:40:14.593940Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2a9f8508-ef957e9-3a06f18f-748cf171_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:14.594082Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:14.594102Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3242
2025-10-10T14:40:14.594222Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3242 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:14.594257Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3242 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:14.594268Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3242 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:14.594282Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:14.594749Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3242 sessionId:  describe result for acl check
2025-10-10T14:40:14.594797Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:14.594809Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:14.594811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:14.594818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602923902025293:8331] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:14.595439Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602923902025293:8331] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:14.595582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:14.597244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:14.597487Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:14.597499Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:14.597511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:14.597568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:14.597615Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602923119771918:12770]
2025-10-10T14:40:14.598202Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602923902025293:8331] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:14.598294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:14.598658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:14.598708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:14.599072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:14.599137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:14.599143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:14.599145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:14.599146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:14.599148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:14.599149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:14.599150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:14.599154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:14.599155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:14.599156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:14.599158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:14.599159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:14.599160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:14.599166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:14.599179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:14.599183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:14.599203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:14.599208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:14.599212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:14.599216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:14.599220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:14.599224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:14.599230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:14.599234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:14.599238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:14.599242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:14.599249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:14.599258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:14.599265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:14.599277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:14.599282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:14.599287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:14.599292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:14.599297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:14.599302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:14.599308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:14.599313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:14.599319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:14.599325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:14.599330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:14.599335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:14.599340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:14.599345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:14.599350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:14.599355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:14.599360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:14.599366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:14.599371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:14.599376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:14.599380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:14.599385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:14.599391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:14.599434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:14.602000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:14.602006Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602923902025293:8331] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:14.602026Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602923902025293:8331] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:14.602031Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602923902025293:8331] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:14.602041Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3242 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:14.602524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:14.602536Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:14.602538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:14.602544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:14.602550Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3241 [2:7559602923119771918:12770]
2025-10-10T14:40:14.602563Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:14.602582Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:14.602592Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:14.602599Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:14.602601Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:14.602618Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:14.602632Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:14.602639Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:14.602699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:14.602706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:14.602707Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:14.602711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:14.602783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:14.602791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:14.602803Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:14.602815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:14.602832Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:14.602853Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602923119771912:12770]
2025-10-10T14:40:14.602855Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602923119771912:12770]
2025-10-10T14:40:14.602857Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602923119771912:12770]
2025-10-10T14:40:14.602866Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:14.602880Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:14.602897Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:14.602901Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:14.602928Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602923119771912:12770]
2025-10-10T14:40:14.602930Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:14.602943Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:14.602955Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:14.602958Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:14.602966Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:14.603039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602923902025247:2438], now have 1 active actors on pipe
2025-10-10T14:40:14.603050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602923902025329:8331], now have 1 active actors on pipe
2025-10-10T14:40:14.603093Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3241
2025-10-10T14:40:14.603144Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3241
2025-10-10T14:40:14.603201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:14.603211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:14.603242Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4632eb4e-3d1df30e-7cb30c15-edd9e91f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:14.603251Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:14.603257Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:14.603259Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:14.603271Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:14.603282Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:14.603296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:14.603461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:14.603468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:14.603482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:14.603601Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3242 partition: 0 MaxSeqNo: 40 sessionId: src_id|4632eb4e-3d1df30e-7cb30c15-edd9e91f_0
2025-10-10T14:40:14.604014Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a9f8508-ef957e9-3a06f18f-748cf171_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|4632eb4e-3d1df30e-7cb30c15-edd9e91f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:14.607195Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4632eb4e-3d1df30e-7cb30c15-edd9e91f_0] Write session: try to update token
2025-10-10T14:40:14.607218Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4632eb4e-3d1df30e-7cb30c15-edd9e91f_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:14.623509Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:14.623530Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:14.623537Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:14.623539Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:14.623549Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602923119771912:12770]
2025-10-10T14:40:14.623555Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602923119771912:12770]
2025-10-10T14:40:14.623559Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602923119771912:12770]
2025-10-10T14:40:14.623608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:14.623613Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:14.623617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:14.623619Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:14.623622Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:14.623627Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:14.623768Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:14.624863Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3242 sessionId: src_id|4632eb4e-3d1df30e-7cb30c15-edd9e91f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:14.627613Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:14.683879Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602923902025338:2851]
2025-10-10T14:40:14.684184Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 pipe creation result: OK TabletId: 72075186224037892 Generation: 3241, pipe: [1:7559602923902025338:2851]
2025-10-10T14:40:14.741258Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:14.741586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:14.741606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:14.741672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602923902025338:2851], now have 1 active actors on pipe
2025-10-10T14:40:14.741914Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:14.742368Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4632eb4e-3d1df30e-7cb30c15-edd9e91f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:40:14.742385Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4632eb4e-3d1df30e-7cb30c15-edd9e91f_0] Write session will restart in 0.005921s
2025-10-10T14:40:14.742410Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4632eb4e-3d1df30e-7cb30c15-edd9e91f_0] Write session: Do CDS request
2025-10-10T14:40:14.742415Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4632eb4e-3d1df30e-7cb30c15-edd9e91f_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:14.741954Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:40:14.741960Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:14.741971Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:40:14.742011Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 40 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602923902025338:2851]
2025-10-10T14:40:14.742037Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3242 reason: error at write: Disconnected sessionId: src_id|4632eb4e-3d1df30e-7cb30c15-edd9e91f_0
2025-10-10T14:40:14.742243Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3242 sessionId: src_id|4632eb4e-3d1df30e-7cb30c15-edd9e91f_0 is DEAD
2025-10-10T14:40:14.750035Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4632eb4e-3d1df30e-7cb30c15-edd9e91f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:14.750134Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:14.750158Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3243
2025-10-10T14:40:14.750290Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3243 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:14.750330Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3243 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:14.750353Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3243 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:14.750363Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:14.751032Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3243 sessionId:  describe result for acl check
2025-10-10T14:40:14.751074Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:14.751081Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:14.751083Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:14.751090Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602923902025384:8328] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:14.751684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602923902025384:8328] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:14.752282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:14.754582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:14.754887Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:14.754901Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:14.754914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:14.754982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:14.755029Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602923119772015:12773]
2025-10-10T14:40:14.755234Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602923902025384:8328] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:14.755663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:14.756024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:14.756071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:14.756433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:14.756498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:14.756504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:14.756505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:14.756506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:14.756507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:14.756508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:14.756510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:14.756511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:14.756513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:14.756514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:14.756515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:14.756516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:14.756517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:14.756523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:14.756536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:14.756541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:14.756545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:14.756549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:14.756554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:14.756558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:14.756562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:14.756565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:14.756569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:14.756574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:14.756578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:14.756582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:14.756592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:14.756602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:14.756607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:14.756614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:14.756618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:14.756622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:14.756626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:14.756631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:14.756634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:14.756639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:14.756642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:14.756647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:14.756651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:14.756655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:14.756658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:14.756664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:14.756668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:14.756672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:14.756676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:14.756681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:14.756684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:14.756689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:14.756693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:14.756698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:14.756702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:14.756706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:14.756740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:14.759992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:14.760006Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602923902025384:8328] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:14.760029Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602923902025384:8328] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:14.760033Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602923902025384:8328] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:14.760043Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3243 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:14.760327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:14.760340Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:14.760342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:14.760346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:14.760356Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3242 [2:7559602923119772015:12773]
2025-10-10T14:40:14.760369Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:14.760386Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:14.760396Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:14.760400Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:14.760403Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:14.760420Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:14.760427Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:14.760435Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:14.760589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:14.760598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:14.760600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:14.760602Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:14.760676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:14.760684Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:14.760696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:14.760718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:14.760740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:14.760763Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602923119772009:12773]
2025-10-10T14:40:14.760769Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602923119772009:12773]
2025-10-10T14:40:14.760771Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602923119772009:12773]
2025-10-10T14:40:14.760787Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:14.760794Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:14.760798Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:14.760800Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:14.760808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602923902025421:8328], now have 1 active actors on pipe
2025-10-10T14:40:14.760812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602923902025339:2438], now have 1 active actors on pipe
2025-10-10T14:40:14.760820Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:14.760840Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:14.760847Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:14.760876Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602923119772009:12773]
2025-10-10T14:40:14.760887Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:14.760897Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:14.760882Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3242
2025-10-10T14:40:14.760891Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3242
2025-10-10T14:40:14.761097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:14.761124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:14.761166Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a3fba254-d3667b6b-220e593d-c1e8cdb3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:14.761184Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:14.761194Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:14.761198Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:14.761212Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:14.761238Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:14.761260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:14.761786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:14.761795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:14.761817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:14.761958Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3243 partition: 0 MaxSeqNo: 40 sessionId: src_id|a3fba254-d3667b6b-220e593d-c1e8cdb3_0
2025-10-10T14:40:14.762390Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4632eb4e-3d1df30e-7cb30c15-edd9e91f_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|a3fba254-d3667b6b-220e593d-c1e8cdb3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:14.765166Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a3fba254-d3667b6b-220e593d-c1e8cdb3_0] Write session: try to update token
2025-10-10T14:40:14.765185Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a3fba254-d3667b6b-220e593d-c1e8cdb3_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:14.782074Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:40:14.782099Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:14.782113Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602923119772009:12773]
2025-10-10T14:40:14.782173Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:40:14.782379Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:40:14.783630Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3243 sessionId: src_id|a3fba254-d3667b6b-220e593d-c1e8cdb3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:14.782554Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:14.782707Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:14.782859Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:14.783066Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:40:14.783108Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:40:14.783657Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:40:14.786450Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:14.786827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:14.786851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:14.786891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:40:14.787002Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:40:14.796542Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:14.796558Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:14.796563Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:14.796564Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:14.796576Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602923119772009:12773]
2025-10-10T14:40:14.796581Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602923119772009:12773]
2025-10-10T14:40:14.796585Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602923119772009:12773]
2025-10-10T14:40:14.796636Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:14.796638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:14.796647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:14.796650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:14.796653Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:14.796657Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:14.796787Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:14.842034Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602923902025431:2851]
2025-10-10T14:40:14.842418Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 pipe creation result: OK TabletId: 72075186224037892 Generation: 3242, pipe: [1:7559602923902025431:2851]
2025-10-10T14:40:14.917953Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:14.927581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:14.927622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:14.927832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:14.927913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:14.927993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:14.928076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:14.928756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:14.928775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:14.928862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:14.928934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:14.929011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:14.929086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:14.929132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:14.929142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:14.929218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:14.929283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:14.932153Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:14.932190Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 41 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602923902025431:2851]
2025-10-10T14:40:14.932220Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:40:14.932223Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:40:14.932259Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3243 reason: error at write: Disconnected sessionId: src_id|a3fba254-d3667b6b-220e593d-c1e8cdb3_0
2025-10-10T14:40:14.932543Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3243 sessionId: src_id|a3fba254-d3667b6b-220e593d-c1e8cdb3_0 is DEAD
2025-10-10T14:40:14.929384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:14.929460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:14.929504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:14.929507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:14.929584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:14.929654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:14.929720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:14.929787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:14.929832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:14.929835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:14.929912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:14.929977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:14.930042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:14.930112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:14.930161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:14.930164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:14.930236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:14.930303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:14.930365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:14.930432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:14.930483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:14.930487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:14.930564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:14.930630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:14.930699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:14.930768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:14.930812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:14.930815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:14.930886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:14.930952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:14.931021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:14.931084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:14.931130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:14.931134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:14.931204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:14.931268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:14.931331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:14.931401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:14.931448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:14.931450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:14.931531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:14.931594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:14.931656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:14.931722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:14.931774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:14.931777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:14.931858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602923902025431:2851], now have 1 active actors on pipe
2025-10-10T14:40:14.932926Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:14.937499Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a3fba254-d3667b6b-220e593d-c1e8cdb3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:40:14.937518Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a3fba254-d3667b6b-220e593d-c1e8cdb3_0] Write session will restart in 0.005751s
2025-10-10T14:40:14.937548Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a3fba254-d3667b6b-220e593d-c1e8cdb3_0] Write session: Do CDS request
2025-10-10T14:40:14.937554Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a3fba254-d3667b6b-220e593d-c1e8cdb3_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:14.945015Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a3fba254-d3667b6b-220e593d-c1e8cdb3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:14.945120Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:14.945145Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3244
2025-10-10T14:40:14.945324Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3244 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:14.945383Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3244 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:14.945389Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3244 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:14.945393Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:14.945888Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3244 sessionId:  describe result for acl check
2025-10-10T14:40:14.945940Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:14.945942Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:14.945945Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:14.945953Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602923902025461:8335] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:14.946563Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602923902025461:8335] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:14.949053Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602923902025461:8335] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:14.955712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602923902025461:8335] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:14.955734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602923902025461:8335] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:14.955738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602923902025461:8335] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:14.955749Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3244 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:14.957493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:14.959546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:14.959788Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:14.959801Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:14.959814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:14.959873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:14.959919Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602923119772102:12775]
2025-10-10T14:40:14.960598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:14.960934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:14.960985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:14.961314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:14.961424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:14.961432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:14.961433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:14.961435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:14.961436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:14.961440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:14.961441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:14.961442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:14.961443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:14.961444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:14.961445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:14.961447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:14.961448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:14.961454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:14.961469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:14.961473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:14.961478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:14.961482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:14.961486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:14.961490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:14.961494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:14.961498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:14.961503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:14.961507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:14.961511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:14.961515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:14.961524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:14.961533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:14.961540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:14.961545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:14.961550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:14.961556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:14.961560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:14.961566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:14.961571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:14.961577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:14.961582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:14.961588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:14.961593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:14.961599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:14.961604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:14.961608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:14.961612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:14.961618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:14.961621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:14.961626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:14.961630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:14.961635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:14.961640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:14.961645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:14.961649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:14.961655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:14.961703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:14.964650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:14.965061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:14.965073Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:14.965076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:14.965080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:14.965087Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3243 [2:7559602923119772102:12775]
2025-10-10T14:40:14.965102Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:14.965123Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:14.965132Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:14.965136Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:14.965138Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:14.965160Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:14.965169Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:14.965185Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:14.965255Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:14.965262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:14.965263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:14.965266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:14.965355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:14.965363Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:14.965374Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:14.965387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:14.965408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:14.965431Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602923119772097:12775]
2025-10-10T14:40:14.965438Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602923119772097:12775]
2025-10-10T14:40:14.965440Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602923119772097:12775]
2025-10-10T14:40:14.965451Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:14.965461Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:14.965465Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:14.965471Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:14.965473Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:14.965482Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:14.965485Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:14.965496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602923902025529:8335], now have 1 active actors on pipe
2025-10-10T14:40:14.965500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602923902025453:2438], now have 1 active actors on pipe
2025-10-10T14:40:14.965526Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602923119772097:12775]
2025-10-10T14:40:14.965540Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:14.965711Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3243
2025-10-10T14:40:14.965764Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3243
2025-10-10T14:40:14.965952Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:14.966009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:14.966024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:14.966064Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|427b311-8b869b-23797103-f15c522_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:14.966076Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:14.966082Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:14.966085Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:14.966096Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:14.966113Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:14.966134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:14.966526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:14.966535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:14.966559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:14.966760Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3244 partition: 0 MaxSeqNo: 40 sessionId: src_id|427b311-8b869b-23797103-f15c522_0
2025-10-10T14:40:14.967238Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a3fba254-d3667b6b-220e593d-c1e8cdb3_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|427b311-8b869b-23797103-f15c522_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:14.970615Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|427b311-8b869b-23797103-f15c522_0] Write session: try to update token
2025-10-10T14:40:14.970638Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|427b311-8b869b-23797103-f15c522_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:14.992522Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:14.992544Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:14.992551Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:14.992553Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:14.992564Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602923119772097:12775]
2025-10-10T14:40:14.992568Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602923119772097:12775]
2025-10-10T14:40:14.992574Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602923119772097:12775]
2025-10-10T14:40:14.992630Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:14.992632Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:14.992639Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:14.992640Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:14.992645Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:14.992646Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:14.992807Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:14.999733Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3244 sessionId: src_id|427b311-8b869b-23797103-f15c522_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:15.002530Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:15.032543Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602928196992840:2851]
2025-10-10T14:40:15.033051Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 pipe creation result: OK TabletId: 72075186224037892 Generation: 3243, pipe: [1:7559602928196992840:2851]
2025-10-10T14:40:15.112384Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:15.112768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:15.112785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:15.112811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602928196992840:2851], now have 1 active actors on pipe
2025-10-10T14:40:15.113183Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:15.114461Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|427b311-8b869b-23797103-f15c522_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:40:15.114473Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|427b311-8b869b-23797103-f15c522_0] Write session will restart in 0.006387s
2025-10-10T14:40:15.114504Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|427b311-8b869b-23797103-f15c522_0] Write session: Do CDS request
2025-10-10T14:40:15.114511Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|427b311-8b869b-23797103-f15c522_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:15.113928Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 42 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602928196992840:2851]
2025-10-10T14:40:15.113974Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:40:15.114048Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3244 reason: status is not ok: tablet will be restarted right now sessionId: src_id|427b311-8b869b-23797103-f15c522_0
2025-10-10T14:40:15.114282Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3244 sessionId: src_id|427b311-8b869b-23797103-f15c522_0 is DEAD
2025-10-10T14:40:15.114433Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:15.121837Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|427b311-8b869b-23797103-f15c522_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:15.125507Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:15.125529Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3245
2025-10-10T14:40:15.125811Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3245 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:15.125873Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3245 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:15.125882Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3245 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:15.125887Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:15.126528Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3245 sessionId:  describe result for acl check
2025-10-10T14:40:15.126570Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:15.126573Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:15.126575Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:15.126588Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602928196992850:8346] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:15.127196Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602928196992850:8346] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:15.134841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602928196992850:8346] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:15.142428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:15.142619Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602928196992850:8346] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:15.142643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602928196992850:8346] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:15.142647Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602928196992850:8346] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:15.142666Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3245 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:15.144805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:15.145068Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:15.145079Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:15.145091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:15.145148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:15.145196Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602927414739485:12777]
2025-10-10T14:40:15.145884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:15.146195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:15.146241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:15.146566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:15.146630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:15.146637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:15.146638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:15.146639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:15.146640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:15.146641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:15.146642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:15.146644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:15.146645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:15.146646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:15.146647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:15.146648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:15.146650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:15.146655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:15.146669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:15.146673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:15.146677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:15.146682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:15.146686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:15.146691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:15.146695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:15.146699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:15.146703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:15.146709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:15.146713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:15.146717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:15.146724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:15.146732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:15.146739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:15.146744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:15.146748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:15.146752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:15.146756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:15.146760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:15.146767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:15.146778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:15.146782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:15.146787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:15.146791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:15.146796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:15.146799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:15.146804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:15.146809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:15.146814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:15.146818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:15.146824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:15.146833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:15.146838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:15.146842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:15.146847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:15.146853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:15.146858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:15.146898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:15.149708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:15.150645Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3244
2025-10-10T14:40:15.150687Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3244
2025-10-10T14:40:15.150201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:15.150217Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:15.150219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:15.150223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:15.150230Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3244 [2:7559602927414739485:12777]
2025-10-10T14:40:15.150244Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:15.150266Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:15.150269Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:15.150273Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:15.150275Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:15.150293Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:15.150303Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:15.150312Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:15.150379Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:15.150382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:15.150384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:15.150387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:15.150457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:15.150460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:15.150472Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:15.150484Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:15.150502Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:15.150526Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602927414739478:12777]
2025-10-10T14:40:15.150528Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602927414739478:12777]
2025-10-10T14:40:15.150532Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602927414739478:12777]
2025-10-10T14:40:15.150541Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:15.150551Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:15.150554Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:15.150556Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:15.150557Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:15.150572Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:15.150575Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:15.150589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602928196992926:8346], now have 1 active actors on pipe
2025-10-10T14:40:15.150592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602928196992844:2438], now have 1 active actors on pipe
2025-10-10T14:40:15.150625Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602927414739478:12777]
2025-10-10T14:40:15.150633Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:15.150700Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:15.150939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:15.150950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:15.150985Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d3a9b38b-3af3c5c-b712959f-e8b43343_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:15.150998Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:15.151002Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:15.151005Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:15.151016Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:15.151027Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:15.151055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:15.151296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:15.151312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:15.151339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:15.151424Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3245 partition: 0 MaxSeqNo: 40 sessionId: src_id|d3a9b38b-3af3c5c-b712959f-e8b43343_0
2025-10-10T14:40:15.153462Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|427b311-8b869b-23797103-f15c522_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|d3a9b38b-3af3c5c-b712959f-e8b43343_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:15.156315Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d3a9b38b-3af3c5c-b712959f-e8b43343_0] Write session: try to update token
2025-10-10T14:40:15.156335Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d3a9b38b-3af3c5c-b712959f-e8b43343_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:15.176873Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:15.176896Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:15.176900Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:15.176902Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:15.176913Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602927414739478:12777]
2025-10-10T14:40:15.176917Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602927414739478:12777]
2025-10-10T14:40:15.176921Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602927414739478:12777]
2025-10-10T14:40:15.176979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:15.176997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:15.177005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:15.177153Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:15.177395Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:15.177408Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:15.177412Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:15.182683Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3245 sessionId: src_id|d3a9b38b-3af3c5c-b712959f-e8b43343_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:15.185483Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:15.213822Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602928196992965:2851]
2025-10-10T14:40:15.214253Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 pipe creation result: OK TabletId: 72075186224037892 Generation: 3244, pipe: [1:7559602928196992965:2851]
2025-10-10T14:40:15.315798Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:40:15.315878Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3245 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d3a9b38b-3af3c5c-b712959f-e8b43343_0
2025-10-10T14:40:15.316068Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3245 sessionId: src_id|d3a9b38b-3af3c5c-b712959f-e8b43343_0 is DEAD
2025-10-10T14:40:15.316211Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 43 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602928196992965:2851]
2025-10-10T14:40:15.316224Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:15.314563Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:15.314884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:15.314898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:15.314947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602928196992965:2851], now have 1 active actors on pipe
2025-10-10T14:40:15.315180Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:15.318350Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d3a9b38b-3af3c5c-b712959f-e8b43343_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:40:15.318361Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d3a9b38b-3af3c5c-b712959f-e8b43343_0] Write session will restart in 0.007930s
2025-10-10T14:40:15.318387Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d3a9b38b-3af3c5c-b712959f-e8b43343_0] Write session: Do CDS request
2025-10-10T14:40:15.318394Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d3a9b38b-3af3c5c-b712959f-e8b43343_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:15.327996Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d3a9b38b-3af3c5c-b712959f-e8b43343_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:15.329610Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:15.329631Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3246
2025-10-10T14:40:15.333476Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3246 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:15.333546Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3246 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:15.333552Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3246 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:15.333557Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:15.334669Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3246 sessionId:  describe result for acl check
2025-10-10T14:40:15.334702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:15.334704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:15.334708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:15.334716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602928196993019:8351] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:15.335302Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602928196993019:8351] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:15.336233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:15.339923Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602928196993019:8351] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:15.338434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:15.338712Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:15.338718Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:15.338731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:15.338790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:15.338834Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602927414739575:12779]
2025-10-10T14:40:15.339524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:15.339865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:15.339911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:15.340303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:15.340364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:15.340365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:15.340367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:15.340368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:15.340370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:15.340371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:15.340372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:15.340374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:15.340375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:15.340377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:15.340379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:15.340380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:15.340382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:15.340388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:15.340406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:15.340411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:15.340416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:15.340421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:15.340425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:15.340430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:15.340435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:15.340439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:15.340444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:15.340449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:15.340453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:15.340457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:15.340465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:15.340474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:15.340482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:15.340488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:15.340493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:15.340498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:15.340503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:15.340509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:15.340515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:15.340521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:15.340527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:15.340535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:15.340540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:15.340546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:15.340551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:15.340557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:15.340563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:15.340569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:15.340574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:15.340584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:15.340590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:15.340596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:15.340602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:15.340608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:15.340614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:15.340620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:15.340667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:15.343995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:15.344062Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602928196993019:8351] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:15.344083Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602928196993019:8351] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:15.344087Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602928196993019:8351] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:15.344097Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3246 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:15.344469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:15.344483Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:15.344486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:15.344490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:15.344497Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3245 [2:7559602927414739575:12779]
2025-10-10T14:40:15.344514Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:15.344537Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:15.344545Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:15.344549Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:15.344552Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:15.344573Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:15.344587Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:15.344596Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:15.344659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:15.345039Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3245
2025-10-10T14:40:15.344668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:15.345080Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3245
2025-10-10T14:40:15.344670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:15.344673Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:15.344758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:15.344761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:15.344774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:15.344787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:15.344808Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:15.344830Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602927414739570:12779]
2025-10-10T14:40:15.344832Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602927414739570:12779]
2025-10-10T14:40:15.344834Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602927414739570:12779]
2025-10-10T14:40:15.344843Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:15.344859Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:15.344863Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:15.344866Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:15.344869Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:15.344876Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:15.344879Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:15.344920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602928196992967:2438], now have 1 active actors on pipe
2025-10-10T14:40:15.344923Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602927414739570:12779]
2025-10-10T14:40:15.344926Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:15.344930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602928196993052:8351], now have 1 active actors on pipe
2025-10-10T14:40:15.344941Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:15.345366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:15.345377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:15.345413Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|45b97677-b0ecca7b-3d7752bb-555e578b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:15.345423Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:15.345427Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:15.345430Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:15.345442Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:15.345455Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:15.345471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:15.345796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:15.345802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:15.345819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:15.346174Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3246 partition: 0 MaxSeqNo: 40 sessionId: src_id|45b97677-b0ecca7b-3d7752bb-555e578b_0
2025-10-10T14:40:15.346730Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d3a9b38b-3af3c5c-b712959f-e8b43343_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|45b97677-b0ecca7b-3d7752bb-555e578b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:15.349592Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|45b97677-b0ecca7b-3d7752bb-555e578b_0] Write session: try to update token
2025-10-10T14:40:15.349611Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|45b97677-b0ecca7b-3d7752bb-555e578b_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:15.371467Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:15.371488Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:15.371492Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:15.371494Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:15.371506Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602927414739570:12779]
2025-10-10T14:40:15.371511Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602927414739570:12779]
2025-10-10T14:40:15.371516Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602927414739570:12779]
2025-10-10T14:40:15.371574Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:15.371583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:15.371586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:15.371739Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:15.373577Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:15.373590Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:15.373595Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:15.374127Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3246 sessionId: src_id|45b97677-b0ecca7b-3d7752bb-555e578b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:15.376813Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:15.417577Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602928196993060:2851]
2025-10-10T14:40:15.421448Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 pipe creation result: OK TabletId: 72075186224037892 Generation: 3245, pipe: [1:7559602928196993060:2851]
2025-10-10T14:40:15.520402Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:15.520804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:15.520820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:15.520875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602928196993060:2851], now have 1 active actors on pipe
2025-10-10T14:40:15.521271Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 44 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602928196993060:2851]
2025-10-10T14:40:15.521304Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:15.521342Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:40:15.521347Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:40:15.521424Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3246 reason: error at write: Disconnected sessionId: src_id|45b97677-b0ecca7b-3d7752bb-555e578b_0
2025-10-10T14:40:15.521857Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45b97677-b0ecca7b-3d7752bb-555e578b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:40:15.521422Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:15.521870Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45b97677-b0ecca7b-3d7752bb-555e578b_0] Write session will restart in 0.007127s
2025-10-10T14:40:15.521953Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45b97677-b0ecca7b-3d7752bb-555e578b_0] Write session: Do CDS request
2025-10-10T14:40:15.521960Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45b97677-b0ecca7b-3d7752bb-555e578b_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:15.521651Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3246 sessionId: src_id|45b97677-b0ecca7b-3d7752bb-555e578b_0 is DEAD
2025-10-10T14:40:15.529857Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|45b97677-b0ecca7b-3d7752bb-555e578b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:15.533503Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:15.533523Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3247
2025-10-10T14:40:15.533731Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3247 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:15.533780Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3247 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:15.533799Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3247 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:15.533808Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:15.534234Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3247 sessionId:  describe result for acl check
2025-10-10T14:40:15.534274Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:15.534286Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:15.534288Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:15.534295Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602928196993140:8366] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:15.534875Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602928196993140:8366] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:15.535305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:15.537698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602928196993140:8366] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:15.538383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:15.538621Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:15.538636Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:15.538650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:15.538717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:15.538755Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602927414739703:12795]
2025-10-10T14:40:15.539372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:15.539785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:15.539862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:15.540248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:15.540343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:15.540349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:15.540350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:15.540351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:15.540353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:15.540354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:15.540356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:15.540357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:15.540358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:15.540359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:15.540366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:15.540367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:15.540368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:15.540375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:15.540390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:15.540394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:15.540399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:15.540403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:15.540408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:15.540412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:15.540417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:15.540422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:15.540427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:15.540431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:15.540436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:15.540440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:15.540449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:15.540459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:15.540466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:15.540472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:15.540477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:15.540483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:15.540488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:15.540494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:15.540499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:15.540505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:15.540510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:15.540516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:15.540521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:15.540527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:15.540532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:15.540540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:15.540545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:15.540554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:15.540559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:15.540565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:15.540569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:15.540575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:15.540580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:15.540585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:15.540590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:15.540596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:15.540640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:15.540736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602928196993140:8366] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:15.540753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602928196993140:8366] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:15.540756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602928196993140:8366] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:15.540766Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3247 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:15.543400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:15.543820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:15.543837Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:15.543839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:15.543843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:15.543849Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3246 [2:7559602927414739703:12795]
2025-10-10T14:40:15.543863Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:15.543884Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:15.543888Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:15.543893Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:15.543896Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:15.543916Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:15.543924Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:15.543936Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:15.544013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:15.544020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:15.544023Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:15.544026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:15.544098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:15.544105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:15.544117Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:15.544135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:15.544159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:15.544186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602928196993170:8366], now have 1 active actors on pipe
2025-10-10T14:40:15.544195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602928196993089:2438], now have 1 active actors on pipe
2025-10-10T14:40:15.544203Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602927414739698:12795]
2025-10-10T14:40:15.544210Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602927414739698:12795]
2025-10-10T14:40:15.544212Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602927414739698:12795]
2025-10-10T14:40:15.544225Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:15.544239Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:15.544243Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:15.544248Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:15.544250Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:15.544261Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:15.544265Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:15.544306Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602927414739698:12795]
2025-10-10T14:40:15.544317Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:15.544325Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:15.544748Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3246
2025-10-10T14:40:15.544750Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3246
2025-10-10T14:40:15.544972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:15.544995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:15.545029Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|29a91c1b-9e360828-65c8d405-fd8091f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:15.545039Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:15.545044Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:15.545047Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:15.545059Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:15.545078Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:15.545093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:15.545280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:15.545292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:15.545353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:15.545467Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3247 partition: 0 MaxSeqNo: 40 sessionId: src_id|29a91c1b-9e360828-65c8d405-fd8091f_0
2025-10-10T14:40:15.545903Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45b97677-b0ecca7b-3d7752bb-555e578b_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|29a91c1b-9e360828-65c8d405-fd8091f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:15.548789Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|29a91c1b-9e360828-65c8d405-fd8091f_0] Write session: try to update token
2025-10-10T14:40:15.548813Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|29a91c1b-9e360828-65c8d405-fd8091f_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:15.556905Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:40:15.556924Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:15.556935Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602927414739698:12795]
2025-10-10T14:40:15.556982Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:40:15.556988Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:40:15.557161Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:40:15.557309Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:15.557470Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:15.557609Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:15.557803Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:40:15.557853Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:40:15.563277Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3247 sessionId: src_id|29a91c1b-9e360828-65c8d405-fd8091f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:15.566120Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:15.566355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:15.566376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:15.566419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:40:15.566504Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:40:15.575092Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:15.575119Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:15.575122Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:15.575124Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:15.575136Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602927414739698:12795]
2025-10-10T14:40:15.575142Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602927414739698:12795]
2025-10-10T14:40:15.575146Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602927414739698:12795]
2025-10-10T14:40:15.575194Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:15.575197Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:15.575202Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:15.575206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:15.575206Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:15.575208Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:15.575339Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:15.621355Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602928196993179:2851]
2025-10-10T14:40:15.621734Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 pipe creation result: OK TabletId: 72075186224037892 Generation: 3246, pipe: [1:7559602928196993179:2851]
2025-10-10T14:40:15.690843Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:15.698714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:15.698744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:15.698928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:15.698995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:15.699064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:15.699128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:15.699385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:15.699396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:15.699479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:15.699539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:15.699599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:15.699666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:15.699712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:15.699720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:15.699786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:15.699849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:15.699908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:15.699968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:15.700013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:15.700019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:15.700080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:15.700359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:15.700439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:15.700508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:15.700551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:15.700558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:15.700623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:15.700685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:15.700756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:15.700817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:15.700856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:15.700859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:15.700927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:15.700986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:15.701053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:15.701112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:15.701155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:15.701158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:15.701235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:15.701292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:15.701466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:15.701534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:15.701581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:15.701587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:15.701655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:15.701725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:15.701792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:15.701861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:15.701905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:15.701912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:15.701980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:15.702045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:15.702111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:15.702176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:15.702227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:15.702232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:15.702301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:15.702358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:15.702424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:15.702490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:15.702532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:15.702541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:15.702615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602928196993179:2851], now have 1 active actors on pipe
2025-10-10T14:40:15.702910Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:40:15.702929Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:40:15.702963Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3247 reason: error at write: Disconnected sessionId: src_id|29a91c1b-9e360828-65c8d405-fd8091f_0
2025-10-10T14:40:15.703319Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|29a91c1b-9e360828-65c8d405-fd8091f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:40:15.703329Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|29a91c1b-9e360828-65c8d405-fd8091f_0] Write session will restart in 0.006062s
2025-10-10T14:40:15.703354Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|29a91c1b-9e360828-65c8d405-fd8091f_0] Write session: Do CDS request
2025-10-10T14:40:15.703361Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|29a91c1b-9e360828-65c8d405-fd8091f_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:15.703360Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3247 sessionId: src_id|29a91c1b-9e360828-65c8d405-fd8091f_0 is DEAD
2025-10-10T14:40:15.703121Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:15.703629Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:15.703695Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 45 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602928196993179:2851]
2025-10-10T14:40:15.710909Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|29a91c1b-9e360828-65c8d405-fd8091f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:15.711075Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:15.711097Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3248
2025-10-10T14:40:15.711249Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3248 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:15.711302Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3248 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:15.711313Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3248 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:15.711317Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:15.711805Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3248 sessionId:  describe result for acl check
2025-10-10T14:40:15.711860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:15.711866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:15.711868Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:15.711874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602928196993193:8378] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:15.712467Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602928196993193:8378] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:15.715784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602928196993193:8378] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:15.718678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:15.720414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:15.720580Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602928196993193:8378] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:15.720597Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602928196993193:8378] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:15.720601Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602928196993193:8378] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:15.720610Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3248 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:15.720624Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:15.720635Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:15.720646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:15.720696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:15.720728Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602927414739794:12797]
2025-10-10T14:40:15.721274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:15.721660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:15.721711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:15.722036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:15.722104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:15.722111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:15.722112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:15.722113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:15.722114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:15.722116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:15.722117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:15.722118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:15.722120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:15.722121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:15.722135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:15.722136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:15.722137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:15.722143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:15.722156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:15.722161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:15.722165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:15.722169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:15.722173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:15.722178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:15.722182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:15.722186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:15.722190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:15.722194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:15.722199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:15.722203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:15.722210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:15.722219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:15.722227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:15.722232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:15.722237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:15.722242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:15.722246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:15.722250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:15.722254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:15.722258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:15.722262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:15.722267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:15.722271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:15.722275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:15.722279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:15.722284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:15.722295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:15.722299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:15.722303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:15.722307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:15.722311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:15.722316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:15.722322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:15.722327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:15.722331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:15.722336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:15.722375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:15.724748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:15.725072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:15.725084Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:15.725087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:15.725091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:15.725098Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3247 [2:7559602927414739794:12797]
2025-10-10T14:40:15.725110Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:15.725130Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:15.725137Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:15.725141Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:15.725144Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:15.725160Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:15.725171Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:15.725178Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:15.725233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:15.725240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:15.725243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:15.725246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:15.725344Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:15.725353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:15.725364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:15.725377Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:15.725398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:15.725425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602928196993265:8378], now have 1 active actors on pipe
2025-10-10T14:40:15.725433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602928196993182:2438], now have 1 active actors on pipe
2025-10-10T14:40:15.725441Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602927414739789:12797]
2025-10-10T14:40:15.725443Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602927414739789:12797]
2025-10-10T14:40:15.725445Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602927414739789:12797]
2025-10-10T14:40:15.725458Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:15.725505Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3247
2025-10-10T14:40:15.725508Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3247
2025-10-10T14:40:15.725473Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:15.725474Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:15.725478Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:15.725480Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:15.725492Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:15.725495Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:15.725517Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602927414739789:12797]
2025-10-10T14:40:15.725523Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:15.725533Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:15.725556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:15.725561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:15.725601Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5c49f738-1c02ef30-64c61f28-a5abe422_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:15.725608Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:15.725618Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:15.725621Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:15.725632Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:15.725642Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:15.725667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:15.725948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:15.725958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:15.725976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:15.726079Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3248 partition: 0 MaxSeqNo: 40 sessionId: src_id|5c49f738-1c02ef30-64c61f28-a5abe422_0
2025-10-10T14:40:15.726554Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|29a91c1b-9e360828-65c8d405-fd8091f_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|5c49f738-1c02ef30-64c61f28-a5abe422_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:15.729296Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5c49f738-1c02ef30-64c61f28-a5abe422_0] Write session: try to update token
2025-10-10T14:40:15.729316Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5c49f738-1c02ef30-64c61f28-a5abe422_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:15.750161Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3248 sessionId: src_id|5c49f738-1c02ef30-64c61f28-a5abe422_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:15.751524Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:15.751548Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:15.751552Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:15.751554Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:15.751565Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602927414739789:12797]
2025-10-10T14:40:15.751575Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602927414739789:12797]
2025-10-10T14:40:15.751580Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602927414739789:12797]
2025-10-10T14:40:15.752889Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:15.751653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:15.751662Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:15.751672Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:15.751672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:15.751675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:15.751676Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:15.751902Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:15.803108Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602928196993276:2851]
2025-10-10T14:40:15.803433Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 pipe creation result: OK TabletId: 72075186224037892 Generation: 3247, pipe: [1:7559602928196993276:2851]
2025-10-10T14:40:15.870616Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:15.871100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:15.871120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:15.871169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602928196993276:2851], now have 1 active actors on pipe
2025-10-10T14:40:15.873623Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:15.874094Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c49f738-1c02ef30-64c61f28-a5abe422_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:40:15.874110Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c49f738-1c02ef30-64c61f28-a5abe422_0] Write session will restart in 0.007525s
2025-10-10T14:40:15.874136Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c49f738-1c02ef30-64c61f28-a5abe422_0] Write session: Do CDS request
2025-10-10T14:40:15.874143Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c49f738-1c02ef30-64c61f28-a5abe422_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:15.873632Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:40:15.873632Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:15.873651Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:40:15.873725Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3248 reason: error at write: Disconnected sessionId: src_id|5c49f738-1c02ef30-64c61f28-a5abe422_0
2025-10-10T14:40:15.873785Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 46 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602928196993276:2851]
2025-10-10T14:40:15.873932Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3248 sessionId: src_id|5c49f738-1c02ef30-64c61f28-a5abe422_0 is DEAD
2025-10-10T14:40:15.882969Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5c49f738-1c02ef30-64c61f28-a5abe422_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:15.883076Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:15.883098Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3249
2025-10-10T14:40:15.883272Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3249 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:15.883323Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3249 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:15.883333Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3249 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:15.883337Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:15.884840Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3249 sessionId:  describe result for acl check
2025-10-10T14:40:15.884882Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:15.884884Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:15.884886Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:15.884892Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602928196993308:8390] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:15.885510Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602928196993308:8390] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:15.889858Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602928196993308:8390] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:15.889714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:15.891916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:15.892152Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:15.892163Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:15.892174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:15.892231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:15.892307Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602927414739898:12800]
2025-10-10T14:40:15.893030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:15.893317Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602928196993308:8390] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:15.893349Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602928196993308:8390] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:15.893353Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602928196993308:8390] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:15.893361Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3249 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:15.893508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:15.893614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:15.894018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:15.894122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:15.894134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:15.894136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:15.894137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:15.894138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:15.894139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:15.894141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:15.894142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:15.894143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:15.894145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:15.894146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:15.894147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:15.894148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:15.894156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:15.894171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:15.894176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:15.894180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:15.894185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:15.894190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:15.894194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:15.894198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:15.894203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:15.894207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:15.894222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:15.894226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:15.894230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:15.894239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:15.894248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:15.894255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:15.894261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:15.894265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:15.894271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:15.894280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:15.894294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:15.894299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:15.894305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:15.894310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:15.894316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:15.894321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:15.894326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:15.894331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:15.894336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:15.894341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:15.894347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:15.894351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:15.894357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:15.894361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:15.894367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:15.894372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:15.894378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:15.894382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:15.894389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:15.894431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:15.897034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:15.897884Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3248
2025-10-10T14:40:15.897900Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3248
2025-10-10T14:40:15.897466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:15.897480Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:15.897483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:15.897488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:15.897495Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3248 [2:7559602927414739898:12800]
2025-10-10T14:40:15.897512Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:15.897530Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:15.897534Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:15.897538Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:15.897542Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:15.897562Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:15.897570Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:15.897577Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:15.897644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:15.897646Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:15.897649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:15.897652Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:15.897767Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:15.897771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:15.897785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:15.897798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:15.897816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:15.897837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602928196993370:8390], now have 1 active actors on pipe
2025-10-10T14:40:15.897842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602928196993280:2438], now have 1 active actors on pipe
2025-10-10T14:40:15.897849Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602927414739893:12800]
2025-10-10T14:40:15.897853Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602927414739893:12800]
2025-10-10T14:40:15.897855Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602927414739893:12800]
2025-10-10T14:40:15.897876Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:15.897891Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:15.897908Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:15.897912Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:15.897900Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:15.897919Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:15.897922Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:15.897946Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602927414739893:12800]
2025-10-10T14:40:15.897950Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:15.897953Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:15.897971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:15.897976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:15.898034Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b00542a8-c7334a64-d279dfdc-b42897d6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:15.898041Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:15.898045Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:15.898049Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:15.898060Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:15.898070Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:15.898095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:15.898360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:15.898370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:15.898386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:15.898477Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3249 partition: 0 MaxSeqNo: 40 sessionId: src_id|b00542a8-c7334a64-d279dfdc-b42897d6_0
2025-10-10T14:40:15.898903Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c49f738-1c02ef30-64c61f28-a5abe422_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|b00542a8-c7334a64-d279dfdc-b42897d6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:15.901771Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b00542a8-c7334a64-d279dfdc-b42897d6_0] Write session: try to update token
2025-10-10T14:40:15.901795Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b00542a8-c7334a64-d279dfdc-b42897d6_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:15.916819Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3249 sessionId: src_id|b00542a8-c7334a64-d279dfdc-b42897d6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:15.919633Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:15.918884Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:15.918910Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:15.918914Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:15.918917Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:15.918927Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602927414739893:12800]
2025-10-10T14:40:15.918933Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602927414739893:12800]
2025-10-10T14:40:15.918944Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602927414739893:12800]
2025-10-10T14:40:15.919012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:15.919014Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:15.919024Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:15.919024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:15.919027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:15.919031Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:15.919211Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:15.974186Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602928196993394:2851]
2025-10-10T14:40:15.974468Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 pipe creation result: OK TabletId: 72075186224037892 Generation: 3248, pipe: [1:7559602928196993394:2851]
2025-10-10T14:40:16.046914Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:16.047451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:16.047472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:16.047532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602928196993394:2851], now have 1 active actors on pipe
2025-10-10T14:40:16.047851Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:16.047862Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 47 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602928196993394:2851]
2025-10-10T14:40:16.047892Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:40:16.047895Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:40:16.047993Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3249 reason: error at write: Disconnected sessionId: src_id|b00542a8-c7334a64-d279dfdc-b42897d6_0
2025-10-10T14:40:16.047845Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:16.048200Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3249 sessionId: src_id|b00542a8-c7334a64-d279dfdc-b42897d6_0 is DEAD
2025-10-10T14:40:16.048374Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b00542a8-c7334a64-d279dfdc-b42897d6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:40:16.048385Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b00542a8-c7334a64-d279dfdc-b42897d6_0] Write session will restart in 0.008570s
2025-10-10T14:40:16.048411Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b00542a8-c7334a64-d279dfdc-b42897d6_0] Write session: Do CDS request
2025-10-10T14:40:16.048421Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b00542a8-c7334a64-d279dfdc-b42897d6_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:16.057989Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b00542a8-c7334a64-d279dfdc-b42897d6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:16.061704Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:16.061727Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3250
2025-10-10T14:40:16.061896Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3250 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:16.061934Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3250 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:16.061945Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3250 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:16.061949Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:16.062488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:16.062389Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3250 sessionId:  describe result for acl check
2025-10-10T14:40:16.062431Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:16.062433Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:16.062435Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:16.062441Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602932491960748:8395] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:16.063050Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602932491960748:8395] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:16.064950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:16.065169Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:16.065183Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:16.065196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:16.065414Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602932491960748:8395] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:16.065256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:16.065302Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602931709707287:12802]
2025-10-10T14:40:16.065934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:16.066331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:16.066383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:16.066737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:16.066801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:16.066807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:16.066808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:16.066809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:16.066810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:16.066812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:16.066814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:16.066815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:16.066816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:16.066817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:16.066819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:16.066820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:16.066821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:16.066827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:16.066841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:16.066859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:16.066864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:16.066869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:16.066872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:16.066877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:16.066881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:16.066886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:16.066891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:16.066895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:16.066899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:16.066904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:16.066913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:16.066926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:16.066935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:16.066940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:16.066944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:16.066949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:16.066953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:16.066957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:16.066961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:16.066966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:16.066972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:16.066977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:16.066981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:16.066986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:16.066989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:16.066994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:16.066998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:16.067002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:16.067007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:16.067012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:16.067018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:16.067023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:16.067044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:16.067051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:16.067056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:16.067062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:16.067107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:16.070140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:16.069946Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602932491960748:8395] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:16.069967Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602932491960748:8395] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:16.069971Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602932491960748:8395] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:16.069981Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3250 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:16.070509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:16.070520Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:16.070523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:16.070528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:16.070535Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3249 [2:7559602931709707287:12802]
2025-10-10T14:40:16.070550Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:16.070575Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:16.070578Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:16.070582Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:16.070585Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:16.070604Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:16.070617Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:16.070627Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:16.070697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:16.070700Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:16.070701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:16.070704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:16.070781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:16.070788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:16.070799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:16.070810Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:16.070828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:16.070853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602932491960692:2438], now have 1 active actors on pipe
2025-10-10T14:40:16.070861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602932491960781:8395], now have 1 active actors on pipe
2025-10-10T14:40:16.070869Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602931709707282:12802]
2025-10-10T14:40:16.070872Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602931709707282:12802]
2025-10-10T14:40:16.070873Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602931709707282:12802]
2025-10-10T14:40:16.070889Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:16.070905Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:16.070922Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:16.070925Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:16.070963Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602931709707282:12802]
2025-10-10T14:40:16.070971Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:16.070989Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3249
2025-10-10T14:40:16.071029Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3249
2025-10-10T14:40:16.071091Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:16.071103Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:16.071116Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:16.071123Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:16.071262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:16.071274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:16.071310Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|720dcaa1-8e048cfe-30258923-a8ee98a9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:16.071326Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:16.071335Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:16.071338Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:16.071351Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:16.071368Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:16.071389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:16.071656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:16.071672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:16.071695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:16.071830Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3250 partition: 0 MaxSeqNo: 40 sessionId: src_id|720dcaa1-8e048cfe-30258923-a8ee98a9_0
2025-10-10T14:40:16.072325Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b00542a8-c7334a64-d279dfdc-b42897d6_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|720dcaa1-8e048cfe-30258923-a8ee98a9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:16.075396Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|720dcaa1-8e048cfe-30258923-a8ee98a9_0] Write session: try to update token
2025-10-10T14:40:16.075424Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|720dcaa1-8e048cfe-30258923-a8ee98a9_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:16.093160Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:16.093181Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:16.093185Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:16.093187Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:16.093197Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602931709707282:12802]
2025-10-10T14:40:16.093202Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602931709707282:12802]
2025-10-10T14:40:16.093206Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602931709707282:12802]
2025-10-10T14:40:16.093249Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:16.093256Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:16.093257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:16.093302Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:16.093321Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:16.093326Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:16.093413Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:16.098839Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3250 sessionId: src_id|720dcaa1-8e048cfe-30258923-a8ee98a9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:16.101769Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:16.148471Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602932491960789:2851]
2025-10-10T14:40:16.148918Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 pipe creation result: OK TabletId: 72075186224037892 Generation: 3249, pipe: [1:7559602932491960789:2851]
2025-10-10T14:40:16.209557Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:16.209989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:16.210009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:16.210057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602932491960789:2851], now have 1 active actors on pipe
2025-10-10T14:40:16.210280Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:16.211458Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|720dcaa1-8e048cfe-30258923-a8ee98a9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:40:16.211470Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|720dcaa1-8e048cfe-30258923-a8ee98a9_0] Write session will restart in 0.008448s
2025-10-10T14:40:16.211496Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|720dcaa1-8e048cfe-30258923-a8ee98a9_0] Write session: Do CDS request
2025-10-10T14:40:16.211503Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|720dcaa1-8e048cfe-30258923-a8ee98a9_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:16.210890Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 48 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602932491960789:2851]
2025-10-10T14:40:16.210930Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:40:16.211016Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3250 reason: status is not ok: tablet will be restarted right now sessionId: src_id|720dcaa1-8e048cfe-30258923-a8ee98a9_0
2025-10-10T14:40:16.211244Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3250 sessionId: src_id|720dcaa1-8e048cfe-30258923-a8ee98a9_0 is DEAD
2025-10-10T14:40:16.211446Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:16.220951Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|720dcaa1-8e048cfe-30258923-a8ee98a9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:16.221113Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:16.221133Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3251
2025-10-10T14:40:16.221254Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3251 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:16.221300Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3251 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:16.221310Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3251 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:16.221314Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:16.221777Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3251 sessionId:  describe result for acl check
2025-10-10T14:40:16.221816Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:16.221817Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:16.221821Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:16.221828Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602932491960841:8399] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:16.222406Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602932491960841:8399] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:16.223746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:16.225770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:16.225973Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:16.225986Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:16.225998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:16.226044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:16.226099Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602931709707381:12804]
2025-10-10T14:40:16.226557Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602932491960841:8399] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:16.226719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:16.227149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:16.227215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:16.227584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:16.227684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:16.227693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:16.227694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:16.227695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:16.227696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:16.227698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:16.227699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:16.227701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:16.227702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:16.227703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:16.227705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:16.227706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:16.227707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:16.227716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:16.227729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:16.227733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:16.227737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:16.227742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:16.227746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:16.227750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:16.227754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:16.227759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:16.227763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:16.227767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:16.227771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:16.227775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:16.227786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:16.227795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:16.227802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:16.227808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:16.227812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:16.227818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:16.227822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:16.227827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:16.227840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:16.227845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:16.227849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:16.227865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:16.227871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:16.227876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:16.227880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:16.227886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:16.227891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:16.227896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:16.227902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:16.227907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:16.227917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:16.227922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:16.227926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:16.227932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:16.227936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:16.227941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:16.227987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:16.230356Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602932491960841:8399] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:16.230373Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602932491960841:8399] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:16.230377Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602932491960841:8399] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:16.230387Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3251 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:16.230407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:16.230859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:16.230871Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:16.230874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:16.230880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:16.230886Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3250 [2:7559602931709707381:12804]
2025-10-10T14:40:16.230902Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:16.230920Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:16.230924Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:16.230929Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:16.230932Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:16.230948Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:16.230961Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:16.230968Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:16.231045Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:16.231055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:16.231057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:16.231059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:16.231133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:16.231142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:16.231155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:16.231172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:16.231199Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:16.231222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602932491960791:2438], now have 1 active actors on pipe
2025-10-10T14:40:16.231232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602932491960881:8399], now have 1 active actors on pipe
2025-10-10T14:40:16.231239Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602931709707375:12804]
2025-10-10T14:40:16.231218Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3250
2025-10-10T14:40:16.231242Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602931709707375:12804]
2025-10-10T14:40:16.231232Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3250
2025-10-10T14:40:16.231245Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602931709707375:12804]
2025-10-10T14:40:16.231263Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:16.231278Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:16.231300Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:16.231309Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:16.231321Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:16.231341Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:16.231346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:16.231347Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:16.231351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:16.231365Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602931709707375:12804]
2025-10-10T14:40:16.231374Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:16.231376Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:16.231404Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6da72f63-e86ec744-ec6b38e0-2dd1b8f1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:16.231418Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:16.231428Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:16.231430Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:16.231441Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:16.231456Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:16.231484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:16.231660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:16.231674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:16.231697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:16.231799Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3251 partition: 0 MaxSeqNo: 40 sessionId: src_id|6da72f63-e86ec744-ec6b38e0-2dd1b8f1_0
2025-10-10T14:40:16.232205Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|720dcaa1-8e048cfe-30258923-a8ee98a9_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|6da72f63-e86ec744-ec6b38e0-2dd1b8f1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:16.235128Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6da72f63-e86ec744-ec6b38e0-2dd1b8f1_0] Write session: try to update token
2025-10-10T14:40:16.235147Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6da72f63-e86ec744-ec6b38e0-2dd1b8f1_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:16.251433Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:16.251454Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:16.251458Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:16.251460Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:16.251470Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602931709707375:12804]
2025-10-10T14:40:16.251478Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602931709707375:12804]
2025-10-10T14:40:16.251483Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602931709707375:12804]
2025-10-10T14:40:16.251537Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:16.251545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:16.251553Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:16.251555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:16.251560Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:16.251569Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:16.251711Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:16.255409Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3251 sessionId: src_id|6da72f63-e86ec744-ec6b38e0-2dd1b8f1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:16.258556Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:16.309972Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602932491960888:2851]
2025-10-10T14:40:16.310824Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 pipe creation result: OK TabletId: 72075186224037892 Generation: 3250, pipe: [1:7559602932491960888:2851]
2025-10-10T14:40:16.375309Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:16.375622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:16.375638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:16.375685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602932491960888:2851], now have 1 active actors on pipe
2025-10-10T14:40:16.375991Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:16.376304Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:40:16.376320Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:40:16.376377Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3251 reason: error at write: Disconnected sessionId: src_id|6da72f63-e86ec744-ec6b38e0-2dd1b8f1_0
2025-10-10T14:40:16.376571Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3251 sessionId: src_id|6da72f63-e86ec744-ec6b38e0-2dd1b8f1_0 is DEAD
2025-10-10T14:40:16.376700Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:16.376761Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 49 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602932491960888:2851]
2025-10-10T14:40:16.377081Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6da72f63-e86ec744-ec6b38e0-2dd1b8f1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:40:16.377089Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6da72f63-e86ec744-ec6b38e0-2dd1b8f1_0] Write session will restart in 0.008314s
2025-10-10T14:40:16.377115Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6da72f63-e86ec744-ec6b38e0-2dd1b8f1_0] Write session: Do CDS request
2025-10-10T14:40:16.377121Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6da72f63-e86ec744-ec6b38e0-2dd1b8f1_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:16.386844Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6da72f63-e86ec744-ec6b38e0-2dd1b8f1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:16.387752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:16.389482Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:16.389500Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3252
2025-10-10T14:40:16.389689Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3252 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:16.389726Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3252 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:16.389733Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3252 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:16.389737Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:16.389864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:16.390088Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:16.390100Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:16.390112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:16.390164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:16.390208Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602931709707478:12807]
2025-10-10T14:40:16.390811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:16.391678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:16.391735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:16.392086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:16.392157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:16.392163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:16.392165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:16.392166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:16.392167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:16.392169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:16.392170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:16.392172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:16.392173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:16.392175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:16.392176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:16.392177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:16.392179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:16.392186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:16.392199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:16.392203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:16.392208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:16.392213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:16.392217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:16.392222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:16.392226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:16.392231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:16.392236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:16.392240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:16.392245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:16.392251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:16.392258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:16.392282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:16.390223Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3252 sessionId:  describe result for acl check
2025-10-10T14:40:16.390260Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:16.390262Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:16.390264Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:16.390270Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602932491960950:8409] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:16.390838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602932491960950:8409] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:16.392289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:16.392300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:16.392307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:16.392313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:16.392318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:16.392325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:16.392331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:16.392337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:16.392341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:16.392347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:16.392353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:16.392358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:16.392363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:16.392368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:16.392374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:16.392380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:16.392387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:16.392392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:16.392397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:16.392403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:16.392408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:16.392414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:16.392419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:16.392425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:16.392472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:16.396008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:16.396370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:16.396384Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:16.396387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:16.396394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:16.396401Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3251 [2:7559602931709707478:12807]
2025-10-10T14:40:16.396415Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:16.396434Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:16.396443Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:16.396447Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:16.396449Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:16.396467Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:16.396475Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:16.396483Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:16.396568Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:16.396572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:16.396574Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:16.396577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:16.396644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:16.396653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:16.396665Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:16.396676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:16.396701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:16.396731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602932491960890:2438], now have 1 active actors on pipe
2025-10-10T14:40:16.396745Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602931709707473:12807]
2025-10-10T14:40:16.396751Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602931709707473:12807]
2025-10-10T14:40:16.396753Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602931709707473:12807]
2025-10-10T14:40:16.396769Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:16.396789Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:16.396793Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:16.396796Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:16.396798Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:16.396804Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:16.396808Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:16.396846Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602931709707473:12807]
2025-10-10T14:40:16.396853Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:16.396868Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:16.396618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602932491960950:8409] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:16.396754Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3251
2025-10-10T14:40:16.405253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602932491960988:8409], now have 1 active actors on pipe
2025-10-10T14:40:16.404914Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602932491960950:8409] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:16.404935Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602932491960950:8409] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:16.404940Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602932491960950:8409] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:16.404950Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3252 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:16.405516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:16.405533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:16.405571Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2d59b359-2599822e-3f856e99-cdc4615a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:16.405593Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:16.405600Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:16.405603Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:16.405621Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:16.405641Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:16.405664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:16.405947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:16.405970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:16.406621Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6da72f63-e86ec744-ec6b38e0-2dd1b8f1_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|2d59b359-2599822e-3f856e99-cdc4615a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:16.405995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:16.405402Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3251
2025-10-10T14:40:16.406142Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3252 partition: 0 MaxSeqNo: 40 sessionId: src_id|2d59b359-2599822e-3f856e99-cdc4615a_0
2025-10-10T14:40:16.409425Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2d59b359-2599822e-3f856e99-cdc4615a_0] Write session: try to update token
2025-10-10T14:40:16.409444Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2d59b359-2599822e-3f856e99-cdc4615a_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:16.417276Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:40:16.417294Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:16.417307Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602931709707473:12807]
2025-10-10T14:40:16.417402Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:40:16.417450Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:40:16.417645Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:40:16.417798Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:16.417936Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:16.418071Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:16.418274Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:40:16.418314Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:40:16.429310Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3252 sessionId: src_id|2d59b359-2599822e-3f856e99-cdc4615a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:16.431958Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:16.431975Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:16.431982Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:16.431984Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:16.431995Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602931709707473:12807]
2025-10-10T14:40:16.431999Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602931709707473:12807]
2025-10-10T14:40:16.432002Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602931709707473:12807]
2025-10-10T14:40:16.432051Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:16.432052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:16.432036Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:16.432059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:16.432061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:16.432063Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:16.432068Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:16.432200Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:16.476871Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602932491960991:2851]
2025-10-10T14:40:16.477174Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 pipe creation result: OK TabletId: 72075186224037892 Generation: 3251, pipe: [1:7559602932491960991:2851]
2025-10-10T14:40:16.555864Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:16.556317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:16.556332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:16.556358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602932491960991:2851], now have 1 active actors on pipe
2025-10-10T14:40:16.556588Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:16.556649Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:16.556726Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 50 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602932491960991:2851]
2025-10-10T14:40:16.556736Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:40:16.556825Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3252 reason: status is not ok: tablet will be restarted right now sessionId: src_id|2d59b359-2599822e-3f856e99-cdc4615a_0
2025-10-10T14:40:16.557066Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3252 sessionId: src_id|2d59b359-2599822e-3f856e99-cdc4615a_0 is DEAD
2025-10-10T14:40:16.557440Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d59b359-2599822e-3f856e99-cdc4615a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:40:16.557453Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d59b359-2599822e-3f856e99-cdc4615a_0] Write session will restart in 0.005661s
2025-10-10T14:40:16.557481Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d59b359-2599822e-3f856e99-cdc4615a_0] Write session: Do CDS request
2025-10-10T14:40:16.557488Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d59b359-2599822e-3f856e99-cdc4615a_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:16.564893Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2d59b359-2599822e-3f856e99-cdc4615a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:16.565706Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:16.565725Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3253
2025-10-10T14:40:16.566393Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3253 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:16.566453Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3253 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:16.566460Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3253 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:16.566463Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:16.567208Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3253 sessionId:  describe result for acl check
2025-10-10T14:40:16.567249Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:16.567251Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:16.567253Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:16.567260Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602932491961053:8441] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:16.567886Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602932491961053:8441] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:16.573134Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602932491961053:8441] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:16.578837Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602932491961053:8441] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:16.578855Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602932491961053:8441] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:16.578859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602932491961053:8441] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:16.578870Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3253 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:16.583631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:16.584371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:16.584584Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:16.584590Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:16.584602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:16.584654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:16.584718Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602931709707613:12822]
2025-10-10T14:40:16.585372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:16.585699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:16.585752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:16.586221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:16.586299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:16.586301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:16.586302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:16.586304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:16.586306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:16.586307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:16.586309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:16.586310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:16.586312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:16.586313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:16.586317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:16.586318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:16.586320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:16.586326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:16.586340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:16.586344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:16.586348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:16.586352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:16.586356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:16.586360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:16.586364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:16.586367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:16.586371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:16.586375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:16.586378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:16.586381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:16.586389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:16.586397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:16.586403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:16.586408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:16.586412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:16.586418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:16.586422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:16.586427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:16.586433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:16.586439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:16.586446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:16.586451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:16.586456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:16.586462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:16.586467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:16.586473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:16.586506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:16.586517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:16.586521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:16.586526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:16.586532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:16.586539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:16.586543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:16.586549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:16.586559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:16.586564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:16.586613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:16.591987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:16.592344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:16.592358Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:16.592360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:16.592365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:16.592372Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3252 [2:7559602931709707613:12822]
2025-10-10T14:40:16.592388Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:16.592410Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:16.592418Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:16.592422Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:16.592425Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:16.592444Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:16.592457Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:16.592466Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:16.592538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:16.592549Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:16.592554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:16.592557Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:16.592633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:16.592641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:16.592665Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:16.592677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:16.592692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:16.592717Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602931709707608:12822]
2025-10-10T14:40:16.592719Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602931709707608:12822]
2025-10-10T14:40:16.592721Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602931709707608:12822]
2025-10-10T14:40:16.592731Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:16.592740Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:16.592743Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:16.592745Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:16.592746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602932491961103:8441], now have 1 active actors on pipe
2025-10-10T14:40:16.592754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602932491961020:2438], now have 1 active actors on pipe
2025-10-10T14:40:16.592760Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:16.592777Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:16.592781Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:16.592818Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602931709707608:12822]
2025-10-10T14:40:16.592830Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:16.592879Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3252
2025-10-10T14:40:16.592943Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3252
2025-10-10T14:40:16.592902Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:16.593204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:16.593212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:16.593245Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7b1658f1-85150d8-35be6077-4d6a751c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:16.593260Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:16.593272Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:16.593275Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:16.593288Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:16.593313Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:16.593343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:16.601615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:16.601640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:16.601703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:16.605626Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3253 partition: 0 MaxSeqNo: 40 sessionId: src_id|7b1658f1-85150d8-35be6077-4d6a751c_0
2025-10-10T14:40:16.609470Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d59b359-2599822e-3f856e99-cdc4615a_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|7b1658f1-85150d8-35be6077-4d6a751c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:16.612225Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7b1658f1-85150d8-35be6077-4d6a751c_0] Write session: try to update token
2025-10-10T14:40:16.612253Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7b1658f1-85150d8-35be6077-4d6a751c_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:16.623752Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:16.623769Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:16.623773Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:16.623775Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:16.623789Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602931709707608:12822]
2025-10-10T14:40:16.623794Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602931709707608:12822]
2025-10-10T14:40:16.623798Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602931709707608:12822]
2025-10-10T14:40:16.623849Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:16.623858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:16.623861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:16.624013Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:16.625519Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:16.625532Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:16.625536Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:16.641220Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3253 sessionId: src_id|7b1658f1-85150d8-35be6077-4d6a751c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:16.644003Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:16.657124Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602932491961116:2851]
2025-10-10T14:40:16.657607Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 pipe creation result: OK TabletId: 72075186224037892 Generation: 3252, pipe: [1:7559602932491961116:2851]
2025-10-10T14:40:16.741609Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:16.741925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:16.741936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:16.741961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602932491961116:2851], now have 1 active actors on pipe
2025-10-10T14:40:16.742585Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:16.743476Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:16.743484Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 51 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602932491961116:2851]
2025-10-10T14:40:16.743513Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:40:16.745600Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b1658f1-85150d8-35be6077-4d6a751c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:40:16.745615Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b1658f1-85150d8-35be6077-4d6a751c_0] Write session will restart in 0.005156s
2025-10-10T14:40:16.745640Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b1658f1-85150d8-35be6077-4d6a751c_0] Write session: Do CDS request
2025-10-10T14:40:16.745647Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b1658f1-85150d8-35be6077-4d6a751c_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:16.743583Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3253 reason: status is not ok: tablet will be restarted right now sessionId: src_id|7b1658f1-85150d8-35be6077-4d6a751c_0
2025-10-10T14:40:16.743788Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3253 sessionId: src_id|7b1658f1-85150d8-35be6077-4d6a751c_0 is DEAD
2025-10-10T14:40:16.751889Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7b1658f1-85150d8-35be6077-4d6a751c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:16.753021Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:16.753041Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3254
2025-10-10T14:40:16.753485Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3254 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:16.753525Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3254 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:16.753540Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3254 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:16.753545Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:16.754791Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3254 sessionId:  describe result for acl check
2025-10-10T14:40:16.754840Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:16.754847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:16.754849Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:16.754855Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602932491961157:8450] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:16.755401Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602932491961157:8450] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:16.758105Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602932491961157:8450] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:16.760000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:16.762362Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602932491961157:8450] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:16.762381Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602932491961157:8450] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:16.762385Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602932491961157:8450] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:16.762395Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3254 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:16.762059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:16.762284Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:16.762289Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:16.762301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:16.762356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:16.762400Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602931709707721:12824]
2025-10-10T14:40:16.763074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:16.763419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:16.763471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:16.763815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:16.763870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:16.763872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:16.763873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:16.763874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:16.763876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:16.763877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:16.763879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:16.763880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:16.763881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:16.763883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:16.763884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:16.763886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:16.763887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:16.763894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:16.763908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:16.763912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:16.763916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:16.763920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:16.763924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:16.763928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:16.763932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:16.763936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:16.763941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:16.763945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:16.763952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:16.763956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:16.763963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:16.763972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:16.763979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:16.763986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:16.763991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:16.763997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:16.764002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:16.764007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:16.764011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:16.764016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:16.764020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:16.764026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:16.764030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:16.764034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:16.764039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:16.764045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:16.764050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:16.764056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:16.764061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:16.764066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:16.764072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:16.764078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:16.764083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:16.764088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:16.764092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:16.764098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:16.764142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:16.766688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:16.767200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:16.767214Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:16.767217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:16.767221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:16.767228Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3253 [2:7559602931709707721:12824]
2025-10-10T14:40:16.767242Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:16.767261Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:16.767270Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:16.767273Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:16.767276Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:16.767307Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:16.767320Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:16.767330Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:16.767399Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:16.767407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:16.767410Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:16.767412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:16.767484Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:16.767491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:16.767503Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:16.767516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:16.767533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:16.767555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602932491961207:8450], now have 1 active actors on pipe
2025-10-10T14:40:16.767561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602932491961119:2438], now have 1 active actors on pipe
2025-10-10T14:40:16.767569Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602931709707715:12824]
2025-10-10T14:40:16.767571Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602931709707715:12824]
2025-10-10T14:40:16.767574Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602931709707715:12824]
2025-10-10T14:40:16.767587Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:16.767601Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:16.767604Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:16.767607Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:16.767609Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:16.767620Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:16.767623Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:16.767655Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602931709707715:12824]
2025-10-10T14:40:16.767667Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:16.767675Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:16.767808Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3253
2025-10-10T14:40:16.767842Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3253
2025-10-10T14:40:16.773442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:16.773469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:16.773519Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|45043eb4-ff767eab-e2304549-fe36569b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:16.773534Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:16.773541Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:16.773547Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:16.773565Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:16.773586Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:16.773609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:16.775007Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3254 partition: 0 MaxSeqNo: 40 sessionId: src_id|45043eb4-ff767eab-e2304549-fe36569b_0
2025-10-10T14:40:16.774593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:16.774607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:16.774628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:16.777469Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b1658f1-85150d8-35be6077-4d6a751c_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|45043eb4-ff767eab-e2304549-fe36569b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:16.780573Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|45043eb4-ff767eab-e2304549-fe36569b_0] Write session: try to update token
2025-10-10T14:40:16.780595Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|45043eb4-ff767eab-e2304549-fe36569b_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:16.781159Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:40:16.781184Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:16.781194Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602931709707715:12824]
2025-10-10T14:40:16.781244Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:40:16.781258Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:40:16.781448Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:40:16.781606Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:16.781768Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:16.781927Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:16.782149Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:40:16.782197Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:40:16.804855Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:16.804872Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:16.804875Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:16.804877Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:16.804886Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602931709707715:12824]
2025-10-10T14:40:16.804890Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602931709707715:12824]
2025-10-10T14:40:16.804892Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602931709707715:12824]
2025-10-10T14:40:16.804929Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:16.804938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:16.804940Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:16.805072Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:16.806609Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:16.806615Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:16.806619Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:16.803751Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3254 sessionId: src_id|45043eb4-ff767eab-e2304549-fe36569b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:16.806465Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:16.843458Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602932491961220:2851]
2025-10-10T14:40:16.843860Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 pipe creation result: OK TabletId: 72075186224037892 Generation: 3253, pipe: [1:7559602932491961220:2851]
2025-10-10T14:40:16.922231Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:16.922631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:16.922648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:16.922673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602932491961220:2851], now have 1 active actors on pipe
2025-10-10T14:40:16.923318Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:16.922937Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:16.923384Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 52 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602932491961220:2851]
2025-10-10T14:40:16.923415Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:40:16.923497Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3254 reason: status is not ok: tablet will be restarted right now sessionId: src_id|45043eb4-ff767eab-e2304549-fe36569b_0
2025-10-10T14:40:16.923696Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3254 sessionId: src_id|45043eb4-ff767eab-e2304549-fe36569b_0 is DEAD
2025-10-10T14:40:16.925180Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45043eb4-ff767eab-e2304549-fe36569b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:40:16.925191Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45043eb4-ff767eab-e2304549-fe36569b_0] Write session will restart in 0.007447s
2025-10-10T14:40:16.925214Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45043eb4-ff767eab-e2304549-fe36569b_0] Write session: Do CDS request
2025-10-10T14:40:16.925220Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45043eb4-ff767eab-e2304549-fe36569b_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:16.934000Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|45043eb4-ff767eab-e2304549-fe36569b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:16.935049Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:16.935068Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3255
2025-10-10T14:40:16.934837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:16.936856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:16.937080Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:16.937086Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:16.937098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:16.937152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:16.937189Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602931709707819:12827]
2025-10-10T14:40:16.937643Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3255 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:16.937716Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3255 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:16.937728Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3255 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:16.937733Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:16.937867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:16.938213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:16.938237Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3255 sessionId:  describe result for acl check
2025-10-10T14:40:16.938257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:16.938276Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:16.938283Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:16.938285Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:16.938291Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602932491961305:8463] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:16.938586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:16.938653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:16.938660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:16.938661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:16.938663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:16.938664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:16.938666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:16.938667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:16.938669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:16.938670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:16.938672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:16.938673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:16.938674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:16.938675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:16.938682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:16.938695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:16.938700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:16.938704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:16.938708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:16.938712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:16.938716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:16.938721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:16.938725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:16.938729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:16.938734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:16.938738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:16.938742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:16.938751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:16.938760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:16.938766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:16.938772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:16.938777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:16.938783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:16.938788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:16.938793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:16.938810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:16.938815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:16.938819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:16.938824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:16.938829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:16.938835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:16.938839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:16.938844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:16.938852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:16.938858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:16.938863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:16.938869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:16.938879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:16.938862Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602932491961305:8463] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:16.938884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:16.938888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:16.938894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:16.938900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:16.938906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:16.938949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:16.941494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:16.941609Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602932491961305:8463] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:16.941977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:16.941991Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:16.941994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:16.941998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:16.942003Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3254 [2:7559602931709707819:12827]
2025-10-10T14:40:16.942017Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:16.942037Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:16.942040Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:16.942044Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:16.942046Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:16.942064Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:16.942071Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:16.942079Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:16.942173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:16.942187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:16.942189Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:16.942192Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:16.942286Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:16.942298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:16.942313Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:16.942335Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:16.942361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:16.942402Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602931709707813:12827]
2025-10-10T14:40:16.942414Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602931709707813:12827]
2025-10-10T14:40:16.942419Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602931709707813:12827]
2025-10-10T14:40:16.942441Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:16.942462Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:16.942477Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:16.942482Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:16.942486Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:16.942487Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:16.942492Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:16.942523Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602931709707813:12827]
2025-10-10T14:40:16.942537Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:16.942539Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:16.942547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602932491961232:2438], now have 1 active actors on pipe
2025-10-10T14:40:16.942590Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3254
2025-10-10T14:40:16.949503Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602932491961305:8463] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:16.949524Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602932491961305:8463] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:16.949529Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602932491961305:8463] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:16.949541Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3255 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:16.950297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602932491961339:8463], now have 1 active actors on pipe
2025-10-10T14:40:16.950296Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3254
2025-10-10T14:40:16.951624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:16.951646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:16.951698Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9f152d70-63a5e8a2-998f52c9-7fa6940_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:16.951712Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:16.951718Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:16.951722Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:16.951738Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:16.951768Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:16.951791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:16.952401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:16.952416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:16.952441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:16.952625Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3255 partition: 0 MaxSeqNo: 40 sessionId: src_id|9f152d70-63a5e8a2-998f52c9-7fa6940_0
2025-10-10T14:40:16.953065Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45043eb4-ff767eab-e2304549-fe36569b_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|9f152d70-63a5e8a2-998f52c9-7fa6940_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:16.955894Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9f152d70-63a5e8a2-998f52c9-7fa6940_0] Write session: try to update token
2025-10-10T14:40:16.955915Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9f152d70-63a5e8a2-998f52c9-7fa6940_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:16.962704Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:16.962725Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:16.962730Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:16.962732Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:16.962741Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602931709707813:12827]
2025-10-10T14:40:16.962747Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602931709707813:12827]
2025-10-10T14:40:16.962751Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602931709707813:12827]
2025-10-10T14:40:16.962805Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:16.962805Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:16.962813Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:16.962817Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:16.962820Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:16.962825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:16.962964Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:16.973681Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3255 sessionId: src_id|9f152d70-63a5e8a2-998f52c9-7fa6940_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:16.976356Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:17.023687Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602936786928640:2851]
2025-10-10T14:40:17.024146Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 pipe creation result: OK TabletId: 72075186224037892 Generation: 3254, pipe: [1:7559602936786928640:2851]
2025-10-10T14:40:17.085864Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:17.086211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:17.086227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:17.086251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602936786928640:2851], now have 1 active actors on pipe
2025-10-10T14:40:17.086546Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:17.086581Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:40:17.086585Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:40:17.086618Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 53 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602936786928640:2851]
2025-10-10T14:40:17.086662Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3255 reason: error at write: Disconnected sessionId: src_id|9f152d70-63a5e8a2-998f52c9-7fa6940_0
2025-10-10T14:40:17.086541Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:17.086891Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3255 sessionId: src_id|9f152d70-63a5e8a2-998f52c9-7fa6940_0 is DEAD
2025-10-10T14:40:17.089450Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f152d70-63a5e8a2-998f52c9-7fa6940_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:40:17.089464Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f152d70-63a5e8a2-998f52c9-7fa6940_0] Write session will restart in 0.005299s
2025-10-10T14:40:17.089497Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f152d70-63a5e8a2-998f52c9-7fa6940_0] Write session: Do CDS request
2025-10-10T14:40:17.089503Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f152d70-63a5e8a2-998f52c9-7fa6940_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:17.095961Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9f152d70-63a5e8a2-998f52c9-7fa6940_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:17.096067Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:17.096087Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3256
2025-10-10T14:40:17.096206Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3256 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:17.096237Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3256 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:17.096243Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3256 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:17.096247Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:17.096737Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3256 sessionId:  describe result for acl check
2025-10-10T14:40:17.096792Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:17.096800Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:17.096802Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:17.096809Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602936786928700:8467] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:17.097408Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602936786928700:8467] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:17.097387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:17.099376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:17.099566Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602936786928700:8467] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:17.099603Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:17.099617Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:17.099631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:17.099697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:17.099760Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602936004675214:12829]
2025-10-10T14:40:17.100454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:17.100762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:17.100811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:17.101164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:17.101235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:17.101243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:17.101245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:17.101246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:17.101247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:17.101249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:17.101250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:17.101252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:17.101254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:17.101255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:17.101256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:17.101258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:17.101259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:17.101266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:17.101280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:17.101285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:17.101290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:17.101294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:17.101299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:17.101303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:17.101308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:17.101312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:17.101317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:17.101322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:17.101326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:17.101347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:17.101355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:17.101365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:17.101373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:17.101379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:17.101385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:17.101391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:17.101396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:17.101402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:17.101409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:17.101415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:17.101420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:17.101427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:17.101433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:17.101438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:17.101443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:17.101449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:17.101455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:17.101460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:17.101466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:17.101472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:17.101486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:17.101493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:17.101497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:17.101502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:17.101507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:17.101513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:17.101570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:17.102371Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602936786928700:8467] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:17.102386Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602936786928700:8467] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:17.102390Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602936786928700:8467] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:17.102411Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3256 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:17.104267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:17.104639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:17.104653Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:17.104658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:17.104662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:17.104669Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3255 [2:7559602936004675214:12829]
2025-10-10T14:40:17.104683Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:17.104701Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:17.104710Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:17.104714Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:17.104716Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:17.104735Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:17.104742Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:17.104755Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:17.104828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:17.104835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:17.104837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:17.104841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:17.104914Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:17.104922Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:17.104934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:17.104956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:17.104977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:17.105000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602936786928735:8467], now have 1 active actors on pipe
2025-10-10T14:40:17.105004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602936786928641:2438], now have 1 active actors on pipe
2025-10-10T14:40:17.105012Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602936004675208:12829]
2025-10-10T14:40:17.105016Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602936004675208:12829]
2025-10-10T14:40:17.105018Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602936004675208:12829]
2025-10-10T14:40:17.105039Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:17.105054Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:17.105075Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:17.105080Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:17.105077Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3255
2025-10-10T14:40:17.105108Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3255
2025-10-10T14:40:17.105106Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:17.105109Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602936004675208:12829]
2025-10-10T14:40:17.105112Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:17.105115Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:17.105117Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:17.105124Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:17.105203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:17.105209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:17.105242Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|77f2db36-fbd371e0-c67e114f-1b5b40ab_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:17.105250Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:17.105257Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:17.105259Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:17.105271Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:17.105288Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:17.105307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:17.105513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:17.105523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:17.105540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:17.105648Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3256 partition: 0 MaxSeqNo: 40 sessionId: src_id|77f2db36-fbd371e0-c67e114f-1b5b40ab_0
2025-10-10T14:40:17.106088Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f152d70-63a5e8a2-998f52c9-7fa6940_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|77f2db36-fbd371e0-c67e114f-1b5b40ab_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:17.108714Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|77f2db36-fbd371e0-c67e114f-1b5b40ab_0] Write session: try to update token
2025-10-10T14:40:17.108732Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|77f2db36-fbd371e0-c67e114f-1b5b40ab_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:17.124055Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3256 sessionId: src_id|77f2db36-fbd371e0-c67e114f-1b5b40ab_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:17.126863Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:17.128434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:17.128462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:17.128486Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:17.128490Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:17.128497Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:17.128499Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:17.128510Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602936004675208:12829]
2025-10-10T14:40:17.128516Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602936004675208:12829]
2025-10-10T14:40:17.128520Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602936004675208:12829]
2025-10-10T14:40:17.128564Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:17.128583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:17.128586Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:17.128591Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:17.128591Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:17.128594Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:17.128730Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:17.189431Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602936786928744:2851]
2025-10-10T14:40:17.193023Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 pipe creation result: OK TabletId: 72075186224037892 Generation: 3255, pipe: [1:7559602936786928744:2851]
2025-10-10T14:40:17.244102Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:17.244479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:40:17.244551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602936786928744:2851], now have 1 active actors on pipe
2025-10-10T14:40:17.245493Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:40:17.245580Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:17.245615Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:40:17.245618Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:40:17.245627Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 54 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602936786928744:2851]
2025-10-10T14:40:17.245713Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3256 reason: error at write: Disconnected sessionId: src_id|77f2db36-fbd371e0-c67e114f-1b5b40ab_0
2025-10-10T14:40:17.245907Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3256 sessionId: src_id|77f2db36-fbd371e0-c67e114f-1b5b40ab_0 is DEAD
2025-10-10T14:40:17.249578Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77f2db36-fbd371e0-c67e114f-1b5b40ab_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:40:17.249591Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77f2db36-fbd371e0-c67e114f-1b5b40ab_0] Write session will restart in 0.009239s
2025-10-10T14:40:17.249618Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77f2db36-fbd371e0-c67e114f-1b5b40ab_0] Write session: Do CDS request
2025-10-10T14:40:17.249625Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77f2db36-fbd371e0-c67e114f-1b5b40ab_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:17.259153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:17.259943Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|77f2db36-fbd371e0-c67e114f-1b5b40ab_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:17.260113Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:17.260135Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3257
2025-10-10T14:40:17.260284Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3257 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:17.260324Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3257 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:17.260336Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3257 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:17.260341Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:17.260834Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3257 sessionId:  describe result for acl check
2025-10-10T14:40:17.260880Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:17.260887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:17.260889Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:17.260896Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602936786928808:8474] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:17.261423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:17.261515Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602936786928808:8474] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:17.261654Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:17.261669Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:17.261681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:17.261751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:17.261804Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602936004675314:12831]
2025-10-10T14:40:17.262384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:17.262776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:17.262836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:17.263175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:17.263250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:17.263251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:17.263252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:17.263253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:17.263255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:17.263256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:17.263257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:17.263259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:17.263260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:17.263261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:17.263263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:17.263264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:17.263265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:17.263274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:17.263287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:17.263292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:17.263296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:17.263300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:17.263305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:17.263310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:17.263315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:17.263319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:17.263324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:17.263328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:17.263332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:17.263335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:17.263343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:17.263352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:17.263360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:17.263366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:17.263371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:17.263377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:17.263382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:17.263388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:17.263393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:17.263399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:17.263404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:17.263409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:17.263414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:17.263421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:17.263428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:17.263434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:17.263439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:17.263447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:17.263452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:17.263458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:17.263463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:17.263469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:17.263474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:17.263480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:17.263485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:17.263491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:17.263534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:17.263943Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602936786928808:8474] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:17.266245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:17.266783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:17.266797Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:17.266799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:17.266803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:17.266811Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3256 [2:7559602936004675314:12831]
2025-10-10T14:40:17.266824Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:17.266841Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:17.266847Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:17.266850Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:17.266853Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:17.266871Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:17.266881Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:17.266896Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:17.266958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:17.266965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:17.266967Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:17.266970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:17.267044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:17.267053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:17.267066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:17.267079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:17.267097Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:17.267122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602936786928745:2438], now have 1 active actors on pipe
2025-10-10T14:40:17.267132Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602936004675309:12831]
2025-10-10T14:40:17.267134Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602936004675309:12831]
2025-10-10T14:40:17.267137Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602936004675309:12831]
2025-10-10T14:40:17.267151Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:17.267169Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:17.267191Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:17.267199Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:17.267207Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:17.267210Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:17.267212Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:17.267191Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3256
2025-10-10T14:40:17.267229Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602936004675309:12831]
2025-10-10T14:40:17.267236Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:17.267248Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:17.273416Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602936786928808:8474] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:17.273438Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602936786928808:8474] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:17.273442Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602936786928808:8474] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:17.273453Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3257 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:17.274134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602936786928845:8474], now have 1 active actors on pipe
2025-10-10T14:40:17.274649Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3256
2025-10-10T14:40:17.274723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:17.274738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:17.274774Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|82e3b24f-454c9f03-a675a301-37e1fa7f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:17.274802Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:17.274809Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:17.274813Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:17.274829Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:17.274853Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:17.274890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:17.275109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:17.275129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:17.275150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:17.275251Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3257 partition: 0 MaxSeqNo: 40 sessionId: src_id|82e3b24f-454c9f03-a675a301-37e1fa7f_0
2025-10-10T14:40:17.275796Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77f2db36-fbd371e0-c67e114f-1b5b40ab_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|82e3b24f-454c9f03-a675a301-37e1fa7f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:17.278688Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|82e3b24f-454c9f03-a675a301-37e1fa7f_0] Write session: try to update token
2025-10-10T14:40:17.278709Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|82e3b24f-454c9f03-a675a301-37e1fa7f_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:17.287665Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:17.287688Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:17.287691Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:17.287693Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:17.287704Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602936004675309:12831]
2025-10-10T14:40:17.287713Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602936004675309:12831]
2025-10-10T14:40:17.287716Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602936004675309:12831]
2025-10-10T14:40:17.287769Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:17.287782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:17.287784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:17.287918Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:17.293168Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:17.293184Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:17.293191Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:17.296738Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3257 sessionId: src_id|82e3b24f-454c9f03-a675a301-37e1fa7f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:17.299463Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:17.345754Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602936786928849:2851]
2025-10-10T14:40:17.346149Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 pipe creation result: OK TabletId: 72075186224037892 Generation: 3256, pipe: [1:7559602936786928849:2851]
2025-10-10T14:40:17.414552Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:17.415061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:17.415072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:17.415097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602936786928849:2851], now have 1 active actors on pipe
2025-10-10T14:40:17.415348Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:17.416314Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:17.417155Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82e3b24f-454c9f03-a675a301-37e1fa7f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:40:17.417168Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82e3b24f-454c9f03-a675a301-37e1fa7f_0] Write session will restart in 0.009276s
2025-10-10T14:40:17.417194Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82e3b24f-454c9f03-a675a301-37e1fa7f_0] Write session: Do CDS request
2025-10-10T14:40:17.417201Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82e3b24f-454c9f03-a675a301-37e1fa7f_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:17.416376Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:40:17.416459Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3257 reason: status is not ok: tablet will be restarted right now sessionId: src_id|82e3b24f-454c9f03-a675a301-37e1fa7f_0
2025-10-10T14:40:17.416675Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3257 sessionId: src_id|82e3b24f-454c9f03-a675a301-37e1fa7f_0 is DEAD
2025-10-10T14:40:17.416833Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 55 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602936786928849:2851]
2025-10-10T14:40:17.429883Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|82e3b24f-454c9f03-a675a301-37e1fa7f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:17.430023Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:17.430042Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3258
2025-10-10T14:40:17.430213Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3258 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:17.430248Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3258 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:17.430258Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3258 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:17.430262Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:17.430744Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3258 sessionId:  describe result for acl check
2025-10-10T14:40:17.430786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:17.430793Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:17.430795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:17.430802Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602936786928912:8478] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:17.431452Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602936786928912:8478] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:17.432098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:17.434283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:17.434352Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602936786928912:8478] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:17.434542Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:17.434556Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:17.434570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:17.434646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:17.434694Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602936004675417:12834]
2025-10-10T14:40:17.435362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:17.435747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:17.435798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:17.436128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:17.436187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:17.436193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:17.436194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:17.436196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:17.436197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:17.436199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:17.436200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:17.436202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:17.436203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:17.436205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:17.436206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:17.436208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:17.436209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:17.436216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:17.436230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:17.436234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:17.436239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:17.436244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:17.436248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:17.436265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:17.436269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:17.436274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:17.436279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:17.436282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:17.436287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:17.436291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:17.436299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:17.436309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:17.436316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:17.436323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:17.436327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:17.436333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:17.436338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:17.436344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:17.436349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:17.436355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:17.436368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:17.436373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:17.436378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:17.436384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:17.436389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:17.436395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:17.436400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:17.436405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:17.436410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:17.436416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:17.436421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:17.436426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:17.436431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:17.436437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:17.436444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:17.436449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:17.436493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:17.440840Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602936786928912:8478] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:17.440861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602936786928912:8478] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:17.440866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602936786928912:8478] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:17.440876Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3258 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:17.441451Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3257
2025-10-10T14:40:17.441482Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3257
2025-10-10T14:40:17.440627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:17.441120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:17.441126Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:17.441129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:17.441133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:17.441140Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3257 [2:7559602936004675417:12834]
2025-10-10T14:40:17.441155Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:17.441177Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:17.441183Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:17.441188Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:17.441191Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:17.441210Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:17.441219Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:17.441227Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:17.441288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:17.441290Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:17.441292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:17.441295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:17.441391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:17.441394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:17.441407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:17.441417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:17.441433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:17.441457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602936786928850:2438], now have 1 active actors on pipe
2025-10-10T14:40:17.441460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602936786928947:8478], now have 1 active actors on pipe
2025-10-10T14:40:17.441469Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602936004675412:12834]
2025-10-10T14:40:17.441471Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602936004675412:12834]
2025-10-10T14:40:17.441473Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602936004675412:12834]
2025-10-10T14:40:17.441487Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:17.441501Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:17.441511Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:17.441516Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:17.441516Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:17.441517Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:17.441521Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:17.441572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:17.441577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:17.441592Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602936004675412:12834]
2025-10-10T14:40:17.441604Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:17.441614Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:17.441638Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5ad7eed5-c3cac568-13e84102-34634e6a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:17.441646Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:17.441651Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:17.441653Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:17.441665Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:17.441676Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:17.441700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:17.441946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:17.441958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:17.441989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:17.442157Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3258 partition: 0 MaxSeqNo: 40 sessionId: src_id|5ad7eed5-c3cac568-13e84102-34634e6a_0
2025-10-10T14:40:17.443300Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82e3b24f-454c9f03-a675a301-37e1fa7f_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|5ad7eed5-c3cac568-13e84102-34634e6a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:17.446001Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5ad7eed5-c3cac568-13e84102-34634e6a_0] Write session: try to update token
2025-10-10T14:40:17.446021Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5ad7eed5-c3cac568-13e84102-34634e6a_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:17.463554Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:17.463578Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:17.463582Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:17.463584Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:17.463595Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602936004675412:12834]
2025-10-10T14:40:17.463601Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602936004675412:12834]
2025-10-10T14:40:17.463606Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602936004675412:12834]
2025-10-10T14:40:17.463660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:17.463668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:17.463671Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:17.463821Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:17.465537Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:17.465545Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:17.465549Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:17.482953Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3258 sessionId: src_id|5ad7eed5-c3cac568-13e84102-34634e6a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:17.485787Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:17.517281Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602936786928956:2851]
2025-10-10T14:40:17.518186Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 pipe creation result: OK TabletId: 72075186224037892 Generation: 3257, pipe: [1:7559602936786928956:2851]
2025-10-10T14:40:17.592321Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:17.592390Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 56 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602936786928956:2851]
2025-10-10T14:40:17.592415Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:40:17.592493Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3258 reason: status is not ok: tablet will be restarted right now sessionId: src_id|5ad7eed5-c3cac568-13e84102-34634e6a_0
2025-10-10T14:40:17.592719Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3258 sessionId: src_id|5ad7eed5-c3cac568-13e84102-34634e6a_0 is DEAD
2025-10-10T14:40:17.589608Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:17.590016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:17.590026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:17.590052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602936786928956:2851], now have 1 active actors on pipe
2025-10-10T14:40:17.590416Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:17.593425Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ad7eed5-c3cac568-13e84102-34634e6a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:40:17.593437Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ad7eed5-c3cac568-13e84102-34634e6a_0] Write session will restart in 0.009499s
2025-10-10T14:40:17.593466Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ad7eed5-c3cac568-13e84102-34634e6a_0] Write session: Do CDS request
2025-10-10T14:40:17.593472Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ad7eed5-c3cac568-13e84102-34634e6a_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:17.603991Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5ad7eed5-c3cac568-13e84102-34634e6a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:17.605474Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:17.605492Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3259
2025-10-10T14:40:17.605646Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3259 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:17.605692Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3259 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:17.605698Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3259 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:17.605702Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:17.606164Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3259 sessionId:  describe result for acl check
2025-10-10T14:40:17.606198Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:17.606200Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:17.606202Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:17.606208Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602936786929018:8511] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:17.607231Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602936786929018:8511] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:17.612723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602936786929018:8511] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:17.615852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:17.616545Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602936786929018:8511] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:17.616565Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602936786929018:8511] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:17.616569Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602936786929018:8511] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:17.616580Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3259 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:17.618000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:17.618229Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:17.618247Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:17.618260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:17.618321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:17.618369Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602936004675559:12842]
2025-10-10T14:40:17.619015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:17.619374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:17.619430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:17.619749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:17.619831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:17.619832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:17.619834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:17.619835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:17.619836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:17.619837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:17.619839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:17.619840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:17.619841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:17.619843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:17.619844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:17.619845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:17.619847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:17.619853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:17.619868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:17.619872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:17.619877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:17.619881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:17.619886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:17.619890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:17.619895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:17.619899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:17.619904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:17.619907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:17.619911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:17.619914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:17.619923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:17.619934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:17.619941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:17.619947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:17.619953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:17.619959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:17.619964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:17.619970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:17.619975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:17.619980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:17.619984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:17.619990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:17.619996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:17.620002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:17.620008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:17.620014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:17.620019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:17.620024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:17.620030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:17.620035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:17.620042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:17.620048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:17.620052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:17.620058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:17.620063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:17.620069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:17.620114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:17.622953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:17.623495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:17.623508Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:17.623511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:17.623516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:17.623527Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3258 [2:7559602936004675559:12842]
2025-10-10T14:40:17.623545Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:17.623570Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:17.623575Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:17.623578Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:17.623581Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:17.623601Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:17.623614Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:17.623628Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:17.623697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:17.623705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:17.623707Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:17.623711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:17.623790Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:17.623798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:17.623811Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:17.623824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:17.623840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:17.623872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602936786928970:2438], now have 1 active actors on pipe
2025-10-10T14:40:17.623889Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602936004675553:12842]
2025-10-10T14:40:17.623895Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602936004675553:12842]
2025-10-10T14:40:17.623903Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602936004675553:12842]
2025-10-10T14:40:17.623920Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:17.623939Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:17.623942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602936786929075:8511], now have 1 active actors on pipe
2025-10-10T14:40:17.623947Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:17.623949Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:17.623951Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:17.623967Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:17.623971Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:17.623972Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3258
2025-10-10T14:40:17.624009Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602936004675553:12842]
2025-10-10T14:40:17.623989Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3258
2025-10-10T14:40:17.624017Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:17.624019Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:17.624047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:17.624058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:17.624107Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|eab72854-f67d3942-c7bd151b-298ebae9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:17.624122Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:17.624127Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:17.624129Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:17.624142Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:17.624154Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:17.624183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:17.624384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:17.624407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:17.624436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:17.624686Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3259 partition: 0 MaxSeqNo: 40 sessionId: src_id|eab72854-f67d3942-c7bd151b-298ebae9_0
2025-10-10T14:40:17.625125Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ad7eed5-c3cac568-13e84102-34634e6a_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|eab72854-f67d3942-c7bd151b-298ebae9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:17.628006Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eab72854-f67d3942-c7bd151b-298ebae9_0] Write session: try to update token
2025-10-10T14:40:17.628031Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eab72854-f67d3942-c7bd151b-298ebae9_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:17.644332Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:17.644351Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:17.644354Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:17.644356Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:17.644367Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602936004675553:12842]
2025-10-10T14:40:17.644372Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602936004675553:12842]
2025-10-10T14:40:17.644378Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602936004675553:12842]
2025-10-10T14:40:17.644432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:17.644447Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:17.644453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:17.644605Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:17.644899Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:17.644913Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:17.644918Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:17.651440Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3259 sessionId: src_id|eab72854-f67d3942-c7bd151b-298ebae9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:17.654174Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:17.691368Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602936786929088:2851]
2025-10-10T14:40:17.691740Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 pipe creation result: OK TabletId: 72075186224037892 Generation: 3258, pipe: [1:7559602936786929088:2851]
2025-10-10T14:40:17.765204Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:17.765677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:17.765694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:17.765723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602936786929088:2851], now have 1 active actors on pipe
2025-10-10T14:40:17.765984Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:17.766233Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 57 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602936786929088:2851]
2025-10-10T14:40:17.766276Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:40:17.766739Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eab72854-f67d3942-c7bd151b-298ebae9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:40:17.766756Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eab72854-f67d3942-c7bd151b-298ebae9_0] Write session will restart in 0.009220s
2025-10-10T14:40:17.766349Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3259 reason: status is not ok: tablet will be restarted right now sessionId: src_id|eab72854-f67d3942-c7bd151b-298ebae9_0
2025-10-10T14:40:17.766478Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:17.766788Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eab72854-f67d3942-c7bd151b-298ebae9_0] Write session: Do CDS request
2025-10-10T14:40:17.766566Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3259 sessionId: src_id|eab72854-f67d3942-c7bd151b-298ebae9_0 is DEAD
2025-10-10T14:40:17.766800Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eab72854-f67d3942-c7bd151b-298ebae9_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:17.776927Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eab72854-f67d3942-c7bd151b-298ebae9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:17.777052Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:17.777073Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3260
2025-10-10T14:40:17.777223Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3260 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:17.777266Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3260 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:17.777278Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3260 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:17.777282Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:17.777726Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3260 sessionId:  describe result for acl check
2025-10-10T14:40:17.777772Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:17.777775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:17.777777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:17.777783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602936786929153:8529] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:17.778405Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602936786929153:8529] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:17.779320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:17.781000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:17.781261Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:17.781267Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:17.781280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:17.781358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:17.781399Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602936004675673:12852]
2025-10-10T14:40:17.782052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:17.782371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:17.782583Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602936786929153:8529] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:17.782426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:17.782775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:17.782840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:17.782841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:17.782843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:17.782844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:17.782846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:17.782847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:17.782849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:17.782850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:17.782852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:17.782853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:17.782855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:17.782856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:17.782858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:17.782865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:17.782879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:17.782884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:17.782888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:17.782892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:17.782897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:17.782901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:17.782906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:17.782910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:17.782916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:17.782920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:17.782925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:17.782929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:17.782937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:17.782946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:17.782955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:17.782961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:17.782966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:17.782972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:17.782977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:17.782983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:17.782988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:17.782994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:17.783000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:17.783006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:17.783012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:17.783018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:17.783023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:17.783029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:17.783035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:17.783042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:17.783048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:17.783055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:17.783060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:17.783066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:17.783071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:17.783094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:17.783099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:17.783104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:17.783146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:17.785925Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602936786929153:8529] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:17.785944Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602936786929153:8529] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:17.785948Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602936786929153:8529] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:17.785957Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3260 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:17.786760Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3259
2025-10-10T14:40:17.785983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:17.786334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:17.786790Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3259
2025-10-10T14:40:17.786339Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:17.786342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:17.786347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:17.786353Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3259 [2:7559602936004675673:12852]
2025-10-10T14:40:17.786367Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:17.786389Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:17.786393Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:17.786396Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:17.786399Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:17.786417Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:17.786424Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:17.786432Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:17.786490Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:17.786492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:17.786494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:17.786497Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:17.786574Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:17.786577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:17.786589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:17.786601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:17.786620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:17.786643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602936786929188:8529], now have 1 active actors on pipe
2025-10-10T14:40:17.786647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602936786929089:2438], now have 1 active actors on pipe
2025-10-10T14:40:17.786655Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602936004675667:12852]
2025-10-10T14:40:17.786678Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602936004675667:12852]
2025-10-10T14:40:17.786681Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602936004675667:12852]
2025-10-10T14:40:17.786696Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:17.786711Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:17.786730Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:17.786734Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:17.786743Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:17.786747Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:17.786749Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:17.786766Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602936004675667:12852]
2025-10-10T14:40:17.786769Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:17.786772Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:17.786941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:17.786950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:17.786986Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a548e4dc-23c4fba3-62ad485e-4e872b46_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:17.787003Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:17.787007Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:17.787010Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:17.787023Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:17.787037Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:17.787057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:17.787448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:17.787460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:17.787480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:17.787800Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3260 partition: 0 MaxSeqNo: 40 sessionId: src_id|a548e4dc-23c4fba3-62ad485e-4e872b46_0
2025-10-10T14:40:17.788232Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eab72854-f67d3942-c7bd151b-298ebae9_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|a548e4dc-23c4fba3-62ad485e-4e872b46_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:17.791191Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a548e4dc-23c4fba3-62ad485e-4e872b46_0] Write session: try to update token
2025-10-10T14:40:17.791212Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a548e4dc-23c4fba3-62ad485e-4e872b46_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:17.806932Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:40:17.806951Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:17.806964Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602936004675667:12852]
2025-10-10T14:40:17.807014Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:40:17.807021Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:40:17.807209Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:40:17.807357Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:17.807513Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:17.807659Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:17.807851Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:40:17.807890Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:40:17.810736Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3260 sessionId: src_id|a548e4dc-23c4fba3-62ad485e-4e872b46_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:17.813676Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:17.814151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:17.814182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:17.814225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:40:17.814401Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:40:17.827457Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:17.827479Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:17.827485Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:17.827487Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:17.827498Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602936004675667:12852]
2025-10-10T14:40:17.827501Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602936004675667:12852]
2025-10-10T14:40:17.827506Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602936004675667:12852]
2025-10-10T14:40:17.827551Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:17.827554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:17.827561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:17.827563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:17.827564Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:17.827569Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:17.827697Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:17.865918Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602936786929200:2851]
2025-10-10T14:40:17.866223Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 pipe creation result: OK TabletId: 72075186224037892 Generation: 3259, pipe: [1:7559602936786929200:2851]
2025-10-10T14:40:17.942512Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:17.951233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:17.951266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:17.951459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:17.951520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:17.951586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:17.951648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:17.951689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:17.951697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:17.951770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:17.951828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:17.951890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:17.951954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:17.951993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:17.951997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:17.952071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:17.952131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:17.952191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:17.952268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:17.952309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:17.952315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:17.952382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:17.952441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:17.952504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:17.952572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:17.952612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:17.952615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:17.952684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:17.952743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:17.952807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:17.952873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:17.952917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:17.952920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:17.952997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:17.953055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:17.953117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:17.953178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:17.953223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:17.953229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:17.953301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:17.953580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:17.953657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:17.953721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:17.953764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:17.953767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:17.953842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:17.953908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:17.953974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:17.954045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:17.954097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:17.954100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:17.954173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:17.954241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:17.954303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:17.954373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:17.954416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:17.954419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:17.954489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:17.954550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:17.954610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:17.954670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:17.954719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:17.954722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:17.954793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602936786929200:2851], now have 1 active actors on pipe
2025-10-10T14:40:17.955904Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:17.956912Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a548e4dc-23c4fba3-62ad485e-4e872b46_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:40:17.956924Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a548e4dc-23c4fba3-62ad485e-4e872b46_0] Write session will restart in 0.009764s
2025-10-10T14:40:17.956950Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a548e4dc-23c4fba3-62ad485e-4e872b46_0] Write session: Do CDS request
2025-10-10T14:40:17.956956Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a548e4dc-23c4fba3-62ad485e-4e872b46_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:17.955361Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:40:17.955369Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 58 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602936786929200:2851]
2025-10-10T14:40:17.955381Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:40:17.955395Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:17.955415Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3260 reason: error at write: Disconnected sessionId: src_id|a548e4dc-23c4fba3-62ad485e-4e872b46_0
2025-10-10T14:40:17.955642Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3260 sessionId: src_id|a548e4dc-23c4fba3-62ad485e-4e872b46_0 is DEAD
2025-10-10T14:40:17.969842Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a548e4dc-23c4fba3-62ad485e-4e872b46_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:17.969936Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:17.969955Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3261
2025-10-10T14:40:17.970067Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3261 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:17.970097Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3261 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:17.970103Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3261 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:17.970108Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:17.970511Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3261 sessionId:  describe result for acl check
2025-10-10T14:40:17.970537Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:17.970542Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:17.970544Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:17.970551Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602936786929239:8525] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:17.971228Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602936786929239:8525] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:17.974424Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602936786929239:8525] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:17.975702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:17.979115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:17.979381Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:17.979393Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:17.979408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:17.979475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:17.979324Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602936786929239:8525] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:17.979342Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602936786929239:8525] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:17.979347Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602936786929239:8525] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:17.979356Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3261 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:17.979523Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602936004675777:12854]
2025-10-10T14:40:17.980188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:17.980547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:17.980604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:17.980964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:17.981052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:17.981059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:17.981060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:17.981061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:17.981063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:17.981064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:17.981065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:17.981067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:17.981068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:17.981069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:17.981071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:17.981072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:17.981074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:17.981082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:17.981097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:17.981101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:17.981106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:17.981111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:17.981116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:17.981120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:17.981125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:17.981129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:17.981134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:17.981138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:17.981142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:17.981146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:17.981156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:17.981169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:17.981175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:17.981182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:17.981186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:17.981192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:17.981196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:17.981204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:17.981209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:17.981221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:17.981226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:17.981232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:17.981238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:17.981243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:17.981247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:17.981253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:17.981258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:17.981263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:17.981268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:17.981273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:17.981277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:17.981283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:17.981287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:17.981293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:17.981297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:17.981302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:17.981371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:17.984433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:17.984762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:17.984775Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:17.984778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:17.984783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:17.984790Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3260 [2:7559602936004675777:12854]
2025-10-10T14:40:17.984806Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:17.984828Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:17.984838Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:17.984841Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:17.984844Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:17.984865Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:17.984873Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:17.984888Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:17.984962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:17.984971Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:17.984974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:17.984977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:17.985055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:17.985065Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:17.985078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:17.985089Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:17.985105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:17.985129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602936786929223:2438], now have 1 active actors on pipe
2025-10-10T14:40:17.985133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602936786929316:8525], now have 1 active actors on pipe
2025-10-10T14:40:17.985144Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602936004675772:12854]
2025-10-10T14:40:17.985147Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602936004675772:12854]
2025-10-10T14:40:17.985149Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602936004675772:12854]
2025-10-10T14:40:17.985167Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:17.985188Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:17.985218Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:17.985227Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:17.985267Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602936004675772:12854]
2025-10-10T14:40:17.985275Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:17.985247Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3260
2025-10-10T14:40:17.985296Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3260
2025-10-10T14:40:17.985435Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:17.985443Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:17.985446Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:17.985453Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:17.985617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:17.985632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:17.985668Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|aaf70cc2-29c11486-c23575fc-e05bc12c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:17.985686Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:17.985715Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:17.985718Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:17.985733Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:17.985754Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:17.985780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:17.985983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:17.985995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:17.986012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:17.986122Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3261 partition: 0 MaxSeqNo: 40 sessionId: src_id|aaf70cc2-29c11486-c23575fc-e05bc12c_0
2025-10-10T14:40:17.986568Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a548e4dc-23c4fba3-62ad485e-4e872b46_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|aaf70cc2-29c11486-c23575fc-e05bc12c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:17.989216Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aaf70cc2-29c11486-c23575fc-e05bc12c_0] Write session: try to update token
2025-10-10T14:40:17.989239Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aaf70cc2-29c11486-c23575fc-e05bc12c_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:18.006040Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:18.006063Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:18.006067Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:18.006069Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:18.006080Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602936004675772:12854]
2025-10-10T14:40:18.006084Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602936004675772:12854]
2025-10-10T14:40:18.006088Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602936004675772:12854]
2025-10-10T14:40:18.006145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:18.006154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:18.006157Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:18.006306Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:18.009375Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:18.009396Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:18.009401Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:18.011370Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3261 sessionId: src_id|aaf70cc2-29c11486-c23575fc-e05bc12c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:18.014234Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:18.054367Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602941081896624:2851]
2025-10-10T14:40:18.054637Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 pipe creation result: OK TabletId: 72075186224037892 Generation: 3260, pipe: [1:7559602941081896624:2851]
2025-10-10T14:40:18.126458Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:18.126902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:18.126920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:18.126971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602941081896624:2851], now have 1 active actors on pipe
2025-10-10T14:40:18.127212Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:18.127898Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aaf70cc2-29c11486-c23575fc-e05bc12c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:40:18.127910Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aaf70cc2-29c11486-c23575fc-e05bc12c_0] Write session will restart in 0.005489s
2025-10-10T14:40:18.127936Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aaf70cc2-29c11486-c23575fc-e05bc12c_0] Write session: Do CDS request
2025-10-10T14:40:18.127942Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aaf70cc2-29c11486-c23575fc-e05bc12c_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:18.127383Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:40:18.127386Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 59 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602941081896624:2851]
2025-10-10T14:40:18.127407Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:18.127491Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3261 reason: status is not ok: tablet will be restarted right now sessionId: src_id|aaf70cc2-29c11486-c23575fc-e05bc12c_0
2025-10-10T14:40:18.127729Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3261 sessionId: src_id|aaf70cc2-29c11486-c23575fc-e05bc12c_0 is DEAD
2025-10-10T14:40:18.134985Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aaf70cc2-29c11486-c23575fc-e05bc12c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:18.137668Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:18.137690Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3262
2025-10-10T14:40:18.137920Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3262 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:18.137952Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3262 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:18.137958Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3262 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:18.137963Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:18.138403Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3262 sessionId:  describe result for acl check
2025-10-10T14:40:18.138433Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:18.138435Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:18.138437Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:18.138443Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602941081896690:8537] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:18.139044Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602941081896690:8537] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:18.143345Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602941081896690:8537] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:18.143153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:18.143825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:18.144075Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:18.144081Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:18.144110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:18.144181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:18.144222Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602940299643178:12856]
2025-10-10T14:40:18.144883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:18.145241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:18.145291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:18.145664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:18.145753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:18.145761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:18.145762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:18.145764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:18.145765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:18.145767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:18.145768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:18.145770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:18.145771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:18.145772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:18.145774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:18.145775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:18.145777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:18.145783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:18.145797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:18.145802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:18.145806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:18.145811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:18.145815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:18.145819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:18.145823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:18.145827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:18.145832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:18.145836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:18.145840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:18.145844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:18.145853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:18.145861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:18.145868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:18.145874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:18.145880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:18.145886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:18.145891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:18.145896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:18.145910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:18.145915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:18.145920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:18.145925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:18.145930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:18.145935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:18.145940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:18.145945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:18.145950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:18.145955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:18.145959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:18.145964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:18.145969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:18.145974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:18.145978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:18.145983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:18.145988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:18.145994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:18.146048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:18.148616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:18.149133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:18.149145Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:18.149148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:18.149152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:18.149158Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3261 [2:7559602940299643178:12856]
2025-10-10T14:40:18.149172Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:18.149190Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:18.149203Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:18.149206Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:18.149210Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:18.149227Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:18.149235Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:18.149245Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:18.149307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:18.149316Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:18.149318Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:18.149320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:18.146276Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602941081896690:8537] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:18.146294Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602941081896690:8537] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:18.146297Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602941081896690:8537] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:18.146308Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3262 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:18.149415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:18.149425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:18.149440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:18.149453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:18.149477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:18.149505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602941081896727:8537], now have 1 active actors on pipe
2025-10-10T14:40:18.149514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602941081896626:2438], now have 1 active actors on pipe
2025-10-10T14:40:18.149522Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602940299643173:12856]
2025-10-10T14:40:18.149526Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602940299643173:12856]
2025-10-10T14:40:18.149528Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602940299643173:12856]
2025-10-10T14:40:18.149544Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:18.149564Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:18.149567Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:18.149571Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:18.149573Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:18.149567Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3261
2025-10-10T14:40:18.149605Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3261
2025-10-10T14:40:18.149587Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:18.149593Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:18.149620Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602940299643173:12856]
2025-10-10T14:40:18.149624Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:18.149625Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:18.149656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:18.149667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:18.149705Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|68af8eff-42fc05b5-3d7b2e4e-19d83300_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:18.149718Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:18.149722Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:18.149726Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:18.149739Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:18.149750Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:18.149774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:18.149920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:18.149930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:18.149946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:18.150067Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3262 partition: 0 MaxSeqNo: 40 sessionId: src_id|68af8eff-42fc05b5-3d7b2e4e-19d83300_0
2025-10-10T14:40:18.150505Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aaf70cc2-29c11486-c23575fc-e05bc12c_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|68af8eff-42fc05b5-3d7b2e4e-19d83300_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:18.153491Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|68af8eff-42fc05b5-3d7b2e4e-19d83300_0] Write session: try to update token
2025-10-10T14:40:18.153516Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|68af8eff-42fc05b5-3d7b2e4e-19d83300_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:18.169559Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:18.169581Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:18.169586Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:18.169588Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:18.169599Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602940299643173:12856]
2025-10-10T14:40:18.169604Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602940299643173:12856]
2025-10-10T14:40:18.169612Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602940299643173:12856]
2025-10-10T14:40:18.169667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:18.169676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:18.169681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:18.169731Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:18.169744Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:18.169748Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:18.169835Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:18.170079Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3262 sessionId: src_id|68af8eff-42fc05b5-3d7b2e4e-19d83300_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:18.173126Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:18.225872Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602941081896735:2851]
2025-10-10T14:40:18.226185Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 pipe creation result: OK TabletId: 72075186224037892 Generation: 3261, pipe: [1:7559602941081896735:2851]
2025-10-10T14:40:18.291992Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:18.292329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:18.292341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:18.292391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602941081896735:2851], now have 1 active actors on pipe
2025-10-10T14:40:18.292665Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:18.292665Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 60 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602941081896735:2851]
2025-10-10T14:40:18.292708Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:40:18.292712Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:40:18.292803Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3262 reason: error at write: Disconnected sessionId: src_id|68af8eff-42fc05b5-3d7b2e4e-19d83300_0
2025-10-10T14:40:18.293009Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3262 sessionId: src_id|68af8eff-42fc05b5-3d7b2e4e-19d83300_0 is DEAD
2025-10-10T14:40:18.293195Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:18.293557Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68af8eff-42fc05b5-3d7b2e4e-19d83300_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:40:18.293570Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68af8eff-42fc05b5-3d7b2e4e-19d83300_0] Write session will restart in 0.008309s
2025-10-10T14:40:18.293596Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68af8eff-42fc05b5-3d7b2e4e-19d83300_0] Write session: Do CDS request
2025-10-10T14:40:18.293604Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68af8eff-42fc05b5-3d7b2e4e-19d83300_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:18.303535Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|68af8eff-42fc05b5-3d7b2e4e-19d83300_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:18.304658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:18.305463Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:18.305485Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3263
2025-10-10T14:40:18.305663Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3263 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:18.305715Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3263 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:18.305736Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3263 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:18.305741Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:18.306222Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3263 sessionId:  describe result for acl check
2025-10-10T14:40:18.306538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:18.306775Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:18.306787Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:18.306801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:18.306872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:18.306920Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602940299643284:12858]
2025-10-10T14:40:18.306260Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:18.306269Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:18.306271Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:18.306277Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602941081896805:8540] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:18.306860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602941081896805:8540] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:18.307620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:18.307971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:18.308022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:18.308389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:18.308454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:18.308461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:18.308463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:18.308464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:18.308466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:18.308467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:18.308469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:18.308470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:18.308472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:18.308473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:18.308474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:18.308476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:18.308477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:18.308484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:18.308497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:18.308502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:18.308507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:18.308511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:18.308516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:18.308520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:18.308525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:18.308529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:18.308535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:18.308539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:18.308544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:18.308548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:18.308556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:18.308565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:18.308572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:18.308579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:18.308585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:18.308591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:18.308597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:18.308602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:18.308608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:18.308614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:18.308620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:18.308633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:18.308638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:18.308644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:18.308650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:18.308656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:18.308661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:18.308667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:18.308672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:18.308680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:18.308687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:18.308699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:18.308704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:18.308710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:18.308720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:18.308726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:18.308770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:18.309570Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602941081896805:8540] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:18.311227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:18.311557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:18.311572Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:18.311575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:18.311579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:18.311586Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3262 [2:7559602940299643284:12858]
2025-10-10T14:40:18.311600Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:18.311617Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:18.311628Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:18.311635Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:18.311638Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:18.311656Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:18.311665Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:18.311673Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:18.311744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:18.311750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:18.311752Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:18.311755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:18.311909Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3262
2025-10-10T14:40:18.311931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:18.311940Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:18.311954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:18.311969Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:18.311993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:18.312023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602941081896736:2438], now have 1 active actors on pipe
2025-10-10T14:40:18.312044Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602940299643278:12858]
2025-10-10T14:40:18.312051Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602940299643278:12858]
2025-10-10T14:40:18.312054Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602940299643278:12858]
2025-10-10T14:40:18.312070Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:18.312086Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:18.312087Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:18.312090Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:18.312092Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:18.312111Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:18.312119Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:18.312152Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602940299643278:12858]
2025-10-10T14:40:18.312164Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:18.312179Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:18.312164Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602941081896805:8540] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:18.312177Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602941081896805:8540] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:18.312182Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602941081896805:8540] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:18.312190Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3263 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:18.312410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602941081896839:8540], now have 1 active actors on pipe
2025-10-10T14:40:18.312467Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3262
2025-10-10T14:40:18.312517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:18.312531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:18.312565Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|90704ddb-de6015d2-e6b65e09-1ac30a28_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:18.312579Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:18.312588Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:18.312592Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:18.312605Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:18.312621Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:18.312636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:18.312848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:18.312858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:18.312877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:18.312972Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3263 partition: 0 MaxSeqNo: 40 sessionId: src_id|90704ddb-de6015d2-e6b65e09-1ac30a28_0
2025-10-10T14:40:18.313422Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68af8eff-42fc05b5-3d7b2e4e-19d83300_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|90704ddb-de6015d2-e6b65e09-1ac30a28_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:18.316143Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|90704ddb-de6015d2-e6b65e09-1ac30a28_0] Write session: try to update token
2025-10-10T14:40:18.316165Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|90704ddb-de6015d2-e6b65e09-1ac30a28_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:18.332379Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:40:18.332399Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:18.332411Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602940299643278:12858]
2025-10-10T14:40:18.332458Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:40:18.332467Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:40:18.332645Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:40:18.332789Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:18.332926Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:18.333067Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:18.333261Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:40:18.333298Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:40:18.333708Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3263 sessionId: src_id|90704ddb-de6015d2-e6b65e09-1ac30a28_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:18.336420Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:18.336792Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:40:18.336634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:18.336656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:18.336707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:40:18.369549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:18.369588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:18.369778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:18.369854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:18.369915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:18.369976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:18.370018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:18.370024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:18.370098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:18.370155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:18.370215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:18.370281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:18.370352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:18.370356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:18.370430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:18.370488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:18.370547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:18.370612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:18.370656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:18.370659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:18.370733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:18.370795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:18.370860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:18.370922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:18.370965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:18.370968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:18.371038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:18.371096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:18.371161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:18.371226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:18.371267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:18.371270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:18.371340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:18.371397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:18.371484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:18.371549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:18.371611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:18.371615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:18.371684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:18.371742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:18.371805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:18.371872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:18.371914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:18.371917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:18.371991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:18.372052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:18.372116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:18.372176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:18.372221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:18.372225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:18.372315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:18.372372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:18.372434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:18.372491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:18.372629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:18.372633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:18.372700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:18.372759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:18.372818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:18.372881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:18.372923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:18.372926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:18.373037Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:40:18.373112Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:18.373135Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:18.373138Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-10T14:40:18.373180Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 41 partNo 0
2025-10-10T14:40:18.373196Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 41 partNo 1
2025-10-10T14:40:18.373200Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 41 partNo 2
2025-10-10T14:40:18.373203Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 41 partNo 3
2025-10-10T14:40:18.373206Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 41 partNo 4
2025-10-10T14:40:18.374337Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 41 partNo 4 FormedBlobsCount 0 NewHead: Offset 40 PartNo 0 PackedSize 2253230 count 1 nextOffset 41 batches 5
2025-10-10T14:40:18.374372Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 42 partNo 0
2025-10-10T14:40:18.374380Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 42 partNo 1
2025-10-10T14:40:18.374393Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 42 partNo 2
2025-10-10T14:40:18.374395Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 42 partNo 3
2025-10-10T14:40:18.374399Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 42 partNo 4
2025-10-10T14:40:18.375606Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 42 partNo 4 FormedBlobsCount 0 NewHead: Offset 40 PartNo 0 PackedSize 4506428 count 2 nextOffset 42 batches 9
2025-10-10T14:40:18.375629Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 43 partNo 0
2025-10-10T14:40:18.375637Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 43 partNo 1
2025-10-10T14:40:18.375645Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 43 partNo 2
2025-10-10T14:40:18.375649Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 43 partNo 3
2025-10-10T14:40:18.375654Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 43 partNo 4
2025-10-10T14:40:18.376128Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 43 partNo 4 FormedBlobsCount 0 NewHead: Offset 40 PartNo 0 PackedSize 6759626 count 3 nextOffset 43 batches 13
2025-10-10T14:40:18.376149Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 44 partNo 0
2025-10-10T14:40:18.376155Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 44 partNo 1
2025-10-10T14:40:18.376163Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 44 partNo 2
2025-10-10T14:40:18.376166Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 44 partNo 3
2025-10-10T14:40:18.377620Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 44 partNo 3 result is x0000000000_00000000000000000040_00000_0000000003_00015? size 8295638
2025-10-10T14:40:18.377639Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 44 partNo 4
2025-10-10T14:40:18.377655Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000040_00000_0000000003_00015? new key d0000000000_00000000000000000040_00000_0000000003_00015? size 8295638 WTime 1760107218377
2025-10-10T14:40:18.377789Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 44 partNo 4 FormedBlobsCount 1 NewHead: Offset 43 PartNo 3 PackedSize 717145 count 1 nextOffset 44 batches 2
2025-10-10T14:40:18.377804Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 45 partNo 0
2025-10-10T14:40:18.377809Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 45 partNo 1
2025-10-10T14:40:18.377812Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 45 partNo 2
2025-10-10T14:40:18.377817Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 45 partNo 3
2025-10-10T14:40:18.377820Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 45 partNo 4
2025-10-10T14:40:18.378534Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 45 partNo 4 FormedBlobsCount 0 NewHead: Offset 43 PartNo 3 PackedSize 2970343 count 2 nextOffset 45 batches 6
2025-10-10T14:40:18.378571Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 0
2025-10-10T14:40:18.378577Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 1
2025-10-10T14:40:18.378581Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 2
2025-10-10T14:40:18.378585Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 3
2025-10-10T14:40:18.378594Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 4
2025-10-10T14:40:18.379069Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 46 partNo 4 FormedBlobsCount 0 NewHead: Offset 43 PartNo 3 PackedSize 5223541 count 3 nextOffset 46 batches 10
2025-10-10T14:40:18.379091Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 0
2025-10-10T14:40:18.379098Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 1
2025-10-10T14:40:18.379101Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 2
2025-10-10T14:40:18.379105Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 3
2025-10-10T14:40:18.379109Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 4
2025-10-10T14:40:18.379664Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 47 partNo 4 FormedBlobsCount 0 NewHead: Offset 43 PartNo 3 PackedSize 7476739 count 4 nextOffset 47 batches 14
2025-10-10T14:40:18.379685Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 0
2025-10-10T14:40:18.379691Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 1
2025-10-10T14:40:18.380851Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 48 partNo 1 result is x0000000000_00000000000000000043_00003_0000000004_00014? size 7988760
2025-10-10T14:40:18.380868Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 2
2025-10-10T14:40:18.380874Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 3
2025-10-10T14:40:18.380878Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 4
2025-10-10T14:40:18.380889Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000043_00003_0000000004_00014? new key d0000000000_00000000000000000043_00003_0000000004_00014? size 7988760 WTime 1760107218380
2025-10-10T14:40:18.381258Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 48 partNo 4 FormedBlobsCount 1 NewHead: Offset 47 PartNo 1 PackedSize 1741199 count 1 nextOffset 48 batches 4
2025-10-10T14:40:18.381279Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 49 partNo 0
2025-10-10T14:40:18.381284Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 49 partNo 1
2025-10-10T14:40:18.381288Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 49 partNo 2
2025-10-10T14:40:18.381292Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 49 partNo 3
2025-10-10T14:40:18.381295Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 49 partNo 4
2025-10-10T14:40:18.381817Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 49 partNo 4 FormedBlobsCount 0 NewHead: Offset 47 PartNo 1 PackedSize 3994397 count 2 nextOffset 49 batches 8
2025-10-10T14:40:18.381838Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 50 partNo 0
2025-10-10T14:40:18.381845Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 50 partNo 1
2025-10-10T14:40:18.381848Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 50 partNo 2
2025-10-10T14:40:18.381854Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 50 partNo 3
2025-10-10T14:40:18.381858Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 50 partNo 4
2025-10-10T14:40:18.382346Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 50 partNo 4 FormedBlobsCount 0 NewHead: Offset 47 PartNo 1 PackedSize 6247595 count 3 nextOffset 50 batches 12
2025-10-10T14:40:18.382367Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:18.382460Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 47,3 HeadOffset 40 endOffset 40 curOffset 50 d0000000000_00000000000000000047_00001_0000000003_00011? size 6247585 WTime 1760107218382
2025-10-10T14:40:18.385101Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:40:18.385133Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 40 partNo 0 count 3 size 8295638
2025-10-10T14:40:18.385141Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 43 partNo 3 count 4 size 7988760
2025-10-10T14:40:18.385149Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 47 partNo 1 count 3 size 6247585
2025-10-10T14:40:18.385169Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:18.385172Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:18.385176Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:18.385178Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:18.385187Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602940299643278:12858]
2025-10-10T14:40:18.385192Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602940299643278:12858]
2025-10-10T14:40:18.385199Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602940299643278:12858]
2025-10-10T14:40:18.385271Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:18.385284Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:18.385290Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:18.385300Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:18.385305Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:18.385308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:18.385468Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:18.392810Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602941081896847:2851]
2025-10-10T14:40:18.393157Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 pipe creation result: OK TabletId: 72075186224037892 Generation: 3262, pipe: [1:7559602941081896847:2851]
2025-10-10T14:40:18.506174Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:18.506694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602941081896847:2851], now have 1 active actors on pipe
2025-10-10T14:40:18.507019Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:18.507380Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:18.507477Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:40:18.507545Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3263 reason: status is not ok: tablet will be restarted right now sessionId: src_id|90704ddb-de6015d2-e6b65e09-1ac30a28_0
2025-10-10T14:40:18.507742Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 61 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602941081896847:2851]
2025-10-10T14:40:18.507758Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3263 sessionId: src_id|90704ddb-de6015d2-e6b65e09-1ac30a28_0 is DEAD
2025-10-10T14:40:18.509511Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90704ddb-de6015d2-e6b65e09-1ac30a28_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:40:18.509525Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90704ddb-de6015d2-e6b65e09-1ac30a28_0] Write session will restart in 0.007606s
2025-10-10T14:40:18.509552Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90704ddb-de6015d2-e6b65e09-1ac30a28_0] Write session: Do CDS request
2025-10-10T14:40:18.509558Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90704ddb-de6015d2-e6b65e09-1ac30a28_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:18.513408Z node 2 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [5c60e16c33010bba] Result# TEvPutResult {Id# [72075186224037892:3262:1:2:1:8295638:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-10T14:40:18.514208Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:3262:1:2:2:7988760:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-10T14:40:18.514345Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:3262:1:2:3:6247585:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-10T14:40:18.518936Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|90704ddb-de6015d2-e6b65e09-1ac30a28_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:18.519088Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:18.519107Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3264
2025-10-10T14:40:18.519250Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3264 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:18.519299Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3264 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:18.519305Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3264 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:18.519310Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:18.520305Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3264 sessionId:  describe result for acl check
2025-10-10T14:40:18.520357Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:18.520364Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:18.520368Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:18.520375Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602941081896918:8551] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:18.520989Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602941081896918:8551] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:18.521997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:18.523908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:18.524126Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:18.524139Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:18.524152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:18.524208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:18.524263Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602940299643397:12861]
2025-10-10T14:40:18.524326Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602941081896918:8551] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:18.524956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:18.525316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:18.525381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:18.525733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:18.525798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:18.525801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:18.525803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:18.525804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:18.525805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:18.525807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:18.525808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:18.525809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:18.525811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:18.525812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:18.525813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:18.525814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:18.525816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:18.525821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:18.525834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:18.525839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:18.525843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:18.525847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:18.525851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:18.525856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:18.525860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:18.525865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:18.525869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:18.525873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:18.525877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:18.525881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:18.525889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:18.525897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:18.525905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:18.525910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:18.525915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:18.525920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:18.525925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:18.525931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:18.525936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:18.525942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:18.525947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:18.525952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:18.525965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:18.525971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:18.525976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:18.525982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:18.525987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:18.525993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:18.526000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:18.526006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:18.526011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:18.526017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:18.526027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:18.526032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:18.526042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:18.526047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:18.526087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:18.528506Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602941081896918:8551] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:18.528524Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602941081896918:8551] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:18.528527Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602941081896918:8551] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:18.528537Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3264 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:18.528656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:18.529109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:18.529121Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:18.529124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:18.529128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:18.529136Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3263 [2:7559602940299643397:12861]
2025-10-10T14:40:18.529151Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:18.529169Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:18.529176Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:18.529179Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:18.529181Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:18.529197Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:18.529210Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:18.529222Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:18.529285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:18.529293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:18.529295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:18.529297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:18.529385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:18.529394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:18.529405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:18.529416Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:18.529433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:18.529453Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602940299643392:12861]
2025-10-10T14:40:18.529456Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602940299643392:12861]
2025-10-10T14:40:18.529458Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602940299643392:12861]
2025-10-10T14:40:18.529467Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:18.529486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602941081896954:8551], now have 1 active actors on pipe
2025-10-10T14:40:18.529489Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:18.529492Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:18.529493Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:18.529495Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:18.529509Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:18.529513Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:18.529521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602941081896849:2438], now have 1 active actors on pipe
2025-10-10T14:40:18.529549Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602940299643392:12861]
2025-10-10T14:40:18.529562Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:18.529593Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:18.529589Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3263
2025-10-10T14:40:18.529607Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3263
2025-10-10T14:40:18.529672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:18.529686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:18.529724Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|114c6bbf-27c7391b-8502ad33-b3bb39d0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:18.529738Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:18.529746Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:18.529749Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:18.529761Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:18.529778Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:18.529800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:18.530004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:18.530014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:18.530029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:18.530117Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3264 partition: 0 MaxSeqNo: 40 sessionId: src_id|114c6bbf-27c7391b-8502ad33-b3bb39d0_0
2025-10-10T14:40:18.530566Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90704ddb-de6015d2-e6b65e09-1ac30a28_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|114c6bbf-27c7391b-8502ad33-b3bb39d0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:18.533278Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|114c6bbf-27c7391b-8502ad33-b3bb39d0_0] Write session: try to update token
2025-10-10T14:40:18.533298Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|114c6bbf-27c7391b-8502ad33-b3bb39d0_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:18.541269Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:40:18.541287Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:18.541302Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602940299643392:12861]
2025-10-10T14:40:18.541366Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:40:18.541372Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:40:18.541551Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:40:18.541702Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:18.541844Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:18.541998Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:18.542254Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:40:18.542301Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:40:18.548781Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3264 sessionId: src_id|114c6bbf-27c7391b-8502ad33-b3bb39d0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:18.549697Z :ERROR: [/Root] OnFederationDiscovery: Got error. Status: CLIENT_DEADLINE_EXCEEDED. Description: [ { <main>: Error: GRpc error: (4): Deadline Exceeded } { <main>: Error: Grpc error response on endpoint localhost:7170 } ]
2025-10-10T14:40:18.551559Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:18.551831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:18.551854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:18.551910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:40:18.551996Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:40:18.560197Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:18.560214Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:18.560218Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:18.560220Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:18.560232Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602940299643392:12861]
2025-10-10T14:40:18.560247Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602940299643392:12861]
2025-10-10T14:40:18.560255Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602940299643392:12861]
2025-10-10T14:40:18.560306Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:18.560309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:18.560317Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:18.560319Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:18.560320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:18.560323Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:18.560455Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:18.608934Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602941081896965:2851]
2025-10-10T14:40:18.609567Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 pipe creation result: OK TabletId: 72075186224037892 Generation: 3263, pipe: [1:7559602941081896965:2851]
2025-10-10T14:40:18.682296Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:18.691542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:18.691575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:18.691772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:18.691845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:18.691917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:18.691988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:18.692366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:18.692379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:18.692458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:18.692531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:18.692605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:18.692681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:18.692727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:18.692734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:18.692809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:18.692878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:18.692954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:18.693031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:18.693083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:18.693092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:18.693173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:18.693243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:18.693317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:18.693423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:18.693473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:18.693482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:18.693560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:18.693627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:18.693700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:18.693768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:18.693815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:18.693824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:18.693896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:18.693968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:18.694041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:18.694130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:18.694178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:18.694184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:18.694256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:18.694325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:18.694397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:18.694472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:18.694530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:18.694536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:18.694608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:18.694677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:18.694746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:18.694815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:18.694860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:18.694868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:18.694940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:18.695006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:18.695072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:18.695134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:18.695260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:18.695268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:18.695342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:18.695409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:18.695481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:18.695552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:18.695596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:18.695604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:18.695675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602941081896965:2851], now have 1 active actors on pipe
2025-10-10T14:40:18.696274Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:18.696344Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 62 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602941081896965:2851]
2025-10-10T14:40:18.696392Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:40:18.696400Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:40:18.696433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3264 reason: error at write: Disconnected sessionId: src_id|114c6bbf-27c7391b-8502ad33-b3bb39d0_0
2025-10-10T14:40:18.696636Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:18.696734Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3264 sessionId: src_id|114c6bbf-27c7391b-8502ad33-b3bb39d0_0 is DEAD
2025-10-10T14:40:18.697157Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|114c6bbf-27c7391b-8502ad33-b3bb39d0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:40:18.697166Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|114c6bbf-27c7391b-8502ad33-b3bb39d0_0] Write session will restart in 0.008334s
2025-10-10T14:40:18.697191Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|114c6bbf-27c7391b-8502ad33-b3bb39d0_0] Write session: Do CDS request
2025-10-10T14:40:18.697199Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|114c6bbf-27c7391b-8502ad33-b3bb39d0_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:18.709036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:18.709950Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|114c6bbf-27c7391b-8502ad33-b3bb39d0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:18.710024Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:18.710044Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3265
2025-10-10T14:40:18.710180Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3265 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:18.710220Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3265 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:18.710225Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3265 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:18.710229Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:18.710728Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3265 sessionId:  describe result for acl check
2025-10-10T14:40:18.710770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:18.710772Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:18.710774Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:18.710781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602941081897065:8573] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:18.711171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:18.711395Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:18.711406Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:18.711419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:18.711435Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602941081897065:8573] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:18.711477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:18.711526Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602940299643543:12876]
2025-10-10T14:40:18.712131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:18.712529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:18.712588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:18.712965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:18.713020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:18.713026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:18.713027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:18.713029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:18.713030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:18.713031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:18.713032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:18.713033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:18.713035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:18.713036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:18.713037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:18.713038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:18.713040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:18.713047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:18.713059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:18.713063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:18.713067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:18.713070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:18.713074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:18.713078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:18.713082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:18.713085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:18.713090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:18.713094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:18.713097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:18.713101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:18.713108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:18.713117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:18.713124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:18.713130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:18.713137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:18.713143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:18.713147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:18.713152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:18.713156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:18.713162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:18.713166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:18.713171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:18.713176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:18.713181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:18.713186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:18.713190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:18.713195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:18.713200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:18.713205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:18.713211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:18.713215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:18.713220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:18.713232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:18.713237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:18.713241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:18.713246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:18.713284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:18.713923Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602941081897065:8573] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:18.715868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:18.716245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:18.716257Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:18.716260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:18.716264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:18.716270Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3264 [2:7559602940299643543:12876]
2025-10-10T14:40:18.716285Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:18.716302Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:18.716306Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:18.716309Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:18.716311Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:18.716329Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:18.716341Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:18.716348Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:18.716416Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:18.716428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:18.716430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:18.716432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:18.716503Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:18.716510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:18.716524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:18.716539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:18.716560Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:18.716587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602941081896990:2438], now have 1 active actors on pipe
2025-10-10T14:40:18.716599Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602940299643537:12876]
2025-10-10T14:40:18.716583Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3264
2025-10-10T14:40:18.716606Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602940299643537:12876]
2025-10-10T14:40:18.716608Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602940299643537:12876]
2025-10-10T14:40:18.716617Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:18.716626Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:18.716629Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:18.716632Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:18.716633Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:18.716649Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:18.716652Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:18.716690Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602940299643537:12876]
2025-10-10T14:40:18.716689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602941081897065:8573] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:18.716705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602941081897065:8573] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:18.716709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602941081897065:8573] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:18.716703Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:18.716717Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3265 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:18.716711Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:18.716936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602941081897096:8573], now have 1 active actors on pipe
2025-10-10T14:40:18.716991Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3264
2025-10-10T14:40:18.717042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:18.717053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:18.717081Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9e0a6509-1729ad31-eb869b1-bed757cd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:18.717091Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:18.717094Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:18.717096Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:18.717106Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:18.717118Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:18.717138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:18.717312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:18.717319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:18.717348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:18.717441Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3265 partition: 0 MaxSeqNo: 40 sessionId: src_id|9e0a6509-1729ad31-eb869b1-bed757cd_0
2025-10-10T14:40:18.717863Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|114c6bbf-27c7391b-8502ad33-b3bb39d0_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|9e0a6509-1729ad31-eb869b1-bed757cd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:18.720624Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9e0a6509-1729ad31-eb869b1-bed757cd_0] Write session: try to update token
2025-10-10T14:40:18.720645Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9e0a6509-1729ad31-eb869b1-bed757cd_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:18.736008Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3265 sessionId: src_id|9e0a6509-1729ad31-eb869b1-bed757cd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:18.738655Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:18.739748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:18.739773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:18.739797Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:18.739801Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:18.739804Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:18.739806Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:18.739816Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602940299643537:12876]
2025-10-10T14:40:18.739820Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602940299643537:12876]
2025-10-10T14:40:18.739824Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602940299643537:12876]
2025-10-10T14:40:18.739862Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:18.739872Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:18.739876Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:18.739885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:18.739892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:18.739901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:18.740034Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:18.801552Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602941081897104:2851]
2025-10-10T14:40:18.807073Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 pipe creation result: OK TabletId: 72075186224037892 Generation: 3264, pipe: [1:7559602941081897104:2851]
2025-10-10T14:40:18.858735Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:18.859043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:40:18.859099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602941081897104:2851], now have 1 active actors on pipe
2025-10-10T14:40:18.859216Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:40:18.859346Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:40:18.859358Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:40:18.859443Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3265 reason: error at write: Disconnected sessionId: src_id|9e0a6509-1729ad31-eb869b1-bed757cd_0
2025-10-10T14:40:18.859625Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:18.859642Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3265 sessionId: src_id|9e0a6509-1729ad31-eb869b1-bed757cd_0 is DEAD
2025-10-10T14:40:18.859681Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 63 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602941081897104:2851]
2025-10-10T14:40:18.859788Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e0a6509-1729ad31-eb869b1-bed757cd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:40:18.859801Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e0a6509-1729ad31-eb869b1-bed757cd_0] Write session will restart in 0.006037s
2025-10-10T14:40:18.859841Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e0a6509-1729ad31-eb869b1-bed757cd_0] Write session: Do CDS request
2025-10-10T14:40:18.859848Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e0a6509-1729ad31-eb869b1-bed757cd_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:18.867167Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9e0a6509-1729ad31-eb869b1-bed757cd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:18.867219Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:18.867239Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3266
2025-10-10T14:40:18.867436Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3266 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:18.867478Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3266 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:18.867489Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3266 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:18.867494Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:18.868010Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3266 sessionId:  describe result for acl check
2025-10-10T14:40:18.868049Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:18.868051Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:18.868053Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:18.868060Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602941081897159:8585] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:18.868658Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602941081897159:8585] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:18.870801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:18.871248Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602941081897159:8585] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:18.873089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:18.873302Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:18.873314Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:18.873327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:18.873402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:18.873442Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602940299643663:12879]
2025-10-10T14:40:18.874099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:18.874369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:18.874413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:18.874741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:18.874801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:18.874807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:18.874809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:18.874810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:18.874811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:18.874812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:18.874813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:18.874815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:18.874816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:18.874817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:18.874819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:18.874820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:18.874821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:18.874827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:18.874840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:18.874844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:18.874848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:18.874853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:18.874857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:18.874861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:18.874865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:18.874869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:18.874873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:18.874877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:18.874881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:18.874885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:18.874892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:18.874901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:18.874907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:18.874913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:18.874918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:18.874924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:18.874928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:18.874934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:18.874938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:18.874943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:18.874948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:18.874952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:18.874957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:18.874963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:18.874974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:18.874979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:18.874988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:18.874993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:18.874997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:18.875006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:18.875011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:18.875017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:18.875025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:18.875030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:18.875035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:18.875044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:18.875085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:18.875839Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602941081897159:8585] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:18.875856Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602941081897159:8585] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:18.875860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602941081897159:8585] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:18.875869Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3266 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:18.878322Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3265
2025-10-10T14:40:18.878324Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3265
2025-10-10T14:40:18.877490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:18.877956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:18.877961Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:18.877966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:18.877970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:18.877976Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3265 [2:7559602940299643663:12879]
2025-10-10T14:40:18.877987Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:18.878004Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:18.878007Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:18.878010Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:18.878012Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:18.878028Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:18.878036Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:18.878044Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:18.878102Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:18.878105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:18.878107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:18.878109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:18.878175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:18.878178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:18.878190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:18.878202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:18.878219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:18.878240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602941081897214:8585], now have 1 active actors on pipe
2025-10-10T14:40:18.878244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602941081897109:2438], now have 1 active actors on pipe
2025-10-10T14:40:18.878251Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602940299643657:12879]
2025-10-10T14:40:18.878253Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602940299643657:12879]
2025-10-10T14:40:18.878254Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602940299643657:12879]
2025-10-10T14:40:18.878270Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:18.878283Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:18.878284Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:18.878285Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:18.878288Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:18.878298Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:18.878301Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:18.878323Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602940299643657:12879]
2025-10-10T14:40:18.878331Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:18.878348Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:18.878368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:18.878373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:18.878412Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c1720217-2fe451d4-ef2dbdc6-3798e56f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:18.878419Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:18.878423Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:18.878426Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:18.878438Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:18.878448Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:18.878463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:18.878679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:18.878690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:18.878706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:18.878789Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3266 partition: 0 MaxSeqNo: 40 sessionId: src_id|c1720217-2fe451d4-ef2dbdc6-3798e56f_0
2025-10-10T14:40:18.879222Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e0a6509-1729ad31-eb869b1-bed757cd_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|c1720217-2fe451d4-ef2dbdc6-3798e56f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:18.882007Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c1720217-2fe451d4-ef2dbdc6-3798e56f_0] Write session: try to update token
2025-10-10T14:40:18.882023Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c1720217-2fe451d4-ef2dbdc6-3798e56f_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:18.897938Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3266 sessionId: src_id|c1720217-2fe451d4-ef2dbdc6-3798e56f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:18.901436Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:18.901903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:18.901931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:18.901957Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:18.901961Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:18.901965Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:18.901967Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:18.901978Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602940299643657:12879]
2025-10-10T14:40:18.901982Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602940299643657:12879]
2025-10-10T14:40:18.901985Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602940299643657:12879]
2025-10-10T14:40:18.902038Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:18.902048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:18.902053Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:18.902056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:18.902061Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:18.902062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:18.902196Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:18.960066Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602941081897239:2851]
2025-10-10T14:40:18.960527Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 pipe creation result: OK TabletId: 72075186224037892 Generation: 3265, pipe: [1:7559602941081897239:2851]
2025-10-10T14:40:19.020649Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:19.020938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:40:19.021005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602941081897239:2851], now have 1 active actors on pipe
2025-10-10T14:40:19.021105Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:40:19.021690Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 64 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602941081897239:2851]
2025-10-10T14:40:19.021730Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:19.033088Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:40:19.033106Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:40:19.033134Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3266 reason: error at write: Disconnected sessionId: src_id|c1720217-2fe451d4-ef2dbdc6-3798e56f_0
2025-10-10T14:40:19.033315Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3266 sessionId: src_id|c1720217-2fe451d4-ef2dbdc6-3798e56f_0 is DEAD
2025-10-10T14:40:19.033502Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1720217-2fe451d4-ef2dbdc6-3798e56f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:40:19.033526Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1720217-2fe451d4-ef2dbdc6-3798e56f_0] Write session will restart in 0.005060s
2025-10-10T14:40:19.033551Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1720217-2fe451d4-ef2dbdc6-3798e56f_0] Write session: Do CDS request
2025-10-10T14:40:19.033557Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1720217-2fe451d4-ef2dbdc6-3798e56f_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:19.042185Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c1720217-2fe451d4-ef2dbdc6-3798e56f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:19.043754Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:19.043782Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3267
2025-10-10T14:40:19.044095Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3267 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:19.044145Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3267 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:19.044151Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3267 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:19.044156Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:19.044761Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3267 sessionId:  describe result for acl check
2025-10-10T14:40:19.044791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:19.044793Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:19.044794Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:19.044803Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602945376864596:8596] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:19.045585Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602945376864596:8596] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:19.050102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:19.051762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602945376864596:8596] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:19.050813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:19.051110Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:19.051116Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:19.051130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:19.051198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:19.051242Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602944594611068:12881]
2025-10-10T14:40:19.051854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:19.052221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:19.052283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:19.052607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:19.052667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:19.052668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:19.052669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:19.052671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:19.052672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:19.052673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:19.052674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:19.052675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:19.052677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:19.052678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:19.052679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:19.052681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:19.052682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:19.052689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:19.052702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:19.052707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:19.052711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:19.052715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:19.052719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:19.052723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:19.052726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:19.052730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:19.052735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:19.052739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:19.052746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:19.052750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:19.052759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:19.052768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:19.052775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:19.052780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:19.052785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:19.052790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:19.052795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:19.052800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:19.052805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:19.052810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:19.052815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:19.052820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:19.052824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:19.052829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:19.052835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:19.052841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:19.052845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:19.052850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:19.052855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:19.052860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:19.052864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:19.052870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:19.052874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:19.052879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:19.052883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:19.052888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:19.052930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:19.056655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602945376864596:8596] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:19.056673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602945376864596:8596] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:19.056676Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602945376864596:8596] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:19.056687Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3267 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:19.056795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:19.057211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:19.057216Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:19.057221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:19.057226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:19.057233Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3266 [2:7559602944594611068:12881]
2025-10-10T14:40:19.057247Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:19.057267Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:19.057270Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:19.057275Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:19.057277Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:19.057294Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:19.057302Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:19.057309Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:19.057400Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:19.057402Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:19.057404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:19.057407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:19.057481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:19.057484Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:19.057498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:19.057512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:19.057529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:19.057553Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602944594611063:12881]
2025-10-10T14:40:19.057557Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602944594611063:12881]
2025-10-10T14:40:19.057559Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602944594611063:12881]
2025-10-10T14:40:19.057569Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:19.057585Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:19.057601Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:19.057605Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:19.057636Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602944594611063:12881]
2025-10-10T14:40:19.057639Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:19.057794Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:19.057804Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:19.057807Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:19.057814Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:19.058017Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3266
2025-10-10T14:40:19.058019Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3266
2025-10-10T14:40:19.058279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602945376864537:2438], now have 1 active actors on pipe
2025-10-10T14:40:19.058328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602945376864643:8596], now have 1 active actors on pipe
2025-10-10T14:40:19.058353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:19.058365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:19.058402Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|870d51db-a84070cd-925a4963-bc1979ed_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:19.058418Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:19.058422Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:19.058424Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:19.058437Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:19.058453Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:19.058470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:19.059032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:19.059044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:19.059066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:19.059174Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3267 partition: 0 MaxSeqNo: 40 sessionId: src_id|870d51db-a84070cd-925a4963-bc1979ed_0
2025-10-10T14:40:19.059638Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1720217-2fe451d4-ef2dbdc6-3798e56f_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|870d51db-a84070cd-925a4963-bc1979ed_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:19.062511Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|870d51db-a84070cd-925a4963-bc1979ed_0] Write session: try to update token
2025-10-10T14:40:19.062535Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|870d51db-a84070cd-925a4963-bc1979ed_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:19.076719Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:19.076744Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:19.076748Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:19.076750Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:19.076761Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602944594611063:12881]
2025-10-10T14:40:19.076767Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602944594611063:12881]
2025-10-10T14:40:19.076771Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602944594611063:12881]
2025-10-10T14:40:19.076829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:19.076838Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:19.076842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:19.076845Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:19.076845Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:19.076849Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:19.077002Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:19.080419Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3267 sessionId: src_id|870d51db-a84070cd-925a4963-bc1979ed_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:19.083168Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:19.123031Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602945376864651:2851]
2025-10-10T14:40:19.127074Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 pipe creation result: OK TabletId: 72075186224037892 Generation: 3266, pipe: [1:7559602945376864651:2851]
2025-10-10T14:40:19.198635Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:19.198984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:19.198998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:19.199045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602945376864651:2851], now have 1 active actors on pipe
2025-10-10T14:40:19.199282Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:19.199323Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 65 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602945376864651:2851]
2025-10-10T14:40:19.199366Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:40:19.199369Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:40:19.199450Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3267 reason: error at write: Disconnected sessionId: src_id|870d51db-a84070cd-925a4963-bc1979ed_0
2025-10-10T14:40:19.199571Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:19.199694Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3267 sessionId: src_id|870d51db-a84070cd-925a4963-bc1979ed_0 is DEAD
2025-10-10T14:40:19.199863Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|870d51db-a84070cd-925a4963-bc1979ed_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:40:19.199871Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|870d51db-a84070cd-925a4963-bc1979ed_0] Write session will restart in 0.006830s
2025-10-10T14:40:19.199907Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|870d51db-a84070cd-925a4963-bc1979ed_0] Write session: Do CDS request
2025-10-10T14:40:19.199913Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|870d51db-a84070cd-925a4963-bc1979ed_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:19.207904Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|870d51db-a84070cd-925a4963-bc1979ed_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:19.208033Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:19.208065Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3268
2025-10-10T14:40:19.208205Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3268 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:19.208273Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3268 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:19.208284Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3268 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:19.208300Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:19.208901Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3268 sessionId:  describe result for acl check
2025-10-10T14:40:19.208963Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:19.208972Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:19.208974Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:19.208982Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602945376864723:8601] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:19.209645Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602945376864723:8601] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:19.211632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:19.212167Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602945376864723:8601] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:19.213697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:19.213914Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:19.213925Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:19.213936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:19.213994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:19.214039Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602944594611178:12883]
2025-10-10T14:40:19.214639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:19.214944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:19.214993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:19.215363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:19.215422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:19.215427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:19.215429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:19.215430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:19.215432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:19.215433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:19.215434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:19.215435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:19.215437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:19.215438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:19.215439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:19.215441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:19.215442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:19.215448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:19.215462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:19.215467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:19.215471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:19.215476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:19.215480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:19.215484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:19.215487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:19.215491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:19.215496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:19.215500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:19.215504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:19.215509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:19.215517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:19.215526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:19.215532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:19.215537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:19.215542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:19.215546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:19.215551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:19.215556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:19.215561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:19.215566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:19.215571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:19.215576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:19.215581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:19.215588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:19.215597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:19.215603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:19.215608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:19.215613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:19.215618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:19.215623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:19.215628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:19.215633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:19.215642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:19.215648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:19.215653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:19.215659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:19.215703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:19.215329Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602945376864723:8601] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:19.215348Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602945376864723:8601] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:19.215351Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602945376864723:8601] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:19.215362Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3268 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:19.218427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:19.219014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:19.219026Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:19.219029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:19.219033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:19.219039Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3267 [2:7559602944594611178:12883]
2025-10-10T14:40:19.219054Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:19.219077Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:19.219085Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:19.219089Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:19.219092Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:19.219111Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:19.219133Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:19.219145Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:19.219215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:19.219222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:19.219224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:19.219227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:19.219301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:19.219309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:19.219322Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:19.219337Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:19.219358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:19.219388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602945376864654:2438], now have 1 active actors on pipe
2025-10-10T14:40:19.219397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602945376864758:8601], now have 1 active actors on pipe
2025-10-10T14:40:19.219405Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602944594611171:12883]
2025-10-10T14:40:19.219408Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602944594611171:12883]
2025-10-10T14:40:19.219411Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602944594611171:12883]
2025-10-10T14:40:19.219424Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:19.219435Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:19.219441Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:19.219443Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:19.219444Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:19.219461Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:19.219469Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:19.219457Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3267
2025-10-10T14:40:19.219478Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3267
2025-10-10T14:40:19.219510Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602944594611171:12883]
2025-10-10T14:40:19.219520Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:19.219526Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:19.219623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:19.219633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:19.219668Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ab4dbb25-d8b8401-59c01a66-ff9da60f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:19.219681Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:19.219690Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:19.219697Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:19.219709Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:19.219722Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:19.219741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:19.219962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:19.219968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:19.219983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:19.220545Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|870d51db-a84070cd-925a4963-bc1979ed_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|ab4dbb25-d8b8401-59c01a66-ff9da60f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:19.220096Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3268 partition: 0 MaxSeqNo: 40 sessionId: src_id|ab4dbb25-d8b8401-59c01a66-ff9da60f_0
2025-10-10T14:40:19.223464Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ab4dbb25-d8b8401-59c01a66-ff9da60f_0] Write session: try to update token
2025-10-10T14:40:19.223484Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ab4dbb25-d8b8401-59c01a66-ff9da60f_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:19.240579Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:19.240596Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:19.240600Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:19.240603Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:19.240613Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602944594611171:12883]
2025-10-10T14:40:19.240618Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602944594611171:12883]
2025-10-10T14:40:19.240622Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602944594611171:12883]
2025-10-10T14:40:19.240666Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:19.240671Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:19.240675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:19.240676Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:19.240683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:19.240685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:19.240819Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:19.246364Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3268 sessionId: src_id|ab4dbb25-d8b8401-59c01a66-ff9da60f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:19.249177Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:19.299570Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602945376864768:2851]
2025-10-10T14:40:19.299893Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 pipe creation result: OK TabletId: 72075186224037892 Generation: 3267, pipe: [1:7559602945376864768:2851]
2025-10-10T14:40:19.361694Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:19.362101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:19.362121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:19.362175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602945376864768:2851], now have 1 active actors on pipe
2025-10-10T14:40:19.362602Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:19.365556Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab4dbb25-d8b8401-59c01a66-ff9da60f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:40:19.365587Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab4dbb25-d8b8401-59c01a66-ff9da60f_0] Write session will restart in 0.005908s
2025-10-10T14:40:19.365614Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab4dbb25-d8b8401-59c01a66-ff9da60f_0] Write session: Do CDS request
2025-10-10T14:40:19.365621Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab4dbb25-d8b8401-59c01a66-ff9da60f_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:19.362614Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 66 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602945376864768:2851]
2025-10-10T14:40:19.362627Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:40:19.362632Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:40:19.362650Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:19.362698Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3268 reason: error at write: Disconnected sessionId: src_id|ab4dbb25-d8b8401-59c01a66-ff9da60f_0
2025-10-10T14:40:19.362914Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3268 sessionId: src_id|ab4dbb25-d8b8401-59c01a66-ff9da60f_0 is DEAD
2025-10-10T14:40:19.372945Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ab4dbb25-d8b8401-59c01a66-ff9da60f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:19.373025Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:19.373047Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3269
2025-10-10T14:40:19.373190Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3269 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:19.373231Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3269 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:19.373252Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3269 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:19.373257Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:19.373792Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3269 sessionId:  describe result for acl check
2025-10-10T14:40:19.373836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:19.373838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:19.373841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:19.373849Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602945376864850:8605] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:19.374467Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602945376864850:8605] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:19.375114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:19.376830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:19.377031Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:19.377044Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:19.377057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:19.377108Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602945376864850:8605] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:19.377110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:19.377152Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602944594611291:12886]
2025-10-10T14:40:19.377807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:19.378155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:19.378216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:19.378620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:19.378697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:19.378703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:19.378704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:19.378705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:19.378706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:19.378708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:19.378709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:19.378711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:19.378712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:19.378713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:19.378715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:19.378716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:19.378717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:19.378724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:19.378737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:19.378760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:19.378764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:19.378768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:19.378773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:19.378777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:19.378781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:19.378785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:19.378790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:19.378799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:19.378803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:19.378807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:19.378817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:19.378830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:19.378841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:19.378847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:19.378851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:19.378856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:19.378860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:19.378866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:19.378871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:19.378876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:19.378881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:19.378892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:19.378897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:19.378903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:19.378911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:19.378916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:19.378921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:19.378928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:19.378937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:19.378943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:19.378947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:19.378956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:19.378961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:19.378966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:19.378972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:19.378977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:19.379022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:19.381659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:19.381495Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602945376864850:8605] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:19.381514Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602945376864850:8605] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:19.381519Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602945376864850:8605] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:19.381528Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3269 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:19.382277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:19.382291Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:19.382294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:19.382299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:19.382306Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3268 [2:7559602944594611291:12886]
2025-10-10T14:40:19.382320Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:19.382338Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:19.382342Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:19.382346Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:19.382348Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:19.382369Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:19.382376Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:19.382390Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:19.382454Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:19.382462Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:19.382465Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:19.382467Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:19.382538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:19.382548Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:19.382560Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:19.382571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:19.382590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:19.382613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602945376864887:8605], now have 1 active actors on pipe
2025-10-10T14:40:19.382622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602945376864770:2438], now have 1 active actors on pipe
2025-10-10T14:40:19.382630Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602944594611286:12886]
2025-10-10T14:40:19.382632Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602944594611286:12886]
2025-10-10T14:40:19.382634Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602944594611286:12886]
2025-10-10T14:40:19.382650Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:19.382668Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:19.382669Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:19.382673Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:19.382676Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:19.382688Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:19.382691Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:19.382679Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3268
2025-10-10T14:40:19.382681Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3268
2025-10-10T14:40:19.382730Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602944594611286:12886]
2025-10-10T14:40:19.382738Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:19.382741Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:19.382763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:19.382774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:19.382816Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e3fa5978-934efcfd-8802db6d-482fb8db_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:19.382831Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:19.382835Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:19.382837Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:19.382847Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:19.382858Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:19.382885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:19.383042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:19.383054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:19.383078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:19.383175Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3269 partition: 0 MaxSeqNo: 40 sessionId: src_id|e3fa5978-934efcfd-8802db6d-482fb8db_0
2025-10-10T14:40:19.383631Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab4dbb25-d8b8401-59c01a66-ff9da60f_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|e3fa5978-934efcfd-8802db6d-482fb8db_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:19.386637Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e3fa5978-934efcfd-8802db6d-482fb8db_0] Write session: try to update token
2025-10-10T14:40:19.386655Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e3fa5978-934efcfd-8802db6d-482fb8db_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:19.404162Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3269 sessionId: src_id|e3fa5978-934efcfd-8802db6d-482fb8db_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:19.402917Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:19.402941Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:19.402945Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:19.402948Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:19.402959Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602944594611286:12886]
2025-10-10T14:40:19.402964Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602944594611286:12886]
2025-10-10T14:40:19.402969Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602944594611286:12886]
2025-10-10T14:40:19.403041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:19.403047Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:19.403052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:19.403055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:19.403060Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:19.403064Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:19.403224Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:19.406804Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:19.462850Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602945376864894:2851]
2025-10-10T14:40:19.463161Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 pipe creation result: OK TabletId: 72075186224037892 Generation: 3268, pipe: [1:7559602945376864894:2851]
2025-10-10T14:40:19.534761Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:19.535172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:19.535193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:19.535254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602945376864894:2851], now have 1 active actors on pipe
2025-10-10T14:40:19.535546Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:19.536157Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e3fa5978-934efcfd-8802db6d-482fb8db_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:40:19.536173Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e3fa5978-934efcfd-8802db6d-482fb8db_0] Write session will restart in 0.005402s
2025-10-10T14:40:19.536211Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e3fa5978-934efcfd-8802db6d-482fb8db_0] Write session: Do CDS request
2025-10-10T14:40:19.536217Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e3fa5978-934efcfd-8802db6d-482fb8db_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:19.535547Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:40:19.535568Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:40:19.535729Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 67 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602945376864894:2851]
2025-10-10T14:40:19.535747Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:19.535768Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3269 reason: error at write: Disconnected sessionId: src_id|e3fa5978-934efcfd-8802db6d-482fb8db_0
2025-10-10T14:40:19.535979Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3269 sessionId: src_id|e3fa5978-934efcfd-8802db6d-482fb8db_0 is DEAD
2025-10-10T14:40:19.544533Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e3fa5978-934efcfd-8802db6d-482fb8db_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:19.544664Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:19.544685Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3270
2025-10-10T14:40:19.544837Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3270 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:19.544867Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3270 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:19.544873Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3270 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:19.544878Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:19.545430Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3270 sessionId:  describe result for acl check
2025-10-10T14:40:19.545464Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:19.545466Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:19.545468Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:19.545475Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602945376864912:8632] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:19.546068Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602945376864912:8632] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:19.549950Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602945376864912:8632] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:19.553159Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602945376864912:8632] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:19.553179Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602945376864912:8632] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:19.553193Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602945376864912:8632] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:19.553202Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3270 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:19.554741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:19.556822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:19.557052Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:19.557056Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:19.557069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:19.557122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:19.557162Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602944594611404:12888]
2025-10-10T14:40:19.557830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:19.558265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:19.558327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:19.558663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:19.558714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:19.558715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:19.558716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:19.558717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:19.558719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:19.558720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:19.558722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:19.558723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:19.558724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:19.558725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:19.558727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:19.558728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:19.558729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:19.558735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:19.558747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:19.558752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:19.558756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:19.558760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:19.558764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:19.558768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:19.558772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:19.558776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:19.558780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:19.558784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:19.558788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:19.558792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:19.558800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:19.558810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:19.558818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:19.558825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:19.558830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:19.558836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:19.558840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:19.558845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:19.558851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:19.558857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:19.558861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:19.558867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:19.558873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:19.558878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:19.558882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:19.558889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:19.558894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:19.558900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:19.558905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:19.558910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:19.558917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:19.558923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:19.558928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:19.558933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:19.558939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:19.558944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:19.558986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:19.562887Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3269
2025-10-10T14:40:19.562954Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3269
2025-10-10T14:40:19.561789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:19.562382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:19.562388Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:19.562391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:19.562396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:19.562402Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3269 [2:7559602944594611404:12888]
2025-10-10T14:40:19.562418Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:19.562436Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:19.562440Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:19.562444Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:19.562447Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:19.562467Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:19.562476Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:19.562484Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:19.562566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:19.562569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:19.562571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:19.562574Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:19.562650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:19.562654Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:19.562667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:19.562679Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:19.562697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:19.562718Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602944594611399:12888]
2025-10-10T14:40:19.562721Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602944594611399:12888]
2025-10-10T14:40:19.562722Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602944594611399:12888]
2025-10-10T14:40:19.562734Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:19.562749Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:19.562763Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:19.562766Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:19.562768Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:19.562773Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:19.562776Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:19.562802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602945376864896:2438], now have 1 active actors on pipe
2025-10-10T14:40:19.562806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602945376864998:8632], now have 1 active actors on pipe
2025-10-10T14:40:19.562808Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602944594611399:12888]
2025-10-10T14:40:19.562821Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:19.562856Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:19.563127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:19.563145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:19.563188Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f830cac9-bf660a5d-5d3e2148-9b2b20af_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:19.563211Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:19.563217Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:19.563221Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:19.563237Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:19.563253Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:19.563279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:19.563590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:19.563603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:19.563624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:19.564192Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e3fa5978-934efcfd-8802db6d-482fb8db_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|f830cac9-bf660a5d-5d3e2148-9b2b20af_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:19.563807Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3270 partition: 0 MaxSeqNo: 40 sessionId: src_id|f830cac9-bf660a5d-5d3e2148-9b2b20af_0
2025-10-10T14:40:19.566941Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f830cac9-bf660a5d-5d3e2148-9b2b20af_0] Write session: try to update token
2025-10-10T14:40:19.566964Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f830cac9-bf660a5d-5d3e2148-9b2b20af_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:19.584259Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:19.584283Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:19.584286Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:19.584289Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:19.584301Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602944594611399:12888]
2025-10-10T14:40:19.584307Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602944594611399:12888]
2025-10-10T14:40:19.584313Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602944594611399:12888]
2025-10-10T14:40:19.584377Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:19.584383Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:19.584395Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:19.584398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:19.584393Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:19.584407Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:19.584575Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:19.586543Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3270 sessionId: src_id|f830cac9-bf660a5d-5d3e2148-9b2b20af_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:19.589465Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:19.637432Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602945376865013:2851]
2025-10-10T14:40:19.645655Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 pipe creation result: OK TabletId: 72075186224037892 Generation: 3269, pipe: [1:7559602945376865013:2851]
2025-10-10T14:40:19.706170Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:19.708659Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f830cac9-bf660a5d-5d3e2148-9b2b20af_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:40:19.708676Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f830cac9-bf660a5d-5d3e2148-9b2b20af_0] Write session will restart in 0.008601s
2025-10-10T14:40:19.708711Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f830cac9-bf660a5d-5d3e2148-9b2b20af_0] Write session: Do CDS request
2025-10-10T14:40:19.708717Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f830cac9-bf660a5d-5d3e2148-9b2b20af_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:19.708185Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:40:19.708302Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3270 reason: status is not ok: tablet will be restarted right now sessionId: src_id|f830cac9-bf660a5d-5d3e2148-9b2b20af_0
2025-10-10T14:40:19.708485Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3270 sessionId: src_id|f830cac9-bf660a5d-5d3e2148-9b2b20af_0 is DEAD
2025-10-10T14:40:19.708681Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 68 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602945376865013:2851]
2025-10-10T14:40:19.708696Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:19.706917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:19.706935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:19.706975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602945376865013:2851], now have 1 active actors on pipe
2025-10-10T14:40:19.707178Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:19.718901Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f830cac9-bf660a5d-5d3e2148-9b2b20af_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:19.719101Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:19.719126Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3271
2025-10-10T14:40:19.719295Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3271 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:19.719350Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3271 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:19.719361Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3271 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:19.719366Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:19.719828Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3271 sessionId:  describe result for acl check
2025-10-10T14:40:19.719866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:19.719872Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:19.719874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:19.719880Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602945376865065:8641] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:19.720472Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602945376865065:8641] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:19.724820Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602945376865065:8641] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:19.729700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:19.732149Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602945376865065:8641] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:19.732170Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602945376865065:8641] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:19.732175Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602945376865065:8641] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:19.732185Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3271 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:19.731880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:19.732143Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:19.732148Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:19.732162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:19.732247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:19.732292Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602944594611555:12901]
2025-10-10T14:40:19.732921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:19.733289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:19.733352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:19.733696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:19.733760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:19.733761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:19.733762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:19.733763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:19.733765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:19.733766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:19.733767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:19.733769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:19.733770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:19.733771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:19.733773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:19.733774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:19.733776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:19.733782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:19.733795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:19.733800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:19.733803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:19.733807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:19.733811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:19.733814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:19.733818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:19.733822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:19.733825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:19.733829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:19.733832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:19.733836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:19.733844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:19.733853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:19.733861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:19.733883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:19.733889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:19.733895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:19.733901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:19.733907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:19.733912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:19.733917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:19.733922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:19.733928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:19.733933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:19.733939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:19.733943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:19.733948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:19.733953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:19.733958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:19.733962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:19.733967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:19.733972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:19.733979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:19.733982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:19.733989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:19.733993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:19.733998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:19.734037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:19.737457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:19.737842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:19.737857Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:19.737860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:19.737864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:19.737870Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3270 [2:7559602944594611555:12901]
2025-10-10T14:40:19.737884Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:19.737902Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:19.737906Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:19.737909Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:19.737912Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:19.737929Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:19.737937Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:19.737945Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:19.738003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:19.738005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:19.738007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:19.738010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:19.738086Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:19.738090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:19.738103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:19.738115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:19.738133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:19.738156Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602944594611550:12901]
2025-10-10T14:40:19.738159Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602944594611550:12901]
2025-10-10T14:40:19.738161Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602944594611550:12901]
2025-10-10T14:40:19.738284Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:19.738302Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:19.738320Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:19.738323Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:19.738335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602945376865028:2438], now have 1 active actors on pipe
2025-10-10T14:40:19.738339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602945376865144:8641], now have 1 active actors on pipe
2025-10-10T14:40:19.738365Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602944594611550:12901]
2025-10-10T14:40:19.738368Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:19.738775Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3270
2025-10-10T14:40:19.738825Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3270
2025-10-10T14:40:19.738686Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:19.738695Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:19.738697Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:19.738703Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:19.739102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:19.739113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:19.739146Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d10d500f-92b52c81-66e68134-29dc737a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:19.739156Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:19.739161Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:19.739164Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:19.739176Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:19.739190Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:19.739207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:19.739700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:19.739709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:19.739731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:19.739906Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3271 partition: 0 MaxSeqNo: 40 sessionId: src_id|d10d500f-92b52c81-66e68134-29dc737a_0
2025-10-10T14:40:19.740539Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f830cac9-bf660a5d-5d3e2148-9b2b20af_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|d10d500f-92b52c81-66e68134-29dc737a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:19.743302Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d10d500f-92b52c81-66e68134-29dc737a_0] Write session: try to update token
2025-10-10T14:40:19.743324Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d10d500f-92b52c81-66e68134-29dc737a_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:19.751669Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:40:19.751685Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:19.751694Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602944594611550:12901]
2025-10-10T14:40:19.751739Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:40:19.751797Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:40:19.751901Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:40:19.752058Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:19.752197Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:19.752339Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:19.752517Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:40:19.752555Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:40:19.762773Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3271 sessionId: src_id|d10d500f-92b52c81-66e68134-29dc737a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:19.765858Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:19.766129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:19.766150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:19.766192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:40:19.766497Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:40:19.770484Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:19.770509Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:19.770515Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:19.770518Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:19.770531Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602944594611550:12901]
2025-10-10T14:40:19.770536Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602944594611550:12901]
2025-10-10T14:40:19.770540Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602944594611550:12901]
2025-10-10T14:40:19.770601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:19.770600Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:19.770609Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:19.770614Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:19.770619Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:19.770621Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:19.770806Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:19.809012Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602945376865156:2851]
2025-10-10T14:40:19.811071Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 pipe creation result: OK TabletId: 72075186224037892 Generation: 3270, pipe: [1:7559602945376865156:2851]
2025-10-10T14:40:19.889554Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:19.898378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:19.898405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:19.898595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:19.898657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:19.898719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:19.898780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:19.899168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:19.899174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:19.899248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:19.899304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:19.899366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:19.899428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:19.899475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:19.899479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:19.899547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:19.899605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:19.899663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:19.899727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:19.899767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:19.899770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:19.899838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:19.899897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:19.899955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:19.900015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:19.900054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:19.900057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:19.900124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:19.900184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:19.900262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:19.900323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:19.900370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:19.900373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:19.900439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:19.900497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:19.900558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:19.900625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:19.900664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:19.900667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:19.900736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:19.900795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:19.900856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:19.900919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:19.900959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:19.900961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:19.901031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:19.901094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:19.901157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:19.901216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:19.901256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:19.901261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:19.902892Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d10d500f-92b52c81-66e68134-29dc737a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:40:19.902381Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:19.902906Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d10d500f-92b52c81-66e68134-29dc737a_0] Write session will restart in 0.009836s
2025-10-10T14:40:19.902441Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 69 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602945376865156:2851]
2025-10-10T14:40:19.902479Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:40:19.902482Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:40:19.902514Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3271 reason: error at write: Disconnected sessionId: src_id|d10d500f-92b52c81-66e68134-29dc737a_0
2025-10-10T14:40:19.902729Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3271 sessionId: src_id|d10d500f-92b52c81-66e68134-29dc737a_0 is DEAD
2025-10-10T14:40:19.902936Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d10d500f-92b52c81-66e68134-29dc737a_0] Write session: Do CDS request
2025-10-10T14:40:19.902942Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d10d500f-92b52c81-66e68134-29dc737a_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:19.901562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:19.901628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:19.901689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:19.901749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:19.901793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:19.901796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:19.901865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:19.901926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:19.901988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:19.902048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:19.902087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:19.902090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:19.902162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602945376865156:2851], now have 1 active actors on pipe
2025-10-10T14:40:19.902887Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:19.913949Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d10d500f-92b52c81-66e68134-29dc737a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:19.914330Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:19.914350Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3272
2025-10-10T14:40:19.914488Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3272 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:19.914536Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3272 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:19.914542Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3272 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:19.914546Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:19.915235Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3272 sessionId:  describe result for acl check
2025-10-10T14:40:19.915275Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:19.915276Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:19.915278Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:19.915286Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602945376865227:8654] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:19.915904Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602945376865227:8654] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:19.918224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:19.920182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:19.920408Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:19.920423Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:19.920436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:19.920503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:19.920548Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602944594611682:12906]
2025-10-10T14:40:19.921144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:19.921696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:19.921762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:19.922099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:19.922169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:19.922170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:19.922172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:19.922173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:19.922174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:19.922175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:19.922177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:19.922178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:19.922179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:19.922180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:19.922182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:19.922183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:19.922184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:19.922191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:19.922205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:19.922211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:19.922215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:19.922220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:19.922224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:19.922228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:19.922233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:19.922238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:19.922243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:19.922247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:19.922251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:19.922256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:19.922264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:19.922274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:19.922288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:19.922294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:19.922299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:19.922304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:19.922309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:19.922314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:19.922319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:19.922325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:19.922330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:19.922336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:19.922342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:19.922351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:19.922355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:19.922360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:19.922365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:19.922370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:19.922374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:19.922379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:19.922383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:19.922388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:19.922391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:19.922398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:19.922402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:19.922407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:19.922448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:19.923870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602945376865227:8654] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:19.925470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:19.925952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:19.925968Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:19.925971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:19.925975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:19.925983Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3271 [2:7559602944594611682:12906]
2025-10-10T14:40:19.925996Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:19.926018Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:19.926027Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:19.926031Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:19.926033Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:19.926050Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:19.926062Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:19.926074Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:19.926137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:19.926146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:19.926148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:19.926151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:19.926222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:19.926229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:19.926241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:19.926252Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:19.926272Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:19.926295Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602944594611677:12906]
2025-10-10T14:40:19.926301Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602944594611677:12906]
2025-10-10T14:40:19.926303Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602944594611677:12906]
2025-10-10T14:40:19.926317Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:19.926340Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:19.926361Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:19.926369Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:19.926403Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602944594611677:12906]
2025-10-10T14:40:19.926411Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:19.926519Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:19.926527Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:19.926529Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:19.926536Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:19.926813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602945376865166:2438], now have 1 active actors on pipe
2025-10-10T14:40:19.926932Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3271
2025-10-10T14:40:19.927326Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602945376865227:8654] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:19.927333Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602945376865227:8654] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:19.927337Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602945376865227:8654] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:19.927347Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3272 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:19.927911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602945376865281:8654], now have 1 active actors on pipe
2025-10-10T14:40:19.928031Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3271
2025-10-10T14:40:19.928136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:19.928147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:19.928179Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|31658a4-a2ed2c20-e2349ca1-7a7f7d5c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:19.928190Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:19.928196Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:19.928199Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:19.928214Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:19.928244Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:19.928266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:19.929227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:19.929239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:19.929262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:19.929432Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3272 partition: 0 MaxSeqNo: 40 sessionId: src_id|31658a4-a2ed2c20-e2349ca1-7a7f7d5c_0
2025-10-10T14:40:19.929937Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d10d500f-92b52c81-66e68134-29dc737a_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|31658a4-a2ed2c20-e2349ca1-7a7f7d5c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:19.932744Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|31658a4-a2ed2c20-e2349ca1-7a7f7d5c_0] Write session: try to update token
2025-10-10T14:40:19.932765Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|31658a4-a2ed2c20-e2349ca1-7a7f7d5c_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:19.951783Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:19.951803Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:19.951807Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:19.951810Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:19.951820Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602944594611677:12906]
2025-10-10T14:40:19.951825Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602944594611677:12906]
2025-10-10T14:40:19.951829Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602944594611677:12906]
2025-10-10T14:40:19.951897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:19.951906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:19.951908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:19.951922Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:19.951929Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:19.951939Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:19.952054Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:19.954351Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3272 sessionId: src_id|31658a4-a2ed2c20-e2349ca1-7a7f7d5c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:19.956986Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:20.002515Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602949671832595:2851]
2025-10-10T14:40:20.002944Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 pipe creation result: OK TabletId: 72075186224037892 Generation: 3271, pipe: [1:7559602949671832595:2851]
2025-10-10T14:40:20.073281Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:20.073684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:20.073704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:20.073756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602949671832595:2851], now have 1 active actors on pipe
2025-10-10T14:40:20.074063Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:20.074885Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31658a4-a2ed2c20-e2349ca1-7a7f7d5c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:40:20.074898Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31658a4-a2ed2c20-e2349ca1-7a7f7d5c_0] Write session will restart in 0.005054s
2025-10-10T14:40:20.074924Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31658a4-a2ed2c20-e2349ca1-7a7f7d5c_0] Write session: Do CDS request
2025-10-10T14:40:20.074931Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31658a4-a2ed2c20-e2349ca1-7a7f7d5c_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:20.074417Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:40:20.074507Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3272 reason: status is not ok: tablet will be restarted right now sessionId: src_id|31658a4-a2ed2c20-e2349ca1-7a7f7d5c_0
2025-10-10T14:40:20.074741Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3272 sessionId: src_id|31658a4-a2ed2c20-e2349ca1-7a7f7d5c_0 is DEAD
2025-10-10T14:40:20.074952Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:20.074989Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 70 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602949671832595:2851]
2025-10-10T14:40:20.080928Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|31658a4-a2ed2c20-e2349ca1-7a7f7d5c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:20.081883Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:20.081901Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3273
2025-10-10T14:40:20.085468Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3273 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:20.085531Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3273 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:20.085538Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3273 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:20.085545Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:20.086202Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3273 sessionId:  describe result for acl check
2025-10-10T14:40:20.086242Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:20.086244Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:20.086246Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:20.086253Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602949671832657:8681] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:20.086872Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602949671832657:8681] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:20.090812Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602949671832657:8681] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:20.094350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:20.098377Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602949671832657:8681] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:20.098399Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602949671832657:8681] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:20.098403Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602949671832657:8681] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:20.098415Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3273 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:20.099687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:20.099999Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:20.100015Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:20.100030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:20.100107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:20.100183Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602948889579096:12908]
2025-10-10T14:40:20.100875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:20.101289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:20.101368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:20.101762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:20.101836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:20.101843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:20.101844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:20.101845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:20.101847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:20.101863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:20.101865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:20.101866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:20.101867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:20.101869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:20.101871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:20.101872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:20.101873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:20.101882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:20.101896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:20.101901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:20.101905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:20.101908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:20.101912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:20.101917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:20.101921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:20.101924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:20.101929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:20.101932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:20.101936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:20.101940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:20.101949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:20.101962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:20.101973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:20.101988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:20.101998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:20.102004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:20.102013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:20.102019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:20.102028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:20.102035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:20.102040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:20.102046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:20.102051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:20.102057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:20.102061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:20.102070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:20.102075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:20.102085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:20.102091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:20.102100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:20.102105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:20.102116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:20.102121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:20.102126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:20.102134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:20.102140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:20.102188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:20.105129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:20.105848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:20.105865Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:20.105869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:20.105874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:20.105883Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3272 [2:7559602948889579096:12908]
2025-10-10T14:40:20.105903Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:20.105924Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:20.105936Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:20.105940Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:20.105944Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:20.105964Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:20.105978Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:20.105986Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:20.106072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:20.106082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:20.106085Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:20.106088Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:20.106175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:20.106189Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:20.106204Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:20.106218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:20.106237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:20.106259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602949671832708:8681], now have 1 active actors on pipe
2025-10-10T14:40:20.106276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602949671832597:2438], now have 1 active actors on pipe
2025-10-10T14:40:20.106285Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602948889579089:12908]
2025-10-10T14:40:20.106287Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602948889579089:12908]
2025-10-10T14:40:20.106297Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602948889579089:12908]
2025-10-10T14:40:20.106317Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:20.106332Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:20.106350Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:20.106351Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:20.106354Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:20.106356Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:20.106358Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:20.106398Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602948889579089:12908]
2025-10-10T14:40:20.106412Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:20.106398Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3272
2025-10-10T14:40:20.106439Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3272
2025-10-10T14:40:20.106429Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:20.106668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:20.106681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:20.106709Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7b51f91e-db971d1b-18c6e8e1-37fcfa76_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:20.106717Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:20.106722Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:20.106725Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:20.106741Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:20.106752Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:20.106774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:20.107124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:20.107135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:20.107154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:20.107292Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3273 partition: 0 MaxSeqNo: 40 sessionId: src_id|7b51f91e-db971d1b-18c6e8e1-37fcfa76_0
2025-10-10T14:40:20.107778Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31658a4-a2ed2c20-e2349ca1-7a7f7d5c_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|7b51f91e-db971d1b-18c6e8e1-37fcfa76_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:20.110784Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7b51f91e-db971d1b-18c6e8e1-37fcfa76_0] Write session: try to update token
2025-10-10T14:40:20.110809Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7b51f91e-db971d1b-18c6e8e1-37fcfa76_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:20.132703Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3273 sessionId: src_id|7b51f91e-db971d1b-18c6e8e1-37fcfa76_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:20.130007Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:20.130032Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:20.130036Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:20.130043Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:20.130055Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602948889579089:12908]
2025-10-10T14:40:20.130060Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602948889579089:12908]
2025-10-10T14:40:20.130066Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602948889579089:12908]
2025-10-10T14:40:20.130132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:20.130143Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:20.130145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:20.130328Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:20.135381Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:20.135657Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:20.135674Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:20.135678Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:20.177429Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602949671832720:2851]
2025-10-10T14:40:20.177933Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 pipe creation result: OK TabletId: 72075186224037892 Generation: 3272, pipe: [1:7559602949671832720:2851]
2025-10-10T14:40:20.251050Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:20.251543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:20.251562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:20.251609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602949671832720:2851], now have 1 active actors on pipe
2025-10-10T14:40:20.251978Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:20.252642Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 71 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602949671832720:2851]
2025-10-10T14:40:20.252683Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:20.252724Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:40:20.253712Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b51f91e-db971d1b-18c6e8e1-37fcfa76_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:40:20.253743Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b51f91e-db971d1b-18c6e8e1-37fcfa76_0] Write session will restart in 0.007041s
2025-10-10T14:40:20.253770Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b51f91e-db971d1b-18c6e8e1-37fcfa76_0] Write session: Do CDS request
2025-10-10T14:40:20.253776Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b51f91e-db971d1b-18c6e8e1-37fcfa76_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:20.252833Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3273 reason: status is not ok: tablet will be restarted right now sessionId: src_id|7b51f91e-db971d1b-18c6e8e1-37fcfa76_0
2025-10-10T14:40:20.253071Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3273 sessionId: src_id|7b51f91e-db971d1b-18c6e8e1-37fcfa76_0 is DEAD
2025-10-10T14:40:20.261982Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7b51f91e-db971d1b-18c6e8e1-37fcfa76_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:20.268677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:20.264539Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:20.264564Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3274
2025-10-10T14:40:20.268302Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3274 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:20.268354Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3274 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:20.268361Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3274 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:20.268367Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:20.268863Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3274 sessionId:  describe result for acl check
2025-10-10T14:40:20.268894Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:20.268897Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:20.268899Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:20.268907Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602949671832802:8678] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:20.269605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602949671832802:8678] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:20.271791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:20.272052Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:20.272057Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:20.272069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:20.272130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:20.272173Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602948889579212:12910]
2025-10-10T14:40:20.272869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:20.273253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:20.273319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:20.273266Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602949671832802:8678] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:20.273698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:20.273778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:20.273788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:20.273789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:20.273791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:20.273793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:20.273794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:20.273795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:20.273797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:20.273798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:20.273800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:20.273801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:20.273802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:20.273804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:20.273810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:20.273824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:20.273829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:20.273833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:20.273838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:20.273843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:20.273847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:20.273851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:20.273856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:20.273861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:20.273865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:20.273868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:20.273872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:20.273880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:20.273889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:20.273895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:20.273901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:20.273907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:20.273913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:20.273918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:20.273923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:20.273928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:20.273934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:20.273939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:20.273945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:20.273951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:20.273956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:20.273961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:20.273967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:20.273972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:20.273977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:20.273981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:20.273986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:20.273994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:20.274000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:20.274005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:20.274011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:20.274016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:20.274021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:20.274059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:20.276841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:20.276812Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602949671832802:8678] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:20.276831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602949671832802:8678] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:20.276835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602949671832802:8678] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:20.276844Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3274 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:20.277357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:20.277370Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:20.277373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:20.277378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:20.277385Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3273 [2:7559602948889579212:12910]
2025-10-10T14:40:20.277409Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:20.277431Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:20.277435Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:20.277438Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:20.277440Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:20.277460Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:20.277473Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:20.277479Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:20.277542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:20.277550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:20.277552Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:20.277555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:20.277635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:20.277642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:20.277653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:20.277663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:20.277678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:20.277707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602949671832836:8678], now have 1 active actors on pipe
2025-10-10T14:40:20.277716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602949671832722:2438], now have 1 active actors on pipe
2025-10-10T14:40:20.277723Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602948889579207:12910]
2025-10-10T14:40:20.277726Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602948889579207:12910]
2025-10-10T14:40:20.277728Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602948889579207:12910]
2025-10-10T14:40:20.277742Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:20.277757Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:20.277759Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:20.277770Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:20.277774Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:20.277776Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:20.277779Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:20.277796Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3273
2025-10-10T14:40:20.277797Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3273
2025-10-10T14:40:20.277806Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602948889579207:12910]
2025-10-10T14:40:20.277817Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:20.277823Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:20.278153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:20.278164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:20.278200Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8e98345-ca52d1f9-f78ee2a4-56f92bcd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:20.278208Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:20.278218Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:20.278221Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:20.278235Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:20.278250Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:20.278274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:20.278730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:20.278749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:20.278772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:20.278892Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3274 partition: 0 MaxSeqNo: 40 sessionId: src_id|8e98345-ca52d1f9-f78ee2a4-56f92bcd_0
2025-10-10T14:40:20.279939Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b51f91e-db971d1b-18c6e8e1-37fcfa76_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|8e98345-ca52d1f9-f78ee2a4-56f92bcd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:20.282770Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8e98345-ca52d1f9-f78ee2a4-56f92bcd_0] Write session: try to update token
2025-10-10T14:40:20.282792Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8e98345-ca52d1f9-f78ee2a4-56f92bcd_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:20.300108Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3274 sessionId: src_id|8e98345-ca52d1f9-f78ee2a4-56f92bcd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:20.303242Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:20.303628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:20.303668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:20.303713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:40:20.303860Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:40:20.312701Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:20.312725Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:20.312729Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:20.312732Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:20.312743Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602948889579207:12910]
2025-10-10T14:40:20.312749Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602948889579207:12910]
2025-10-10T14:40:20.312755Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602948889579207:12910]
2025-10-10T14:40:20.312818Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:20.312828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:20.312831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:20.312835Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:20.312844Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:20.312850Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:20.313006Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:20.352835Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602949671832844:2851]
2025-10-10T14:40:20.353265Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 pipe creation result: OK TabletId: 72075186224037892 Generation: 3273, pipe: [1:7559602949671832844:2851]
2025-10-10T14:40:20.437440Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:20.449853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:20.449895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:20.450125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:20.450215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:20.450299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:20.450395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:20.450835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:20.450854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:20.450950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:20.451021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:20.451664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:20.451747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:20.451800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:20.451804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:20.451894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:20.451966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:20.452044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:20.452121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:20.452184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:20.452187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:20.452290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:20.452370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:20.452455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:20.452534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:20.452596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:20.452600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:20.452687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:20.452759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:20.452841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:20.452919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:20.452976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:20.452979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:20.453066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:20.453140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:20.453216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:20.453294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:20.453572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:20.453586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:20.453679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:20.453758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:20.453844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:20.453940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:20.454005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:20.454013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:20.454103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:20.454182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:20.454265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:20.454346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:20.454411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:20.454419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:20.454504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:20.454579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:20.454657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:20.454756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:20.454820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:20.454828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:20.454914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:20.454991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:20.455077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:20.455161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:20.455808Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:40:20.455831Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:40:20.455876Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3274 reason: error at write: Disconnected sessionId: src_id|8e98345-ca52d1f9-f78ee2a4-56f92bcd_0
2025-10-10T14:40:20.456192Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3274 sessionId: src_id|8e98345-ca52d1f9-f78ee2a4-56f92bcd_0 is DEAD
2025-10-10T14:40:20.456341Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e98345-ca52d1f9-f78ee2a4-56f92bcd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:40:20.456353Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e98345-ca52d1f9-f78ee2a4-56f92bcd_0] Write session will restart in 0.008827s
2025-10-10T14:40:20.456381Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e98345-ca52d1f9-f78ee2a4-56f92bcd_0] Write session: Do CDS request
2025-10-10T14:40:20.456395Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e98345-ca52d1f9-f78ee2a4-56f92bcd_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:20.456420Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 72 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602949671832844:2851]
2025-10-10T14:40:20.456448Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:20.455228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:20.455241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:20.455324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602949671832844:2851], now have 1 active actors on pipe
2025-10-10T14:40:20.456416Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:20.469899Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8e98345-ca52d1f9-f78ee2a4-56f92bcd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:20.470757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:20.473452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:20.473695Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:20.473710Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:20.473724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:20.473756Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:20.473785Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3275
2025-10-10T14:40:20.474546Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3275 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:20.473783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:20.473835Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602948889579332:12913]
2025-10-10T14:40:20.474499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:20.474590Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3275 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:20.474596Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3275 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:20.474605Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:20.474962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:20.475022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:20.475071Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3275 sessionId:  describe result for acl check
2025-10-10T14:40:20.475110Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:20.475116Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:20.475119Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:20.475124Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602949671832930:8695] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:20.475384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:20.475472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:20.475479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:20.475480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:20.475482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:20.475483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:20.475485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:20.475486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:20.475487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:20.475489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:20.475490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:20.475491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:20.475493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:20.475494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:20.475501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:20.475513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:20.475518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:20.475523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:20.475527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:20.475531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:20.475535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:20.475539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:20.475543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:20.475547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:20.475551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:20.475555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:20.475559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:20.475568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:20.475576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:20.475583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:20.475589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:20.475593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:20.475599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:20.475603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:20.475609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:20.475617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:20.475623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:20.475628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:20.475633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:20.475638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:20.475643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:20.475647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:20.475652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:20.475657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:20.475663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:20.475671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:20.475676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:20.475680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:20.475686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:20.475697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:20.475715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:20.475729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:20.475735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:20.475760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602949671832930:8695] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:20.475773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:20.478520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:20.478909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:20.478923Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:20.478926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:20.478930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:20.478936Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3274 [2:7559602948889579332:12913]
2025-10-10T14:40:20.478952Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:20.478973Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:20.478977Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:20.478981Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:20.478984Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:20.479001Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:20.479013Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:20.479020Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:20.479073Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:20.479078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:20.479079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:20.479082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:20.479137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:20.479146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:20.479156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:20.479167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:20.479182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:20.479203Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602948889579327:12913]
2025-10-10T14:40:20.479206Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602948889579327:12913]
2025-10-10T14:40:20.479208Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602948889579327:12913]
2025-10-10T14:40:20.479223Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:20.479239Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:20.479240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602949671832847:2438], now have 1 active actors on pipe
2025-10-10T14:40:20.479243Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:20.479245Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:20.479250Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:20.479266Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:20.479269Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:20.479295Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602948889579327:12913]
2025-10-10T14:40:20.479307Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:20.479307Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3274
2025-10-10T14:40:20.479345Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:20.479434Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602949671832930:8695] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:20.486596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602949671832930:8695] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:20.486621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602949671832930:8695] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:20.486624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602949671832930:8695] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:20.486634Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3275 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:20.486965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602949671832965:8695], now have 1 active actors on pipe
2025-10-10T14:40:20.487089Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3274
2025-10-10T14:40:20.487251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:20.487272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:20.487303Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5263f5f6-c36c780d-b808d5df-90b99447_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:20.487317Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:20.487330Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:20.487334Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:20.487349Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:20.487382Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:20.487401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:20.487583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:20.487598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:20.487614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:20.487711Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3275 partition: 0 MaxSeqNo: 40 sessionId: src_id|5263f5f6-c36c780d-b808d5df-90b99447_0
2025-10-10T14:40:20.489454Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e98345-ca52d1f9-f78ee2a4-56f92bcd_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|5263f5f6-c36c780d-b808d5df-90b99447_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:20.492181Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5263f5f6-c36c780d-b808d5df-90b99447_0] Write session: try to update token
2025-10-10T14:40:20.492204Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5263f5f6-c36c780d-b808d5df-90b99447_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:20.500713Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:20.500740Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:20.500743Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:20.500746Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:20.500759Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602948889579327:12913]
2025-10-10T14:40:20.500765Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602948889579327:12913]
2025-10-10T14:40:20.500776Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602948889579327:12913]
2025-10-10T14:40:20.500833Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:20.500835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:20.500841Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:20.500845Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:20.500847Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:20.500848Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:20.501043Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:20.515109Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3275 sessionId: src_id|5263f5f6-c36c780d-b808d5df-90b99447_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:20.518019Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:20.556520Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602949671832969:2851]
2025-10-10T14:40:20.557298Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 pipe creation result: OK TabletId: 72075186224037892 Generation: 3274, pipe: [1:7559602949671832969:2851]
2025-10-10T14:40:20.630409Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:20.630942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:20.630961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:20.630982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602949671832969:2851], now have 1 active actors on pipe
2025-10-10T14:40:20.631440Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:20.631527Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 73 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602949671832969:2851]
2025-10-10T14:40:20.631551Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:40:20.631554Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:40:20.631647Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3275 reason: error at write: Disconnected sessionId: src_id|5263f5f6-c36c780d-b808d5df-90b99447_0
2025-10-10T14:40:20.631318Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:20.631976Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3275 sessionId: src_id|5263f5f6-c36c780d-b808d5df-90b99447_0 is DEAD
2025-10-10T14:40:20.632575Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5263f5f6-c36c780d-b808d5df-90b99447_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:40:20.632588Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5263f5f6-c36c780d-b808d5df-90b99447_0] Write session will restart in 0.009054s
2025-10-10T14:40:20.632614Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5263f5f6-c36c780d-b808d5df-90b99447_0] Write session: Do CDS request
2025-10-10T14:40:20.632624Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5263f5f6-c36c780d-b808d5df-90b99447_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:20.645948Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5263f5f6-c36c780d-b808d5df-90b99447_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:20.648865Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:20.648896Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3276
2025-10-10T14:40:20.649032Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3276 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:20.649073Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3276 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:20.649085Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3276 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:20.649089Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:20.650174Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3276 sessionId:  describe result for acl check
2025-10-10T14:40:20.650219Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:20.650226Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:20.650229Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:20.650237Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602949671833045:8703] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:20.650879Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602949671833045:8703] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:20.655176Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602949671833045:8703] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:20.655966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:20.657919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:20.658160Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:20.658173Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:20.658185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:20.658246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:20.658295Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602948889579451:12915]
2025-10-10T14:40:20.658982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:20.659800Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602949671833045:8703] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:20.659817Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602949671833045:8703] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:20.659820Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602949671833045:8703] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:20.659828Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3276 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:20.660355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:20.660436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:20.660838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:20.660904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:20.660912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:20.660914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:20.660916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:20.660917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:20.660919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:20.660920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:20.660922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:20.660923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:20.660924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:20.660926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:20.660927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:20.660929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:20.660937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:20.660950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:20.660954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:20.660958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:20.660961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:20.660966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:20.660969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:20.660973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:20.660977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:20.660982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:20.660986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:20.660990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:20.660994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:20.661002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:20.661011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:20.661018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:20.661024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:20.661029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:20.661034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:20.661038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:20.661044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:20.661048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:20.661054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:20.661059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:20.661064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:20.661068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:20.661074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:20.661078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:20.661083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:20.661088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:20.661094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:20.661099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:20.661104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:20.661108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:20.661114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:20.661119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:20.661126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:20.661132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:20.661137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:20.661176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:20.663867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:20.664382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:20.664386Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:20.664388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:20.664391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:20.664398Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3275 [2:7559602948889579451:12915]
2025-10-10T14:40:20.664409Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:20.664425Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:20.664428Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:20.664430Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:20.664432Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:20.664447Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:20.664455Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:20.664463Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:20.664519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:20.664531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:20.664534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:20.664536Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:20.664618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:20.664625Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:20.664633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:20.664641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:20.664656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:20.664678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602949671832970:2438], now have 1 active actors on pipe
2025-10-10T14:40:20.664685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602949671833083:8703], now have 1 active actors on pipe
2025-10-10T14:40:20.664692Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602948889579446:12915]
2025-10-10T14:40:20.664694Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602948889579446:12915]
2025-10-10T14:40:20.664698Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602948889579446:12915]
2025-10-10T14:40:20.664715Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:20.664733Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:20.664747Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:20.664753Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:20.664733Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3275
2025-10-10T14:40:20.664755Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3275
2025-10-10T14:40:20.664789Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602948889579446:12915]
2025-10-10T14:40:20.664795Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:20.664798Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:20.664802Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:20.664804Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:20.664813Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:20.665001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:20.665033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:20.665078Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c835e579-3fe71948-da5254c5-1bad58e6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:20.665096Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:20.665107Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:20.665110Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:20.665125Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:20.665148Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:20.665178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:20.665391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:20.665406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:20.665441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:20.665563Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3276 partition: 0 MaxSeqNo: 40 sessionId: src_id|c835e579-3fe71948-da5254c5-1bad58e6_0
2025-10-10T14:40:20.665977Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5263f5f6-c36c780d-b808d5df-90b99447_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|c835e579-3fe71948-da5254c5-1bad58e6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:20.668725Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c835e579-3fe71948-da5254c5-1bad58e6_0] Write session: try to update token
2025-10-10T14:40:20.668745Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c835e579-3fe71948-da5254c5-1bad58e6_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:20.685011Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:20.685032Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:20.685036Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:20.685039Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:20.685051Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602948889579446:12915]
2025-10-10T14:40:20.685057Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602948889579446:12915]
2025-10-10T14:40:20.685062Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602948889579446:12915]
2025-10-10T14:40:20.685126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:20.685132Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:20.685141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:20.685142Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:20.685145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:20.685147Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:20.685322Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:20.696617Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3276 sessionId: src_id|c835e579-3fe71948-da5254c5-1bad58e6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:20.699327Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:20.733397Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602949671833098:2851]
2025-10-10T14:40:20.733734Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 pipe creation result: OK TabletId: 72075186224037892 Generation: 3275, pipe: [1:7559602949671833098:2851]
2025-10-10T14:40:20.806016Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:20.806427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:20.806444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:20.806464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602949671833098:2851], now have 1 active actors on pipe
2025-10-10T14:40:20.806719Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:20.807449Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:40:20.807603Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3276 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c835e579-3fe71948-da5254c5-1bad58e6_0
2025-10-10T14:40:20.807745Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:20.807796Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 74 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602949671833098:2851]
2025-10-10T14:40:20.807832Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3276 sessionId: src_id|c835e579-3fe71948-da5254c5-1bad58e6_0 is DEAD
2025-10-10T14:40:20.809533Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c835e579-3fe71948-da5254c5-1bad58e6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:40:20.809546Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c835e579-3fe71948-da5254c5-1bad58e6_0] Write session will restart in 0.006195s
2025-10-10T14:40:20.809572Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c835e579-3fe71948-da5254c5-1bad58e6_0] Write session: Do CDS request
2025-10-10T14:40:20.809578Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c835e579-3fe71948-da5254c5-1bad58e6_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:20.817922Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c835e579-3fe71948-da5254c5-1bad58e6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:20.818262Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:20.818283Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3277
2025-10-10T14:40:20.818445Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3277 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:20.818478Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3277 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:20.818485Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3277 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:20.818491Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:20.825013Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3277 sessionId:  describe result for acl check
2025-10-10T14:40:20.825065Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:20.825076Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:20.825079Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:20.825086Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602949671833187:8724] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:20.825705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602949671833187:8724] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:20.829266Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602949671833187:8724] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:20.830657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:20.833892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:20.834100Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:20.834108Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:20.834118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:20.834171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:20.834219Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602948889579621:12931]
2025-10-10T14:40:20.834667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:20.835152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:20.835186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:20.835451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:20.835523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:20.835529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:20.835530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:20.835531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:20.835532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:20.835533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:20.835535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:20.835536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:20.835538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:20.835539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:20.835540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:20.835541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:20.835542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:20.835547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:20.835559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:20.835562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:20.835566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:20.835569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:20.835573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:20.835577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:20.835580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:20.835584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:20.835591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:20.835595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:20.835598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:20.835602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:20.835610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:20.835624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:20.835635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:20.835643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:20.835648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:20.835653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:20.835659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:20.835666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:20.835677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:20.835682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:20.835655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602949671833187:8724] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:20.835688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:20.835674Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602949671833187:8724] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:20.835694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:20.835678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602949671833187:8724] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:20.835700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:20.835688Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3277 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:20.835705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:20.835709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:20.835714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:20.835719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:20.835724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:20.835733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:20.835741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:20.835750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:20.835755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:20.835764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:20.835770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:20.835775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:20.835779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:20.835810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:20.838818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:20.839445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:20.839464Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:20.839467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:20.839471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:20.839480Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3276 [2:7559602948889579621:12931]
2025-10-10T14:40:20.839495Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:20.839517Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:20.839521Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:20.839525Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:20.839527Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:20.839545Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:20.839554Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:20.839562Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:20.839630Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:20.839640Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:20.839643Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:20.839646Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:20.839721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:20.839730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:20.839741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:20.839755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:20.839777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:20.839805Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602948889579615:12931]
2025-10-10T14:40:20.839813Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602948889579615:12931]
2025-10-10T14:40:20.839815Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602948889579615:12931]
2025-10-10T14:40:20.839825Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:20.839842Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:20.839863Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:20.839872Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:20.839897Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:20.839908Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:20.839911Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:20.839912Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602948889579615:12931]
2025-10-10T14:40:20.839915Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:20.839919Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:20.840056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602949671833122:2438], now have 1 active actors on pipe
2025-10-10T14:40:20.840066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602949671833233:8724], now have 1 active actors on pipe
2025-10-10T14:40:20.840250Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3276
2025-10-10T14:40:20.840322Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3276
2025-10-10T14:40:20.840451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:20.840464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:20.840498Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a49e71e-800f5752-4577df56-8d383b04_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:20.840512Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:20.840520Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:20.840528Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:20.840540Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:20.840557Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:20.840582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:20.840792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:20.840801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:20.841080Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3277 partition: 0 MaxSeqNo: 40 sessionId: src_id|a49e71e-800f5752-4577df56-8d383b04_0
2025-10-10T14:40:20.840816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:20.841706Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c835e579-3fe71948-da5254c5-1bad58e6_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|a49e71e-800f5752-4577df56-8d383b04_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:20.844393Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a49e71e-800f5752-4577df56-8d383b04_0] Write session: try to update token
2025-10-10T14:40:20.844413Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a49e71e-800f5752-4577df56-8d383b04_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:20.861108Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:20.861138Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:20.861143Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:20.861146Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:20.861158Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602948889579615:12931]
2025-10-10T14:40:20.861169Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602948889579615:12931]
2025-10-10T14:40:20.861175Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602948889579615:12931]
2025-10-10T14:40:20.861238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:20.861259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:20.861267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:20.861472Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:20.863064Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3277 sessionId: src_id|a49e71e-800f5752-4577df56-8d383b04_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:20.863262Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:20.863277Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:20.863288Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:20.865881Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:20.908194Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602949671833250:2851]
2025-10-10T14:40:20.908630Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 pipe creation result: OK TabletId: 72075186224037892 Generation: 3276, pipe: [1:7559602949671833250:2851]
2025-10-10T14:40:20.985628Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:20.985981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:20.985997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:20.986040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602949671833250:2851], now have 1 active actors on pipe
2025-10-10T14:40:20.986334Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:20.986324Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:20.986391Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:40:20.987090Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a49e71e-800f5752-4577df56-8d383b04_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:40:20.987103Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a49e71e-800f5752-4577df56-8d383b04_0] Write session will restart in 0.007561s
2025-10-10T14:40:20.987127Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a49e71e-800f5752-4577df56-8d383b04_0] Write session: Do CDS request
2025-10-10T14:40:20.987134Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a49e71e-800f5752-4577df56-8d383b04_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:20.986404Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:40:20.986488Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3277 reason: error at write: Disconnected sessionId: src_id|a49e71e-800f5752-4577df56-8d383b04_0
2025-10-10T14:40:20.986693Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3277 sessionId: src_id|a49e71e-800f5752-4577df56-8d383b04_0 is DEAD
2025-10-10T14:40:20.986856Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 75 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602949671833250:2851]
2025-10-10T14:40:20.995985Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a49e71e-800f5752-4577df56-8d383b04_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:21.001509Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:21.001530Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3278
2025-10-10T14:40:21.005478Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3278 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:21.005544Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3278 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:21.005551Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3278 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:21.005556Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:21.006056Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3278 sessionId:  describe result for acl check
2025-10-10T14:40:21.005955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:21.006099Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:21.006107Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:21.006109Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:21.006116Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602953966800649:8726] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:21.006739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602953966800649:8726] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:21.008932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:21.009208Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:21.009222Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:21.009235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:21.009316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:21.009528Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602953966800649:8726] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:21.009537Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602953184547038:12933]
2025-10-10T14:40:21.010281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:21.010821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:21.010903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:21.011268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:21.011363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:21.011374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:21.011376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:21.011377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:21.011378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:21.011380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:21.011385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:21.011387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:21.011388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:21.011389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:21.011391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:21.011392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:21.011394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:21.011400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:21.011412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:21.011417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:21.011421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:21.011425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:21.011430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:21.011434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:21.011437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:21.011441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:21.011446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:21.011450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:21.011454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:21.011458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:21.011467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:21.011475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:21.011488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:21.011494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:21.011499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:21.011505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:21.011510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:21.011516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:21.011521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:21.011527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:21.011532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:21.011538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:21.011543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:21.011549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:21.011556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:21.011562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:21.011566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:21.011572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:21.011576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:21.011581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:21.011586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:21.011591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:21.011596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:21.011601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:21.011606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:21.011611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:21.011652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:21.012678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602953966800649:8726] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:21.012697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602953966800649:8726] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:21.012702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602953966800649:8726] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:21.012711Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3278 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:21.015354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:21.015893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:21.015910Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:21.015913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:21.015917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:21.015924Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3277 [2:7559602953184547038:12933]
2025-10-10T14:40:21.015939Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:21.015958Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:21.015967Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:21.015971Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:21.015974Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:21.015988Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:21.016000Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:21.016007Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:21.016090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:21.016101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:21.016104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:21.016107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:21.016180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:21.016190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:21.016217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:21.016231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:21.016252Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:21.016276Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602953184547033:12933]
2025-10-10T14:40:21.016285Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602953184547033:12933]
2025-10-10T14:40:21.016287Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602953184547033:12933]
2025-10-10T14:40:21.016302Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:21.016319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602949671833270:2438], now have 1 active actors on pipe
2025-10-10T14:40:21.016328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602953966800680:8726], now have 1 active actors on pipe
2025-10-10T14:40:21.016328Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:21.016332Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:21.016334Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:21.016337Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:21.016353Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:21.016357Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:21.016390Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602953184547033:12933]
2025-10-10T14:40:21.016401Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:21.016423Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:21.016397Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3277
2025-10-10T14:40:21.016398Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3277
2025-10-10T14:40:21.016514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:21.016526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:21.016551Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ccb13af0-3764f217-2aeff44a-6fb19e52_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:21.016562Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:21.016567Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:21.016569Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:21.016580Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:21.016590Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:21.016603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:21.017210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:21.017224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:21.017247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:21.017592Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3278 partition: 0 MaxSeqNo: 40 sessionId: src_id|ccb13af0-3764f217-2aeff44a-6fb19e52_0
2025-10-10T14:40:21.018038Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a49e71e-800f5752-4577df56-8d383b04_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|ccb13af0-3764f217-2aeff44a-6fb19e52_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:21.020781Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ccb13af0-3764f217-2aeff44a-6fb19e52_0] Write session: try to update token
2025-10-10T14:40:21.020802Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ccb13af0-3764f217-2aeff44a-6fb19e52_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:21.035034Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3278 sessionId: src_id|ccb13af0-3764f217-2aeff44a-6fb19e52_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:21.037673Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:21.038670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:21.038701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:21.038723Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:21.038726Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:21.038729Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:21.038732Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:21.038740Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602953184547033:12933]
2025-10-10T14:40:21.038745Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602953184547033:12933]
2025-10-10T14:40:21.038749Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602953184547033:12933]
2025-10-10T14:40:21.038790Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:21.038813Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:21.038814Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:21.038816Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:21.038824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:21.038827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:21.038986Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:21.084896Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602953966800688:2851]
2025-10-10T14:40:21.085263Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 pipe creation result: OK TabletId: 72075186224037892 Generation: 3277, pipe: [1:7559602953966800688:2851]
2025-10-10T14:40:21.157457Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:21.157860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:40:21.157925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602953966800688:2851], now have 1 active actors on pipe
2025-10-10T14:40:21.158065Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:40:21.158123Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 76 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602953966800688:2851]
2025-10-10T14:40:21.158149Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:21.158225Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:40:21.158236Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:40:21.158331Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3278 reason: error at write: Disconnected sessionId: src_id|ccb13af0-3764f217-2aeff44a-6fb19e52_0
2025-10-10T14:40:21.158549Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3278 sessionId: src_id|ccb13af0-3764f217-2aeff44a-6fb19e52_0 is DEAD
2025-10-10T14:40:21.158765Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ccb13af0-3764f217-2aeff44a-6fb19e52_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:40:21.158778Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ccb13af0-3764f217-2aeff44a-6fb19e52_0] Write session will restart in 0.008975s
2025-10-10T14:40:21.158805Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ccb13af0-3764f217-2aeff44a-6fb19e52_0] Write session: Do CDS request
2025-10-10T14:40:21.158812Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ccb13af0-3764f217-2aeff44a-6fb19e52_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:21.169008Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ccb13af0-3764f217-2aeff44a-6fb19e52_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:21.169099Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:21.169124Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3279
2025-10-10T14:40:21.169292Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3279 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:21.169325Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3279 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:21.169347Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3279 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:21.169353Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:21.169869Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3279 sessionId:  describe result for acl check
2025-10-10T14:40:21.169912Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:21.169918Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:21.169920Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:21.169927Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602953966800774:8732] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:21.170186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:21.170555Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602953966800774:8732] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:21.172899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:21.173151Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:21.173162Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:21.173173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:21.173233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:21.173281Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602953184547160:12935]
2025-10-10T14:40:21.173356Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602953966800774:8732] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:21.173935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:21.174448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:21.174513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:21.174862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:21.174986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:21.174993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:21.174994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:21.174996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:21.174998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:21.174999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:21.175001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:21.175002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:21.175006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:21.175008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:21.175009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:21.175011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:21.175012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:21.175019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:21.175030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:21.175034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:21.175038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:21.175043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:21.175047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:21.175050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:21.175054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:21.175058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:21.175065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:21.175069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:21.175074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:21.175078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:21.175086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:21.175095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:21.175101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:21.175114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:21.175120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:21.175126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:21.175131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:21.175137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:21.175143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:21.175159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:21.175164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:21.175168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:21.175174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:21.175180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:21.175185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:21.175190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:21.175195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:21.175200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:21.175205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:21.175210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:21.175215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:21.175219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:21.175224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:21.175231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:21.175237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:21.175241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:21.175292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:21.178187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:21.178128Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602953966800774:8732] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:21.178153Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602953966800774:8732] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:21.178157Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602953966800774:8732] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:21.178166Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3279 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:21.178687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:21.178702Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:21.178705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:21.178709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:21.178716Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3278 [2:7559602953184547160:12935]
2025-10-10T14:40:21.178731Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:21.178746Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:21.178754Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:21.178759Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:21.178762Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:21.178776Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:21.178788Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:21.178801Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:21.178886Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:21.178897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:21.178899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:21.178902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:21.178976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:21.178984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:21.178997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:21.179009Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:21.179033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:21.179051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602953966800808:8732], now have 1 active actors on pipe
2025-10-10T14:40:21.179055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602953966800690:2438], now have 1 active actors on pipe
2025-10-10T14:40:21.179062Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602953184547155:12935]
2025-10-10T14:40:21.179064Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602953184547155:12935]
2025-10-10T14:40:21.179066Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602953184547155:12935]
2025-10-10T14:40:21.179081Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:21.179092Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:21.179104Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:21.179107Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:21.179108Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:21.179110Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:21.179111Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:21.179137Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602953184547155:12935]
2025-10-10T14:40:21.179140Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:21.179150Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:21.179167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:21.179171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:21.179207Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7e33ef34-74a2c44d-bebcdd51-fae27796_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:21.179214Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:21.179221Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:21.179224Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:21.179234Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:21.179244Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:21.179263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:21.179403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:21.179410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:21.179433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:21.180097Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ccb13af0-3764f217-2aeff44a-6fb19e52_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|7e33ef34-74a2c44d-bebcdd51-fae27796_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:21.179093Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3278
2025-10-10T14:40:21.179142Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3278
2025-10-10T14:40:21.179656Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3279 partition: 0 MaxSeqNo: 40 sessionId: src_id|7e33ef34-74a2c44d-bebcdd51-fae27796_0
2025-10-10T14:40:21.182882Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7e33ef34-74a2c44d-bebcdd51-fae27796_0] Write session: try to update token
2025-10-10T14:40:21.182907Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7e33ef34-74a2c44d-bebcdd51-fae27796_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:21.201363Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3279 sessionId: src_id|7e33ef34-74a2c44d-bebcdd51-fae27796_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:21.199237Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:21.199263Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:21.199267Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:21.199270Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:21.199281Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602953184547155:12935]
2025-10-10T14:40:21.199286Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602953184547155:12935]
2025-10-10T14:40:21.199291Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602953184547155:12935]
2025-10-10T14:40:21.199360Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:21.199365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:21.199369Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:21.199374Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:21.199375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:21.199378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:21.199545Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:21.205161Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:21.258478Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602953966800816:2851]
2025-10-10T14:40:21.258830Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 pipe creation result: OK TabletId: 72075186224037892 Generation: 3278, pipe: [1:7559602953966800816:2851]
2025-10-10T14:40:21.328930Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:21.329498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:21.329514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:21.329559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602953966800816:2851], now have 1 active actors on pipe
2025-10-10T14:40:21.329847Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:21.330541Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:21.330615Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 77 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602953966800816:2851]
2025-10-10T14:40:21.330663Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:40:21.330754Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3279 reason: status is not ok: tablet will be restarted right now sessionId: src_id|7e33ef34-74a2c44d-bebcdd51-fae27796_0
2025-10-10T14:40:21.330958Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3279 sessionId: src_id|7e33ef34-74a2c44d-bebcdd51-fae27796_0 is DEAD
2025-10-10T14:40:21.331266Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e33ef34-74a2c44d-bebcdd51-fae27796_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:40:21.331283Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e33ef34-74a2c44d-bebcdd51-fae27796_0] Write session will restart in 0.005067s
2025-10-10T14:40:21.331312Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e33ef34-74a2c44d-bebcdd51-fae27796_0] Write session: Do CDS request
2025-10-10T14:40:21.331318Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e33ef34-74a2c44d-bebcdd51-fae27796_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:21.337947Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7e33ef34-74a2c44d-bebcdd51-fae27796_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:21.338083Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:21.338107Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3280
2025-10-10T14:40:21.338278Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3280 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:21.338320Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3280 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:21.338337Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3280 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:21.338341Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:21.339253Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3280 sessionId:  describe result for acl check
2025-10-10T14:40:21.339310Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:21.339312Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:21.339314Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:21.339331Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602953966800851:8747] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:21.339948Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602953966800851:8747] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:21.343226Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602953966800851:8747] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:21.344086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:21.346731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:21.347075Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:21.347097Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:21.347081Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602953966800851:8747] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:21.347103Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602953966800851:8747] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:21.347126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:21.347107Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602953966800851:8747] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:21.347118Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3280 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:21.347294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:21.347363Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602953184547285:12938]
2025-10-10T14:40:21.348014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:21.348430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:21.348505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:21.348975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:21.349048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:21.349056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:21.349058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:21.349060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:21.349062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:21.349063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:21.349065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:21.349067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:21.349068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:21.349070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:21.349072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:21.349073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:21.349075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:21.349082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:21.349094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:21.349098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:21.349103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:21.349107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:21.349111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:21.349116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:21.349120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:21.349125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:21.349130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:21.349134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:21.349138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:21.349143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:21.349153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:21.349162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:21.349169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:21.349176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:21.349185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:21.349192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:21.349197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:21.349203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:21.349208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:21.349213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:21.349219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:21.349225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:21.349232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:21.349238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:21.349243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:21.349250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:21.349255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:21.349262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:21.349268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:21.349275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:21.349283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:21.349292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:21.349297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:21.349303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:21.349308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:21.349313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:21.349372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:21.352431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:21.353012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:21.353025Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:21.353028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:21.353032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:21.353039Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3279 [2:7559602953184547285:12938]
2025-10-10T14:40:21.353055Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:21.353073Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:21.353077Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:21.353080Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:21.353083Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:21.353100Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:21.353114Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:21.353122Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:21.353202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:21.353211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:21.353214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:21.353221Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:21.353301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:21.353311Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:21.353323Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:21.353350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:21.353372Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:21.353399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602953966800933:8747], now have 1 active actors on pipe
2025-10-10T14:40:21.353411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602953966800817:2438], now have 1 active actors on pipe
2025-10-10T14:40:21.353418Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602953184547280:12938]
2025-10-10T14:40:21.353421Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602953184547280:12938]
2025-10-10T14:40:21.353424Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602953184547280:12938]
2025-10-10T14:40:21.353438Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:21.353452Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:21.353457Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:21.353473Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3279
2025-10-10T14:40:21.353478Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3279
2025-10-10T14:40:21.353462Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:21.353465Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:21.353468Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:21.353472Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:21.353504Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602953184547280:12938]
2025-10-10T14:40:21.353508Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:21.353511Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:21.353526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:21.353531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:21.353588Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cc68f7e0-76f503f6-9d2fdb3-4971a7b9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:21.353605Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:21.353610Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:21.353613Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:21.353624Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:21.353633Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:21.353651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:21.353839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:21.353848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:21.353861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:21.353953Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3280 partition: 0 MaxSeqNo: 40 sessionId: src_id|cc68f7e0-76f503f6-9d2fdb3-4971a7b9_0
2025-10-10T14:40:21.354364Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e33ef34-74a2c44d-bebcdd51-fae27796_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|cc68f7e0-76f503f6-9d2fdb3-4971a7b9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:21.357528Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cc68f7e0-76f503f6-9d2fdb3-4971a7b9_0] Write session: try to update token
2025-10-10T14:40:21.357549Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cc68f7e0-76f503f6-9d2fdb3-4971a7b9_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:21.373674Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3280 sessionId: src_id|cc68f7e0-76f503f6-9d2fdb3-4971a7b9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:21.374607Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:21.374631Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:21.374635Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:21.374638Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:21.374654Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602953184547280:12938]
2025-10-10T14:40:21.374659Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602953184547280:12938]
2025-10-10T14:40:21.374667Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602953184547280:12938]
2025-10-10T14:40:21.374730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:21.374740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:21.374743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:21.374908Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:21.374927Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:21.374934Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:21.377378Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:21.377411Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:21.431005Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602953966800948:2851]
2025-10-10T14:40:21.431413Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 pipe creation result: OK TabletId: 72075186224037892 Generation: 3279, pipe: [1:7559602953966800948:2851]
2025-10-10T14:40:21.513942Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:21.514408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:21.514425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:21.514469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602953966800948:2851], now have 1 active actors on pipe
2025-10-10T14:40:21.514864Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:21.514888Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:40:21.514906Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:40:21.515006Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 78 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602953966800948:2851]
2025-10-10T14:40:21.515019Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3280 reason: error at write: Disconnected sessionId: src_id|cc68f7e0-76f503f6-9d2fdb3-4971a7b9_0
2025-10-10T14:40:21.515052Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:21.515243Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3280 sessionId: src_id|cc68f7e0-76f503f6-9d2fdb3-4971a7b9_0 is DEAD
2025-10-10T14:40:21.515391Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc68f7e0-76f503f6-9d2fdb3-4971a7b9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:40:21.515399Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc68f7e0-76f503f6-9d2fdb3-4971a7b9_0] Write session will restart in 0.009236s
2025-10-10T14:40:21.515437Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc68f7e0-76f503f6-9d2fdb3-4971a7b9_0] Write session: Do CDS request
2025-10-10T14:40:21.515448Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc68f7e0-76f503f6-9d2fdb3-4971a7b9_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:21.525934Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cc68f7e0-76f503f6-9d2fdb3-4971a7b9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:21.526049Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:21.526089Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3281
2025-10-10T14:40:21.526333Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3281 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:21.526374Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3281 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:21.526385Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3281 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:21.526390Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:21.527014Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3281 sessionId:  describe result for acl check
2025-10-10T14:40:21.527057Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:21.527059Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:21.527061Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:21.527069Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602953966801026:8750] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:21.527717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602953966801026:8750] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:21.529764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:21.529996Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602953966801026:8750] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:21.531961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:21.532372Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:21.532383Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:21.532399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:21.532482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:21.532533Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602953184547409:12940]
2025-10-10T14:40:21.533250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:21.533349Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602953966801026:8750] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:21.533373Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602953966801026:8750] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:21.533378Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602953966801026:8750] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:21.533390Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3281 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:21.533588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:21.533638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:21.534004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:21.534073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:21.534080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:21.534081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:21.534083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:21.534084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:21.534085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:21.534087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:21.534089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:21.534090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:21.534091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:21.534093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:21.534094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:21.534096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:21.534102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:21.534115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:21.534120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:21.534124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:21.534127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:21.534132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:21.534136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:21.534140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:21.534145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:21.534150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:21.534154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:21.534158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:21.534162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:21.534170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:21.534181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:21.534187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:21.534194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:21.534199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:21.534205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:21.534210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:21.534216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:21.534221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:21.534227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:21.534231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:21.534237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:21.534244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:21.534250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:21.534254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:21.534259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:21.534263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:21.534268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:21.534273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:21.534279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:21.534285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:21.534292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:21.534303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:21.534308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:21.534317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:21.534323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:21.534365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:21.537532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:21.538012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:21.538027Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:21.538030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:21.538050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:21.538057Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3280 [2:7559602953184547409:12940]
2025-10-10T14:40:21.538072Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:21.538098Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:21.538106Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:21.538110Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:21.538112Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:21.538135Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:21.538147Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:21.538157Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:21.538241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:21.538248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:21.538250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:21.538252Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:21.538334Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:21.538342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:21.538353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:21.538367Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:21.538390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:21.538425Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602953184547404:12940]
2025-10-10T14:40:21.538432Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602953184547404:12940]
2025-10-10T14:40:21.538434Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602953184547404:12940]
2025-10-10T14:40:21.538454Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:21.538476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602953966800950:2438], now have 1 active actors on pipe
2025-10-10T14:40:21.538479Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:21.538485Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:21.538486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602953966801069:8750], now have 1 active actors on pipe
2025-10-10T14:40:21.538489Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:21.538496Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:21.538512Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:21.538520Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:21.538563Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602953184547404:12940]
2025-10-10T14:40:21.538577Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:21.538627Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:21.538757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:21.538776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:21.538810Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c4e133a8-80880018-b58cfc0f-c0b7147d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:21.538831Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:21.538836Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:21.538842Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:21.538857Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:21.538884Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:21.538910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:21.539194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:21.539213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:21.539256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:21.538568Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3280
2025-10-10T14:40:21.538664Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3280
2025-10-10T14:40:21.539358Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3281 partition: 0 MaxSeqNo: 40 sessionId: src_id|c4e133a8-80880018-b58cfc0f-c0b7147d_0
2025-10-10T14:40:21.539871Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc68f7e0-76f503f6-9d2fdb3-4971a7b9_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|c4e133a8-80880018-b58cfc0f-c0b7147d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:21.542974Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c4e133a8-80880018-b58cfc0f-c0b7147d_0] Write session: try to update token
2025-10-10T14:40:21.542996Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c4e133a8-80880018-b58cfc0f-c0b7147d_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:21.559056Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:40:21.559073Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:21.559085Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602953184547404:12940]
2025-10-10T14:40:21.559155Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:40:21.559163Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:40:21.559352Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:40:21.559363Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3281 sessionId: src_id|c4e133a8-80880018-b58cfc0f-c0b7147d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:21.559504Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:21.559654Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:21.559803Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:21.560013Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:40:21.560073Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:40:21.563034Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:21.563298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:21.563319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:21.563375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:40:21.563458Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:40:21.573176Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:21.573197Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:21.573200Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:21.573203Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:21.573219Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602953184547404:12940]
2025-10-10T14:40:21.573224Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602953184547404:12940]
2025-10-10T14:40:21.573228Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602953184547404:12940]
2025-10-10T14:40:21.573278Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:21.573282Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:21.573291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:21.573291Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:21.573293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:21.573297Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:21.573454Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:21.615335Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602953966801078:2851]
2025-10-10T14:40:21.615675Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 pipe creation result: OK TabletId: 72075186224037892 Generation: 3280, pipe: [1:7559602953966801078:2851]
2025-10-10T14:40:21.691424Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:21.699906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:21.699937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:21.700133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:21.700212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:21.700284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:21.700361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:21.700791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:21.700809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:21.700885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:21.700943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:21.701005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:21.701068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:21.701114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:21.701117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:21.701194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:21.701256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:21.701323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:21.701424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:21.701470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:21.701474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:21.701551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:21.701628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:21.701698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:21.701761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:21.701812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:21.701820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:21.701894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:21.701963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:21.702025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:21.702093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:21.702148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:21.702159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:21.702230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:21.702296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:21.702366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:21.702434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:21.702477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:21.702485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:21.702557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:21.702627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:21.702698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:21.702766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:21.702817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:21.702824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:21.702893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:21.702956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:21.703021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:21.703096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:21.703146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:21.703153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:21.703225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:21.703296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:21.703360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:21.703432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:21.703482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:21.703489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:21.703559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:21.703623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:21.703690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:21.703755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:21.703802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:21.703805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:21.703872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602953966801078:2851], now have 1 active actors on pipe
2025-10-10T14:40:21.704521Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:21.704276Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:40:21.704293Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 79 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602953966801078:2851]
2025-10-10T14:40:21.704302Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:40:21.704325Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:21.704339Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3281 reason: error at write: Disconnected sessionId: src_id|c4e133a8-80880018-b58cfc0f-c0b7147d_0
2025-10-10T14:40:21.704765Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4e133a8-80880018-b58cfc0f-c0b7147d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:40:21.704777Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4e133a8-80880018-b58cfc0f-c0b7147d_0] Write session will restart in 0.009129s
2025-10-10T14:40:21.704803Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4e133a8-80880018-b58cfc0f-c0b7147d_0] Write session: Do CDS request
2025-10-10T14:40:21.704826Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4e133a8-80880018-b58cfc0f-c0b7147d_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:21.704677Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3281 sessionId: src_id|c4e133a8-80880018-b58cfc0f-c0b7147d_0 is DEAD
2025-10-10T14:40:21.714959Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c4e133a8-80880018-b58cfc0f-c0b7147d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:21.715380Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:21.715418Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3282
2025-10-10T14:40:21.717831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:21.716999Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3282 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:21.717052Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3282 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:21.717059Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3282 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:21.717065Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:21.717518Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3282 sessionId:  describe result for acl check
2025-10-10T14:40:21.717549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:21.717550Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:21.717556Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:21.717562Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602953966801168:8761] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:21.718184Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602953966801168:8761] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:21.719864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:21.720101Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:21.720175Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:21.720208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:21.720284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:21.720351Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602953184547535:12942]
2025-10-10T14:40:21.721023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:21.721070Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602953966801168:8761] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:21.721394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:21.721448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:21.721799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:21.721860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:21.721867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:21.721868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:21.721870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:21.721871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:21.721872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:21.721874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:21.721875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:21.721877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:21.721878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:21.721880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:21.721881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:21.721883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:21.721890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:21.721905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:21.721910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:21.721915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:21.721919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:21.721924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:21.721929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:21.721934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:21.721938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:21.721943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:21.721948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:21.721952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:21.721961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:21.721970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:21.721986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:21.721997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:21.722003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:21.722011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:21.722017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:21.722022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:21.722028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:21.722033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:21.722038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:21.722044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:21.722050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:21.722055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:21.722066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:21.722071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:21.722080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:21.722085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:21.722092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:21.722100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:21.722105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:21.722110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:21.722119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:21.722124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:21.722129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:21.722137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:21.722143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:21.722183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:21.724691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602953966801168:8761] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:21.724709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602953966801168:8761] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:21.724713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602953966801168:8761] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:21.724723Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3282 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:21.724825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:21.725471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:21.725484Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:21.725486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:21.725491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:21.725497Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3281 [2:7559602953184547535:12942]
2025-10-10T14:40:21.725512Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:21.725530Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:21.725534Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:21.725538Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:21.725540Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:21.725558Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:21.725572Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:21.725580Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:21.725645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:21.725655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:21.725657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:21.725659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:21.725732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:21.725740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:21.725753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:21.725769Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:21.725792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:21.725873Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3281
2025-10-10T14:40:21.725903Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3281
2025-10-10T14:40:21.725818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602953966801201:8761], now have 1 active actors on pipe
2025-10-10T14:40:21.725828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602953966801081:2438], now have 1 active actors on pipe
2025-10-10T14:40:21.725836Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602953184547530:12942]
2025-10-10T14:40:21.725838Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602953184547530:12942]
2025-10-10T14:40:21.725841Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602953184547530:12942]
2025-10-10T14:40:21.725854Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:21.725869Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:21.725870Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:21.725874Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:21.725876Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:21.725885Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:21.725888Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:21.725914Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602953184547530:12942]
2025-10-10T14:40:21.725921Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:21.725930Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:21.726064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:21.726073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:21.726121Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4ef0663d-7ecb8a0c-297f3316-b8bd68f7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:21.726156Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:21.726165Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:21.726168Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:21.726181Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:21.726199Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:21.726231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:21.726627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:21.726640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:21.726674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:21.726890Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3282 partition: 0 MaxSeqNo: 40 sessionId: src_id|4ef0663d-7ecb8a0c-297f3316-b8bd68f7_0
2025-10-10T14:40:21.727357Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4e133a8-80880018-b58cfc0f-c0b7147d_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|4ef0663d-7ecb8a0c-297f3316-b8bd68f7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:21.730176Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4ef0663d-7ecb8a0c-297f3316-b8bd68f7_0] Write session: try to update token
2025-10-10T14:40:21.730197Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4ef0663d-7ecb8a0c-297f3316-b8bd68f7_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:21.738602Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:40:21.738636Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:21.738649Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602953184547530:12942]
2025-10-10T14:40:21.738705Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:40:21.738758Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:40:21.738899Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:40:21.739040Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:21.739174Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:21.739306Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:21.739527Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:40:21.739569Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:40:21.750640Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3282 sessionId: src_id|4ef0663d-7ecb8a0c-297f3316-b8bd68f7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:21.753240Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:21.753499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:21.753524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:21.753574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:40:21.753824Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:40:21.759526Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:21.759547Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:21.759551Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:21.759554Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:21.759564Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602953184547530:12942]
2025-10-10T14:40:21.759572Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602953184547530:12942]
2025-10-10T14:40:21.759578Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602953184547530:12942]
2025-10-10T14:40:21.759629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:21.759642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:21.759645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:21.759781Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:21.760895Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:21.760909Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:21.760914Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:21.804761Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602953966801222:2851]
2025-10-10T14:40:21.805668Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 pipe creation result: OK TabletId: 72075186224037892 Generation: 3281, pipe: [1:7559602953966801222:2851]
2025-10-10T14:40:21.884099Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:21.892869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:21.892902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:21.893085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:21.893155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:21.893240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:21.893313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:21.893694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:21.893707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:21.893776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:21.893837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:21.893894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:21.893958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:21.894003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:21.894009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:21.894067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:21.894122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:21.894192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:21.894250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:21.894293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:21.894298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:21.894360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:21.894420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:21.894490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:21.894556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:21.894607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:21.894615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:21.894688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:21.894759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:21.894837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:21.894907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:21.894961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:21.894973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:21.895047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:21.895115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:21.895182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:21.895257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:21.895309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:21.895316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:21.895390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:21.895457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:21.895528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:21.895599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:21.895649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:21.895658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:21.895731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:21.895797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:21.895861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:21.895926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:21.895973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:21.895979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:21.896049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:21.896113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:21.896174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:21.896255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:21.896302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:21.896309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:21.896376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:21.896442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:21.896507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:21.896571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:21.896618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:21.896627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:21.896694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602953966801222:2851], now have 1 active actors on pipe
2025-10-10T14:40:21.897622Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:40:21.897660Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:40:21.897692Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3282 reason: error at write: Disconnected sessionId: src_id|4ef0663d-7ecb8a0c-297f3316-b8bd68f7_0
2025-10-10T14:40:21.897636Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:21.897933Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3282 sessionId: src_id|4ef0663d-7ecb8a0c-297f3316-b8bd68f7_0 is DEAD
2025-10-10T14:40:21.898116Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:21.898167Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 80 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602953966801222:2851]
2025-10-10T14:40:21.901634Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ef0663d-7ecb8a0c-297f3316-b8bd68f7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:40:21.901648Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ef0663d-7ecb8a0c-297f3316-b8bd68f7_0] Write session will restart in 0.005064s
2025-10-10T14:40:21.901675Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ef0663d-7ecb8a0c-297f3316-b8bd68f7_0] Write session: Do CDS request
2025-10-10T14:40:21.901682Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ef0663d-7ecb8a0c-297f3316-b8bd68f7_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:21.907927Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4ef0663d-7ecb8a0c-297f3316-b8bd68f7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:21.909770Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:21.909792Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3283
2025-10-10T14:40:21.910039Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3283 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:21.910076Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3283 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:21.910082Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3283 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:21.910086Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:21.910560Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3283 sessionId:  describe result for acl check
2025-10-10T14:40:21.910601Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:21.910603Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:21.910606Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:21.910612Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602953966801253:8797] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:21.911234Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602953966801253:8797] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:21.918925Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602953966801253:8797] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:21.921611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:21.923644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:21.923719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602953966801253:8797] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:21.923738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602953966801253:8797] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:21.923742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602953966801253:8797] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:21.923752Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3283 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:21.923884Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:21.923897Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:21.923910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:21.923968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:21.924014Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602953184547712:12958]
2025-10-10T14:40:21.924655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:21.924977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:21.925021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:21.925376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:21.925434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:21.925442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:21.925443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:21.925444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:21.925445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:21.925446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:21.925447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:21.925448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:21.925450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:21.925451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:21.925452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:21.925453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:21.925455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:21.925460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:21.925473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:21.925477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:21.925480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:21.925483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:21.925486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:21.925489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:21.925493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:21.925496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:21.925501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:21.925504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:21.925507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:21.925510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:21.925519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:21.925528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:21.925535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:21.925540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:21.925544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:21.925550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:21.925557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:21.925563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:21.925568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:21.925573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:21.925577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:21.925582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:21.925587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:21.925592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:21.925596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:21.925602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:21.925606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:21.925613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:21.925618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:21.925623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:21.925627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:21.925632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:21.925636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:21.925642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:21.925646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:21.925651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:21.925689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:21.928848Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3282
2025-10-10T14:40:21.928849Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3282
2025-10-10T14:40:21.928126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:21.928486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:21.928489Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:21.928492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:21.928496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:21.928502Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3282 [2:7559602953184547712:12958]
2025-10-10T14:40:21.928513Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:21.928531Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:21.928534Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:21.928538Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:21.928541Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:21.928558Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:21.928565Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:21.928572Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:21.928632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:21.928634Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:21.928636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:21.928638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:21.928771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:21.928774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:21.928785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:21.928798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:21.928817Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:21.928841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602953966801359:8797], now have 1 active actors on pipe
2025-10-10T14:40:21.928846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602953966801241:2438], now have 1 active actors on pipe
2025-10-10T14:40:21.928853Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602953184547707:12958]
2025-10-10T14:40:21.928855Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602953184547707:12958]
2025-10-10T14:40:21.928857Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602953184547707:12958]
2025-10-10T14:40:21.928874Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:21.928889Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:21.928890Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:21.928893Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:21.928897Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:21.928905Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:21.928908Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:21.928943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:21.928948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:21.928966Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602953184547707:12958]
2025-10-10T14:40:21.928976Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:21.928989Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:21.929007Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e5482bea-ed9f2911-5bea7932-61f55590_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:21.929015Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:21.929019Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:21.929021Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:21.929032Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:21.929042Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:21.929063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:21.929287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:21.929301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:21.929325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:21.929456Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3283 partition: 0 MaxSeqNo: 40 sessionId: src_id|e5482bea-ed9f2911-5bea7932-61f55590_0
2025-10-10T14:40:21.929850Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ef0663d-7ecb8a0c-297f3316-b8bd68f7_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|e5482bea-ed9f2911-5bea7932-61f55590_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:21.932631Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e5482bea-ed9f2911-5bea7932-61f55590_0] Write session: try to update token
2025-10-10T14:40:21.932649Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e5482bea-ed9f2911-5bea7932-61f55590_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:21.947863Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3283 sessionId: src_id|e5482bea-ed9f2911-5bea7932-61f55590_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:21.949033Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:21.949062Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:21.949069Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:21.949072Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:21.949083Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602953184547707:12958]
2025-10-10T14:40:21.949088Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602953184547707:12958]
2025-10-10T14:40:21.949096Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602953184547707:12958]
2025-10-10T14:40:21.949156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:21.949173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:21.949176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:21.949233Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:21.949249Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:21.949254Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:21.949403Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:21.952934Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:21.998364Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602953966801385:2851]
2025-10-10T14:40:21.998746Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 pipe creation result: OK TabletId: 72075186224037892 Generation: 3282, pipe: [1:7559602953966801385:2851]
2025-10-10T14:40:22.073942Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:22.074273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:22.074289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:22.074337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602953966801385:2851], now have 1 active actors on pipe
2025-10-10T14:40:22.074696Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:22.075070Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e5482bea-ed9f2911-5bea7932-61f55590_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:40:22.075080Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e5482bea-ed9f2911-5bea7932-61f55590_0] Write session will restart in 0.005269s
2025-10-10T14:40:22.075117Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e5482bea-ed9f2911-5bea7932-61f55590_0] Write session: Do CDS request
2025-10-10T14:40:22.075123Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e5482bea-ed9f2911-5bea7932-61f55590_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:22.074623Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 81 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602953966801385:2851]
2025-10-10T14:40:22.074631Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:40:22.074635Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:40:22.074706Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3283 reason: error at write: Disconnected sessionId: src_id|e5482bea-ed9f2911-5bea7932-61f55590_0
2025-10-10T14:40:22.074769Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:22.074917Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3283 sessionId: src_id|e5482bea-ed9f2911-5bea7932-61f55590_0 is DEAD
2025-10-10T14:40:22.081888Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e5482bea-ed9f2911-5bea7932-61f55590_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:22.081972Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:22.081996Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3284
2025-10-10T14:40:22.082125Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3284 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:22.082178Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3284 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:22.082190Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3284 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:22.082194Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:22.082664Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3284 sessionId:  describe result for acl check
2025-10-10T14:40:22.082708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:22.082718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:22.082720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:22.082727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602958261768704:8814] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:22.083303Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602958261768704:8814] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:22.086008Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602958261768704:8814] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:22.086602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:22.088344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:22.088650Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:22.088665Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:22.088678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:22.088742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:22.088788Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602957479515135:12960]
2025-10-10T14:40:22.088993Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602958261768704:8814] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:22.089009Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602958261768704:8814] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:22.089013Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602958261768704:8814] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:22.089021Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3284 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:22.089502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:22.089772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:22.089814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:22.090169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:22.090223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:22.090231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:22.090233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:22.090234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:22.090236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:22.090237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:22.090238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:22.090240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:22.090241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:22.090242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:22.090243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:22.090245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:22.090246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:22.090251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:22.090267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:22.090272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:22.090276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:22.090281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:22.090285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:22.090289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:22.090294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:22.090298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:22.090303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:22.090307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:22.090311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:22.090315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:22.090322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:22.090332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:22.090338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:22.090345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:22.090352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:22.090358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:22.090363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:22.090369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:22.090374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:22.090379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:22.090384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:22.090390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:22.090395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:22.090401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:22.090406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:22.090411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:22.090416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:22.090422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:22.090428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:22.090433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:22.090438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:22.090443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:22.090449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:22.090455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:22.090460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:22.090467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:22.090509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:22.092871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:22.093248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:22.093261Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:22.093263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:22.093267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:22.093273Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3283 [2:7559602957479515135:12960]
2025-10-10T14:40:22.093286Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:22.093302Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:22.093305Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:22.093309Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:22.093311Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:22.093343Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:22.093358Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:22.093366Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:22.093423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:22.093430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:22.093432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:22.093435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:22.093501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:22.093509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:22.093521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:22.093538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:22.093561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:22.093589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602958261768683:2438], now have 1 active actors on pipe
2025-10-10T14:40:22.093599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602958261768803:8814], now have 1 active actors on pipe
2025-10-10T14:40:22.093607Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602957479515129:12960]
2025-10-10T14:40:22.093609Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602957479515129:12960]
2025-10-10T14:40:22.093611Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602957479515129:12960]
2025-10-10T14:40:22.093627Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:22.093634Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3283
2025-10-10T14:40:22.093651Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3283
2025-10-10T14:40:22.093642Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:22.093646Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:22.093650Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:22.093652Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:22.093663Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:22.093667Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:22.093702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:22.093716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:22.093736Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602957479515129:12960]
2025-10-10T14:40:22.093746Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:22.093753Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:22.093778Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9800dae0-63985fe8-99c3323d-14c7d13c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:22.093790Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:22.093794Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:22.093797Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:22.093808Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:22.093819Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:22.093844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:22.094019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:22.094032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:22.094055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:22.094140Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3284 partition: 0 MaxSeqNo: 40 sessionId: src_id|9800dae0-63985fe8-99c3323d-14c7d13c_0
2025-10-10T14:40:22.094539Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e5482bea-ed9f2911-5bea7932-61f55590_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|9800dae0-63985fe8-99c3323d-14c7d13c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:22.097229Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9800dae0-63985fe8-99c3323d-14c7d13c_0] Write session: try to update token
2025-10-10T14:40:22.097248Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9800dae0-63985fe8-99c3323d-14c7d13c_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:22.111767Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3284 sessionId: src_id|9800dae0-63985fe8-99c3323d-14c7d13c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:22.113893Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:22.113913Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:22.113917Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:22.113919Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:22.113929Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602957479515129:12960]
2025-10-10T14:40:22.113935Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602957479515129:12960]
2025-10-10T14:40:22.113939Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602957479515129:12960]
2025-10-10T14:40:22.113994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:22.114004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:22.114006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:22.114014Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:22.114029Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:22.114034Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:22.114153Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:22.114739Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:22.174933Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602958261768814:2851]
2025-10-10T14:40:22.175270Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 pipe creation result: OK TabletId: 72075186224037892 Generation: 3283, pipe: [1:7559602958261768814:2851]
2025-10-10T14:40:22.236426Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:22.236810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:22.236827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:22.236875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602958261768814:2851], now have 1 active actors on pipe
2025-10-10T14:40:22.237118Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:22.237122Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 82 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602958261768814:2851]
2025-10-10T14:40:22.237149Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:22.237161Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:40:22.237163Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:40:22.237241Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3284 reason: error at write: Disconnected sessionId: src_id|9800dae0-63985fe8-99c3323d-14c7d13c_0
2025-10-10T14:40:22.237500Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3284 sessionId: src_id|9800dae0-63985fe8-99c3323d-14c7d13c_0 is DEAD
2025-10-10T14:40:22.237677Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9800dae0-63985fe8-99c3323d-14c7d13c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:40:22.237688Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9800dae0-63985fe8-99c3323d-14c7d13c_0] Write session will restart in 0.006447s
2025-10-10T14:40:22.237713Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9800dae0-63985fe8-99c3323d-14c7d13c_0] Write session: Do CDS request
2025-10-10T14:40:22.237723Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9800dae0-63985fe8-99c3323d-14c7d13c_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:22.245967Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9800dae0-63985fe8-99c3323d-14c7d13c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:22.246026Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:22.246045Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3285
2025-10-10T14:40:22.246234Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3285 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:22.246274Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3285 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:22.246281Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3285 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:22.246285Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:22.246787Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3285 sessionId:  describe result for acl check
2025-10-10T14:40:22.246831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:22.246839Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:22.246841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:22.246857Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602958261768895:8833] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:22.247484Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602958261768895:8833] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:22.248773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:22.249688Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602958261768895:8833] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:22.250902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:22.251183Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:22.251195Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:22.251229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:22.251285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:22.251331Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602957479515263:12962]
2025-10-10T14:40:22.251998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:22.252346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:22.252391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:22.252751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:22.252920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:22.252928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:22.252929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:22.252931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:22.252932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:22.252934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:22.252936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:22.252937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:22.252939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:22.252941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:22.252942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:22.252944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:22.252946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:22.252952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:22.252968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:22.252973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:22.252978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:22.252983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:22.252988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:22.252992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:22.252997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:22.253002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:22.253009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:22.253013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:22.253018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:22.253023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:22.253032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:22.253042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:22.253050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:22.253057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:22.253071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:22.253077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:22.253083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:22.253089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:22.253095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:22.253101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:22.253106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:22.253134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:22.253145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:22.253151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:22.253156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:22.253162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:22.253169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:22.253175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:22.253181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:22.253186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:22.253191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:22.253197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:22.253202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:22.253208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:22.253212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:22.253218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:22.253263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:22.253296Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602958261768895:8833] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:22.253312Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602958261768895:8833] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:22.253315Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602958261768895:8833] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:22.253325Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3285 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:22.255730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:22.256059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:22.256072Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:22.256075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:22.256079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:22.256086Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3284 [2:7559602957479515263:12962]
2025-10-10T14:40:22.256099Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:22.256117Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:22.256128Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:22.256132Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:22.256135Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:22.256152Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:22.256160Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:22.256168Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:22.256241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:22.256250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:22.256252Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:22.256255Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:22.256408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:22.256420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:22.256433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:22.256452Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:22.256477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:22.256502Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602957479515257:12962]
2025-10-10T14:40:22.256505Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602957479515257:12962]
2025-10-10T14:40:22.256508Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602957479515257:12962]
2025-10-10T14:40:22.256524Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:22.256544Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:22.256564Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:22.256566Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:22.256567Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:22.256569Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:22.256570Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:22.256596Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602957479515257:12962]
2025-10-10T14:40:22.256606Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:22.256657Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:22.256746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602958261768938:8833], now have 1 active actors on pipe
2025-10-10T14:40:22.256759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602958261768816:2438], now have 1 active actors on pipe
2025-10-10T14:40:22.256959Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3284
2025-10-10T14:40:22.256967Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3284
2025-10-10T14:40:22.257088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:22.257105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:22.257151Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f37f0056-2c11565c-e94adf0e-1b1542c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:22.257166Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:22.257170Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:22.257172Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:22.257186Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:22.257205Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:22.257219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:22.257437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:22.257446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:22.257462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:22.257570Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3285 partition: 0 MaxSeqNo: 40 sessionId: src_id|f37f0056-2c11565c-e94adf0e-1b1542c_0
2025-10-10T14:40:22.257980Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9800dae0-63985fe8-99c3323d-14c7d13c_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|f37f0056-2c11565c-e94adf0e-1b1542c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:22.260771Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f37f0056-2c11565c-e94adf0e-1b1542c_0] Write session: try to update token
2025-10-10T14:40:22.260791Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f37f0056-2c11565c-e94adf0e-1b1542c_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:22.269721Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:40:22.269740Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:22.269751Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602957479515257:12962]
2025-10-10T14:40:22.269792Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:40:22.269801Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:40:22.269971Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:40:22.270134Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:22.270263Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:22.270391Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:22.270605Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:40:22.270650Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:40:22.279794Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3285 sessionId: src_id|f37f0056-2c11565c-e94adf0e-1b1542c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:22.282516Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:22.282766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:22.282807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:22.282871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:40:22.282999Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:40:22.288716Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:22.288737Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:22.288741Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:22.288743Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:22.288760Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602957479515257:12962]
2025-10-10T14:40:22.288764Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602957479515257:12962]
2025-10-10T14:40:22.288769Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602957479515257:12962]
2025-10-10T14:40:22.288825Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:22.288839Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:22.288844Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:22.288862Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:22.288879Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:22.288883Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:22.289031Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:22.337242Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602958261768947:2851]
2025-10-10T14:40:22.337540Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 pipe creation result: OK TabletId: 72075186224037892 Generation: 3284, pipe: [1:7559602958261768947:2851]
2025-10-10T14:40:22.410812Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:22.419791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:22.419826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:22.420021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:22.420090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:22.420160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:22.420260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:22.420877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:22.420896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:22.420977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:22.421043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:22.421117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:22.421194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:22.421239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:22.421242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:22.421312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:22.421415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:22.421484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:22.421554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:22.421603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:22.421611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:22.421685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:22.421751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:22.421823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:22.421895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:22.421943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:22.421950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:22.422025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:22.422091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:22.422157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:22.422227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:22.422275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:22.422285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:22.422356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:22.422430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:22.422502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:22.422574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:22.422621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:22.422630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:22.422702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:22.422768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:22.422839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:22.422909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:22.422956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:22.422964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:22.423038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:22.423102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:22.423174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:22.423251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:22.423301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:22.423309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:22.423379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:22.423449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:22.423520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:22.423589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:22.423641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:22.423649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:22.423725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:22.423793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:22.423865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:22.423935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:22.423986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:22.423994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:22.424076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602958261768947:2851], now have 1 active actors on pipe
2025-10-10T14:40:22.424374Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:40:22.424408Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:40:22.424447Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3285 reason: error at write: Disconnected sessionId: src_id|f37f0056-2c11565c-e94adf0e-1b1542c_0
2025-10-10T14:40:22.424698Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 83 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602958261768947:2851]
2025-10-10T14:40:22.424712Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3285 sessionId: src_id|f37f0056-2c11565c-e94adf0e-1b1542c_0 is DEAD
2025-10-10T14:40:22.424725Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:22.425131Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f37f0056-2c11565c-e94adf0e-1b1542c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:40:22.425139Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f37f0056-2c11565c-e94adf0e-1b1542c_0] Write session will restart in 0.008758s
2025-10-10T14:40:22.424688Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:22.425170Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f37f0056-2c11565c-e94adf0e-1b1542c_0] Write session: Do CDS request
2025-10-10T14:40:22.425177Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f37f0056-2c11565c-e94adf0e-1b1542c_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:22.434944Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f37f0056-2c11565c-e94adf0e-1b1542c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:22.435062Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:22.435082Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3286
2025-10-10T14:40:22.435227Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3286 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:22.435264Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3286 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:22.435291Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3286 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:22.435298Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:22.435803Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3286 sessionId:  describe result for acl check
2025-10-10T14:40:22.435850Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:22.435860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:22.435862Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:22.435869Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602958261769038:8837] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:22.436527Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602958261769038:8837] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:22.436916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:22.439321Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602958261769038:8837] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:22.440702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:22.440991Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:22.441003Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:22.441017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:22.441084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:22.441132Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602957479515394:12965]
2025-10-10T14:40:22.441806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:22.442169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:22.442233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:22.442581Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602958261769038:8837] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:22.442601Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602958261769038:8837] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:22.442605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602958261769038:8837] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:22.442601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:22.442614Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3286 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:22.442824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:22.442834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:22.442835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:22.442837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:22.442838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:22.442839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:22.442841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:22.442842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:22.442844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:22.442845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:22.442847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:22.442848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:22.442849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:22.442857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:22.442870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:22.442875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:22.442879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:22.442884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:22.442888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:22.442892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:22.442897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:22.442901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:22.442905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:22.442910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:22.442914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:22.442918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:22.442927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:22.442946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:22.442958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:22.442963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:22.442968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:22.442974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:22.442980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:22.442985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:22.442990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:22.442999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:22.443004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:22.443009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:22.443014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:22.443020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:22.443024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:22.443029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:22.443034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:22.443039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:22.443052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:22.443056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:22.443061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:22.443071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:22.443075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:22.443080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:22.443084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:22.443090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:22.443130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:22.445805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:22.446157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:22.446172Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:22.446175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:22.446180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:22.446187Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3285 [2:7559602957479515394:12965]
2025-10-10T14:40:22.446202Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:22.446220Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:22.446223Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:22.446227Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:22.446229Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:22.446247Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:22.446263Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:22.446273Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:22.446349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:22.446351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:22.446353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:22.446355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:22.446532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:22.446536Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:22.446547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:22.446561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:22.446580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:22.446539Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3285
2025-10-10T14:40:22.446566Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3285
2025-10-10T14:40:22.446606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602958261768950:2438], now have 1 active actors on pipe
2025-10-10T14:40:22.446616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602958261769073:8837], now have 1 active actors on pipe
2025-10-10T14:40:22.446635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:22.446645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:22.446664Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602957479515389:12965]
2025-10-10T14:40:22.446673Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602957479515389:12965]
2025-10-10T14:40:22.446675Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602957479515389:12965]
2025-10-10T14:40:22.446690Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:22.446704Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:22.446710Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:22.446714Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:22.446716Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:22.446729Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:22.446733Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:22.446757Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f4addcfe-c3b4526e-edaf0c60-67e091dd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:22.446771Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:22.446775Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:22.446778Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:22.446789Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:22.446800Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:22.446834Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602957479515389:12965]
2025-10-10T14:40:22.446851Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:22.446867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:22.446883Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:22.447058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:22.447079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:22.447108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:22.447228Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3286 partition: 0 MaxSeqNo: 40 sessionId: src_id|f4addcfe-c3b4526e-edaf0c60-67e091dd_0
2025-10-10T14:40:22.447668Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f37f0056-2c11565c-e94adf0e-1b1542c_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|f4addcfe-c3b4526e-edaf0c60-67e091dd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:22.450482Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f4addcfe-c3b4526e-edaf0c60-67e091dd_0] Write session: try to update token
2025-10-10T14:40:22.450504Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f4addcfe-c3b4526e-edaf0c60-67e091dd_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:22.459159Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:40:22.459179Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:22.459192Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602957479515389:12965]
2025-10-10T14:40:22.459243Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:40:22.459247Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:40:22.459447Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:40:22.459622Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:22.459877Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:22.460043Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:22.460284Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:40:22.460335Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:40:22.466944Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3286 sessionId: src_id|f4addcfe-c3b4526e-edaf0c60-67e091dd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:22.469732Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:22.469978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:22.470005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:22.470057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:40:22.470134Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:40:22.477828Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:22.477853Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:22.477858Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:22.477860Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:22.477872Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602957479515389:12965]
2025-10-10T14:40:22.477878Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602957479515389:12965]
2025-10-10T14:40:22.477882Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602957479515389:12965]
2025-10-10T14:40:22.477938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:22.477945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:22.477948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:22.477953Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:22.477960Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:22.477968Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:22.478094Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:22.524612Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602958261769083:2851]
2025-10-10T14:40:22.524950Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 pipe creation result: OK TabletId: 72075186224037892 Generation: 3285, pipe: [1:7559602958261769083:2851]
2025-10-10T14:40:22.605677Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:22.614673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:22.614709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:22.614903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:22.614972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:22.615041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:22.615111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:22.615712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:22.615732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:22.615805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:22.615868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:22.615935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:22.616012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:22.616059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:22.616067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:22.616144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:22.616228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:22.616298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:22.616369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:22.616417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:22.616426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:22.616497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:22.616572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:22.616638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:22.616711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:22.616768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:22.616776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:22.616851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:22.616918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:22.616988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:22.617056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:22.617105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:22.617117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:22.617189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:22.617267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:22.617361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:22.617431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:22.617482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:22.617493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:22.617570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:22.617644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:22.617711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:22.617781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:22.617831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:22.617838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:22.617929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:22.617995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:22.618064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:22.618134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:22.618187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:22.618195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:22.618267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:22.618332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:22.618398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:22.618466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:22.618515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:22.618523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:22.618594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:22.618661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:22.618728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:22.618802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:22.618853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:22.618861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:22.618933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602958261769083:2851], now have 1 active actors on pipe
2025-10-10T14:40:22.619199Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 84 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602958261769083:2851]
2025-10-10T14:40:22.619250Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:40:22.619249Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:22.619259Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:40:22.619307Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3286 reason: error at write: Disconnected sessionId: src_id|f4addcfe-c3b4526e-edaf0c60-67e091dd_0
2025-10-10T14:40:22.619578Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3286 sessionId: src_id|f4addcfe-c3b4526e-edaf0c60-67e091dd_0 is DEAD
2025-10-10T14:40:22.619711Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4addcfe-c3b4526e-edaf0c60-67e091dd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:40:22.619721Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4addcfe-c3b4526e-edaf0c60-67e091dd_0] Write session will restart in 0.008544s
2025-10-10T14:40:22.619746Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4addcfe-c3b4526e-edaf0c60-67e091dd_0] Write session: Do CDS request
2025-10-10T14:40:22.619754Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4addcfe-c3b4526e-edaf0c60-67e091dd_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:22.619548Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:22.629933Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f4addcfe-c3b4526e-edaf0c60-67e091dd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:22.630009Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:22.630028Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3287
2025-10-10T14:40:22.630194Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3287 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:22.630247Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3287 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:22.630259Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3287 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:22.630263Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:22.630799Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3287 sessionId:  describe result for acl check
2025-10-10T14:40:22.630839Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:22.630847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:22.630849Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:22.630855Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602958261769149:5212] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:22.631461Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602958261769149:5212] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:22.635097Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602958261769149:5212] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:22.637745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:22.640094Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602958261769149:5212] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:22.640113Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602958261769149:5212] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:22.640117Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602958261769149:5212] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:22.640128Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3287 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:22.641147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:22.641416Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:22.641432Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:22.641446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:22.641513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:22.641563Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602957479515525:12967]
2025-10-10T14:40:22.642199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:22.642592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:22.642662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:22.643023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:22.643100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:22.643108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:22.643109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:22.643110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:22.643112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:22.643113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:22.643115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:22.643117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:22.643119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:22.643121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:22.643122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:22.643124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:22.643126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:22.643132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:22.643145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:22.643149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:22.643153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:22.643156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:22.643160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:22.643163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:22.643168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:22.643171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:22.643175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:22.643179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:22.643182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:22.643185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:22.643194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:22.643202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:22.643209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:22.643215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:22.643222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:22.643235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:22.643239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:22.643245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:22.643250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:22.643256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:22.643261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:22.643267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:22.643273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:22.643278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:22.643284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:22.643294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:22.643299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:22.643311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:22.643315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:22.643321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:22.643327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:22.643346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:22.643357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:22.643362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:22.643367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:22.643372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:22.643417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:22.646641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:22.647254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:22.647270Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:22.647273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:22.647277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:22.647284Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3286 [2:7559602957479515525:12967]
2025-10-10T14:40:22.647297Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:22.647315Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:22.647323Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:22.647328Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:22.647331Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:22.647349Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:22.647357Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:22.647371Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:22.647438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:22.647451Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:22.647453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:22.647455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:22.647527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:22.647536Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:22.647549Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:22.647566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:22.647589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:22.647615Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602957479515519:12967]
2025-10-10T14:40:22.647622Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602957479515519:12967]
2025-10-10T14:40:22.647624Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602957479515519:12967]
2025-10-10T14:40:22.647635Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:22.647646Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:22.647655Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:22.647658Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:22.647660Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:22.647673Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:22.647682Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:22.647693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602958261769085:2438], now have 1 active actors on pipe
2025-10-10T14:40:22.647701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602958261769206:5212], now have 1 active actors on pipe
2025-10-10T14:40:22.647723Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602957479515519:12967]
2025-10-10T14:40:22.647736Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:22.648076Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:22.648360Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3286
2025-10-10T14:40:22.648407Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3286
2025-10-10T14:40:22.648951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:22.648980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:22.649032Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1c27afe7-12e24680-e0c337e9-fbcc6f4f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:22.649049Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:22.649058Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:22.649066Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:22.649080Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:22.649107Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:22.649127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:22.650457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:22.650470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:22.650494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:22.650641Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3287 partition: 0 MaxSeqNo: 40 sessionId: src_id|1c27afe7-12e24680-e0c337e9-fbcc6f4f_0
2025-10-10T14:40:22.651051Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4addcfe-c3b4526e-edaf0c60-67e091dd_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|1c27afe7-12e24680-e0c337e9-fbcc6f4f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:22.653901Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1c27afe7-12e24680-e0c337e9-fbcc6f4f_0] Write session: try to update token
2025-10-10T14:40:22.653921Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1c27afe7-12e24680-e0c337e9-fbcc6f4f_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:22.668275Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3287 sessionId: src_id|1c27afe7-12e24680-e0c337e9-fbcc6f4f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:22.671119Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:22.672531Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:22.672550Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:22.672554Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:22.672556Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:22.672565Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602957479515519:12967]
2025-10-10T14:40:22.672570Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602957479515519:12967]
2025-10-10T14:40:22.672574Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602957479515519:12967]
2025-10-10T14:40:22.672618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:22.672626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:22.672629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:22.672758Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:22.673627Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:22.673644Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:22.673652Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:22.719168Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602958261769219:2851]
2025-10-10T14:40:22.719438Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 pipe creation result: OK TabletId: 72075186224037892 Generation: 3286, pipe: [1:7559602958261769219:2851]
2025-10-10T14:40:22.794864Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:22.795236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:22.795253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:22.795304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602958261769219:2851], now have 1 active actors on pipe
2025-10-10T14:40:22.795576Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:22.795589Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 85 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602958261769219:2851]
2025-10-10T14:40:22.795618Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:40:22.795719Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3287 reason: status is not ok: tablet will be restarted right now sessionId: src_id|1c27afe7-12e24680-e0c337e9-fbcc6f4f_0
2025-10-10T14:40:22.795962Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3287 sessionId: src_id|1c27afe7-12e24680-e0c337e9-fbcc6f4f_0 is DEAD
2025-10-10T14:40:22.796121Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c27afe7-12e24680-e0c337e9-fbcc6f4f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:40:22.796133Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c27afe7-12e24680-e0c337e9-fbcc6f4f_0] Write session will restart in 0.009233s
2025-10-10T14:40:22.796167Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c27afe7-12e24680-e0c337e9-fbcc6f4f_0] Write session: Do CDS request
2025-10-10T14:40:22.796173Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c27afe7-12e24680-e0c337e9-fbcc6f4f_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:22.795545Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:22.806949Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1c27afe7-12e24680-e0c337e9-fbcc6f4f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:22.807018Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:22.807038Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3288
2025-10-10T14:40:22.807197Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3288 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:22.807246Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3288 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:22.807255Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3288 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:22.807260Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:22.807642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:22.807727Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3288 sessionId:  describe result for acl check
2025-10-10T14:40:22.807768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:22.807774Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:22.807776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:22.807783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602958261769314:5217] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:22.808365Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602958261769314:5217] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:22.809709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:22.809973Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:22.809985Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:22.809999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:22.810069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:22.810112Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602957479515655:12969]
2025-10-10T14:40:22.810787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:22.810991Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602958261769314:5217] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:22.811152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:22.811207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:22.811564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:22.811634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:22.811640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:22.811641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:22.811643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:22.811644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:22.811645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:22.811647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:22.811648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:22.811649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:22.811651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:22.811652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:22.811653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:22.811655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:22.811661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:22.811675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:22.811680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:22.811684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:22.811688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:22.811693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:22.811696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:22.811700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:22.811705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:22.811709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:22.811714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:22.811718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:22.811722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:22.811731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:22.811740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:22.811748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:22.811753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:22.811758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:22.811764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:22.811769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:22.811774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:22.811780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:22.811786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:22.811790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:22.811796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:22.811802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:22.811808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:22.811812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:22.811817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:22.811822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:22.811828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:22.811833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:22.811839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:22.811844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:22.811850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:22.811854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:22.811860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:22.811866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:22.811871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:22.811911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:22.814337Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602958261769314:5217] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:22.814354Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602958261769314:5217] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:22.814358Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602958261769314:5217] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:22.814367Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3288 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:22.814388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:22.814711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:22.814728Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:22.814731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:22.814735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:22.814741Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3287 [2:7559602957479515655:12969]
2025-10-10T14:40:22.814756Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:22.814775Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:22.814781Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:22.814784Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:22.814793Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:22.814811Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:22.814824Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:22.814832Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:22.814894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:22.814903Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:22.814905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:22.814909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:22.814981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:22.814990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:22.815003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:22.815016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:22.815039Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:22.815068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602958261769348:5217], now have 1 active actors on pipe
2025-10-10T14:40:22.815077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602958261769220:2438], now have 1 active actors on pipe
2025-10-10T14:40:22.815085Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602957479515650:12969]
2025-10-10T14:40:22.815087Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602957479515650:12969]
2025-10-10T14:40:22.815090Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602957479515650:12969]
2025-10-10T14:40:22.815104Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:22.815111Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3287
2025-10-10T14:40:22.815112Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3287
2025-10-10T14:40:22.815124Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:22.815126Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:22.815127Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:22.815130Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:22.815143Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:22.815147Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:22.815182Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602957479515650:12969]
2025-10-10T14:40:22.815189Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:22.815197Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:22.815204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:22.815209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:22.815258Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f1bb07cf-7d2075a1-2d736836-a41b43e5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:22.815270Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:22.815275Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:22.815278Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:22.815291Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:22.815306Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:22.815328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:22.815503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:22.815517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:22.815540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:22.815618Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3288 partition: 0 MaxSeqNo: 40 sessionId: src_id|f1bb07cf-7d2075a1-2d736836-a41b43e5_0
2025-10-10T14:40:22.816032Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c27afe7-12e24680-e0c337e9-fbcc6f4f_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|f1bb07cf-7d2075a1-2d736836-a41b43e5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:22.818778Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f1bb07cf-7d2075a1-2d736836-a41b43e5_0] Write session: try to update token
2025-10-10T14:40:22.818798Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f1bb07cf-7d2075a1-2d736836-a41b43e5_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:22.833783Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3288 sessionId: src_id|f1bb07cf-7d2075a1-2d736836-a41b43e5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:22.834846Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:22.834863Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:22.834867Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:22.834869Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:22.834877Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602957479515650:12969]
2025-10-10T14:40:22.834882Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602957479515650:12969]
2025-10-10T14:40:22.834888Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602957479515650:12969]
2025-10-10T14:40:22.834930Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:22.834939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:22.834943Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:22.834946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:22.834948Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:22.834949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:22.835083Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:22.836487Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:22.895824Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602958261769385:2851]
2025-10-10T14:40:22.896019Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 pipe creation result: OK TabletId: 72075186224037892 Generation: 3287, pipe: [1:7559602958261769385:2851]
2025-10-10T14:40:22.952369Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:22.952756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:22.952772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:22.952816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602958261769385:2851], now have 1 active actors on pipe
2025-10-10T14:40:22.953008Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:22.952989Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:22.953049Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 86 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602958261769385:2851]
2025-10-10T14:40:22.953071Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:40:22.953074Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:40:22.953136Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3288 reason: error at write: Disconnected sessionId: src_id|f1bb07cf-7d2075a1-2d736836-a41b43e5_0
2025-10-10T14:40:22.953384Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3288 sessionId: src_id|f1bb07cf-7d2075a1-2d736836-a41b43e5_0 is DEAD
2025-10-10T14:40:22.953781Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1bb07cf-7d2075a1-2d736836-a41b43e5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:40:22.953793Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1bb07cf-7d2075a1-2d736836-a41b43e5_0] Write session will restart in 0.008458s
2025-10-10T14:40:22.953820Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1bb07cf-7d2075a1-2d736836-a41b43e5_0] Write session: Do CDS request
2025-10-10T14:40:22.953830Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1bb07cf-7d2075a1-2d736836-a41b43e5_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:22.963909Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f1bb07cf-7d2075a1-2d736836-a41b43e5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:22.964022Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:22.964041Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3289
2025-10-10T14:40:22.964201Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3289 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:22.964233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:22.964258Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3289 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:22.964270Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3289 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:22.964274Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:22.964790Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3289 sessionId:  describe result for acl check
2025-10-10T14:40:22.964827Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:22.964829Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:22.964831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:22.964837Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602958261769498:5240] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:22.965417Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602958261769498:5240] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:22.966289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:22.966511Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:22.966523Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:22.966535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:22.966600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:22.966706Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602957479515836:12985]
2025-10-10T14:40:22.967278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:22.967329Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602958261769498:5240] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:22.967623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:22.967673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:22.967968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:22.968045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:22.968053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:22.968054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:22.968055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:22.968056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:22.968068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:22.968069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:22.968070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:22.968071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:22.968072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:22.968073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:22.968074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:22.968075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:22.968080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:22.968092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:22.968096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:22.968100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:22.968103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:22.968106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:22.968110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:22.968113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:22.968117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:22.968121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:22.968125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:22.968129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:22.968132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:22.968140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:22.968148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:22.968154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:22.968159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:22.968163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:22.968167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:22.968171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:22.968188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:22.968199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:22.968204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:22.968208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:22.968214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:22.968230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:22.968234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:22.968238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:22.968242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:22.968246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:22.968251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:22.968256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:22.968261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:22.968268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:22.968272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:22.968276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:22.968280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:22.968285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:22.968289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:22.968324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:22.970607Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602958261769498:5240] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:22.970639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:22.970623Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602958261769498:5240] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:22.970627Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602958261769498:5240] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:22.970636Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3289 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:22.971032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:22.971046Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:22.971048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:22.971052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:22.971057Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3288 [2:7559602957479515836:12985]
2025-10-10T14:40:22.971071Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:22.971087Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:22.971094Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:22.971098Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:22.971100Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:22.971116Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:22.971128Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:22.971136Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:22.971194Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:22.971202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:22.971203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:22.971206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:22.971287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:22.971295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:22.971306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:22.971323Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:22.971345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:22.971369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602958261769404:2438], now have 1 active actors on pipe
2025-10-10T14:40:22.971377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602958261769529:5240], now have 1 active actors on pipe
2025-10-10T14:40:22.971384Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602957479515830:12985]
2025-10-10T14:40:22.971387Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602957479515830:12985]
2025-10-10T14:40:22.971389Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602957479515830:12985]
2025-10-10T14:40:22.971402Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:22.971423Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:22.971401Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3288
2025-10-10T14:40:22.971431Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:22.971433Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:22.971412Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3288
2025-10-10T14:40:22.971435Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:22.971444Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:22.971448Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:22.971468Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602957479515830:12985]
2025-10-10T14:40:22.971475Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:22.971476Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:22.971494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:22.971502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:22.971550Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e757d7bf-bff6b236-d467f2ab-d02bca0d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:22.971565Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:22.971569Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:22.971571Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:22.971581Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:22.971591Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:22.971607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:22.971802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:22.971826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:22.971852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:22.971938Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3289 partition: 0 MaxSeqNo: 40 sessionId: src_id|e757d7bf-bff6b236-d467f2ab-d02bca0d_0
2025-10-10T14:40:22.972356Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1bb07cf-7d2075a1-2d736836-a41b43e5_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|e757d7bf-bff6b236-d467f2ab-d02bca0d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:22.975122Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e757d7bf-bff6b236-d467f2ab-d02bca0d_0] Write session: try to update token
2025-10-10T14:40:22.975143Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e757d7bf-bff6b236-d467f2ab-d02bca0d_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:22.989688Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3289 sessionId: src_id|e757d7bf-bff6b236-d467f2ab-d02bca0d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:22.990805Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:22.990825Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:22.990828Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:22.990831Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:22.990841Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602957479515830:12985]
2025-10-10T14:40:22.990846Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602957479515830:12985]
2025-10-10T14:40:22.990850Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602957479515830:12985]
2025-10-10T14:40:22.990900Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:22.990903Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:22.990906Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:22.990912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:22.990914Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:22.990914Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:22.991074Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:22.992419Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:23.052970Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602962556736833:2851]
2025-10-10T14:40:23.053249Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 pipe creation result: OK TabletId: 72075186224037892 Generation: 3288, pipe: [1:7559602962556736833:2851]
2025-10-10T14:40:23.108228Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:23.108652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:23.108669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:23.108722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602962556736833:2851], now have 1 active actors on pipe
2025-10-10T14:40:23.108970Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:40:23.108990Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:40:23.109055Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3289 reason: error at write: Disconnected sessionId: src_id|e757d7bf-bff6b236-d467f2ab-d02bca0d_0
2025-10-10T14:40:23.109288Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3289 sessionId: src_id|e757d7bf-bff6b236-d467f2ab-d02bca0d_0 is DEAD
2025-10-10T14:40:23.109401Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:23.109472Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e757d7bf-bff6b236-d467f2ab-d02bca0d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:40:23.109469Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 87 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602962556736833:2851]
2025-10-10T14:40:23.109484Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e757d7bf-bff6b236-d467f2ab-d02bca0d_0] Write session will restart in 0.007672s
2025-10-10T14:40:23.109005Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:23.109520Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e757d7bf-bff6b236-d467f2ab-d02bca0d_0] Write session: Do CDS request
2025-10-10T14:40:23.109527Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e757d7bf-bff6b236-d467f2ab-d02bca0d_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:23.118880Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e757d7bf-bff6b236-d467f2ab-d02bca0d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:23.118974Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:23.119004Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3290
2025-10-10T14:40:23.119138Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3290 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:23.119179Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3290 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:23.119197Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3290 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:23.119207Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:23.120069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:23.119708Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3290 sessionId:  describe result for acl check
2025-10-10T14:40:23.119750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:23.119752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:23.119754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:23.119761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602962556736929:5260] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:23.120329Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602962556736929:5260] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:23.122069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:23.122280Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:23.122295Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:23.122307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:23.122364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:23.122421Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602961774483264:12987]
2025-10-10T14:40:23.122702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602962556736929:5260] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:23.123065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:23.123363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:23.123408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:23.123737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:23.123797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:23.123803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:23.123804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:23.123806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:23.123807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:23.123808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:23.123809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:23.123811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:23.123812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:23.123813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:23.123815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:23.123816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:23.123817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:23.123823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:23.123836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:23.123841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:23.123846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:23.123850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:23.123854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:23.123859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:23.123863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:23.123883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:23.123888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:23.123892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:23.123895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:23.123899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:23.123907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:23.123916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:23.123923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:23.123929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:23.123934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:23.123940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:23.123945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:23.123956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:23.123961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:23.123971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:23.123976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:23.123983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:23.123989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:23.123994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:23.123998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:23.124003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:23.124008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:23.124014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:23.124019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:23.124025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:23.124033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:23.124037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:23.124042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:23.124048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:23.124057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:23.124063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:23.124111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:23.126455Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602962556736929:5260] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:23.126473Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602962556736929:5260] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:23.126477Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602962556736929:5260] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:23.126485Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3290 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:23.126530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:23.127075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:23.127087Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:23.127089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:23.127093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:23.127099Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3289 [2:7559602961774483264:12987]
2025-10-10T14:40:23.127111Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:23.127132Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:23.127135Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:23.127139Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:23.127147Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:23.127165Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:23.127176Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:23.127188Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:23.127247Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:23.127254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:23.127255Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:23.127258Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:23.127325Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:23.127335Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:23.127349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:23.127361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:23.127379Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:23.127399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602962556736963:5260], now have 1 active actors on pipe
2025-10-10T14:40:23.127407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602962556736834:2438], now have 1 active actors on pipe
2025-10-10T14:40:23.127415Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602961774483259:12987]
2025-10-10T14:40:23.127422Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602961774483259:12987]
2025-10-10T14:40:23.127423Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602961774483259:12987]
2025-10-10T14:40:23.127437Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:23.127454Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3289
2025-10-10T14:40:23.127459Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3289
2025-10-10T14:40:23.127452Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:23.127472Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:23.127472Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:23.127475Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:23.127477Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:23.127479Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:23.127498Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602961774483259:12987]
2025-10-10T14:40:23.127501Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:23.127510Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:23.127523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:23.127527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:23.127569Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|141df70-d6513558-d7bfa644-9cafe711_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:23.127577Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:23.127581Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:23.127583Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:23.127594Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:23.127603Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:23.127630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:23.127859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:23.127870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:23.127896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:23.127995Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3290 partition: 0 MaxSeqNo: 40 sessionId: src_id|141df70-d6513558-d7bfa644-9cafe711_0
2025-10-10T14:40:23.128383Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e757d7bf-bff6b236-d467f2ab-d02bca0d_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|141df70-d6513558-d7bfa644-9cafe711_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:23.131026Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|141df70-d6513558-d7bfa644-9cafe711_0] Write session: try to update token
2025-10-10T14:40:23.131043Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|141df70-d6513558-d7bfa644-9cafe711_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:23.145739Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3290 sessionId: src_id|141df70-d6513558-d7bfa644-9cafe711_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:23.146928Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:23.146955Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:23.146962Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:23.146964Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:23.146977Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602961774483259:12987]
2025-10-10T14:40:23.146983Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602961774483259:12987]
2025-10-10T14:40:23.146988Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602961774483259:12987]
2025-10-10T14:40:23.147036Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:23.147045Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:23.147051Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:23.147056Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:23.147056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:23.147059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:23.147331Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:23.148669Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:23.209674Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602962556736971:2851]
2025-10-10T14:40:23.209975Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 pipe creation result: OK TabletId: 72075186224037892 Generation: 3289, pipe: [1:7559602962556736971:2851]
2025-10-10T14:40:23.261969Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:23.262332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:23.262347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:23.262399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602962556736971:2851], now have 1 active actors on pipe
2025-10-10T14:40:23.262639Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:40:23.262654Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 88 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602962556736971:2851]
2025-10-10T14:40:23.262667Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:40:23.262678Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:23.262749Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3290 reason: error at write: Disconnected sessionId: src_id|141df70-d6513558-d7bfa644-9cafe711_0
2025-10-10T14:40:23.262973Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:23.262991Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3290 sessionId: src_id|141df70-d6513558-d7bfa644-9cafe711_0 is DEAD
2025-10-10T14:40:23.263130Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|141df70-d6513558-d7bfa644-9cafe711_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:40:23.263138Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|141df70-d6513558-d7bfa644-9cafe711_0] Write session will restart in 0.005098s
2025-10-10T14:40:23.263163Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|141df70-d6513558-d7bfa644-9cafe711_0] Write session: Do CDS request
2025-10-10T14:40:23.263174Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|141df70-d6513558-d7bfa644-9cafe711_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:23.269978Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|141df70-d6513558-d7bfa644-9cafe711_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:23.270054Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:23.270074Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3291
2025-10-10T14:40:23.270233Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3291 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:23.270292Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3291 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:23.270302Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3291 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:23.270306Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:23.270837Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3291 sessionId:  describe result for acl check
2025-10-10T14:40:23.270878Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:23.270886Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:23.270888Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:23.270894Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602962556737010:5251] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:23.271482Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602962556737010:5251] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:23.273887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602962556737010:5251] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:23.274169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:23.276404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:23.276644Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:23.276654Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:23.276668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:23.276738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:23.276745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602962556737010:5251] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:23.276784Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602961774483397:12989]
2025-10-10T14:40:23.276773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602962556737010:5251] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:23.276777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602962556737010:5251] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:23.276786Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3291 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:23.277397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:23.277715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:23.277763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:23.278101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:23.278161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:23.278167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:23.278169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:23.278170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:23.278171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:23.278172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:23.278174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:23.278175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:23.278177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:23.278178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:23.278180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:23.278181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:23.278182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:23.278187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:23.278201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:23.278205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:23.278210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:23.278214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:23.278218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:23.278222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:23.278226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:23.278242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:23.278246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:23.278259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:23.278263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:23.278267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:23.278275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:23.278284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:23.278291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:23.278297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:23.278302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:23.278307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:23.278312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:23.278317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:23.278322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:23.278326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:23.278331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:23.278336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:23.278340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:23.278345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:23.278349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:23.278354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:23.278358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:23.278364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:23.278367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:23.278372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:23.278377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:23.278394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:23.278404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:23.278410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:23.278417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:23.278426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:23.278463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:23.280962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:23.281293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:23.281314Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:23.281317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:23.281321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:23.281328Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3290 [2:7559602961774483397:12989]
2025-10-10T14:40:23.281358Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:23.281376Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:23.281379Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:23.281383Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:23.281385Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:23.281403Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:23.281418Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:23.281426Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:23.281503Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:23.281510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:23.281512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:23.281514Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:23.281729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:23.281722Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3290
2025-10-10T14:40:23.281741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:23.281754Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:23.281752Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3290
2025-10-10T14:40:23.281765Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:23.281782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:23.281806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602962556737098:5251], now have 1 active actors on pipe
2025-10-10T14:40:23.281815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602962556736972:2438], now have 1 active actors on pipe
2025-10-10T14:40:23.281823Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602961774483391:12989]
2025-10-10T14:40:23.281826Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602961774483391:12989]
2025-10-10T14:40:23.281828Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602961774483391:12989]
2025-10-10T14:40:23.281838Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:23.281847Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:23.281853Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:23.281858Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:23.281860Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:23.281870Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:23.281874Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:23.281891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:23.281896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:23.281935Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602961774483391:12989]
2025-10-10T14:40:23.281943Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:23.281963Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|985abf42-8262365e-4c09ec84-3133bf32_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:23.281973Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:23.281976Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:23.281979Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:23.281990Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:23.281994Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:23.282001Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:23.282032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:23.282221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:23.282236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:23.282262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:23.282349Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3291 partition: 0 MaxSeqNo: 40 sessionId: src_id|985abf42-8262365e-4c09ec84-3133bf32_0
2025-10-10T14:40:23.282866Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|141df70-d6513558-d7bfa644-9cafe711_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|985abf42-8262365e-4c09ec84-3133bf32_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:23.285650Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|985abf42-8262365e-4c09ec84-3133bf32_0] Write session: try to update token
2025-10-10T14:40:23.285669Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|985abf42-8262365e-4c09ec84-3133bf32_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:23.300388Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3291 sessionId: src_id|985abf42-8262365e-4c09ec84-3133bf32_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:23.303226Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:23.301854Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:23.301877Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:23.301880Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:23.301882Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:23.301892Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602961774483391:12989]
2025-10-10T14:40:23.301897Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602961774483391:12989]
2025-10-10T14:40:23.301901Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602961774483391:12989]
2025-10-10T14:40:23.301959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:23.301962Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:23.301966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:23.301969Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:23.301970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:23.301973Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:23.302119Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:23.362776Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602962556737110:2851]
2025-10-10T14:40:23.363135Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 pipe creation result: OK TabletId: 72075186224037892 Generation: 3290, pipe: [1:7559602962556737110:2851]
2025-10-10T14:40:23.424852Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:23.425249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:23.425265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:23.425315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602962556737110:2851], now have 1 active actors on pipe
2025-10-10T14:40:23.425657Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:40:23.425665Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:23.425684Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:40:23.425724Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 89 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602962556737110:2851]
2025-10-10T14:40:23.425766Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3291 reason: error at write: Disconnected sessionId: src_id|985abf42-8262365e-4c09ec84-3133bf32_0
2025-10-10T14:40:23.425969Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3291 sessionId: src_id|985abf42-8262365e-4c09ec84-3133bf32_0 is DEAD
2025-10-10T14:40:23.426313Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|985abf42-8262365e-4c09ec84-3133bf32_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:40:23.426322Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|985abf42-8262365e-4c09ec84-3133bf32_0] Write session will restart in 0.009051s
2025-10-10T14:40:23.426350Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|985abf42-8262365e-4c09ec84-3133bf32_0] Write session: Do CDS request
2025-10-10T14:40:23.426373Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|985abf42-8262365e-4c09ec84-3133bf32_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:23.426412Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:23.437123Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|985abf42-8262365e-4c09ec84-3133bf32_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:23.437438Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:23.437469Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3292
2025-10-10T14:40:23.437655Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3292 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:23.437701Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3292 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:23.437713Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3292 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:23.437718Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:23.438199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:23.438203Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3292 sessionId:  describe result for acl check
2025-10-10T14:40:23.438240Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:23.438244Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:23.438245Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:23.438252Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602962556737208:5266] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:23.438835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602962556737208:5266] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:23.440120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:23.440353Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:23.440367Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:23.440378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:23.440438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:23.440481Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602961774483533:12992]
2025-10-10T14:40:23.441117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:23.441347Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602962556737208:5266] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:23.441380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:23.441426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:23.441760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:23.441821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:23.441827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:23.441828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:23.441830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:23.441831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:23.441832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:23.441833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:23.441834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:23.441835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:23.441837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:23.441838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:23.441839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:23.441840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:23.441846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:23.441859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:23.441864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:23.441868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:23.441872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:23.441877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:23.441881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:23.441885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:23.441889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:23.441893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:23.441898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:23.441901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:23.441905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:23.441912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:23.441921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:23.441928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:23.441939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:23.441943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:23.441948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:23.441957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:23.441963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:23.441968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:23.441973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:23.441978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:23.441988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:23.441993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:23.441998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:23.442007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:23.442012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:23.442021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:23.442027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:23.442037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:23.442042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:23.442052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:23.442057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:23.442067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:23.442072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:23.442081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:23.442086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:23.442129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:23.444510Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602962556737208:5266] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:23.444524Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602962556737208:5266] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:23.444528Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602962556737208:5266] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:23.444537Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3292 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:23.444782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:23.445118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:23.445130Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:23.445133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:23.445137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:23.445143Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3291 [2:7559602961774483533:12992]
2025-10-10T14:40:23.445156Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:23.445175Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:23.445184Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:23.445188Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:23.445190Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:23.445219Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:23.445234Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:23.445241Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:23.445300Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:23.445308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:23.445310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:23.445313Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:23.445395Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:23.445403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:23.445414Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:23.445424Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:23.445442Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:23.445469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602962556737111:2438], now have 1 active actors on pipe
2025-10-10T14:40:23.445478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602962556737243:5266], now have 1 active actors on pipe
2025-10-10T14:40:23.445486Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602961774483528:12992]
2025-10-10T14:40:23.445488Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602961774483528:12992]
2025-10-10T14:40:23.445491Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602961774483528:12992]
2025-10-10T14:40:23.445504Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:23.445518Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:23.445521Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:23.445521Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:23.445523Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:23.445507Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3291
2025-10-10T14:40:23.445538Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:23.445541Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:23.445513Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3291
2025-10-10T14:40:23.445580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:23.445591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:23.445606Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602961774483528:12992]
2025-10-10T14:40:23.445623Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:23.445655Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:23.445665Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5bbc3a51-36d4c44e-38bc13cc-3bf0f071_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:23.445674Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:23.445679Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:23.445682Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:23.445692Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:23.445704Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:23.445874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:23.446061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:23.446070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:23.446087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:23.446204Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3292 partition: 0 MaxSeqNo: 40 sessionId: src_id|5bbc3a51-36d4c44e-38bc13cc-3bf0f071_0
2025-10-10T14:40:23.446617Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|985abf42-8262365e-4c09ec84-3133bf32_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|5bbc3a51-36d4c44e-38bc13cc-3bf0f071_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:23.449225Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5bbc3a51-36d4c44e-38bc13cc-3bf0f071_0] Write session: try to update token
2025-10-10T14:40:23.449240Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5bbc3a51-36d4c44e-38bc13cc-3bf0f071_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:23.464387Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3292 sessionId: src_id|5bbc3a51-36d4c44e-38bc13cc-3bf0f071_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:23.465765Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:23.465783Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:23.465786Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:23.465788Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:23.465799Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602961774483528:12992]
2025-10-10T14:40:23.465804Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602961774483528:12992]
2025-10-10T14:40:23.465808Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602961774483528:12992]
2025-10-10T14:40:23.465858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:23.465867Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:23.465873Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:23.465874Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:23.465876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:23.465878Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:23.466018Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:23.467249Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:23.526082Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602962556737251:2851]
2025-10-10T14:40:23.526348Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 pipe creation result: OK TabletId: 72075186224037892 Generation: 3291, pipe: [1:7559602962556737251:2851]
2025-10-10T14:40:23.583624Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:23.583983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:23.583999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:23.584039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602962556737251:2851], now have 1 active actors on pipe
2025-10-10T14:40:23.584259Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 90 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602962556737251:2851]
2025-10-10T14:40:23.584287Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:40:23.584291Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:40:23.584304Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:23.584366Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3292 reason: error at write: Disconnected sessionId: src_id|5bbc3a51-36d4c44e-38bc13cc-3bf0f071_0
2025-10-10T14:40:23.584498Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:23.584585Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3292 sessionId: src_id|5bbc3a51-36d4c44e-38bc13cc-3bf0f071_0 is DEAD
2025-10-10T14:40:23.584766Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5bbc3a51-36d4c44e-38bc13cc-3bf0f071_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:40:23.584774Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5bbc3a51-36d4c44e-38bc13cc-3bf0f071_0] Write session will restart in 0.006074s
2025-10-10T14:40:23.584799Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5bbc3a51-36d4c44e-38bc13cc-3bf0f071_0] Write session: Do CDS request
2025-10-10T14:40:23.584808Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5bbc3a51-36d4c44e-38bc13cc-3bf0f071_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:23.591888Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5bbc3a51-36d4c44e-38bc13cc-3bf0f071_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:23.591990Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:23.592004Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3293
2025-10-10T14:40:23.592131Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3293 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:23.592192Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3293 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:23.592202Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3293 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:23.592206Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:23.592700Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3293 sessionId:  describe result for acl check
2025-10-10T14:40:23.592750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:23.592758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:23.592760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:23.592766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602962556737276:5273] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:23.593380Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602962556737276:5273] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:23.595916Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602962556737276:5273] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:23.597311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:23.599145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:23.599371Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:23.599384Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:23.599397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:23.599414Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602962556737276:5273] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:23.599430Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602962556737276:5273] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:23.599434Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602962556737276:5273] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:23.599443Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3293 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:23.599457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:23.599501Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602961774483668:12994]
2025-10-10T14:40:23.600156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:23.600523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:23.600576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:23.600914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:23.600985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:23.600997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:23.600998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:23.600999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:23.601000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:23.601002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:23.601003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:23.601004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:23.601005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:23.601006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:23.601007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:23.601008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:23.601009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:23.601016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:23.601031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:23.601035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:23.601040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:23.601044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:23.601048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:23.601053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:23.601057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:23.601061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:23.601066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:23.601071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:23.601075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:23.601079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:23.601088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:23.601098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:23.601105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:23.601110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:23.601121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:23.601127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:23.601136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:23.601142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:23.601152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:23.601158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:23.601167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:23.601173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:23.601178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:23.601189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:23.601193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:23.601216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:23.601225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:23.601231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:23.601239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:23.601244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:23.601249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:23.601259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:23.601263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:23.601274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:23.601279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:23.601289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:23.601349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:23.603785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:23.604099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:23.604115Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:23.604117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:23.604121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:23.604127Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3292 [2:7559602961774483668:12994]
2025-10-10T14:40:23.604138Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:23.604161Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:23.604184Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:23.604187Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:23.604190Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:23.604207Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:23.604215Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:23.604225Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:23.604286Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:23.604293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:23.604295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:23.604297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:23.604361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:23.604370Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:23.604381Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:23.604391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:23.604405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:23.604431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602962556737252:2438], now have 1 active actors on pipe
2025-10-10T14:40:23.604439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602962556737380:5273], now have 1 active actors on pipe
2025-10-10T14:40:23.604447Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602961774483663:12994]
2025-10-10T14:40:23.604450Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602961774483663:12994]
2025-10-10T14:40:23.604453Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602961774483663:12994]
2025-10-10T14:40:23.604466Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:23.604481Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:23.604483Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:23.604491Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:23.604493Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:23.604499Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:23.604502Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:23.604523Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602961774483663:12994]
2025-10-10T14:40:23.604531Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:23.604495Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3292
2025-10-10T14:40:23.604537Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:23.604522Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3292
2025-10-10T14:40:23.604557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:23.604565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:23.604603Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2b2032a-882f3ca1-c8ee82c7-1f5fcca_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:23.604615Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:23.604623Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:23.604625Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:23.604636Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:23.604651Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:23.604669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:23.604863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:23.604877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:23.604899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:23.604988Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3293 partition: 0 MaxSeqNo: 40 sessionId: src_id|2b2032a-882f3ca1-c8ee82c7-1f5fcca_0
2025-10-10T14:40:23.605424Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5bbc3a51-36d4c44e-38bc13cc-3bf0f071_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|2b2032a-882f3ca1-c8ee82c7-1f5fcca_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:23.608146Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2b2032a-882f3ca1-c8ee82c7-1f5fcca_0] Write session: try to update token
2025-10-10T14:40:23.608178Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2b2032a-882f3ca1-c8ee82c7-1f5fcca_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:23.622666Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3293 sessionId: src_id|2b2032a-882f3ca1-c8ee82c7-1f5fcca_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:23.624009Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:23.624034Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:23.624038Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:23.624040Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:23.624050Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602961774483663:12994]
2025-10-10T14:40:23.624055Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602961774483663:12994]
2025-10-10T14:40:23.624061Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602961774483663:12994]
2025-10-10T14:40:23.624103Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:23.624111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:23.624117Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:23.624120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:23.624123Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:23.624123Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:23.624280Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:23.625438Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:23.684330Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602962556737391:2851]
2025-10-10T14:40:23.684641Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 pipe creation result: OK TabletId: 72075186224037892 Generation: 3292, pipe: [1:7559602962556737391:2851]
2025-10-10T14:40:23.742608Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:23.743130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:23.743146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:23.743194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602962556737391:2851], now have 1 active actors on pipe
2025-10-10T14:40:23.743443Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:23.743453Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:23.743457Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:40:23.743461Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:40:23.743515Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 91 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602962556737391:2851]
2025-10-10T14:40:23.743551Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3293 reason: error at write: Disconnected sessionId: src_id|2b2032a-882f3ca1-c8ee82c7-1f5fcca_0
2025-10-10T14:40:23.743789Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3293 sessionId: src_id|2b2032a-882f3ca1-c8ee82c7-1f5fcca_0 is DEAD
2025-10-10T14:40:23.743964Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b2032a-882f3ca1-c8ee82c7-1f5fcca_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:40:23.743975Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b2032a-882f3ca1-c8ee82c7-1f5fcca_0] Write session will restart in 0.009163s
2025-10-10T14:40:23.744002Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b2032a-882f3ca1-c8ee82c7-1f5fcca_0] Write session: Do CDS request
2025-10-10T14:40:23.744020Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b2032a-882f3ca1-c8ee82c7-1f5fcca_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:23.754931Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2b2032a-882f3ca1-c8ee82c7-1f5fcca_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:23.755006Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:23.755022Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3294
2025-10-10T14:40:23.755183Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3294 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:23.755229Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3294 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:23.755238Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3294 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:23.755242Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:23.755291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:23.755772Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3294 sessionId:  describe result for acl check
2025-10-10T14:40:23.755809Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:23.755815Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:23.755817Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:23.755823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602962556737493:5276] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:23.756436Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602962556737493:5276] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:23.757628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:23.757922Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:23.757934Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:23.757948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:23.758015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:23.758063Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602961774483804:12996]
2025-10-10T14:40:23.758627Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602962556737493:5276] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:23.758770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:23.759112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:23.759159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:23.759501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:23.759556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:23.759562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:23.759564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:23.759565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:23.759566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:23.759568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:23.759569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:23.759571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:23.759572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:23.759574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:23.759576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:23.759577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:23.759579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:23.759585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:23.759600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:23.759605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:23.759610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:23.759615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:23.759620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:23.759625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:23.759630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:23.759634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:23.759641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:23.759651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:23.759656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:23.759661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:23.759668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:23.759678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:23.759684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:23.759691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:23.759696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:23.759702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:23.759711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:23.759718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:23.759727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:23.759734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:23.759745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:23.759756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:23.759767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:23.759773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:23.759782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:23.759788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:23.759798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:23.759804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:23.759813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:23.759819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:23.759831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:23.759841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:23.759847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:23.759853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:23.759862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:23.759869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:23.759921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:23.762532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:23.762887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:23.762901Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:23.762904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:23.762907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:23.762915Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3293 [2:7559602961774483804:12996]
2025-10-10T14:40:23.762931Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:23.762953Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:23.762961Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:23.762966Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:23.762969Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:23.762987Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:23.762999Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:23.763013Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:23.763081Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:23.763088Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:23.763091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:23.763093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:23.763182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:23.763190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:23.763203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:23.763220Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:23.763245Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:23.763268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602962556737526:5276], now have 1 active actors on pipe
2025-10-10T14:40:23.763277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602962556737393:2438], now have 1 active actors on pipe
2025-10-10T14:40:23.763285Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602961774483799:12996]
2025-10-10T14:40:23.763288Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602961774483799:12996]
2025-10-10T14:40:23.763290Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602961774483799:12996]
2025-10-10T14:40:23.763305Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:23.763323Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:23.763324Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:23.763328Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:23.763330Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:23.763346Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:23.763354Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:23.763395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:23.763405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:23.763425Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602961774483799:12996]
2025-10-10T14:40:23.763437Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:23.763468Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c1b3a573-e8a091ac-a33eaff7-fb7d3805_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:23.763481Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:23.763486Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:23.763484Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:23.763490Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:23.763503Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:23.763514Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:23.763549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:23.763800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:23.763809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:23.763826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:23.764288Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b2032a-882f3ca1-c8ee82c7-1f5fcca_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|c1b3a573-e8a091ac-a33eaff7-fb7d3805_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:23.762448Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602962556737493:5276] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:23.762463Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602962556737493:5276] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:23.762468Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602962556737493:5276] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:23.762479Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3294 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:23.763305Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3293
2025-10-10T14:40:23.763313Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3293
2025-10-10T14:40:23.763928Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3294 partition: 0 MaxSeqNo: 40 sessionId: src_id|c1b3a573-e8a091ac-a33eaff7-fb7d3805_0
2025-10-10T14:40:23.767100Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c1b3a573-e8a091ac-a33eaff7-fb7d3805_0] Write session: try to update token
2025-10-10T14:40:23.767115Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c1b3a573-e8a091ac-a33eaff7-fb7d3805_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:23.786143Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3294 sessionId: src_id|c1b3a573-e8a091ac-a33eaff7-fb7d3805_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:23.788112Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:23.788133Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:23.788138Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:23.788141Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:23.788153Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602961774483799:12996]
2025-10-10T14:40:23.788157Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602961774483799:12996]
2025-10-10T14:40:23.788162Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602961774483799:12996]
2025-10-10T14:40:23.788236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:23.788250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:23.788253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:23.788290Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:23.788305Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:23.788311Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:23.788412Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:23.789153Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:23.843526Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602962556737535:2851]
2025-10-10T14:40:23.843745Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 pipe creation result: OK TabletId: 72075186224037892 Generation: 3293, pipe: [1:7559602962556737535:2851]
2025-10-10T14:40:23.910319Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:23.910696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:23.910713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:23.910763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602962556737535:2851], now have 1 active actors on pipe
2025-10-10T14:40:23.910996Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:23.911046Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 92 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602962556737535:2851]
2025-10-10T14:40:23.911090Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:40:23.911175Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3294 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c1b3a573-e8a091ac-a33eaff7-fb7d3805_0
2025-10-10T14:40:23.911394Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3294 sessionId: src_id|c1b3a573-e8a091ac-a33eaff7-fb7d3805_0 is DEAD
2025-10-10T14:40:23.911582Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:23.911814Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1b3a573-e8a091ac-a33eaff7-fb7d3805_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:40:23.911825Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1b3a573-e8a091ac-a33eaff7-fb7d3805_0] Write session will restart in 0.005750s
2025-10-10T14:40:23.911869Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1b3a573-e8a091ac-a33eaff7-fb7d3805_0] Write session: Do CDS request
2025-10-10T14:40:23.911876Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1b3a573-e8a091ac-a33eaff7-fb7d3805_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:23.919008Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c1b3a573-e8a091ac-a33eaff7-fb7d3805_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:23.921478Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:23.921495Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3295
2025-10-10T14:40:23.921706Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3295 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:23.921753Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3295 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:23.921762Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3295 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:23.921777Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:23.922314Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3295 sessionId:  describe result for acl check
2025-10-10T14:40:23.922351Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:23.922358Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:23.922360Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:23.922368Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602962556737614:5301] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:23.922933Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602962556737614:5301] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:23.926178Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602962556737614:5301] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:23.927211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:23.929366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:23.929598Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:23.929614Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:23.929627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:23.929691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:23.929741Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602961774483966:13005]
2025-10-10T14:40:23.930336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:23.930689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:23.930761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:23.931103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:23.931173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:23.931179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:23.931181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:23.931182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:23.931184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:23.931185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:23.931196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:23.931198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:23.931200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:23.931201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:23.931202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:23.931204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:23.931205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:23.931212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:23.931225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:23.931229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:23.931234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:23.931238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:23.931243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:23.931247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:23.931251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:23.931255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:23.931260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:23.931264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:23.931269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:23.931274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:23.931282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:23.931291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:23.931299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:23.931306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:23.931311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:23.931318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:23.931329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:23.931335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:23.931340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:23.931346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:23.931351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:23.931362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:23.931367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:23.931378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:23.931388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:23.931394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:23.931399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:23.931405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:23.931410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:23.931416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:23.931421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:23.931427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:23.931438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:23.931444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:23.931449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:23.931455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:23.931499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:23.929563Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602962556737614:5301] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:23.929580Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602962556737614:5301] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:23.929584Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602962556737614:5301] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:23.929592Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3295 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:23.934265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:23.934873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:23.934885Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:23.934888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:23.934892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:23.934899Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3294 [2:7559602961774483966:13005]
2025-10-10T14:40:23.934913Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:23.934942Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:23.934951Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:23.934955Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:23.934958Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:23.934975Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:23.934988Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:23.934995Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:23.935067Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:23.935074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:23.935077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:23.935079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:23.935157Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:23.935165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:23.935180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:23.935199Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:23.935222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:23.935250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602962556737555:2438], now have 1 active actors on pipe
2025-10-10T14:40:23.935259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602962556737688:5301], now have 1 active actors on pipe
2025-10-10T14:40:23.935268Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602961774483961:13005]
2025-10-10T14:40:23.935275Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602961774483961:13005]
2025-10-10T14:40:23.935277Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602961774483961:13005]
2025-10-10T14:40:23.935292Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:23.935307Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:23.935317Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:23.935320Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:23.935322Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:23.935332Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:23.935335Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:23.935370Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602961774483961:13005]
2025-10-10T14:40:23.935382Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:23.935399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:23.935408Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:23.935409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:23.935454Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f0d7b930-820b9564-f36c226-b6d4a1ed_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:23.935471Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:23.935475Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:23.935477Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:23.935488Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:23.935500Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:23.935520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:23.935759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:23.935769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:23.935786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:23.936348Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1b3a573-e8a091ac-a33eaff7-fb7d3805_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|f0d7b930-820b9564-f36c226-b6d4a1ed_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:23.935291Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3294
2025-10-10T14:40:23.935337Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3294
2025-10-10T14:40:23.935877Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3295 partition: 0 MaxSeqNo: 40 sessionId: src_id|f0d7b930-820b9564-f36c226-b6d4a1ed_0
2025-10-10T14:40:23.939366Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f0d7b930-820b9564-f36c226-b6d4a1ed_0] Write session: try to update token
2025-10-10T14:40:23.939386Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f0d7b930-820b9564-f36c226-b6d4a1ed_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:23.956818Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:23.956838Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:23.956842Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:23.956844Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:23.956854Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602961774483961:13005]
2025-10-10T14:40:23.956859Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602961774483961:13005]
2025-10-10T14:40:23.956863Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602961774483961:13005]
2025-10-10T14:40:23.956916Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:23.956925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:23.956929Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:23.956933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:23.956937Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:23.956941Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:23.957080Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:23.966617Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3295 sessionId: src_id|f0d7b930-820b9564-f36c226-b6d4a1ed_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:23.969561Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:24.011489Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602966851705019:2851]
2025-10-10T14:40:24.011965Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 pipe creation result: OK TabletId: 72075186224037892 Generation: 3294, pipe: [1:7559602966851705019:2851]
2025-10-10T14:40:24.074378Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:24.074758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:24.074768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:24.074816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602966851705019:2851], now have 1 active actors on pipe
2025-10-10T14:40:24.075099Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:24.075896Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:24.075957Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:40:24.076037Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3295 reason: status is not ok: tablet will be restarted right now sessionId: src_id|f0d7b930-820b9564-f36c226-b6d4a1ed_0
2025-10-10T14:40:24.076259Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3295 sessionId: src_id|f0d7b930-820b9564-f36c226-b6d4a1ed_0 is DEAD
2025-10-10T14:40:24.076404Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f0d7b930-820b9564-f36c226-b6d4a1ed_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:40:24.076415Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f0d7b930-820b9564-f36c226-b6d4a1ed_0] Write session will restart in 0.007840s
2025-10-10T14:40:24.076440Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f0d7b930-820b9564-f36c226-b6d4a1ed_0] Write session: Do CDS request
2025-10-10T14:40:24.076446Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f0d7b930-820b9564-f36c226-b6d4a1ed_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:24.076447Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 93 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602966851705019:2851]
2025-10-10T14:40:24.086008Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f0d7b930-820b9564-f36c226-b6d4a1ed_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:24.086249Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:24.086265Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3296
2025-10-10T14:40:24.086395Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3296 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:24.086447Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3296 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:24.086454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3296 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:24.086459Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:24.086902Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3296 sessionId:  describe result for acl check
2025-10-10T14:40:24.086947Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:24.086949Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:24.086952Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:24.086959Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602966851705111:5310] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:24.087570Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602966851705111:5310] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:24.090081Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602966851705111:5310] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:24.092645Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602966851705111:5310] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:24.092659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602966851705111:5310] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:24.092663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602966851705111:5310] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:24.092673Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3296 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:24.092683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:24.095212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:24.095454Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:24.095458Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:24.095470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:24.095523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:24.095581Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602966069451427:13014]
2025-10-10T14:40:24.096222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:24.096572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:24.096648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:24.096998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:24.097056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:24.097063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:24.097065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:24.097066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:24.097067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:24.097068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:24.097069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:24.097071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:24.097072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:24.097074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:24.097075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:24.097076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:24.097078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:24.097084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:24.097097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:24.097102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:24.097106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:24.097110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:24.097114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:24.097118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:24.097122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:24.097126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:24.097131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:24.097135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:24.097139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:24.097143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:24.097150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:24.097159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:24.097165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:24.097171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:24.097176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:24.097181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:24.097186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:24.097191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:24.097196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:24.097201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:24.097205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:24.097211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:24.097215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:24.097220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:24.097225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:24.097230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:24.097233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:24.097237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:24.097240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:24.097242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:24.097245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:24.097249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:24.097251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:24.097254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:24.097257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:24.097261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:24.097286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:24.099958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:24.100320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:24.100335Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:24.100338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:24.100342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:24.100349Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3295 [2:7559602966069451427:13014]
2025-10-10T14:40:24.100364Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:24.100382Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:24.100390Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:24.100394Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:24.100397Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:24.100416Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:24.100429Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:24.100441Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:24.100503Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:24.100509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:24.100512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:24.100515Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:24.100589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:24.100594Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:24.100605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:24.100617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:24.100635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:24.100660Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602966069451421:13014]
2025-10-10T14:40:24.100667Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602966069451421:13014]
2025-10-10T14:40:24.100670Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602966069451421:13014]
2025-10-10T14:40:24.100684Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:24.100699Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:24.100700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602966851705150:5310], now have 1 active actors on pipe
2025-10-10T14:40:24.100702Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:24.100704Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:24.100705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602966851705021:2438], now have 1 active actors on pipe
2025-10-10T14:40:24.100713Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:24.100731Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:24.100739Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:24.100769Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602966069451421:13014]
2025-10-10T14:40:24.100784Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:24.100791Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:24.100796Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3295
2025-10-10T14:40:24.100827Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3295
2025-10-10T14:40:24.100886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:24.100895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:24.100930Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|954aa8c2-2ea3120f-151a503c-77476b23_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:24.100941Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:24.100948Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:24.100951Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:24.100963Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:24.100983Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:24.100999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:24.101162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:24.101167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:24.101183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:24.101288Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3296 partition: 0 MaxSeqNo: 40 sessionId: src_id|954aa8c2-2ea3120f-151a503c-77476b23_0
2025-10-10T14:40:24.101704Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f0d7b930-820b9564-f36c226-b6d4a1ed_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|954aa8c2-2ea3120f-151a503c-77476b23_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:24.104539Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|954aa8c2-2ea3120f-151a503c-77476b23_0] Write session: try to update token
2025-10-10T14:40:24.104557Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|954aa8c2-2ea3120f-151a503c-77476b23_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:24.119514Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3296 sessionId: src_id|954aa8c2-2ea3120f-151a503c-77476b23_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:24.121396Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:24.121416Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:24.121420Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:24.121422Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:24.121436Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602966069451421:13014]
2025-10-10T14:40:24.121441Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602966069451421:13014]
2025-10-10T14:40:24.121445Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602966069451421:13014]
2025-10-10T14:40:24.121499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:24.121518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:24.121521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:24.121672Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:24.121683Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:24.121693Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:24.121697Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:24.122296Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:24.176890Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602966851705163:2851]
2025-10-10T14:40:24.177246Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 pipe creation result: OK TabletId: 72075186224037892 Generation: 3295, pipe: [1:7559602966851705163:2851]
2025-10-10T14:40:24.239274Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:24.239652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:24.239668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:24.239708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602966851705163:2851], now have 1 active actors on pipe
2025-10-10T14:40:24.239911Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:24.240002Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:40:24.240105Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3296 reason: status is not ok: tablet will be restarted right now sessionId: src_id|954aa8c2-2ea3120f-151a503c-77476b23_0
2025-10-10T14:40:24.240308Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:24.240363Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 94 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602966851705163:2851]
2025-10-10T14:40:24.240365Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3296 sessionId: src_id|954aa8c2-2ea3120f-151a503c-77476b23_0 is DEAD
2025-10-10T14:40:24.240714Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|954aa8c2-2ea3120f-151a503c-77476b23_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:40:24.240726Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|954aa8c2-2ea3120f-151a503c-77476b23_0] Write session will restart in 0.009456s
2025-10-10T14:40:24.240752Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|954aa8c2-2ea3120f-151a503c-77476b23_0] Write session: Do CDS request
2025-10-10T14:40:24.240759Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|954aa8c2-2ea3120f-151a503c-77476b23_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:24.253879Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|954aa8c2-2ea3120f-151a503c-77476b23_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:24.253950Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:24.253966Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3297
2025-10-10T14:40:24.254130Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3297 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:24.254167Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3297 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:24.254177Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3297 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:24.254181Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:24.254711Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3297 sessionId:  describe result for acl check
2025-10-10T14:40:24.254747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:24.254756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:24.254758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:24.254765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602966851705181:5319] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:24.255386Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602966851705181:5319] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:24.258125Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602966851705181:5319] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:24.262680Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602966851705181:5319] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:24.262695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602966851705181:5319] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:24.262699Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602966851705181:5319] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:24.262710Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3297 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:24.270555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:24.273120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:24.273378Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:24.273392Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:24.273407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:24.273472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:24.273518Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602966069451567:13016]
2025-10-10T14:40:24.274203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:24.274548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:24.274594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:24.274977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:24.275033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:24.275034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:24.275035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:24.275037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:24.275038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:24.275039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:24.275040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:24.275041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:24.275042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:24.275043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:24.275045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:24.275046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:24.275047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:24.275053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:24.275066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:24.275070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:24.275074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:24.275078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:24.275082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:24.275086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:24.275089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:24.275093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:24.275098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:24.275101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:24.275105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:24.275109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:24.275117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:24.275126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:24.275132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:24.275138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:24.275142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:24.275148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:24.275152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:24.275158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:24.275163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:24.275168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:24.275172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:24.275178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:24.275183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:24.275188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:24.275193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:24.275199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:24.275204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:24.275210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:24.275215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:24.275221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:24.275225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:24.275231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:24.275236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:24.275243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:24.275248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:24.275254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:24.275297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:24.277879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:24.278444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:24.278459Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:24.278462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:24.278465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:24.278472Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3296 [2:7559602966069451567:13016]
2025-10-10T14:40:24.278487Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:24.278510Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:24.278517Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:24.278522Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:24.278524Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:24.278542Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:24.278554Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:24.278564Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:24.278620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:24.278627Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:24.278629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:24.278631Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:24.278747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:24.278757Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:24.278770Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:24.278784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:24.278806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:24.278828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602966851705165:2438], now have 1 active actors on pipe
2025-10-10T14:40:24.278833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602966851705228:5319], now have 1 active actors on pipe
2025-10-10T14:40:24.278840Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602966069451562:13016]
2025-10-10T14:40:24.278843Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602966069451562:13016]
2025-10-10T14:40:24.278845Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602966069451562:13016]
2025-10-10T14:40:24.278859Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:24.278873Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:24.278834Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3296
2025-10-10T14:40:24.278891Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3296
2025-10-10T14:40:24.278889Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:24.278892Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:24.278896Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:24.278897Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:24.278898Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:24.278921Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602966069451562:13016]
2025-10-10T14:40:24.278929Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:24.278931Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:24.279029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:24.279038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:24.279070Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|97d0ae52-565d1199-2b387964-ac470011_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:24.279082Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:24.279090Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:24.279093Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:24.279109Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:24.279125Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:24.279139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:24.279393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:24.279402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:24.279417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:24.279502Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3297 partition: 0 MaxSeqNo: 40 sessionId: src_id|97d0ae52-565d1199-2b387964-ac470011_0
2025-10-10T14:40:24.285461Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|954aa8c2-2ea3120f-151a503c-77476b23_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|97d0ae52-565d1199-2b387964-ac470011_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:24.288123Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|97d0ae52-565d1199-2b387964-ac470011_0] Write session: try to update token
2025-10-10T14:40:24.288145Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|97d0ae52-565d1199-2b387964-ac470011_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:24.299490Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:24.299511Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:24.299516Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:24.299518Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:24.299528Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602966069451562:13016]
2025-10-10T14:40:24.299535Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602966069451562:13016]
2025-10-10T14:40:24.299539Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602966069451562:13016]
2025-10-10T14:40:24.299592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:24.299592Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:24.299601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:24.299603Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:24.299604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:24.299608Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:24.299744Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:24.304035Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3297 sessionId: src_id|97d0ae52-565d1199-2b387964-ac470011_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:24.306744Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:24.337644Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602966851705309:2851]
2025-10-10T14:40:24.338043Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 pipe creation result: OK TabletId: 72075186224037892 Generation: 3296, pipe: [1:7559602966851705309:2851]
2025-10-10T14:40:24.417698Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:24.418021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:24.418039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:24.418089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602966851705309:2851], now have 1 active actors on pipe
2025-10-10T14:40:24.418326Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:24.419117Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97d0ae52-565d1199-2b387964-ac470011_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:40:24.419128Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97d0ae52-565d1199-2b387964-ac470011_0] Write session will restart in 0.007325s
2025-10-10T14:40:24.419154Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97d0ae52-565d1199-2b387964-ac470011_0] Write session: Do CDS request
2025-10-10T14:40:24.419161Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97d0ae52-565d1199-2b387964-ac470011_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:24.418360Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:24.418402Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 95 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602966851705309:2851]
2025-10-10T14:40:24.418414Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:40:24.418417Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:40:24.418482Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3297 reason: error at write: Disconnected sessionId: src_id|97d0ae52-565d1199-2b387964-ac470011_0
2025-10-10T14:40:24.418689Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3297 sessionId: src_id|97d0ae52-565d1199-2b387964-ac470011_0 is DEAD
2025-10-10T14:40:24.427914Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|97d0ae52-565d1199-2b387964-ac470011_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:24.428482Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:24.428497Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3298
2025-10-10T14:40:24.428697Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3298 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:24.428743Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3298 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:24.428754Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3298 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:24.428758Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:24.429370Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3298 sessionId:  describe result for acl check
2025-10-10T14:40:24.429429Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:24.429439Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:24.429442Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:24.429449Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602966851705385:5341] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:24.430063Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602966851705385:5341] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:24.432374Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602966851705385:5341] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:24.432662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:24.434638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:24.434858Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:24.434869Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:24.434881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:24.434933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:24.434979Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602966069451709:13019]
2025-10-10T14:40:24.435067Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602966851705385:5341] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:24.435081Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602966851705385:5341] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:24.435084Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602966851705385:5341] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:24.435093Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3298 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:24.435658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:24.436010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:24.436050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:24.436463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:24.436527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:24.436533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:24.436535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:24.436536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:24.436537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:24.436539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:24.436541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:24.436543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:24.436544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:24.436546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:24.436548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:24.436549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:24.436550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:24.436556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:24.436571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:24.436576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:24.436581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:24.436585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:24.436590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:24.436595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:24.436599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:24.436604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:24.436610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:24.436614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:24.436619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:24.436624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:24.436632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:24.436641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:24.436653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:24.436659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:24.436666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:24.436672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:24.436677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:24.436683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:24.436694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:24.436700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:24.436709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:24.436716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:24.436721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:24.436727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:24.436733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:24.436739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:24.436744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:24.436750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:24.436761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:24.436767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:24.436773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:24.436783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:24.436789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:24.436800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:24.436805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:24.436815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:24.436862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:24.439381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:24.439868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:24.439883Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:24.439886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:24.439890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:24.439897Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3297 [2:7559602966069451709:13019]
2025-10-10T14:40:24.439914Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:24.439937Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:24.439945Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:24.439949Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:24.439952Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:24.439969Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:24.439981Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:24.439989Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:24.440048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:24.440059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:24.440061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:24.440064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:24.440135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:24.440147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:24.440171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:24.440190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:24.440214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:24.440241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602966851705311:2438], now have 1 active actors on pipe
2025-10-10T14:40:24.440250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602966851705445:5341], now have 1 active actors on pipe
2025-10-10T14:40:24.440258Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602966069451704:13019]
2025-10-10T14:40:24.440264Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602966069451704:13019]
2025-10-10T14:40:24.440267Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602966069451704:13019]
2025-10-10T14:40:24.440279Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:24.440294Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:24.440294Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:24.440298Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:24.440300Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:24.440312Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:24.440315Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:24.440338Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602966069451704:13019]
2025-10-10T14:40:24.440346Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:24.440360Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:24.440300Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3297
2025-10-10T14:40:24.440348Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3297
2025-10-10T14:40:24.440483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:24.440495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:24.440527Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|555080a5-8a19554b-7ec5f9de-c8da85b0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:24.440535Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:24.440542Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:24.440545Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:24.440557Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:24.440573Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:24.440587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:24.440751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:24.440760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:24.440776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:24.440867Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3298 partition: 0 MaxSeqNo: 40 sessionId: src_id|555080a5-8a19554b-7ec5f9de-c8da85b0_0
2025-10-10T14:40:24.441328Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97d0ae52-565d1199-2b387964-ac470011_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|555080a5-8a19554b-7ec5f9de-c8da85b0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:24.444373Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|555080a5-8a19554b-7ec5f9de-c8da85b0_0] Write session: try to update token
2025-10-10T14:40:24.444391Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|555080a5-8a19554b-7ec5f9de-c8da85b0_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:24.460831Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:24.460855Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:24.460859Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:24.460862Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:24.460872Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602966069451704:13019]
2025-10-10T14:40:24.460877Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602966069451704:13019]
2025-10-10T14:40:24.460882Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602966069451704:13019]
2025-10-10T14:40:24.460937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:24.460943Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:24.460946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:24.460948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:24.460951Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:24.460969Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:24.461095Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:24.462768Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3298 sessionId: src_id|555080a5-8a19554b-7ec5f9de-c8da85b0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:24.465571Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:24.518346Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602966851705456:2851]
2025-10-10T14:40:24.518793Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 pipe creation result: OK TabletId: 72075186224037892 Generation: 3297, pipe: [1:7559602966851705456:2851]
2025-10-10T14:40:24.582674Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:24.583090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:24.583106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:24.583149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602966851705456:2851], now have 1 active actors on pipe
2025-10-10T14:40:24.583381Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:24.583380Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:24.583419Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:40:24.583424Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:40:24.583452Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 96 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602966851705456:2851]
2025-10-10T14:40:24.583494Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3298 reason: error at write: Disconnected sessionId: src_id|555080a5-8a19554b-7ec5f9de-c8da85b0_0
2025-10-10T14:40:24.583748Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3298 sessionId: src_id|555080a5-8a19554b-7ec5f9de-c8da85b0_0 is DEAD
2025-10-10T14:40:24.583927Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|555080a5-8a19554b-7ec5f9de-c8da85b0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:40:24.583936Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|555080a5-8a19554b-7ec5f9de-c8da85b0_0] Write session will restart in 0.009775s
2025-10-10T14:40:24.583979Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|555080a5-8a19554b-7ec5f9de-c8da85b0_0] Write session: Do CDS request
2025-10-10T14:40:24.583985Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|555080a5-8a19554b-7ec5f9de-c8da85b0_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:24.595003Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|555080a5-8a19554b-7ec5f9de-c8da85b0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:24.595064Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:24.595080Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3299
2025-10-10T14:40:24.595323Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3299 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:24.595379Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3299 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:24.595391Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3299 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:24.595395Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:24.595939Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3299 sessionId:  describe result for acl check
2025-10-10T14:40:24.595976Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:24.595978Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:24.595980Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:24.595990Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602966851705566:5339] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:24.596220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:24.596598Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602966851705566:5339] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:24.598426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:24.598651Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:24.598664Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:24.598676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:24.598728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:24.598887Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602966069451852:13021]
2025-10-10T14:40:24.599013Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602966851705566:5339] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:24.599560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:24.599842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:24.599885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:24.600228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:24.600284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:24.600291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:24.600292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:24.600294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:24.600295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:24.600296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:24.600298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:24.600300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:24.600301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:24.600303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:24.600304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:24.600305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:24.600307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:24.600313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:24.600328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:24.600333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:24.600338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:24.600343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:24.600347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:24.600352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:24.600357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:24.600361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:24.600366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:24.600371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:24.600376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:24.600381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:24.600389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:24.600402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:24.600416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:24.600426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:24.600433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:24.600440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:24.600445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:24.600450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:24.600461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:24.600467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:24.600476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:24.600482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:24.600494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:24.600502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:24.600511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:24.600517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:24.600523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:24.600529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:24.600534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:24.600540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:24.600546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:24.600552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:24.600561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:24.600568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:24.600573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:24.600583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:24.600628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:24.603143Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602966851705566:5339] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:24.603158Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602966851705566:5339] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:24.603162Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602966851705566:5339] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:24.603172Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3299 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:24.603435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:24.603745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:24.603758Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:24.603762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:24.603767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:24.603773Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3298 [2:7559602966069451852:13021]
2025-10-10T14:40:24.603786Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:24.603804Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:24.603813Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:24.603816Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:24.603819Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:24.603834Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:24.603847Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:24.603856Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:24.603916Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:24.603923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:24.603925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:24.603931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:24.604006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:24.604014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:24.604027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:24.604047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:24.604067Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:24.604090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602966851705462:2438], now have 1 active actors on pipe
2025-10-10T14:40:24.604095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602966851705600:5339], now have 1 active actors on pipe
2025-10-10T14:40:24.604102Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602966069451847:13021]
2025-10-10T14:40:24.604109Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602966069451847:13021]
2025-10-10T14:40:24.604112Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602966069451847:13021]
2025-10-10T14:40:24.604099Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3298
2025-10-10T14:40:24.604124Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:24.604102Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3298
2025-10-10T14:40:24.604143Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:24.604148Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:24.604164Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:24.604166Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:24.604179Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:24.604183Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:24.604223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:24.604232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:24.604247Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602966069451847:13021]
2025-10-10T14:40:24.604260Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:24.604289Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:24.604294Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|62044929-aa876613-d325ed9b-de6e024a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:24.604301Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:24.604305Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:24.604307Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:24.604318Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:24.604328Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:24.604418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:24.604584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:24.604594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:24.604611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:24.604733Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3299 partition: 0 MaxSeqNo: 40 sessionId: src_id|62044929-aa876613-d325ed9b-de6e024a_0
2025-10-10T14:40:24.605141Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|555080a5-8a19554b-7ec5f9de-c8da85b0_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|62044929-aa876613-d325ed9b-de6e024a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:24.607980Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|62044929-aa876613-d325ed9b-de6e024a_0] Write session: try to update token
2025-10-10T14:40:24.608002Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|62044929-aa876613-d325ed9b-de6e024a_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:24.623529Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3299 sessionId: src_id|62044929-aa876613-d325ed9b-de6e024a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:24.624966Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:24.624992Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:24.624996Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:24.624998Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:24.625011Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602966069451847:13021]
2025-10-10T14:40:24.625015Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602966069451847:13021]
2025-10-10T14:40:24.625019Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602966069451847:13021]
2025-10-10T14:40:24.625072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:24.625081Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:24.625087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:24.625089Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:24.625092Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:24.625094Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:24.625241Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:24.626519Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:24.683759Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602966851705608:2851]
2025-10-10T14:40:24.684210Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 pipe creation result: OK TabletId: 72075186224037892 Generation: 3298, pipe: [1:7559602966851705608:2851]
2025-10-10T14:40:24.747158Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:24.747582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:24.747598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:24.747648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602966851705608:2851], now have 1 active actors on pipe
2025-10-10T14:40:24.747913Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:24.748008Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:24.748068Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:40:24.748181Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3299 reason: status is not ok: tablet will be restarted right now sessionId: src_id|62044929-aa876613-d325ed9b-de6e024a_0
2025-10-10T14:40:24.748391Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 97 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602966851705608:2851]
2025-10-10T14:40:24.748408Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3299 sessionId: src_id|62044929-aa876613-d325ed9b-de6e024a_0 is DEAD
2025-10-10T14:40:24.748602Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|62044929-aa876613-d325ed9b-de6e024a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:40:24.748614Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|62044929-aa876613-d325ed9b-de6e024a_0] Write session will restart in 0.005747s
2025-10-10T14:40:24.748639Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|62044929-aa876613-d325ed9b-de6e024a_0] Write session: Do CDS request
2025-10-10T14:40:24.748645Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|62044929-aa876613-d325ed9b-de6e024a_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:24.755955Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|62044929-aa876613-d325ed9b-de6e024a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:24.756024Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:24.756040Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3300
2025-10-10T14:40:24.756227Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3300 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:24.756264Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3300 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:24.756270Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3300 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:24.756274Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:24.756859Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3300 sessionId:  describe result for acl check
2025-10-10T14:40:24.756893Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:24.756900Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:24.756902Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:24.756908Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602966851705627:5364] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:24.757514Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602966851705627:5364] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:24.763184Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602966851705627:5364] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:24.766663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602966851705627:5364] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:24.766680Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602966851705627:5364] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:24.766684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602966851705627:5364] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:24.766693Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3300 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:24.767216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:24.769877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:24.770103Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:24.770115Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:24.770127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:24.770179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:24.770227Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602966069451996:13023]
2025-10-10T14:40:24.770928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:24.771263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:24.771306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:24.771639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:24.771699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:24.771707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:24.771709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:24.771710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:24.771712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:24.771714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:24.771715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:24.771717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:24.771719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:24.771720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:24.771721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:24.771723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:24.771724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:24.771730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:24.771745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:24.771750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:24.771755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:24.771759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:24.771765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:24.771769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:24.771774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:24.771779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:24.771784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:24.771789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:24.771794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:24.771799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:24.771807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:24.771816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:24.771823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:24.771829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:24.771834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:24.771840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:24.771845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:24.771851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:24.771856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:24.771862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:24.771874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:24.771880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:24.771891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:24.771896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:24.771901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:24.771912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:24.771918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:24.771928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:24.771933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:24.771944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:24.771949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:24.771955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:24.771961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:24.771972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:24.771981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:24.771991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:24.772041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:24.774866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:24.775344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:24.775360Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:24.775363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:24.775367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:24.775374Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3299 [2:7559602966069451996:13023]
2025-10-10T14:40:24.775388Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:24.775408Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:24.775417Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:24.775421Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:24.775424Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:24.775442Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:24.775450Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:24.775459Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:24.775537Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:24.775544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:24.775547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:24.775550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:24.775732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:24.775741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:24.775754Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:24.775775Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:24.775802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:24.775831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602966851705612:2438], now have 1 active actors on pipe
2025-10-10T14:40:24.775840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602966851705745:5364], now have 1 active actors on pipe
2025-10-10T14:40:24.775849Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602966069451991:13023]
2025-10-10T14:40:24.775857Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602966069451991:13023]
2025-10-10T14:40:24.775860Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602966069451991:13023]
2025-10-10T14:40:24.775875Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:24.775894Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:24.775901Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:24.775904Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:24.775907Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:24.775917Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:24.775920Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:24.775955Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602966069451991:13023]
2025-10-10T14:40:24.775966Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:24.775973Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:24.777823Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3299
2025-10-10T14:40:24.777857Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3299
2025-10-10T14:40:24.777990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:24.778002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:24.778045Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|590e1f9e-85898dee-66f6720e-4c55c271_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:24.778060Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:24.778065Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:24.778068Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:24.778081Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:24.778095Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:24.778118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:24.778291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:24.778306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:24.778335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:24.778436Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3300 partition: 0 MaxSeqNo: 40 sessionId: src_id|590e1f9e-85898dee-66f6720e-4c55c271_0
2025-10-10T14:40:24.778847Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|62044929-aa876613-d325ed9b-de6e024a_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|590e1f9e-85898dee-66f6720e-4c55c271_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:24.781735Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|590e1f9e-85898dee-66f6720e-4c55c271_0] Write session: try to update token
2025-10-10T14:40:24.781757Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|590e1f9e-85898dee-66f6720e-4c55c271_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:24.797021Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3300 sessionId: src_id|590e1f9e-85898dee-66f6720e-4c55c271_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:24.798965Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:40:24.798993Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:24.799006Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602966069451991:13023]
2025-10-10T14:40:24.799071Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:40:24.799083Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:40:24.799295Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:40:24.799486Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:24.799673Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:24.799724Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:24.799850Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:24.800113Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:40:24.800201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:24.800222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:24.800251Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:40:24.800301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:40:24.800430Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:40:24.809806Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:24.809835Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:24.809839Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:24.809843Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:24.809863Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602966069451991:13023]
2025-10-10T14:40:24.809869Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602966069451991:13023]
2025-10-10T14:40:24.809874Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602966069451991:13023]
2025-10-10T14:40:24.809944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:24.809945Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:24.809953Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:24.809962Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:24.809963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:24.809966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:24.810140Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:24.848608Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602966851705758:2851]
2025-10-10T14:40:24.848971Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 pipe creation result: OK TabletId: 72075186224037892 Generation: 3299, pipe: [1:7559602966851705758:2851]
2025-10-10T14:40:24.936999Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:24.946746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:24.946787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:24.947007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:24.947086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:24.947155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:24.947221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:24.947270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:24.947275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:24.947354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:24.947417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:24.947486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:24.947557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:24.947600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:24.947604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:24.947685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:24.947755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:24.947822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:24.947895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:24.948194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:24.948200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:24.948270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:24.948724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:24.948791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:24.948860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:24.948906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:24.948909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:24.948980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:24.949041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:24.949101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:24.949164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:24.949208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:24.949211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:24.949284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:24.949407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:24.949474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:24.949538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:24.949585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:24.949588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:24.949660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:24.949734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:24.949808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:24.949888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:24.949939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:24.949948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:24.950019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:24.950090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:24.950167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:24.950238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:24.950288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:24.950291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:24.950369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:24.950438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:24.950504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:24.950573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:24.950617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:24.950621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:24.950692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:24.950752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:24.950820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:24.950899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:24.950951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:24.950955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:24.951025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602966851705758:2851], now have 1 active actors on pipe
2025-10-10T14:40:24.951401Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:40:24.951413Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:40:24.951441Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3300 reason: error at write: Disconnected sessionId: src_id|590e1f9e-85898dee-66f6720e-4c55c271_0
2025-10-10T14:40:24.951726Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:24.951828Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|590e1f9e-85898dee-66f6720e-4c55c271_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:40:24.951838Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|590e1f9e-85898dee-66f6720e-4c55c271_0] Write session will restart in 0.007231s
2025-10-10T14:40:24.951866Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|590e1f9e-85898dee-66f6720e-4c55c271_0] Write session: Do CDS request
2025-10-10T14:40:24.951872Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|590e1f9e-85898dee-66f6720e-4c55c271_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:24.951671Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3300 sessionId: src_id|590e1f9e-85898dee-66f6720e-4c55c271_0 is DEAD
2025-10-10T14:40:24.951826Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 98 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602966851705758:2851]
2025-10-10T14:40:24.951840Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:24.959917Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|590e1f9e-85898dee-66f6720e-4c55c271_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:24.959977Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:24.959992Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3301
2025-10-10T14:40:24.960379Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3301 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:24.960434Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3301 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:24.960445Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3301 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:24.960449Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:24.960965Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3301 sessionId:  describe result for acl check
2025-10-10T14:40:24.960997Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:24.961005Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:24.961007Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:24.961014Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602966851705818:5375] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:24.961592Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602966851705818:5375] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:24.964088Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602966851705818:5375] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:24.965238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:24.967463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:24.967598Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602966851705818:5375] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:24.967609Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602966851705818:5375] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:24.967614Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602966851705818:5375] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:24.967623Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3301 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:24.967793Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:24.967814Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:24.967827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:24.967895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:24.967943Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602966069452152:13026]
2025-10-10T14:40:24.968640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:24.969063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:24.969171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:24.969602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:24.969717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:24.969726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:24.969727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:24.969728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:24.969730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:24.969731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:24.969733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:24.969734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:24.969736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:24.969737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:24.969739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:24.969740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:24.969742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:24.969751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:24.969766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:24.969771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:24.969776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:24.969781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:24.969785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:24.969790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:24.969795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:24.969799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:24.969804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:24.969808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:24.969813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:24.969817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:24.969827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:24.969838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:24.969845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:24.969853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:24.969865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:24.969870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:24.969875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:24.969886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:24.969892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:24.969902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:24.969907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:24.969913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:24.969918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:24.969924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:24.969934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:24.969941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:24.969951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:24.969957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:24.969979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:24.969990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:24.969995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:24.970002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:24.970012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:24.970018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:24.970028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:24.970034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:24.970084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:24.972725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:24.973067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:24.973081Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:24.973085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:24.973089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:24.973096Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3300 [2:7559602966069452152:13026]
2025-10-10T14:40:24.973110Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:24.973134Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:24.973141Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:24.973145Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:24.973147Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:24.973166Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:24.973175Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:24.973183Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:24.973247Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:24.973254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:24.973256Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:24.973259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:24.973351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:24.973360Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:24.973372Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:24.973383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:24.973398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:24.973425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602966851705784:2438], now have 1 active actors on pipe
2025-10-10T14:40:24.973435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602966851705917:5375], now have 1 active actors on pipe
2025-10-10T14:40:24.973443Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602966069452147:13026]
2025-10-10T14:40:24.973446Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602966069452147:13026]
2025-10-10T14:40:24.973448Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602966069452147:13026]
2025-10-10T14:40:24.973487Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3300
2025-10-10T14:40:24.973462Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:24.973534Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3300
2025-10-10T14:40:24.973477Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:24.973492Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:24.973495Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:24.973508Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:24.973512Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:24.973514Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:24.973521Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602966069452147:13026]
2025-10-10T14:40:24.973523Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:24.973541Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:24.973643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:24.973658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:24.973697Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|22a46ad9-4bf67409-6b6c1269-ae02edde_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:24.973711Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:24.973716Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:24.973721Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:24.973734Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:24.973752Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:24.973773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:24.973981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:24.973992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:24.974015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:24.974122Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3301 partition: 0 MaxSeqNo: 40 sessionId: src_id|22a46ad9-4bf67409-6b6c1269-ae02edde_0
2025-10-10T14:40:24.977449Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|590e1f9e-85898dee-66f6720e-4c55c271_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|22a46ad9-4bf67409-6b6c1269-ae02edde_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:24.980220Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|22a46ad9-4bf67409-6b6c1269-ae02edde_0] Write session: try to update token
2025-10-10T14:40:24.980240Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|22a46ad9-4bf67409-6b6c1269-ae02edde_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:25.003355Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3301 sessionId: src_id|22a46ad9-4bf67409-6b6c1269-ae02edde_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:25.006120Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:25.006726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:25.006757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:25.006783Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:25.006787Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:25.006791Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:25.006794Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:25.006803Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602966069452147:13026]
2025-10-10T14:40:25.006807Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602966069452147:13026]
2025-10-10T14:40:25.006812Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602966069452147:13026]
2025-10-10T14:40:25.006875Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:25.006875Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:25.006882Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:25.006885Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:25.006892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:25.006896Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:25.007035Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:25.051385Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602971146673249:2851]
2025-10-10T14:40:25.051728Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 pipe creation result: OK TabletId: 72075186224037892 Generation: 3300, pipe: [1:7559602971146673249:2851]
2025-10-10T14:40:25.130551Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:25.131151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:40:25.131215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602971146673249:2851], now have 1 active actors on pipe
2025-10-10T14:40:25.133491Z :ERROR: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] Got error. Status: UNAVAILABLE. Description: <main>: Error: too much attempts to restart pipe, code: 500027 
2025-10-10T14:40:25.133675Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-10T14:40:25.133683Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-10T14:40:25.133692Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] Reconnecting session to cluster  in 0.009967s
2025-10-10T14:40:25.131330Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:40:25.132120Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:25.132184Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 99 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602971146673249:2851]
2025-10-10T14:40:25.132199Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1661: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 closed with error: reason# too much attempts to restart pipe
2025-10-10T14:40:25.132460Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 33 consumer shared/user session shared/user_1_33_1104800769444553160_v1 is DEAD
2025-10-10T14:40:25.132602Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559602893837247335:2867] disconnected; active server actors: 1
2025-10-10T14:40:25.132606Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559602893837247335:2867] client user disconnected session shared/user_1_33_1104800769444553160_v1
2025-10-10T14:40:25.144799Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] Successfully connected. Initializing session
2025-10-10T14:40:25.145053Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-10T14:40:25.145065Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 34
2025-10-10T14:40:25.145278Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 34 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-10T14:40:25.145367Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 read init: from# ipv6:[::1]:37328, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-10T14:40:25.145479Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 auth for : user
2025-10-10T14:40:25.145672Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 Handle describe topics response
2025-10-10T14:40:25.145703Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 auth is DEAD
2025-10-10T14:40:25.145719Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 auth ok: topics# 1, initDone# 0
2025-10-10T14:40:25.146004Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 register session: topic# rt3.dc1--test-topic
2025-10-10T14:40:25.146117Z :INFO: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] Got InitResponse. ReadSessionId: shared/user_1_34_5982580832181462992_v1
2025-10-10T14:40:25.146100Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559602971146673268:5393] connected; active server actors: 1
2025-10-10T14:40:25.146117Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7559602971146673268:5393] session shared/user_1_34_5982580832181462992_v1
2025-10-10T14:40:25.146127Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-10-10T14:40:25.146140Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-10-10T14:40:25.146148Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_34_5982580832181462992_v1" (Sender=[1:7559602971146673265:5393], Pipe=[1:7559602971146673268:5393], Partitions=[], ActiveFamilyCount=0)
2025-10-10T14:40:25.146153Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-10T14:40:25.146166Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-10-10T14:40:25.146175Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_34_5982580832181462992_v1" (Sender=[1:7559602971146673265:5393], Pipe=[1:7559602971146673268:5393], Partitions=[], ActiveFamilyCount=0)
2025-10-10T14:40:25.146192Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_34_5982580832181462992_v1" sender [1:7559602971146673265:5393] lock partition 0 for ReadingSession "shared/user_1_34_5982580832181462992_v1" (Sender=[1:7559602971146673265:5393], Pipe=[1:7559602971146673268:5393], Partitions=[], ActiveFamilyCount=1) generation 1 step 34
2025-10-10T14:40:25.146201Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-10-10T14:40:25.146206Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000037s
2025-10-10T14:40:25.146410Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 34 Session: "shared/user_1_34_5982580832181462992_v1" ClientId: "user" PipeClient { RawX1: 7559602971146673268 RawX2: 4503603922343185 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-10T14:40:25.146427Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-10T14:40:25.148920Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:40:25.148931Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:40:25.148962Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3301 reason: error at write: Disconnected sessionId: src_id|22a46ad9-4bf67409-6b6c1269-ae02edde_0
2025-10-10T14:40:25.149111Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3301 sessionId: src_id|22a46ad9-4bf67409-6b6c1269-ae02edde_0 is DEAD
2025-10-10T14:40:25.153453Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|22a46ad9-4bf67409-6b6c1269-ae02edde_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:40:25.153471Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|22a46ad9-4bf67409-6b6c1269-ae02edde_0] Write session will restart in 0.005890s
2025-10-10T14:40:25.153501Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|22a46ad9-4bf67409-6b6c1269-ae02edde_0] Write session: Do CDS request
2025-10-10T14:40:25.153510Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|22a46ad9-4bf67409-6b6c1269-ae02edde_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:25.160980Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|22a46ad9-4bf67409-6b6c1269-ae02edde_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:25.161143Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:25.161161Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3302
2025-10-10T14:40:25.161360Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3302 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:25.161406Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3302 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:25.161419Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3302 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:25.161424Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:25.162257Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3302 sessionId:  describe result for acl check
2025-10-10T14:40:25.162307Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:25.162313Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:25.162314Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:25.162321Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602971146673365:5407] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:25.162893Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602971146673365:5407] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:25.165693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602971146673365:5407] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:25.170306Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602971146673365:5407] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:25.170323Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602971146673365:5407] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:25.170328Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602971146673365:5407] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:25.170338Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3302 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:25.170326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:25.172972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:25.173239Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:25.173251Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:25.173264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:25.173323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:25.173388Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602970364419633:13041]
2025-10-10T14:40:25.174060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:25.174437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:25.174493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:25.174820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:25.174897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:25.174898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:25.174899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:25.174901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:25.174902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:25.174904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:25.174905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:25.174906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:25.174908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:25.174909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:25.174911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:25.174912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:25.174913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:25.174920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:25.174933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:25.174938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:25.174942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:25.174946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:25.174950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:25.174954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:25.174958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:25.174961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:25.174967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:25.174971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:25.174975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:25.174979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:25.174989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:25.174998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:25.175005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:25.175010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:25.175015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:25.175020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:25.175024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:25.175030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:25.175036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:25.175042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:25.175047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:25.175053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:25.175060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:25.175066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:25.175071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:25.175076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:25.175081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:25.175086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:25.175104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:25.175110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:25.175114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:25.175119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:25.175125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:25.175130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:25.175136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:25.175141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:25.175184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:25.177825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:25.178402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:25.178420Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:25.178424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:25.178430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:25.178437Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3301 [2:7559602970364419633:13041]
2025-10-10T14:40:25.178455Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:25.178475Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:25.178484Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:25.178488Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:25.178491Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:25.178511Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:25.178523Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:25.178532Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:25.178606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:25.178615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:25.178617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:25.178620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:25.178690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:25.178698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:25.178711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:25.178728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:25.178750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:25.178780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602971146673251:2438], now have 1 active actors on pipe
2025-10-10T14:40:25.178787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602971146673395:5407], now have 1 active actors on pipe
2025-10-10T14:40:25.178792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602971146673271:5396], now have 1 active actors on pipe
2025-10-10T14:40:25.178800Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602970364419627:13041]
2025-10-10T14:40:25.178802Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602970364419627:13041]
2025-10-10T14:40:25.178805Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602970364419627:13041]
2025-10-10T14:40:25.178819Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:25.178833Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:25.178843Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:25.178849Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:25.178853Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:25.178864Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:25.178868Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:25.178888Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602970364419627:13041]
2025-10-10T14:40:25.178891Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:25.178894Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:25.178921Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3301
2025-10-10T14:40:25.178997Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 3301, pipe: [1:7559602971146673271:5396]
2025-10-10T14:40:25.179048Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3301
2025-10-10T14:40:25.179018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:25.179030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:25.179053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:25.179056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:25.179063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_34_5982580832181462992_v1 on pipe: [1:7559602971146673271:5396]
2025-10-10T14:40:25.179098Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_34_5982580832181462992_v1:1 with generation 3301
2025-10-10T14:40:25.179099Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|65fb219b-b1c97ab9-dc86065c-716512cf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:25.179108Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:25.179112Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:25.179114Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:25.179127Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:25.179153Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:25.179173Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:25.179177Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:25.179179Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:25.179195Z node 2 :PERSQUEUE DEBUG: partition.cpp:3747: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_34_5982580832181462992_v1
2025-10-10T14:40:25.179197Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:25.179240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:25.179261Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:40:25.179431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:25.179440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:25.179456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:25.179562Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3302 partition: 0 MaxSeqNo: 40 sessionId: src_id|65fb219b-b1c97ab9-dc86065c-716512cf_0
2025-10-10T14:40:25.180023Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|22a46ad9-4bf67409-6b6c1269-ae02edde_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|65fb219b-b1c97ab9-dc86065c-716512cf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:25.181948Z node 2 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:40:25.181984Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:40:25.181993Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:25.181996Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:25.181998Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:25.182007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-10T14:40:25.182034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-10T14:40:25.182259Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 40 WriteTimestampMS: 1760106661000 SizeLag: 17206678 WriteTimestampEstimateMS: 1760107225178 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-10T14:40:25.182284Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 40 readOffset 0 committedOffset 0
2025-10-10T14:40:25.182347Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 sending to client partition status
2025-10-10T14:40:25.182998Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|65fb219b-b1c97ab9-dc86065c-716512cf_0] Write session: try to update token
2025-10-10T14:40:25.183016Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|65fb219b-b1c97ab9-dc86065c-716512cf_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:25.199963Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3302 sessionId: src_id|65fb219b-b1c97ab9-dc86065c-716512cf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:25.200523Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:25.200544Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:25.200549Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:25.200552Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:25.200561Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602970364419627:13041]
2025-10-10T14:40:25.200566Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602970364419627:13041]
2025-10-10T14:40:25.200572Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602970364419627:13041]
2025-10-10T14:40:25.200632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:25.200633Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:25.200640Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:25.200641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:25.200644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:25.200646Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:25.200805Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:25.202936Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:25.325836Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:25.326461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:25.326483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:25.326873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_34_5982580832181462992_v1
2025-10-10T14:40:25.326890Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:25.327224Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_34_5982580832181462992_v1
2025-10-10T14:40:25.327110Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:40:25.327123Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:40:25.327190Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3302 reason: error at write: Disconnected sessionId: src_id|65fb219b-b1c97ab9-dc86065c-716512cf_0
2025-10-10T14:40:25.327437Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3302 sessionId: src_id|65fb219b-b1c97ab9-dc86065c-716512cf_0 is DEAD
2025-10-10T14:40:25.327615Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:25.327654Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 0 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602971146673271:5396]
2025-10-10T14:40:25.329559Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65fb219b-b1c97ab9-dc86065c-716512cf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:40:25.329572Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65fb219b-b1c97ab9-dc86065c-716512cf_0] Write session will restart in 0.009837s
2025-10-10T14:40:25.329601Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65fb219b-b1c97ab9-dc86065c-716512cf_0] Write session: Do CDS request
2025-10-10T14:40:25.329607Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65fb219b-b1c97ab9-dc86065c-716512cf_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:25.341818Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|65fb219b-b1c97ab9-dc86065c-716512cf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:25.342010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:25.342300Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:25.342318Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3303
2025-10-10T14:40:25.342465Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3303 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:25.342520Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3303 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:25.342532Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3303 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:25.342535Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:25.343063Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3303 sessionId:  describe result for acl check
2025-10-10T14:40:25.343100Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:25.343105Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:25.343107Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:25.343114Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602971146673519:5406] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:25.343709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602971146673519:5406] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:25.344829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:25.345089Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:25.345111Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:25.345125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:25.345189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:25.345238Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602970364419783:13043]
2025-10-10T14:40:25.345944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:25.345946Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602971146673519:5406] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:25.346356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:25.346414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:25.346765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:25.346833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:25.346841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:25.346842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:25.346844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:25.346846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:25.346848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:25.346849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:25.346851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:25.346852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:25.346853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:25.346855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:25.346857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:25.346858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:25.346866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:25.346881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:25.346887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:25.346892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:25.346897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:25.346902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:25.346906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:25.346911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:25.346916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:25.346921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:25.346926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:25.346931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:25.346935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:25.346944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:25.346959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:25.346970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:25.346980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:25.346993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:25.347002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:25.347013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:25.347020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:25.347026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:25.347032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:25.347037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:25.347044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:25.347054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:25.347061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:25.347073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:25.347079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:25.347089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:25.347095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:25.347105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:25.347112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:25.347117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:25.347127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:25.347137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:25.347143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:25.347160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:25.347172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:25.347226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:25.349740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602971146673519:5406] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:25.349753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602971146673519:5406] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:25.349757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602971146673519:5406] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:25.349775Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3303 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:25.349781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:25.350344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:25.350359Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:25.350361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:25.350366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:25.350373Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3302 [2:7559602970364419783:13043]
2025-10-10T14:40:25.350388Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:25.350407Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:25.350430Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:25.350434Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:25.350437Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:25.350457Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:25.350472Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:25.350486Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:25.350545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:25.350553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:25.350555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:25.350558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:25.350631Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:25.350644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:25.350656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:25.350666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:25.350682Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:25.350711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602971146673552:5406], now have 1 active actors on pipe
2025-10-10T14:40:25.350720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602971146673409:2438], now have 1 active actors on pipe
2025-10-10T14:40:25.350728Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602970364419777:13043]
2025-10-10T14:40:25.350735Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602970364419777:13043]
2025-10-10T14:40:25.350737Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602970364419777:13043]
2025-10-10T14:40:25.350718Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3302
2025-10-10T14:40:25.350753Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:25.350765Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3302
2025-10-10T14:40:25.350773Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:25.350782Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:25.350790Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:25.350790Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:25.350793Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:25.350794Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:25.350837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:25.350845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:25.350866Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602970364419777:13043]
2025-10-10T14:40:25.350875Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:25.350892Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:25.350911Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9195b75c-6a5b56e1-1c41ef38-9315a1e4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:25.350926Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:25.350931Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:25.350933Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:25.350945Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:25.350960Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:25.351016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:25.351275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:25.351289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:25.351320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:25.351414Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3303 partition: 0 MaxSeqNo: 40 sessionId: src_id|9195b75c-6a5b56e1-1c41ef38-9315a1e4_0
2025-10-10T14:40:25.351963Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65fb219b-b1c97ab9-dc86065c-716512cf_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|9195b75c-6a5b56e1-1c41ef38-9315a1e4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:25.354975Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9195b75c-6a5b56e1-1c41ef38-9315a1e4_0] Write session: try to update token
2025-10-10T14:40:25.354994Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9195b75c-6a5b56e1-1c41ef38-9315a1e4_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:25.373872Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:25.373901Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:25.373905Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:25.373907Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:25.373919Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602970364419777:13043]
2025-10-10T14:40:25.373924Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602970364419777:13043]
2025-10-10T14:40:25.373929Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602970364419777:13043]
2025-10-10T14:40:25.373986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:25.373994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:25.373997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:25.373999Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:25.374008Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:25.374013Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:25.374171Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:25.372325Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3303 sessionId: src_id|9195b75c-6a5b56e1-1c41ef38-9315a1e4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:25.375466Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:25.428700Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602971146673560:5396]
2025-10-10T14:40:25.429111Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 pipe creation result: OK TabletId: 72075186224037892 Generation: 3302, pipe: [1:7559602971146673560:5396]
2025-10-10T14:40:25.491392Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:25.491956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:25.491980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:25.492038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602971146673560:5396], now have 1 active actors on pipe
2025-10-10T14:40:25.492429Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:25.492434Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 1 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602971146673560:5396]
2025-10-10T14:40:25.492474Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:40:25.492477Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:40:25.492552Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3303 reason: error at write: Disconnected sessionId: src_id|9195b75c-6a5b56e1-1c41ef38-9315a1e4_0
2025-10-10T14:40:25.492778Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3303 sessionId: src_id|9195b75c-6a5b56e1-1c41ef38-9315a1e4_0 is DEAD
2025-10-10T14:40:25.492895Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9195b75c-6a5b56e1-1c41ef38-9315a1e4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:40:25.492907Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9195b75c-6a5b56e1-1c41ef38-9315a1e4_0] Write session will restart in 0.008314s
2025-10-10T14:40:25.492932Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9195b75c-6a5b56e1-1c41ef38-9315a1e4_0] Write session: Do CDS request
2025-10-10T14:40:25.492938Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9195b75c-6a5b56e1-1c41ef38-9315a1e4_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:25.494524Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:25.502983Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9195b75c-6a5b56e1-1c41ef38-9315a1e4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:25.503069Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:25.503083Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3304
2025-10-10T14:40:25.503233Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3304 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:25.503284Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3304 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:25.503295Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3304 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:25.503299Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:25.503786Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3304 sessionId:  describe result for acl check
2025-10-10T14:40:25.503828Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:25.503830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:25.503832Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:25.503838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602971146673652:5421] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:25.504412Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602971146673652:5421] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:25.506772Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602971146673652:5421] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:25.507453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:25.509616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:25.509869Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:25.509884Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:25.509897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:25.509960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:25.510005Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602970364419930:13046]
2025-10-10T14:40:25.510685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:25.511022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:25.511076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:25.511340Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602971146673652:5421] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:25.511357Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602971146673652:5421] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:25.511361Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602971146673652:5421] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:25.511370Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3304 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:25.511437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:25.511506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:25.511512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:25.511514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:25.511515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:25.511516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:25.511517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:25.511518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:25.511520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:25.511521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:25.511522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:25.511523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:25.511524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:25.511524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:25.511531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:25.511546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:25.511550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:25.511555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:25.511559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:25.511562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:25.511565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:25.511569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:25.511573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:25.511578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:25.511582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:25.511587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:25.511591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:25.511600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:25.511609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:25.511616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:25.511621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:25.511625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:25.511631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:25.511636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:25.511641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:25.511661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:25.511667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:25.511672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:25.511677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:25.511682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:25.511689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:25.511693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:25.511697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:25.511701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:25.511706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:25.511710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:25.511715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:25.511719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:25.511724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:25.511733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:25.511738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:25.511742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:25.511747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:25.511790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:25.514393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:25.514963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:25.514977Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:25.514980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:25.514984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:25.514991Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3303 [2:7559602970364419930:13046]
2025-10-10T14:40:25.515006Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:25.515025Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:25.515037Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:25.515040Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:25.515043Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:25.515062Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:25.515070Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:25.515085Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:25.515151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:25.515158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:25.515161Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:25.515164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:25.515246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:25.515254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:25.515268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:25.515284Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:25.515307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:25.515334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602971146673701:5421], now have 1 active actors on pipe
2025-10-10T14:40:25.515342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602971146673561:2438], now have 1 active actors on pipe
2025-10-10T14:40:25.515351Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602970364419925:13046]
2025-10-10T14:40:25.515357Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602970364419925:13046]
2025-10-10T14:40:25.515359Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602970364419925:13046]
2025-10-10T14:40:25.515374Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:25.515392Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:25.515396Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:25.515401Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:25.515380Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3303
2025-10-10T14:40:25.515403Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:25.515389Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3303
2025-10-10T14:40:25.515426Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:25.515431Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:25.515464Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602970364419925:13046]
2025-10-10T14:40:25.515472Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:25.515475Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:25.515503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:25.515513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:25.515553Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|47d9f06f-563b1444-8bd2e3a5-7b352c85_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:25.515569Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:25.515573Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:25.515576Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:25.515588Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:25.515604Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:25.515625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:25.515786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:25.515794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:25.515809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:25.515934Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3304 partition: 0 MaxSeqNo: 40 sessionId: src_id|47d9f06f-563b1444-8bd2e3a5-7b352c85_0
2025-10-10T14:40:25.516519Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9195b75c-6a5b56e1-1c41ef38-9315a1e4_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|47d9f06f-563b1444-8bd2e3a5-7b352c85_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:25.519381Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|47d9f06f-563b1444-8bd2e3a5-7b352c85_0] Write session: try to update token
2025-10-10T14:40:25.519400Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|47d9f06f-563b1444-8bd2e3a5-7b352c85_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:25.535667Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:25.535696Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:25.535700Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:25.535702Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:25.535714Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602970364419925:13046]
2025-10-10T14:40:25.535720Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602970364419925:13046]
2025-10-10T14:40:25.535726Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602970364419925:13046]
2025-10-10T14:40:25.535788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:25.535794Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:25.535798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:25.535801Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:25.535810Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:25.535814Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:25.535969Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:25.536545Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3304 sessionId: src_id|47d9f06f-563b1444-8bd2e3a5-7b352c85_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:25.539312Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:25.592552Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602971146673712:5396]
2025-10-10T14:40:25.593120Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 pipe creation result: OK TabletId: 72075186224037892 Generation: 3303, pipe: [1:7559602971146673712:5396]
2025-10-10T14:40:25.656719Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:25.657063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:25.657078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:25.657122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602971146673712:5396], now have 1 active actors on pipe
2025-10-10T14:40:25.657410Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:25.658618Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47d9f06f-563b1444-8bd2e3a5-7b352c85_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:40:25.658631Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47d9f06f-563b1444-8bd2e3a5-7b352c85_0] Write session will restart in 0.008126s
2025-10-10T14:40:25.658658Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47d9f06f-563b1444-8bd2e3a5-7b352c85_0] Write session: Do CDS request
2025-10-10T14:40:25.658665Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47d9f06f-563b1444-8bd2e3a5-7b352c85_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:25.657879Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:40:25.657969Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3304 reason: status is not ok: tablet will be restarted right now sessionId: src_id|47d9f06f-563b1444-8bd2e3a5-7b352c85_0
2025-10-10T14:40:25.658168Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3304 sessionId: src_id|47d9f06f-563b1444-8bd2e3a5-7b352c85_0 is DEAD
2025-10-10T14:40:25.658300Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:25.658336Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 2 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602971146673712:5396]
2025-10-10T14:40:25.670261Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|47d9f06f-563b1444-8bd2e3a5-7b352c85_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:25.670856Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:25.670869Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3305
2025-10-10T14:40:25.670966Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3305 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:25.670989Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3305 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:25.670993Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3305 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:25.670997Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:25.671763Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3305 sessionId:  describe result for acl check
2025-10-10T14:40:25.671801Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:25.671803Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:25.671805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:25.671810Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602971146673722:5431] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:25.672411Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602971146673722:5431] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:25.682255Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602971146673722:5431] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:25.697917Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602971146673722:5431] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:25.697940Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602971146673722:5431] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:25.697944Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602971146673722:5431] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:25.697955Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3305 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:25.699280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:25.706537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:25.706858Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:25.706877Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:25.706895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:25.706985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:25.707055Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602970364420079:13048]
2025-10-10T14:40:25.707752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:25.708133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:25.708208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:25.708635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:25.708730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:25.708732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:25.708733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:25.708735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:25.708737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:25.708739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:25.708740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:25.708742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:25.708743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:25.708745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:25.708746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:25.708747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:25.708749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:25.708758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:25.708773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:25.708778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:25.708782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:25.708786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:25.708791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:25.708795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:25.708799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:25.708803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:25.708808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:25.708812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:25.708816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:25.708819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:25.708830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:25.708840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:25.708847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:25.708853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:25.708859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:25.708865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:25.708871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:25.708878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:25.708884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:25.708889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:25.708895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:25.708901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:25.708906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:25.708912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:25.708918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:25.708924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:25.708931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:25.708940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:25.708945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:25.708951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:25.708956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:25.708962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:25.708967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:25.708974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:25.708981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:25.708987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:25.709033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:25.716237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:25.716839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:25.716846Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:25.716849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:25.716853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:25.716861Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3304 [2:7559602970364420079:13048]
2025-10-10T14:40:25.716878Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:25.716901Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:25.716906Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:25.716910Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:25.716913Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:25.716933Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:25.716942Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:25.716951Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:25.717022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:25.717024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:25.717027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:25.717030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:25.717110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:25.717114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:25.717129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:25.717143Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:25.717163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:25.717187Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602970364420074:13048]
2025-10-10T14:40:25.717190Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602970364420074:13048]
2025-10-10T14:40:25.717193Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602970364420074:13048]
2025-10-10T14:40:25.717212Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:25.717229Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:25.717248Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:25.717252Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:25.717296Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602970364420074:13048]
2025-10-10T14:40:25.717299Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:25.717441Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:25.717443Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:25.717446Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:25.717452Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:25.718028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602971146673852:5431], now have 1 active actors on pipe
2025-10-10T14:40:25.718044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602971146673713:2438], now have 1 active actors on pipe
2025-10-10T14:40:25.721451Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3304
2025-10-10T14:40:25.721500Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3304
2025-10-10T14:40:25.721715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:25.721741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:25.721803Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8a11e433-4d890537-fd9be8c4-485849b7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:25.721817Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:25.721824Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:25.721828Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:25.721865Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:25.721888Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:25.721927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:25.725030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:25.725056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:25.725112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:25.725538Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3305 partition: 0 MaxSeqNo: 40 sessionId: src_id|8a11e433-4d890537-fd9be8c4-485849b7_0
2025-10-10T14:40:25.726061Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47d9f06f-563b1444-8bd2e3a5-7b352c85_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|8a11e433-4d890537-fd9be8c4-485849b7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:25.729033Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8a11e433-4d890537-fd9be8c4-485849b7_0] Write session: try to update token
2025-10-10T14:40:25.729055Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8a11e433-4d890537-fd9be8c4-485849b7_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:25.747558Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3305 sessionId: src_id|8a11e433-4d890537-fd9be8c4-485849b7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:25.750456Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:25.750728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:25.750754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:25.750812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:40:25.750906Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:40:25.751240Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602971146673864:5396]
2025-10-10T14:40:25.751473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602971146673864:5396], now have 1 active actors on pipe
2025-10-10T14:40:25.751548Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 pipe creation result: OK TabletId: 72075186224037892 Generation: 3304, pipe: [1:7559602971146673864:5396]
2025-10-10T14:40:25.755471Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:25.755496Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:25.755500Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:25.755502Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:25.755516Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602970364420074:13048]
2025-10-10T14:40:25.755520Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602970364420074:13048]
2025-10-10T14:40:25.755523Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602970364420074:13048]
2025-10-10T14:40:25.755573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:25.755584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:25.755586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:25.755601Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:25.755607Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:25.755613Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:25.755746Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:25.873442Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:25.881790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:25.881820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:25.882015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:25.882079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:25.882151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:25.882214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:25.882807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:25.882820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:25.882892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:25.882958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:25.883018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:25.883083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:25.883136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:25.883143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:25.883215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:25.883277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:25.883339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:25.883404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:25.883446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:25.883453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:25.883535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:25.883596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:25.883661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:25.883740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:25.883790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:25.883797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:25.883864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:25.883928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:25.883994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:25.884057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:25.884104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:25.884111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:25.884188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:25.884249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:25.884310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:25.884380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:25.884426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:25.884431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:25.884496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:25.884554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:25.884621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:25.884689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:25.884744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:25.884753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:25.884820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:25.884880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:25.884943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:25.885006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:25.885053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:25.885060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:25.885128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:25.885186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:25.885254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:25.885320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:25.885382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:25.885388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:25.885457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:25.885519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:25.885582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:25.885645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:25.885687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:25.885694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:25.886040Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 3 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602971146673864:5396]
2025-10-10T14:40:25.886079Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:40:25.886083Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:40:25.886123Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3305 reason: error at write: Disconnected sessionId: src_id|8a11e433-4d890537-fd9be8c4-485849b7_0
2025-10-10T14:40:25.886304Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:25.886378Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3305 sessionId: src_id|8a11e433-4d890537-fd9be8c4-485849b7_0 is DEAD
2025-10-10T14:40:25.886574Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a11e433-4d890537-fd9be8c4-485849b7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:40:25.886586Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a11e433-4d890537-fd9be8c4-485849b7_0] Write session will restart in 0.009031s
2025-10-10T14:40:25.886576Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:25.886611Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a11e433-4d890537-fd9be8c4-485849b7_0] Write session: Do CDS request
2025-10-10T14:40:25.886617Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a11e433-4d890537-fd9be8c4-485849b7_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:25.896958Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8a11e433-4d890537-fd9be8c4-485849b7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:25.897347Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:25.897363Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3306
2025-10-10T14:40:25.897591Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3306 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:25.897644Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3306 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:25.897655Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3306 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:25.897669Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:25.898362Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3306 sessionId:  describe result for acl check
2025-10-10T14:40:25.898412Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:25.898413Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:25.898415Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:25.898422Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602971146673972:5437] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:25.899077Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602971146673972:5437] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:25.901684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:25.902538Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602971146673972:5437] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:25.903860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:25.904179Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:25.904192Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:25.904207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:25.904269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:25.904313Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602970364420241:13051]
2025-10-10T14:40:25.904951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:25.905247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:25.905299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:25.905596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602971146673972:5437] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:25.905612Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602971146673972:5437] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:25.905616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602971146673972:5437] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:25.905626Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3306 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:25.905678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:25.905742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:25.905743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:25.905744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:25.905746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:25.905747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:25.905748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:25.905750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:25.905751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:25.905752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:25.905753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:25.905754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:25.905756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:25.905756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:25.905762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:25.905776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:25.905781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:25.905785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:25.905789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:25.905793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:25.905797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:25.905801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:25.905805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:25.905809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:25.905813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:25.905817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:25.905821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:25.905829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:25.905839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:25.905845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:25.905851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:25.905856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:25.905861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:25.905866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:25.905871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:25.905876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:25.905881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:25.905885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:25.905890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:25.905895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:25.905900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:25.905905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:25.905910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:25.905915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:25.905920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:25.905924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:25.905929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:25.905933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:25.905939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:25.905943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:25.905949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:25.905953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:25.905959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:25.905998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:25.908354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:25.908873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:25.908891Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:25.908894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:25.908899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:25.908906Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3305 [2:7559602970364420241:13051]
2025-10-10T14:40:25.908920Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:25.908944Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:25.908952Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:25.908957Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:25.908959Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:25.908978Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:25.908994Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:25.909002Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:25.909068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:25.909077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:25.909079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:25.909081Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:25.909155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:25.909164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:25.909177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:25.909194Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:25.909218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:25.909249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602971146673876:2438], now have 1 active actors on pipe
2025-10-10T14:40:25.909257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602971146674018:5437], now have 1 active actors on pipe
2025-10-10T14:40:25.909265Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602970364420236:13051]
2025-10-10T14:40:25.909267Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602970364420236:13051]
2025-10-10T14:40:25.909270Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602970364420236:13051]
2025-10-10T14:40:25.909280Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:25.909295Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:25.909315Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:25.909325Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:25.909350Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:25.909353Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:25.909356Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:25.909508Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602970364420236:13051]
2025-10-10T14:40:25.909527Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:25.909551Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:25.909732Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3305
2025-10-10T14:40:25.909783Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3305
2025-10-10T14:40:25.909888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:25.909917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:25.909953Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b49a66c9-1fecd2a3-24d69d2a-89f1e91_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:25.909978Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:25.909983Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:25.909985Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:25.909999Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:25.910010Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:25.910026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:25.910178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:25.910185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:25.910199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:25.910326Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3306 partition: 0 MaxSeqNo: 40 sessionId: src_id|b49a66c9-1fecd2a3-24d69d2a-89f1e91_0
2025-10-10T14:40:25.913437Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a11e433-4d890537-fd9be8c4-485849b7_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|b49a66c9-1fecd2a3-24d69d2a-89f1e91_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:25.916215Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b49a66c9-1fecd2a3-24d69d2a-89f1e91_0] Write session: try to update token
2025-10-10T14:40:25.916239Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b49a66c9-1fecd2a3-24d69d2a-89f1e91_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:25.934887Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:40:25.934909Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:25.934921Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602970364420236:13051]
2025-10-10T14:40:25.934967Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:40:25.934970Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:40:25.935382Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:40:25.935549Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:25.935693Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:25.935831Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:25.936017Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:40:25.936060Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:40:25.937381Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3306 sessionId: src_id|b49a66c9-1fecd2a3-24d69d2a-89f1e91_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:25.940493Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:25.940937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:25.940975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:25.941019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:40:25.941125Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:40:25.955022Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:25.955044Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:25.955047Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:25.955049Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:25.955061Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602970364420236:13051]
2025-10-10T14:40:25.955065Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602970364420236:13051]
2025-10-10T14:40:25.955069Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602970364420236:13051]
2025-10-10T14:40:25.955119Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:25.955123Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:25.955131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:25.955137Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:25.955137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:25.955141Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:25.955290Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:25.986295Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602971146674043:5396]
2025-10-10T14:40:25.986683Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 pipe creation result: OK TabletId: 72075186224037892 Generation: 3305, pipe: [1:7559602971146674043:5396]
2025-10-10T14:40:26.073243Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:26.081170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:26.081196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:26.081370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:26.081434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:26.081500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:26.081561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:26.081763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:26.081766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:26.081837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:26.081904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:26.081959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:26.082017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:26.082054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:26.082056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:26.082125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:26.082182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:26.082236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:26.082291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:26.082327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:26.082329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:26.082399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:26.082662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:26.082715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:26.082767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:26.082803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:26.082805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:26.082875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:26.082929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:26.082988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:26.083047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:26.083087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:26.083088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:26.083162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:26.083217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:26.083276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:26.083341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:26.083386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:26.083388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:26.083455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:26.083508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:26.083569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:26.083628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:26.083672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:26.083674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:26.083735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:26.083787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:26.083839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:26.083901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:26.083942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:26.083943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:26.084007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:26.084057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:26.084113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:26.084193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:26.084232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:26.084234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:26.084299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:26.084355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:26.084418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:26.084473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:26.084519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:26.084521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:26.084586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602971146674043:5396], now have 1 active actors on pipe
2025-10-10T14:40:26.085304Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b49a66c9-1fecd2a3-24d69d2a-89f1e91_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:40:26.085349Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b49a66c9-1fecd2a3-24d69d2a-89f1e91_0] Write session will restart in 0.008516s
2025-10-10T14:40:26.085373Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b49a66c9-1fecd2a3-24d69d2a-89f1e91_0] Write session: Do CDS request
2025-10-10T14:40:26.085379Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b49a66c9-1fecd2a3-24d69d2a-89f1e91_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:26.085382Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:26.084854Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 4 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602971146674043:5396]
2025-10-10T14:40:26.084898Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:26.084934Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:40:26.084936Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:40:26.084962Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3306 reason: error at write: Disconnected sessionId: src_id|b49a66c9-1fecd2a3-24d69d2a-89f1e91_0
2025-10-10T14:40:26.088060Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3306 sessionId: src_id|b49a66c9-1fecd2a3-24d69d2a-89f1e91_0 is DEAD
2025-10-10T14:40:26.095518Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b49a66c9-1fecd2a3-24d69d2a-89f1e91_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:26.095817Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:26.095833Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3307
2025-10-10T14:40:26.095968Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3307 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:26.096003Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3307 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:26.096014Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3307 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:26.096018Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:26.096689Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3307 sessionId:  describe result for acl check
2025-10-10T14:40:26.096726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:26.096732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:26.096734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:26.096740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602975441641418:5473] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:26.097318Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602975441641418:5473] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:26.101129Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602975441641418:5473] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:26.102396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:26.104701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:26.105077Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602975441641418:5473] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:26.105090Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602975441641418:5473] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:26.105093Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602975441641418:5473] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:26.105102Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3307 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:26.104932Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:26.104947Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:26.104962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:26.105021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:26.105061Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602974659387725:13061]
2025-10-10T14:40:26.105755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:26.109797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:26.109887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:26.110286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:26.110368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:26.110375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:26.110376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:26.110378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:26.110379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:26.110381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:26.110383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:26.110385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:26.110387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:26.110389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:26.110390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:26.110392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:26.110393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:26.110401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:26.110414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:26.110419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:26.110423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:26.110427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:26.110432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:26.110436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:26.110440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:26.110444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:26.110448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:26.110452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:26.110456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:26.110460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:26.110469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:26.110479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:26.110487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:26.110494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:26.110507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:26.110518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:26.110522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:26.110533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:26.110538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:26.110547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:26.110551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:26.110556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:26.110569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:26.110578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:26.110583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:26.110588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:26.110598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:26.110603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:26.110607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:26.110616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:26.110620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:26.110625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:26.110629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:26.110634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:26.110638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:26.110642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:26.110679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:26.113654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:26.114201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:26.114221Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:26.114223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:26.114227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:26.114234Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3306 [2:7559602974659387725:13061]
2025-10-10T14:40:26.114249Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:26.114270Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:26.114279Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:26.114283Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:26.114285Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:26.114305Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:26.114318Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:26.114326Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:26.114396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:26.114403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:26.114405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:26.114408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:26.114482Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:26.114490Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:26.114507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:26.114521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:26.114540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:26.114566Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602974659387720:13061]
2025-10-10T14:40:26.114573Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602974659387720:13061]
2025-10-10T14:40:26.114575Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602974659387720:13061]
2025-10-10T14:40:26.114585Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:26.114595Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:26.114598Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:26.114601Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:26.114606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602975441641368:2438], now have 1 active actors on pipe
2025-10-10T14:40:26.114610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602975441641508:5473], now have 1 active actors on pipe
2025-10-10T14:40:26.114616Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:26.114632Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:26.114635Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:26.114665Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602974659387720:13061]
2025-10-10T14:40:26.114675Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:26.114724Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:26.114943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:26.114957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:26.114672Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3306
2025-10-10T14:40:26.114723Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3306
2025-10-10T14:40:26.114995Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|478a652b-fb985b1a-19d4a254-f71cc62e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:26.115009Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:26.115014Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:26.115017Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:26.115031Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:26.115044Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:26.115061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:26.116826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:26.116840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:26.116867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:26.117009Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3307 partition: 0 MaxSeqNo: 40 sessionId: src_id|478a652b-fb985b1a-19d4a254-f71cc62e_0
2025-10-10T14:40:26.120274Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b49a66c9-1fecd2a3-24d69d2a-89f1e91_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|478a652b-fb985b1a-19d4a254-f71cc62e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:26.123235Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|478a652b-fb985b1a-19d4a254-f71cc62e_0] Write session: try to update token
2025-10-10T14:40:26.123257Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|478a652b-fb985b1a-19d4a254-f71cc62e_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:26.135073Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:26.135100Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:26.135103Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:26.135105Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:26.135116Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602974659387720:13061]
2025-10-10T14:40:26.135120Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602974659387720:13061]
2025-10-10T14:40:26.135125Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602974659387720:13061]
2025-10-10T14:40:26.135177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:26.135190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:26.135193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:26.135351Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:26.135780Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:26.135792Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:26.135798Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:26.142975Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3307 sessionId: src_id|478a652b-fb985b1a-19d4a254-f71cc62e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:26.145689Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:26.184901Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602975441641519:5396]
2025-10-10T14:40:26.185253Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 pipe creation result: OK TabletId: 72075186224037892 Generation: 3306, pipe: [1:7559602975441641519:5396]
2025-10-10T14:40:26.255868Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:26.256423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:26.256444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:26.256497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602975441641519:5396], now have 1 active actors on pipe
2025-10-10T14:40:26.256752Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:26.257969Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|478a652b-fb985b1a-19d4a254-f71cc62e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:40:26.257980Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|478a652b-fb985b1a-19d4a254-f71cc62e_0] Write session will restart in 0.008650s
2025-10-10T14:40:26.258008Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|478a652b-fb985b1a-19d4a254-f71cc62e_0] Write session: Do CDS request
2025-10-10T14:40:26.258015Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|478a652b-fb985b1a-19d4a254-f71cc62e_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:26.257429Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:40:26.257565Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3307 reason: status is not ok: tablet will be restarted right now sessionId: src_id|478a652b-fb985b1a-19d4a254-f71cc62e_0
2025-10-10T14:40:26.257816Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3307 sessionId: src_id|478a652b-fb985b1a-19d4a254-f71cc62e_0 is DEAD
2025-10-10T14:40:26.258403Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:26.258445Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 5 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602975441641519:5396]
2025-10-10T14:40:26.268035Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|478a652b-fb985b1a-19d4a254-f71cc62e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:26.268118Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:26.268152Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3308
2025-10-10T14:40:26.268290Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3308 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:26.268330Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3308 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:26.268340Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3308 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:26.268345Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:26.268851Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3308 sessionId:  describe result for acl check
2025-10-10T14:40:26.268899Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:26.268904Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:26.268907Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:26.268913Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602975441641529:5470] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:26.269552Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602975441641529:5470] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:26.272232Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602975441641529:5470] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:26.278602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602975441641529:5470] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:26.278620Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602975441641529:5470] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:26.278625Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602975441641529:5470] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:26.278635Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3308 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:26.304733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:26.311270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:26.311678Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:26.311691Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:26.311704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:26.311777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:26.311828Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602974659387878:13068]
2025-10-10T14:40:26.312534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:26.313111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:26.313170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:26.313553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:26.313617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:26.313624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:26.313626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:26.313627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:26.313629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:26.313630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:26.313632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:26.313634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:26.313636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:26.313637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:26.313639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:26.313640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:26.313642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:26.313649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:26.313664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:26.313669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:26.313674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:26.313679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:26.313684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:26.313703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:26.313713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:26.313717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:26.313723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:26.313732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:26.313737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:26.313741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:26.313750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:26.313760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:26.313772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:26.313778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:26.313789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:26.313795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:26.313805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:26.313811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:26.313821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:26.313827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:26.313837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:26.313844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:26.313855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:26.313861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:26.313870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:26.313877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:26.313885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:26.313895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:26.313900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:26.313911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:26.313916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:26.313923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:26.313932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:26.313939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:26.313948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:26.313958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:26.314005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:26.322552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:26.323142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:26.323166Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:26.323169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:26.323174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:26.323181Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3307 [2:7559602974659387878:13068]
2025-10-10T14:40:26.323198Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:26.323221Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:26.323227Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:26.323230Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:26.323233Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:26.323253Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:26.323261Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:26.323270Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:26.323349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:26.323351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:26.323353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:26.323355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:26.323471Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:26.323474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:26.323488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:26.323501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:26.323519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:26.323543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602975441641564:5470], now have 1 active actors on pipe
2025-10-10T14:40:26.323547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602975441641524:2438], now have 1 active actors on pipe
2025-10-10T14:40:26.323555Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602974659387872:13068]
2025-10-10T14:40:26.323557Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602974659387872:13068]
2025-10-10T14:40:26.323559Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602974659387872:13068]
2025-10-10T14:40:26.323576Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:26.323594Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:26.323610Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:26.323614Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:26.323657Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602974659387872:13068]
2025-10-10T14:40:26.323660Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:26.323711Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:26.323715Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:26.323718Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:26.323726Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:26.323936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:26.323954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:26.324007Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|371452d2-d32eb44c-9fdceadc-91a824d8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:26.324032Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:26.324038Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:26.324040Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:26.324055Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:26.324070Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:26.324092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:26.324342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:26.324357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:26.324389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:26.324954Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|478a652b-fb985b1a-19d4a254-f71cc62e_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|371452d2-d32eb44c-9fdceadc-91a824d8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:26.328008Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|371452d2-d32eb44c-9fdceadc-91a824d8_0] Write session: try to update token
2025-10-10T14:40:26.328036Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|371452d2-d32eb44c-9fdceadc-91a824d8_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:26.323702Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3307
2025-10-10T14:40:26.323742Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3307
2025-10-10T14:40:26.324474Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3308 partition: 0 MaxSeqNo: 40 sessionId: src_id|371452d2-d32eb44c-9fdceadc-91a824d8_0
2025-10-10T14:40:26.346981Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3308 sessionId: src_id|371452d2-d32eb44c-9fdceadc-91a824d8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:26.352318Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:26.349777Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:26.349798Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:26.349801Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:26.349803Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:26.349813Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602974659387872:13068]
2025-10-10T14:40:26.349818Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602974659387872:13068]
2025-10-10T14:40:26.349822Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602974659387872:13068]
2025-10-10T14:40:26.349877Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:26.349881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:26.349882Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:26.349886Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:26.349890Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:26.349892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:26.350049Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:26.358961Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602975441641676:5396]
2025-10-10T14:40:26.360610Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 pipe creation result: OK TabletId: 72075186224037892 Generation: 3307, pipe: [1:7559602975441641676:5396]
2025-10-10T14:40:26.484241Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:26.484869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:26.484897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:26.484930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602975441641676:5396], now have 1 active actors on pipe
2025-10-10T14:40:26.485394Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 6 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602975441641676:5396]
2025-10-10T14:40:26.485418Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:26.485442Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:40:26.485445Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:40:26.485515Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3308 reason: error at write: Disconnected sessionId: src_id|371452d2-d32eb44c-9fdceadc-91a824d8_0
2025-10-10T14:40:26.485742Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3308 sessionId: src_id|371452d2-d32eb44c-9fdceadc-91a824d8_0 is DEAD
2025-10-10T14:40:26.486201Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|371452d2-d32eb44c-9fdceadc-91a824d8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:40:26.486213Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|371452d2-d32eb44c-9fdceadc-91a824d8_0] Write session will restart in 0.005832s
2025-10-10T14:40:26.486242Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|371452d2-d32eb44c-9fdceadc-91a824d8_0] Write session: Do CDS request
2025-10-10T14:40:26.486249Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|371452d2-d32eb44c-9fdceadc-91a824d8_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:26.486221Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:26.492983Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|371452d2-d32eb44c-9fdceadc-91a824d8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:26.496285Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:26.496303Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3309
2025-10-10T14:40:26.496797Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3309 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:26.496836Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3309 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:26.496842Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3309 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:26.496855Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:26.497379Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3309 sessionId:  describe result for acl check
2025-10-10T14:40:26.497411Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:26.497414Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:26.497416Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:26.497423Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602975441641689:5499] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:26.498015Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602975441641689:5499] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:26.500858Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602975441641689:5499] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:26.506146Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602975441641689:5499] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:26.506161Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602975441641689:5499] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:26.506166Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602975441641689:5499] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:26.506177Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3309 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:26.517739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:26.520264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:26.520533Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:26.520539Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:26.520552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:26.520614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:26.520657Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602974659388032:13071]
2025-10-10T14:40:26.521263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:26.521697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:26.521755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:26.522092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:26.522150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:26.522152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:26.522153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:26.522154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:26.522155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:26.522157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:26.522159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:26.522160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:26.522162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:26.522163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:26.522164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:26.522165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:26.522167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:26.522173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:26.522186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:26.522190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:26.522194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:26.522198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:26.522202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:26.522206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:26.522210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:26.522214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:26.522218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:26.522223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:26.522227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:26.522230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:26.522241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:26.522250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:26.522256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:26.522262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:26.522266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:26.522272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:26.522276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:26.522282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:26.522286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:26.522292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:26.522296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:26.522301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:26.522307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:26.522312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:26.522316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:26.522323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:26.522328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:26.522333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:26.522338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:26.522343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:26.522348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:26.522353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:26.522357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:26.522362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:26.522367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:26.522372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:26.522410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:26.525159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:26.525823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:26.525830Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:26.525833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:26.525838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:26.525845Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3308 [2:7559602974659388032:13071]
2025-10-10T14:40:26.525859Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:26.525881Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:26.525886Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:26.525890Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:26.525893Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:26.525913Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:26.525922Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:26.525930Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:26.526589Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3308
2025-10-10T14:40:26.526623Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3308
2025-10-10T14:40:26.526000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:26.526002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:26.526004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:26.526007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:26.526094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:26.526097Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:26.526111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:26.526122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:26.526139Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:26.526161Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602974659388027:13071]
2025-10-10T14:40:26.526164Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602974659388027:13071]
2025-10-10T14:40:26.526167Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602974659388027:13071]
2025-10-10T14:40:26.526185Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:26.526201Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:26.526216Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:26.526220Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:26.526238Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:26.526242Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:26.526244Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:26.526253Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602974659388027:13071]
2025-10-10T14:40:26.526256Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:26.526333Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:26.526660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602975441641735:5499], now have 1 active actors on pipe
2025-10-10T14:40:26.526665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602975441641682:2438], now have 1 active actors on pipe
2025-10-10T14:40:26.526782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:26.526794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:26.526831Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cebef19b-4d4be94-73fda0a0-2d317c12_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:26.526840Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:26.526844Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:26.526847Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:26.526861Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:26.526874Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:26.526892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:26.528075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:26.528086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:26.528107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:26.528293Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3309 partition: 0 MaxSeqNo: 40 sessionId: src_id|cebef19b-4d4be94-73fda0a0-2d317c12_0
2025-10-10T14:40:26.528757Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|371452d2-d32eb44c-9fdceadc-91a824d8_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|cebef19b-4d4be94-73fda0a0-2d317c12_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:26.531682Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cebef19b-4d4be94-73fda0a0-2d317c12_0] Write session: try to update token
2025-10-10T14:40:26.531704Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cebef19b-4d4be94-73fda0a0-2d317c12_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:26.538947Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:40:26.538967Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:26.538979Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602974659388027:13071]
2025-10-10T14:40:26.539038Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:40:26.539174Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:40:26.539234Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:40:26.539395Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:26.539548Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:26.539734Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:26.539958Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:40:26.540001Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:40:26.565210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:26.565237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:26.565265Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:26.565268Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:26.565272Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:26.565275Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:26.565284Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602974659388027:13071]
2025-10-10T14:40:26.565292Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602974659388027:13071]
2025-10-10T14:40:26.565297Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602974659388027:13071]
2025-10-10T14:40:26.565361Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:26.565377Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:26.565380Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:26.565381Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:26.565388Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:26.561610Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3309 sessionId: src_id|cebef19b-4d4be94-73fda0a0-2d317c12_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:26.565390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:26.564596Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:26.565532Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:26.584005Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602975441641838:5396]
2025-10-10T14:40:26.584479Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 pipe creation result: OK TabletId: 72075186224037892 Generation: 3308, pipe: [1:7559602975441641838:5396]
2025-10-10T14:40:26.682968Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:26.683273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:40:26.683324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602975441641838:5396], now have 1 active actors on pipe
2025-10-10T14:40:26.683507Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:40:26.685412Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 7 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602975441641838:5396]
2025-10-10T14:40:26.685448Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:26.702733Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cebef19b-4d4be94-73fda0a0-2d317c12_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:40:26.702750Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cebef19b-4d4be94-73fda0a0-2d317c12_0] Write session will restart in 0.009968s
2025-10-10T14:40:26.702779Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cebef19b-4d4be94-73fda0a0-2d317c12_0] Write session: Do CDS request
2025-10-10T14:40:26.702798Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cebef19b-4d4be94-73fda0a0-2d317c12_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:26.701734Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:40:26.701748Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:40:26.701779Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3309 reason: error at write: Disconnected sessionId: src_id|cebef19b-4d4be94-73fda0a0-2d317c12_0
2025-10-10T14:40:26.701949Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3309 sessionId: src_id|cebef19b-4d4be94-73fda0a0-2d317c12_0 is DEAD
2025-10-10T14:40:26.717951Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cebef19b-4d4be94-73fda0a0-2d317c12_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:26.720696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:26.721533Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:26.721550Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3310
2025-10-10T14:40:26.722940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:26.723163Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:26.723169Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:26.723181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:26.723235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:26.723279Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602974659388184:13073]
2025-10-10T14:40:26.723782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:26.724157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:26.724209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:26.724450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:26.724494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:26.724495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:26.724496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:26.724496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:26.724497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:26.724498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:26.724499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:26.724500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:26.724501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:26.724502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:26.724502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:26.724503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:26.724504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:26.724508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:26.724518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:26.724520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:26.724523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:26.724525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:26.724528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:26.724531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:26.724533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:26.724536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:26.724538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:26.724540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:26.724543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:26.724545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:26.724552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:26.724559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:26.724566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:26.724571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:26.724576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:26.724581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:26.724586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:26.724592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:26.724598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:26.724617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:26.724622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:26.724629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:26.724633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:26.724636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:26.724639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:26.724643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:26.724649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:26.724652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:26.724656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:26.724659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:26.724662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:26.724665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:26.724668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:26.724673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:26.724676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:26.724679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:26.724702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:26.725613Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3310 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:26.725669Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3310 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:26.725675Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3310 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:26.725691Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:26.726127Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3310 sessionId:  describe result for acl check
2025-10-10T14:40:26.726157Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:26.726162Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:26.726164Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:26.726170Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602975441641960:5504] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:26.726784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602975441641960:5504] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:26.727324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:26.728109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:26.728140Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:26.728142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:26.728146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:26.728153Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3309 [2:7559602974659388184:13073]
2025-10-10T14:40:26.728167Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:26.728186Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:26.728191Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:26.728194Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:26.728197Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:26.728216Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:26.728234Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:26.728242Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:26.728312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:26.728314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:26.728317Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:26.728320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:26.728395Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:26.728398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:26.728411Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:26.728425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:26.728443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:26.728465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602975441641842:2438], now have 1 active actors on pipe
2025-10-10T14:40:26.728474Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602974659388179:13073]
2025-10-10T14:40:26.728477Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602974659388179:13073]
2025-10-10T14:40:26.728480Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602974659388179:13073]
2025-10-10T14:40:26.728494Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:26.728514Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:26.728515Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:26.728518Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:26.728520Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:26.728534Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:26.728538Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:26.728574Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602974659388179:13073]
2025-10-10T14:40:26.728583Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:26.728608Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:26.728804Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3309
2025-10-10T14:40:26.729760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602975441641960:5504] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:26.734732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602975441641960:5504] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:26.734748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602975441641960:5504] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:26.734752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602975441641960:5504] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:26.734762Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3310 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:26.735099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602975441641992:5504], now have 1 active actors on pipe
2025-10-10T14:40:26.735187Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3309
2025-10-10T14:40:26.736023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:26.736053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:26.736103Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|98c36127-607bbc5e-7f0dca8f-e4559c94_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:26.736136Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:26.736143Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:26.736147Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:26.736166Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:26.736193Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:26.736215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:26.736476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:26.736491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:26.736512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:26.736640Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3310 partition: 0 MaxSeqNo: 40 sessionId: src_id|98c36127-607bbc5e-7f0dca8f-e4559c94_0
2025-10-10T14:40:26.737118Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cebef19b-4d4be94-73fda0a0-2d317c12_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|98c36127-607bbc5e-7f0dca8f-e4559c94_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:26.740089Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|98c36127-607bbc5e-7f0dca8f-e4559c94_0] Write session: try to update token
2025-10-10T14:40:26.740110Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|98c36127-607bbc5e-7f0dca8f-e4559c94_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:26.750433Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:26.750456Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:26.750460Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:26.750462Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:26.750474Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602974659388179:13073]
2025-10-10T14:40:26.750480Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602974659388179:13073]
2025-10-10T14:40:26.750484Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602974659388179:13073]
2025-10-10T14:40:26.750544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:26.750558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:26.750567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:26.750587Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:26.750609Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:26.750616Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:26.750712Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:26.757290Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3310 sessionId: src_id|98c36127-607bbc5e-7f0dca8f-e4559c94_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:26.759923Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:26.785508Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602975441641996:5396]
2025-10-10T14:40:26.785814Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 pipe creation result: OK TabletId: 72075186224037892 Generation: 3309, pipe: [1:7559602975441641996:5396]
2025-10-10T14:40:26.875209Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:26.875583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:26.875599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:26.875648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602975441641996:5396], now have 1 active actors on pipe
2025-10-10T14:40:26.875928Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:26.875909Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:40:26.875937Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:40:26.876014Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3310 reason: error at write: Disconnected sessionId: src_id|98c36127-607bbc5e-7f0dca8f-e4559c94_0
2025-10-10T14:40:26.876027Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 8 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602975441641996:5396]
2025-10-10T14:40:26.876047Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:26.876462Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98c36127-607bbc5e-7f0dca8f-e4559c94_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:40:26.876472Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98c36127-607bbc5e-7f0dca8f-e4559c94_0] Write session will restart in 0.009270s
2025-10-10T14:40:26.876499Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98c36127-607bbc5e-7f0dca8f-e4559c94_0] Write session: Do CDS request
2025-10-10T14:40:26.876285Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3310 sessionId: src_id|98c36127-607bbc5e-7f0dca8f-e4559c94_0 is DEAD
2025-10-10T14:40:26.876507Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98c36127-607bbc5e-7f0dca8f-e4559c94_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:26.886988Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|98c36127-607bbc5e-7f0dca8f-e4559c94_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:26.887051Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:26.887068Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3311
2025-10-10T14:40:26.887275Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3311 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:26.887308Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3311 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:26.887321Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3311 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:26.887324Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:26.887768Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3311 sessionId:  describe result for acl check
2025-10-10T14:40:26.887813Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:26.887820Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:26.887822Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:26.887828Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602975441642083:5522] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:26.888442Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602975441642083:5522] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:26.891154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:26.893307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:26.893532Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:26.893545Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:26.893557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:26.893612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:26.893653Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602974659388350:13076]
2025-10-10T14:40:26.894213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:26.894418Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602975441642083:5522] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:26.894557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:26.894615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:26.894960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:26.895024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:26.895031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:26.895032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:26.895033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:26.895035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:26.895036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:26.895037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:26.895038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:26.895039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:26.895041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:26.895042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:26.895043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:26.895045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:26.895051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:26.895064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:26.895068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:26.895073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:26.895077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:26.895081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:26.895085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:26.895089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:26.895093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:26.895098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:26.895102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:26.895106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:26.895110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:26.895117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:26.895125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:26.895132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:26.895138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:26.895145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:26.895150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:26.895156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:26.895161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:26.895167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:26.895173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:26.895185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:26.895191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:26.895196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:26.895206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:26.895210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:26.895215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:26.895220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:26.895225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:26.895230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:26.895235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:26.895239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:26.895245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:26.895249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:26.895259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:26.895264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:26.895270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:26.895309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:26.897729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602975441642083:5522] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:26.897745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602975441642083:5522] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:26.897749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602975441642083:5522] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:26.897759Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3311 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:26.897769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:26.898269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:26.898281Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:26.898284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:26.898288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:26.898294Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3310 [2:7559602974659388350:13076]
2025-10-10T14:40:26.898316Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:26.898332Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:26.898340Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:26.898343Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:26.898346Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:26.898363Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:26.898370Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:26.898379Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:26.898444Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:26.898461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:26.898463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:26.898466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:26.898536Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:26.898547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:26.898558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:26.898570Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:26.898588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:26.898610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602975441642155:5522], now have 1 active actors on pipe
2025-10-10T14:40:26.898620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602975441642002:2438], now have 1 active actors on pipe
2025-10-10T14:40:26.898628Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602974659388344:13076]
2025-10-10T14:40:26.898630Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602974659388344:13076]
2025-10-10T14:40:26.898632Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602974659388344:13076]
2025-10-10T14:40:26.898653Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3310
2025-10-10T14:40:26.898645Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:26.898660Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:26.898654Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3310
2025-10-10T14:40:26.898671Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:26.898675Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:26.898676Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:26.898677Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:26.898678Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:26.898703Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602974659388344:13076]
2025-10-10T14:40:26.898706Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:26.898709Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:26.898723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:26.898734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:26.898857Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1f7d1419-e04a9645-d2668181-e4c4c305_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:26.898869Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:26.898873Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:26.898874Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:26.898886Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:26.898898Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:26.898924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:26.899148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:26.899176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:26.899202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:26.899297Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3311 partition: 0 MaxSeqNo: 40 sessionId: src_id|1f7d1419-e04a9645-d2668181-e4c4c305_0
2025-10-10T14:40:26.899741Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98c36127-607bbc5e-7f0dca8f-e4559c94_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|1f7d1419-e04a9645-d2668181-e4c4c305_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:26.902475Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1f7d1419-e04a9645-d2668181-e4c4c305_0] Write session: try to update token
2025-10-10T14:40:26.902492Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1f7d1419-e04a9645-d2668181-e4c4c305_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:26.917592Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3311 sessionId: src_id|1f7d1419-e04a9645-d2668181-e4c4c305_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:26.918664Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:26.918693Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:26.918697Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:26.918699Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:26.918711Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602974659388344:13076]
2025-10-10T14:40:26.918716Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602974659388344:13076]
2025-10-10T14:40:26.918720Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602974659388344:13076]
2025-10-10T14:40:26.918778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:26.918782Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:26.918788Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:26.918792Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:26.918796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:26.918799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:26.918958Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:26.920682Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:26.977595Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602975441642177:5396]
2025-10-10T14:40:26.977923Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 pipe creation result: OK TabletId: 72075186224037892 Generation: 3310, pipe: [1:7559602975441642177:5396]
2025-10-10T14:40:27.035646Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:27.036030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:27.036046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:27.036094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602975441642177:5396], now have 1 active actors on pipe
2025-10-10T14:40:27.036332Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:27.036905Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f7d1419-e04a9645-d2668181-e4c4c305_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:40:27.036918Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f7d1419-e04a9645-d2668181-e4c4c305_0] Write session will restart in 0.009182s
2025-10-10T14:40:27.036951Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f7d1419-e04a9645-d2668181-e4c4c305_0] Write session: Do CDS request
2025-10-10T14:40:27.036958Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f7d1419-e04a9645-d2668181-e4c4c305_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:27.036352Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 9 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602975441642177:5396]
2025-10-10T14:40:27.036388Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:40:27.036488Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3311 reason: status is not ok: tablet will be restarted right now sessionId: src_id|1f7d1419-e04a9645-d2668181-e4c4c305_0
2025-10-10T14:40:27.036524Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:27.036730Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3311 sessionId: src_id|1f7d1419-e04a9645-d2668181-e4c4c305_0 is DEAD
2025-10-10T14:40:27.046932Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1f7d1419-e04a9645-d2668181-e4c4c305_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:27.049671Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:27.049688Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3312
2025-10-10T14:40:27.049895Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3312 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:27.049948Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3312 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:27.049960Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3312 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:27.049965Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:27.050455Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3312 sessionId:  describe result for acl check
2025-10-10T14:40:27.050502Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:27.050509Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:27.050511Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:27.050518Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602979736609575:5526] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:27.051194Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602979736609575:5526] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:27.053439Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602979736609575:5526] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:27.053992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:27.056474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:27.056727Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:27.056739Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:27.056752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:27.056837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:27.056887Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602978954355801:13078]
2025-10-10T14:40:27.056783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602979736609575:5526] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:27.056796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602979736609575:5526] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:27.056799Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602979736609575:5526] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:27.056808Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3312 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:27.057548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:27.057860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:27.057916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:27.058285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:27.058343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:27.058344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:27.058346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:27.058347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:27.058349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:27.058350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:27.058351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:27.058353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:27.058354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:27.058356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:27.058357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:27.058358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:27.058359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:27.058367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:27.058381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:27.058386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:27.058391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:27.058395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:27.058399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:27.058404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:27.058408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:27.058413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:27.058418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:27.058422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:27.058427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:27.058431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:27.058441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:27.058451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:27.058458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:27.058464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:27.058472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:27.058478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:27.058483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:27.058489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:27.058495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:27.058501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:27.058506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:27.058512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:27.058517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:27.058524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:27.058529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:27.058534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:27.058538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:27.058542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:27.058546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:27.058551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:27.058555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:27.058560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:27.058565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:27.058570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:27.058574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:27.058579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:27.058626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:27.065802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:27.066599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:27.066614Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:27.066616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:27.066621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:27.066634Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3311 [2:7559602978954355801:13078]
2025-10-10T14:40:27.066650Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:27.066678Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:27.066686Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:27.066690Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:27.066693Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:27.066719Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:27.066733Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:27.066746Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:27.066822Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:27.066828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:27.066831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:27.066834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:27.066913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:27.066921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:27.066935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:27.066953Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:27.066976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:27.067195Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3311
2025-10-10T14:40:27.067245Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3311
2025-10-10T14:40:27.067005Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602978954355796:13078]
2025-10-10T14:40:27.067014Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602978954355796:13078]
2025-10-10T14:40:27.067015Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602978954355796:13078]
2025-10-10T14:40:27.067031Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:27.067048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602979736609475:2438], now have 1 active actors on pipe
2025-10-10T14:40:27.067052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602979736609622:5526], now have 1 active actors on pipe
2025-10-10T14:40:27.067062Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:27.067077Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:27.067082Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:27.067108Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:27.067112Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:27.067115Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:27.067130Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602978954355796:13078]
2025-10-10T14:40:27.067134Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:27.067136Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:27.069769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:27.069789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:27.069835Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|57dd4a99-70258423-3d37ed4c-3a81017c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:27.069856Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:27.069866Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:27.069874Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:27.069891Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:27.069911Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:27.069938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:27.071586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:27.071626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:27.071662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:27.072111Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3312 partition: 0 MaxSeqNo: 40 sessionId: src_id|57dd4a99-70258423-3d37ed4c-3a81017c_0
2025-10-10T14:40:27.072558Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f7d1419-e04a9645-d2668181-e4c4c305_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|57dd4a99-70258423-3d37ed4c-3a81017c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:27.075509Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|57dd4a99-70258423-3d37ed4c-3a81017c_0] Write session: try to update token
2025-10-10T14:40:27.075531Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|57dd4a99-70258423-3d37ed4c-3a81017c_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:27.089949Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:27.089972Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:27.089976Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:27.089979Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:27.089990Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602978954355796:13078]
2025-10-10T14:40:27.089995Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602978954355796:13078]
2025-10-10T14:40:27.090000Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602978954355796:13078]
2025-10-10T14:40:27.090051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:27.090056Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:27.090060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:27.090063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:27.090063Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:27.090068Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:27.090214Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:27.094403Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3312 sessionId: src_id|57dd4a99-70258423-3d37ed4c-3a81017c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:27.097273Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:27.136706Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602979736609646:5396]
2025-10-10T14:40:27.137103Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 pipe creation result: OK TabletId: 72075186224037892 Generation: 3311, pipe: [1:7559602979736609646:5396]
2025-10-10T14:40:27.213861Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:27.214254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:27.214273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:27.214325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602979736609646:5396], now have 1 active actors on pipe
2025-10-10T14:40:27.214631Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:27.215069Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:27.215237Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 10 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602979736609646:5396]
2025-10-10T14:40:27.215277Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:40:27.215285Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:40:27.215357Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3312 reason: error at write: Disconnected sessionId: src_id|57dd4a99-70258423-3d37ed4c-3a81017c_0
2025-10-10T14:40:27.215612Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3312 sessionId: src_id|57dd4a99-70258423-3d37ed4c-3a81017c_0 is DEAD
2025-10-10T14:40:27.215988Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|57dd4a99-70258423-3d37ed4c-3a81017c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:40:27.215995Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|57dd4a99-70258423-3d37ed4c-3a81017c_0] Write session will restart in 0.008867s
2025-10-10T14:40:27.216022Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|57dd4a99-70258423-3d37ed4c-3a81017c_0] Write session: Do CDS request
2025-10-10T14:40:27.216032Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|57dd4a99-70258423-3d37ed4c-3a81017c_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:27.226930Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|57dd4a99-70258423-3d37ed4c-3a81017c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:27.227023Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:27.227037Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3313
2025-10-10T14:40:27.227179Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3313 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:27.227230Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3313 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:27.227243Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3313 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:27.227248Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:27.227693Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3313 sessionId:  describe result for acl check
2025-10-10T14:40:27.227723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:27.227728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:27.227730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:27.227734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602979736609737:5553] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:27.228185Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602979736609737:5553] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:27.231233Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602979736609737:5553] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:27.234231Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602979736609737:5553] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:27.234249Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602979736609737:5553] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:27.234252Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602979736609737:5553] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:27.234262Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3313 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:27.237425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:27.241840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:27.242281Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:27.242287Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:27.242302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:27.242370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:27.242411Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602978954355995:13093]
2025-10-10T14:40:27.243090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:27.243428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:27.243472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:27.243790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:27.243846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:27.243847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:27.243849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:27.243851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:27.243852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:27.243853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:27.243855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:27.243857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:27.243858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:27.243859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:27.243861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:27.243862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:27.243863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:27.243869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:27.243883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:27.243888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:27.243892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:27.243897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:27.243902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:27.243906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:27.243910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:27.243914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:27.243919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:27.243923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:27.243927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:27.243931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:27.243939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:27.243948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:27.243955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:27.243960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:27.243966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:27.243972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:27.243977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:27.243982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:27.243987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:27.243993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:27.243998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:27.244004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:27.244009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:27.244015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:27.244020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:27.244026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:27.244031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:27.244037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:27.244042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:27.244047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:27.244052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:27.244057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:27.244063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:27.244068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:27.244077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:27.244083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:27.244134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:27.246834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:27.247319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:27.247334Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:27.247336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:27.247341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:27.247348Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3312 [2:7559602978954355995:13093]
2025-10-10T14:40:27.247364Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:27.247383Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:27.247387Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:27.247391Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:27.247394Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:27.247413Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:27.247420Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:27.247429Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:27.247495Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:27.247504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:27.247506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:27.247508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:27.247597Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:27.247606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:27.247618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:27.247630Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:27.247651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:27.247679Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602978954355989:13093]
2025-10-10T14:40:27.247686Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602978954355989:13093]
2025-10-10T14:40:27.247688Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602978954355989:13093]
2025-10-10T14:40:27.247702Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:27.247716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602979736609806:5553], now have 1 active actors on pipe
2025-10-10T14:40:27.247721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602979736609659:2438], now have 1 active actors on pipe
2025-10-10T14:40:27.247729Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:27.247728Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:27.247732Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:27.247734Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:27.247745Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:27.247749Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:27.247776Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602978954355989:13093]
2025-10-10T14:40:27.247784Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:27.247797Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:27.247935Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3312
2025-10-10T14:40:27.248011Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3312
2025-10-10T14:40:27.248177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:27.248188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:27.248222Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f5d6c574-bdda11d5-b08e1855-40a72c5a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:27.248230Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:27.248234Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:27.248237Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:27.248250Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:27.248261Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:27.248276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:27.248596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:27.248604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:27.248618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:27.248734Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3313 partition: 0 MaxSeqNo: 40 sessionId: src_id|f5d6c574-bdda11d5-b08e1855-40a72c5a_0
2025-10-10T14:40:27.249180Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|57dd4a99-70258423-3d37ed4c-3a81017c_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|f5d6c574-bdda11d5-b08e1855-40a72c5a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:27.252058Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f5d6c574-bdda11d5-b08e1855-40a72c5a_0] Write session: try to update token
2025-10-10T14:40:27.252081Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f5d6c574-bdda11d5-b08e1855-40a72c5a_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:27.276280Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3313 sessionId: src_id|f5d6c574-bdda11d5-b08e1855-40a72c5a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:27.276380Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:27.276400Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:27.276403Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:27.276406Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:27.276416Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602978954355989:13093]
2025-10-10T14:40:27.276420Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602978954355989:13093]
2025-10-10T14:40:27.276423Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602978954355989:13093]
2025-10-10T14:40:27.276477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:27.276479Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:27.276485Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:27.276486Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:27.276488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:27.276491Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:27.276647Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:27.279096Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:27.315441Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602979736609819:5396]
2025-10-10T14:40:27.317655Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 pipe creation result: OK TabletId: 72075186224037892 Generation: 3312, pipe: [1:7559602979736609819:5396]
2025-10-10T14:40:27.394175Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:27.394535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:27.394547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:27.394593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602979736609819:5396], now have 1 active actors on pipe
2025-10-10T14:40:27.394832Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:27.395438Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5d6c574-bdda11d5-b08e1855-40a72c5a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:40:27.395458Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5d6c574-bdda11d5-b08e1855-40a72c5a_0] Write session will restart in 0.009191s
2025-10-10T14:40:27.395485Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5d6c574-bdda11d5-b08e1855-40a72c5a_0] Write session: Do CDS request
2025-10-10T14:40:27.395491Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5d6c574-bdda11d5-b08e1855-40a72c5a_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:27.394959Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:40:27.394981Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:40:27.395054Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3313 reason: error at write: Disconnected sessionId: src_id|f5d6c574-bdda11d5-b08e1855-40a72c5a_0
2025-10-10T14:40:27.395278Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3313 sessionId: src_id|f5d6c574-bdda11d5-b08e1855-40a72c5a_0 is DEAD
2025-10-10T14:40:27.395374Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:27.395424Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 11 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602979736609819:5396]
2025-10-10T14:40:27.405874Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f5d6c574-bdda11d5-b08e1855-40a72c5a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:27.409214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:27.409498Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:27.409515Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3314
2025-10-10T14:40:27.409726Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3314 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:27.409779Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3314 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:27.409790Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3314 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:27.409795Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:27.410181Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3314 sessionId:  describe result for acl check
2025-10-10T14:40:27.410209Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:27.410214Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:27.410215Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:27.410220Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602979736609942:5550] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:27.410722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602979736609942:5550] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:27.411733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:27.412160Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:27.412174Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:27.412190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:27.412280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:27.412324Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602978954356153:13096]
2025-10-10T14:40:27.412935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:27.413327Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602979736609942:5550] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:27.413380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:27.413433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:27.413772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:27.413840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:27.413841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:27.413842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:27.413844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:27.413845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:27.413847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:27.413848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:27.413849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:27.413850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:27.413852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:27.413853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:27.413854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:27.413855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:27.413861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:27.413876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:27.413880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:27.413884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:27.413888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:27.413893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:27.413896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:27.413901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:27.413905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:27.413910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:27.413914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:27.413918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:27.413922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:27.413931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:27.413939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:27.413947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:27.413952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:27.413957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:27.413962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:27.413967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:27.413973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:27.413978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:27.413984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:27.413988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:27.413994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:27.413999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:27.414004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:27.414008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:27.414014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:27.414018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:27.414024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:27.414029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:27.414035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:27.414040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:27.414045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:27.414050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:27.414056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:27.414060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:27.414065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:27.414105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:27.416608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602979736609942:5550] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:27.416623Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602979736609942:5550] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:27.416628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602979736609942:5550] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:27.416637Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3314 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:27.416693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:27.417156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:27.417171Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:27.417173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:27.417177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:27.417183Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3313 [2:7559602978954356153:13096]
2025-10-10T14:40:27.417199Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:27.417220Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:27.417228Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:27.417232Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:27.417235Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:27.417253Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:27.417265Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:27.417274Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:27.417360Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:27.417371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:27.417373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:27.417378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:27.417454Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:27.417463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:27.417475Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:27.417488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:27.417507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:27.417529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602979736609975:5550], now have 1 active actors on pipe
2025-10-10T14:40:27.417533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602979736609821:2438], now have 1 active actors on pipe
2025-10-10T14:40:27.417541Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602978954356147:13096]
2025-10-10T14:40:27.417543Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602978954356147:13096]
2025-10-10T14:40:27.417546Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602978954356147:13096]
2025-10-10T14:40:27.417561Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:27.417575Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:27.417597Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:27.417567Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3313
2025-10-10T14:40:27.417606Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:27.417596Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3313
2025-10-10T14:40:27.417631Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602978954356147:13096]
2025-10-10T14:40:27.417631Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:27.417635Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:27.417638Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:27.417639Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:27.417645Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:27.417785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:27.417805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:27.417841Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a032fe4b-aca93622-4c34c332-638eeca5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:27.417862Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:27.417866Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:27.417869Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:27.417882Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:27.417894Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:27.417912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:27.418230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:27.418243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:27.418264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:27.418370Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3314 partition: 0 MaxSeqNo: 40 sessionId: src_id|a032fe4b-aca93622-4c34c332-638eeca5_0
2025-10-10T14:40:27.418776Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5d6c574-bdda11d5-b08e1855-40a72c5a_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|a032fe4b-aca93622-4c34c332-638eeca5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:27.421659Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a032fe4b-aca93622-4c34c332-638eeca5_0] Write session: try to update token
2025-10-10T14:40:27.421679Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a032fe4b-aca93622-4c34c332-638eeca5_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:27.438343Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:27.438366Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:27.438370Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:27.438372Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:27.438459Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602978954356147:13096]
2025-10-10T14:40:27.438464Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602978954356147:13096]
2025-10-10T14:40:27.438468Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602978954356147:13096]
2025-10-10T14:40:27.438509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:27.438516Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:27.438523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:27.438523Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:27.438524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:27.438528Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:27.438668Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:27.441031Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3314 sessionId: src_id|a032fe4b-aca93622-4c34c332-638eeca5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:27.444199Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:27.495601Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602979736609982:5396]
2025-10-10T14:40:27.496045Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 pipe creation result: OK TabletId: 72075186224037892 Generation: 3313, pipe: [1:7559602979736609982:5396]
2025-10-10T14:40:27.555810Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:27.556243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:27.556269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:27.556327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602979736609982:5396], now have 1 active actors on pipe
2025-10-10T14:40:27.556581Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:27.557068Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:27.557097Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 12 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602979736609982:5396]
2025-10-10T14:40:27.557118Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:40:27.557211Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3314 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a032fe4b-aca93622-4c34c332-638eeca5_0
2025-10-10T14:40:27.557431Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3314 sessionId: src_id|a032fe4b-aca93622-4c34c332-638eeca5_0 is DEAD
2025-10-10T14:40:27.561761Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a032fe4b-aca93622-4c34c332-638eeca5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:40:27.561774Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a032fe4b-aca93622-4c34c332-638eeca5_0] Write session will restart in 0.006855s
2025-10-10T14:40:27.561803Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a032fe4b-aca93622-4c34c332-638eeca5_0] Write session: Do CDS request
2025-10-10T14:40:27.561809Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a032fe4b-aca93622-4c34c332-638eeca5_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:27.569964Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a032fe4b-aca93622-4c34c332-638eeca5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:27.570169Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:27.570185Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3315
2025-10-10T14:40:27.573972Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3315 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:27.574033Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3315 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:27.574039Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3315 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:27.574045Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:27.574582Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3315 sessionId:  describe result for acl check
2025-10-10T14:40:27.574619Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:27.574625Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:27.574627Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:27.574633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602979736610088:5560] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:27.575204Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602979736610088:5560] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:27.577501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:27.577944Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602979736610088:5560] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:27.580075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:27.580498Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:27.580515Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:27.580530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:27.580600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:27.580648Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602978954356310:13098]
2025-10-10T14:40:27.580805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602979736610088:5560] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:27.580821Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602979736610088:5560] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:27.580825Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602979736610088:5560] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:27.580842Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3315 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:27.581319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:27.581685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:27.581745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:27.582095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:27.582160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:27.582169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:27.582171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:27.582172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:27.582174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:27.582175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:27.582177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:27.582178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:27.582180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:27.582181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:27.582183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:27.582184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:27.582185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:27.582192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:27.582207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:27.582212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:27.582216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:27.582221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:27.582226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:27.582230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:27.582235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:27.582240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:27.582245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:27.582250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:27.582255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:27.582259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:27.582267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:27.582277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:27.582285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:27.582296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:27.582302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:27.582312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:27.582318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:27.582324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:27.582330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:27.582342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:27.582349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:27.582359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:27.582367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:27.582373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:27.582378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:27.582384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:27.582389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:27.582394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:27.582403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:27.582408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:27.582413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:27.582423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:27.582428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:27.582438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:27.582443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:27.582448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:27.582501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:27.586554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:27.587076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:27.587093Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:27.587096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:27.587100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:27.587108Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3314 [2:7559602978954356310:13098]
2025-10-10T14:40:27.587125Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:27.587151Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:27.587162Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:27.587166Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:27.587169Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:27.587189Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:27.587204Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:27.587214Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:27.587292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:27.587295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:27.587297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:27.587300Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:27.587378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:27.587388Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:27.587402Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:27.587421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:27.587444Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:27.587471Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602978954356305:13098]
2025-10-10T14:40:27.587479Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602978954356305:13098]
2025-10-10T14:40:27.587481Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602978954356305:13098]
2025-10-10T14:40:27.587497Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:27.587513Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:27.587534Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:27.587543Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:27.587557Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:27.587574Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:27.587576Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:27.587582Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602978954356305:13098]
2025-10-10T14:40:27.587585Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:27.587651Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:27.587715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602979736610134:5560], now have 1 active actors on pipe
2025-10-10T14:40:27.587730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602979736609984:2438], now have 1 active actors on pipe
2025-10-10T14:40:27.587902Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3314
2025-10-10T14:40:27.587935Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3314
2025-10-10T14:40:27.588051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:27.588064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:27.588102Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|74e449fc-9d4ce014-9a355b3a-31d156f7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:27.588128Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:27.588134Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:27.588137Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:27.588152Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:27.588166Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:27.588186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:27.588554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:27.588566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:27.588584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:27.588672Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3315 partition: 0 MaxSeqNo: 40 sessionId: src_id|74e449fc-9d4ce014-9a355b3a-31d156f7_0
2025-10-10T14:40:27.589139Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a032fe4b-aca93622-4c34c332-638eeca5_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|74e449fc-9d4ce014-9a355b3a-31d156f7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:27.592188Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|74e449fc-9d4ce014-9a355b3a-31d156f7_0] Write session: try to update token
2025-10-10T14:40:27.592208Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|74e449fc-9d4ce014-9a355b3a-31d156f7_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:27.611545Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:40:27.611571Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:27.611584Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602978954356305:13098]
2025-10-10T14:40:27.611641Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:40:27.611902Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:40:27.612060Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:27.612028Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3315 sessionId: src_id|74e449fc-9d4ce014-9a355b3a-31d156f7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:27.612228Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:27.612380Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:27.612591Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:40:27.612640Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:40:27.612776Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:40:27.614997Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:27.615239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:27.615268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:27.615307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:40:27.615503Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:40:27.637679Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:27.637704Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:27.637709Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:27.637715Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:27.637727Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602978954356305:13098]
2025-10-10T14:40:27.637731Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602978954356305:13098]
2025-10-10T14:40:27.637734Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602978954356305:13098]
2025-10-10T14:40:27.637792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:27.637801Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:27.637807Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:27.637808Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:27.637813Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:27.637826Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:27.637974Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:27.657679Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602979736610145:5396]
2025-10-10T14:40:27.658005Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 pipe creation result: OK TabletId: 72075186224037892 Generation: 3314, pipe: [1:7559602979736610145:5396]
2025-10-10T14:40:27.764464Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:27.774095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:27.774129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:27.774333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:27.774443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:27.774517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:27.774595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:27.774933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:27.774949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:27.775038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:27.775117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:27.775200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:27.775595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:27.775653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:27.775663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:27.775743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:27.775815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:27.775888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:27.775966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:27.776017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:27.776025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:27.776102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:27.776193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:27.776271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:27.776344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:27.776395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:27.776403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:27.776483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:27.776559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:27.776639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:27.776720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:27.776773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:27.776782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:27.776858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:27.776929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:27.777000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:27.777076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:27.777135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:27.777144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:27.777223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:27.777289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:27.777481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:27.777564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:27.777619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:27.777627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:27.777709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:27.777785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:27.777861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:27.777936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:27.777989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:27.778001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:27.778078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:27.778141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:27.778208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:27.778274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:27.778332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:27.778346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:27.778450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:27.778516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:27.778587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:27.778660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:27.778706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:27.778715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:27.778792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602979736610145:5396], now have 1 active actors on pipe
2025-10-10T14:40:27.779038Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 13 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602979736610145:5396]
2025-10-10T14:40:27.779070Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:40:27.779074Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:40:27.779086Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:27.779108Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3315 reason: error at write: Disconnected sessionId: src_id|74e449fc-9d4ce014-9a355b3a-31d156f7_0
2025-10-10T14:40:27.779500Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:27.779413Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3315 sessionId: src_id|74e449fc-9d4ce014-9a355b3a-31d156f7_0 is DEAD
2025-10-10T14:40:27.781443Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|74e449fc-9d4ce014-9a355b3a-31d156f7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:40:27.781462Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|74e449fc-9d4ce014-9a355b3a-31d156f7_0] Write session will restart in 0.005481s
2025-10-10T14:40:27.781491Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|74e449fc-9d4ce014-9a355b3a-31d156f7_0] Write session: Do CDS request
2025-10-10T14:40:27.781497Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|74e449fc-9d4ce014-9a355b3a-31d156f7_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:27.788044Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|74e449fc-9d4ce014-9a355b3a-31d156f7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:27.788476Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:27.788493Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3316
2025-10-10T14:40:27.788692Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3316 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:27.788756Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3316 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:27.788780Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3316 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:27.788790Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:27.789761Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3316 sessionId:  describe result for acl check
2025-10-10T14:40:27.789804Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:27.789810Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:27.789812Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:27.789820Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602979736610157:5573] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:27.790412Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602979736610157:5573] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:27.793453Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602979736610157:5573] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:27.802123Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602979736610157:5573] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:27.802141Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602979736610157:5573] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:27.802145Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602979736610157:5573] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:27.802155Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3316 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:27.814561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:27.817484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:27.817912Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:27.817941Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:27.817964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:27.818082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:27.818139Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602978954356469:13100]
2025-10-10T14:40:27.818872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:27.819288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:27.819357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:27.819797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:27.819898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:27.819905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:27.819906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:27.819908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:27.819909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:27.819911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:27.819912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:27.819914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:27.819915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:27.819917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:27.819918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:27.819920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:27.819922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:27.819929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:27.819943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:27.819947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:27.819951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:27.819956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:27.819960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:27.819965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:27.819968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:27.819972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:27.819976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:27.819980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:27.819984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:27.819989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:27.819997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:27.820007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:27.820014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:27.820036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:27.820046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:27.820052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:27.820056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:27.820063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:27.820074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:27.820079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:27.820089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:27.820094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:27.820104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:27.820125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:27.820129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:27.820135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:27.820140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:27.820152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:27.820156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:27.820168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:27.820178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:27.820183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:27.820188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:27.820194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:27.820204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:27.820209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:27.820257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:27.823026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:27.823560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:27.823572Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:27.823574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:27.823576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:27.823582Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3315 [2:7559602978954356469:13100]
2025-10-10T14:40:27.823593Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:27.823617Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:27.823620Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:27.823622Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:27.823624Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:27.823638Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:27.823648Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:27.823654Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:27.823705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:27.823711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:27.823713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:27.823715Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:27.823774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:27.823784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:27.823794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:27.823805Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:27.823820Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:27.823842Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602978954356463:13100]
2025-10-10T14:40:27.823847Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602978954356463:13100]
2025-10-10T14:40:27.823850Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602978954356463:13100]
2025-10-10T14:40:27.823864Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:27.823878Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:27.823882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602979736610193:5573], now have 1 active actors on pipe
2025-10-10T14:40:27.823886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602979736610148:2438], now have 1 active actors on pipe
2025-10-10T14:40:27.823890Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:27.823892Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:27.823895Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:27.823911Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:27.823915Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:27.823937Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3315
2025-10-10T14:40:27.823949Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3315
2025-10-10T14:40:27.823944Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602978954356463:13100]
2025-10-10T14:40:27.823957Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:27.823961Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:27.823994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:27.824000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:27.824047Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4e86c075-629b9e06-c9b223bc-d3be1107_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:27.824059Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:27.824064Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:27.824067Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:27.824079Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:27.824094Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:27.824124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:27.824303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:27.824312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:27.824330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:27.824430Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3316 partition: 0 MaxSeqNo: 40 sessionId: src_id|4e86c075-629b9e06-c9b223bc-d3be1107_0
2025-10-10T14:40:27.824874Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|74e449fc-9d4ce014-9a355b3a-31d156f7_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|4e86c075-629b9e06-c9b223bc-d3be1107_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:27.828155Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4e86c075-629b9e06-c9b223bc-d3be1107_0] Write session: try to update token
2025-10-10T14:40:27.828180Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4e86c075-629b9e06-c9b223bc-d3be1107_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:27.845511Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:27.845533Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:27.845537Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:27.845539Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:27.845552Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602978954356463:13100]
2025-10-10T14:40:27.845557Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602978954356463:13100]
2025-10-10T14:40:27.845561Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602978954356463:13100]
2025-10-10T14:40:27.845617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:27.845620Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:27.845628Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:27.845630Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:27.845633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:27.845634Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:27.845793Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:27.849395Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3316 sessionId: src_id|4e86c075-629b9e06-c9b223bc-d3be1107_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:27.852282Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:27.879127Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602979736610313:5396]
2025-10-10T14:40:27.879435Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 pipe creation result: OK TabletId: 72075186224037892 Generation: 3315, pipe: [1:7559602979736610313:5396]
2025-10-10T14:40:27.963089Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:27.963405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:27.963421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:27.963470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602979736610313:5396], now have 1 active actors on pipe
2025-10-10T14:40:27.963697Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:27.964095Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:40:27.964171Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:40:27.964247Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3316 reason: error at write: Disconnected sessionId: src_id|4e86c075-629b9e06-c9b223bc-d3be1107_0
2025-10-10T14:40:27.964475Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3316 sessionId: src_id|4e86c075-629b9e06-c9b223bc-d3be1107_0 is DEAD
2025-10-10T14:40:27.964594Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 14 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602979736610313:5396]
2025-10-10T14:40:27.964641Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e86c075-629b9e06-c9b223bc-d3be1107_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:40:27.964653Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e86c075-629b9e06-c9b223bc-d3be1107_0] Write session will restart in 0.009210s
2025-10-10T14:40:27.964629Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:27.964681Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e86c075-629b9e06-c9b223bc-d3be1107_0] Write session: Do CDS request
2025-10-10T14:40:27.964691Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e86c075-629b9e06-c9b223bc-d3be1107_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:27.974960Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4e86c075-629b9e06-c9b223bc-d3be1107_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:27.975136Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:27.975154Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3317
2025-10-10T14:40:27.975592Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3317 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:27.975644Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3317 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:27.975650Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3317 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:27.975655Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:27.976708Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3317 sessionId:  describe result for acl check
2025-10-10T14:40:27.976748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:27.976749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:27.976751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:27.976758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602979736610416:5593] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:27.977366Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602979736610416:5593] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:27.980239Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602979736610416:5593] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:27.981143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:27.983618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:27.983907Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:27.983920Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:27.983937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:27.984006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:27.984047Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602978954356639:13103]
2025-10-10T14:40:27.984587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:27.984894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:27.984956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:27.985282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:27.985372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:27.985378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:27.985380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:27.985381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:27.985382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:27.985384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:27.985385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:27.985386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:27.985388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:27.985389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:27.985391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:27.985393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:27.985394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:27.985400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:27.985414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:27.985418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:27.985423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:27.985426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:27.985430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:27.985434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:27.985437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:27.985442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:27.985446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:27.985450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:27.985454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:27.985458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:27.985467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:27.985476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:27.985482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:27.985487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:27.985492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:27.985497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:27.985502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:27.985507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:27.985513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:27.985518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:27.985523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:27.985528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:27.985533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:27.985538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:27.985542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:27.985545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:27.985548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:27.985551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:27.985554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:27.985559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:27.985563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:27.985568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:27.985572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:27.985576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:27.985581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:27.985585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:27.985438Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602979736610416:5593] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:27.985623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:27.985454Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602979736610416:5593] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:27.985458Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602979736610416:5593] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:27.985468Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3317 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:27.988266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:27.989050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:27.989065Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:27.989068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:27.989072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:27.989079Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3316 [2:7559602978954356639:13103]
2025-10-10T14:40:27.989096Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:27.989118Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:27.989126Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:27.989130Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:27.989133Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:27.989154Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:27.989161Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:27.989169Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:27.989234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:27.989241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:27.989244Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:27.989247Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:27.989321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:27.989342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:27.989356Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:27.989367Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:27.989389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:27.989417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602979736610485:5593], now have 1 active actors on pipe
2025-10-10T14:40:27.989425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602979736610335:2438], now have 1 active actors on pipe
2025-10-10T14:40:27.989433Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602978954356634:13103]
2025-10-10T14:40:27.989435Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602978954356634:13103]
2025-10-10T14:40:27.989437Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602978954356634:13103]
2025-10-10T14:40:27.989451Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:27.989471Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:27.989491Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:27.989500Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:27.989505Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:27.989509Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:27.989511Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:27.989484Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3316
2025-10-10T14:40:27.989536Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602978954356634:13103]
2025-10-10T14:40:27.989545Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:27.989517Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3316
2025-10-10T14:40:27.989554Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:27.989573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:27.989583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:27.989628Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1e94a63a-86927d7a-1d95bed3-5479d905_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:27.989641Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:27.989649Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:27.989652Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:27.989663Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:27.989678Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:27.989701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:27.989961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:27.989972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:27.989998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:27.990166Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3317 partition: 0 MaxSeqNo: 40 sessionId: src_id|1e94a63a-86927d7a-1d95bed3-5479d905_0
2025-10-10T14:40:27.990555Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e86c075-629b9e06-c9b223bc-d3be1107_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|1e94a63a-86927d7a-1d95bed3-5479d905_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:27.993211Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1e94a63a-86927d7a-1d95bed3-5479d905_0] Write session: try to update token
2025-10-10T14:40:27.993229Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1e94a63a-86927d7a-1d95bed3-5479d905_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:28.011584Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3317 sessionId: src_id|1e94a63a-86927d7a-1d95bed3-5479d905_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:28.010356Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:28.010383Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:28.010386Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:28.010388Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:28.010400Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602978954356634:13103]
2025-10-10T14:40:28.010405Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602978954356634:13103]
2025-10-10T14:40:28.010410Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602978954356634:13103]
2025-10-10T14:40:28.010468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:28.010477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:28.010476Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:28.010480Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:28.010484Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:28.010489Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:28.010640Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:28.014474Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:28.065029Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602984031577792:5396]
2025-10-10T14:40:28.065448Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 pipe creation result: OK TabletId: 72075186224037892 Generation: 3316, pipe: [1:7559602984031577792:5396]
2025-10-10T14:40:28.127677Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:28.127985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:28.128001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:28.128048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602984031577792:5396], now have 1 active actors on pipe
2025-10-10T14:40:28.128325Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:28.128339Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:40:28.128354Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:40:28.128419Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3317 reason: error at write: Disconnected sessionId: src_id|1e94a63a-86927d7a-1d95bed3-5479d905_0
2025-10-10T14:40:28.128657Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3317 sessionId: src_id|1e94a63a-86927d7a-1d95bed3-5479d905_0 is DEAD
2025-10-10T14:40:28.128792Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:28.128838Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 15 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602984031577792:5396]
2025-10-10T14:40:28.129566Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e94a63a-86927d7a-1d95bed3-5479d905_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:40:28.129576Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e94a63a-86927d7a-1d95bed3-5479d905_0] Write session will restart in 0.005057s
2025-10-10T14:40:28.129602Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e94a63a-86927d7a-1d95bed3-5479d905_0] Write session: Do CDS request
2025-10-10T14:40:28.129612Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e94a63a-86927d7a-1d95bed3-5479d905_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:28.135927Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1e94a63a-86927d7a-1d95bed3-5479d905_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:28.137666Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:28.137680Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3318
2025-10-10T14:40:28.138810Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3318 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:28.138862Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3318 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:28.138869Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3318 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:28.138872Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:28.139414Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3318 sessionId:  describe result for acl check
2025-10-10T14:40:28.139452Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:28.139459Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:28.139461Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:28.139468Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602984031577851:5597] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:28.140059Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602984031577851:5597] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:28.142374Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602984031577851:5597] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:28.145367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:28.145483Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602984031577851:5597] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:28.145499Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602984031577851:5597] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:28.145519Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602984031577851:5597] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:28.145534Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3318 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:28.147948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:28.148231Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:28.148245Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:28.148259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:28.148327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:28.148377Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602983249324096:13105]
2025-10-10T14:40:28.149065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:28.149413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:28.149467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:28.149807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:28.149901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:28.149925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:28.149929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:28.149930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:28.149931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:28.149932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:28.149934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:28.149935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:28.149937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:28.149938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:28.149939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:28.149940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:28.149942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:28.149949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:28.149962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:28.149966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:28.149970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:28.149975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:28.149979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:28.149982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:28.149986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:28.149990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:28.149995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:28.149999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:28.150004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:28.150008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:28.150017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:28.150026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:28.150033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:28.150039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:28.150045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:28.150051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:28.150057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:28.150062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:28.150067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:28.150073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:28.150078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:28.150084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:28.150092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:28.150098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:28.150109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:28.150115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:28.150120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:28.150127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:28.150131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:28.150137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:28.150147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:28.150152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:28.150157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:28.150163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:28.150168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:28.150178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:28.150221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:28.152871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:28.153508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:28.153525Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:28.153528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:28.153532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:28.153539Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3317 [2:7559602983249324096:13105]
2025-10-10T14:40:28.153553Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:28.153573Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:28.153576Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:28.153580Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:28.153582Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:28.153618Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:28.153631Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:28.153645Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:28.153713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:28.153721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:28.153723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:28.153726Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:28.153794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:28.153806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:28.153820Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:28.153833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:28.153853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:28.153877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602984031577955:5597], now have 1 active actors on pipe
2025-10-10T14:40:28.153887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602984031577798:2438], now have 1 active actors on pipe
2025-10-10T14:40:28.153896Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602983249324090:13105]
2025-10-10T14:40:28.153898Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602983249324090:13105]
2025-10-10T14:40:28.153899Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602983249324090:13105]
2025-10-10T14:40:28.153914Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:28.153928Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:28.153933Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:28.153943Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:28.153946Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:28.153950Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:28.153953Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:28.153933Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3317
2025-10-10T14:40:28.153946Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3317
2025-10-10T14:40:28.153997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:28.154008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:28.154023Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602983249324090:13105]
2025-10-10T14:40:28.154035Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:28.154042Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:28.154073Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|abea9ebc-e45ff338-fb881d16-5cc0730a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:28.154086Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:28.154090Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:28.154095Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:28.154109Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:28.154126Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:28.154154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:28.154297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:28.154308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:28.154323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:28.154417Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3318 partition: 0 MaxSeqNo: 40 sessionId: src_id|abea9ebc-e45ff338-fb881d16-5cc0730a_0
2025-10-10T14:40:28.154841Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e94a63a-86927d7a-1d95bed3-5479d905_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|abea9ebc-e45ff338-fb881d16-5cc0730a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:28.157723Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|abea9ebc-e45ff338-fb881d16-5cc0730a_0] Write session: try to update token
2025-10-10T14:40:28.157744Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|abea9ebc-e45ff338-fb881d16-5cc0730a_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:28.172932Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3318 sessionId: src_id|abea9ebc-e45ff338-fb881d16-5cc0730a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:28.174265Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:28.174286Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:28.174290Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:28.174292Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:28.174303Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602983249324090:13105]
2025-10-10T14:40:28.174308Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602983249324090:13105]
2025-10-10T14:40:28.174312Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602983249324090:13105]
2025-10-10T14:40:28.174355Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:28.174361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:28.174361Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:28.174365Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:28.174370Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:28.174372Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:28.174522Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:28.175897Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:28.229398Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602984031577982:5396]
2025-10-10T14:40:28.229870Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 pipe creation result: OK TabletId: 72075186224037892 Generation: 3317, pipe: [1:7559602984031577982:5396]
2025-10-10T14:40:28.285475Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:28.285858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:28.285882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:28.285947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602984031577982:5396], now have 1 active actors on pipe
2025-10-10T14:40:28.286170Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:28.286210Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 16 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602984031577982:5396]
2025-10-10T14:40:28.286231Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:40:28.286239Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:40:28.286300Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3318 reason: error at write: Disconnected sessionId: src_id|abea9ebc-e45ff338-fb881d16-5cc0730a_0
2025-10-10T14:40:28.286532Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3318 sessionId: src_id|abea9ebc-e45ff338-fb881d16-5cc0730a_0 is DEAD
2025-10-10T14:40:28.286179Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:28.289438Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|abea9ebc-e45ff338-fb881d16-5cc0730a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:40:28.289452Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|abea9ebc-e45ff338-fb881d16-5cc0730a_0] Write session will restart in 0.006045s
2025-10-10T14:40:28.289477Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|abea9ebc-e45ff338-fb881d16-5cc0730a_0] Write session: Do CDS request
2025-10-10T14:40:28.289483Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|abea9ebc-e45ff338-fb881d16-5cc0730a_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:28.296935Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|abea9ebc-e45ff338-fb881d16-5cc0730a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:28.297112Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:28.297128Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3319
2025-10-10T14:40:28.297279Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3319 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:28.297320Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3319 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:28.297326Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3319 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:28.297346Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:28.297905Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3319 sessionId:  describe result for acl check
2025-10-10T14:40:28.297939Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:28.297941Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:28.297943Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:28.297950Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602984031578046:5633] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:28.298568Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602984031578046:5633] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:28.303581Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602984031578046:5633] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:28.306031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:28.308743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:28.308963Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602984031578046:5633] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:28.308980Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602984031578046:5633] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:28.308984Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602984031578046:5633] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:28.308993Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3319 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:28.309254Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:28.309269Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:28.309287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:28.309406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:28.309457Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602983249324296:13120]
2025-10-10T14:40:28.310182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:28.310540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:28.310598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:28.310999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:28.311081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:28.311091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:28.311093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:28.311094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:28.311096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:28.311098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:28.311099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:28.311101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:28.311102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:28.311103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:28.311105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:28.311106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:28.311108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:28.311115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:28.311129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:28.311133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:28.311138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:28.311144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:28.311148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:28.311154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:28.311158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:28.311162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:28.311167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:28.311173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:28.311177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:28.311182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:28.311191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:28.311201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:28.311208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:28.311214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:28.311219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:28.311226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:28.311238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:28.311245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:28.311251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:28.311259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:28.311268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:28.311275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:28.311284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:28.311294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:28.311299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:28.311310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:28.311315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:28.311321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:28.311330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:28.311337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:28.311365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:28.311375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:28.311381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:28.311391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:28.311395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:28.311402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:28.311448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:28.314154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:28.314535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:28.314561Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:28.314564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:28.314568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:28.314576Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3318 [2:7559602983249324296:13120]
2025-10-10T14:40:28.314591Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:28.314611Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:28.314621Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:28.314625Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:28.314628Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:28.314666Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:28.314681Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:28.314689Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:28.314865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:28.314878Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:28.314880Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:28.314883Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:28.314962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:28.314972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:28.314984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:28.315001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:28.315023Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:28.315054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602984031577993:2438], now have 1 active actors on pipe
2025-10-10T14:40:28.315064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602984031578147:5633], now have 1 active actors on pipe
2025-10-10T14:40:28.315072Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602983249324290:13120]
2025-10-10T14:40:28.315077Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602983249324290:13120]
2025-10-10T14:40:28.315081Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602983249324290:13120]
2025-10-10T14:40:28.315098Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:28.315118Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:28.315126Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:28.315130Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:28.315133Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:28.315141Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:28.315148Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:28.315134Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3318
2025-10-10T14:40:28.315181Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602983249324290:13120]
2025-10-10T14:40:28.315136Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3318
2025-10-10T14:40:28.315190Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:28.315192Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:28.315209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:28.315222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:28.315287Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b49a113c-a5d665b6-35065cfb-f432c447_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:28.315303Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:28.315307Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:28.315310Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:28.315322Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:28.315334Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:28.315360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:28.315530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:28.315540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:28.315559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:28.315714Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3319 partition: 0 MaxSeqNo: 40 sessionId: src_id|b49a113c-a5d665b6-35065cfb-f432c447_0
2025-10-10T14:40:28.316134Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|abea9ebc-e45ff338-fb881d16-5cc0730a_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|b49a113c-a5d665b6-35065cfb-f432c447_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:28.319200Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b49a113c-a5d665b6-35065cfb-f432c447_0] Write session: try to update token
2025-10-10T14:40:28.319222Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b49a113c-a5d665b6-35065cfb-f432c447_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:28.335424Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:28.335443Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:28.335448Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:28.335450Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:28.335466Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602983249324290:13120]
2025-10-10T14:40:28.335471Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602983249324290:13120]
2025-10-10T14:40:28.335476Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602983249324290:13120]
2025-10-10T14:40:28.335503Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:28.335510Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:28.335523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:28.335526Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:28.335531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:28.335533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:28.335690Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:28.343531Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3319 sessionId: src_id|b49a113c-a5d665b6-35065cfb-f432c447_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:28.346498Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:28.386522Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602984031578159:5396]
2025-10-10T14:40:28.386868Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 pipe creation result: OK TabletId: 72075186224037892 Generation: 3318, pipe: [1:7559602984031578159:5396]
2025-10-10T14:40:28.465325Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:28.465764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:28.465785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:28.465812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602984031578159:5396], now have 1 active actors on pipe
2025-10-10T14:40:28.466050Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:28.466124Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:40:28.466134Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 17 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602984031578159:5396]
2025-10-10T14:40:28.466139Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:40:28.466158Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:28.466205Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3319 reason: error at write: Disconnected sessionId: src_id|b49a113c-a5d665b6-35065cfb-f432c447_0
2025-10-10T14:40:28.466427Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3319 sessionId: src_id|b49a113c-a5d665b6-35065cfb-f432c447_0 is DEAD
2025-10-10T14:40:28.466590Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b49a113c-a5d665b6-35065cfb-f432c447_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:40:28.466602Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b49a113c-a5d665b6-35065cfb-f432c447_0] Write session will restart in 0.008281s
2025-10-10T14:40:28.466627Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b49a113c-a5d665b6-35065cfb-f432c447_0] Write session: Do CDS request
2025-10-10T14:40:28.466637Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b49a113c-a5d665b6-35065cfb-f432c447_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:28.476039Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b49a113c-a5d665b6-35065cfb-f432c447_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:28.476217Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:28.476235Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3320
2025-10-10T14:40:28.476377Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3320 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:28.476416Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3320 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:28.476427Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3320 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:28.476432Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:28.476979Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3320 sessionId:  describe result for acl check
2025-10-10T14:40:28.477033Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:28.477041Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:28.477043Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:28.477049Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602984031578240:5631] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:28.477658Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602984031578240:5631] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:28.479899Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602984031578240:5631] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:28.480642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:28.483071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:28.483210Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602984031578240:5631] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:28.483225Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602984031578240:5631] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:28.483229Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602984031578240:5631] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:28.483238Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3320 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:28.483372Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:28.483392Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:28.483409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:28.483483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:28.483529Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602983249324460:13123]
2025-10-10T14:40:28.484152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:28.484545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:28.484602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:28.484972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:28.485080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:28.485088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:28.485089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:28.485090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:28.485091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:28.485093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:28.485094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:28.485096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:28.485097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:28.485098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:28.485100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:28.485102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:28.485103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:28.485110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:28.485124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:28.485128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:28.485132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:28.485136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:28.485140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:28.485144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:28.485148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:28.485152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:28.485156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:28.485160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:28.485164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:28.485168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:28.485178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:28.485187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:28.485195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:28.485200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:28.485207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:28.485212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:28.485217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:28.485223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:28.485228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:28.485233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:28.485247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:28.485253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:28.485262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:28.485272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:28.485279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:28.485289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:28.485293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:28.485299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:28.485304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:28.485309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:28.485313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:28.485318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:28.485324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:28.485348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:28.485359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:28.485365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:28.485413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:28.487990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:28.488512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:28.488525Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:28.488528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:28.488533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:28.488540Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3319 [2:7559602983249324460:13123]
2025-10-10T14:40:28.488554Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:28.488576Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:28.488584Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:28.488589Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:28.488593Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:28.488613Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:28.488625Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:28.488641Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:28.488707Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:28.488714Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:28.488717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:28.488734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:28.488804Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:28.488812Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:28.488825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:28.488843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:28.488861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:28.488893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602984031578316:5631], now have 1 active actors on pipe
2025-10-10T14:40:28.488897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602984031578160:2438], now have 1 active actors on pipe
2025-10-10T14:40:28.488905Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602983249324455:13123]
2025-10-10T14:40:28.488908Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602983249324455:13123]
2025-10-10T14:40:28.488910Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602983249324455:13123]
2025-10-10T14:40:28.488926Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:28.488941Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:28.488952Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:28.488956Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:28.488959Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:28.488962Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:28.488966Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:28.488997Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602983249324455:13123]
2025-10-10T14:40:28.489007Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:28.489011Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:28.488980Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3319
2025-10-10T14:40:28.488984Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3319
2025-10-10T14:40:28.489042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:28.489052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:28.489097Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e04fc366-cf8d2823-40c97157-a8aba14a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:28.489109Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:28.489114Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:28.489116Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:28.489127Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:28.489139Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:28.489160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:28.489348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:28.489357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:28.489372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:28.489449Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3320 partition: 0 MaxSeqNo: 40 sessionId: src_id|e04fc366-cf8d2823-40c97157-a8aba14a_0
2025-10-10T14:40:28.489880Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b49a113c-a5d665b6-35065cfb-f432c447_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|e04fc366-cf8d2823-40c97157-a8aba14a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:28.492614Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e04fc366-cf8d2823-40c97157-a8aba14a_0] Write session: try to update token
2025-10-10T14:40:28.492638Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e04fc366-cf8d2823-40c97157-a8aba14a_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:28.508005Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3320 sessionId: src_id|e04fc366-cf8d2823-40c97157-a8aba14a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:28.510876Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:28.509719Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:28.509736Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:28.509740Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:28.509742Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:28.509753Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602983249324455:13123]
2025-10-10T14:40:28.509758Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602983249324455:13123]
2025-10-10T14:40:28.509762Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602983249324455:13123]
2025-10-10T14:40:28.509816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:28.509819Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:28.509825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:28.509826Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:28.509828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:28.509831Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:28.509978Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:28.566218Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602984031578328:5396]
2025-10-10T14:40:28.566426Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 pipe creation result: OK TabletId: 72075186224037892 Generation: 3319, pipe: [1:7559602984031578328:5396]
2025-10-10T14:40:28.630430Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:28.630822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:28.630841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:28.630892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602984031578328:5396], now have 1 active actors on pipe
2025-10-10T14:40:28.631191Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:28.631207Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:40:28.631213Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:40:28.631258Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 18 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602984031578328:5396]
2025-10-10T14:40:28.631283Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3320 reason: error at write: Disconnected sessionId: src_id|e04fc366-cf8d2823-40c97157-a8aba14a_0
2025-10-10T14:40:28.631499Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3320 sessionId: src_id|e04fc366-cf8d2823-40c97157-a8aba14a_0 is DEAD
2025-10-10T14:40:28.631143Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:28.631676Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e04fc366-cf8d2823-40c97157-a8aba14a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:40:28.631689Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e04fc366-cf8d2823-40c97157-a8aba14a_0] Write session will restart in 0.005054s
2025-10-10T14:40:28.631717Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e04fc366-cf8d2823-40c97157-a8aba14a_0] Write session: Do CDS request
2025-10-10T14:40:28.631728Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e04fc366-cf8d2823-40c97157-a8aba14a_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:28.637976Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e04fc366-cf8d2823-40c97157-a8aba14a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:28.638037Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:28.638052Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3321
2025-10-10T14:40:28.638220Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3321 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:28.638257Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3321 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:28.638268Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3321 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:28.638272Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:28.638739Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3321 sessionId:  describe result for acl check
2025-10-10T14:40:28.638794Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:28.638796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:28.638798Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:28.638803Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602984031578344:5639] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:28.639405Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602984031578344:5639] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:28.642149Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602984031578344:5639] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:28.644743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602984031578344:5639] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:28.644756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602984031578344:5639] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:28.644759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602984031578344:5639] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:28.644777Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3321 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:28.646241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:28.649617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:28.649883Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:28.649910Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:28.649923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:28.649984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:28.650029Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602983249324625:13125]
2025-10-10T14:40:28.650674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:28.650994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:28.651045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:28.651399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:28.651481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:28.651489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:28.651490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:28.651491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:28.651493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:28.651494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:28.651495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:28.651496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:28.651497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:28.651498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:28.651499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:28.651501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:28.651502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:28.651508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:28.651521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:28.651525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:28.651529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:28.651533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:28.651537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:28.651541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:28.651545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:28.651549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:28.651554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:28.651558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:28.651562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:28.651567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:28.651575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:28.651584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:28.651591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:28.651596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:28.651601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:28.651607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:28.651611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:28.651620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:28.651630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:28.651636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:28.651645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:28.651650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:28.651655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:28.651666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:28.651670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:28.651675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:28.651680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:28.651685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:28.651690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:28.651695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:28.651700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:28.651710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:28.651715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:28.651721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:28.651730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:28.651735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:28.651777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:28.654384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:28.654943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:28.654957Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:28.654959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:28.654964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:28.654972Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3320 [2:7559602983249324625:13125]
2025-10-10T14:40:28.654988Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:28.655006Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:28.655010Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:28.655014Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:28.655017Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:28.655034Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:28.655047Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:28.655055Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:28.655128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:28.655140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:28.655142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:28.655145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:28.655222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:28.655232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:28.655245Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:28.655259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:28.655285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:28.655352Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3320
2025-10-10T14:40:28.655358Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3320
2025-10-10T14:40:28.655314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602984031578329:2438], now have 1 active actors on pipe
2025-10-10T14:40:28.655324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602984031578482:5639], now have 1 active actors on pipe
2025-10-10T14:40:28.655334Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602983249324620:13125]
2025-10-10T14:40:28.655337Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602983249324620:13125]
2025-10-10T14:40:28.655339Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602983249324620:13125]
2025-10-10T14:40:28.655353Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:28.655368Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:28.655378Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:28.655382Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:28.655385Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:28.655385Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:28.655390Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:28.655419Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602983249324620:13125]
2025-10-10T14:40:28.655423Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:28.655425Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:28.655459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:28.655464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:28.655520Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|54c55d36-9f7afe01-b1864450-52d09bce_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:28.655529Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:28.655533Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:28.655535Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:28.655548Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:28.655559Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:28.655586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:28.655879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:28.655891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:28.655910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:28.656010Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3321 partition: 0 MaxSeqNo: 40 sessionId: src_id|54c55d36-9f7afe01-b1864450-52d09bce_0
2025-10-10T14:40:28.656453Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e04fc366-cf8d2823-40c97157-a8aba14a_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|54c55d36-9f7afe01-b1864450-52d09bce_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:28.659291Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|54c55d36-9f7afe01-b1864450-52d09bce_0] Write session: try to update token
2025-10-10T14:40:28.659312Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|54c55d36-9f7afe01-b1864450-52d09bce_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:28.676012Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3321 sessionId: src_id|54c55d36-9f7afe01-b1864450-52d09bce_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:28.678894Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:28.678533Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:28.678554Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:28.678558Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:28.678559Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:28.678570Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602983249324620:13125]
2025-10-10T14:40:28.678579Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602983249324620:13125]
2025-10-10T14:40:28.678583Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602983249324620:13125]
2025-10-10T14:40:28.678636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:28.678645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:28.678647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:28.678724Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:28.678731Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:28.678734Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:28.678825Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:28.731589Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602984031578497:5396]
2025-10-10T14:40:28.731944Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 pipe creation result: OK TabletId: 72075186224037892 Generation: 3320, pipe: [1:7559602984031578497:5396]
2025-10-10T14:40:28.795243Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:28.795801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:28.795818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:28.795864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602984031578497:5396], now have 1 active actors on pipe
2025-10-10T14:40:28.796207Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:28.796204Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:28.796263Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:40:28.796267Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:40:28.796276Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 19 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602984031578497:5396]
2025-10-10T14:40:28.796365Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3321 reason: error at write: Disconnected sessionId: src_id|54c55d36-9f7afe01-b1864450-52d09bce_0
2025-10-10T14:40:28.796603Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3321 sessionId: src_id|54c55d36-9f7afe01-b1864450-52d09bce_0 is DEAD
2025-10-10T14:40:28.796772Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54c55d36-9f7afe01-b1864450-52d09bce_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:40:28.796790Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54c55d36-9f7afe01-b1864450-52d09bce_0] Write session will restart in 0.009433s
2025-10-10T14:40:28.796816Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54c55d36-9f7afe01-b1864450-52d09bce_0] Write session: Do CDS request
2025-10-10T14:40:28.796823Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54c55d36-9f7afe01-b1864450-52d09bce_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:28.807914Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|54c55d36-9f7afe01-b1864450-52d09bce_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:28.807970Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:28.807997Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3322
2025-10-10T14:40:28.808474Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3322 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:28.808527Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3322 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:28.808537Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3322 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:28.808542Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:28.809056Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3322 sessionId:  describe result for acl check
2025-10-10T14:40:28.809105Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:28.809111Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:28.809113Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:28.809121Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602984031578591:5646] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:28.809756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602984031578591:5646] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:28.811852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:28.811905Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602984031578591:5646] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:28.815930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:28.816175Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:28.816187Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:28.816201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:28.816808Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602984031578591:5646] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:28.816824Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602984031578591:5646] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:28.816828Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602984031578591:5646] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:28.816837Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3322 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:28.816265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:28.816313Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602983249324789:13127]
2025-10-10T14:40:28.816886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:28.817169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:28.817213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:28.817503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:28.817562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:28.817569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:28.817570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:28.817572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:28.817573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:28.817575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:28.817576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:28.817577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:28.817578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:28.817580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:28.817581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:28.817582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:28.817583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:28.817590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:28.817602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:28.817605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:28.817607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:28.817609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:28.817611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:28.817613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:28.817616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:28.817618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:28.817620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:28.817622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:28.817624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:28.817626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:28.817632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:28.817637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:28.817642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:28.817645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:28.817648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:28.817651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:28.817654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:28.817657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:28.817660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:28.817662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:28.817666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:28.817669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:28.817671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:28.817687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:28.817690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:28.817694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:28.817699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:28.817704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:28.817710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:28.817716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:28.817720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:28.817726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:28.817730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:28.817735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:28.817741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:28.817746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:28.817788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:28.820719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:28.821369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:28.821382Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:28.821385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:28.821390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:28.821396Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3321 [2:7559602983249324789:13127]
2025-10-10T14:40:28.821411Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:28.821730Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3321
2025-10-10T14:40:28.821751Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3321
2025-10-10T14:40:28.821426Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:28.821432Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:28.821435Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:28.821436Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:28.821451Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:28.821459Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:28.821466Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:28.821531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:28.821533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:28.821535Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:28.821538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:28.821806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:28.821809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:28.821823Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:28.821836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:28.821855Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:28.821878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602984031578656:5646], now have 1 active actors on pipe
2025-10-10T14:40:28.821881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602984031578498:2438], now have 1 active actors on pipe
2025-10-10T14:40:28.821896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:28.821901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:28.821922Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602983249324784:13127]
2025-10-10T14:40:28.821924Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602983249324784:13127]
2025-10-10T14:40:28.821925Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602983249324784:13127]
2025-10-10T14:40:28.821936Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:28.821948Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:28.821959Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:28.821962Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:28.821968Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:28.821971Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:28.821973Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:28.821979Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d62ae186-3ba9f64d-c4199d0e-df889743_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:28.821986Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:28.821990Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:28.821993Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:28.822005Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:28.822016Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:28.822047Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602983249324784:13127]
2025-10-10T14:40:28.822056Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:28.822068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:28.822080Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:28.822294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:28.822303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:28.822320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:28.822429Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3322 partition: 0 MaxSeqNo: 40 sessionId: src_id|d62ae186-3ba9f64d-c4199d0e-df889743_0
2025-10-10T14:40:28.822870Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54c55d36-9f7afe01-b1864450-52d09bce_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|d62ae186-3ba9f64d-c4199d0e-df889743_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:28.825671Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d62ae186-3ba9f64d-c4199d0e-df889743_0] Write session: try to update token
2025-10-10T14:40:28.825695Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d62ae186-3ba9f64d-c4199d0e-df889743_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:28.838810Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:40:28.838827Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:28.838840Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602983249324784:13127]
2025-10-10T14:40:28.838885Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:40:28.838894Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:40:28.839279Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:40:28.839439Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:28.839583Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:28.839731Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:28.839937Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:40:28.839981Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:40:28.849893Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3322 sessionId: src_id|d62ae186-3ba9f64d-c4199d0e-df889743_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:28.852763Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:28.852827Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:28.852846Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:28.852851Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:28.852853Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:28.852864Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602983249324784:13127]
2025-10-10T14:40:28.852868Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602983249324784:13127]
2025-10-10T14:40:28.852872Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602983249324784:13127]
2025-10-10T14:40:28.852913Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:28.852918Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:28.852921Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:28.852924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:28.853045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:28.853076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:28.853090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:28.853098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:28.853243Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:28.896455Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602984031578673:5396]
2025-10-10T14:40:28.896730Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 pipe creation result: OK TabletId: 72075186224037892 Generation: 3321, pipe: [1:7559602984031578673:5396]
2025-10-10T14:40:28.970029Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:28.970294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602984031578673:5396], now have 1 active actors on pipe
2025-10-10T14:40:28.970499Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:40:28.970521Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:28.970513Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:40:28.970532Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:28.970583Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3322 reason: error at write: Disconnected sessionId: src_id|d62ae186-3ba9f64d-c4199d0e-df889743_0
2025-10-10T14:40:28.970586Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 20 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602984031578673:5396]
2025-10-10T14:40:28.970800Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3322 sessionId: src_id|d62ae186-3ba9f64d-c4199d0e-df889743_0 is DEAD
2025-10-10T14:40:28.970989Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d62ae186-3ba9f64d-c4199d0e-df889743_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:40:28.971001Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d62ae186-3ba9f64d-c4199d0e-df889743_0] Write session will restart in 0.009654s
2025-10-10T14:40:28.971027Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d62ae186-3ba9f64d-c4199d0e-df889743_0] Write session: Do CDS request
2025-10-10T14:40:28.971034Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d62ae186-3ba9f64d-c4199d0e-df889743_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:28.981987Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d62ae186-3ba9f64d-c4199d0e-df889743_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:28.982075Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:28.982091Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3323
2025-10-10T14:40:28.982262Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3323 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:28.982300Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3323 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:28.982308Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3323 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:28.982313Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:28.982884Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3323 sessionId:  describe result for acl check
2025-10-10T14:40:28.982931Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:28.982949Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:28.982951Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:28.982958Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602984031578818:5651] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:28.983702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602984031578818:5651] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:28.985009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:28.986506Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602984031578818:5651] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:28.987261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:28.987504Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:28.987516Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:28.987529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:28.987590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:28.987640Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602983249324967:13130]
2025-10-10T14:40:28.988305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:28.988669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:28.988729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:28.989108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:28.989175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:28.989181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:28.989182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:28.989183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:28.989185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:28.989186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:28.989187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:28.989189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:28.989190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:28.989191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:28.989193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:28.989194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:28.989195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:28.989203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:28.989216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:28.989220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:28.989223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:28.989227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:28.989231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:28.989235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:28.989238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:28.989242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:28.989246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:28.989250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:28.989253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:28.989257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:28.989265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:28.989274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:28.989281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:28.989286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:28.989292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:28.989297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:28.989301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:28.989305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:28.989310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:28.989315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:28.989319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:28.989324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:28.989344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:28.989350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:28.989359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:28.989364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:28.989368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:28.989379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:28.989383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:28.989388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:28.989393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:28.989399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:28.989404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:28.989409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:28.989414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:28.989419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:28.989461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:28.989412Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602984031578818:5651] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:28.989428Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602984031578818:5651] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:28.989432Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602984031578818:5651] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:28.989440Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3323 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:28.992004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:28.992602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:28.992615Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:28.992618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:28.992622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:28.992629Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3322 [2:7559602983249324967:13130]
2025-10-10T14:40:28.992643Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:28.992663Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:28.992666Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:28.992670Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:28.992672Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:28.992691Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:28.992703Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:28.992712Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:28.992786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:28.992795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:28.992797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:28.992799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:28.992868Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:28.992875Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:28.992887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:28.992904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:28.992924Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:28.992951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602984031578849:5651], now have 1 active actors on pipe
2025-10-10T14:40:28.992955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602984031578692:2438], now have 1 active actors on pipe
2025-10-10T14:40:28.992963Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602983249324962:13130]
2025-10-10T14:40:28.992965Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602983249324962:13130]
2025-10-10T14:40:28.992968Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602983249324962:13130]
2025-10-10T14:40:28.992982Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:28.993001Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:28.993013Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:28.993022Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:28.993022Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:28.993024Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:28.993025Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:28.993061Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602983249324962:13130]
2025-10-10T14:40:28.993018Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3322
2025-10-10T14:40:28.993070Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:28.993072Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:28.993088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:28.993020Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3322
2025-10-10T14:40:28.993093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:28.993147Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7041ae6e-edb0084d-929a6554-bc4c8ffe_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:28.993161Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:28.993166Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:28.993170Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:28.993182Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:28.993197Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:28.993219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:28.993392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:28.993404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:28.993428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:28.993566Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3323 partition: 0 MaxSeqNo: 40 sessionId: src_id|7041ae6e-edb0084d-929a6554-bc4c8ffe_0
2025-10-10T14:40:28.993993Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d62ae186-3ba9f64d-c4199d0e-df889743_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|7041ae6e-edb0084d-929a6554-bc4c8ffe_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:28.996870Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7041ae6e-edb0084d-929a6554-bc4c8ffe_0] Write session: try to update token
2025-10-10T14:40:28.996891Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7041ae6e-edb0084d-929a6554-bc4c8ffe_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:29.012940Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:29.012962Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:29.012966Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:29.012968Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:29.012978Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602983249324962:13130]
2025-10-10T14:40:29.012982Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602983249324962:13130]
2025-10-10T14:40:29.012987Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602983249324962:13130]
2025-10-10T14:40:29.013035Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:29.013042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:29.013045Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:29.013046Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:29.013130Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:29.013151Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:29.013180Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:29.013210Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3323 sessionId: src_id|7041ae6e-edb0084d-929a6554-bc4c8ffe_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:29.015983Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:29.070547Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602988326546155:5396]
2025-10-10T14:40:29.070870Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 pipe creation result: OK TabletId: 72075186224037892 Generation: 3322, pipe: [1:7559602988326546155:5396]
2025-10-10T14:40:29.129282Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:29.129852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:29.129870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:29.129925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602988326546155:5396], now have 1 active actors on pipe
2025-10-10T14:40:29.130241Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:29.130914Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7041ae6e-edb0084d-929a6554-bc4c8ffe_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:40:29.130926Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7041ae6e-edb0084d-929a6554-bc4c8ffe_0] Write session will restart in 0.006796s
2025-10-10T14:40:29.130966Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7041ae6e-edb0084d-929a6554-bc4c8ffe_0] Write session: Do CDS request
2025-10-10T14:40:29.130972Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7041ae6e-edb0084d-929a6554-bc4c8ffe_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:29.130287Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 21 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602988326546155:5396]
2025-10-10T14:40:29.130331Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:40:29.130335Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:40:29.130422Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3323 reason: error at write: Disconnected sessionId: src_id|7041ae6e-edb0084d-929a6554-bc4c8ffe_0
2025-10-10T14:40:29.130621Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:29.130688Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3323 sessionId: src_id|7041ae6e-edb0084d-929a6554-bc4c8ffe_0 is DEAD
2025-10-10T14:40:29.138962Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7041ae6e-edb0084d-929a6554-bc4c8ffe_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:29.139053Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:29.139068Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3324
2025-10-10T14:40:29.139198Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3324 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:29.139236Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3324 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:29.139247Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3324 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:29.139251Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:29.139759Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3324 sessionId:  describe result for acl check
2025-10-10T14:40:29.139811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:29.139813Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:29.139815Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:29.139824Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602988326546181:5662] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:29.140484Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602988326546181:5662] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:29.143531Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602988326546181:5662] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:29.146357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:29.146498Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602988326546181:5662] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:29.146513Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602988326546181:5662] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:29.146517Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602988326546181:5662] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:29.146526Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3324 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:29.149114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:29.149404Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:29.149417Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:29.149431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:29.149496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:29.149752Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602987544292431:13132]
2025-10-10T14:40:29.150423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:29.150842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:29.150896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:29.151233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:29.151300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:29.151307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:29.151309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:29.151310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:29.151311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:29.151313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:29.151314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:29.151316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:29.151317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:29.151319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:29.151320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:29.151321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:29.151323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:29.151330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:29.151344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:29.151349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:29.151354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:29.151358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:29.151363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:29.151367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:29.151372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:29.151376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:29.151381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:29.151385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:29.151389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:29.151394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:29.151403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:29.151412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:29.151420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:29.151426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:29.151431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:29.151438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:29.151442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:29.151450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:29.151455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:29.151461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:29.151466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:29.151472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:29.151477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:29.151483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:29.151488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:29.151494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:29.151500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:29.151506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:29.151511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:29.151517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:29.151522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:29.151528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:29.151533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:29.151539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:29.151545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:29.151550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:29.151604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:29.154871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:29.155298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:29.155312Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:29.155316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:29.155320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:29.155328Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3323 [2:7559602987544292431:13132]
2025-10-10T14:40:29.155343Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:29.155370Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:29.155378Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:29.155383Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:29.155385Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:29.155405Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:29.155419Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:29.155429Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:29.155493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:29.155502Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:29.155504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:29.155508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:29.155586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:29.155597Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:29.155610Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:29.155625Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:29.155645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:29.155670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602988326546315:5662], now have 1 active actors on pipe
2025-10-10T14:40:29.155679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602988326546157:2438], now have 1 active actors on pipe
2025-10-10T14:40:29.155691Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602987544292425:13132]
2025-10-10T14:40:29.155694Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602987544292425:13132]
2025-10-10T14:40:29.155697Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602987544292425:13132]
2025-10-10T14:40:29.155712Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:29.155727Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:29.155732Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:29.155745Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:29.155748Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:29.155749Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:29.155753Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:29.155767Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3323
2025-10-10T14:40:29.155802Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3323
2025-10-10T14:40:29.155791Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602987544292425:13132]
2025-10-10T14:40:29.155807Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:29.155813Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:29.155991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:29.156002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:29.156038Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2a0ad629-92c7591c-a8421198-ed7efb15_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:29.156051Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:29.156056Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:29.156058Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:29.156072Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:29.156083Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:29.156119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:29.156348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:29.156362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:29.156390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:29.156513Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3324 partition: 0 MaxSeqNo: 40 sessionId: src_id|2a0ad629-92c7591c-a8421198-ed7efb15_0
2025-10-10T14:40:29.156944Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7041ae6e-edb0084d-929a6554-bc4c8ffe_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|2a0ad629-92c7591c-a8421198-ed7efb15_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:29.159782Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2a0ad629-92c7591c-a8421198-ed7efb15_0] Write session: try to update token
2025-10-10T14:40:29.159806Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2a0ad629-92c7591c-a8421198-ed7efb15_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:29.167865Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:40:29.167883Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:29.167895Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602987544292425:13132]
2025-10-10T14:40:29.167945Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:40:29.167950Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:40:29.168362Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:40:29.168512Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:29.168657Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:29.168800Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:29.169130Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:40:29.169177Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:40:29.179392Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3324 sessionId: src_id|2a0ad629-92c7591c-a8421198-ed7efb15_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:29.182261Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:29.182695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:29.182718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:29.182765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:40:29.182869Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:40:29.186314Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:29.186326Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:29.186330Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:29.186332Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:29.186348Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602987544292425:13132]
2025-10-10T14:40:29.186354Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602987544292425:13132]
2025-10-10T14:40:29.186360Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602987544292425:13132]
2025-10-10T14:40:29.186415Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:29.186419Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:29.186428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:29.186429Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:29.186431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:29.186434Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:29.186575Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:29.230575Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602988326546328:5396]
2025-10-10T14:40:29.230919Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 pipe creation result: OK TabletId: 72075186224037892 Generation: 3323, pipe: [1:7559602988326546328:5396]
2025-10-10T14:40:29.310621Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:29.319937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:29.319973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:29.320185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:29.320256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:29.320335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:29.320410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:29.320934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:29.320948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:29.321094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:29.321418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:29.321691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:29.321769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:29.321923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:29.321940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:29.322056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:29.322124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:29.322196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:29.322304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:29.322443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:29.322453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:29.322567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:29.322642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:29.322719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:29.322993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:29.323045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:29.323054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:29.323168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:29.323236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:29.323478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:29.323755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:29.323896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:29.323908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:29.324195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:29.324309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:29.324422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:29.324539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:29.324684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:29.324692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:29.324811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:29.324884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:29.324990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:29.325058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:29.325109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:29.325116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:29.325228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:29.325376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:29.325452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:29.325527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:29.325577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:29.325585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:29.325659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:29.325772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:29.325883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:29.326000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:29.326179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:29.326187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:29.326293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:29.326402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:29.326476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:29.326551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:29.326652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:29.326655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:29.326732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602988326546328:5396], now have 1 active actors on pipe
2025-10-10T14:40:29.327627Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:29.328487Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 22 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602988326546328:5396]
2025-10-10T14:40:29.328527Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:29.328588Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:40:29.328640Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3324 reason: status is not ok: tablet will be restarted right now sessionId: src_id|2a0ad629-92c7591c-a8421198-ed7efb15_0
2025-10-10T14:40:29.328875Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3324 sessionId: src_id|2a0ad629-92c7591c-a8421198-ed7efb15_0 is DEAD
2025-10-10T14:40:29.329260Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a0ad629-92c7591c-a8421198-ed7efb15_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:40:29.329273Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a0ad629-92c7591c-a8421198-ed7efb15_0] Write session will restart in 0.007586s
2025-10-10T14:40:29.329301Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a0ad629-92c7591c-a8421198-ed7efb15_0] Write session: Do CDS request
2025-10-10T14:40:29.329308Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a0ad629-92c7591c-a8421198-ed7efb15_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:29.337955Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2a0ad629-92c7591c-a8421198-ed7efb15_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:29.338424Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:29.338442Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3325
2025-10-10T14:40:29.338622Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3325 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:29.338669Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3325 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:29.338682Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3325 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:29.338686Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:29.339244Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3325 sessionId:  describe result for acl check
2025-10-10T14:40:29.339283Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:29.339285Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:29.339287Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:29.339293Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602988326546393:5685] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:29.339891Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602988326546393:5685] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:29.344631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602988326546393:5685] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:29.348075Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602988326546393:5685] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:29.348107Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602988326546393:5685] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:29.348111Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602988326546393:5685] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:29.348123Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3325 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:29.348161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:29.351452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:29.351779Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:29.351792Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:29.351806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:29.351878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:29.351939Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602987544292639:13147]
2025-10-10T14:40:29.352671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:29.353207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:29.353269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:29.353700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:29.353785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:29.353793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:29.353794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:29.353796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:29.353797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:29.353799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:29.353800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:29.353802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:29.353803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:29.353805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:29.353807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:29.353808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:29.353809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:29.353836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:29.353852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:29.353862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:29.353866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:29.353870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:29.353874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:29.353879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:29.353883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:29.353887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:29.353892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:29.353897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:29.353901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:29.353905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:29.353914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:29.353924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:29.353937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:29.353943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:29.353953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:29.353960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:29.353971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:29.353978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:29.353989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:29.353995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:29.354004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:29.354011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:29.354022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:29.354033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:29.354052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:29.354062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:29.354069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:29.354075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:29.354080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:29.354087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:29.354096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:29.354103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:29.354109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:29.354115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:29.354120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:29.354127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:29.354172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:29.357364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:29.358050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:29.358057Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:29.358060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:29.358064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:29.358230Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3324 [2:7559602987544292639:13147]
2025-10-10T14:40:29.358246Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:29.358268Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:29.358273Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:29.358277Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:29.358279Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:29.358299Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:29.358308Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:29.358317Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:29.358385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:29.358388Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:29.358390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:29.358394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:29.358479Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:29.358482Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:29.358496Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:29.358510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:29.358529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:29.358554Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602987544292632:13147]
2025-10-10T14:40:29.358557Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602987544292632:13147]
2025-10-10T14:40:29.358559Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602987544292632:13147]
2025-10-10T14:40:29.358889Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3324
2025-10-10T14:40:29.358576Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:29.358935Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3324
2025-10-10T14:40:29.358595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602988326546356:2438], now have 1 active actors on pipe
2025-10-10T14:40:29.358595Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:29.358599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602988326546511:5685], now have 1 active actors on pipe
2025-10-10T14:40:29.358599Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:29.358602Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:29.358609Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:29.358628Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:29.358632Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:29.358674Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602987544292632:13147]
2025-10-10T14:40:29.358684Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:29.358694Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:29.359077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:29.359091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:29.359125Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3f514d4f-4cf33d25-2966ab6a-f9f995c8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:29.359141Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:29.359147Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:29.359152Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:29.359177Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:29.359196Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:29.359218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:29.359605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:29.359616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:29.359636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:29.366379Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3325 partition: 0 MaxSeqNo: 40 sessionId: src_id|3f514d4f-4cf33d25-2966ab6a-f9f995c8_0
2025-10-10T14:40:29.366860Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a0ad629-92c7591c-a8421198-ed7efb15_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|3f514d4f-4cf33d25-2966ab6a-f9f995c8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:29.369963Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3f514d4f-4cf33d25-2966ab6a-f9f995c8_0] Write session: try to update token
2025-10-10T14:40:29.369990Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3f514d4f-4cf33d25-2966ab6a-f9f995c8_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:29.387545Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:29.387564Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:29.387568Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:29.387570Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:29.387582Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602987544292632:13147]
2025-10-10T14:40:29.387587Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602987544292632:13147]
2025-10-10T14:40:29.387591Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602987544292632:13147]
2025-10-10T14:40:29.387643Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:29.387651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:29.387655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:29.387662Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:29.387671Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:29.387675Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:29.387802Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:29.393469Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3325 sessionId: src_id|3f514d4f-4cf33d25-2966ab6a-f9f995c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:29.396165Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:29.428916Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602988326546525:5396]
2025-10-10T14:40:29.429359Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 pipe creation result: OK TabletId: 72075186224037892 Generation: 3324, pipe: [1:7559602988326546525:5396]
2025-10-10T14:40:29.513411Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:29.513738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:29.513750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:29.513803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602988326546525:5396], now have 1 active actors on pipe
2025-10-10T14:40:29.514068Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:29.514555Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 23 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602988326546525:5396]
2025-10-10T14:40:29.514586Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:29.514622Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:40:29.514699Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3325 reason: status is not ok: tablet will be restarted right now sessionId: src_id|3f514d4f-4cf33d25-2966ab6a-f9f995c8_0
2025-10-10T14:40:29.514902Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3325 sessionId: src_id|3f514d4f-4cf33d25-2966ab6a-f9f995c8_0 is DEAD
2025-10-10T14:40:29.515072Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f514d4f-4cf33d25-2966ab6a-f9f995c8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:40:29.515085Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f514d4f-4cf33d25-2966ab6a-f9f995c8_0] Write session will restart in 0.006139s
2025-10-10T14:40:29.515112Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f514d4f-4cf33d25-2966ab6a-f9f995c8_0] Write session: Do CDS request
2025-10-10T14:40:29.515119Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f514d4f-4cf33d25-2966ab6a-f9f995c8_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:29.522924Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3f514d4f-4cf33d25-2966ab6a-f9f995c8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:29.523046Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:29.523063Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3326
2025-10-10T14:40:29.523367Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3326 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:29.523411Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3326 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:29.523422Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3326 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:29.523426Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:29.523869Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3326 sessionId:  describe result for acl check
2025-10-10T14:40:29.523925Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:29.523932Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:29.523934Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:29.523941Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602988326546576:5693] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:29.524583Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602988326546576:5693] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:29.527690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602988326546576:5693] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:29.529083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:29.531555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:29.531666Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602988326546576:5693] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:29.531682Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602988326546576:5693] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:29.531685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602988326546576:5693] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:29.531695Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3326 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:29.531795Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:29.531809Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:29.531823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:29.531883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:29.531928Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602987544292807:13150]
2025-10-10T14:40:29.532600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:29.532943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:29.533010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:29.533389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:29.533484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:29.533493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:29.533494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:29.533495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:29.533496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:29.533498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:29.533499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:29.533500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:29.533501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:29.533502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:29.533504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:29.533505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:29.533506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:29.533535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:29.533558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:29.533564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:29.533568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:29.533580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:29.533587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:29.533595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:29.533603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:29.533623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:29.533634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:29.533649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:29.533654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:29.533661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:29.533679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:29.533695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:29.533712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:29.533725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:29.533731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:29.533743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:29.533755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:29.533762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:29.533768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:29.533774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:29.533786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:29.533792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:29.533797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:29.533810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:29.533823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:29.533834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:29.533845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:29.533858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:29.533869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:29.533875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:29.533883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:29.533896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:29.533903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:29.533925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:29.533948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:29.533967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:29.534034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:29.536843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:29.537441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:29.537460Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:29.537462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:29.537467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:29.537476Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3325 [2:7559602987544292807:13150]
2025-10-10T14:40:29.537494Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:29.537517Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:29.537522Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:29.537526Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:29.537537Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:29.537557Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:29.537565Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:29.537575Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:29.537643Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:29.537652Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:29.537655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:29.537657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:29.537731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:29.537739Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:29.537752Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:29.537768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:29.537792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:29.537815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602988326546688:5693], now have 1 active actors on pipe
2025-10-10T14:40:29.537823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602988326546527:2438], now have 1 active actors on pipe
2025-10-10T14:40:29.537833Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602987544292802:13150]
2025-10-10T14:40:29.537835Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602987544292802:13150]
2025-10-10T14:40:29.537837Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602987544292802:13150]
2025-10-10T14:40:29.537851Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:29.537864Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:29.537870Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:29.537873Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:29.537876Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:29.537888Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:29.537892Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:29.537919Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3325
2025-10-10T14:40:29.537933Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602987544292802:13150]
2025-10-10T14:40:29.537944Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:29.537955Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:29.537978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:29.537989Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3325
2025-10-10T14:40:29.537984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:29.538021Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c80a318-bead232a-a7e5417-1a225d14_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:29.538034Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:29.538041Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:29.538043Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:29.538056Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:29.538072Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:29.538088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:29.538301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:29.538310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:29.538329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:29.538416Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3326 partition: 0 MaxSeqNo: 40 sessionId: src_id|c80a318-bead232a-a7e5417-1a225d14_0
2025-10-10T14:40:29.543025Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f514d4f-4cf33d25-2966ab6a-f9f995c8_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|c80a318-bead232a-a7e5417-1a225d14_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:29.545985Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c80a318-bead232a-a7e5417-1a225d14_0] Write session: try to update token
2025-10-10T14:40:29.546013Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c80a318-bead232a-a7e5417-1a225d14_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:29.565645Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:29.565665Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:29.565668Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:29.565670Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:29.565681Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602987544292802:13150]
2025-10-10T14:40:29.565686Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602987544292802:13150]
2025-10-10T14:40:29.565690Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602987544292802:13150]
2025-10-10T14:40:29.565745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:29.565753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:29.565755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:29.565832Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:29.565846Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:29.565850Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:29.566327Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:29.575572Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3326 sessionId: src_id|c80a318-bead232a-a7e5417-1a225d14_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:29.578488Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:29.614802Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602988326546700:5396]
2025-10-10T14:40:29.617081Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 pipe creation result: OK TabletId: 72075186224037892 Generation: 3325, pipe: [1:7559602988326546700:5396]
2025-10-10T14:40:29.686930Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:29.687386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:29.687401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:29.687426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602988326546700:5396], now have 1 active actors on pipe
2025-10-10T14:40:29.687713Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:29.689415Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:40:29.689521Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3326 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c80a318-bead232a-a7e5417-1a225d14_0
2025-10-10T14:40:29.689791Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3326 sessionId: src_id|c80a318-bead232a-a7e5417-1a225d14_0 is DEAD
2025-10-10T14:40:29.689942Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c80a318-bead232a-a7e5417-1a225d14_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:40:29.689956Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c80a318-bead232a-a7e5417-1a225d14_0] Write session will restart in 0.007248s
2025-10-10T14:40:29.689993Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c80a318-bead232a-a7e5417-1a225d14_0] Write session: Do CDS request
2025-10-10T14:40:29.690000Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c80a318-bead232a-a7e5417-1a225d14_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:29.690026Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 24 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602988326546700:5396]
2025-10-10T14:40:29.690054Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:29.699010Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c80a318-bead232a-a7e5417-1a225d14_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:29.699101Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:29.699117Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3327
2025-10-10T14:40:29.699337Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3327 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:29.699374Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3327 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:29.699380Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3327 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:29.699385Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:29.699804Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3327 sessionId:  describe result for acl check
2025-10-10T14:40:29.699843Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:29.699845Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:29.699847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:29.699854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602988326546789:5696] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:29.700446Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602988326546789:5696] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:29.702942Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602988326546789:5696] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:29.703755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:29.706105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:29.706236Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602988326546789:5696] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:29.706248Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602988326546789:5696] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:29.706251Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602988326546789:5696] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:29.706260Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3327 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:29.706344Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:29.706362Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:29.706375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:29.706437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:29.706483Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602987544292977:13152]
2025-10-10T14:40:29.707135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:29.707444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:29.707486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:29.707828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:29.707892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:29.707899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:29.707901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:29.707912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:29.707913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:29.707915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:29.707916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:29.707917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:29.707919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:29.707920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:29.707922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:29.707923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:29.707924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:29.707930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:29.707943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:29.707947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:29.707952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:29.707956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:29.707961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:29.707965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:29.707969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:29.707973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:29.707978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:29.707982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:29.707986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:29.707990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:29.707997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:29.708006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:29.708013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:29.708018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:29.708023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:29.708029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:29.708033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:29.708039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:29.708044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:29.708049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:29.708054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:29.708059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:29.708064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:29.708069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:29.708074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:29.708095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:29.708102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:29.708108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:29.708112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:29.708118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:29.708129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:29.708134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:29.708143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:29.708148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:29.708153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:29.708162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:29.708206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:29.711485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:29.712052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:29.712064Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:29.712066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:29.712071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:29.712078Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3326 [2:7559602987544292977:13152]
2025-10-10T14:40:29.712103Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:29.712123Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:29.712132Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:29.712136Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:29.712138Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:29.712157Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:29.712166Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:29.712178Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:29.712242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:29.712248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:29.712250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:29.712254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:29.712321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:29.712329Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:29.712341Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:29.712360Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:29.712392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:29.712420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602988326546863:5696], now have 1 active actors on pipe
2025-10-10T14:40:29.712431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602988326546703:2438], now have 1 active actors on pipe
2025-10-10T14:40:29.712439Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602987544292972:13152]
2025-10-10T14:40:29.712441Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602987544292972:13152]
2025-10-10T14:40:29.712443Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602987544292972:13152]
2025-10-10T14:40:29.712457Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:29.712470Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:29.712472Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:29.712480Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:29.712482Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:29.712490Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:29.712493Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:29.712500Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3326
2025-10-10T14:40:29.712505Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3326
2025-10-10T14:40:29.712523Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602987544292972:13152]
2025-10-10T14:40:29.712531Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:29.712534Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:29.712564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:29.712570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:29.712620Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|16b12806-6acd7eaa-c1591e5-3ad3ba62_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:29.712632Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:29.712637Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:29.712644Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:29.712656Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:29.712671Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:29.712698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:29.712858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:29.712866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:29.712881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:29.712976Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3327 partition: 0 MaxSeqNo: 40 sessionId: src_id|16b12806-6acd7eaa-c1591e5-3ad3ba62_0
2025-10-10T14:40:29.713467Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c80a318-bead232a-a7e5417-1a225d14_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|16b12806-6acd7eaa-c1591e5-3ad3ba62_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:29.716241Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|16b12806-6acd7eaa-c1591e5-3ad3ba62_0] Write session: try to update token
2025-10-10T14:40:29.716264Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|16b12806-6acd7eaa-c1591e5-3ad3ba62_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:29.731837Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3327 sessionId: src_id|16b12806-6acd7eaa-c1591e5-3ad3ba62_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:29.732700Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:29.732722Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:29.732726Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:29.732728Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:29.732738Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602987544292972:13152]
2025-10-10T14:40:29.732743Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602987544292972:13152]
2025-10-10T14:40:29.732749Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602987544292972:13152]
2025-10-10T14:40:29.732794Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:29.732800Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:29.732805Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:29.732808Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:29.732810Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:29.732811Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:29.732983Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:29.734712Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:29.790438Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602988326546875:5396]
2025-10-10T14:40:29.790789Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 pipe creation result: OK TabletId: 72075186224037892 Generation: 3326, pipe: [1:7559602988326546875:5396]
2025-10-10T14:40:29.856186Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:29.856528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:29.856544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:29.856591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602988326546875:5396], now have 1 active actors on pipe
2025-10-10T14:40:29.856956Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:29.856959Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:40:29.856964Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:40:29.857023Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 25 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602988326546875:5396]
2025-10-10T14:40:29.857041Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3327 reason: error at write: Disconnected sessionId: src_id|16b12806-6acd7eaa-c1591e5-3ad3ba62_0
2025-10-10T14:40:29.857239Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3327 sessionId: src_id|16b12806-6acd7eaa-c1591e5-3ad3ba62_0 is DEAD
2025-10-10T14:40:29.857053Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:29.857453Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|16b12806-6acd7eaa-c1591e5-3ad3ba62_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:40:29.857465Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|16b12806-6acd7eaa-c1591e5-3ad3ba62_0] Write session will restart in 0.005263s
2025-10-10T14:40:29.857488Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|16b12806-6acd7eaa-c1591e5-3ad3ba62_0] Write session: Do CDS request
2025-10-10T14:40:29.857494Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|16b12806-6acd7eaa-c1591e5-3ad3ba62_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:29.863960Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|16b12806-6acd7eaa-c1591e5-3ad3ba62_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:29.864867Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:29.864883Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3328
2025-10-10T14:40:29.865027Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3328 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:29.865064Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3328 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:29.865076Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3328 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:29.865080Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:29.865576Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3328 sessionId:  describe result for acl check
2025-10-10T14:40:29.865617Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:29.865623Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:29.865626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:29.865632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602988326546892:5707] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:29.866197Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602988326546892:5707] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:29.868232Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602988326546892:5707] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:29.872077Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602988326546892:5707] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:29.872101Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602988326546892:5707] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:29.872105Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602988326546892:5707] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:29.872114Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3328 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:29.875466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:29.877818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:29.878090Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:29.878103Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:29.878116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:29.878180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:29.878231Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602987544293161:13155]
2025-10-10T14:40:29.878888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:29.879250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:29.879311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:29.879846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:29.879941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:29.879947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:29.879949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:29.879950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:29.879951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:29.879953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:29.879954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:29.879955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:29.879956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:29.879958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:29.879960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:29.879961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:29.879962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:29.879969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:29.879983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:29.879988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:29.879992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:29.879996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:29.880001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:29.880005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:29.880009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:29.880013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:29.880018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:29.880030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:29.880034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:29.880038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:29.880047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:29.880057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:29.880064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:29.880069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:29.880073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:29.880087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:29.880093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:29.880099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:29.880103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:29.880109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:29.880114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:29.880119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:29.880126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:29.880137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:29.880142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:29.880148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:29.880155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:29.880160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:29.880164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:29.880169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:29.880174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:29.880179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:29.880183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:29.880188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:29.880193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:29.880198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:29.880240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:29.882832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:29.883185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:29.883199Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:29.883201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:29.883205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:29.883212Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3327 [2:7559602987544293161:13155]
2025-10-10T14:40:29.883227Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:29.883246Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:29.883255Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:29.883260Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:29.883262Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:29.883281Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:29.883293Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:29.883302Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:29.883375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:29.883383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:29.883385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:29.883388Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:29.883479Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:29.883487Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:29.883500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:29.883512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:29.883532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:29.883561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602988326546996:5707], now have 1 active actors on pipe
2025-10-10T14:40:29.883571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602988326546878:2438], now have 1 active actors on pipe
2025-10-10T14:40:29.883579Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602987544293156:13155]
2025-10-10T14:40:29.883582Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602987544293156:13155]
2025-10-10T14:40:29.883584Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602987544293156:13155]
2025-10-10T14:40:29.883597Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:29.883614Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:29.883616Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:29.883623Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:29.883625Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:29.883632Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:29.883635Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:29.883628Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3327
2025-10-10T14:40:29.883644Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3327
2025-10-10T14:40:29.883664Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602987544293156:13155]
2025-10-10T14:40:29.883679Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:29.883686Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:29.883893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:29.883909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:29.883965Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|627a6edc-1dcb65b4-33e5b49d-7c339fd0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:29.883979Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:29.883989Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:29.883992Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:29.884005Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:29.884025Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:29.884043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:29.884310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:29.884320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:29.884341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:29.884449Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3328 partition: 0 MaxSeqNo: 40 sessionId: src_id|627a6edc-1dcb65b4-33e5b49d-7c339fd0_0
2025-10-10T14:40:29.884870Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|16b12806-6acd7eaa-c1591e5-3ad3ba62_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|627a6edc-1dcb65b4-33e5b49d-7c339fd0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:29.887696Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|627a6edc-1dcb65b4-33e5b49d-7c339fd0_0] Write session: try to update token
2025-10-10T14:40:29.887714Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|627a6edc-1dcb65b4-33e5b49d-7c339fd0_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:29.904911Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3328 sessionId: src_id|627a6edc-1dcb65b4-33e5b49d-7c339fd0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:29.905546Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:40:29.905565Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:29.905576Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602987544293156:13155]
2025-10-10T14:40:29.905630Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:40:29.905645Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:40:29.905833Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:40:29.906007Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:29.906187Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:29.906332Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:29.906535Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:40:29.906571Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:40:29.907701Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:29.907895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:29.907915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:29.907966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:40:29.908047Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:40:29.917182Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:29.917199Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:29.917203Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:29.917205Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:29.917216Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602987544293156:13155]
2025-10-10T14:40:29.917221Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602987544293156:13155]
2025-10-10T14:40:29.917224Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602987544293156:13155]
2025-10-10T14:40:29.917270Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:29.917270Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:29.917279Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:29.917279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:29.917282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:29.917284Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:29.917461Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:29.957650Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602988326547061:5396]
2025-10-10T14:40:29.957971Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 pipe creation result: OK TabletId: 72075186224037892 Generation: 3327, pipe: [1:7559602988326547061:5396]
2025-10-10T14:40:30.032551Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:30.041240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:30.041274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:30.041484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:30.041556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:30.041626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:30.041695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:30.042216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:30.042234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:30.042311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:30.042379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:30.042456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:30.042524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:30.042571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:30.042574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:30.042647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:30.042758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:30.042866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:30.042938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:30.042983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:30.042989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:30.043066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:30.043133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:30.043199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:30.043267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:30.043325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:30.043331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:30.043408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:30.043470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:30.043534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:30.043601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:30.043651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:30.043659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:30.043737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:30.043816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:30.043900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:30.043976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:30.044027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:30.044033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:30.044120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:30.044185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:30.044260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:30.044331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:30.044449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:30.044455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:30.044527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:30.044603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:30.044673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:30.044747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:30.044803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:30.044812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:30.044889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:30.044954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:30.045025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:30.045093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:30.045140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:30.045147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:30.045218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:30.045295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:30.045387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:30.045459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:30.045523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:30.045531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:30.045602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602988326547061:5396], now have 1 active actors on pipe
2025-10-10T14:40:30.045874Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 26 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602988326547061:5396]
2025-10-10T14:40:30.045893Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:40:30.045907Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:30.045911Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:40:30.045947Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3328 reason: error at write: Disconnected sessionId: src_id|627a6edc-1dcb65b4-33e5b49d-7c339fd0_0
2025-10-10T14:40:30.046215Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3328 sessionId: src_id|627a6edc-1dcb65b4-33e5b49d-7c339fd0_0 is DEAD
2025-10-10T14:40:30.046347Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:30.046411Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|627a6edc-1dcb65b4-33e5b49d-7c339fd0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:40:30.046424Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|627a6edc-1dcb65b4-33e5b49d-7c339fd0_0] Write session will restart in 0.009159s
2025-10-10T14:40:30.046463Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|627a6edc-1dcb65b4-33e5b49d-7c339fd0_0] Write session: Do CDS request
2025-10-10T14:40:30.046470Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|627a6edc-1dcb65b4-33e5b49d-7c339fd0_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:30.056999Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|627a6edc-1dcb65b4-33e5b49d-7c339fd0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:30.057637Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:30.057655Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3329
2025-10-10T14:40:30.061469Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3329 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:30.061526Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3329 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:30.061532Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3329 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:30.061537Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:30.062117Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3329 sessionId:  describe result for acl check
2025-10-10T14:40:30.062155Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:30.062161Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:30.062163Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:30.062171Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602992621514505:5714] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:30.062774Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602992621514505:5714] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:30.063095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:30.065680Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602992621514505:5714] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:30.065801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:30.066229Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:30.066247Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:30.066261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:30.066328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:30.066370Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602991839260628:13157]
2025-10-10T14:40:30.066939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:30.067315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:30.067358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:30.067652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:30.067714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:30.067721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:30.067722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:30.067723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:30.067724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:30.067725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:30.067726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:30.067727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:30.067728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:30.067729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:30.067731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:30.067731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:30.067732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:30.067738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:30.067751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:30.067754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:30.067757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:30.067760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:30.067764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:30.067767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:30.067770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:30.067774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:30.067777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:30.067781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:30.067784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:30.067788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:30.067797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:30.067805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:30.067812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:30.067817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:30.067820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:30.067825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:30.067829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:30.067834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:30.067837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:30.067841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:30.067845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:30.067850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:30.067854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:30.067858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:30.067862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:30.067866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:30.067870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:30.067874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:30.067878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:30.067882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:30.067886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:30.067890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:30.067893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:30.067898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:30.067902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:30.067907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:30.067939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:30.069114Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602992621514505:5714] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:30.069130Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602992621514505:5714] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:30.069134Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602992621514505:5714] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:30.069143Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3329 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:30.070694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:30.071083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:30.071101Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:30.071103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:30.071108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:30.071116Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3328 [2:7559602991839260628:13157]
2025-10-10T14:40:30.071131Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:30.071152Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:30.071162Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:30.071183Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:30.071186Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:30.071206Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:30.071223Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:30.071238Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:30.071322Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:30.071332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:30.071336Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:30.071338Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:30.071414Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:30.071423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:30.071437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:30.071453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:30.071470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:30.071499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602992621514540:5714], now have 1 active actors on pipe
2025-10-10T14:40:30.071509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602992621514372:2438], now have 1 active actors on pipe
2025-10-10T14:40:30.071517Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602991839260623:13157]
2025-10-10T14:40:30.071519Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602991839260623:13157]
2025-10-10T14:40:30.071521Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602991839260623:13157]
2025-10-10T14:40:30.071536Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:30.071554Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:30.071555Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:30.071569Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:30.071571Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:30.071573Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:30.071577Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:30.071572Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3328
2025-10-10T14:40:30.071612Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602991839260623:13157]
2025-10-10T14:40:30.071572Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3328
2025-10-10T14:40:30.071624Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:30.071632Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:30.071781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:30.071796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:30.071831Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|53305c91-ddc2da83-8208a3fa-ed61db36_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:30.071846Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:30.071851Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:30.071854Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:30.071866Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:30.071879Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:30.071895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:30.072102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:30.072111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:30.072128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:30.072222Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3329 partition: 0 MaxSeqNo: 40 sessionId: src_id|53305c91-ddc2da83-8208a3fa-ed61db36_0
2025-10-10T14:40:30.072667Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|627a6edc-1dcb65b4-33e5b49d-7c339fd0_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|53305c91-ddc2da83-8208a3fa-ed61db36_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:30.075424Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|53305c91-ddc2da83-8208a3fa-ed61db36_0] Write session: try to update token
2025-10-10T14:40:30.075449Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|53305c91-ddc2da83-8208a3fa-ed61db36_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:30.083597Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:40:30.083620Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:30.083633Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602991839260623:13157]
2025-10-10T14:40:30.083687Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:40:30.083688Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:40:30.083869Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:40:30.084025Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:30.084189Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:30.084332Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:30.084544Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:40:30.084596Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:40:30.090756Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3329 sessionId: src_id|53305c91-ddc2da83-8208a3fa-ed61db36_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:30.094033Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:30.094302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:30.094326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:30.094382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:40:30.094510Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:40:30.102311Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:30.102333Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:30.102337Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:30.102340Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:30.102353Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602991839260623:13157]
2025-10-10T14:40:30.102358Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602991839260623:13157]
2025-10-10T14:40:30.102367Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602991839260623:13157]
2025-10-10T14:40:30.102422Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:30.102423Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:30.102430Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:30.102436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:30.102438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:30.102439Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:30.102586Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:30.137581Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:155: [72075186224037893][rt3.dc1--test-topic] TPersQueueReadBalancer::HandleWakeup
2025-10-10T14:40:30.137629Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 19
2025-10-10T14:40:30.146223Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602992621514550:5396]
2025-10-10T14:40:30.146530Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 pipe creation result: OK TabletId: 72075186224037892 Generation: 3328, pipe: [1:7559602992621514550:5396]
2025-10-10T14:40:30.242777Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:30.251747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:30.251782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:30.251975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:30.252045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:30.252133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:30.252203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:30.252255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:30.252265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:30.252352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:30.252420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:30.252489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:30.252564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:30.252612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:30.252620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:30.252689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:30.252771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:30.252842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:30.252915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:30.253031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:30.253040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:30.253148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:30.253212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:30.253318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:30.253406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:30.253594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:30.253607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:30.253683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:30.253741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:30.253808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:30.253878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:30.253993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:30.254003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:30.254113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:30.254209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:30.254277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:30.254346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:30.254394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:30.254401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:30.254512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:30.254582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:30.254650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:30.254715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:30.254757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:30.254769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:30.254842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:30.254906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:30.254975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:30.255042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:30.255091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:30.255098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:30.255166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:30.255230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:30.255299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:30.255366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:30.255414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:30.255420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:30.255492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:30.255559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:30.255624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:30.255693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:30.255739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:30.255745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:30.255865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602992621514550:5396], now have 1 active actors on pipe
2025-10-10T14:40:30.256687Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53305c91-ddc2da83-8208a3fa-ed61db36_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:40:30.256711Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53305c91-ddc2da83-8208a3fa-ed61db36_0] Write session will restart in 0.005495s
2025-10-10T14:40:30.256183Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:40:30.256738Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53305c91-ddc2da83-8208a3fa-ed61db36_0] Write session: Do CDS request
2025-10-10T14:40:30.256745Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53305c91-ddc2da83-8208a3fa-ed61db36_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:30.256198Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:40:30.256219Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:30.256234Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3329 reason: error at write: Disconnected sessionId: src_id|53305c91-ddc2da83-8208a3fa-ed61db36_0
2025-10-10T14:40:30.256235Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 19
2025-10-10T14:40:30.256296Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 27 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602992621514550:5396]
2025-10-10T14:40:30.256495Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3329 sessionId: src_id|53305c91-ddc2da83-8208a3fa-ed61db36_0 is DEAD
2025-10-10T14:40:30.257103Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:30.263949Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|53305c91-ddc2da83-8208a3fa-ed61db36_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:30.264047Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:30.264062Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3330
2025-10-10T14:40:30.264226Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3330 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:30.264260Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3330 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:30.264271Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3330 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:30.264275Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:30.264665Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3330 sessionId:  describe result for acl check
2025-10-10T14:40:30.264696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:30.264700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:30.264704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:30.264709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602992621514567:5724] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:30.265626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602992621514567:5724] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:30.269288Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602992621514567:5724] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:30.272561Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602992621514567:5724] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:30.272578Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602992621514567:5724] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:30.272582Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602992621514567:5724] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:30.272591Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3330 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:30.273422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:30.275582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:30.275852Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:30.275865Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:30.275877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:30.275941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:30.275990Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602991839260804:13160]
2025-10-10T14:40:30.276629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:30.277056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:30.277124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:30.277533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:30.277611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:30.277619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:30.277621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:30.277622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:30.277624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:30.277625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:30.277627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:30.277628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:30.277629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:30.277630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:30.277631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:30.277632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:30.277633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:30.277640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:30.277653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:30.277657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:30.277661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:30.277666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:30.277670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:30.277674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:30.277678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:30.277683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:30.277687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:30.277692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:30.277697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:30.277701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:30.277710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:30.277721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:30.277728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:30.277735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:30.277740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:30.277746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:30.277759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:30.277770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:30.277776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:30.277787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:30.277792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:30.277804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:30.277810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:30.277821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:30.277826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:30.277837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:30.277842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:30.277852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:30.277858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:30.277864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:30.277871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:30.277882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:30.277887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:30.277897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:30.277903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:30.277925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:30.277969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:30.280566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:30.281006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:30.281023Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:30.281025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:30.281030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:30.281037Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3329 [2:7559602991839260804:13160]
2025-10-10T14:40:30.281052Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:30.281073Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:30.281081Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:30.281086Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:30.281089Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:30.281108Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:30.281121Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:30.281134Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:30.281210Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:30.281221Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:30.281224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:30.281227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:30.281309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:30.281322Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:30.281357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:30.281370Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:30.281394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:30.281423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602992621514715:5724], now have 1 active actors on pipe
2025-10-10T14:40:30.281432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602992621514552:2438], now have 1 active actors on pipe
2025-10-10T14:40:30.281441Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602991839260799:13160]
2025-10-10T14:40:30.281444Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602991839260799:13160]
2025-10-10T14:40:30.281446Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602991839260799:13160]
2025-10-10T14:40:30.281473Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:30.281494Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:30.281494Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:30.281479Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3329
2025-10-10T14:40:30.281499Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:30.281501Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:30.281485Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3329
2025-10-10T14:40:30.281517Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:30.281525Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:30.281568Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602991839260799:13160]
2025-10-10T14:40:30.281581Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:30.281597Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:30.281597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:30.281602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:30.281673Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3bd98562-a07a1d7-35d2eeaf-93dba895_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:30.281686Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:30.281692Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:30.281694Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:30.281709Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:30.281727Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:30.281784Z node 2 :PERSQUEUE DEBUG: partition.cpp:1000: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 80296142 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-10-10T14:40:30.281830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:30.282034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:30.282034Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 9 Generation: 1 StatsReportRound: 24 DataSize: 80296142 UsedReserveSize: 0
2025-10-10T14:40:30.282045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:30.282065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:30.282076Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-10-10T14:40:30.282173Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3330 partition: 0 MaxSeqNo: 40 sessionId: src_id|3bd98562-a07a1d7-35d2eeaf-93dba895_0
2025-10-10T14:40:30.282608Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53305c91-ddc2da83-8208a3fa-ed61db36_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|3bd98562-a07a1d7-35d2eeaf-93dba895_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:30.285507Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3bd98562-a07a1d7-35d2eeaf-93dba895_0] Write session: try to update token
2025-10-10T14:40:30.285532Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3bd98562-a07a1d7-35d2eeaf-93dba895_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:30.300165Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3330 sessionId: src_id|3bd98562-a07a1d7-35d2eeaf-93dba895_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:30.301755Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:30.301776Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:30.301779Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:30.301781Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:30.301790Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602991839260799:13160]
2025-10-10T14:40:30.301794Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602991839260799:13160]
2025-10-10T14:40:30.301798Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602991839260799:13160]
2025-10-10T14:40:30.301850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:30.301851Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:30.301858Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:30.301862Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:30.301863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:30.301867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:30.302010Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:30.302948Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:30.356700Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602992621514756:5396]
2025-10-10T14:40:30.357009Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 pipe creation result: OK TabletId: 72075186224037892 Generation: 3329, pipe: [1:7559602992621514756:5396]
2025-10-10T14:40:30.420285Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:30.420854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:30.420871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:30.420920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602992621514756:5396], now have 1 active actors on pipe
2025-10-10T14:40:30.421192Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:30.421174Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 28 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602992621514756:5396]
2025-10-10T14:40:30.421177Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:40:30.421181Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:40:30.421208Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:30.421272Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3330 reason: error at write: Disconnected sessionId: src_id|3bd98562-a07a1d7-35d2eeaf-93dba895_0
2025-10-10T14:40:30.421519Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3330 sessionId: src_id|3bd98562-a07a1d7-35d2eeaf-93dba895_0 is DEAD
2025-10-10T14:40:30.421887Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3bd98562-a07a1d7-35d2eeaf-93dba895_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:40:30.421900Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3bd98562-a07a1d7-35d2eeaf-93dba895_0] Write session will restart in 0.007807s
2025-10-10T14:40:30.421937Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3bd98562-a07a1d7-35d2eeaf-93dba895_0] Write session: Do CDS request
2025-10-10T14:40:30.421946Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3bd98562-a07a1d7-35d2eeaf-93dba895_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:30.430947Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3bd98562-a07a1d7-35d2eeaf-93dba895_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:30.431037Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:30.431052Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3331
2025-10-10T14:40:30.431232Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3331 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:30.431265Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3331 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:30.431271Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3331 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:30.431276Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:30.431748Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3331 sessionId:  describe result for acl check
2025-10-10T14:40:30.431785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:30.431787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:30.431789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:30.431796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602992621514798:5747] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:30.432435Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602992621514798:5747] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:30.435566Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602992621514798:5747] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:30.438790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:30.438794Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602992621514798:5747] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:30.438808Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602992621514798:5747] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:30.438812Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602992621514798:5747] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:30.438821Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3331 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:30.441182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:30.441447Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:30.441459Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:30.441472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:30.441539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:30.441578Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602991839261019:13177]
2025-10-10T14:40:30.442151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:30.442476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:30.442527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:30.442842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:30.442910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:30.442917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:30.442918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:30.442919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:30.442920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:30.442922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:30.442923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:30.442924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:30.442925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:30.442926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:30.442927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:30.442928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:30.442929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:30.442935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:30.442947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:30.442951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:30.442955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:30.442959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:30.442964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:30.442967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:30.442971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:30.442975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:30.442978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:30.442982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:30.442985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:30.442988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:30.442997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:30.443006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:30.443013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:30.443018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:30.443022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:30.443027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:30.443031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:30.443036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:30.443041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:30.443046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:30.443050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:30.443055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:30.443059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:30.443064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:30.443068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:30.443073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:30.443077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:30.443082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:30.443086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:30.443091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:30.443096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:30.443100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:30.443107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:30.443117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:30.443122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:30.443128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:30.443165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:30.445988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:30.446508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:30.446531Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:30.446533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:30.446537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:30.446545Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3330 [2:7559602991839261019:13177]
2025-10-10T14:40:30.446561Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:30.446583Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:30.446586Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:30.446590Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:30.446593Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:30.446613Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:30.446623Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:30.446638Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:30.446714Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:30.446722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:30.446725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:30.446728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:30.446804Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:30.446812Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:30.446827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:30.446845Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:30.446869Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:30.446897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602992621514760:2438], now have 1 active actors on pipe
2025-10-10T14:40:30.446907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602992621514925:5747], now have 1 active actors on pipe
2025-10-10T14:40:30.446916Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602991839261013:13177]
2025-10-10T14:40:30.446919Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602991839261013:13177]
2025-10-10T14:40:30.446921Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602991839261013:13177]
2025-10-10T14:40:30.446935Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:30.446949Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:30.446952Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:30.446960Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:30.446963Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:30.446971Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:30.446974Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:30.446981Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3330
2025-10-10T14:40:30.447013Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602991839261013:13177]
2025-10-10T14:40:30.447029Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3330
2025-10-10T14:40:30.447030Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:30.447040Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:30.447226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:30.447238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:30.447271Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|48672398-f54bb0a-f77aad59-9ff03e4e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:30.447289Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:30.447294Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:30.447297Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:30.447310Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:30.447322Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:30.447339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:30.447508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:30.447516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:30.447547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:30.447638Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3331 partition: 0 MaxSeqNo: 40 sessionId: src_id|48672398-f54bb0a-f77aad59-9ff03e4e_0
2025-10-10T14:40:30.448104Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3bd98562-a07a1d7-35d2eeaf-93dba895_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|48672398-f54bb0a-f77aad59-9ff03e4e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:30.451162Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|48672398-f54bb0a-f77aad59-9ff03e4e_0] Write session: try to update token
2025-10-10T14:40:30.451184Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|48672398-f54bb0a-f77aad59-9ff03e4e_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:30.459496Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:40:30.459521Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:30.459532Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602991839261013:13177]
2025-10-10T14:40:30.459588Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:40:30.459578Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:40:30.459786Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:40:30.459950Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:30.460120Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:30.460288Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:30.460588Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:40:30.460648Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:40:30.466377Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3331 sessionId: src_id|48672398-f54bb0a-f77aad59-9ff03e4e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:30.469285Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:30.469580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:30.469604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:30.469654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:40:30.469819Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:40:30.478482Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:30.478505Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:30.478509Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:30.478511Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:30.478524Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602991839261013:13177]
2025-10-10T14:40:30.478529Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602991839261013:13177]
2025-10-10T14:40:30.478534Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602991839261013:13177]
2025-10-10T14:40:30.478589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:30.478593Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:30.478601Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:30.478603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:30.478605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:30.478608Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:30.478821Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:30.521569Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602992621514938:5396]
2025-10-10T14:40:30.521904Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 pipe creation result: OK TabletId: 72075186224037892 Generation: 3330, pipe: [1:7559602992621514938:5396]
2025-10-10T14:40:30.595776Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:30.605570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:30.605596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:30.605788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:30.605865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:30.605945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:30.606012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:30.606060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:30.606074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:30.606152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:30.606221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:30.606294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:30.606366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:30.606416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:30.606419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:30.606492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:30.606560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:30.606626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:30.606695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:30.606740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:30.606746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:30.606818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:30.606894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:30.606967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:30.607040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:30.607084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:30.607087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:30.607162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:30.607224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:30.607290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:30.607357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:30.607399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:30.607402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:30.607477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:30.607541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:30.607604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:30.607671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:30.607728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:30.607732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:30.607808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:30.607882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:30.607964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:30.608037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:30.608096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:30.608098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:30.608172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:30.608241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:30.608312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:30.608389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:30.608438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:30.608442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:30.608524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:30.608587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:30.608654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:30.608725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:30.608774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:30.608778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:30.608858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:30.608920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:30.608984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:30.609050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:30.609196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:30.609199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:30.609276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602992621514938:5396], now have 1 active actors on pipe
2025-10-10T14:40:30.609527Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:40:30.609543Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:40:30.609581Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3331 reason: error at write: Disconnected sessionId: src_id|48672398-f54bb0a-f77aad59-9ff03e4e_0
2025-10-10T14:40:30.609796Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 29 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602992621514938:5396]
2025-10-10T14:40:30.609822Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:30.609978Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3331 sessionId: src_id|48672398-f54bb0a-f77aad59-9ff03e4e_0 is DEAD
2025-10-10T14:40:30.610772Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:30.613439Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|48672398-f54bb0a-f77aad59-9ff03e4e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:40:30.613455Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|48672398-f54bb0a-f77aad59-9ff03e4e_0] Write session will restart in 0.009274s
2025-10-10T14:40:30.613485Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|48672398-f54bb0a-f77aad59-9ff03e4e_0] Write session: Do CDS request
2025-10-10T14:40:30.613492Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|48672398-f54bb0a-f77aad59-9ff03e4e_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:30.624079Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|48672398-f54bb0a-f77aad59-9ff03e4e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:30.624083Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:30.624100Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3332
2025-10-10T14:40:30.624323Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3332 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:30.624385Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3332 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:30.624397Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3332 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:30.624402Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:30.624885Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3332 sessionId:  describe result for acl check
2025-10-10T14:40:30.624922Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:30.624928Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:30.624930Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:30.624937Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602992621515051:5756] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:30.625577Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602992621515051:5756] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:30.628136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:30.628910Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602992621515051:5756] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:30.630485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:30.630727Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:30.630738Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:30.630751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:30.630807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:30.630851Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602991839261194:13179]
2025-10-10T14:40:30.631495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:30.631823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:30.631892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:30.632146Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602992621515051:5756] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:30.632163Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602992621515051:5756] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:30.632168Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602992621515051:5756] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:30.632179Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3332 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:30.632284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:30.632365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:30.632373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:30.632374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:30.632376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:30.632377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:30.632378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:30.632380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:30.632381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:30.632382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:30.632383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:30.632385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:30.632386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:30.632387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:30.632394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:30.632409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:30.632414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:30.632419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:30.632423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:30.632427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:30.632435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:30.632439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:30.632443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:30.632448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:30.632452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:30.632456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:30.632461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:30.632470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:30.632480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:30.632487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:30.632493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:30.632498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:30.632504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:30.632509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:30.632522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:30.632526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:30.632536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:30.632542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:30.632553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:30.632558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:30.632564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:30.632568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:30.632578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:30.632584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:30.632595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:30.632599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:30.632605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:30.632610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:30.632616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:30.632620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:30.632626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:30.632636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:30.632642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:30.632693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:30.637892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:30.638358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:30.638370Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:30.638373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:30.638377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:30.638386Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3331 [2:7559602991839261194:13179]
2025-10-10T14:40:30.638401Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:30.638422Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:30.638431Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:30.638434Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:30.638438Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:30.638457Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:30.638464Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:30.638473Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:30.638541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:30.638547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:30.638549Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:30.638552Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:30.638627Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:30.638631Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:30.638644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:30.638663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:30.638680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:30.638714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602992621514940:2438], now have 1 active actors on pipe
2025-10-10T14:40:30.638726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602992621515108:5756], now have 1 active actors on pipe
2025-10-10T14:40:30.638736Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602991839261189:13179]
2025-10-10T14:40:30.638738Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602991839261189:13179]
2025-10-10T14:40:30.638740Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602991839261189:13179]
2025-10-10T14:40:30.638756Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:30.638771Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:30.638793Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:30.638802Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:30.638838Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602991839261189:13179]
2025-10-10T14:40:30.638846Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:30.638878Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3331
2025-10-10T14:40:30.638885Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3331
2025-10-10T14:40:30.638915Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:30.638922Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:30.638924Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:30.638930Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:30.639175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:30.639186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:30.639219Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5d2ed053-9c004c52-dbadff35-59f64b29_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:30.639233Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:30.639237Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:30.639240Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:30.639253Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:30.639264Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:30.639288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:30.639568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:30.639578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:30.639596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:30.639725Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3332 partition: 0 MaxSeqNo: 40 sessionId: src_id|5d2ed053-9c004c52-dbadff35-59f64b29_0
2025-10-10T14:40:30.640212Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|48672398-f54bb0a-f77aad59-9ff03e4e_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|5d2ed053-9c004c52-dbadff35-59f64b29_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:30.643001Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5d2ed053-9c004c52-dbadff35-59f64b29_0] Write session: try to update token
2025-10-10T14:40:30.643027Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5d2ed053-9c004c52-dbadff35-59f64b29_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:30.651027Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:40:30.651044Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:30.651055Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602991839261189:13179]
2025-10-10T14:40:30.651105Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:40:30.651126Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:40:30.651333Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:40:30.651517Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:30.651678Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:30.651861Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:30.652107Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:40:30.652150Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:40:30.659479Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3332 sessionId: src_id|5d2ed053-9c004c52-dbadff35-59f64b29_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:30.662244Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:30.662529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:30.662555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:30.662611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:40:30.662715Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:40:30.670650Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:30.670672Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:30.670676Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:30.670679Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:30.670691Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602991839261189:13179]
2025-10-10T14:40:30.670695Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602991839261189:13179]
2025-10-10T14:40:30.670701Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602991839261189:13179]
2025-10-10T14:40:30.670753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:30.670757Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:30.670763Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:30.670768Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:30.670768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:30.670771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:30.670915Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:30.709987Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602992621515119:5396]
2025-10-10T14:40:30.710410Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 pipe creation result: OK TabletId: 72075186224037892 Generation: 3331, pipe: [1:7559602992621515119:5396]
2025-10-10T14:40:30.796506Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:30.805004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:30.805041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:30.805230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:30.805303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:30.805408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:30.805487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:30.806038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:30.806044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:30.806120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:30.806181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:30.806251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:30.806315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:30.806354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:30.806356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:30.806429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:30.806494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:30.806554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:30.806614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:30.806658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:30.806677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:30.806753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:30.806818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:30.806883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:30.806949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:30.806989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:30.806992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:30.807063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:30.807127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:30.807192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:30.807258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:30.807300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:30.807303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:30.807385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:30.807447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:30.807511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:30.807577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:30.807619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:30.807622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:30.807701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:30.807763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:30.807834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:30.807901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:30.808037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:30.808041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:30.808125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:30.808190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:30.808249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:30.808307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:30.808368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:30.808370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:30.808445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:30.808507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:30.808570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:30.808637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:30.808680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:30.808683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:30.808756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:30.808818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:30.808887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:30.808951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:30.809012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:30.809014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:30.809095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602992621515119:5396], now have 1 active actors on pipe
2025-10-10T14:40:30.809922Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:30.809548Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 30 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602992621515119:5396]
2025-10-10T14:40:30.809589Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:30.809601Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:40:30.809604Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:40:30.809637Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3332 reason: error at write: Disconnected sessionId: src_id|5d2ed053-9c004c52-dbadff35-59f64b29_0
2025-10-10T14:40:30.809883Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3332 sessionId: src_id|5d2ed053-9c004c52-dbadff35-59f64b29_0 is DEAD
2025-10-10T14:40:30.813624Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d2ed053-9c004c52-dbadff35-59f64b29_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:40:30.813635Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d2ed053-9c004c52-dbadff35-59f64b29_0] Write session will restart in 0.009356s
2025-10-10T14:40:30.813663Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d2ed053-9c004c52-dbadff35-59f64b29_0] Write session: Do CDS request
2025-10-10T14:40:30.813669Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d2ed053-9c004c52-dbadff35-59f64b29_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:30.824536Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5d2ed053-9c004c52-dbadff35-59f64b29_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:30.824612Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:30.824628Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3333
2025-10-10T14:40:30.825236Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3333 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:30.825272Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3333 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:30.825277Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3333 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:30.825281Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:30.825712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:30.825734Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3333 sessionId:  describe result for acl check
2025-10-10T14:40:30.825771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:30.825773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:30.825774Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:30.825781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602992621515260:5752] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:30.826311Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602992621515260:5752] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:30.828552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:30.828808Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:30.828822Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:30.828834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:30.828894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:30.828941Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602991839261370:13181]
2025-10-10T14:40:30.829633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:30.829977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:30.830031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:30.830347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:30.830422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:30.830429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:30.830430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:30.830431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:30.830433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:30.830434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:30.830435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:30.830436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:30.830437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:30.830438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:30.830440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:30.830441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:30.830442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:30.830449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:30.830461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:30.830466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:30.830470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:30.830473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:30.830477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:30.830480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:30.830484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:30.830487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:30.830491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:30.830495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:30.830498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:30.830502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:30.830510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:30.830518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:30.830526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:30.830531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:30.830536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:30.830541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:30.830545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:30.830550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:30.830555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:30.830560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:30.830565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:30.830570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:30.830575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:30.830580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:30.830584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:30.830589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:30.830594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:30.830599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:30.830603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:30.830607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:30.830612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:30.830617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:30.830622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:30.830627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:30.830633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:30.830638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:30.830675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:30.830681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602992621515260:5752] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:30.833513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:30.833595Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602992621515260:5752] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:30.833611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602992621515260:5752] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:30.833615Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602992621515260:5752] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:30.833624Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3333 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:30.833859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:30.833875Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:30.833878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:30.833882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:30.833890Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3332 [2:7559602991839261370:13181]
2025-10-10T14:40:30.833905Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:30.833930Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:30.833938Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:30.833942Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:30.833944Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:30.833977Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:30.833988Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:30.833995Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:30.834058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:30.834070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:30.834072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:30.834075Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:30.834150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:30.834158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:30.834171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:30.834186Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:30.834205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:30.834228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602992621515121:2438], now have 1 active actors on pipe
2025-10-10T14:40:30.834232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602992621515294:5752], now have 1 active actors on pipe
2025-10-10T14:40:30.834241Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602991839261365:13181]
2025-10-10T14:40:30.834243Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602991839261365:13181]
2025-10-10T14:40:30.834235Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3332
2025-10-10T14:40:30.834246Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602991839261365:13181]
2025-10-10T14:40:30.834255Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:30.834276Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3332
2025-10-10T14:40:30.834270Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:30.834270Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:30.834274Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:30.834276Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:30.834295Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:30.834299Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:30.834348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:30.834359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:30.834373Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602991839261365:13181]
2025-10-10T14:40:30.834389Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:30.834429Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|16e84547-fa361094-23a543a3-727cb231_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:30.834433Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:30.834442Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:30.834447Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:30.834449Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:30.834461Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:30.834472Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:30.834494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:30.834691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:30.834704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:30.834727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:30.834820Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3333 partition: 0 MaxSeqNo: 40 sessionId: src_id|16e84547-fa361094-23a543a3-727cb231_0
2025-10-10T14:40:30.835268Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d2ed053-9c004c52-dbadff35-59f64b29_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|16e84547-fa361094-23a543a3-727cb231_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:30.838131Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|16e84547-fa361094-23a543a3-727cb231_0] Write session: try to update token
2025-10-10T14:40:30.838156Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|16e84547-fa361094-23a543a3-727cb231_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:30.854451Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:30.854472Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:30.854477Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:30.854479Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:30.854490Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602991839261365:13181]
2025-10-10T14:40:30.854495Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602991839261365:13181]
2025-10-10T14:40:30.854499Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602991839261365:13181]
2025-10-10T14:40:30.854550Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:30.854555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:30.854558Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:30.854563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:30.854566Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:30.854566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:30.854714Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:30.855684Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3333 sessionId: src_id|16e84547-fa361094-23a543a3-727cb231_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:30.858493Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:30.909646Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602992621515306:5396]
2025-10-10T14:40:30.909942Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 pipe creation result: OK TabletId: 72075186224037892 Generation: 3332, pipe: [1:7559602992621515306:5396]
2025-10-10T14:40:30.978240Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:30.978835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:30.978856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:30.978906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602992621515306:5396], now have 1 active actors on pipe
2025-10-10T14:40:30.979143Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:30.979203Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:40:30.979217Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:40:30.979306Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3333 reason: error at write: Disconnected sessionId: src_id|16e84547-fa361094-23a543a3-727cb231_0
2025-10-10T14:40:30.979518Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3333 sessionId: src_id|16e84547-fa361094-23a543a3-727cb231_0 is DEAD
2025-10-10T14:40:30.979602Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:30.979653Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 31 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602992621515306:5396]
2025-10-10T14:40:30.979707Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|16e84547-fa361094-23a543a3-727cb231_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:40:30.979719Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|16e84547-fa361094-23a543a3-727cb231_0] Write session will restart in 0.007400s
2025-10-10T14:40:30.979745Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|16e84547-fa361094-23a543a3-727cb231_0] Write session: Do CDS request
2025-10-10T14:40:30.979751Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|16e84547-fa361094-23a543a3-727cb231_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:30.988934Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|16e84547-fa361094-23a543a3-727cb231_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:30.989055Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:30.989079Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3334
2025-10-10T14:40:30.989192Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3334 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:30.989223Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3334 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:30.989229Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3334 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:30.989233Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:30.989718Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3334 sessionId:  describe result for acl check
2025-10-10T14:40:30.989756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:30.989758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:30.989760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:30.989767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602992621515386:5773] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:30.990320Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602992621515386:5773] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:30.992821Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602992621515386:5773] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:30.995650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:30.995834Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602992621515386:5773] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:30.995847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602992621515386:5773] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:30.995851Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602992621515386:5773] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:30.995859Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3334 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:30.997885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:30.998163Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:30.998176Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:30.998190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:30.998252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:30.998292Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602991839261560:13184]
2025-10-10T14:40:30.998985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:30.999408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:30.999480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:30.999867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:30.999933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:30.999940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:30.999941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:30.999943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:30.999944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:30.999945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:30.999957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:30.999959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:30.999960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:30.999961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:30.999963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:30.999964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:30.999966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:30.999973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:30.999989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:30.999994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:30.999998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:31.000003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:31.000008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:31.000012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:31.000017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:31.000021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:31.000026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:31.000031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:31.000035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:31.000040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:31.000048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:31.000058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:31.000076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:31.000083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:31.000098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:31.000108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:31.000113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:31.000117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:31.000123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:31.000132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:31.000136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:31.000140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:31.000144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:31.000149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:31.000153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:31.000159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:31.000168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:31.000173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:31.000177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:31.000181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:31.000185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:31.000190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:31.000196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:31.000201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:31.000216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:31.000221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:31.000258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:31.002867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:31.003251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:31.003264Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:31.003267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:31.003271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:31.003277Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3333 [2:7559602991839261560:13184]
2025-10-10T14:40:31.003291Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:31.003308Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:31.003311Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:31.003315Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:31.003317Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:31.003336Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:31.003349Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:31.003357Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:31.003420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:31.003427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:31.003430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:31.003432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:31.003518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:31.003525Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:31.003536Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:31.003553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:31.003574Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:31.003600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602992621515492:5773], now have 1 active actors on pipe
2025-10-10T14:40:31.003661Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3333
2025-10-10T14:40:31.003609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602992621515326:2438], now have 1 active actors on pipe
2025-10-10T14:40:31.003667Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3333
2025-10-10T14:40:31.003617Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602991839261554:13184]
2025-10-10T14:40:31.003619Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602991839261554:13184]
2025-10-10T14:40:31.003622Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602991839261554:13184]
2025-10-10T14:40:31.003637Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:31.003650Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:31.003651Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:31.003654Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:31.003656Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:31.003668Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:31.003672Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:31.003701Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602991839261554:13184]
2025-10-10T14:40:31.003705Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:31.003707Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:31.003726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:31.003731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:31.003783Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|75215a07-c1652479-c79dd133-fd4ec50f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:31.003795Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:31.003800Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:31.003802Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:31.003815Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:31.003825Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:31.003854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:31.004036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:31.004045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:31.004059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:31.004168Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3334 partition: 0 MaxSeqNo: 40 sessionId: src_id|75215a07-c1652479-c79dd133-fd4ec50f_0
2025-10-10T14:40:31.004631Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|16e84547-fa361094-23a543a3-727cb231_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|75215a07-c1652479-c79dd133-fd4ec50f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:31.007344Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|75215a07-c1652479-c79dd133-fd4ec50f_0] Write session: try to update token
2025-10-10T14:40:31.007367Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|75215a07-c1652479-c79dd133-fd4ec50f_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:31.023087Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3334 sessionId: src_id|75215a07-c1652479-c79dd133-fd4ec50f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:31.023328Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:31.023345Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:31.023349Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:31.023351Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:31.023362Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602991839261554:13184]
2025-10-10T14:40:31.023367Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602991839261554:13184]
2025-10-10T14:40:31.023371Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602991839261554:13184]
2025-10-10T14:40:31.023423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:31.023430Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:31.023439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:31.023441Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:31.023442Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:31.023446Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:31.023584Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:31.026033Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:31.079597Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602996916482799:5396]
2025-10-10T14:40:31.079939Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 pipe creation result: OK TabletId: 72075186224037892 Generation: 3333, pipe: [1:7559602996916482799:5396]
2025-10-10T14:40:31.144483Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:31.145127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:31.145144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:31.145191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602996916482799:5396], now have 1 active actors on pipe
2025-10-10T14:40:31.145695Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:31.145703Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 32 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602996916482799:5396]
2025-10-10T14:40:31.145738Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:31.145775Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:40:31.145778Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:40:31.145841Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3334 reason: error at write: Disconnected sessionId: src_id|75215a07-c1652479-c79dd133-fd4ec50f_0
2025-10-10T14:40:31.146035Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3334 sessionId: src_id|75215a07-c1652479-c79dd133-fd4ec50f_0 is DEAD
2025-10-10T14:40:31.146202Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75215a07-c1652479-c79dd133-fd4ec50f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:40:31.146214Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75215a07-c1652479-c79dd133-fd4ec50f_0] Write session will restart in 0.009783s
2025-10-10T14:40:31.146237Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75215a07-c1652479-c79dd133-fd4ec50f_0] Write session: Do CDS request
2025-10-10T14:40:31.146247Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75215a07-c1652479-c79dd133-fd4ec50f_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:31.156984Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|75215a07-c1652479-c79dd133-fd4ec50f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:31.157079Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:31.157095Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3335
2025-10-10T14:40:31.157246Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3335 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:31.157292Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3335 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:31.157299Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3335 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:31.157305Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:31.157900Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3335 sessionId:  describe result for acl check
2025-10-10T14:40:31.157937Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:31.157948Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:31.157950Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:31.157957Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602996916482817:5777] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:31.158578Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602996916482817:5777] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:31.162157Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602996916482817:5777] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:31.166591Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602996916482817:5777] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:31.166610Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602996916482817:5777] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:31.166614Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602996916482817:5777] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:31.166625Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3335 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:31.171133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:31.173785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:31.174071Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:31.174086Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:31.174100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:31.174170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:31.174230Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602996134229034:13186]
2025-10-10T14:40:31.174926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:31.175346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:31.175410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:31.175777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:31.175855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:31.175862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:31.175864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:31.175865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:31.175867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:31.175869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:31.175870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:31.175872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:31.175873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:31.175874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:31.175876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:31.175877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:31.175878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:31.175885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:31.175899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:31.175904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:31.175908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:31.175924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:31.175928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:31.175932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:31.175936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:31.175941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:31.175946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:31.175950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:31.175954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:31.175975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:31.175989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:31.175999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:31.176007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:31.176013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:31.176018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:31.176024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:31.176028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:31.176034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:31.176040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:31.176045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:31.176050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:31.176056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:31.176077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:31.176089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:31.176094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:31.176105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:31.176111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:31.176117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:31.176121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:31.176127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:31.176132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:31.176139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:31.176144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:31.176149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:31.176154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:31.176162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:31.176202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:31.179150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:31.179706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:31.179720Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:31.179723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:31.179727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:31.179734Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3334 [2:7559602996134229034:13186]
2025-10-10T14:40:31.179749Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:31.179772Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:31.179775Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:31.179779Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:31.179788Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:31.179807Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:31.179820Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:31.179833Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:31.179906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:31.179916Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:31.179919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:31.179922Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:31.180006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:31.180016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:31.180031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:31.180045Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:31.180078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:31.180112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602996916482929:5777], now have 1 active actors on pipe
2025-10-10T14:40:31.180121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602996916482802:2438], now have 1 active actors on pipe
2025-10-10T14:40:31.180130Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602996134229029:13186]
2025-10-10T14:40:31.180137Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602996134229029:13186]
2025-10-10T14:40:31.180140Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602996134229029:13186]
2025-10-10T14:40:31.180155Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:31.180177Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:31.180194Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:31.180198Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:31.180200Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:31.180201Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:31.180204Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:31.180182Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3334
2025-10-10T14:40:31.180186Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3334
2025-10-10T14:40:31.180241Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602996134229029:13186]
2025-10-10T14:40:31.180249Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:31.180258Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:31.180277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:31.180287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:31.180332Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7da914bc-43b9ba39-7ea84016-3cdd20f7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:31.180346Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:31.180350Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:31.180353Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:31.180364Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:31.180376Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:31.180397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:31.180559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:31.180568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:31.180583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:31.180693Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3335 partition: 0 MaxSeqNo: 40 sessionId: src_id|7da914bc-43b9ba39-7ea84016-3cdd20f7_0
2025-10-10T14:40:31.181130Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75215a07-c1652479-c79dd133-fd4ec50f_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|7da914bc-43b9ba39-7ea84016-3cdd20f7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:31.184102Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7da914bc-43b9ba39-7ea84016-3cdd20f7_0] Write session: try to update token
2025-10-10T14:40:31.184127Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7da914bc-43b9ba39-7ea84016-3cdd20f7_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:31.200448Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:31.200472Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:31.200476Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:31.200479Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:31.200488Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602996134229029:13186]
2025-10-10T14:40:31.200492Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602996134229029:13186]
2025-10-10T14:40:31.200496Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602996134229029:13186]
2025-10-10T14:40:31.200548Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:31.200557Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:31.200562Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:31.200623Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:31.200640Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:31.200645Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:31.200702Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:31.200722Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3335 sessionId: src_id|7da914bc-43b9ba39-7ea84016-3cdd20f7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:31.203710Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:31.245485Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602996916482983:5396]
2025-10-10T14:40:31.245734Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 pipe creation result: OK TabletId: 72075186224037892 Generation: 3334, pipe: [1:7559602996916482983:5396]
2025-10-10T14:40:31.319745Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:31.320151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:31.320167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:31.320216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602996916482983:5396], now have 1 active actors on pipe
2025-10-10T14:40:31.320483Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:31.320527Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 33 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602996916482983:5396]
2025-10-10T14:40:31.320536Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:31.320565Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:40:31.320659Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3335 reason: status is not ok: tablet will be restarted right now sessionId: src_id|7da914bc-43b9ba39-7ea84016-3cdd20f7_0
2025-10-10T14:40:31.320867Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3335 sessionId: src_id|7da914bc-43b9ba39-7ea84016-3cdd20f7_0 is DEAD
2025-10-10T14:40:31.321043Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7da914bc-43b9ba39-7ea84016-3cdd20f7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:40:31.321056Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7da914bc-43b9ba39-7ea84016-3cdd20f7_0] Write session will restart in 0.009208s
2025-10-10T14:40:31.321083Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7da914bc-43b9ba39-7ea84016-3cdd20f7_0] Write session: Do CDS request
2025-10-10T14:40:31.321090Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7da914bc-43b9ba39-7ea84016-3cdd20f7_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:31.331962Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7da914bc-43b9ba39-7ea84016-3cdd20f7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:31.332028Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:31.332046Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3336
2025-10-10T14:40:31.332246Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3336 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:31.332287Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3336 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:31.332298Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3336 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:31.332303Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:31.332824Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3336 sessionId:  describe result for acl check
2025-10-10T14:40:31.332866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:31.332873Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:31.332875Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:31.332882Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602996916483115:5786] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:31.333498Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602996916483115:5786] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:31.335143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:31.335715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602996916483115:5786] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:31.337435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:31.337687Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:31.337702Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:31.337714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:31.337772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:31.337816Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602996134229212:13188]
2025-10-10T14:40:31.338400Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602996916483115:5786] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:31.338413Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602996916483115:5786] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:31.338417Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602996916483115:5786] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:31.338426Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3336 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:31.338456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:31.338785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:31.338835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:31.339181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:31.339245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:31.339252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:31.339254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:31.339255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:31.339256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:31.339258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:31.339260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:31.339261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:31.339262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:31.339264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:31.339265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:31.339267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:31.339268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:31.339274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:31.339289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:31.339293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:31.339298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:31.339302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:31.339306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:31.339310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:31.339315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:31.339319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:31.339324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:31.339328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:31.339332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:31.339336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:31.339344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:31.339353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:31.339360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:31.339366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:31.339372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:31.339378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:31.339382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:31.339393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:31.339398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:31.339404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:31.339409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:31.339429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:31.339438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:31.339444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:31.339449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:31.339454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:31.339459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:31.339465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:31.339470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:31.339476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:31.339485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:31.339490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:31.339499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:31.339505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:31.339510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:31.339517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:31.339559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:31.342179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:31.342528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:31.342542Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:31.342545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:31.342549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:31.342565Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3335 [2:7559602996134229212:13188]
2025-10-10T14:40:31.342580Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:31.342598Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:31.342607Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:31.342610Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:31.342613Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:31.342630Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:31.342642Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:31.342651Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:31.342721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:31.342729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:31.342731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:31.342734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:31.342808Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:31.342816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:31.342830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:31.342842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:31.342860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:31.342888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602996916483158:5786], now have 1 active actors on pipe
2025-10-10T14:40:31.342898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602996916482986:2438], now have 1 active actors on pipe
2025-10-10T14:40:31.342905Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602996134229207:13188]
2025-10-10T14:40:31.342908Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602996134229207:13188]
2025-10-10T14:40:31.342910Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602996134229207:13188]
2025-10-10T14:40:31.342925Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:31.342940Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:31.342958Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:31.342963Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:31.342966Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:31.342968Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:31.342970Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:31.342923Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3335
2025-10-10T14:40:31.342937Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3335
2025-10-10T14:40:31.342997Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602996134229207:13188]
2025-10-10T14:40:31.343008Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:31.343023Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:31.343032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:31.343038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:31.343090Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bc5fdfb9-780554c3-febf7c85-1cd2a82e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:31.343103Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:31.343107Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:31.343110Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:31.343123Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:31.343138Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:31.343163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:31.343346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:31.343355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:31.343373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:31.343481Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3336 partition: 0 MaxSeqNo: 40 sessionId: src_id|bc5fdfb9-780554c3-febf7c85-1cd2a82e_0
2025-10-10T14:40:31.343957Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7da914bc-43b9ba39-7ea84016-3cdd20f7_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|bc5fdfb9-780554c3-febf7c85-1cd2a82e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:31.346778Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bc5fdfb9-780554c3-febf7c85-1cd2a82e_0] Write session: try to update token
2025-10-10T14:40:31.346821Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bc5fdfb9-780554c3-febf7c85-1cd2a82e_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:31.363756Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3336 sessionId: src_id|bc5fdfb9-780554c3-febf7c85-1cd2a82e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:31.366488Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:31.367237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:31.367261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:31.367287Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:31.367296Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:31.367299Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:31.367301Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:31.367312Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602996134229207:13188]
2025-10-10T14:40:31.367317Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602996134229207:13188]
2025-10-10T14:40:31.367321Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602996134229207:13188]
2025-10-10T14:40:31.367376Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:31.367391Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:31.367395Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:31.367398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:31.367407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:31.367409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:31.367541Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:31.420648Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602996916483196:5396]
2025-10-10T14:40:31.420958Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 pipe creation result: OK TabletId: 72075186224037892 Generation: 3335, pipe: [1:7559602996916483196:5396]
2025-10-10T14:40:31.486980Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:31.487678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:40:31.487744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602996916483196:5396], now have 1 active actors on pipe
2025-10-10T14:40:31.487830Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:40:31.487947Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:31.488018Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 34 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602996916483196:5396]
2025-10-10T14:40:31.501317Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:40:31.501363Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:40:31.501394Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3336 reason: error at write: Disconnected sessionId: src_id|bc5fdfb9-780554c3-febf7c85-1cd2a82e_0
2025-10-10T14:40:31.501578Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3336 sessionId: src_id|bc5fdfb9-780554c3-febf7c85-1cd2a82e_0 is DEAD
2025-10-10T14:40:31.501763Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc5fdfb9-780554c3-febf7c85-1cd2a82e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:40:31.501777Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc5fdfb9-780554c3-febf7c85-1cd2a82e_0] Write session will restart in 0.007477s
2025-10-10T14:40:31.501805Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc5fdfb9-780554c3-febf7c85-1cd2a82e_0] Write session: Do CDS request
2025-10-10T14:40:31.501813Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc5fdfb9-780554c3-febf7c85-1cd2a82e_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:31.510939Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bc5fdfb9-780554c3-febf7c85-1cd2a82e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:31.511071Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:31.511087Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3337
2025-10-10T14:40:31.511227Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3337 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:31.511263Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3337 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:31.511275Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3337 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:31.511279Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:31.511753Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3337 sessionId:  describe result for acl check
2025-10-10T14:40:31.511804Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:31.511811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:31.511813Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:31.511820Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602996916483341:5822] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:31.512496Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602996916483341:5822] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:31.514210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:31.515964Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602996916483341:5822] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:31.517162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:31.517534Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:31.517547Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:31.517561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:31.517629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:31.517676Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602996134229432:13204]
2025-10-10T14:40:31.518369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:31.518730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:31.518773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:31.519083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:31.519174Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602996916483341:5822] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:31.519191Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602996916483341:5822] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:31.519195Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602996916483341:5822] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:31.519205Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3337 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:31.519156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:31.519165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:31.519166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:31.519167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:31.519169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:31.519170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:31.519171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:31.519172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:31.519174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:31.519175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:31.519176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:31.519177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:31.519178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:31.519184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:31.519198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:31.519202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:31.519206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:31.519210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:31.519214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:31.519219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:31.519222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:31.519225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:31.519230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:31.519233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:31.519237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:31.519241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:31.519249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:31.519258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:31.519265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:31.519269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:31.519277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:31.519282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:31.519286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:31.519292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:31.519296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:31.519301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:31.519306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:31.519311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:31.519315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:31.519320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:31.519324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:31.519329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:31.519334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:31.519340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:31.519344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:31.519350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:31.519355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:31.519361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:31.519366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:31.519372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:31.519377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:31.519383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:31.519427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:31.523541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:31.523885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:31.523898Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:31.523901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:31.523905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:31.523913Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3336 [2:7559602996134229432:13204]
2025-10-10T14:40:31.523927Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:31.523951Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:31.523959Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:31.523963Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:31.523966Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:31.523984Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:31.523997Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:31.524009Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:31.524088Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:31.524095Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:31.524098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:31.524101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:31.524183Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:31.524190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:31.524202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:31.524218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:31.524242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:31.524272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602996916483373:5822], now have 1 active actors on pipe
2025-10-10T14:40:31.524281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602996916483198:2438], now have 1 active actors on pipe
2025-10-10T14:40:31.524289Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602996134229427:13204]
2025-10-10T14:40:31.524292Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602996134229427:13204]
2025-10-10T14:40:31.524294Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602996134229427:13204]
2025-10-10T14:40:31.524311Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:31.524331Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:31.524348Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:31.524351Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:31.524352Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:31.524354Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:31.524355Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:31.524307Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3336
2025-10-10T14:40:31.524308Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3336
2025-10-10T14:40:31.524408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:31.524417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:31.524432Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602996134229427:13204]
2025-10-10T14:40:31.524445Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:31.524459Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:31.524478Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f3ef2998-80f158d3-71e44a5c-ebdc7321_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:31.524491Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:31.524496Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:31.524498Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:31.524510Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:31.524522Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:31.524550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:31.524867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:31.524881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:31.524904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:31.525185Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3337 partition: 0 MaxSeqNo: 40 sessionId: src_id|f3ef2998-80f158d3-71e44a5c-ebdc7321_0
2025-10-10T14:40:31.525652Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc5fdfb9-780554c3-febf7c85-1cd2a82e_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|f3ef2998-80f158d3-71e44a5c-ebdc7321_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:31.528573Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f3ef2998-80f158d3-71e44a5c-ebdc7321_0] Write session: try to update token
2025-10-10T14:40:31.528599Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f3ef2998-80f158d3-71e44a5c-ebdc7321_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:31.544504Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:31.544522Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:31.544527Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:31.544529Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:31.544541Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602996134229427:13204]
2025-10-10T14:40:31.544547Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602996134229427:13204]
2025-10-10T14:40:31.544551Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602996134229427:13204]
2025-10-10T14:40:31.544593Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:31.544597Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:31.544601Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:31.544602Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:31.544610Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:31.544612Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:31.544622Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3337 sessionId: src_id|f3ef2998-80f158d3-71e44a5c-ebdc7321_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:31.544768Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:31.547389Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:31.588071Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602996916483382:5396]
2025-10-10T14:40:31.588382Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 pipe creation result: OK TabletId: 72075186224037892 Generation: 3336, pipe: [1:7559602996916483382:5396]
2025-10-10T14:40:31.663451Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:31.664953Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3ef2998-80f158d3-71e44a5c-ebdc7321_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:40:31.664966Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3ef2998-80f158d3-71e44a5c-ebdc7321_0] Write session will restart in 0.006639s
2025-10-10T14:40:31.664994Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3ef2998-80f158d3-71e44a5c-ebdc7321_0] Write session: Do CDS request
2025-10-10T14:40:31.665002Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3ef2998-80f158d3-71e44a5c-ebdc7321_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:31.664452Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 35 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602996916483382:5396]
2025-10-10T14:40:31.664476Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:31.664491Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:40:31.664494Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:40:31.664565Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3337 reason: error at write: Disconnected sessionId: src_id|f3ef2998-80f158d3-71e44a5c-ebdc7321_0
2025-10-10T14:40:31.664789Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3337 sessionId: src_id|f3ef2998-80f158d3-71e44a5c-ebdc7321_0 is DEAD
2025-10-10T14:40:31.664048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:31.664080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:31.664135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602996916483382:5396], now have 1 active actors on pipe
2025-10-10T14:40:31.665474Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:31.672978Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f3ef2998-80f158d3-71e44a5c-ebdc7321_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:31.673139Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:31.673158Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3338
2025-10-10T14:40:31.673318Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3338 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:31.673391Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3338 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:31.673403Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3338 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:31.673407Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:31.673958Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3338 sessionId:  describe result for acl check
2025-10-10T14:40:31.673999Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:31.674006Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:31.674009Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:31.674015Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602996916483423:5827] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:31.674628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602996916483423:5827] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:31.677552Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602996916483423:5827] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:31.680552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:31.680841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602996916483423:5827] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:31.680855Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602996916483423:5827] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:31.680860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602996916483423:5827] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:31.680868Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3338 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:31.683023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:31.683276Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:31.683288Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:31.683300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:31.683358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:31.683407Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602996134229615:13206]
2025-10-10T14:40:31.684106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:31.684440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:31.684492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:31.684837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:31.685002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:31.685010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:31.685011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:31.685013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:31.685015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:31.685016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:31.685017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:31.685018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:31.685020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:31.685021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:31.685023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:31.685024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:31.685025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:31.685032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:31.685046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:31.685051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:31.685056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:31.685060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:31.685065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:31.685069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:31.685074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:31.685078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:31.685083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:31.685087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:31.685091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:31.685096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:31.685106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:31.685116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:31.685123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:31.685129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:31.685133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:31.685139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:31.685144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:31.685150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:31.685156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:31.685162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:31.685167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:31.685173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:31.685179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:31.685185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:31.685190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:31.685197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:31.685210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:31.685216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:31.685221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:31.685227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:31.685231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:31.685237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:31.685242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:31.685247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:31.685254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:31.685264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:31.685308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:31.688116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:31.688445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:31.688459Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:31.688462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:31.688466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:31.688473Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3337 [2:7559602996134229615:13206]
2025-10-10T14:40:31.688501Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:31.688523Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:31.688532Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:31.688536Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:31.688539Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:31.688556Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:31.688572Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:31.688580Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:31.688647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:31.688655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:31.688658Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:31.688661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:31.688883Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3337
2025-10-10T14:40:31.688934Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3337
2025-10-10T14:40:31.688986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:31.688996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:31.689010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:31.689025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:31.689047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:31.689075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602996916483557:5827], now have 1 active actors on pipe
2025-10-10T14:40:31.689085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602996916483384:2438], now have 1 active actors on pipe
2025-10-10T14:40:31.689102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:31.689108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:31.689133Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602996134229609:13206]
2025-10-10T14:40:31.689138Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602996134229609:13206]
2025-10-10T14:40:31.689141Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602996134229609:13206]
2025-10-10T14:40:31.689158Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:31.689171Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:31.689174Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:31.689181Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:31.689183Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:31.689193Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:31.689197Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:31.689218Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2a78cd0e-e299b347-d7824a53-a501e535_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:31.689232Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:31.689237Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:31.689240Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:31.689252Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:31.689271Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:31.689311Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602996134229609:13206]
2025-10-10T14:40:31.689346Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:31.689366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:31.689376Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:31.689603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:31.689613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:31.689631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:31.689744Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3338 partition: 0 MaxSeqNo: 40 sessionId: src_id|2a78cd0e-e299b347-d7824a53-a501e535_0
2025-10-10T14:40:31.690209Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3ef2998-80f158d3-71e44a5c-ebdc7321_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|2a78cd0e-e299b347-d7824a53-a501e535_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:31.692990Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2a78cd0e-e299b347-d7824a53-a501e535_0] Write session: try to update token
2025-10-10T14:40:31.693013Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2a78cd0e-e299b347-d7824a53-a501e535_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:31.702580Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:40:31.702601Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:31.702614Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602996134229609:13206]
2025-10-10T14:40:31.702669Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:40:31.702677Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:40:31.702868Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:40:31.703033Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:31.703188Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:31.703350Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:31.703557Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:40:31.703606Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:40:31.712053Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3338 sessionId: src_id|2a78cd0e-e299b347-d7824a53-a501e535_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:31.715125Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:31.715493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:31.715527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:31.715587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:40:31.715683Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:40:31.722663Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:31.722685Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:31.722689Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:31.722691Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:31.722703Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602996134229609:13206]
2025-10-10T14:40:31.722708Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602996134229609:13206]
2025-10-10T14:40:31.722712Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602996134229609:13206]
2025-10-10T14:40:31.722771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:31.722776Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:31.722779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:31.722782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:31.722783Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:31.722787Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:31.722965Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:31.764652Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602996916483568:5396]
2025-10-10T14:40:31.765003Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 pipe creation result: OK TabletId: 72075186224037892 Generation: 3337, pipe: [1:7559602996916483568:5396]
2025-10-10T14:40:31.846189Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:31.855591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:31.855619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:31.855800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:31.855866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:31.855942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:31.856016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:31.856080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:31.856085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:31.856174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:31.856246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:31.856314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:31.856385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:31.856430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:31.856433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:31.856509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:31.856579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:31.856644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:31.856705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:31.856827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:31.856830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:31.856907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:31.856966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:31.857031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:31.857101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:31.857143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:31.857146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:31.857236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:31.857321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:31.859705Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:31.859718Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:40:31.859724Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:40:31.859756Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3338 reason: error at write: Disconnected sessionId: src_id|2a78cd0e-e299b347-d7824a53-a501e535_0
2025-10-10T14:40:31.859768Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 36 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602996916483568:5396]
2025-10-10T14:40:31.860574Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3338 sessionId: src_id|2a78cd0e-e299b347-d7824a53-a501e535_0 is DEAD
2025-10-10T14:40:31.857618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:31.857699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:31.857740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:31.857743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:31.857816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:31.857897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:31.857974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:31.858039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:31.858088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:31.858091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:31.858172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:31.858235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:31.858307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:31.858378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:31.858423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:31.858426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:31.858501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:31.858564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:31.858631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:31.858696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:31.858739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:31.858743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:31.858816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:31.858881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:31.858949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:31.859013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:31.859063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:31.859065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:31.859178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:31.859239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:31.859303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:31.859368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:31.859427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:31.859430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:31.859502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602996916483568:5396], now have 1 active actors on pipe
2025-10-10T14:40:31.860831Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:31.864797Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a78cd0e-e299b347-d7824a53-a501e535_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:40:31.864813Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a78cd0e-e299b347-d7824a53-a501e535_0] Write session will restart in 0.006039s
2025-10-10T14:40:31.864841Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a78cd0e-e299b347-d7824a53-a501e535_0] Write session: Do CDS request
2025-10-10T14:40:31.864849Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a78cd0e-e299b347-d7824a53-a501e535_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:31.871922Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2a78cd0e-e299b347-d7824a53-a501e535_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:31.873514Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:31.873530Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3339
2025-10-10T14:40:31.873709Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3339 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:31.873755Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3339 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:31.873766Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3339 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:31.873770Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:31.874431Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3339 sessionId:  describe result for acl check
2025-10-10T14:40:31.874468Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:31.874474Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:31.874477Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:31.874484Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602996916483636:5819] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:31.875079Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602996916483636:5819] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:31.881581Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602996916483636:5819] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:31.882470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:31.885779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602996916483636:5819] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:31.885795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602996916483636:5819] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:31.885799Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602996916483636:5819] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:31.885807Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3339 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:31.885407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:31.885626Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:31.885631Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:31.885640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:31.885691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:31.885720Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602996134229808:13209]
2025-10-10T14:40:31.886205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:31.886580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:31.886629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:31.886896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:31.886942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:31.886944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:31.886945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:31.886946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:31.886947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:31.886948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:31.886949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:31.886950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:31.886951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:31.886952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:31.886953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:31.886954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:31.886955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:31.886961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:31.886975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:31.886980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:31.886985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:31.886989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:31.886993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:31.886997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:31.887001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:31.887005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:31.887010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:31.887014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:31.887018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:31.887022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:31.887031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:31.887040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:31.887047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:31.887051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:31.887054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:31.887058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:31.887060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:31.887064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:31.887066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:31.887070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:31.887073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:31.887076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:31.887079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:31.887083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:31.887089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:31.887095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:31.887102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:31.887108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:31.887113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:31.887118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:31.887123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:31.887128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:31.887133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:31.887138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:31.887143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:31.887148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:31.887194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:31.890755Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3338
2025-10-10T14:40:31.890791Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3338
2025-10-10T14:40:31.889786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:31.890311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:31.890315Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:31.890317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:31.890322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:31.890328Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3338 [2:7559602996134229808:13209]
2025-10-10T14:40:31.890342Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:31.890361Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:31.890364Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:31.890368Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:31.890370Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:31.890388Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:31.890396Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:31.890404Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:31.890471Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:31.890474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:31.890477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:31.890479Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:31.890554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:31.890556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:31.890566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:31.890577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:31.890592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:31.890613Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602996134229802:13209]
2025-10-10T14:40:31.890615Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602996134229802:13209]
2025-10-10T14:40:31.890617Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602996134229802:13209]
2025-10-10T14:40:31.890626Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:31.890632Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:31.890635Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:31.890637Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:31.890641Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:31.890657Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:31.890660Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:31.890672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602996916483575:2438], now have 1 active actors on pipe
2025-10-10T14:40:31.890676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602996916483751:5819], now have 1 active actors on pipe
2025-10-10T14:40:31.890701Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602996134229802:13209]
2025-10-10T14:40:31.890709Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:31.890715Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:31.890984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:31.890995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:31.891035Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a1f44487-f516e7cb-cc07e8a6-e91c3492_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:31.891045Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:31.891050Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:31.891053Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:31.891078Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:31.891093Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:31.891112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:31.891450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:31.891463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:31.891480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:31.896402Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3339 partition: 0 MaxSeqNo: 40 sessionId: src_id|a1f44487-f516e7cb-cc07e8a6-e91c3492_0
2025-10-10T14:40:31.896946Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a78cd0e-e299b347-d7824a53-a501e535_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|a1f44487-f516e7cb-cc07e8a6-e91c3492_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:31.899959Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a1f44487-f516e7cb-cc07e8a6-e91c3492_0] Write session: try to update token
2025-10-10T14:40:31.899990Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a1f44487-f516e7cb-cc07e8a6-e91c3492_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:31.921112Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3339 sessionId: src_id|a1f44487-f516e7cb-cc07e8a6-e91c3492_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:31.924039Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:31.924623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:31.924647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:31.924695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:40:31.924819Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:40:31.931350Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:31.931371Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:31.931375Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:31.931378Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:31.931390Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602996134229802:13209]
2025-10-10T14:40:31.931394Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602996134229802:13209]
2025-10-10T14:40:31.931402Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602996134229802:13209]
2025-10-10T14:40:31.931473Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:31.931488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:31.931490Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:31.931640Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:31.933574Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:31.933592Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:31.933597Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:31.961447Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602996916483766:5396]
2025-10-10T14:40:31.961880Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 pipe creation result: OK TabletId: 72075186224037892 Generation: 3338, pipe: [1:7559602996916483766:5396]
2025-10-10T14:40:32.053186Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:32.062654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:32.062685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:32.062877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:32.062945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:32.063030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:32.063143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:32.063213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:32.063227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:32.063310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:32.063381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:32.063452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:32.063536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:32.063588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:32.063595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:32.063670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:32.063738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:32.063811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:32.063880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:32.063933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:32.063940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:32.064015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:32.064098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:32.064160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:32.064232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:32.064283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:32.064291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:32.064359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:32.064426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:32.064491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:32.064558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:32.064625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:32.064632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:32.064701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:32.064769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:32.064836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:32.064901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:32.064969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:32.064977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:32.065047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:32.065111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:32.065176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:32.065247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:32.065294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:32.065302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:32.065393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:32.065461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:32.065535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:32.065596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:32.065652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:32.065655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:32.065734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:32.065800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:32.065868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:32.065934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:32.065979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:32.065981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:32.066057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:32.066119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:32.066182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:32.066245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:32.066288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:32.066291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:32.066374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602996916483766:5396], now have 1 active actors on pipe
2025-10-10T14:40:32.068162Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:32.070007Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 37 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602996916483766:5396]
2025-10-10T14:40:32.070039Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:32.070085Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:40:32.070138Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3339 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a1f44487-f516e7cb-cc07e8a6-e91c3492_0
2025-10-10T14:40:32.070375Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3339 sessionId: src_id|a1f44487-f516e7cb-cc07e8a6-e91c3492_0 is DEAD
2025-10-10T14:40:32.073743Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1f44487-f516e7cb-cc07e8a6-e91c3492_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:40:32.073770Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1f44487-f516e7cb-cc07e8a6-e91c3492_0] Write session will restart in 0.009456s
2025-10-10T14:40:32.073800Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1f44487-f516e7cb-cc07e8a6-e91c3492_0] Write session: Do CDS request
2025-10-10T14:40:32.073807Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1f44487-f516e7cb-cc07e8a6-e91c3492_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:32.085948Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a1f44487-f516e7cb-cc07e8a6-e91c3492_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:32.090227Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:32.090244Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3340
2025-10-10T14:40:32.090538Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3340 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:32.090595Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3340 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:32.090607Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3340 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:32.090612Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:32.091302Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3340 sessionId:  describe result for acl check
2025-10-10T14:40:32.091344Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:32.091346Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:32.091348Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:32.091355Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559603001211451133:5836] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:32.092019Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559603001211451133:5836] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:32.095092Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559603001211451133:5836] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:32.102209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:32.102744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559603001211451133:5836] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:32.102762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559603001211451133:5836] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:32.102766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559603001211451133:5836] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:32.102777Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3340 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:32.105151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:32.105434Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:32.105449Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:32.105463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:32.105540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:32.105597Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559603000429197289:13211]
2025-10-10T14:40:32.106310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:32.106702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:32.106759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:32.107118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:32.107189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:32.107190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:32.107191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:32.107192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:32.107193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:32.107194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:32.107195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:32.107196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:32.107198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:32.107199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:32.107201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:32.107202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:32.107203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:32.107210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:32.107225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:32.107230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:32.107234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:32.107238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:32.107243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:32.107248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:32.107251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:32.107256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:32.107261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:32.107266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:32.107270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:32.107275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:32.107285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:32.107295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:32.107302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:32.107308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:32.107313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:32.107319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:32.107324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:32.107330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:32.107336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:32.107343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:32.107347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:32.107353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:32.107359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:32.107365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:32.107370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:32.107376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:32.107383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:32.107390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:32.107395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:32.107400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:32.107405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:32.107410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:32.107415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:32.107421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:32.107426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:32.107432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:32.107486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:32.110230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:32.110575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:32.110590Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:32.110593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:32.110597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:32.110603Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3339 [2:7559603000429197289:13211]
2025-10-10T14:40:32.110616Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:32.110634Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:32.110643Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:32.110647Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:32.110649Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:32.110667Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:32.110679Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:32.110688Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:32.110749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:32.110758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:32.110760Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:32.110762Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:32.110832Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:32.110840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:32.110852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:32.110864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:32.110881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:32.110911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603001211451077:2438], now have 1 active actors on pipe
2025-10-10T14:40:32.110920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603001211451251:5836], now have 1 active actors on pipe
2025-10-10T14:40:32.110929Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559603000429197283:13211]
2025-10-10T14:40:32.110931Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559603000429197283:13211]
2025-10-10T14:40:32.110933Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559603000429197283:13211]
2025-10-10T14:40:32.110948Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:32.110971Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:32.110979Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:32.110983Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:32.110986Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:32.110996Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:32.110999Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:32.111024Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559603000429197283:13211]
2025-10-10T14:40:32.111033Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:32.111035Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:32.111006Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3339
2025-10-10T14:40:32.111058Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3339
2025-10-10T14:40:32.111150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:32.111161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:32.111208Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|68db0536-7d74452f-bd21c6d8-c48567fb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:32.111221Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:32.111227Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:32.111230Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:32.111243Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:32.111255Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:32.111269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:32.111442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:32.111453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:32.111469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:32.111602Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3340 partition: 0 MaxSeqNo: 40 sessionId: src_id|68db0536-7d74452f-bd21c6d8-c48567fb_0
2025-10-10T14:40:32.112110Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1f44487-f516e7cb-cc07e8a6-e91c3492_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|68db0536-7d74452f-bd21c6d8-c48567fb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:32.114982Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|68db0536-7d74452f-bd21c6d8-c48567fb_0] Write session: try to update token
2025-10-10T14:40:32.115004Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|68db0536-7d74452f-bd21c6d8-c48567fb_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:32.123306Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:40:32.123322Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:32.123337Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559603000429197283:13211]
2025-10-10T14:40:32.123390Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:40:32.123396Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:40:32.123575Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:40:32.123723Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:32.123858Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:32.123984Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:32.124191Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:40:32.124229Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:40:32.142981Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3340 sessionId: src_id|68db0536-7d74452f-bd21c6d8-c48567fb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:32.143619Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:32.143642Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:32.143646Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:32.143648Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:32.143659Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559603000429197283:13211]
2025-10-10T14:40:32.143663Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559603000429197283:13211]
2025-10-10T14:40:32.143667Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559603000429197283:13211]
2025-10-10T14:40:32.143712Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:32.143720Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:32.143720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:32.143725Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:32.143729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:32.143732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:32.143890Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:32.145948Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:32.170186Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559603001211451264:5396]
2025-10-10T14:40:32.170554Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 pipe creation result: OK TabletId: 72075186224037892 Generation: 3339, pipe: [1:7559603001211451264:5396]
2025-10-10T14:40:32.267375Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:32.268145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:32.268159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:32.268186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603001211451264:5396], now have 1 active actors on pipe
2025-10-10T14:40:32.268414Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:32.269866Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:32.269935Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 38 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559603001211451264:5396]
2025-10-10T14:40:32.269966Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:40:32.270046Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3340 reason: status is not ok: tablet will be restarted right now sessionId: src_id|68db0536-7d74452f-bd21c6d8-c48567fb_0
2025-10-10T14:40:32.270262Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3340 sessionId: src_id|68db0536-7d74452f-bd21c6d8-c48567fb_0 is DEAD
2025-10-10T14:40:32.270506Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68db0536-7d74452f-bd21c6d8-c48567fb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:40:32.270527Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68db0536-7d74452f-bd21c6d8-c48567fb_0] Write session will restart in 0.005834s
2025-10-10T14:40:32.270555Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68db0536-7d74452f-bd21c6d8-c48567fb_0] Write session: Do CDS request
2025-10-10T14:40:32.270561Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68db0536-7d74452f-bd21c6d8-c48567fb_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:32.281927Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|68db0536-7d74452f-bd21c6d8-c48567fb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:32.282137Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:32.282156Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3341
2025-10-10T14:40:32.282308Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3341 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:32.282347Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3341 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:32.282357Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3341 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:32.282362Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:32.282870Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3341 sessionId:  describe result for acl check
2025-10-10T14:40:32.282919Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:32.282921Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:32.282926Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:32.282933Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559603001211451362:5845] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:32.283532Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559603001211451362:5845] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:32.287547Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559603001211451362:5845] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:32.290308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:32.293202Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559603001211451362:5845] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:32.293223Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559603001211451362:5845] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:32.293227Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559603001211451362:5845] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:32.293237Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3341 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:32.293639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:32.293883Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:32.293895Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:32.293906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:32.293962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:32.294007Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559603000429197474:13213]
2025-10-10T14:40:32.294602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:32.295015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:32.295055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:32.295379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:32.295447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:32.295448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:32.295450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:32.295451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:32.295453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:32.295454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:32.295455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:32.295457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:32.295458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:32.295459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:32.295460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:32.295462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:32.295463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:32.295469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:32.295483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:32.295487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:32.295491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:32.295495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:32.295498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:32.295502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:32.295506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:32.295509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:32.295513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:32.295517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:32.295521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:32.295525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:32.295533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:32.295541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:32.295548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:32.295553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:32.295557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:32.295562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:32.295567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:32.295572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:32.295577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:32.295582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:32.295586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:32.295592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:32.295596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:32.295601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:32.295605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:32.295611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:32.295615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:32.295620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:32.295624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:32.295629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:32.295633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:32.295639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:32.295643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:32.295648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:32.295653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:32.295658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:32.295699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:32.298448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:32.298810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:32.298824Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:32.298828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:32.298833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:32.298840Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3340 [2:7559603000429197474:13213]
2025-10-10T14:40:32.298854Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:32.298874Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:32.298878Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:32.298881Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:32.298884Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:32.298902Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:32.298920Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:32.298928Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:32.298994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:32.298996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:32.298998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:32.299000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:32.299087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:32.299095Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:32.299107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:32.299122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:32.299143Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:32.299170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603001211451442:5845], now have 1 active actors on pipe
2025-10-10T14:40:32.299180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603001211451266:2438], now have 1 active actors on pipe
2025-10-10T14:40:32.299188Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559603000429197467:13213]
2025-10-10T14:40:32.299191Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559603000429197467:13213]
2025-10-10T14:40:32.299193Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559603000429197467:13213]
2025-10-10T14:40:32.299206Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:32.299221Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:32.299236Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:32.299240Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:32.299240Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3340
2025-10-10T14:40:32.299269Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559603000429197467:13213]
2025-10-10T14:40:32.299278Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:32.299282Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3340
2025-10-10T14:40:32.299279Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:32.299283Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:32.299285Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:32.299294Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:32.299470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:32.299496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:32.299535Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9825dba4-393c7c28-5ed008e0-5f5ddefa_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:32.299549Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:32.299564Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:32.299571Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:32.299585Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:32.299602Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:32.299624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:32.299832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:32.299843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:32.299865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:32.299976Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3341 partition: 0 MaxSeqNo: 40 sessionId: src_id|9825dba4-393c7c28-5ed008e0-5f5ddefa_0
2025-10-10T14:40:32.300519Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68db0536-7d74452f-bd21c6d8-c48567fb_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|9825dba4-393c7c28-5ed008e0-5f5ddefa_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:32.303340Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9825dba4-393c7c28-5ed008e0-5f5ddefa_0] Write session: try to update token
2025-10-10T14:40:32.303363Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9825dba4-393c7c28-5ed008e0-5f5ddefa_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:32.323138Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:32.323162Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:32.323166Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:32.323168Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:32.323179Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559603000429197467:13213]
2025-10-10T14:40:32.323184Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559603000429197467:13213]
2025-10-10T14:40:32.323188Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559603000429197467:13213]
2025-10-10T14:40:32.323242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:32.323252Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:32.323261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:32.323265Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:32.323276Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:32.323282Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:32.323426Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:32.328834Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3341 sessionId: src_id|9825dba4-393c7c28-5ed008e0-5f5ddefa_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:32.331797Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:32.369913Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559603001211451454:5396]
2025-10-10T14:40:32.370236Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 pipe creation result: OK TabletId: 72075186224037892 Generation: 3340, pipe: [1:7559603001211451454:5396]
2025-10-10T14:40:32.450475Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:32.451224Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 39 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559603001211451454:5396]
2025-10-10T14:40:32.451261Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:40:32.451267Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:40:32.450809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:32.450827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:32.450875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603001211451454:5396], now have 1 active actors on pipe
2025-10-10T14:40:32.451796Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:32.452306Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3341 reason: error at write: Disconnected sessionId: src_id|9825dba4-393c7c28-5ed008e0-5f5ddefa_0
2025-10-10T14:40:32.452534Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3341 sessionId: src_id|9825dba4-393c7c28-5ed008e0-5f5ddefa_0 is DEAD
2025-10-10T14:40:32.452704Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:32.452933Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9825dba4-393c7c28-5ed008e0-5f5ddefa_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:40:32.452945Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9825dba4-393c7c28-5ed008e0-5f5ddefa_0] Write session will restart in 0.005075s
2025-10-10T14:40:32.452971Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9825dba4-393c7c28-5ed008e0-5f5ddefa_0] Write session: Do CDS request
2025-10-10T14:40:32.452979Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9825dba4-393c7c28-5ed008e0-5f5ddefa_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:32.461877Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9825dba4-393c7c28-5ed008e0-5f5ddefa_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:32.463294Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:32.463309Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3342
2025-10-10T14:40:32.463447Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3342 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:32.463491Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3342 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:32.463497Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3342 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:32.463502Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:32.464022Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3342 sessionId:  describe result for acl check
2025-10-10T14:40:32.464077Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:32.464079Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:32.464081Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:32.464088Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559603001211451498:5875] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:32.464695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559603001211451498:5875] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:32.469417Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559603001211451498:5875] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:32.474329Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559603001211451498:5875] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:32.474348Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559603001211451498:5875] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:32.474353Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559603001211451498:5875] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:32.474362Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3342 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:32.477140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:32.480666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:32.480998Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:32.481014Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:32.481029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:32.481111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:32.481166Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559603000429197698:13227]
2025-10-10T14:40:32.481872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:32.482451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:32.482519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:32.483186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:32.483298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:32.483306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:32.483307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:32.483309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:32.483310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:32.483312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:32.483313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:32.483315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:32.483316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:32.483318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:32.483320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:32.483321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:32.483323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:32.483331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:32.483345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:32.483350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:32.483354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:32.483358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:32.483362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:32.483366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:32.483370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:32.483374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:32.483381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:32.483385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:32.483389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:32.483394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:32.483404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:32.483416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:32.483424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:32.483431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:32.483436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:32.483443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:32.483447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:32.483453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:32.483458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:32.483470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:32.483475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:32.483481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:32.483486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:32.483492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:32.483497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:32.483502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:32.483506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:32.483511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:32.483515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:32.483522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:32.483527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:32.483533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:32.483544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:32.483550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:32.483563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:32.483570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:32.483616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:32.486598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:32.487159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:32.487177Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:32.487180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:32.487185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:32.487193Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3341 [2:7559603000429197698:13227]
2025-10-10T14:40:32.487209Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:32.487238Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:32.487246Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:32.487250Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:32.487257Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:32.487276Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:32.487285Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:32.487299Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:32.487373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:32.487381Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:32.487383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:32.487386Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:32.487849Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3341
2025-10-10T14:40:32.487975Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3341
2025-10-10T14:40:32.487479Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:32.487491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:32.487505Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:32.487518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:32.487536Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:32.487560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603001211451646:5875], now have 1 active actors on pipe
2025-10-10T14:40:32.487563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603001211451471:2438], now have 1 active actors on pipe
2025-10-10T14:40:32.487573Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559603000429197693:13227]
2025-10-10T14:40:32.487575Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559603000429197693:13227]
2025-10-10T14:40:32.487578Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559603000429197693:13227]
2025-10-10T14:40:32.487594Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:32.487610Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:32.487610Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:32.487613Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:32.487615Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:32.487631Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:32.487635Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:32.487670Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559603000429197693:13227]
2025-10-10T14:40:32.487679Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:32.487687Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:32.488162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:32.488175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:32.488214Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c2d32873-b503e2eb-d5d610e0-b79cc94c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:32.488222Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:32.488228Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:32.488230Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:32.488244Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:32.488257Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:32.488278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:32.488439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:32.488447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:32.488464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:32.488565Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3342 partition: 0 MaxSeqNo: 40 sessionId: src_id|c2d32873-b503e2eb-d5d610e0-b79cc94c_0
2025-10-10T14:40:32.489024Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9825dba4-393c7c28-5ed008e0-5f5ddefa_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|c2d32873-b503e2eb-d5d610e0-b79cc94c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:32.492026Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c2d32873-b503e2eb-d5d610e0-b79cc94c_0] Write session: try to update token
2025-10-10T14:40:32.492060Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c2d32873-b503e2eb-d5d610e0-b79cc94c_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:32.501450Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:40:32.501466Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:32.501477Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559603000429197693:13227]
2025-10-10T14:40:32.501535Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:40:32.501733Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:40:32.501901Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:32.502070Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:32.502224Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:32.502459Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:40:32.502511Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:40:32.503252Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:40:32.513420Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3342 sessionId: src_id|c2d32873-b503e2eb-d5d610e0-b79cc94c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:32.516200Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:32.516448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:32.516474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:32.516531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:40:32.516654Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:40:32.521105Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:32.521136Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:32.521140Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:32.521142Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:32.521154Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559603000429197693:13227]
2025-10-10T14:40:32.521159Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559603000429197693:13227]
2025-10-10T14:40:32.521163Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559603000429197693:13227]
2025-10-10T14:40:32.521225Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:32.521228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:32.521238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:32.521241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:32.521242Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:32.521248Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:32.521416Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:32.551115Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559603001211451669:5396]
2025-10-10T14:40:32.551381Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 pipe creation result: OK TabletId: 72075186224037892 Generation: 3341, pipe: [1:7559603001211451669:5396]
2025-10-10T14:40:32.645702Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:32.654364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:32.654399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:32.654593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:32.654652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:32.654715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:32.654780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:32.654825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:32.654830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:32.654906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:32.654972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:32.655038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:32.655108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:32.655152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:32.655156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:32.655235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:32.655294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:32.655361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:32.655430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:32.655478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:32.655482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:32.655564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:32.655631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:32.655698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:32.655765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:32.655806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:32.655809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:32.655885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:32.655958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:32.656023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:32.656110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:32.656154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:32.656160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:32.656229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:32.656291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:32.656355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:32.656420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:32.656491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:32.656495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:32.656569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:32.656630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:32.656694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:32.656759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:32.656804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:32.656808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:32.656906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:32.656971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:32.657040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:32.657104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:32.657154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:32.657160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:32.657232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:32.657291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:32.657635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:32.657711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:32.658543Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:32.658608Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:40:32.658612Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:40:32.658660Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3342 reason: error at write: Disconnected sessionId: src_id|c2d32873-b503e2eb-d5d610e0-b79cc94c_0
2025-10-10T14:40:32.658877Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3342 sessionId: src_id|c2d32873-b503e2eb-d5d610e0-b79cc94c_0 is DEAD
2025-10-10T14:40:32.659004Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 40 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559603001211451669:5396]
2025-10-10T14:40:32.657770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:32.657781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:32.657851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:32.657911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:32.657972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:32.658034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:32.658078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:32.658081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:32.658154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603001211451669:5396], now have 1 active actors on pipe
2025-10-10T14:40:32.659435Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:32.661447Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c2d32873-b503e2eb-d5d610e0-b79cc94c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:40:32.661462Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c2d32873-b503e2eb-d5d610e0-b79cc94c_0] Write session will restart in 0.005478s
2025-10-10T14:40:32.661501Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c2d32873-b503e2eb-d5d610e0-b79cc94c_0] Write session: Do CDS request
2025-10-10T14:40:32.661507Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c2d32873-b503e2eb-d5d610e0-b79cc94c_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:32.667939Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c2d32873-b503e2eb-d5d610e0-b79cc94c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:32.668068Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:32.668083Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3343
2025-10-10T14:40:32.668231Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3343 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:32.668267Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3343 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:32.668278Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3343 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:32.668282Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:32.668803Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3343 sessionId:  describe result for acl check
2025-10-10T14:40:32.668840Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:32.668843Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:32.668845Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:32.668852Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559603001211451687:5884] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:32.669465Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559603001211451687:5884] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:32.673767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559603001211451687:5884] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:32.678552Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559603001211451687:5884] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:32.678568Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559603001211451687:5884] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:32.678573Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559603001211451687:5884] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:32.678583Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3343 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:32.680695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:32.687963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:32.688293Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:32.688306Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:32.688321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:32.688393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:32.688443Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559603000429197883:13231]
2025-10-10T14:40:32.689102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:32.689569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:32.689647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:32.690025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:32.690128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:32.690136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:32.690138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:32.690139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:32.690140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:32.690142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:32.690143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:32.690144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:32.690146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:32.690147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:32.690149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:32.690151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:32.690152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:32.690160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:32.690175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:32.690179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:32.690184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:32.690189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:32.690193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:32.690217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:32.690227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:32.690231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:32.690241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:32.690245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:32.690264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:32.690269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:32.690280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:32.690295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:32.690302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:32.690309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:32.690315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:32.690321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:32.690343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:32.690354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:32.690364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:32.690374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:32.690383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:32.690389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:32.690397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:32.690403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:32.690408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:32.690413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:32.690424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:32.690430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:32.690440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:32.690446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:32.690458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:32.690468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:32.690477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:32.690487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:32.690497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:32.690507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:32.690557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:32.693409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:32.693790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:32.693801Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:32.693805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:32.693809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:32.693816Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3342 [2:7559603000429197883:13231]
2025-10-10T14:40:32.693833Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:32.693856Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:32.693859Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:32.693863Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:32.693866Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:32.693883Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:32.693897Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:32.693906Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:32.693976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:32.693984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:32.693986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:32.693989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:32.694233Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3342
2025-10-10T14:40:32.694235Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3342
2025-10-10T14:40:32.694277Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:32.694288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:32.694301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:32.694312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:32.694328Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:32.694359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603001211451846:5884], now have 1 active actors on pipe
2025-10-10T14:40:32.694367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603001211451672:2438], now have 1 active actors on pipe
2025-10-10T14:40:32.694387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:32.694392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:32.694414Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559603000429197878:13231]
2025-10-10T14:40:32.694422Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559603000429197878:13231]
2025-10-10T14:40:32.694425Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559603000429197878:13231]
2025-10-10T14:40:32.694440Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:32.694456Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:32.694467Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:32.694471Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:32.694473Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:32.694478Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:32.694482Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:32.694503Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|342d67ba-6772ed52-5b2b381d-9a9677b2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:32.694517Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:32.694521Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:32.694523Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:32.694536Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:32.694548Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:32.694586Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559603000429197878:13231]
2025-10-10T14:40:32.694601Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:32.694609Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:32.694617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:32.694772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:32.694780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:32.694798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:32.694968Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3343 partition: 0 MaxSeqNo: 40 sessionId: src_id|342d67ba-6772ed52-5b2b381d-9a9677b2_0
2025-10-10T14:40:32.695590Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c2d32873-b503e2eb-d5d610e0-b79cc94c_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|342d67ba-6772ed52-5b2b381d-9a9677b2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:32.698475Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|342d67ba-6772ed52-5b2b381d-9a9677b2_0] Write session: try to update token
2025-10-10T14:40:32.698502Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|342d67ba-6772ed52-5b2b381d-9a9677b2_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:32.710877Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:40:32.710898Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:32.710910Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559603000429197878:13231]
2025-10-10T14:40:32.710968Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:40:32.710967Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:40:32.711171Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:40:32.711332Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:32.711490Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:32.711648Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:32.711854Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:40:32.711898Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:40:32.718653Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3343 sessionId: src_id|342d67ba-6772ed52-5b2b381d-9a9677b2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:32.721456Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:32.721735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:32.721773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:32.721836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:40:32.721955Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:40:32.729870Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:32.729895Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:32.729899Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:32.729902Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:32.729915Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559603000429197878:13231]
2025-10-10T14:40:32.729920Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559603000429197878:13231]
2025-10-10T14:40:32.729924Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559603000429197878:13231]
2025-10-10T14:40:32.729979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:32.729989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:32.729992Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:32.730143Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:32.733413Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:32.733442Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:32.733448Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:32.759012Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559603001211451861:5396]
2025-10-10T14:40:32.759366Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 pipe creation result: OK TabletId: 72075186224037892 Generation: 3342, pipe: [1:7559603001211451861:5396]
2025-10-10T14:40:32.852019Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:32.861312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:32.861358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:32.861547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:32.861622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:32.861696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:32.861768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:32.862333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:32.862349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:32.862425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:32.862535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:32.862608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:32.862683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:32.862878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:32.862890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:32.862968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:32.863037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:32.863112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:32.863182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:32.863235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:32.863244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:32.863314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:32.863419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:32.863486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:32.863555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:32.863628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:32.863632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:32.863703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:32.863767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:32.863830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:32.863891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:32.863935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:32.863939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:32.864011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:32.864092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:32.864154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:32.864214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:32.864259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:32.864262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:32.864336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:32.864398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:32.864464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:32.864526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:32.864572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:32.864575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:32.864679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:32.864738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:32.864800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:32.864864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:32.864907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:32.864911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:32.864982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:32.865047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:32.865110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:32.865172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:32.865213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:32.865216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:32.865284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:32.865520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:32.865591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:32.865661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:32.865709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:32.865718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:32.866122Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 41 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559603001211451861:5396]
2025-10-10T14:40:32.866171Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:40:32.866175Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:40:32.866208Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3343 reason: error at write: Disconnected sessionId: src_id|342d67ba-6772ed52-5b2b381d-9a9677b2_0
2025-10-10T14:40:32.866438Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3343 sessionId: src_id|342d67ba-6772ed52-5b2b381d-9a9677b2_0 is DEAD
2025-10-10T14:40:32.866454Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:32.865796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603001211451861:5396], now have 1 active actors on pipe
2025-10-10T14:40:32.866314Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:32.869439Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|342d67ba-6772ed52-5b2b381d-9a9677b2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:40:32.869451Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|342d67ba-6772ed52-5b2b381d-9a9677b2_0] Write session will restart in 0.006275s
2025-10-10T14:40:32.869477Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|342d67ba-6772ed52-5b2b381d-9a9677b2_0] Write session: Do CDS request
2025-10-10T14:40:32.869485Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|342d67ba-6772ed52-5b2b381d-9a9677b2_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:32.877909Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|342d67ba-6772ed52-5b2b381d-9a9677b2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:32.885446Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:32.885464Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3344
2025-10-10T14:40:32.885731Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3344 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:32.885768Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3344 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:32.885774Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3344 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:32.885778Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:32.886194Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3344 sessionId:  describe result for acl check
2025-10-10T14:40:32.886227Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:32.886231Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:32.886233Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:32.886239Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559603001211452017:5891] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:32.886823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559603001211452017:5891] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:32.887830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:32.891057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:32.891309Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:32.891314Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:32.891327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:32.891391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:32.891436Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559603000429198080:13234]
2025-10-10T14:40:32.892111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:32.891999Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559603001211452017:5891] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:32.892657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:32.892717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:32.893053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:32.893124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:32.893125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:32.893127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:32.893129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:32.893130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:32.893132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:32.893133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:32.893135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:32.893136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:32.893138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:32.893139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:32.893141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:32.893142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:32.893149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:32.893164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:32.893168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:32.893173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:32.893178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:32.893183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:32.893187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:32.893191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:32.893195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:32.893200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:32.893204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:32.893209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:32.893213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:32.893222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:32.893231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:32.893239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:32.893245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:32.893252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:32.893258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:32.893263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:32.893269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:32.893274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:32.893281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:32.893286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:32.893292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:32.893298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:32.893304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:32.893309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:32.893315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:32.893320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:32.893326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:32.893354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:32.893361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:32.893366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:32.893372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:32.893378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:32.893383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:32.893388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:32.893393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:32.893434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:32.896703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559603001211452017:5891] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:32.896719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559603001211452017:5891] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:32.896722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559603001211452017:5891] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:32.896797Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3344 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:32.896654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:32.896999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:32.897023Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:32.897026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:32.897030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:32.897038Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3343 [2:7559603000429198080:13234]
2025-10-10T14:40:32.897053Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:32.897072Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:32.897076Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:32.897080Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:32.897082Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:32.897101Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:32.897109Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:32.897118Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:32.897180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:32.897182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:32.897184Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:32.897187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:32.897260Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:32.897263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:32.897278Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:32.897292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:32.897310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:32.897349Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559603000429198075:13234]
2025-10-10T14:40:32.897351Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559603000429198075:13234]
2025-10-10T14:40:32.897354Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559603000429198075:13234]
2025-10-10T14:40:32.897373Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:32.897394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603001211451868:2438], now have 1 active actors on pipe
2025-10-10T14:40:32.897401Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:32.897418Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:32.897422Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:32.897453Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559603000429198075:13234]
2025-10-10T14:40:32.897456Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:32.897483Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:32.897487Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:32.897489Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:32.897497Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:32.897636Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3343
2025-10-10T14:40:32.897972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603001211452052:5891], now have 1 active actors on pipe
2025-10-10T14:40:32.898046Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3343
2025-10-10T14:40:32.898154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:32.898164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:32.898196Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e25f8304-1aa50eb7-e4658af7-1db9b3d2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:32.898205Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:32.898211Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:32.898214Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:32.898228Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:32.898242Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:32.898258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:32.898814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:32.898837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:32.898857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:32.899009Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3344 partition: 0 MaxSeqNo: 40 sessionId: src_id|e25f8304-1aa50eb7-e4658af7-1db9b3d2_0
2025-10-10T14:40:32.899419Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|342d67ba-6772ed52-5b2b381d-9a9677b2_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|e25f8304-1aa50eb7-e4658af7-1db9b3d2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:32.902331Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e25f8304-1aa50eb7-e4658af7-1db9b3d2_0] Write session: try to update token
2025-10-10T14:40:32.902353Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e25f8304-1aa50eb7-e4658af7-1db9b3d2_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:32.920495Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3344 sessionId: src_id|e25f8304-1aa50eb7-e4658af7-1db9b3d2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:32.923258Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:32.924986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:32.925016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:32.925042Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:32.925045Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:32.925049Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:32.925051Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:32.925062Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559603000429198075:13234]
2025-10-10T14:40:32.925066Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559603000429198075:13234]
2025-10-10T14:40:32.925070Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559603000429198075:13234]
2025-10-10T14:40:32.925132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:32.925140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:32.925143Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:32.925297Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:32.926804Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:32.926813Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:32.926818Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:32.969002Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559603001211452064:5396]
2025-10-10T14:40:32.969422Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 pipe creation result: OK TabletId: 72075186224037892 Generation: 3343, pipe: [1:7559603001211452064:5396]
2025-10-10T14:40:33.059095Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 42 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559603001211452064:5396]
2025-10-10T14:40:33.059132Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:40:33.059209Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:40:33.059217Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:40:33.059304Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3344 reason: error at write: Disconnected sessionId: src_id|e25f8304-1aa50eb7-e4658af7-1db9b3d2_0
2025-10-10T14:40:33.059490Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3344 sessionId: src_id|e25f8304-1aa50eb7-e4658af7-1db9b3d2_0 is DEAD
2025-10-10T14:40:33.059652Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e25f8304-1aa50eb7-e4658af7-1db9b3d2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:40:33.059666Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e25f8304-1aa50eb7-e4658af7-1db9b3d2_0] Write session will restart in 0.008211s
2025-10-10T14:40:33.059646Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:33.059691Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e25f8304-1aa50eb7-e4658af7-1db9b3d2_0] Write session: Do CDS request
2025-10-10T14:40:33.059698Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e25f8304-1aa50eb7-e4658af7-1db9b3d2_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:33.057483Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:33.058134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:40:33.058202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603001211452064:5396], now have 1 active actors on pipe
2025-10-10T14:40:33.072835Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e25f8304-1aa50eb7-e4658af7-1db9b3d2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:33.072878Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:33.072895Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3345
2025-10-10T14:40:33.073098Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3345 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:33.073136Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3345 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:33.073142Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3345 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:33.073146Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:33.073865Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3345 sessionId:  describe result for acl check
2025-10-10T14:40:33.073920Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:33.073923Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:33.073926Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:33.073933Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559603005506419409:5900] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:33.074533Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559603005506419409:5900] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:33.079235Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559603005506419409:5900] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:33.083007Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559603005506419409:5900] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:33.083025Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559603005506419409:5900] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:33.083029Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559603005506419409:5900] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:33.083040Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3345 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:33.089005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:33.091515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:33.091797Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:33.091809Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:33.091821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:33.091881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:33.091929Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559603004724165564:13236]
2025-10-10T14:40:33.092635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:33.092995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:33.093061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:33.093419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:33.093515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:33.093516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:33.093518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:33.093519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:33.093521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:33.093522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:33.093523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:33.093525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:33.093526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:33.093528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:33.093529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:33.093530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:33.093532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:33.093539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:33.093555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:33.093559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:33.093563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:33.093567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:33.093571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:33.093575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:33.093579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:33.093583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:33.093588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:33.093592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:33.093596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:33.093600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:33.093610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:33.093619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:33.093625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:33.093631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:33.093636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:33.093641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:33.093646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:33.093651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:33.093657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:33.093663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:33.093668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:33.093674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:33.093680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:33.093686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:33.093692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:33.093698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:33.093704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:33.093711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:33.093715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:33.093721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:33.093726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:33.093731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:33.093746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:33.093750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:33.093756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:33.093762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:33.093806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:33.099078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:33.099771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:33.099788Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:33.099791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:33.099795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:33.099802Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3344 [2:7559603004724165564:13236]
2025-10-10T14:40:33.099819Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:33.099839Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:33.099843Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:33.099847Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:33.099850Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:33.099870Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:33.099878Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:33.099887Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:33.099961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:33.099972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:33.099975Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:33.099978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:33.100072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:33.100082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:33.100096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:33.100108Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:33.100131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:33.100156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603005506419375:2438], now have 1 active actors on pipe
2025-10-10T14:40:33.100171Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559603004724165559:13236]
2025-10-10T14:40:33.100179Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559603004724165559:13236]
2025-10-10T14:40:33.100182Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559603004724165559:13236]
2025-10-10T14:40:33.100200Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:33.100218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603005506419510:5900], now have 1 active actors on pipe
2025-10-10T14:40:33.100233Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:33.100255Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:33.100264Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:33.100264Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:33.100268Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:33.100270Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:33.100306Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559603004724165559:13236]
2025-10-10T14:40:33.100318Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:33.100344Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:33.102916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:33.102942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:33.102981Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b477f9d5-38d797cb-4f33726e-fc0f5e35_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:33.102994Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:33.102745Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3344
2025-10-10T14:40:33.103015Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:33.102790Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3344
2025-10-10T14:40:33.103019Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:33.103036Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:33.103069Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:33.103095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:33.109378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:33.109403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:33.109444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:33.109613Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3345 partition: 0 MaxSeqNo: 40 sessionId: src_id|b477f9d5-38d797cb-4f33726e-fc0f5e35_0
2025-10-10T14:40:33.113673Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e25f8304-1aa50eb7-e4658af7-1db9b3d2_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|b477f9d5-38d797cb-4f33726e-fc0f5e35_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:33.116611Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b477f9d5-38d797cb-4f33726e-fc0f5e35_0] Write session: try to update token
2025-10-10T14:40:33.116637Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b477f9d5-38d797cb-4f33726e-fc0f5e35_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:33.137579Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:33.137601Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:33.137605Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:33.137608Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:33.137619Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559603004724165559:13236]
2025-10-10T14:40:33.137625Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559603004724165559:13236]
2025-10-10T14:40:33.137629Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559603004724165559:13236]
2025-10-10T14:40:33.137685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:33.137701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:33.137704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:33.137858Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:33.137973Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:33.137984Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:33.137988Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:33.146098Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3345 sessionId: src_id|b477f9d5-38d797cb-4f33726e-fc0f5e35_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:33.148854Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:33.165810Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559603005506419567:5396]
2025-10-10T14:40:33.169299Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 pipe creation result: OK TabletId: 72075186224037892 Generation: 3344, pipe: [1:7559603005506419567:5396]
2025-10-10T14:40:33.272942Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:33.273424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:33.273440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:33.273494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603005506419567:5396], now have 1 active actors on pipe
2025-10-10T14:40:33.274920Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 43 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559603005506419567:5396]
2025-10-10T14:40:33.274984Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:40:33.274983Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:33.275060Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3345 reason: status is not ok: tablet will be restarted right now sessionId: src_id|b477f9d5-38d797cb-4f33726e-fc0f5e35_0
2025-10-10T14:40:33.273809Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:33.275295Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3345 sessionId: src_id|b477f9d5-38d797cb-4f33726e-fc0f5e35_0 is DEAD
2025-10-10T14:40:33.276455Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b477f9d5-38d797cb-4f33726e-fc0f5e35_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:40:33.276468Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b477f9d5-38d797cb-4f33726e-fc0f5e35_0] Write session will restart in 0.006690s
2025-10-10T14:40:33.276495Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b477f9d5-38d797cb-4f33726e-fc0f5e35_0] Write session: Do CDS request
2025-10-10T14:40:33.276502Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b477f9d5-38d797cb-4f33726e-fc0f5e35_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:33.284879Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b477f9d5-38d797cb-4f33726e-fc0f5e35_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:33.284990Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:33.285008Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3346
2025-10-10T14:40:33.286652Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3346 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:33.286702Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3346 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:33.286713Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3346 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:33.286718Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:33.287828Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3346 sessionId:  describe result for acl check
2025-10-10T14:40:33.287866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:33.287872Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:33.287885Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:33.287896Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559603005506419621:5909] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:33.288464Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559603005506419621:5909] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:33.294903Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559603005506419621:5909] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:33.300585Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559603005506419621:5909] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:33.300604Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559603005506419621:5909] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:33.300608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559603005506419621:5909] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:33.300617Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3346 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:33.304265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:33.305301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:33.305487Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:33.305503Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:33.305514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:33.305556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:33.305614Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559603004724165753:13238]
2025-10-10T14:40:33.306217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:33.307952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:33.308006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:33.308284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:33.308330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:33.308335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:33.308336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:33.308337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:33.308338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:33.308339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:33.308339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:33.308340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:33.308341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:33.308342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:33.308343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:33.308343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:33.308344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:33.308358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:33.308372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:33.308376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:33.308381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:33.308385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:33.308389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:33.308393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:33.308396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:33.308398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:33.308401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:33.308403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:33.308405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:33.308408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:33.308415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:33.308421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:33.308426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:33.308429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:33.308433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:33.308436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:33.308439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:33.308442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:33.308446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:33.308449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:33.308453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:33.308458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:33.308462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:33.308465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:33.308467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:33.308471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:33.308474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:33.308477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:33.308480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:33.308484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:33.308489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:33.308492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:33.308494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:33.308498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:33.308501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:33.308504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:33.308530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:33.311182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:33.311656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:33.311669Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:33.311672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:33.311675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:33.311682Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3345 [2:7559603004724165753:13238]
2025-10-10T14:40:33.311696Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:33.311717Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:33.311728Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:33.311731Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:33.311734Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:33.311753Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:33.311762Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:33.311778Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:33.311857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:33.311866Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:33.311868Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:33.311871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:33.311947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:33.311955Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:33.311967Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:33.311982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:33.312001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:33.312029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603005506419571:2438], now have 1 active actors on pipe
2025-10-10T14:40:33.312049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603005506419745:5909], now have 1 active actors on pipe
2025-10-10T14:40:33.312056Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559603004724165745:13238]
2025-10-10T14:40:33.312063Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559603004724165745:13238]
2025-10-10T14:40:33.312065Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559603004724165745:13238]
2025-10-10T14:40:33.312080Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:33.312095Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:33.312098Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:33.312105Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:33.312108Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:33.312117Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:33.312121Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:33.312147Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559603004724165745:13238]
2025-10-10T14:40:33.312159Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:33.312165Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:33.312253Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3345
2025-10-10T14:40:33.312294Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3345
2025-10-10T14:40:33.312366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:33.312382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:33.312414Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8a241271-5d711a9d-3e7d9e85-b6b35e85_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:33.312422Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:33.312432Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:33.312434Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:33.312446Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:33.312458Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:33.312480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:33.312666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:33.312676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:33.312692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:33.312784Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3346 partition: 0 MaxSeqNo: 40 sessionId: src_id|8a241271-5d711a9d-3e7d9e85-b6b35e85_0
2025-10-10T14:40:33.313205Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b477f9d5-38d797cb-4f33726e-fc0f5e35_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|8a241271-5d711a9d-3e7d9e85-b6b35e85_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:33.316102Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8a241271-5d711a9d-3e7d9e85-b6b35e85_0] Write session: try to update token
2025-10-10T14:40:33.316124Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8a241271-5d711a9d-3e7d9e85-b6b35e85_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:33.335776Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3346 sessionId: src_id|8a241271-5d711a9d-3e7d9e85-b6b35e85_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:33.338863Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:33.339735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:33.339763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:33.339789Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:33.339792Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:33.339796Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:33.339799Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:33.339807Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559603004724165745:13238]
2025-10-10T14:40:33.339812Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559603004724165745:13238]
2025-10-10T14:40:33.339817Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559603004724165745:13238]
2025-10-10T14:40:33.339865Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:33.339872Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:33.339877Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:33.339887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:33.339895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:33.339898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:33.340054Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:33.374997Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559603005506419761:5396]
2025-10-10T14:40:33.375514Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 pipe creation result: OK TabletId: 72075186224037892 Generation: 3345, pipe: [1:7559603005506419761:5396]
2025-10-10T14:40:33.463235Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:33.463777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:40:33.463840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603005506419761:5396], now have 1 active actors on pipe
2025-10-10T14:40:33.464845Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:40:33.464940Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:40:33.464944Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:40:33.465025Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3346 reason: error at write: Disconnected sessionId: src_id|8a241271-5d711a9d-3e7d9e85-b6b35e85_0
2025-10-10T14:40:33.465222Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3346 sessionId: src_id|8a241271-5d711a9d-3e7d9e85-b6b35e85_0 is DEAD
2025-10-10T14:40:33.465435Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 44 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559603005506419761:5396]
2025-10-10T14:40:33.465456Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:33.469603Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a241271-5d711a9d-3e7d9e85-b6b35e85_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:40:33.469616Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a241271-5d711a9d-3e7d9e85-b6b35e85_0] Write session will restart in 0.005112s
2025-10-10T14:40:33.469643Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a241271-5d711a9d-3e7d9e85-b6b35e85_0] Write session: Do CDS request
2025-10-10T14:40:33.469650Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a241271-5d711a9d-3e7d9e85-b6b35e85_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:33.476004Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8a241271-5d711a9d-3e7d9e85-b6b35e85_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:33.477402Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:33.477422Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3347
2025-10-10T14:40:33.477796Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3347 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:33.477830Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3347 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:33.477836Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3347 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:33.477840Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:33.478343Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3347 sessionId:  describe result for acl check
2025-10-10T14:40:33.478386Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:33.478388Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:33.478390Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:33.478397Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559603005506419783:5919] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:33.478916Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559603005506419783:5919] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:33.484053Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559603005506419783:5919] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:33.489483Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559603005506419783:5919] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:33.489500Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559603005506419783:5919] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:33.489504Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559603005506419783:5919] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:33.489515Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3347 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:33.534508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:33.537811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:33.538096Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:33.538112Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:33.538127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:33.538197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:33.538247Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559603004724165983:13247]
2025-10-10T14:40:33.538937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:33.539380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:33.539453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:33.539840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:33.539921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:33.539923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:33.539925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:33.539926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:33.539941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:33.539943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:33.539944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:33.539946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:33.539948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:33.539949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:33.539951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:33.539953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:33.539955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:33.539962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:33.539977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:33.539982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:33.539987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:33.539992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:33.539997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:33.540002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:33.540006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:33.540011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:33.540028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:33.540045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:33.540049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:33.540053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:33.540064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:33.540075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:33.540095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:33.540107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:33.540113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:33.540118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:33.540127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:33.540136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:33.540142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:33.540153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:33.540157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:33.540163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:33.540173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:33.540179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:33.540183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:33.540192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:33.540196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:33.540201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:33.540206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:33.540210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:33.540216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:33.540221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:33.540230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:33.540236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:33.540246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:33.540252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:33.540334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:33.543518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:33.544111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:33.544128Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:33.544130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:33.544135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:33.544143Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3346 [2:7559603004724165983:13247]
2025-10-10T14:40:33.544158Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:33.544183Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:33.544187Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:33.544191Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:33.544194Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:33.544217Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:33.544225Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:33.544233Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:33.544318Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:33.544329Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:33.544331Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:33.544334Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:33.544408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:33.544415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:33.544428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:33.544448Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:33.544466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:33.544491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603005506419776:2438], now have 1 active actors on pipe
2025-10-10T14:40:33.544500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603005506419817:5919], now have 1 active actors on pipe
2025-10-10T14:40:33.544509Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559603004724165977:13247]
2025-10-10T14:40:33.544511Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559603004724165977:13247]
2025-10-10T14:40:33.544513Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559603004724165977:13247]
2025-10-10T14:40:33.544524Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:33.544532Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:33.544535Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:33.544537Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:33.544545Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:33.544563Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:33.544571Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:33.544612Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559603004724165977:13247]
2025-10-10T14:40:33.544622Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:33.544631Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:33.544665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:33.544679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:33.544725Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e32fe3b1-4b6c3c0f-5155c365-f2e3a352_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:33.544738Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:33.544742Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:33.544749Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:33.544761Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:33.544777Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:33.544798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:33.544994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:33.545005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:33.545025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:33.544558Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3346
2025-10-10T14:40:33.544562Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3346
2025-10-10T14:40:33.545150Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3347 partition: 0 MaxSeqNo: 40 sessionId: src_id|e32fe3b1-4b6c3c0f-5155c365-f2e3a352_0
2025-10-10T14:40:33.545704Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a241271-5d711a9d-3e7d9e85-b6b35e85_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|e32fe3b1-4b6c3c0f-5155c365-f2e3a352_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:33.548606Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e32fe3b1-4b6c3c0f-5155c365-f2e3a352_0] Write session: try to update token
2025-10-10T14:40:33.548627Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e32fe3b1-4b6c3c0f-5155c365-f2e3a352_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:33.565478Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559603005506419979:5396]
2025-10-10T14:40:33.565959Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 pipe creation result: OK TabletId: 72075186224037892 Generation: 3346, pipe: [1:7559603005506419979:5396]
2025-10-10T14:40:33.565999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603005506419979:5396], now have 1 active actors on pipe
2025-10-10T14:40:33.568361Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:33.568384Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:33.568388Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:33.568390Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:33.568400Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559603004724165977:13247]
2025-10-10T14:40:33.568405Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559603004724165977:13247]
2025-10-10T14:40:33.568413Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559603004724165977:13247]
2025-10-10T14:40:33.568466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:33.568475Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:33.568476Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:33.568481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:33.568486Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:33.568491Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:33.568627Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:33.574551Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3347 sessionId: src_id|e32fe3b1-4b6c3c0f-5155c365-f2e3a352_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:33.577793Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:33.693005Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:33.693516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:33.693539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:33.694060Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:33.694953Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:33.695020Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 45 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559603005506419979:5396]
2025-10-10T14:40:33.695051Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:40:33.695136Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3347 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e32fe3b1-4b6c3c0f-5155c365-f2e3a352_0
2025-10-10T14:40:33.695374Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3347 sessionId: src_id|e32fe3b1-4b6c3c0f-5155c365-f2e3a352_0 is DEAD
2025-10-10T14:40:33.697601Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e32fe3b1-4b6c3c0f-5155c365-f2e3a352_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:40:33.697616Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e32fe3b1-4b6c3c0f-5155c365-f2e3a352_0] Write session will restart in 0.008249s
2025-10-10T14:40:33.697644Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e32fe3b1-4b6c3c0f-5155c365-f2e3a352_0] Write session: Do CDS request
2025-10-10T14:40:33.697651Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e32fe3b1-4b6c3c0f-5155c365-f2e3a352_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:33.709743Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e32fe3b1-4b6c3c0f-5155c365-f2e3a352_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:33.713521Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:33.713548Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3348
2025-10-10T14:40:33.717465Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3348 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:33.717552Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3348 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:33.717564Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3348 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:33.717570Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:33.718246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:33.718810Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3348 sessionId:  describe result for acl check
2025-10-10T14:40:33.718857Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:33.718864Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:33.718866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:33.718874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559603005506420138:5939] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:33.719544Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559603005506420138:5939] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:33.721268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:33.721554Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:33.721571Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:33.721586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:33.721656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:33.721705Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559603004724166173:13256]
2025-10-10T14:40:33.722376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:33.722688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:33.722732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:33.723090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:33.723175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:33.723183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:33.723185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:33.723186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:33.723187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:33.723189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:33.723190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:33.723192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:33.723193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:33.723194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:33.723196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:33.723197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:33.723198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:33.723205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:33.723219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:33.723224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:33.723228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:33.723232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:33.723237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:33.723241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:33.723245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:33.723249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:33.723254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:33.723258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:33.723262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:33.723266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:33.723274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:33.723283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:33.723289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:33.723295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:33.723300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:33.723305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:33.723311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:33.723317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:33.723322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:33.723327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:33.723332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:33.723338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:33.723343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:33.723348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:33.723352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:33.723357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:33.723362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:33.723367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:33.723372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:33.723377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:33.723383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:33.723389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:33.723394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:33.723399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:33.723404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:33.723409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:33.723452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:33.723937Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559603005506420138:5939] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:33.726047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:33.726738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:33.726755Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:33.726758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:33.726762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:33.726768Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3347 [2:7559603004724166173:13256]
2025-10-10T14:40:33.726782Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:33.726803Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:33.726806Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:33.726810Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:33.726812Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:33.726829Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:33.726843Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:33.726854Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:33.726911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:33.726916Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:33.726917Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:33.726919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:33.726983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:33.726989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:33.726997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:33.727004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:33.727016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:33.727044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603005506419985:2438], now have 1 active actors on pipe
2025-10-10T14:40:33.727058Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559603004724166168:13256]
2025-10-10T14:40:33.727064Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559603004724166168:13256]
2025-10-10T14:40:33.727068Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559603004724166168:13256]
2025-10-10T14:40:33.727084Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:33.727103Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:33.727122Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:33.727130Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:33.727144Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3347
2025-10-10T14:40:33.727164Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559603004724166168:13256]
2025-10-10T14:40:33.727172Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:33.727179Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:33.727183Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:33.727185Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:33.727194Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:33.732480Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559603005506420138:5939] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:33.732498Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559603005506420138:5939] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:33.732502Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559603005506420138:5939] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:33.732511Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3348 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:33.732896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603005506420175:5939], now have 1 active actors on pipe
2025-10-10T14:40:33.732967Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3347
2025-10-10T14:40:33.733104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:33.733117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:33.733153Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|56c51fbb-99940b2e-fa2f0e8-5be29d67_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:33.733172Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:33.733178Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:33.733181Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:33.733196Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:33.733216Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:33.733247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:33.733501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:33.733508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:33.733525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:33.733763Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3348 partition: 0 MaxSeqNo: 40 sessionId: src_id|56c51fbb-99940b2e-fa2f0e8-5be29d67_0
2025-10-10T14:40:33.737255Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e32fe3b1-4b6c3c0f-5155c365-f2e3a352_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|56c51fbb-99940b2e-fa2f0e8-5be29d67_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:33.743164Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|56c51fbb-99940b2e-fa2f0e8-5be29d67_0] Write session: try to update token
2025-10-10T14:40:33.743192Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|56c51fbb-99940b2e-fa2f0e8-5be29d67_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:33.746549Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:40:33.746568Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:33.746580Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559603004724166168:13256]
2025-10-10T14:40:33.746638Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:40:33.746833Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:40:33.746988Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:33.747129Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:33.747275Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:33.747474Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:40:33.747508Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:40:33.747685Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:40:33.757947Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:33.757967Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:33.757971Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:33.757973Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:33.757986Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559603004724166168:13256]
2025-10-10T14:40:33.757990Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559603004724166168:13256]
2025-10-10T14:40:33.757993Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559603004724166168:13256]
2025-10-10T14:40:33.758042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:33.758044Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:33.758052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:33.758054Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:33.758059Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:33.758060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:33.758209Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:33.767142Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3348 sessionId: src_id|56c51fbb-99940b2e-fa2f0e8-5be29d67_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:33.770059Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:33.795311Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559603005506420178:5396]
2025-10-10T14:40:33.795728Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 pipe creation result: OK TabletId: 72075186224037892 Generation: 3347, pipe: [1:7559603005506420178:5396]
2025-10-10T14:40:33.878204Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:33.878640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:33.878652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:33.878680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603005506420178:5396], now have 1 active actors on pipe
2025-10-10T14:40:33.879241Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 46 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559603005506420178:5396]
2025-10-10T14:40:33.879274Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:33.879315Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:40:33.879318Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:40:33.878946Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:33.879453Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3348 reason: error at write: Disconnected sessionId: src_id|56c51fbb-99940b2e-fa2f0e8-5be29d67_0
2025-10-10T14:40:33.880111Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56c51fbb-99940b2e-fa2f0e8-5be29d67_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:40:33.880123Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56c51fbb-99940b2e-fa2f0e8-5be29d67_0] Write session will restart in 0.009590s
2025-10-10T14:40:33.880149Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56c51fbb-99940b2e-fa2f0e8-5be29d67_0] Write session: Do CDS request
2025-10-10T14:40:33.880156Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56c51fbb-99940b2e-fa2f0e8-5be29d67_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:33.879672Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3348 sessionId: src_id|56c51fbb-99940b2e-fa2f0e8-5be29d67_0 is DEAD
2025-10-10T14:40:33.893726Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|56c51fbb-99940b2e-fa2f0e8-5be29d67_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:33.893828Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:33.893848Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3349
2025-10-10T14:40:33.893985Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3349 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:33.894017Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3349 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:33.894025Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3349 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:33.894030Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:33.894492Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3349 sessionId:  describe result for acl check
2025-10-10T14:40:33.894522Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:33.894523Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:33.894526Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:33.894532Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559603005506420289:5952] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:33.895119Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559603005506420289:5952] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:33.897552Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559603005506420289:5952] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:33.898612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:33.901233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:33.901525Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:33.901538Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:33.901552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:33.901571Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559603005506420289:5952] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:33.901589Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559603005506420289:5952] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:33.901592Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559603005506420289:5952] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:33.901602Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3349 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:33.901623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:33.901670Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559603004724166377:13259]
2025-10-10T14:40:33.902320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:33.902666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:33.902737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:33.903091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:33.903151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:33.903157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:33.903158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:33.903159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:33.903161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:33.903162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:33.903163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:33.903165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:33.903166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:33.903168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:33.903170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:33.903171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:33.903173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:33.903180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:33.903193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:33.903197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:33.903201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:33.903205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:33.903209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:33.903213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:33.903217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:33.903222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:33.903227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:33.903235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:33.903239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:33.903243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:33.903251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:33.903260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:33.903266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:33.903273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:33.903278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:33.903283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:33.903289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:33.903294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:33.903299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:33.903304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:33.903310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:33.903321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:33.903326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:33.903331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:33.903336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:33.903341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:33.903346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:33.903351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:33.903356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:33.903361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:33.903365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:33.903371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:33.903377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:33.903382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:33.903387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:33.903392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:33.903435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:33.906060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:33.906381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:33.906395Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:33.906398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:33.906401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:33.906408Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3348 [2:7559603004724166377:13259]
2025-10-10T14:40:33.906421Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:33.906439Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:33.906443Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:33.906446Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:33.906449Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:33.906467Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:33.906480Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:33.906488Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:33.906550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:33.906556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:33.906558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:33.906561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:33.906630Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:33.906637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:33.906648Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:33.906660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:33.906680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:33.906706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603005506420370:5952], now have 1 active actors on pipe
2025-10-10T14:40:33.906715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603005506420182:2438], now have 1 active actors on pipe
2025-10-10T14:40:33.906724Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559603004724166372:13259]
2025-10-10T14:40:33.906726Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559603004724166372:13259]
2025-10-10T14:40:33.906728Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559603004724166372:13259]
2025-10-10T14:40:33.906743Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:33.906761Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:33.906764Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:33.906767Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:33.906769Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:33.906784Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:33.906787Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:33.906814Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559603004724166372:13259]
2025-10-10T14:40:33.906825Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:33.906801Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3348
2025-10-10T14:40:33.906819Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3348
2025-10-10T14:40:33.906838Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:33.907075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:33.907089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:33.907134Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|91805a9a-4fefa805-29331804-655d8e84_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:33.907147Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:33.907152Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:33.907155Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:33.907167Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:33.907181Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:33.907202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:33.907399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:33.907415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:33.907439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:33.907533Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3349 partition: 0 MaxSeqNo: 40 sessionId: src_id|91805a9a-4fefa805-29331804-655d8e84_0
2025-10-10T14:40:33.907973Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56c51fbb-99940b2e-fa2f0e8-5be29d67_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|91805a9a-4fefa805-29331804-655d8e84_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:33.910867Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|91805a9a-4fefa805-29331804-655d8e84_0] Write session: try to update token
2025-10-10T14:40:33.910889Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|91805a9a-4fefa805-29331804-655d8e84_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:33.926817Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:33.926845Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:33.926848Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:33.926851Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:33.926864Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559603004724166372:13259]
2025-10-10T14:40:33.926869Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559603004724166372:13259]
2025-10-10T14:40:33.926874Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559603004724166372:13259]
2025-10-10T14:40:33.926936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:33.926950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:33.926953Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:33.926951Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:33.926959Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:33.926968Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:33.927096Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:33.927624Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3349 sessionId: src_id|91805a9a-4fefa805-29331804-655d8e84_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:33.930483Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:33.979610Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559603005506420384:5396]
2025-10-10T14:40:33.979922Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 pipe creation result: OK TabletId: 72075186224037892 Generation: 3348, pipe: [1:7559603005506420384:5396]
2025-10-10T14:40:34.050562Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:34.051065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:34.051087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:34.051140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603005506420384:5396], now have 1 active actors on pipe
2025-10-10T14:40:34.051432Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:40:34.051448Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:40:34.051527Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3349 reason: error at write: Disconnected sessionId: src_id|91805a9a-4fefa805-29331804-655d8e84_0
2025-10-10T14:40:34.051539Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:34.051588Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 47 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559603005506420384:5396]
2025-10-10T14:40:34.051789Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3349 sessionId: src_id|91805a9a-4fefa805-29331804-655d8e84_0 is DEAD
2025-10-10T14:40:34.051739Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:34.052212Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91805a9a-4fefa805-29331804-655d8e84_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:40:34.052222Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91805a9a-4fefa805-29331804-655d8e84_0] Write session will restart in 0.006602s
2025-10-10T14:40:34.052248Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91805a9a-4fefa805-29331804-655d8e84_0] Write session: Do CDS request
2025-10-10T14:40:34.052260Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91805a9a-4fefa805-29331804-655d8e84_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:34.059991Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|91805a9a-4fefa805-29331804-655d8e84_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:34.060078Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:34.060094Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3350
2025-10-10T14:40:34.060253Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3350 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:34.060301Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3350 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:34.060311Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3350 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:34.060315Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:34.060776Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3350 sessionId:  describe result for acl check
2025-10-10T14:40:34.060811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:34.060813Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:34.060817Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:34.060823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559603009801387732:5956] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:34.061452Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559603009801387732:5956] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:34.064067Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559603009801387732:5956] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:34.066941Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559603009801387732:5956] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:34.066957Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559603009801387732:5956] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:34.066961Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559603009801387732:5956] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:34.066983Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3350 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:34.067883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:34.070464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:34.070738Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:34.070756Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:34.070770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:34.070859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:34.070914Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559603009019133867:13261]
2025-10-10T14:40:34.071558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:34.071925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:34.071979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:34.072534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:34.072632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:34.072642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:34.072643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:34.072644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:34.072646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:34.072647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:34.072648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:34.072650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:34.072651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:34.072652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:34.072654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:34.072655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:34.072656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:34.072663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:34.072677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:34.072681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:34.072686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:34.072690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:34.072695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:34.072698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:34.072702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:34.072706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:34.072713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:34.072718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:34.072722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:34.072726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:34.072735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:34.072744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:34.072752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:34.072758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:34.072764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:34.072769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:34.072775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:34.072780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:34.072785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:34.072790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:34.072795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:34.072800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:34.072805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:34.072810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:34.072815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:34.072821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:34.072827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:34.072833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:34.072838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:34.072844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:34.072850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:34.072856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:34.072874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:34.072880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:34.072886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:34.072892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:34.072943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:34.075643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:34.075976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:34.075989Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:34.075992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:34.075997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:34.076003Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3349 [2:7559603009019133867:13261]
2025-10-10T14:40:34.076020Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:34.076049Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:34.076052Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:34.076056Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:34.076058Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:34.076076Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:34.076090Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:34.076100Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:34.076164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:34.076171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:34.076173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:34.076177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:34.076251Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:34.076264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:34.076276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:34.076287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:34.076306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:34.076334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603009801387694:2438], now have 1 active actors on pipe
2025-10-10T14:40:34.076342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603009801387877:5956], now have 1 active actors on pipe
2025-10-10T14:40:34.076350Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559603009019133862:13261]
2025-10-10T14:40:34.076357Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559603009019133862:13261]
2025-10-10T14:40:34.076360Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559603009019133862:13261]
2025-10-10T14:40:34.076374Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:34.076393Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:34.076414Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:34.076407Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3349
2025-10-10T14:40:34.076439Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3349
2025-10-10T14:40:34.076425Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:34.076436Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:34.076440Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:34.076443Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:34.076458Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559603009019133862:13261]
2025-10-10T14:40:34.076462Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:34.076475Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:34.076678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:34.076690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:34.076722Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c675ba18-dfde2fa9-2280272a-c0e89f3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:34.076734Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:34.076740Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:34.076747Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:34.076759Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:34.076775Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:34.076795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:34.077091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:34.077118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:34.077146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:34.077253Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3350 partition: 0 MaxSeqNo: 40 sessionId: src_id|c675ba18-dfde2fa9-2280272a-c0e89f3_0
2025-10-10T14:40:34.077728Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91805a9a-4fefa805-29331804-655d8e84_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|c675ba18-dfde2fa9-2280272a-c0e89f3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:34.080954Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c675ba18-dfde2fa9-2280272a-c0e89f3_0] Write session: try to update token
2025-10-10T14:40:34.080978Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c675ba18-dfde2fa9-2280272a-c0e89f3_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:34.096785Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:34.096805Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:34.096810Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:34.096811Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:34.096822Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559603009019133862:13261]
2025-10-10T14:40:34.096827Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559603009019133862:13261]
2025-10-10T14:40:34.096831Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559603009019133862:13261]
2025-10-10T14:40:34.096883Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:34.096891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:34.096893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:34.097035Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:34.097038Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:34.097049Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:34.097053Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:34.098690Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3350 sessionId: src_id|c675ba18-dfde2fa9-2280272a-c0e89f3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:34.101579Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:34.151651Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559603009801387890:5396]
2025-10-10T14:40:34.151977Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 pipe creation result: OK TabletId: 72075186224037892 Generation: 3349, pipe: [1:7559603009801387890:5396]
2025-10-10T14:40:34.214070Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:34.214506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:34.214522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:34.214573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603009801387890:5396], now have 1 active actors on pipe
2025-10-10T14:40:34.214827Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:40:34.214840Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:40:34.214843Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:34.214901Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 48 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559603009801387890:5396]
2025-10-10T14:40:34.214908Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3350 reason: error at write: Disconnected sessionId: src_id|c675ba18-dfde2fa9-2280272a-c0e89f3_0
2025-10-10T14:40:34.215140Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3350 sessionId: src_id|c675ba18-dfde2fa9-2280272a-c0e89f3_0 is DEAD
2025-10-10T14:40:34.215309Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c675ba18-dfde2fa9-2280272a-c0e89f3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:40:34.215334Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c675ba18-dfde2fa9-2280272a-c0e89f3_0] Write session will restart in 0.009017s
2025-10-10T14:40:34.214858Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:34.215361Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c675ba18-dfde2fa9-2280272a-c0e89f3_0] Write session: Do CDS request
2025-10-10T14:40:34.215372Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c675ba18-dfde2fa9-2280272a-c0e89f3_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:34.225930Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c675ba18-dfde2fa9-2280272a-c0e89f3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:34.228524Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:34.228541Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3351
2025-10-10T14:40:34.228830Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3351 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:34.228875Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3351 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:34.228887Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3351 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:34.228891Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:34.229422Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3351 sessionId:  describe result for acl check
2025-10-10T14:40:34.229465Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:34.229468Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:34.229469Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:34.229476Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559603009801388015:5967] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:34.230074Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559603009801388015:5967] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:34.233109Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559603009801388015:5967] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:34.234157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:34.237380Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559603009801388015:5967] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:34.237398Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559603009801388015:5967] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:34.237402Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559603009801388015:5967] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:34.237411Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3351 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:34.236999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:34.237444Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:34.237451Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:34.237469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:34.237570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:34.237615Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559603009019134060:13263]
2025-10-10T14:40:34.238247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:34.238561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:34.238617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:34.238988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:34.239056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:34.239061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:34.239063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:34.239064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:34.239065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:34.239067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:34.239068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:34.239069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:34.239071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:34.239072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:34.239074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:34.239075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:34.239076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:34.239083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:34.239097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:34.239102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:34.239108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:34.239112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:34.239116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:34.239120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:34.239124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:34.239128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:34.239133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:34.239137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:34.239141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:34.239145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:34.239153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:34.239161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:34.239168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:34.239174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:34.239179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:34.239185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:34.239190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:34.239196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:34.239200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:34.239207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:34.239212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:34.239217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:34.239222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:34.239227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:34.239237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:34.239243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:34.239250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:34.239255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:34.239260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:34.239266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:34.239271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:34.239277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:34.239284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:34.239289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:34.239294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:34.239298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:34.239339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:34.242281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:34.242705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:34.242718Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:34.242721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:34.242725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:34.242732Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3350 [2:7559603009019134060:13263]
2025-10-10T14:40:34.242746Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:34.242765Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:34.242768Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:34.242772Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:34.242774Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:34.242793Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:34.242809Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:34.242818Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:34.242874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:34.242881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:34.242883Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:34.242888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:34.242972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:34.242980Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:34.242992Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:34.243005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:34.243022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:34.243050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603009801387892:2438], now have 1 active actors on pipe
2025-10-10T14:40:34.243058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603009801388078:5967], now have 1 active actors on pipe
2025-10-10T14:40:34.243066Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559603009019134055:13263]
2025-10-10T14:40:34.243069Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559603009019134055:13263]
2025-10-10T14:40:34.243072Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559603009019134055:13263]
2025-10-10T14:40:34.243085Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:34.243100Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:34.243111Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:34.243115Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:34.243117Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:34.243121Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:34.243125Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:34.243115Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3350
2025-10-10T14:40:34.243149Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559603009019134055:13263]
2025-10-10T14:40:34.243151Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3350
2025-10-10T14:40:34.243158Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:34.243173Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:34.243193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:34.243198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:34.243236Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3645baa6-e83085d4-af4b37dd-f8bd27c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:34.243248Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:34.243253Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:34.243260Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:34.243271Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:34.243282Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:34.243300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:34.243517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:34.243527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:34.243543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:34.243652Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3351 partition: 0 MaxSeqNo: 40 sessionId: src_id|3645baa6-e83085d4-af4b37dd-f8bd27c_0
2025-10-10T14:40:34.244098Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c675ba18-dfde2fa9-2280272a-c0e89f3_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|3645baa6-e83085d4-af4b37dd-f8bd27c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:34.246932Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3645baa6-e83085d4-af4b37dd-f8bd27c_0] Write session: try to update token
2025-10-10T14:40:34.246950Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3645baa6-e83085d4-af4b37dd-f8bd27c_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:34.264345Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:34.264368Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:34.264372Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:34.264374Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:34.264387Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559603009019134055:13263]
2025-10-10T14:40:34.264392Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559603009019134055:13263]
2025-10-10T14:40:34.264395Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559603009019134055:13263]
2025-10-10T14:40:34.264450Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:34.264465Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:34.264467Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:34.264469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:34.264472Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:34.264476Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:34.264625Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:34.271920Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3351 sessionId: src_id|3645baa6-e83085d4-af4b37dd-f8bd27c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:34.274804Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:34.314961Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559603009801388090:5396]
2025-10-10T14:40:34.315280Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 pipe creation result: OK TabletId: 72075186224037892 Generation: 3350, pipe: [1:7559603009801388090:5396]
2025-10-10T14:40:34.388662Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:34.389056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:34.389076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:34.389102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603009801388090:5396], now have 1 active actors on pipe
2025-10-10T14:40:34.389357Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:34.389369Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 49 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559603009801388090:5396]
2025-10-10T14:40:34.389400Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:40:34.389403Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:40:34.389473Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3351 reason: error at write: Disconnected sessionId: src_id|3645baa6-e83085d4-af4b37dd-f8bd27c_0
2025-10-10T14:40:34.389722Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3351 sessionId: src_id|3645baa6-e83085d4-af4b37dd-f8bd27c_0 is DEAD
2025-10-10T14:40:34.389447Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:34.390144Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3645baa6-e83085d4-af4b37dd-f8bd27c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:40:34.390157Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3645baa6-e83085d4-af4b37dd-f8bd27c_0] Write session will restart in 0.006196s
2025-10-10T14:40:34.390184Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3645baa6-e83085d4-af4b37dd-f8bd27c_0] Write session: Do CDS request
2025-10-10T14:40:34.390190Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3645baa6-e83085d4-af4b37dd-f8bd27c_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:34.398049Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3645baa6-e83085d4-af4b37dd-f8bd27c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:34.399232Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:34.399249Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3352
2025-10-10T14:40:34.399432Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3352 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:34.399480Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3352 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:34.399491Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3352 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:34.399504Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:34.400101Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3352 sessionId:  describe result for acl check
2025-10-10T14:40:34.400149Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:34.400155Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:34.400157Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:34.400165Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559603009801388133:5993] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:34.400765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559603009801388133:5993] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:34.406105Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559603009801388133:5993] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:34.408565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:34.411214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:34.411395Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559603009801388133:5993] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:34.411412Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559603009801388133:5993] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:34.411416Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559603009801388133:5993] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:34.411426Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3352 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:34.411589Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:34.411608Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:34.411625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:34.411702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:34.411754Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559603009019134257:13266]
2025-10-10T14:40:34.412377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:34.412749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:34.412801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:34.413141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:34.413212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:34.413219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:34.413221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:34.413222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:34.413223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:34.413225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:34.413226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:34.413227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:34.413228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:34.413230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:34.413231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:34.413232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:34.413233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:34.413239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:34.413252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:34.413256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:34.413260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:34.413264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:34.413268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:34.413271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:34.413275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:34.413279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:34.413283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:34.413286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:34.413290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:34.413294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:34.413302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:34.413311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:34.413318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:34.413324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:34.413347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:34.413353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:34.413358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:34.413365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:34.413379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:34.413383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:34.413387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:34.413390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:34.413398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:34.413402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:34.413406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:34.413410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:34.413414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:34.413419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:34.413422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:34.413427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:34.413430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:34.413435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:34.413440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:34.413444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:34.413449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:34.413454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:34.413499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:34.416663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:34.417135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:34.417154Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:34.417157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:34.417161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:34.417168Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3351 [2:7559603009019134257:13266]
2025-10-10T14:40:34.417184Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:34.417208Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:34.417219Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:34.417222Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:34.417229Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:34.417247Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:34.417259Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:34.417272Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:34.417362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:34.417370Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:34.417372Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:34.417375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:34.417621Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3351
2025-10-10T14:40:34.417666Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3351
2025-10-10T14:40:34.417447Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:34.417458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:34.417470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:34.417482Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:34.417500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:34.417524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603009801388092:2438], now have 1 active actors on pipe
2025-10-10T14:40:34.417528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603009801388279:5993], now have 1 active actors on pipe
2025-10-10T14:40:34.417539Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559603009019134252:13266]
2025-10-10T14:40:34.417541Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559603009019134252:13266]
2025-10-10T14:40:34.417543Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559603009019134252:13266]
2025-10-10T14:40:34.417558Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:34.417575Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:34.417578Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:34.417582Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:34.417584Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:34.417591Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:34.417595Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:34.417624Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559603009019134252:13266]
2025-10-10T14:40:34.417636Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:34.417657Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:34.417855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:34.417869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:34.417902Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2b122acd-2bd24ff5-1e11e52c-7f932142_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:34.417911Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:34.417915Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:34.417917Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:34.417930Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:34.417943Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:34.417959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:34.418117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:34.418126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:34.418145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:34.418306Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3352 partition: 0 MaxSeqNo: 40 sessionId: src_id|2b122acd-2bd24ff5-1e11e52c-7f932142_0
2025-10-10T14:40:34.418818Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3645baa6-e83085d4-af4b37dd-f8bd27c_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|2b122acd-2bd24ff5-1e11e52c-7f932142_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:34.421781Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2b122acd-2bd24ff5-1e11e52c-7f932142_0] Write session: try to update token
2025-10-10T14:40:34.421803Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2b122acd-2bd24ff5-1e11e52c-7f932142_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:34.440238Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3352 sessionId: src_id|2b122acd-2bd24ff5-1e11e52c-7f932142_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:34.443085Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:34.443348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:34.443375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:34.443438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:40:34.443535Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:40:34.446174Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:34.446202Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:34.446206Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:34.446208Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:34.446218Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559603009019134252:13266]
2025-10-10T14:40:34.446223Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559603009019134252:13266]
2025-10-10T14:40:34.446227Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559603009019134252:13266]
2025-10-10T14:40:34.446283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:34.446289Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:34.446291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:34.446294Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:34.446297Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:34.446303Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:34.446442Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:34.489575Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559603009801388291:5396]
2025-10-10T14:40:34.489935Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 pipe creation result: OK TabletId: 72075186224037892 Generation: 3351, pipe: [1:7559603009801388291:5396]
2025-10-10T14:40:34.568538Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:34.581543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:34.581574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:34.581772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:34.581842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:34.581916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:34.581986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:34.582035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:34.582043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:34.582120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:34.582178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:34.582241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:34.582304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:34.582349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:34.582355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:34.582426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:34.582487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:34.582549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:34.582613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:34.582655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:34.582658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:34.582730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:34.582791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:34.582852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:34.582912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:34.582952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:34.582956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:34.583028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:34.583089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:34.583151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:34.583218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:34.583261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:34.583264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:34.583335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:34.583401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:34.583463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:34.583525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:34.583579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:34.583582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:34.583655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:34.583725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:34.583794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:34.583857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:34.583915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:34.583919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:34.583995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:34.584073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:34.584135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:34.584198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:34.585489Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:40:34.584239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:34.585512Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:40:34.584242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:34.584309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:34.584368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:34.585542Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3352 reason: error at write: Disconnected sessionId: src_id|2b122acd-2bd24ff5-1e11e52c-7f932142_0
2025-10-10T14:40:34.584431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:34.584496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:34.584541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:34.584544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:34.584618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:34.584677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:34.584741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:34.584807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:34.585168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:34.585172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:34.585227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603009801388291:5396], now have 1 active actors on pipe
2025-10-10T14:40:34.585771Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3352 sessionId: src_id|2b122acd-2bd24ff5-1e11e52c-7f932142_0 is DEAD
2025-10-10T14:40:34.585938Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b122acd-2bd24ff5-1e11e52c-7f932142_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:40:34.585948Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b122acd-2bd24ff5-1e11e52c-7f932142_0] Write session will restart in 0.009269s
2025-10-10T14:40:34.585970Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 50 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559603009801388291:5396]
2025-10-10T14:40:34.585988Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b122acd-2bd24ff5-1e11e52c-7f932142_0] Write session: Do CDS request
2025-10-10T14:40:34.585995Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b122acd-2bd24ff5-1e11e52c-7f932142_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:34.585995Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:34.590201Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:34.596958Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2b122acd-2bd24ff5-1e11e52c-7f932142_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:34.597869Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:34.597889Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3353
2025-10-10T14:40:34.598179Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3353 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:34.598219Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3353 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:34.598229Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3353 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:34.598233Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:34.598696Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3353 sessionId:  describe result for acl check
2025-10-10T14:40:34.598737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:34.598744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:34.598746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:34.598753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559603009801388376:6002] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:34.599303Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559603009801388376:6002] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:34.603052Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559603009801388376:6002] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:34.606151Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559603009801388376:6002] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:34.606167Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559603009801388376:6002] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:34.606171Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559603009801388376:6002] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:34.606182Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3353 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:34.607013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:34.609409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:34.609657Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:34.609671Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:34.609685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:34.609743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:34.609798Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559603009019134493:13279]
2025-10-10T14:40:34.610454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:34.610841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:34.610912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:34.611259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:34.611340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:34.611348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:34.611349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:34.611350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:34.611352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:34.611353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:34.611355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:34.611357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:34.611358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:34.611360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:34.611361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:34.611362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:34.611364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:34.611370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:34.611385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:34.611390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:34.611395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:34.611399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:34.611404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:34.611409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:34.611413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:34.611418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:34.611422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:34.611426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:34.611431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:34.611435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:34.611444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:34.611453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:34.611460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:34.611466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:34.611471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:34.611477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:34.611482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:34.611491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:34.611496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:34.611502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:34.611507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:34.611512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:34.611518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:34.611529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:34.611536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:34.611542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:34.611547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:34.611553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:34.611563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:34.611568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:34.611576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:34.611581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:34.611591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:34.611596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:34.611604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:34.611610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:34.611659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:34.617664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:34.618300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:34.618314Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:34.618316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:34.618320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:34.618327Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3352 [2:7559603009019134493:13279]
2025-10-10T14:40:34.618342Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:34.618362Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:34.618366Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:34.618370Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:34.618372Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:34.618391Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:34.618409Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:34.618418Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:34.618490Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:34.618500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:34.618502Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:34.618505Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:34.618582Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:34.618592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:34.618607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:34.618620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:34.618640Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:34.618664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603009801388314:2438], now have 1 active actors on pipe
2025-10-10T14:40:34.618673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603009801388507:6002], now have 1 active actors on pipe
2025-10-10T14:40:34.618682Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559603009019134488:13279]
2025-10-10T14:40:34.618684Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559603009019134488:13279]
2025-10-10T14:40:34.618686Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559603009019134488:13279]
2025-10-10T14:40:34.618700Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:34.618716Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:34.618737Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:34.618745Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:34.618740Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3352
2025-10-10T14:40:34.618746Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3352
2025-10-10T14:40:34.618781Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559603009019134488:13279]
2025-10-10T14:40:34.618786Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:34.618789Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:34.618792Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:34.618792Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:34.618799Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:34.618835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:34.618840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:34.618879Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9e929eb4-43d7e75d-65cbb139-883d44db_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:34.618887Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:34.618893Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:34.618895Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:34.618907Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:34.618918Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:34.618932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:34.619106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:34.619115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:34.619139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:34.619240Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3353 partition: 0 MaxSeqNo: 40 sessionId: src_id|9e929eb4-43d7e75d-65cbb139-883d44db_0
2025-10-10T14:40:34.619650Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b122acd-2bd24ff5-1e11e52c-7f932142_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|9e929eb4-43d7e75d-65cbb139-883d44db_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:34.622460Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9e929eb4-43d7e75d-65cbb139-883d44db_0] Write session: try to update token
2025-10-10T14:40:34.622483Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9e929eb4-43d7e75d-65cbb139-883d44db_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:34.643732Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3353 sessionId: src_id|9e929eb4-43d7e75d-65cbb139-883d44db_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:34.646591Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:34.646299Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:34.646327Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:34.646331Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:34.646338Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:34.646349Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559603009019134488:13279]
2025-10-10T14:40:34.646354Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559603009019134488:13279]
2025-10-10T14:40:34.646359Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559603009019134488:13279]
2025-10-10T14:40:34.646416Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:34.646426Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:34.646429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:34.646583Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:34.646735Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:34.646742Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:34.646747Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:34.689122Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559603009801388522:5396]
2025-10-10T14:40:34.689642Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 pipe creation result: OK TabletId: 72075186224037892 Generation: 3352, pipe: [1:7559603009801388522:5396]
2025-10-10T14:40:34.762793Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:34.763197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:34.763210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:34.763258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603009801388522:5396], now have 1 active actors on pipe
2025-10-10T14:40:34.763533Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:34.763689Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:40:34.763803Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3353 reason: status is not ok: tablet will be restarted right now sessionId: src_id|9e929eb4-43d7e75d-65cbb139-883d44db_0
2025-10-10T14:40:34.764061Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3353 sessionId: src_id|9e929eb4-43d7e75d-65cbb139-883d44db_0 is DEAD
2025-10-10T14:40:34.764186Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e929eb4-43d7e75d-65cbb139-883d44db_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:40:34.764194Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e929eb4-43d7e75d-65cbb139-883d44db_0] Write session will restart in 0.005241s
2025-10-10T14:40:34.764212Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e929eb4-43d7e75d-65cbb139-883d44db_0] Write session: Do CDS request
2025-10-10T14:40:34.764217Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e929eb4-43d7e75d-65cbb139-883d44db_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:34.764222Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:34.764238Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 51 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559603009801388522:5396]
2025-10-10T14:40:34.770986Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9e929eb4-43d7e75d-65cbb139-883d44db_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:34.771136Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:34.771159Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3354
2025-10-10T14:40:34.771349Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3354 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:34.771383Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3354 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:34.771390Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3354 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:34.771394Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:34.771862Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3354 sessionId:  describe result for acl check
2025-10-10T14:40:34.771902Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:34.771910Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:34.771912Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:34.771922Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559603009801388539:6015] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:34.772564Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559603009801388539:6015] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:34.778032Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559603009801388539:6015] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:34.781977Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559603009801388539:6015] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:34.781995Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559603009801388539:6015] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:34.781999Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559603009801388539:6015] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:34.782010Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3354 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:34.782976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:34.785800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:34.786070Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:34.786076Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:34.786090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:34.786158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:34.786200Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559603009019134690:13283]
2025-10-10T14:40:34.786868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:34.787197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:34.787251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:34.787947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:34.788045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:34.788046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:34.788048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:34.788049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:34.788050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:34.788051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:34.788052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:34.788069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:34.788071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:34.788072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:34.788074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:34.788075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:34.788077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:34.788084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:34.788097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:34.788101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:34.788105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:34.788109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:34.788113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:34.788116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:34.788120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:34.788124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:34.788127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:34.788131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:34.788134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:34.788138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:34.788148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:34.788157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:34.788164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:34.788170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:34.788176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:34.788181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:34.788186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:34.788192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:34.788197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:34.788205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:34.788210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:34.788216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:34.788220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:34.788225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:34.788230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:34.788235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:34.788244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:34.788249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:34.788254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:34.788259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:34.788264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:34.788270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:34.788274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:34.788279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:34.788284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:34.788289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:34.788329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:34.791767Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3353
2025-10-10T14:40:34.791838Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3353
2025-10-10T14:40:34.791059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:34.791395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:34.791400Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:34.791403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:34.791407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:34.791413Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3353 [2:7559603009019134690:13283]
2025-10-10T14:40:34.791427Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:34.791447Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:34.791451Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:34.791454Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:34.791457Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:34.791475Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:34.791483Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:34.791506Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:34.791567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:34.791569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:34.791571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:34.791574Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:34.791645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:34.791648Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:34.791661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:34.791673Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:34.791692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:34.791716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603009801388711:6015], now have 1 active actors on pipe
2025-10-10T14:40:34.791721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603009801388524:2438], now have 1 active actors on pipe
2025-10-10T14:40:34.791729Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559603009019134685:13283]
2025-10-10T14:40:34.791731Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559603009019134685:13283]
2025-10-10T14:40:34.791736Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559603009019134685:13283]
2025-10-10T14:40:34.791750Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:34.791765Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:34.791770Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:34.791773Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:34.791775Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:34.791782Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:34.791785Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:34.791816Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559603009019134685:13283]
2025-10-10T14:40:34.791819Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:34.791821Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:34.791874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:34.791879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:34.791917Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ee0c8061-348dcb1c-855e740a-96bf7730_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:34.791926Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:34.791931Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:34.791934Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:34.791945Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:34.791955Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:34.791968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:34.792146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:34.792153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:34.792179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:34.792276Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3354 partition: 0 MaxSeqNo: 40 sessionId: src_id|ee0c8061-348dcb1c-855e740a-96bf7730_0
2025-10-10T14:40:34.792722Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e929eb4-43d7e75d-65cbb139-883d44db_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|ee0c8061-348dcb1c-855e740a-96bf7730_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:34.796352Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ee0c8061-348dcb1c-855e740a-96bf7730_0] Write session: try to update token
2025-10-10T14:40:34.796394Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ee0c8061-348dcb1c-855e740a-96bf7730_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:34.811720Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:34.811743Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:34.811747Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:34.811749Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:34.811761Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559603009019134685:13283]
2025-10-10T14:40:34.811765Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559603009019134685:13283]
2025-10-10T14:40:34.811770Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559603009019134685:13283]
2025-10-10T14:40:34.811826Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:34.811834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:34.811843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:34.811910Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:34.811925Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:34.811930Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:34.811987Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:34.812935Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3354 sessionId: src_id|ee0c8061-348dcb1c-855e740a-96bf7730_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:34.815785Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:34.863872Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559603009801388726:5396]
2025-10-10T14:40:34.864121Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 pipe creation result: OK TabletId: 72075186224037892 Generation: 3353, pipe: [1:7559603009801388726:5396]
2025-10-10T14:40:34.930918Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:34.931338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:34.931359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:34.931423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603009801388726:5396], now have 1 active actors on pipe
2025-10-10T14:40:34.931655Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:34.931741Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 52 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559603009801388726:5396]
2025-10-10T14:40:34.931742Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:34.931789Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:40:34.932282Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ee0c8061-348dcb1c-855e740a-96bf7730_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:40:34.932294Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ee0c8061-348dcb1c-855e740a-96bf7730_0] Write session will restart in 0.008880s
2025-10-10T14:40:34.931877Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3354 reason: status is not ok: tablet will be restarted right now sessionId: src_id|ee0c8061-348dcb1c-855e740a-96bf7730_0
2025-10-10T14:40:34.932111Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3354 sessionId: src_id|ee0c8061-348dcb1c-855e740a-96bf7730_0 is DEAD
2025-10-10T14:40:34.932321Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ee0c8061-348dcb1c-855e740a-96bf7730_0] Write session: Do CDS request
2025-10-10T14:40:34.932328Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ee0c8061-348dcb1c-855e740a-96bf7730_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:34.942957Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ee0c8061-348dcb1c-855e740a-96bf7730_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:34.943065Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:34.943081Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3355
2025-10-10T14:40:34.943376Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3355 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:34.943426Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3355 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:34.943439Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3355 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:34.943443Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:34.943964Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3355 sessionId:  describe result for acl check
2025-10-10T14:40:34.944002Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:34.944008Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:34.944019Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:34.944025Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559603009801388815:5654] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:34.944642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559603009801388815:5654] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:34.947271Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559603009801388815:5654] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:34.953324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:34.955575Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559603009801388815:5654] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:34.955595Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559603009801388815:5654] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:34.955600Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559603009801388815:5654] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:34.955610Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3355 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:34.955578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:34.956118Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:34.956135Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:34.956151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:34.956226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:34.956278Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559603009019134900:13286]
2025-10-10T14:40:34.956948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:34.957300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:34.957369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:34.957651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:34.957711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:34.957718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:34.957719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:34.957721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:34.957722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:34.957723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:34.957725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:34.957726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:34.957727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:34.957729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:34.957730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:34.957732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:34.957733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:34.957740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:34.957750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:34.957752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:34.957755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:34.957757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:34.957760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:34.957762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:34.957764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:34.957766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:34.957769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:34.957771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:34.957773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:34.957775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:34.957782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:34.957788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:34.957794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:34.957798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:34.957802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:34.957808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:34.957812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:34.957819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:34.957823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:34.957828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:34.957833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:34.957838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:34.957843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:34.957848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:34.957852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:34.957857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:34.957863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:34.957868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:34.957872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:34.957877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:34.957881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:34.957886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:34.957890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:34.957895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:34.957901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:34.957906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:34.957934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:34.960553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:34.960907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:34.960923Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:34.960925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:34.960930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:34.960937Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3354 [2:7559603009019134900:13286]
2025-10-10T14:40:34.960951Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:34.960969Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:34.960972Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:34.960976Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:34.960979Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:34.960996Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:34.961006Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:34.961015Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:34.961078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:34.961086Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:34.961088Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:34.961092Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:34.961167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:34.961176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:34.961187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:34.961200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:34.961223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:34.961251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603009801388925:5654], now have 1 active actors on pipe
2025-10-10T14:40:34.961260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603009801388731:2438], now have 1 active actors on pipe
2025-10-10T14:40:34.961269Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559603009019134894:13286]
2025-10-10T14:40:34.961276Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559603009019134894:13286]
2025-10-10T14:40:34.961279Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559603009019134894:13286]
2025-10-10T14:40:34.961292Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:34.961308Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:34.961309Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:34.961312Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:34.961315Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:34.961345Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3354
2025-10-10T14:40:34.961370Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3354
2025-10-10T14:40:34.961352Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:34.961364Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:34.961405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:34.961411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:34.961431Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559603009019134894:13286]
2025-10-10T14:40:34.961447Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:34.961460Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:34.961485Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8a9eb4aa-4da47d0-8142d6aa-d5286099_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:34.961498Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:34.961505Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:34.961508Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:34.961521Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:34.961536Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:34.961564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:34.961762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:34.961771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:34.961788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:34.961873Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3355 partition: 0 MaxSeqNo: 40 sessionId: src_id|8a9eb4aa-4da47d0-8142d6aa-d5286099_0
2025-10-10T14:40:34.962291Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ee0c8061-348dcb1c-855e740a-96bf7730_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|8a9eb4aa-4da47d0-8142d6aa-d5286099_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:34.965137Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8a9eb4aa-4da47d0-8142d6aa-d5286099_0] Write session: try to update token
2025-10-10T14:40:34.965155Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8a9eb4aa-4da47d0-8142d6aa-d5286099_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:34.980592Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3355 sessionId: src_id|8a9eb4aa-4da47d0-8142d6aa-d5286099_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:34.982160Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:34.982179Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:34.982182Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:34.982185Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:34.982195Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559603009019134894:13286]
2025-10-10T14:40:34.982199Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559603009019134894:13286]
2025-10-10T14:40:34.982205Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559603009019134894:13286]
2025-10-10T14:40:34.982256Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:34.982257Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:34.982266Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:34.982271Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:34.982271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:34.982274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:34.982422Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:34.983416Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:35.031756Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559603014096356245:5396]
2025-10-10T14:40:35.032041Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 pipe creation result: OK TabletId: 72075186224037892 Generation: 3354, pipe: [1:7559603014096356245:5396]
2025-10-10T14:40:35.100880Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 53 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559603014096356245:5396]
2025-10-10T14:40:35.100917Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:40:35.100919Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:40:35.100988Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:35.100059Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:35.100455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:35.100466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:35.100515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603014096356245:5396], now have 1 active actors on pipe
2025-10-10T14:40:35.101096Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:35.101702Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a9eb4aa-4da47d0-8142d6aa-d5286099_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:40:35.101711Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a9eb4aa-4da47d0-8142d6aa-d5286099_0] Write session will restart in 0.005347s
2025-10-10T14:40:35.101735Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a9eb4aa-4da47d0-8142d6aa-d5286099_0] Write session: Do CDS request
2025-10-10T14:40:35.101741Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a9eb4aa-4da47d0-8142d6aa-d5286099_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:35.101086Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3355 reason: error at write: Disconnected sessionId: src_id|8a9eb4aa-4da47d0-8142d6aa-d5286099_0
2025-10-10T14:40:35.101307Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3355 sessionId: src_id|8a9eb4aa-4da47d0-8142d6aa-d5286099_0 is DEAD
2025-10-10T14:40:35.107849Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8a9eb4aa-4da47d0-8142d6aa-d5286099_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:35.107955Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:35.107970Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3356
2025-10-10T14:40:35.108193Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3356 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:35.108232Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3356 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:35.108243Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3356 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:35.108246Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:35.108843Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3356 sessionId:  describe result for acl check
2025-10-10T14:40:35.108877Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:35.108883Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:35.108885Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:35.108891Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559603014096356261:5697] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:35.109465Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559603014096356261:5697] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:35.115878Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559603014096356261:5697] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:35.122372Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559603014096356261:5697] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:35.122388Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559603014096356261:5697] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:35.122392Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559603014096356261:5697] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:35.122402Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3356 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:35.125820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:35.128773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:35.129204Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:35.129216Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:35.129230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:35.129314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:35.129374Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559603013314102395:13288]
2025-10-10T14:40:35.130044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:35.130433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:35.130485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:35.130860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:35.130922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:35.130929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:35.130930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:35.130932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:35.130933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:35.130935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:35.130937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:35.130938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:35.130950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:35.130951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:35.130953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:35.130955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:35.130956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:35.130963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:35.130978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:35.130982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:35.130986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:35.130990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:35.130995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:35.130998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:35.131002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:35.131007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:35.131011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:35.131015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:35.131020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:35.131024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:35.131032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:35.131041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:35.131048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:35.131054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:35.131059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:35.131064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:35.131069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:35.131075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:35.131080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:35.131085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:35.131090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:35.131095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:35.131101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:35.131106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:35.131110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:35.131116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:35.131122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:35.131134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:35.131138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:35.131144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:35.131148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:35.131154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:35.131158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:35.131164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:35.131169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:35.131174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:35.131219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:35.133961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:35.134552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:35.134566Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:35.134568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:35.134573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:35.134581Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3355 [2:7559603013314102395:13288]
2025-10-10T14:40:35.134596Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:35.134623Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:35.134626Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:35.134634Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:35.134637Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:35.134657Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:35.134667Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:35.134675Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:35.134749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:35.134758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:35.134760Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:35.134763Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:35.134842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:35.134851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:35.134864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:35.134881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:35.134901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:35.134923Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559603013314102390:13288]
2025-10-10T14:40:35.134932Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559603013314102390:13288]
2025-10-10T14:40:35.134935Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559603013314102390:13288]
2025-10-10T14:40:35.134951Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:35.134968Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:35.134987Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:35.134990Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:35.134992Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:35.134995Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:35.134997Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:35.135025Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559603013314102390:13288]
2025-10-10T14:40:35.135029Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:35.135079Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:35.135212Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3355
2025-10-10T14:40:35.135253Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3355
2025-10-10T14:40:35.135138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603014096356246:2438], now have 1 active actors on pipe
2025-10-10T14:40:35.135158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603014096356417:5697], now have 1 active actors on pipe
2025-10-10T14:40:35.135330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:35.135341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:35.135380Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6a099a25-4c56ec10-a46834df-fd7d904_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:35.135395Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:35.135400Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:35.135403Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:35.135416Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:35.135434Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:35.135456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:35.135682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:35.135692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:35.135711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:35.135851Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3356 partition: 0 MaxSeqNo: 40 sessionId: src_id|6a099a25-4c56ec10-a46834df-fd7d904_0
2025-10-10T14:40:35.136322Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a9eb4aa-4da47d0-8142d6aa-d5286099_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|6a099a25-4c56ec10-a46834df-fd7d904_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:35.139213Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6a099a25-4c56ec10-a46834df-fd7d904_0] Write session: try to update token
2025-10-10T14:40:35.139235Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6a099a25-4c56ec10-a46834df-fd7d904_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:35.155490Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3356 sessionId: src_id|6a099a25-4c56ec10-a46834df-fd7d904_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:35.156205Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:35.156225Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:35.156233Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:35.156235Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:35.156247Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559603013314102390:13288]
2025-10-10T14:40:35.156252Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559603013314102390:13288]
2025-10-10T14:40:35.156256Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559603013314102390:13288]
2025-10-10T14:40:35.156313Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:35.156324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:35.156327Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:35.156472Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:35.158711Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:35.158728Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:35.158732Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:35.158373Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:35.201368Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559603014096356449:5396]
2025-10-10T14:40:35.201808Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 pipe creation result: OK TabletId: 72075186224037892 Generation: 3355, pipe: [1:7559603014096356449:5396]
2025-10-10T14:40:35.272287Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:35.272689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:35.272708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:35.272759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603014096356449:5396], now have 1 active actors on pipe
2025-10-10T14:40:35.273032Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:35.273041Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 54 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559603014096356449:5396]
2025-10-10T14:40:35.273091Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:40:35.273102Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:40:35.273173Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3356 reason: error at write: Disconnected sessionId: src_id|6a099a25-4c56ec10-a46834df-fd7d904_0
2025-10-10T14:40:35.273418Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3356 sessionId: src_id|6a099a25-4c56ec10-a46834df-fd7d904_0 is DEAD
2025-10-10T14:40:35.273608Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a099a25-4c56ec10-a46834df-fd7d904_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:40:35.273620Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a099a25-4c56ec10-a46834df-fd7d904_0] Write session will restart in 0.005348s
2025-10-10T14:40:35.273647Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a099a25-4c56ec10-a46834df-fd7d904_0] Write session: Do CDS request
2025-10-10T14:40:35.273653Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a099a25-4c56ec10-a46834df-fd7d904_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:35.273292Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:35.279933Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6a099a25-4c56ec10-a46834df-fd7d904_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:35.279992Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:35.280018Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3357
2025-10-10T14:40:35.280230Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3357 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:35.280275Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3357 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:35.280286Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3357 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:35.280290Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:35.280770Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3357 sessionId:  describe result for acl check
2025-10-10T14:40:35.280809Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:35.280816Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:35.280831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:35.280843Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559603014096356466:5718] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:35.281473Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559603014096356466:5718] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:35.285215Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559603014096356466:5718] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:35.289531Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559603014096356466:5718] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:35.289548Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559603014096356466:5718] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:35.289552Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559603014096356466:5718] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:35.289561Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3357 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:35.291690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:35.294514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:35.294891Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:35.294904Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:35.294917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:35.294987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:35.295031Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559603013314102595:13290]
2025-10-10T14:40:35.295649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:35.295923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:35.295968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:35.296301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:35.296352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:35.296354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:35.296355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:35.296357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:35.296358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:35.296359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:35.296361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:35.296362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:35.296363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:35.296364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:35.296365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:35.296367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:35.296368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:35.296374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:35.296387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:35.296390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:35.296394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:35.296398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:35.296402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:35.296406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:35.296410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:35.296414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:35.296418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:35.296422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:35.296426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:35.296431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:35.296439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:35.296447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:35.296454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:35.296460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:35.296465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:35.296470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:35.296475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:35.296480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:35.296485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:35.296490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:35.296496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:35.296501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:35.296508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:35.296513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:35.296518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:35.296523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:35.296530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:35.296535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:35.296539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:35.296545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:35.296549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:35.296554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:35.296559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:35.296564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:35.296569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:35.296574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:35.296615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:35.298974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:35.299591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:35.299604Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:35.299607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:35.299611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:35.299617Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3356 [2:7559603013314102595:13290]
2025-10-10T14:40:35.299632Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:35.299650Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:35.299654Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:35.299658Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:35.299660Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:35.299678Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:35.299686Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:35.299694Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:35.299753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:35.299755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:35.299757Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:35.299760Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:35.299832Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:35.299841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:35.299853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:35.299871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:35.299896Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:35.299918Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559603013314102590:13290]
2025-10-10T14:40:35.299926Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559603013314102590:13290]
2025-10-10T14:40:35.299928Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559603013314102590:13290]
2025-10-10T14:40:35.299938Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:35.299949Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:35.299952Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:35.299955Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:35.299958Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:35.299972Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:35.299981Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:35.299992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603014096356630:5718], now have 1 active actors on pipe
2025-10-10T14:40:35.300001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603014096356450:2438], now have 1 active actors on pipe
2025-10-10T14:40:35.300044Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559603013314102590:13290]
2025-10-10T14:40:35.300056Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:35.300069Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:35.300071Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3356
2025-10-10T14:40:35.300100Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3356
2025-10-10T14:40:35.300266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:35.300277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:35.300314Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e58f88d8-5cfdfae1-cfcc488b-793cff97_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:35.300327Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:35.300334Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:35.300341Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:35.300353Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:35.300370Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:35.300392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:35.300639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:35.300646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:35.300661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:35.300764Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3357 partition: 0 MaxSeqNo: 40 sessionId: src_id|e58f88d8-5cfdfae1-cfcc488b-793cff97_0
2025-10-10T14:40:35.301188Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a099a25-4c56ec10-a46834df-fd7d904_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|e58f88d8-5cfdfae1-cfcc488b-793cff97_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:35.303933Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e58f88d8-5cfdfae1-cfcc488b-793cff97_0] Write session: try to update token
2025-10-10T14:40:35.303952Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e58f88d8-5cfdfae1-cfcc488b-793cff97_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:35.319733Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3357 sessionId: src_id|e58f88d8-5cfdfae1-cfcc488b-793cff97_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:35.320828Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:35.320846Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:35.320850Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:35.320852Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:35.320861Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559603013314102590:13290]
2025-10-10T14:40:35.320865Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559603013314102590:13290]
2025-10-10T14:40:35.320870Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559603013314102590:13290]
2025-10-10T14:40:35.320923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:35.320931Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:35.320935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:35.320938Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:35.320938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:35.320943Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:35.321075Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:35.322473Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:35.372775Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559603014096356655:5396]
2025-10-10T14:40:35.373111Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 pipe creation result: OK TabletId: 72075186224037892 Generation: 3356, pipe: [1:7559603014096356655:5396]
2025-10-10T14:40:35.439962Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:35.440269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:35.440284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:35.440330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603014096356655:5396], now have 1 active actors on pipe
2025-10-10T14:40:35.440556Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:35.440557Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:40:35.440570Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:35.440584Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:40:35.440623Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 55 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559603014096356655:5396]
2025-10-10T14:40:35.440658Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3357 reason: error at write: Disconnected sessionId: src_id|e58f88d8-5cfdfae1-cfcc488b-793cff97_0
2025-10-10T14:40:35.440911Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3357 sessionId: src_id|e58f88d8-5cfdfae1-cfcc488b-793cff97_0 is DEAD
2025-10-10T14:40:35.441502Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e58f88d8-5cfdfae1-cfcc488b-793cff97_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:40:35.441514Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e58f88d8-5cfdfae1-cfcc488b-793cff97_0] Write session will restart in 0.009379s
2025-10-10T14:40:35.441539Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e58f88d8-5cfdfae1-cfcc488b-793cff97_0] Write session: Do CDS request
2025-10-10T14:40:35.441546Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e58f88d8-5cfdfae1-cfcc488b-793cff97_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:35.452029Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e58f88d8-5cfdfae1-cfcc488b-793cff97_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:35.452104Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:35.452131Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3358
2025-10-10T14:40:35.452268Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3358 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:35.452313Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3358 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:35.452320Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3358 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:35.452324Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:35.452874Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3358 sessionId:  describe result for acl check
2025-10-10T14:40:35.452918Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:35.452925Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:35.452928Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:35.452935Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559603014096356744:5730] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:35.453601Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559603014096356744:5730] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:35.456127Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559603014096356744:5730] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:35.458315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:35.460927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:35.461173Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:35.461186Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:35.461171Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559603014096356744:5730] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:35.461204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:35.461188Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559603014096356744:5730] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:35.461196Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559603014096356744:5730] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:35.461205Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3358 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:35.461277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:35.461353Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559603013314102797:13293]
2025-10-10T14:40:35.461902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:35.462266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:35.462345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:35.462913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:35.463006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:35.463014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:35.463015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:35.463032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:35.463034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:35.463035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:35.463037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:35.463038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:35.463039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:35.463041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:35.463042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:35.463042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:35.463044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:35.463052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:35.463067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:35.463071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:35.463075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:35.463078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:35.463083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:35.463087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:35.463091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:35.463095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:35.463101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:35.463105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:35.463109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:35.463113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:35.463122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:35.463131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:35.463140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:35.463150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:35.463155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:35.463161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:35.463165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:35.463171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:35.463176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:35.463181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:35.463186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:35.463194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:35.463199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:35.463205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:35.463215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:35.463221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:35.463226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:35.463231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:35.463238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:35.463245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:35.463250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:35.463259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:35.463263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:35.463268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:35.463274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:35.463283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:35.463323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:35.466107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:35.466674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:35.466693Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:35.466695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:35.466700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:35.466707Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3357 [2:7559603013314102797:13293]
2025-10-10T14:40:35.466722Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:35.466742Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:35.466746Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:35.466750Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:35.466752Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:35.466772Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:35.466787Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:35.466795Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:35.466859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:35.466868Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:35.466871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:35.466874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:35.466952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:35.466960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:35.466973Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:35.466990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:35.467010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:35.467038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603014096356656:2438], now have 1 active actors on pipe
2025-10-10T14:40:35.467046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603014096356850:5730], now have 1 active actors on pipe
2025-10-10T14:40:35.467055Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559603013314102792:13293]
2025-10-10T14:40:35.467062Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559603013314102792:13293]
2025-10-10T14:40:35.467064Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559603013314102792:13293]
2025-10-10T14:40:35.467085Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:35.467100Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:35.467106Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:35.467111Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:35.467114Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:35.467125Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:35.467129Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:35.467081Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3357
2025-10-10T14:40:35.467082Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3357
2025-10-10T14:40:35.467172Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559603013314102792:13293]
2025-10-10T14:40:35.467187Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:35.467198Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:35.467203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:35.467208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:35.467265Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ec08b64b-436ddf31-f7061976-b7afa6d4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:35.467279Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:35.467285Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:35.467288Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:35.467300Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:35.467312Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:35.467344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:35.467662Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3358 partition: 0 MaxSeqNo: 40 sessionId: src_id|ec08b64b-436ddf31-f7061976-b7afa6d4_0
2025-10-10T14:40:35.468208Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e58f88d8-5cfdfae1-cfcc488b-793cff97_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|ec08b64b-436ddf31-f7061976-b7afa6d4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:35.467521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:35.467529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:35.467545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:35.471147Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ec08b64b-436ddf31-f7061976-b7afa6d4_0] Write session: try to update token
2025-10-10T14:40:35.471166Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ec08b64b-436ddf31-f7061976-b7afa6d4_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:35.487392Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3358 sessionId: src_id|ec08b64b-436ddf31-f7061976-b7afa6d4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:35.490541Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:35.490854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:35.490879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:35.490926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:40:35.491071Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:40:35.497134Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:35.497154Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:35.497158Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:35.497163Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:35.497174Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559603013314102792:13293]
2025-10-10T14:40:35.497185Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559603013314102792:13293]
2025-10-10T14:40:35.497192Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559603013314102792:13293]
2025-10-10T14:40:35.497247Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:35.497257Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:35.497260Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:35.497262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:35.497266Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:35.497271Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:35.497422Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:35.540690Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559603014096356862:5396]
2025-10-10T14:40:35.540942Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 pipe creation result: OK TabletId: 72075186224037892 Generation: 3357, pipe: [1:7559603014096356862:5396]
2025-10-10T14:40:35.615324Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:35.624492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:35.624525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:35.624722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:35.624800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:35.624874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:35.624951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:35.625007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:35.625019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:35.625098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:35.625190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:35.625262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:35.625365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:35.625427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:35.625436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:35.625516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:35.625594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:35.625667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:35.625745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:35.625792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:35.625795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:35.625871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:35.625936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:35.626001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:35.626064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:35.626866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:35.626874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:35.626948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:35.627010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:35.627078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:35.627148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:35.627194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:35.627197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:35.627273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:35.627335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:35.627409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:35.627478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:35.627525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:35.627528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:35.627601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:35.627666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:35.627737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:35.627804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:35.627852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:35.627856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:35.627974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:35.628056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:35.628121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:35.628223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:35.628358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:35.628362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:35.628445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:35.628513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:35.628667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:35.628736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:35.628797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:35.628801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:35.628876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:35.629059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:35.629128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:35.629194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:35.629242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:35.629245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:35.629324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603014096356862:5396], now have 1 active actors on pipe
2025-10-10T14:40:35.630479Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:35.636928Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec08b64b-436ddf31-f7061976-b7afa6d4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:40:35.636945Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec08b64b-436ddf31-f7061976-b7afa6d4_0] Write session will restart in 0.009052s
2025-10-10T14:40:35.636985Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec08b64b-436ddf31-f7061976-b7afa6d4_0] Write session: Do CDS request
2025-10-10T14:40:35.636992Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec08b64b-436ddf31-f7061976-b7afa6d4_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:35.636242Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 56 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559603014096356862:5396]
2025-10-10T14:40:35.636279Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:35.636321Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:40:35.636369Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3358 reason: status is not ok: tablet will be restarted right now sessionId: src_id|ec08b64b-436ddf31-f7061976-b7afa6d4_0
2025-10-10T14:40:35.636606Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3358 sessionId: src_id|ec08b64b-436ddf31-f7061976-b7afa6d4_0 is DEAD
2025-10-10T14:40:35.646949Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ec08b64b-436ddf31-f7061976-b7afa6d4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:35.649502Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:35.649520Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3359
2025-10-10T14:40:35.655277Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3359 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:35.655333Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3359 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:35.655338Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3359 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:35.655342Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:35.655731Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3359 sessionId:  describe result for acl check
2025-10-10T14:40:35.655760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:35.655761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:35.655762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:35.655768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559603014096356932:5802] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:35.656224Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559603014096356932:5802] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:35.659611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559603014096356932:5802] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:35.663713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559603014096356932:5802] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:35.663728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559603014096356932:5802] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:35.663732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559603014096356932:5802] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:35.663741Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3359 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:35.665279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:35.667830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:35.668073Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:35.668079Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:35.668092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:35.668150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:35.668189Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559603013314103039:13306]
2025-10-10T14:40:35.668867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:35.669412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:35.669460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:35.669798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:35.669850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:35.669851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:35.669853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:35.669854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:35.669855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:35.669857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:35.669859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:35.669860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:35.669861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:35.669862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:35.669864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:35.669865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:35.669866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:35.669874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:35.669888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:35.669893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:35.669898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:35.669902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:35.669906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:35.669911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:35.669916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:35.669920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:35.669925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:35.669929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:35.669933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:35.669938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:35.669949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:35.669959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:35.669966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:35.669972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:35.669977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:35.669983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:35.669988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:35.669994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:35.669999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:35.670005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:35.670010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:35.670016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:35.670022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:35.670027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:35.670032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:35.670039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:35.670045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:35.670051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:35.670056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:35.670062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:35.670067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:35.670074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:35.670079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:35.670084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:35.670089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:35.670095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:35.670158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:35.673180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:35.673724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:35.673739Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:35.673741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:35.673746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:35.673753Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3358 [2:7559603013314103039:13306]
2025-10-10T14:40:35.673767Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:35.673788Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:35.673797Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:35.673801Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:35.673804Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:35.673825Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:35.673850Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:35.673866Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:35.673936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:35.673944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:35.673947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:35.673950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:35.674025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:35.674035Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:35.674049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:35.674375Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3358
2025-10-10T14:40:35.674419Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3358
2025-10-10T14:40:35.674063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:35.674088Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:35.674110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603014096357078:5802], now have 1 active actors on pipe
2025-10-10T14:40:35.674115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603014096356882:2438], now have 1 active actors on pipe
2025-10-10T14:40:35.674124Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559603013314103034:13306]
2025-10-10T14:40:35.674127Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559603013314103034:13306]
2025-10-10T14:40:35.674129Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559603013314103034:13306]
2025-10-10T14:40:35.674146Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:35.674161Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:35.674166Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:35.674170Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:35.674172Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:35.674181Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:35.674185Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:35.674218Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559603013314103034:13306]
2025-10-10T14:40:35.674227Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:35.674262Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:35.674544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:35.674551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:35.674600Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c4ff0303-75e6f8df-e5ce295a-3e4aa74_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:35.674609Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:35.674614Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:35.674616Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:35.674629Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:35.674642Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:35.674659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:35.674985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:35.674997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:35.675017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:35.675119Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3359 partition: 0 MaxSeqNo: 40 sessionId: src_id|c4ff0303-75e6f8df-e5ce295a-3e4aa74_0
2025-10-10T14:40:35.675576Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec08b64b-436ddf31-f7061976-b7afa6d4_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|c4ff0303-75e6f8df-e5ce295a-3e4aa74_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:35.678476Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c4ff0303-75e6f8df-e5ce295a-3e4aa74_0] Write session: try to update token
2025-10-10T14:40:35.678496Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c4ff0303-75e6f8df-e5ce295a-3e4aa74_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:35.693781Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:40:35.693808Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:35.693824Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559603013314103034:13306]
2025-10-10T14:40:35.693890Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:40:35.693912Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:40:35.694115Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:40:35.694290Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:35.694451Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:35.694601Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:35.694825Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:40:35.694876Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:40:35.705307Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3359 sessionId: src_id|c4ff0303-75e6f8df-e5ce295a-3e4aa74_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:35.708060Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:35.708279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:35.708306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:35.708354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:40:35.708809Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:40:35.711394Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:35.711417Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:35.711435Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:35.711438Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:35.711453Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559603013314103034:13306]
2025-10-10T14:40:35.711459Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559603013314103034:13306]
2025-10-10T14:40:35.711465Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559603013314103034:13306]
2025-10-10T14:40:35.711534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:35.711553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:35.711557Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:35.711777Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:35.712996Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:35.713012Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:35.713017Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:35.736588Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559603014096357093:5396]
2025-10-10T14:40:35.737023Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 pipe creation result: OK TabletId: 72075186224037892 Generation: 3358, pipe: [1:7559603014096357093:5396]
2025-10-10T14:40:35.827667Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:35.828271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603014096357093:5396], now have 1 active actors on pipe
2025-10-10T14:40:35.837486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:35.837519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:35.837730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:35.837803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:35.837878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:35.837960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:35.838914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:35.838929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:35.839010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:35.839084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:35.839156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:35.839226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:35.839276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:35.839286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:35.839359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:35.839428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:35.839497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:35.839566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:35.839619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:35.839628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:35.839700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:35.839771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:35.839841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:35.839913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:35.839961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:35.839970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:35.840058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:35.840125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:35.840197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:35.840261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:35.840310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:35.840314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:35.840387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:35.840448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:35.840510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:35.840574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:35.840619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:35.840622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:35.840698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:35.840758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:35.840826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:35.840889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:35.840935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:35.840938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:35.841013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:35.841074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:35.841170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:35.841233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:35.841284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:35.841288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:35.841516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:35.841585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:35.841658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:35.841727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:35.841785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:35.841789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:35.841860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:35.841921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:35.841984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:35.842047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:35.842091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:35.842094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:35.843476Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:35.843537Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 57 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559603014096357093:5396]
2025-10-10T14:40:35.843563Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:40:35.843566Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:40:35.843596Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3359 reason: error at write: Disconnected sessionId: src_id|c4ff0303-75e6f8df-e5ce295a-3e4aa74_0
2025-10-10T14:40:35.843829Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3359 sessionId: src_id|c4ff0303-75e6f8df-e5ce295a-3e4aa74_0 is DEAD
2025-10-10T14:40:35.843111Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:35.845790Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4ff0303-75e6f8df-e5ce295a-3e4aa74_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:40:35.845803Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4ff0303-75e6f8df-e5ce295a-3e4aa74_0] Write session will restart in 0.008789s
2025-10-10T14:40:35.845829Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4ff0303-75e6f8df-e5ce295a-3e4aa74_0] Write session: Do CDS request
2025-10-10T14:40:35.845836Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4ff0303-75e6f8df-e5ce295a-3e4aa74_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:35.855938Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c4ff0303-75e6f8df-e5ce295a-3e4aa74_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:35.856015Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:35.856033Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3360
2025-10-10T14:40:35.857241Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3360 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:35.857292Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3360 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:35.857305Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3360 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:35.857309Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:35.857762Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3360 sessionId:  describe result for acl check
2025-10-10T14:40:35.857816Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:35.857824Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:35.857826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:35.857834Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559603014096357162:5854] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:35.858434Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559603014096357162:5854] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:35.866421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:35.867225Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559603014096357162:5854] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:35.870621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:35.870862Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:35.870874Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:35.870886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:35.870955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:35.871138Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559603013314103254:13310]
2025-10-10T14:40:35.871682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:35.871002Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559603014096357162:5854] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:35.871020Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559603014096357162:5854] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:35.871024Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559603014096357162:5854] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:35.871033Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3360 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:35.872104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:35.872165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:35.872533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:35.872592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:35.872593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:35.872594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:35.872596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:35.872597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:35.872598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:35.872600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:35.872601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:35.872602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:35.872604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:35.872605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:35.872607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:35.872609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:35.872616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:35.872631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:35.872636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:35.872641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:35.872645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:35.872649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:35.872653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:35.872657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:35.872662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:35.872667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:35.872671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:35.872676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:35.872680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:35.872689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:35.872699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:35.872707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:35.872713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:35.872718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:35.872725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:35.872730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:35.872736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:35.872742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:35.872748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:35.872753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:35.872760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:35.872765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:35.872771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:35.872776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:35.872783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:35.872788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:35.872794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:35.872799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:35.872806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:35.872811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:35.872817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:35.872823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:35.872829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:35.872834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:35.872841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:35.872888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:35.875537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:35.876358Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3359
2025-10-10T14:40:35.875881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:35.875887Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:35.875889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:35.875894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:35.875901Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3359 [2:7559603013314103254:13310]
2025-10-10T14:40:35.876371Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3359
2025-10-10T14:40:35.875917Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:35.875939Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:35.875942Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:35.875946Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:35.875949Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:35.875969Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:35.875977Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:35.875986Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:35.876074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:35.876079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:35.876081Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:35.876084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:35.876162Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:35.876166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:35.876180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:35.876193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:35.876213Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:35.876236Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559603013314103247:13310]
2025-10-10T14:40:35.876240Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559603013314103247:13310]
2025-10-10T14:40:35.876242Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559603013314103247:13310]
2025-10-10T14:40:35.876251Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:35.876261Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:35.876263Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:35.876268Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:35.876274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603014096357096:2438], now have 1 active actors on pipe
2025-10-10T14:40:35.876279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603014096357294:5854], now have 1 active actors on pipe
2025-10-10T14:40:35.876285Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:35.876304Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:35.876308Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:35.876340Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559603013314103247:13310]
2025-10-10T14:40:35.876351Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:35.876363Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:35.876563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:35.876571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:35.876618Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e415d9aa-3079af34-58d45f4f-b4d69068_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:35.876636Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:35.876641Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:35.876643Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:35.876656Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:35.876670Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:35.876688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:35.876911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:35.876925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:35.876948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:35.877559Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4ff0303-75e6f8df-e5ce295a-3e4aa74_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|e415d9aa-3079af34-58d45f4f-b4d69068_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:35.877060Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3360 partition: 0 MaxSeqNo: 40 sessionId: src_id|e415d9aa-3079af34-58d45f4f-b4d69068_0
2025-10-10T14:40:35.880462Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e415d9aa-3079af34-58d45f4f-b4d69068_0] Write session: try to update token
2025-10-10T14:40:35.880484Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e415d9aa-3079af34-58d45f4f-b4d69068_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:35.888597Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:40:35.888618Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:35.888633Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559603013314103247:13310]
2025-10-10T14:40:35.888678Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:40:35.888689Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:40:35.888872Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:40:35.889026Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:35.889178Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:35.889350Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:35.889557Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:40:35.889596Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:40:35.898397Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3360 sessionId: src_id|e415d9aa-3079af34-58d45f4f-b4d69068_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:35.901195Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:35.901534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:35.901559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:35.901603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:40:35.901699Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:40:35.907406Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:35.907431Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:35.907434Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:35.907437Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:35.907448Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559603013314103247:13310]
2025-10-10T14:40:35.907452Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559603013314103247:13310]
2025-10-10T14:40:35.907456Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559603013314103247:13310]
2025-10-10T14:40:35.907518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:35.907519Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:35.907526Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:35.907532Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:35.907533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:35.907536Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:35.907681Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:35.943641Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559603014096357312:5396]
2025-10-10T14:40:35.943957Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 pipe creation result: OK TabletId: 72075186224037892 Generation: 3359, pipe: [1:7559603014096357312:5396]
2025-10-10T14:40:36.034605Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:36.043346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:36.043380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:36.043576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:36.043646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:36.043713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:36.043776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:36.043826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:36.043831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:36.043911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:36.043975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:36.044056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:36.044127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:36.044171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:36.044174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:36.044247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:36.044314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:36.044382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:36.044448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:36.044495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:36.044498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:36.044570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:36.044638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:36.044704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:36.044773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:36.044818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:36.044821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:36.044895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:36.044956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:36.045025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:36.045089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:36.045136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:36.045139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:36.045211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:36.045281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:36.045544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:36.045619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:36.045664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:36.045667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:36.045743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:36.045803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:36.045865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:36.045927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:36.045971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:36.045974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:36.046053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:36.046115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:36.046179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:36.046246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:36.046291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:36.046294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:36.046368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:36.046428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:36.046495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:36.046557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:36.046604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:36.046607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:36.046680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:36.046739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:36.046806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:36.046870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:36.046916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:36.046920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:36.047002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603014096357312:5396], now have 1 active actors on pipe
2025-10-10T14:40:36.049136Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e415d9aa-3079af34-58d45f4f-b4d69068_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:40:36.049150Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e415d9aa-3079af34-58d45f4f-b4d69068_0] Write session will restart in 0.006164s
2025-10-10T14:40:36.049186Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e415d9aa-3079af34-58d45f4f-b4d69068_0] Write session: Do CDS request
2025-10-10T14:40:36.049192Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e415d9aa-3079af34-58d45f4f-b4d69068_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:36.048583Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:36.048650Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 58 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559603014096357312:5396]
2025-10-10T14:40:36.048678Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:40:36.048681Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:40:36.048714Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3360 reason: error at write: Disconnected sessionId: src_id|e415d9aa-3079af34-58d45f4f-b4d69068_0
2025-10-10T14:40:36.048977Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3360 sessionId: src_id|e415d9aa-3079af34-58d45f4f-b4d69068_0 is DEAD
2025-10-10T14:40:36.048678Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:36.056963Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e415d9aa-3079af34-58d45f4f-b4d69068_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:36.057087Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:36.057105Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3361
2025-10-10T14:40:36.058688Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3361 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:36.058749Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3361 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:36.058761Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3361 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:36.058765Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:36.059289Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3361 sessionId:  describe result for acl check
2025-10-10T14:40:36.059339Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:36.059346Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:36.059348Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:36.059355Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559603018391324638:5856] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:36.059951Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559603018391324638:5856] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:36.063372Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559603018391324638:5856] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:36.067586Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559603018391324638:5856] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:36.067602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559603018391324638:5856] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:36.067606Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559603018391324638:5856] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:36.067616Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3361 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:36.072669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:36.076157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:36.076445Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:36.076451Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:36.076464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:36.076527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:36.076573Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559603017609070755:13313]
2025-10-10T14:40:36.077278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:36.077786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:36.077849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:36.078207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:36.078279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:36.078281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:36.078282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:36.078284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:36.078285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:36.078287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:36.078288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:36.078289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:36.078291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:36.078292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:36.078294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:36.078295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:36.078296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:36.078304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:36.078320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:36.078325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:36.078329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:36.078333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:36.078337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:36.078341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:36.078346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:36.078350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:36.078355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:36.078359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:36.078363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:36.078367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:36.078377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:36.078386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:36.078393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:36.078399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:36.078404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:36.078410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:36.078415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:36.078421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:36.078426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:36.078432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:36.078437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:36.078443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:36.078449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:36.078456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:36.078462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:36.078469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:36.078475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:36.078481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:36.078485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:36.078509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:36.078517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:36.078521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:36.078526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:36.078530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:36.078535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:36.078540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:36.078578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:36.081812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:36.082159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:36.082176Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:36.082179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:36.082183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:36.082191Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3360 [2:7559603017609070755:13313]
2025-10-10T14:40:36.082208Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:36.082235Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:36.082244Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:36.082247Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:36.082251Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:36.082271Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:36.082286Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:36.082294Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:36.082365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:36.082370Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:36.082373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:36.082376Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:36.082456Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:36.082466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:36.082480Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:36.082493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:36.082512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:36.082542Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559603017609070750:13313]
2025-10-10T14:40:36.082550Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559603017609070750:13313]
2025-10-10T14:40:36.082553Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559603017609070750:13313]
2025-10-10T14:40:36.082569Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:36.082593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603018391324771:5856], now have 1 active actors on pipe
2025-10-10T14:40:36.082603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603018391324623:2438], now have 1 active actors on pipe
2025-10-10T14:40:36.082613Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:36.082632Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:36.082641Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:36.082653Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3360
2025-10-10T14:40:36.082682Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559603017609070750:13313]
2025-10-10T14:40:36.082690Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:36.082654Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3360
2025-10-10T14:40:36.082740Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:36.082755Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:36.082757Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:36.082765Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:36.082866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:36.082879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:36.082918Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9e62866a-ad34f8a0-1aa23736-c96d1f5c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:36.082934Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:36.082939Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:36.082947Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:36.082961Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:36.082980Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:36.083003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:36.083300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:36.083310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:36.083330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:36.083481Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3361 partition: 0 MaxSeqNo: 40 sessionId: src_id|9e62866a-ad34f8a0-1aa23736-c96d1f5c_0
2025-10-10T14:40:36.083921Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e415d9aa-3079af34-58d45f4f-b4d69068_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|9e62866a-ad34f8a0-1aa23736-c96d1f5c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:36.086824Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9e62866a-ad34f8a0-1aa23736-c96d1f5c_0] Write session: try to update token
2025-10-10T14:40:36.086847Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9e62866a-ad34f8a0-1aa23736-c96d1f5c_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:36.104626Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:36.104651Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:36.104655Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:36.104658Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:36.104669Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559603017609070750:13313]
2025-10-10T14:40:36.104674Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559603017609070750:13313]
2025-10-10T14:40:36.104679Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559603017609070750:13313]
2025-10-10T14:40:36.104733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:36.104747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:36.104750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:36.104791Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:36.104809Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:36.104814Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:36.104900Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:36.107070Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3361 sessionId: src_id|9e62866a-ad34f8a0-1aa23736-c96d1f5c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:36.109823Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:36.148927Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559603018391324830:5396]
2025-10-10T14:40:36.149481Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 pipe creation result: OK TabletId: 72075186224037892 Generation: 3360, pipe: [1:7559603018391324830:5396]
2025-10-10T14:40:36.235917Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:36.236434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:36.236452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:36.236507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603018391324830:5396], now have 1 active actors on pipe
2025-10-10T14:40:36.236744Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:36.237277Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:40:36.237291Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:40:36.237372Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3361 reason: error at write: Disconnected sessionId: src_id|9e62866a-ad34f8a0-1aa23736-c96d1f5c_0
2025-10-10T14:40:36.237406Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 59 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559603018391324830:5396]
2025-10-10T14:40:36.237426Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:36.240795Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e62866a-ad34f8a0-1aa23736-c96d1f5c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:40:36.240811Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e62866a-ad34f8a0-1aa23736-c96d1f5c_0] Write session will restart in 0.007923s
2025-10-10T14:40:36.240852Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e62866a-ad34f8a0-1aa23736-c96d1f5c_0] Write session: Do CDS request
2025-10-10T14:40:36.240859Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e62866a-ad34f8a0-1aa23736-c96d1f5c_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:36.237623Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3361 sessionId: src_id|9e62866a-ad34f8a0-1aa23736-c96d1f5c_0 is DEAD
2025-10-10T14:40:36.249922Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9e62866a-ad34f8a0-1aa23736-c96d1f5c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:36.253503Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:36.253520Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3362
2025-10-10T14:40:36.253768Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3362 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:36.253804Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3362 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:36.253811Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3362 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:36.253815Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:36.258956Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3362 sessionId:  describe result for acl check
2025-10-10T14:40:36.259008Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:36.259011Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:36.259014Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:36.259022Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559603018391324849:5861] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:36.259777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559603018391324849:5861] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:36.270408Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559603018391324849:5861] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:36.278510Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559603018391324849:5861] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:36.278529Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559603018391324849:5861] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:36.278533Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559603018391324849:5861] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:36.278543Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3362 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:36.280812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:36.283805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:36.284125Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:36.284141Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:36.284156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:36.284236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:36.284288Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559603017609070960:13315]
2025-10-10T14:40:36.284956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:36.285397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:36.285461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:36.285837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:36.285920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:36.285928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:36.285929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:36.285930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:36.285932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:36.285933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:36.285935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:36.285937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:36.285938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:36.285940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:36.285942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:36.285943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:36.285944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:36.285952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:36.285966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:36.285970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:36.285975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:36.285980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:36.285994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:36.285998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:36.286005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:36.286010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:36.286015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:36.286019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:36.286023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:36.286028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:36.286037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:36.286046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:36.286053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:36.286060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:36.286065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:36.286071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:36.286080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:36.286087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:36.286098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:36.286103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:36.286107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:36.286113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:36.286118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:36.286124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:36.286128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:36.286135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:36.286141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:36.286146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:36.286151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:36.286156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:36.286161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:36.286167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:36.286171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:36.286177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:36.286182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:36.286187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:36.286229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:36.289157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:36.289545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:36.289560Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:36.289563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:36.289567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:36.289575Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3361 [2:7559603017609070960:13315]
2025-10-10T14:40:36.289593Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:36.289615Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:36.289624Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:36.289627Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:36.289630Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:36.289649Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:36.289665Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:36.289674Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:36.289748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:36.289750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:36.289752Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:36.289755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:36.289829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:36.289833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:36.289844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:36.289854Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:36.289870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:36.289892Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559603017609070954:13315]
2025-10-10T14:40:36.289895Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559603017609070954:13315]
2025-10-10T14:40:36.289897Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559603017609070954:13315]
2025-10-10T14:40:36.289911Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:36.289927Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:36.289943Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:36.289947Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:36.289981Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559603017609070954:13315]
2025-10-10T14:40:36.289984Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:36.290099Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:36.290101Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:36.290103Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:36.290109Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:36.290490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603018391325027:5861], now have 1 active actors on pipe
2025-10-10T14:40:36.290503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603018391324833:2438], now have 1 active actors on pipe
2025-10-10T14:40:36.290697Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3361
2025-10-10T14:40:36.290728Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3361
2025-10-10T14:40:36.294214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:36.294237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:36.294288Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ce567032-832e139-ef4f069d-df63c7d1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:36.294308Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:36.294315Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:36.294319Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:36.294337Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:36.294366Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:36.294390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:36.296350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:36.296367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:36.296399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:36.296994Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3362 partition: 0 MaxSeqNo: 40 sessionId: src_id|ce567032-832e139-ef4f069d-df63c7d1_0
2025-10-10T14:40:36.297491Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e62866a-ad34f8a0-1aa23736-c96d1f5c_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|ce567032-832e139-ef4f069d-df63c7d1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:36.300623Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ce567032-832e139-ef4f069d-df63c7d1_0] Write session: try to update token
2025-10-10T14:40:36.300643Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ce567032-832e139-ef4f069d-df63c7d1_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:36.314028Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:36.314053Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:36.314057Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:36.314059Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:36.314072Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559603017609070954:13315]
2025-10-10T14:40:36.314077Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559603017609070954:13315]
2025-10-10T14:40:36.314081Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559603017609070954:13315]
2025-10-10T14:40:36.314131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:36.314139Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:36.314142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:36.314285Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:36.314458Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:36.314470Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:36.314475Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:36.322766Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3362 sessionId: src_id|ce567032-832e139-ef4f069d-df63c7d1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:36.325631Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:36.337928Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559603018391325042:5396]
2025-10-10T14:40:36.338420Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 pipe creation result: OK TabletId: 72075186224037892 Generation: 3361, pipe: [1:7559603018391325042:5396]
2025-10-10T14:40:36.432184Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:36.432779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:36.432794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:36.432841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603018391325042:5396], now have 1 active actors on pipe
2025-10-10T14:40:36.433014Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:36.434664Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:40:36.434762Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3362 reason: status is not ok: tablet will be restarted right now sessionId: src_id|ce567032-832e139-ef4f069d-df63c7d1_0
2025-10-10T14:40:36.434996Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3362 sessionId: src_id|ce567032-832e139-ef4f069d-df63c7d1_0 is DEAD
2025-10-10T14:40:36.435142Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:36.435182Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 60 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559603018391325042:5396]
2025-10-10T14:40:36.437584Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce567032-832e139-ef4f069d-df63c7d1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:40:36.437596Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce567032-832e139-ef4f069d-df63c7d1_0] Write session will restart in 0.005714s
2025-10-10T14:40:36.437623Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce567032-832e139-ef4f069d-df63c7d1_0] Write session: Do CDS request
2025-10-10T14:40:36.437630Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce567032-832e139-ef4f069d-df63c7d1_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:36.446050Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ce567032-832e139-ef4f069d-df63c7d1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:36.450418Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:36.450439Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3363
2025-10-10T14:40:36.450672Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3363 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:36.450729Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3363 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:36.450736Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3363 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:36.450741Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:36.451339Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3363 sessionId:  describe result for acl check
2025-10-10T14:40:36.451383Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:36.451385Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:36.451388Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:36.451395Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559603018391325056:5902] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:36.452054Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559603018391325056:5902] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:36.458588Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559603018391325056:5902] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:36.469360Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559603018391325056:5902] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:36.469380Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559603018391325056:5902] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:36.469384Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559603018391325056:5902] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:36.469394Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3363 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:36.486419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:36.489805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:36.490093Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:36.490108Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:36.490123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:36.490185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:36.490241Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559603017609071169:13318]
2025-10-10T14:40:36.490943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:36.491369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:36.491429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:36.491799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:36.491870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:36.491878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:36.491880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:36.491882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:36.491883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:36.491885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:36.491887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:36.491888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:36.491890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:36.491891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:36.491893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:36.491895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:36.491896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:36.491904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:36.491919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:36.491925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:36.491930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:36.491934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:36.491939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:36.491944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:36.491949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:36.491953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:36.491958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:36.491963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:36.491967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:36.491972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:36.491981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:36.492007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:36.492014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:36.492022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:36.492027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:36.492033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:36.492040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:36.492047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:36.492053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:36.492068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:36.492073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:36.492080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:36.492086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:36.492092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:36.492097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:36.492103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:36.492109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:36.492115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:36.492121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:36.492127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:36.492133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:36.492140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:36.492145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:36.492152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:36.492160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:36.492166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:36.492212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:36.495248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:36.495604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:36.495619Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:36.495623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:36.495628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:36.495636Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3362 [2:7559603017609071169:13318]
2025-10-10T14:40:36.495651Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:36.495672Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:36.495689Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:36.495693Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:36.495696Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:36.495714Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:36.495725Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:36.495733Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:36.495844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:36.495847Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:36.495849Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:36.495853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:36.495926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:36.495930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:36.495943Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:36.495957Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:36.495977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:36.496014Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559603017609071163:13318]
2025-10-10T14:40:36.496017Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559603017609071163:13318]
2025-10-10T14:40:36.496019Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559603017609071163:13318]
2025-10-10T14:40:36.496032Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:36.496041Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:36.496048Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:36.496051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603018391325106:5902], now have 1 active actors on pipe
2025-10-10T14:40:36.496058Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:36.496061Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:36.496077Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:36.496081Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:36.496087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603018391325047:2438], now have 1 active actors on pipe
2025-10-10T14:40:36.496119Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559603017609071163:13318]
2025-10-10T14:40:36.496130Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:36.496197Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:36.497234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:36.497248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:36.497287Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f3b87640-64d9c1c0-2a2afe4-6fa9e71e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:36.497297Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:36.497308Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:36.497311Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:36.497324Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:36.497362Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:36.497382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:36.496838Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3362
2025-10-10T14:40:36.496871Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3362
2025-10-10T14:40:36.497967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:36.497977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:36.497996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:36.498152Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3363 partition: 0 MaxSeqNo: 40 sessionId: src_id|f3b87640-64d9c1c0-2a2afe4-6fa9e71e_0
2025-10-10T14:40:36.498610Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce567032-832e139-ef4f069d-df63c7d1_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|f3b87640-64d9c1c0-2a2afe4-6fa9e71e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:36.501426Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f3b87640-64d9c1c0-2a2afe4-6fa9e71e_0] Write session: try to update token
2025-10-10T14:40:36.501446Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f3b87640-64d9c1c0-2a2afe4-6fa9e71e_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:36.519472Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:36.519497Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:36.519501Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:36.519503Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:36.519515Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559603017609071163:13318]
2025-10-10T14:40:36.519519Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559603017609071163:13318]
2025-10-10T14:40:36.519524Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559603017609071163:13318]
2025-10-10T14:40:36.519580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:36.520306Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3363 sessionId: src_id|f3b87640-64d9c1c0-2a2afe4-6fa9e71e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:36.519588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:36.519591Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:36.519743Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:36.521760Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:36.521779Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:36.521785Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:36.523346Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:36.536163Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559603018391325257:5396]
2025-10-10T14:40:36.536572Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 pipe creation result: OK TabletId: 72075186224037892 Generation: 3362, pipe: [1:7559603018391325257:5396]
2025-10-10T14:40:36.641861Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:36.642132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:36.642142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:36.642168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603018391325257:5396], now have 1 active actors on pipe
2025-10-10T14:40:36.643531Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:36.644019Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 61 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559603018391325257:5396]
2025-10-10T14:40:36.644056Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:40:36.644127Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3363 reason: status is not ok: tablet will be restarted right now sessionId: src_id|f3b87640-64d9c1c0-2a2afe4-6fa9e71e_0
2025-10-10T14:40:36.644355Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3363 sessionId: src_id|f3b87640-64d9c1c0-2a2afe4-6fa9e71e_0 is DEAD
2025-10-10T14:40:36.644532Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3b87640-64d9c1c0-2a2afe4-6fa9e71e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:40:36.644544Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3b87640-64d9c1c0-2a2afe4-6fa9e71e_0] Write session will restart in 0.007146s
2025-10-10T14:40:36.644571Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3b87640-64d9c1c0-2a2afe4-6fa9e71e_0] Write session: Do CDS request
2025-10-10T14:40:36.644578Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3b87640-64d9c1c0-2a2afe4-6fa9e71e_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:36.644536Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:36.653122Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f3b87640-64d9c1c0-2a2afe4-6fa9e71e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:36.653227Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:36.653243Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3364
2025-10-10T14:40:36.653532Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3364 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:36.653581Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3364 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:36.653593Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3364 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:36.653598Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:36.654246Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3364 sessionId:  describe result for acl check
2025-10-10T14:40:36.654286Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:36.654289Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:36.654291Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:36.654298Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559603018391325288:5948] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:36.654902Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559603018391325288:5948] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:36.659037Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559603018391325288:5948] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:36.666144Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559603018391325288:5948] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:36.666166Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559603018391325288:5948] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:36.666170Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559603018391325288:5948] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:36.666180Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3364 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:36.669488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:36.672518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:36.672794Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:36.672806Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:36.672820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:36.672889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:36.672939Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559603017609071389:13326]
2025-10-10T14:40:36.673650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:36.674511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:36.674560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:36.674936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:36.675001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:36.675002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:36.675004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:36.675005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:36.675006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:36.675008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:36.675010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:36.675011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:36.675012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:36.675014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:36.675015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:36.675019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:36.675020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:36.675028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:36.675041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:36.675046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:36.675051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:36.675055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:36.675060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:36.675065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:36.675069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:36.675073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:36.675078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:36.675082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:36.675086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:36.675091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:36.675098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:36.675108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:36.675116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:36.675122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:36.675128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:36.675134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:36.675141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:36.675147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:36.675152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:36.675158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:36.675164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:36.675169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:36.675174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:36.675180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:36.675185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:36.675191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:36.675198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:36.675204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:36.675209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:36.675215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:36.675221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:36.675227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:36.675231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:36.675237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:36.675242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:36.675248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:36.675292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:36.678206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:36.678707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:36.678726Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:36.678729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:36.678733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:36.678740Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3363 [2:7559603017609071389:13326]
2025-10-10T14:40:36.678754Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:36.678773Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:36.678782Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:36.678786Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:36.678788Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:36.678807Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:36.678834Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:36.678846Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:36.678924Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:36.678932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:36.678935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:36.678937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:36.679008Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:36.679016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:36.679028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:36.679047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:36.679070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:36.679096Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559603017609071384:13326]
2025-10-10T14:40:36.679105Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559603017609071384:13326]
2025-10-10T14:40:36.679107Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559603017609071384:13326]
2025-10-10T14:40:36.679117Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:36.679128Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:36.679134Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:36.679142Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:36.679144Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:36.679152Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:36.679162Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:36.679173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603018391325259:2438], now have 1 active actors on pipe
2025-10-10T14:40:36.679177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603018391325468:5948], now have 1 active actors on pipe
2025-10-10T14:40:36.679203Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559603017609071384:13326]
2025-10-10T14:40:36.679215Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:36.679220Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:36.679241Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3363
2025-10-10T14:40:36.679295Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3363
2025-10-10T14:40:36.679380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:36.679404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:36.679447Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|71f2fb69-9e78e1e-9629fa22-2e8271fe_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:36.679461Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:36.679470Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:36.679473Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:36.679495Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:36.679514Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:36.679531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:36.679684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:36.679696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:36.679720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:36.679864Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3364 partition: 0 MaxSeqNo: 40 sessionId: src_id|71f2fb69-9e78e1e-9629fa22-2e8271fe_0
2025-10-10T14:40:36.680318Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3b87640-64d9c1c0-2a2afe4-6fa9e71e_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|71f2fb69-9e78e1e-9629fa22-2e8271fe_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:36.683141Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|71f2fb69-9e78e1e-9629fa22-2e8271fe_0] Write session: try to update token
2025-10-10T14:40:36.683161Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|71f2fb69-9e78e1e-9629fa22-2e8271fe_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:36.699667Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:36.699691Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:36.699694Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:36.699696Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:36.699705Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559603017609071384:13326]
2025-10-10T14:40:36.699709Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559603017609071384:13326]
2025-10-10T14:40:36.699714Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559603017609071384:13326]
2025-10-10T14:40:36.699773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:36.699775Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:36.699781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:36.699782Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:36.699783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:36.699787Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:36.699941Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:36.706173Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3364 sessionId: src_id|71f2fb69-9e78e1e-9629fa22-2e8271fe_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:36.708799Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:36.744427Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559603018391325493:5396]
2025-10-10T14:40:36.744771Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 pipe creation result: OK TabletId: 72075186224037892 Generation: 3363, pipe: [1:7559603018391325493:5396]
2025-10-10T14:40:36.826471Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:36.826897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:36.826913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:36.826965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603018391325493:5396], now have 1 active actors on pipe
2025-10-10T14:40:36.827261Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 62 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559603018391325493:5396]
2025-10-10T14:40:36.827297Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:36.827314Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:40:36.827317Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:40:36.827383Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3364 reason: error at write: Disconnected sessionId: src_id|71f2fb69-9e78e1e-9629fa22-2e8271fe_0
2025-10-10T14:40:36.827591Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3364 sessionId: src_id|71f2fb69-9e78e1e-9629fa22-2e8271fe_0 is DEAD
2025-10-10T14:40:36.827751Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71f2fb69-9e78e1e-9629fa22-2e8271fe_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:40:36.827762Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71f2fb69-9e78e1e-9629fa22-2e8271fe_0] Write session will restart in 0.009842s
2025-10-10T14:40:36.827795Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71f2fb69-9e78e1e-9629fa22-2e8271fe_0] Write session: Do CDS request
2025-10-10T14:40:36.827801Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71f2fb69-9e78e1e-9629fa22-2e8271fe_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:36.827593Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:36.841889Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|71f2fb69-9e78e1e-9629fa22-2e8271fe_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:36.845702Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:36.845720Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3365
2025-10-10T14:40:36.845931Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3365 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:36.846001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:36.846151Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3365 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:36.846163Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3365 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:36.846168Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:36.846682Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3365 sessionId:  describe result for acl check
2025-10-10T14:40:36.846717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:36.846723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:36.846726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:36.846733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559603018391325667:5986] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:36.847292Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559603018391325667:5986] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:36.848976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:36.849223Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:36.849243Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:36.849259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:36.849319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:36.849386Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559603017609071621:13335]
2025-10-10T14:40:36.849650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559603018391325667:5986] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:36.850087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:36.850449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:36.850512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:36.850871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:36.850924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:36.850925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:36.850927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:36.850929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:36.850930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:36.850932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:36.850933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:36.850934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:36.850936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:36.850938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:36.850939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:36.850940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:36.851049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:36.851062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:36.851076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:36.851086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:36.851092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:36.851096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:36.851101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:36.851106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:36.851110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:36.851115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:36.851121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:36.851130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:36.851134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:36.851144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:36.851152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:36.851167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:36.851185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:36.851192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:36.851198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:36.851219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:36.851240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:36.851251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:36.851259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:36.851270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:36.851276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:36.851284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:36.851289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:36.851296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:36.851301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:36.851312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:36.851318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:36.851325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:36.851334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:36.851341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:36.851351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:36.851357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:36.851362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:36.851367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:36.851377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:36.851383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:36.851433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:36.852133Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559603018391325667:5986] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:36.852147Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559603018391325667:5986] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:36.852151Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559603018391325667:5986] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:36.852160Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3365 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:36.853950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:36.854459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:36.854471Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:36.854474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:36.854478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:36.854484Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3364 [2:7559603017609071621:13335]
2025-10-10T14:40:36.854497Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:36.854527Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:36.854536Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:36.854539Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:36.854542Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:36.854561Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:36.854576Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:36.854583Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:36.854657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:36.854665Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:36.854667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:36.854669Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:36.854738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:36.854746Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:36.854758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:36.854770Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:36.854793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:36.854822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603018391325494:2438], now have 1 active actors on pipe
2025-10-10T14:40:36.854830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603018391325700:5986], now have 1 active actors on pipe
2025-10-10T14:40:36.854838Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559603017609071616:13335]
2025-10-10T14:40:36.854841Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559603017609071616:13335]
2025-10-10T14:40:36.854843Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559603017609071616:13335]
2025-10-10T14:40:36.854857Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:36.854875Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:36.854875Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:36.854878Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:36.854880Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:36.854894Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:36.854898Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:36.854925Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559603017609071616:13335]
2025-10-10T14:40:36.854933Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:36.854938Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:36.854900Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3364
2025-10-10T14:40:36.854901Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3364
2025-10-10T14:40:36.854956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:36.854967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:36.855012Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4648016a-7306a16b-f7fcfa6a-c89dc933_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:36.855025Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:36.855029Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:36.855034Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:36.855045Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:36.855061Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:36.855084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:36.855234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:36.855242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:36.855258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:36.855350Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3365 partition: 0 MaxSeqNo: 40 sessionId: src_id|4648016a-7306a16b-f7fcfa6a-c89dc933_0
2025-10-10T14:40:36.855774Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71f2fb69-9e78e1e-9629fa22-2e8271fe_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|4648016a-7306a16b-f7fcfa6a-c89dc933_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:36.858583Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4648016a-7306a16b-f7fcfa6a-c89dc933_0] Write session: try to update token
2025-10-10T14:40:36.858603Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4648016a-7306a16b-f7fcfa6a-c89dc933_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:36.874536Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:36.874559Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:36.874562Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:36.874565Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:36.874576Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559603017609071616:13335]
2025-10-10T14:40:36.874580Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559603017609071616:13335]
2025-10-10T14:40:36.874584Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559603017609071616:13335]
2025-10-10T14:40:36.874641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:36.874645Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:36.874655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:36.874658Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:36.874664Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:36.874669Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:36.874814Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:36.875952Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3365 sessionId: src_id|4648016a-7306a16b-f7fcfa6a-c89dc933_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:36.878736Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:36.924122Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559603018391325712:5396]
2025-10-10T14:40:36.924547Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 pipe creation result: OK TabletId: 72075186224037892 Generation: 3364, pipe: [1:7559603018391325712:5396]
2025-10-10T14:40:37.010710Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:37.010965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:37.010980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:37.011021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603018391325712:5396], now have 1 active actors on pipe
2025-10-10T14:40:37.011237Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:37.011324Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:40:37.011345Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:40:37.011419Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3365 reason: error at write: Disconnected sessionId: src_id|4648016a-7306a16b-f7fcfa6a-c89dc933_0
2025-10-10T14:40:37.011850Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4648016a-7306a16b-f7fcfa6a-c89dc933_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:40:37.011867Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4648016a-7306a16b-f7fcfa6a-c89dc933_0] Write session will restart in 0.007633s
2025-10-10T14:40:37.011646Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3365 sessionId: src_id|4648016a-7306a16b-f7fcfa6a-c89dc933_0 is DEAD
2025-10-10T14:40:37.011694Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 63 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559603018391325712:5396]
2025-10-10T14:40:37.011896Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4648016a-7306a16b-f7fcfa6a-c89dc933_0] Write session: Do CDS request
2025-10-10T14:40:37.011714Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:37.011904Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4648016a-7306a16b-f7fcfa6a-c89dc933_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:37.024505Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4648016a-7306a16b-f7fcfa6a-c89dc933_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:37.024653Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:37.024672Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3366
2025-10-10T14:40:37.024848Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3366 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:37.024902Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3366 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:37.024915Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3366 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:37.024919Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:37.025506Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3366 sessionId:  describe result for acl check
2025-10-10T14:40:37.025550Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:37.025552Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:37.025554Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:37.025562Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559603022686293049:6030] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:37.026260Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559603022686293049:6030] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:37.030983Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559603022686293049:6030] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:37.034878Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559603022686293049:6030] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:37.034895Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559603022686293049:6030] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:37.034900Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559603022686293049:6030] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:37.034910Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3366 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:37.037670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:37.040510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:37.040758Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:37.040781Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:37.040798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:37.040867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:37.040913Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559603021904039139:13338]
2025-10-10T14:40:37.041611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:37.041991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:37.042059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:37.042422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:37.042487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:37.042493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:37.042495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:37.042496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:37.042497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:37.042499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:37.042500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:37.042501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:37.042503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:37.042504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:37.042505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:37.042506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:37.042507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:37.042514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:37.042528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:37.042532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:37.042536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:37.042540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:37.042544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:37.042548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:37.042552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:37.042556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:37.042561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:37.042564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:37.042568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:37.042572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:37.042581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:37.042590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:37.042603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:37.042608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:37.042618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:37.042624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:37.042632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:37.042638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:37.042646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:37.042651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:37.042656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:37.042665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:37.042670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:37.042678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:37.042682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:37.042687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:37.042692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:37.042697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:37.042702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:37.042711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:37.042715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:37.042721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:37.042730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:37.042735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:37.042743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:37.042748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:37.042787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:37.045281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:37.046029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:37.046046Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:37.046049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:37.046053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:37.046062Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3365 [2:7559603021904039139:13338]
2025-10-10T14:40:37.046077Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:37.046097Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:37.046108Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:37.046112Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:37.046115Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:37.046135Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:37.046142Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:37.046150Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:37.046215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:37.046223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:37.046225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:37.046228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:37.046306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:37.046313Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:37.046325Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:37.046341Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:37.046363Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:37.046395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603022686293025:2438], now have 1 active actors on pipe
2025-10-10T14:40:37.046403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603022686293205:6030], now have 1 active actors on pipe
2025-10-10T14:40:37.046412Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559603021904039134:13338]
2025-10-10T14:40:37.046414Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559603021904039134:13338]
2025-10-10T14:40:37.046417Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559603021904039134:13338]
2025-10-10T14:40:37.046431Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:37.046445Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:37.046450Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:37.046455Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:37.046458Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:37.046468Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:37.046472Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:37.046464Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3365
2025-10-10T14:40:37.046505Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559603021904039134:13338]
2025-10-10T14:40:37.046516Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:37.046515Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3365
2025-10-10T14:40:37.046523Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:37.046727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:37.046739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:37.046775Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|231e9062-733af32b-d3325ff0-dcedf08b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:37.046788Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:37.046797Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:37.046800Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:37.046815Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:37.046832Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:37.046854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:37.047056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:37.047068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:37.047098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:37.047197Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3366 partition: 0 MaxSeqNo: 40 sessionId: src_id|231e9062-733af32b-d3325ff0-dcedf08b_0
2025-10-10T14:40:37.047625Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4648016a-7306a16b-f7fcfa6a-c89dc933_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|231e9062-733af32b-d3325ff0-dcedf08b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:37.050538Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|231e9062-733af32b-d3325ff0-dcedf08b_0] Write session: try to update token
2025-10-10T14:40:37.050560Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|231e9062-733af32b-d3325ff0-dcedf08b_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:37.071458Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:40:37.071730Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:37.071749Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559603021904039134:13338]
2025-10-10T14:40:37.071819Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:40:37.072053Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:40:37.072065Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:40:37.072215Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:37.072370Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:37.072515Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:37.072731Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:40:37.072770Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:40:37.071459Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3366 sessionId: src_id|231e9062-733af32b-d3325ff0-dcedf08b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:37.074314Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:37.074546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:37.074581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:37.074621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:40:37.074774Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:40:37.084892Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:37.084917Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:37.084920Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:37.084922Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:37.084933Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559603021904039134:13338]
2025-10-10T14:40:37.084938Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559603021904039134:13338]
2025-10-10T14:40:37.084943Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559603021904039134:13338]
2025-10-10T14:40:37.084994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:37.085003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:37.085002Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:37.085005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:37.085010Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:37.085017Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:37.085145Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:37.112030Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559603022686293238:5396]
2025-10-10T14:40:37.112621Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 pipe creation result: OK TabletId: 72075186224037892 Generation: 3365, pipe: [1:7559603022686293238:5396]
2025-10-10T14:40:37.196038Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:37.204505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:37.204540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:37.204726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:37.204798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:37.204868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:37.204937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:37.205058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:37.205074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:37.205152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:37.205216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:37.205286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:37.205381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:37.205431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:37.205434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:37.205510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:37.205577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:37.205643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:37.205710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:37.205761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:37.205764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:37.205844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:37.205913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:37.205980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:37.206052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:37.206096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:37.206104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:37.206187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:37.206254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:37.206319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:37.206387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:37.206434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:37.206437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:37.206515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:37.206580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:37.206645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:37.206712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:37.206755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:37.206758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:37.206833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:37.206902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:37.206971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:37.207032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:37.207075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:37.207077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:37.207152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:37.207220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:37.207284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:37.207352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:37.207496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:37.207500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:37.207575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:37.207638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:37.207703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:37.207770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:37.207811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:37.208968Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 64 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559603022686293238:5396]
2025-10-10T14:40:37.208997Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:37.209042Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:40:37.207813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:37.209571Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|231e9062-733af32b-d3325ff0-dcedf08b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:40:37.207891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:37.209582Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|231e9062-733af32b-d3325ff0-dcedf08b_0] Write session will restart in 0.008794s
2025-10-10T14:40:37.207959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:37.208039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:37.208106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:37.208148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:37.208151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:37.208247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603022686293238:5396], now have 1 active actors on pipe
2025-10-10T14:40:37.208649Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:37.209623Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|231e9062-733af32b-d3325ff0-dcedf08b_0] Write session: Do CDS request
2025-10-10T14:40:37.209630Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|231e9062-733af32b-d3325ff0-dcedf08b_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:37.209089Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3366 reason: status is not ok: tablet will be restarted right now sessionId: src_id|231e9062-733af32b-d3325ff0-dcedf08b_0
2025-10-10T14:40:37.209311Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3366 sessionId: src_id|231e9062-733af32b-d3325ff0-dcedf08b_0 is DEAD
2025-10-10T14:40:37.219940Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|231e9062-733af32b-d3325ff0-dcedf08b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:37.220125Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:37.220144Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3367
2025-10-10T14:40:37.220428Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3367 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:37.220470Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3367 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:37.220481Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3367 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:37.220485Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:37.222608Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3367 sessionId:  describe result for acl check
2025-10-10T14:40:37.222652Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:37.222659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:37.222661Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:37.222668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559603022686293250:6056] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:37.223262Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559603022686293250:6056] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:37.227294Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559603022686293250:6056] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:37.230686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559603022686293250:6056] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:37.230711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559603022686293250:6056] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:37.230716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559603022686293250:6056] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:37.230725Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3367 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:37.242946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:37.245568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:37.245797Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:37.245808Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:37.245820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:37.245876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:37.245923Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559603021904039350:13340]
2025-10-10T14:40:37.246542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:37.246877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:37.246925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:37.247256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:37.247325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:37.247331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:37.247333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:37.247334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:37.247335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:37.247337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:37.247338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:37.247339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:37.247341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:37.247342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:37.247343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:37.247344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:37.247346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:37.247352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:37.247367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:37.247371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:37.247376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:37.247380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:37.247384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:37.247388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:37.247392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:37.247396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:37.247401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:37.247405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:37.247408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:37.247412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:37.247421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:37.247431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:37.247438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:37.247444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:37.247450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:37.247461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:37.247466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:37.247477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:37.247484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:37.247490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:37.247495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:37.247500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:37.247510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:37.247516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:37.247525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:37.247530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:37.247535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:37.247545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:37.247549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:37.247555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:37.247563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:37.247568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:37.247572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:37.247576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:37.247580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:37.247584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:37.247624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:37.250293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:37.250636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:37.250648Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:37.250651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:37.250655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:37.250663Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3366 [2:7559603021904039350:13340]
2025-10-10T14:40:37.250676Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:37.250693Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:37.250701Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:37.250705Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:37.250707Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:37.250724Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:37.250736Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:37.250747Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:37.250813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:37.250820Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:37.250822Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:37.250825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:37.250895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:37.250905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:37.250915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:37.250928Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:37.250949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:37.250976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603022686293286:6056], now have 1 active actors on pipe
2025-10-10T14:40:37.250984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603022686293241:2438], now have 1 active actors on pipe
2025-10-10T14:40:37.250992Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559603021904039345:13340]
2025-10-10T14:40:37.250999Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559603021904039345:13340]
2025-10-10T14:40:37.251002Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559603021904039345:13340]
2025-10-10T14:40:37.251016Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:37.251035Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:37.251050Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:37.251058Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:37.251050Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3366
2025-10-10T14:40:37.251082Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559603021904039345:13340]
2025-10-10T14:40:37.251061Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3366
2025-10-10T14:40:37.251090Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:37.251102Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:37.251118Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:37.251128Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:37.251135Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:37.251407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:37.251425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:37.251466Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b0ee6022-39e398fa-f8fdca1e-a1e9c470_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:37.251497Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:37.251501Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:37.251509Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:37.251521Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:37.251543Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:37.251562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:37.251809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:37.251839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:37.251863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:37.252065Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3367 partition: 0 MaxSeqNo: 40 sessionId: src_id|b0ee6022-39e398fa-f8fdca1e-a1e9c470_0
2025-10-10T14:40:37.252552Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|231e9062-733af32b-d3325ff0-dcedf08b_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|b0ee6022-39e398fa-f8fdca1e-a1e9c470_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:37.255384Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b0ee6022-39e398fa-f8fdca1e-a1e9c470_0] Write session: try to update token
2025-10-10T14:40:37.255405Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b0ee6022-39e398fa-f8fdca1e-a1e9c470_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:37.272628Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:37.272652Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:37.272656Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:37.272659Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:37.272670Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559603021904039345:13340]
2025-10-10T14:40:37.272674Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559603021904039345:13340]
2025-10-10T14:40:37.272679Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559603021904039345:13340]
2025-10-10T14:40:37.272732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:37.272732Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:37.272743Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:37.272747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:37.272748Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:37.272750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:37.272908Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:37.274157Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3367 sessionId: src_id|b0ee6022-39e398fa-f8fdca1e-a1e9c470_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:37.276893Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:37.306065Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559603022686293454:5396]
2025-10-10T14:40:37.306454Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 pipe creation result: OK TabletId: 72075186224037892 Generation: 3366, pipe: [1:7559603022686293454:5396]
2025-10-10T14:40:37.395324Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:37.395860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:37.395880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:37.395927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603022686293454:5396], now have 1 active actors on pipe
2025-10-10T14:40:37.396189Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:37.396958Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0ee6022-39e398fa-f8fdca1e-a1e9c470_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:40:37.396969Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0ee6022-39e398fa-f8fdca1e-a1e9c470_0] Write session will restart in 0.006248s
2025-10-10T14:40:37.396994Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0ee6022-39e398fa-f8fdca1e-a1e9c470_0] Write session: Do CDS request
2025-10-10T14:40:37.397000Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0ee6022-39e398fa-f8fdca1e-a1e9c470_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:37.396192Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 65 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559603022686293454:5396]
2025-10-10T14:40:37.396225Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:37.396292Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:40:37.396296Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:40:37.396363Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3367 reason: error at write: Disconnected sessionId: src_id|b0ee6022-39e398fa-f8fdca1e-a1e9c470_0
2025-10-10T14:40:37.396594Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3367 sessionId: src_id|b0ee6022-39e398fa-f8fdca1e-a1e9c470_0 is DEAD
2025-10-10T14:40:37.404963Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b0ee6022-39e398fa-f8fdca1e-a1e9c470_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:37.405034Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:37.405050Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3368
2025-10-10T14:40:37.405373Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3368 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:37.405421Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3368 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:37.405431Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3368 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:37.405436Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:37.408297Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3368 sessionId:  describe result for acl check
2025-10-10T14:40:37.408350Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:37.408352Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:37.408354Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:37.408362Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559603022686293508:6073] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:37.408981Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559603022686293508:6073] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:37.412770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559603022686293508:6073] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:37.416349Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559603022686293508:6073] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:37.416366Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559603022686293508:6073] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:37.416369Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559603022686293508:6073] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:37.416379Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3368 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:37.418391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:37.421242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:37.421488Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:37.421501Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:37.421513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:37.421573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:37.421621Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559603021904039563:13343]
2025-10-10T14:40:37.422249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:37.422595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:37.422653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:37.422989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:37.423052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:37.423059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:37.423060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:37.423061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:37.423063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:37.423064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:37.423065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:37.423066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:37.423067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:37.423069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:37.423070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:37.423072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:37.423073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:37.423079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:37.423091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:37.423095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:37.423099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:37.423103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:37.423107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:37.423110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:37.423114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:37.423117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:37.423122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:37.423125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:37.423128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:37.423132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:37.423139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:37.423148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:37.423156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:37.423160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:37.423164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:37.423170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:37.423174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:37.423178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:37.423183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:37.423188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:37.423192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:37.423197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:37.423203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:37.423207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:37.423212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:37.423216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:37.423234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:37.423239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:37.423242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:37.423247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:37.423252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:37.423256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:37.423260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:37.423264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:37.423268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:37.423273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:37.423313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:37.425811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:37.426460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:37.426473Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:37.426475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:37.426479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:37.426485Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3367 [2:7559603021904039563:13343]
2025-10-10T14:40:37.426499Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:37.426519Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:37.426523Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:37.426526Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:37.426528Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:37.426545Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:37.426558Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:37.426566Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:37.426638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:37.426646Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:37.426648Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:37.426651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:37.426723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:37.426730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:37.426741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:37.426751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:37.426770Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:37.426796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603022686293457:2438], now have 1 active actors on pipe
2025-10-10T14:40:37.426804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603022686293657:6073], now have 1 active actors on pipe
2025-10-10T14:40:37.426812Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559603021904039558:13343]
2025-10-10T14:40:37.426814Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559603021904039558:13343]
2025-10-10T14:40:37.426816Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559603021904039558:13343]
2025-10-10T14:40:37.426830Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:37.426846Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:37.426847Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:37.426856Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:37.426858Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:37.426865Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:37.426868Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:37.426865Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3367
2025-10-10T14:40:37.426879Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3367
2025-10-10T14:40:37.426905Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559603021904039558:13343]
2025-10-10T14:40:37.426915Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:37.426917Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:37.426944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:37.426953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:37.426992Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e3b0bdbe-b43d4abd-d707b1ff-4b047506_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:37.427004Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:37.427009Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:37.427011Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:37.427023Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:37.427034Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:37.427056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:37.427332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:37.427342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:37.427360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:37.427461Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3368 partition: 0 MaxSeqNo: 40 sessionId: src_id|e3b0bdbe-b43d4abd-d707b1ff-4b047506_0
2025-10-10T14:40:37.427938Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0ee6022-39e398fa-f8fdca1e-a1e9c470_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|e3b0bdbe-b43d4abd-d707b1ff-4b047506_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:37.430735Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e3b0bdbe-b43d4abd-d707b1ff-4b047506_0] Write session: try to update token
2025-10-10T14:40:37.430754Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e3b0bdbe-b43d4abd-d707b1ff-4b047506_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:37.452207Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:37.452234Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:37.452239Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:37.452241Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:37.452253Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559603021904039558:13343]
2025-10-10T14:40:37.452258Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559603021904039558:13343]
2025-10-10T14:40:37.452263Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559603021904039558:13343]
2025-10-10T14:40:37.452307Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:37.452314Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:37.452318Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:37.452326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:37.452335Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:37.452339Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:37.452522Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:37.454463Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3368 sessionId: src_id|e3b0bdbe-b43d4abd-d707b1ff-4b047506_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:37.457504Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:37.496056Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559603022686293671:5396]
2025-10-10T14:40:37.496503Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 pipe creation result: OK TabletId: 72075186224037892 Generation: 3367, pipe: [1:7559603022686293671:5396]
2025-10-10T14:40:37.578758Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:37.579287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:37.579299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:37.579346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603022686293671:5396], now have 1 active actors on pipe
2025-10-10T14:40:37.579613Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:37.580046Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 66 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559603022686293671:5396]
2025-10-10T14:40:37.580080Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:37.580113Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:40:37.580304Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3368 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e3b0bdbe-b43d4abd-d707b1ff-4b047506_0
2025-10-10T14:40:37.580532Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3368 sessionId: src_id|e3b0bdbe-b43d4abd-d707b1ff-4b047506_0 is DEAD
2025-10-10T14:40:37.580979Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e3b0bdbe-b43d4abd-d707b1ff-4b047506_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:40:37.580991Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e3b0bdbe-b43d4abd-d707b1ff-4b047506_0] Write session will restart in 0.005292s
2025-10-10T14:40:37.581026Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e3b0bdbe-b43d4abd-d707b1ff-4b047506_0] Write session: Do CDS request
2025-10-10T14:40:37.581034Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e3b0bdbe-b43d4abd-d707b1ff-4b047506_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:37.587944Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e3b0bdbe-b43d4abd-d707b1ff-4b047506_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:37.588032Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:37.588050Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3369
2025-10-10T14:40:37.588196Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3369 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:37.588254Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3369 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:37.588267Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3369 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:37.588272Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:37.588723Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3369 sessionId:  describe result for acl check
2025-10-10T14:40:37.588760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:37.588766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:37.588768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:37.588774Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559603022686293681:6090] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:37.589367Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559603022686293681:6090] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:37.591758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559603022686293681:6090] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:37.598194Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559603022686293681:6090] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:37.598211Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559603022686293681:6090] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:37.598216Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559603022686293681:6090] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:37.598226Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3369 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:37.619811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:37.622501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:37.622758Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:37.622772Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:37.622785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:37.622846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:37.622895Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559603021904039775:13345]
2025-10-10T14:40:37.623574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:37.624028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:37.624108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:37.624462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:37.624534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:37.624542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:37.624544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:37.624545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:37.624546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:37.624548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:37.624549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:37.624550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:37.624552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:37.624553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:37.624554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:37.624556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:37.624557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:37.624563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:37.624575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:37.624579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:37.624584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:37.624588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:37.624592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:37.624595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:37.624599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:37.624602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:37.624607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:37.624611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:37.624615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:37.624619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:37.624629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:37.624638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:37.624645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:37.624651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:37.624655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:37.624661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:37.624665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:37.624672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:37.624677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:37.624683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:37.624687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:37.624693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:37.624697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:37.624702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:37.624707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:37.624711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:37.624716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:37.624720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:37.624725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:37.624729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:37.624734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:37.624739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:37.624745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:37.624750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:37.624754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:37.624761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:37.624798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:37.627452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:37.628331Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3368
2025-10-10T14:40:37.628366Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3368
2025-10-10T14:40:37.627891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:37.627910Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:37.627912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:37.627916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:37.627923Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3368 [2:7559603021904039775:13345]
2025-10-10T14:40:37.627938Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:37.627957Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:37.627960Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:37.627964Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:37.627966Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:37.627995Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:37.628003Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:37.628012Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:37.628073Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:37.628076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:37.628078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:37.628080Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:37.628153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:37.628156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:37.628168Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:37.628181Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:37.628199Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:37.628220Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559603021904039770:13345]
2025-10-10T14:40:37.628223Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559603021904039770:13345]
2025-10-10T14:40:37.628225Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559603021904039770:13345]
2025-10-10T14:40:37.628241Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:37.628254Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:37.628256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603022686293674:2438], now have 1 active actors on pipe
2025-10-10T14:40:37.628258Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:37.628260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603022686293718:6090], now have 1 active actors on pipe
2025-10-10T14:40:37.628261Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:37.628269Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:37.628286Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:37.628289Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:37.628316Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559603021904039770:13345]
2025-10-10T14:40:37.628324Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:37.628338Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:37.628558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:37.628566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:37.628601Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cfd9d699-e0a65522-c7d0d32f-e93521d8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:37.628621Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:37.628626Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:37.628629Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:37.628645Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:37.628659Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:37.628675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:37.628859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:37.628878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:37.628896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:37.628984Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3369 partition: 0 MaxSeqNo: 40 sessionId: src_id|cfd9d699-e0a65522-c7d0d32f-e93521d8_0
2025-10-10T14:40:37.629423Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e3b0bdbe-b43d4abd-d707b1ff-4b047506_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|cfd9d699-e0a65522-c7d0d32f-e93521d8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:37.632394Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfd9d699-e0a65522-c7d0d32f-e93521d8_0] Write session: try to update token
2025-10-10T14:40:37.632411Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfd9d699-e0a65522-c7d0d32f-e93521d8_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:37.643774Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:40:37.643814Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:37.643826Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559603021904039770:13345]
2025-10-10T14:40:37.643875Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:40:37.643884Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:40:37.644089Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:40:37.644238Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:37.644381Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:37.644526Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:37.644726Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:40:37.644767Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:40:37.649299Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3369 sessionId: src_id|cfd9d699-e0a65522-c7d0d32f-e93521d8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:37.651955Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:37.652593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:37.652621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:37.652670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:40:37.652776Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:40:37.667816Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:37.667838Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:37.667841Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:37.667843Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:37.667855Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559603021904039770:13345]
2025-10-10T14:40:37.667860Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559603021904039770:13345]
2025-10-10T14:40:37.667863Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559603021904039770:13345]
2025-10-10T14:40:37.667914Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:37.667922Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:37.667924Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:37.668093Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:37.669523Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:37.669540Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:37.669546Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:37.679805Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559603022686293890:5396]
2025-10-10T14:40:37.680166Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 pipe creation result: OK TabletId: 72075186224037892 Generation: 3368, pipe: [1:7559603022686293890:5396]
2025-10-10T14:40:37.794470Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:37.803655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:37.803698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:37.803890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:37.803961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:37.804052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:37.804141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:37.804193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:37.804203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:37.804279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:37.804354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:37.804428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:37.804505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:37.804558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:37.804566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:37.804639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:37.804708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:37.804780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:37.804852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:37.804903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:37.804910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:37.804986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:37.805057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:37.805130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:37.805202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:37.805250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:37.805258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:37.805325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:37.805415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:37.805484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:37.805555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:37.805604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:37.805612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:37.805684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:37.805751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:37.805819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:37.805890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:37.805942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:37.805954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:37.806030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:37.806096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:37.806168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:37.806243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:37.806293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:37.806302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:37.806377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:37.806442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:37.806508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:37.806576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:37.806624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:37.806633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:37.806701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:37.806770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:37.806840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:37.806909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:37.806962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:37.806970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:37.807044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:37.807125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:37.807259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:37.807405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:37.807486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:37.807499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:37.807591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603022686293890:5396], now have 1 active actors on pipe
2025-10-10T14:40:37.807836Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:37.807915Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 67 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559603022686293890:5396]
2025-10-10T14:40:37.807927Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:40:37.807931Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:40:37.807971Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3369 reason: error at write: Disconnected sessionId: src_id|cfd9d699-e0a65522-c7d0d32f-e93521d8_0
2025-10-10T14:40:37.808210Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3369 sessionId: src_id|cfd9d699-e0a65522-c7d0d32f-e93521d8_0 is DEAD
2025-10-10T14:40:37.808350Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cfd9d699-e0a65522-c7d0d32f-e93521d8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:40:37.808362Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cfd9d699-e0a65522-c7d0d32f-e93521d8_0] Write session will restart in 0.008306s
2025-10-10T14:40:37.808397Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cfd9d699-e0a65522-c7d0d32f-e93521d8_0] Write session: Do CDS request
2025-10-10T14:40:37.808404Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cfd9d699-e0a65522-c7d0d32f-e93521d8_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:37.808972Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:37.817891Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfd9d699-e0a65522-c7d0d32f-e93521d8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:37.818034Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:37.818052Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3370
2025-10-10T14:40:37.818161Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3370 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:37.818199Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3370 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:37.818209Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3370 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:37.818214Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:37.818712Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3370 sessionId:  describe result for acl check
2025-10-10T14:40:37.818753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:37.818755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:37.818756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:37.818763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559603022686293978:6174] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:37.819510Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559603022686293978:6174] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:37.823526Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559603022686293978:6174] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:37.827320Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559603022686293978:6174] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:37.827336Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559603022686293978:6174] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:37.827340Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559603022686293978:6174] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:37.827350Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3370 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:37.832733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:37.833442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:37.833627Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:37.833640Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:37.833651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:37.833706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:37.833753Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559603021904040026:13360]
2025-10-10T14:40:37.834407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:37.834783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:37.834834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:37.835178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:37.835248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:37.835256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:37.835258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:37.835259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:37.835260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:37.835262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:37.835264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:37.835265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:37.835267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:37.835268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:37.835270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:37.835272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:37.835273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:37.835280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:37.835294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:37.835299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:37.835303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:37.835307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:37.835312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:37.835316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:37.835320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:37.835324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:37.835328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:37.835332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:37.835336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:37.835340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:37.835349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:37.835358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:37.835370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:37.835380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:37.835389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:37.835399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:37.835408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:37.835417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:37.835426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:37.835431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:37.835435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:37.835441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:37.835451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:37.835460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:37.835469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:37.835479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:37.835487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:37.835493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:37.835501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:37.835506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:37.835516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:37.835521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:37.835527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:37.835536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:37.835545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:37.835551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:37.835599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:37.838579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:37.839408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:37.839421Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:37.839424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:37.839428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:37.839436Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3369 [2:7559603021904040026:13360]
2025-10-10T14:40:37.839450Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:37.839469Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:37.839477Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:37.839481Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:37.839483Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:37.839502Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:37.839515Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:37.839523Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:37.839586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:37.839593Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:37.839595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:37.839598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:37.839675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:37.839684Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:37.839696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:37.839707Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:37.839725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:37.839748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603022686293919:2438], now have 1 active actors on pipe
2025-10-10T14:40:37.839752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603022686294120:6174], now have 1 active actors on pipe
2025-10-10T14:40:37.839760Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559603021904040021:13360]
2025-10-10T14:40:37.839763Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559603021904040021:13360]
2025-10-10T14:40:37.839765Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559603021904040021:13360]
2025-10-10T14:40:37.839778Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:37.839793Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:37.839804Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3369
2025-10-10T14:40:37.839860Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3369
2025-10-10T14:40:37.839816Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:37.839823Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:37.839823Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:37.839826Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:37.839828Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:37.839851Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559603021904040021:13360]
2025-10-10T14:40:37.839854Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:37.839856Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:37.840030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:37.840037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:37.840068Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|52d60dc3-4643edf9-50ca71f1-7730197b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:37.840077Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:37.840081Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:37.840084Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:37.840096Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:37.840106Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:37.840145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:37.840561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:37.840577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:37.840600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:37.840898Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3370 partition: 0 MaxSeqNo: 40 sessionId: src_id|52d60dc3-4643edf9-50ca71f1-7730197b_0
2025-10-10T14:40:37.841344Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cfd9d699-e0a65522-c7d0d32f-e93521d8_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|52d60dc3-4643edf9-50ca71f1-7730197b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:37.844122Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|52d60dc3-4643edf9-50ca71f1-7730197b_0] Write session: try to update token
2025-10-10T14:40:37.844140Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|52d60dc3-4643edf9-50ca71f1-7730197b_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:37.851888Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:40:37.851916Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:37.851928Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559603021904040021:13360]
2025-10-10T14:40:37.852006Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:40:37.852198Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:40:37.852359Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:37.852501Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:37.852642Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:37.852846Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:40:37.852885Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:40:37.853092Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:40:37.859845Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3370 sessionId: src_id|52d60dc3-4643edf9-50ca71f1-7730197b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:37.862669Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:37.863041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:37.863072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:37.863116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:40:37.863280Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:40:37.871779Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:37.871804Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:37.871808Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:37.871810Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:37.871821Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559603021904040021:13360]
2025-10-10T14:40:37.871825Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559603021904040021:13360]
2025-10-10T14:40:37.871828Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559603021904040021:13360]
2025-10-10T14:40:37.871872Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:37.871880Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:37.871887Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:37.871889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:37.871891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:37.871892Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:37.872072Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:37.908161Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559603022686294140:5396]
2025-10-10T14:40:37.909569Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 pipe creation result: OK TabletId: 72075186224037892 Generation: 3369, pipe: [1:7559603022686294140:5396]
2025-10-10T14:40:37.987897Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:37.996853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:37.996889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:37.997069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:37.997130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:37.997194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:37.997258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:37.997304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:37.997308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:38.001137Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|52d60dc3-4643edf9-50ca71f1-7730197b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:40:38.001154Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|52d60dc3-4643edf9-50ca71f1-7730197b_0] Write session will restart in 0.009757s
2025-10-10T14:40:38.001194Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|52d60dc3-4643edf9-50ca71f1-7730197b_0] Write session: Do CDS request
2025-10-10T14:40:38.001200Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|52d60dc3-4643edf9-50ca71f1-7730197b_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:37.997505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:37.997588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:37.997654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:37.997727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:37.997774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:37.997779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:37.997854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:37.997917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:37.997986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:37.998056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:37.998099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:37.998102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:37.998173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:37.998234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:37.998329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:37.998392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:37.998433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:37.998435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:37.998500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:37.998572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:37.998635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:37.998694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:37.998737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:37.998739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:37.998812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:37.998885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:37.998954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:37.999017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:37.999058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:37.999060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:37.999131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:37.999188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:37.999257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:37.999319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:37.999360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:37.999362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:37.999430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:37.999492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:37.999559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:37.999630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:37.999671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:37.999672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:37.999739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:37.999793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:37.999854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:37.999925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:37.999988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:37.999990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:38.000057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:38.000117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:38.000178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:38.000237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:38.000278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:38.000280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:38.000360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603022686294140:5396], now have 1 active actors on pipe
2025-10-10T14:40:38.001666Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:38.000622Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:38.000627Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:40:38.000631Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:40:38.000663Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3370 reason: error at write: Disconnected sessionId: src_id|52d60dc3-4643edf9-50ca71f1-7730197b_0
2025-10-10T14:40:38.000684Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 68 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559603022686294140:5396]
2025-10-10T14:40:38.000924Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3370 sessionId: src_id|52d60dc3-4643edf9-50ca71f1-7730197b_0 is DEAD
2025-10-10T14:40:38.012029Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|52d60dc3-4643edf9-50ca71f1-7730197b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:38.012102Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:38.012121Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3371
2025-10-10T14:40:38.012337Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3371 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:38.012384Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3371 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:38.012395Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3371 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:38.012399Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:38.012880Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3371 sessionId:  describe result for acl check
2025-10-10T14:40:38.012920Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:38.012922Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:38.012924Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:38.012930Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559603026981261470:6193] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:38.013496Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559603026981261470:6193] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:38.021448Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559603026981261470:6193] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:38.025695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559603026981261470:6193] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:38.025716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559603026981261470:6193] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:38.025721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559603026981261470:6193] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:38.025731Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3371 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:38.028484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:38.030729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:38.030980Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:38.030990Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:38.031003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:38.031062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:38.031114Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559603026199007548:13363]
2025-10-10T14:40:38.031791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:38.032087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:38.032150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:38.032430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:38.032502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:38.032508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:38.032509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:38.032510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:38.032511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:38.032512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:38.032513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:38.032515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:38.032516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:38.032517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:38.032519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:38.032520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:38.032522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:38.032527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:38.032541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:38.032545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:38.032549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:38.032553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:38.032557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:38.032562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:38.032566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:38.032570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:38.032574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:38.032579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:38.032582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:38.032584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:38.032591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:38.032597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:38.032602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:38.032606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:38.032611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:38.032616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:38.032619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:38.032624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:38.032628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:38.032632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:38.032636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:38.032640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:38.032644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:38.032650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:38.032654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:38.032659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:38.032664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:38.032670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:38.032674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:38.032679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:38.032684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:38.032705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:38.032711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:38.032721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:38.032726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:38.032731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:38.032764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:38.035252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:38.035754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:38.035765Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:38.035768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:38.035773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:38.035780Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3370 [2:7559603026199007548:13363]
2025-10-10T14:40:38.035795Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:38.035821Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:38.035830Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:38.035834Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:38.035836Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:38.035856Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:38.035863Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:38.035881Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:38.035946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:38.035953Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:38.035955Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:38.035958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:38.036044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:38.036053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:38.036067Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:38.036083Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:38.036104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:38.036133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603026981261639:6193], now have 1 active actors on pipe
2025-10-10T14:40:38.036141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603026981261445:2438], now have 1 active actors on pipe
2025-10-10T14:40:38.036148Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559603026199007543:13363]
2025-10-10T14:40:38.036151Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559603026199007543:13363]
2025-10-10T14:40:38.036153Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559603026199007543:13363]
2025-10-10T14:40:38.036167Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:38.036186Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:38.036186Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:38.036189Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:38.036191Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:38.036206Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:38.036170Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3370
2025-10-10T14:40:38.036209Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:38.036189Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3370
2025-10-10T14:40:38.036239Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559603026199007543:13363]
2025-10-10T14:40:38.036250Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:38.036270Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:38.036284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:38.036294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:38.036332Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|50aa9a05-cdf775e8-cffb0417-23d77860_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:38.036343Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:38.036352Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:38.036355Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:38.036367Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:38.036384Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:38.036407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:38.036544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:38.036552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:38.036565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:38.036685Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3371 partition: 0 MaxSeqNo: 40 sessionId: src_id|50aa9a05-cdf775e8-cffb0417-23d77860_0
2025-10-10T14:40:38.037081Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|52d60dc3-4643edf9-50ca71f1-7730197b_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|50aa9a05-cdf775e8-cffb0417-23d77860_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:38.039892Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|50aa9a05-cdf775e8-cffb0417-23d77860_0] Write session: try to update token
2025-10-10T14:40:38.039911Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|50aa9a05-cdf775e8-cffb0417-23d77860_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:38.056496Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:38.056516Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:38.056520Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:38.056522Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:38.056532Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559603026199007543:13363]
2025-10-10T14:40:38.056535Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559603026199007543:13363]
2025-10-10T14:40:38.056539Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559603026199007543:13363]
2025-10-10T14:40:38.056592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:38.056593Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:38.056600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:38.056601Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:38.056602Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:38.056606Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:38.056745Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:38.055915Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3371 sessionId: src_id|50aa9a05-cdf775e8-cffb0417-23d77860_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:38.058622Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:38.100700Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559603026981261672:5396]
2025-10-10T14:40:38.101063Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 pipe creation result: OK TabletId: 72075186224037892 Generation: 3370, pipe: [1:7559603026981261672:5396]
2025-10-10T14:40:38.173613Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:38.174076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:38.174092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:38.174139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603026981261672:5396], now have 1 active actors on pipe
2025-10-10T14:40:38.174425Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:40:38.174439Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:40:38.174504Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:38.174527Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3371 reason: error at write: Disconnected sessionId: src_id|50aa9a05-cdf775e8-cffb0417-23d77860_0
2025-10-10T14:40:38.174551Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 69 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559603026981261672:5396]
2025-10-10T14:40:38.174754Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3371 sessionId: src_id|50aa9a05-cdf775e8-cffb0417-23d77860_0 is DEAD
2025-10-10T14:40:38.175359Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:38.175921Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50aa9a05-cdf775e8-cffb0417-23d77860_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:40:38.175933Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50aa9a05-cdf775e8-cffb0417-23d77860_0] Write session will restart in 0.007074s
2025-10-10T14:40:38.175960Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50aa9a05-cdf775e8-cffb0417-23d77860_0] Write session: Do CDS request
2025-10-10T14:40:38.175981Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50aa9a05-cdf775e8-cffb0417-23d77860_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:38.185836Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|50aa9a05-cdf775e8-cffb0417-23d77860_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:38.185965Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:38.185981Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3372
2025-10-10T14:40:38.187246Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3372 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:38.187307Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3372 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:38.187319Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3372 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:38.187323Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:38.187867Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3372 sessionId:  describe result for acl check
2025-10-10T14:40:38.187905Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:38.187907Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:38.187911Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:38.187917Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559603026981261777:6219] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:38.188506Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559603026981261777:6219] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:38.194551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:38.195621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559603026981261777:6219] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:38.199406Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559603026981261777:6219] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:38.199420Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559603026981261777:6219] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:38.199434Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559603026981261777:6219] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:38.199444Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3372 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:38.198827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:38.199139Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:38.199144Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:38.199156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:38.199219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:38.199260Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559603026199007761:13365]
2025-10-10T14:40:38.199757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:38.200069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:38.200111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:38.200424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:38.200473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:38.200474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:38.200475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:38.200477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:38.200478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:38.200478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:38.200479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:38.200480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:38.200481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:38.200483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:38.200484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:38.200485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:38.200486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:38.200493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:38.200505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:38.200508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:38.200512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:38.200516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:38.200520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:38.200523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:38.200526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:38.200530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:38.200533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:38.200537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:38.200540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:38.200543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:38.200553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:38.200561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:38.200567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:38.200573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:38.200578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:38.200582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:38.200587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:38.200591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:38.200595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:38.200600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:38.200605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:38.200610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:38.200615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:38.200620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:38.200624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:38.200629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:38.200634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:38.200638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:38.200642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:38.200647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:38.200651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:38.200656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:38.200660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:38.200665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:38.200669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:38.200673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:38.200709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:38.204467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:38.205082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:38.205086Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:38.205088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:38.205092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:38.205099Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3371 [2:7559603026199007761:13365]
2025-10-10T14:40:38.205113Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:38.205133Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:38.205136Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:38.205140Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:38.205142Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:38.205161Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:38.205169Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:38.205177Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:38.205241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:38.205243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:38.205244Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:38.205247Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:38.205344Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:38.205348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:38.205358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:38.205368Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:38.205382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:38.205405Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559603026199007755:13365]
2025-10-10T14:40:38.205407Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559603026199007755:13365]
2025-10-10T14:40:38.205409Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559603026199007755:13365]
2025-10-10T14:40:38.205427Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:38.205442Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:38.205458Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:38.205461Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:38.205484Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:38.205488Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:38.205490Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:38.205495Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559603026199007755:13365]
2025-10-10T14:40:38.205498Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:38.205569Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:38.205650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603026981261881:6219], now have 1 active actors on pipe
2025-10-10T14:40:38.205659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603026981261674:2438], now have 1 active actors on pipe
2025-10-10T14:40:38.205941Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3371
2025-10-10T14:40:38.205972Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3371
2025-10-10T14:40:38.206044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:38.206059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:38.206105Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a0e9659d-1f59e91f-e9e348d5-858eb08a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:38.206126Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:38.206131Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:38.206134Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:38.206155Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:38.206174Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:38.206199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:38.206392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:38.206409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:38.206427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:38.206522Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3372 partition: 0 MaxSeqNo: 40 sessionId: src_id|a0e9659d-1f59e91f-e9e348d5-858eb08a_0
2025-10-10T14:40:38.206993Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50aa9a05-cdf775e8-cffb0417-23d77860_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|a0e9659d-1f59e91f-e9e348d5-858eb08a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:38.209891Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a0e9659d-1f59e91f-e9e348d5-858eb08a_0] Write session: try to update token
2025-10-10T14:40:38.209912Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a0e9659d-1f59e91f-e9e348d5-858eb08a_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:38.225277Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:38.225300Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:38.225304Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:38.225306Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:38.225318Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559603026199007755:13365]
2025-10-10T14:40:38.225322Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559603026199007755:13365]
2025-10-10T14:40:38.225327Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559603026199007755:13365]
2025-10-10T14:40:38.225395Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:38.225402Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:38.225406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:38.225562Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:38.229402Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:38.229425Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:38.229430Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:38.229578Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3372 sessionId: src_id|a0e9659d-1f59e91f-e9e348d5-858eb08a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:38.232308Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:38.274722Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559603026981261893:5396]
2025-10-10T14:40:38.275057Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 pipe creation result: OK TabletId: 72075186224037892 Generation: 3371, pipe: [1:7559603026981261893:5396]
2025-10-10T14:40:38.344534Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:38.345147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:38.345167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:38.345217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603026981261893:5396], now have 1 active actors on pipe
2025-10-10T14:40:38.345486Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 70 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559603026981261893:5396]
2025-10-10T14:40:38.345509Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:40:38.345514Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:40:38.345513Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:38.345521Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:38.345584Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3372 reason: error at write: Disconnected sessionId: src_id|a0e9659d-1f59e91f-e9e348d5-858eb08a_0
2025-10-10T14:40:38.346021Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a0e9659d-1f59e91f-e9e348d5-858eb08a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:40:38.346035Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a0e9659d-1f59e91f-e9e348d5-858eb08a_0] Write session will restart in 0.007166s
2025-10-10T14:40:38.346062Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a0e9659d-1f59e91f-e9e348d5-858eb08a_0] Write session: Do CDS request
2025-10-10T14:40:38.345829Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3372 sessionId: src_id|a0e9659d-1f59e91f-e9e348d5-858eb08a_0 is DEAD
2025-10-10T14:40:38.346068Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a0e9659d-1f59e91f-e9e348d5-858eb08a_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:38.357822Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a0e9659d-1f59e91f-e9e348d5-858eb08a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:38.358100Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:38.358117Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3373
2025-10-10T14:40:38.358215Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3373 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:38.358246Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3373 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:38.358252Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3373 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:38.358271Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:38.358690Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3373 sessionId:  describe result for acl check
2025-10-10T14:40:38.358720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:38.358723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:38.358727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:38.358733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559603026981261954:6250] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:38.359438Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559603026981261954:6250] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:38.362580Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559603026981261954:6250] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:38.367197Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559603026981261954:6250] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:38.367221Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559603026981261954:6250] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:38.367225Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559603026981261954:6250] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:38.367236Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3373 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:38.371354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:38.375034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:38.375342Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:38.375349Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:38.375365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:38.375447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:38.375495Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559603026199007979:13368]
2025-10-10T14:40:38.376176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:38.376584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:38.376653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:38.377049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:38.377112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:38.377113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:38.377115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:38.377116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:38.377117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:38.377119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:38.377120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:38.377122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:38.377124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:38.377125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:38.377127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:38.377128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:38.377129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:38.377137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:38.377151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:38.377156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:38.377159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:38.377163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:38.377167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:38.377170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:38.377175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:38.377179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:38.377184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:38.377188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:38.377192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:38.377197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:38.377206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:38.377216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:38.377223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:38.377230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:38.377234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:38.377240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:38.377244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:38.377250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:38.377257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:38.377262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:38.377266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:38.377272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:38.377278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:38.377284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:38.377289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:38.377295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:38.377300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:38.377306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:38.377312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:38.377318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:38.377324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:38.377350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:38.377356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:38.377362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:38.377367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:38.377373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:38.377431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:38.380487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:38.381498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:38.381505Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:38.381507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:38.381512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:38.381520Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3372 [2:7559603026199007979:13368]
2025-10-10T14:40:38.381539Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:38.381563Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:38.381568Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:38.381571Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:38.381574Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:38.381595Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:38.381618Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:38.381627Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:38.381700Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:38.381702Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:38.381705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:38.381708Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:38.381804Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:38.381809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:38.381825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:38.381837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:38.381856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:38.381882Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559603026199007974:13368]
2025-10-10T14:40:38.381884Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559603026199007974:13368]
2025-10-10T14:40:38.381886Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559603026199007974:13368]
2025-10-10T14:40:38.381897Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:38.381907Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:38.381910Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:38.381912Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:38.381917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603026981261894:2438], now have 1 active actors on pipe
2025-10-10T14:40:38.381921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603026981262090:6250], now have 1 active actors on pipe
2025-10-10T14:40:38.381927Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:38.381944Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:38.381947Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:38.381994Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559603026199007974:13368]
2025-10-10T14:40:38.382002Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:38.382395Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:38.382309Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3372
2025-10-10T14:40:38.382355Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3372
2025-10-10T14:40:38.383209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:38.383225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:38.383261Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c01d89f1-3417c5e3-cf88a524-9a0b1cfd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:38.383283Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:38.383289Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:38.383291Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:38.383310Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:38.383334Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:38.383357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:38.384347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:38.384367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:38.384394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:38.384539Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3373 partition: 0 MaxSeqNo: 40 sessionId: src_id|c01d89f1-3417c5e3-cf88a524-9a0b1cfd_0
2025-10-10T14:40:38.385167Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a0e9659d-1f59e91f-e9e348d5-858eb08a_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|c01d89f1-3417c5e3-cf88a524-9a0b1cfd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:38.388063Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c01d89f1-3417c5e3-cf88a524-9a0b1cfd_0] Write session: try to update token
2025-10-10T14:40:38.388085Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c01d89f1-3417c5e3-cf88a524-9a0b1cfd_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:38.410638Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3373 sessionId: src_id|c01d89f1-3417c5e3-cf88a524-9a0b1cfd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:38.413597Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:38.413982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:38.414007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:38.414051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:40:38.414596Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:40:38.416192Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:38.416213Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:38.416216Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:38.416219Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:38.416229Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559603026199007974:13368]
2025-10-10T14:40:38.416234Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559603026199007974:13368]
2025-10-10T14:40:38.416238Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559603026199007974:13368]
2025-10-10T14:40:38.416292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:38.416300Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:38.416303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:38.416445Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:38.421588Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:38.421608Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:38.421612Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:38.445759Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559603026981262114:5396]
2025-10-10T14:40:38.446038Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 pipe creation result: OK TabletId: 72075186224037892 Generation: 3372, pipe: [1:7559603026981262114:5396]
2025-10-10T14:40:38.548486Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:38.556653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:38.556688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:38.556879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:38.556946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:38.557019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:38.557083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:38.557606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:38.557617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:38.557697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:38.557762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:38.557828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:38.557897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:38.557943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:38.557952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:38.558023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:38.558085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:38.560974Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 71 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559603026981262114:5396]
2025-10-10T14:40:38.561006Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:38.561051Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:40:38.561053Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:40:38.561098Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3373 reason: error at write: Disconnected sessionId: src_id|c01d89f1-3417c5e3-cf88a524-9a0b1cfd_0
2025-10-10T14:40:38.558149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:38.558216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:38.558255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:38.558258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:38.558326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:38.558390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:38.558448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:38.558507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:38.558548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:38.558551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:38.558618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:38.558678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:38.558740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:38.558799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:38.558843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:38.558848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:38.558916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:38.558976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:38.559038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:38.559106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:38.559147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:38.559151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:38.559226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:38.559282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:38.559346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:38.559411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:38.559455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:38.559458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:38.559529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:38.559586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:38.559645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:38.559707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:38.559755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:38.559758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:38.559879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:38.559938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:38.560017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:38.560083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:38.560123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:38.560126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:38.560198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:38.560256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:38.560324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:38.560389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:38.560432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:38.560435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:38.560504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603026981262114:5396], now have 1 active actors on pipe
2025-10-10T14:40:38.561081Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:38.561325Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3373 sessionId: src_id|c01d89f1-3417c5e3-cf88a524-9a0b1cfd_0 is DEAD
2025-10-10T14:40:38.564458Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c01d89f1-3417c5e3-cf88a524-9a0b1cfd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:40:38.564470Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c01d89f1-3417c5e3-cf88a524-9a0b1cfd_0] Write session will restart in 0.008942s
2025-10-10T14:40:38.564498Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c01d89f1-3417c5e3-cf88a524-9a0b1cfd_0] Write session: Do CDS request
2025-10-10T14:40:38.564517Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c01d89f1-3417c5e3-cf88a524-9a0b1cfd_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:38.575140Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c01d89f1-3417c5e3-cf88a524-9a0b1cfd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:38.577646Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:38.577662Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3374
2025-10-10T14:40:38.577866Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3374 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:38.577902Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3374 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:38.577908Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3374 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:38.577913Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:38.578352Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3374 sessionId:  describe result for acl check
2025-10-10T14:40:38.578394Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:38.578397Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:38.578399Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:38.578406Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559603026981262181:6243] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:38.578982Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559603026981262181:6243] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:38.587807Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559603026981262181:6243] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:38.591219Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559603026981262181:6243] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:38.591234Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559603026981262181:6243] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:38.591238Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559603026981262181:6243] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:38.591248Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3374 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:38.603117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:38.607515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:38.607774Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:38.607788Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:38.607802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:38.607886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:38.607952Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559603026199008195:13370]
2025-10-10T14:40:38.608627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:38.609240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:38.609308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:38.609710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:38.609785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:38.609793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:38.609794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:38.609795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:38.609796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:38.609798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:38.609799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:38.609800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:38.609802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:38.609803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:38.609804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:38.609805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:38.609806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:38.609814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:38.609828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:38.609833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:38.609838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:38.609843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:38.609847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:38.609852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:38.609856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:38.609861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:38.609868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:38.609873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:38.609877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:38.609882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:38.609893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:38.609908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:38.609920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:38.609929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:38.609939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:38.609945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:38.609952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:38.609958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:38.609967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:38.609973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:38.609979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:38.609990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:38.609994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:38.610005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:38.610010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:38.610019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:38.610026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:38.610037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:38.610046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:38.610052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:38.610058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:38.610068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:38.610073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:38.610083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:38.610088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:38.610096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:38.610142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:38.613203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:38.614074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:38.614090Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:38.614092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:38.614106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:38.614114Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3373 [2:7559603026199008195:13370]
2025-10-10T14:40:38.614129Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:38.614149Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:38.614158Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:38.614162Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:38.614164Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:38.614184Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:38.614196Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:38.614205Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:38.614276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:38.614285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:38.614287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:38.614290Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:38.614366Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:38.614374Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:38.614387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:38.614401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:38.614426Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:38.614453Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559603026199008189:13370]
2025-10-10T14:40:38.614465Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559603026199008189:13370]
2025-10-10T14:40:38.614467Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559603026199008189:13370]
2025-10-10T14:40:38.614481Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:38.614496Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:38.614510Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:38.614514Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:38.614551Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559603026199008189:13370]
2025-10-10T14:40:38.614554Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:38.614605Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:38.614608Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:38.614610Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:38.614617Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:38.614918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603026981262252:6243], now have 1 active actors on pipe
2025-10-10T14:40:38.614928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603026981262117:2438], now have 1 active actors on pipe
2025-10-10T14:40:38.614943Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3373
2025-10-10T14:40:38.614980Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3373
2025-10-10T14:40:38.615355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:38.615371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:38.615407Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5361e14e-e58a5b68-a5604796-8c51a9a4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:38.615417Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:38.615421Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:38.615424Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:38.615437Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:38.615451Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:38.615468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:38.616047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:38.616058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:38.616079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:38.616309Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3374 partition: 0 MaxSeqNo: 40 sessionId: src_id|5361e14e-e58a5b68-a5604796-8c51a9a4_0
2025-10-10T14:40:38.616818Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c01d89f1-3417c5e3-cf88a524-9a0b1cfd_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|5361e14e-e58a5b68-a5604796-8c51a9a4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:38.619620Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5361e14e-e58a5b68-a5604796-8c51a9a4_0] Write session: try to update token
2025-10-10T14:40:38.619638Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5361e14e-e58a5b68-a5604796-8c51a9a4_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:38.639370Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:38.639394Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:38.639398Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:38.639400Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:38.639412Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559603026199008189:13370]
2025-10-10T14:40:38.639416Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559603026199008189:13370]
2025-10-10T14:40:38.639420Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559603026199008189:13370]
2025-10-10T14:40:38.639479Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:38.639487Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:38.639489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:38.639489Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:38.639497Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:38.639508Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:38.639662Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:38.642126Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3374 sessionId: src_id|5361e14e-e58a5b68-a5604796-8c51a9a4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:38.645249Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:38.661313Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559603026981262337:5396]
2025-10-10T14:40:38.661745Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 pipe creation result: OK TabletId: 72075186224037892 Generation: 3373, pipe: [1:7559603026981262337:5396]
2025-10-10T14:40:38.757533Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:38.757921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:38.757944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:38.758007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603026981262337:5396], now have 1 active actors on pipe
2025-10-10T14:40:38.758252Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:38.758301Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:40:38.758325Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:40:38.758402Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3374 reason: error at write: Disconnected sessionId: src_id|5361e14e-e58a5b68-a5604796-8c51a9a4_0
2025-10-10T14:40:38.758809Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5361e14e-e58a5b68-a5604796-8c51a9a4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:40:38.758825Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5361e14e-e58a5b68-a5604796-8c51a9a4_0] Write session will restart in 0.009780s
2025-10-10T14:40:38.758633Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3374 sessionId: src_id|5361e14e-e58a5b68-a5604796-8c51a9a4_0 is DEAD
2025-10-10T14:40:38.758850Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5361e14e-e58a5b68-a5604796-8c51a9a4_0] Write session: Do CDS request
2025-10-10T14:40:38.758705Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 72 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559603026981262337:5396]
2025-10-10T14:40:38.758722Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:38.758868Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5361e14e-e58a5b68-a5604796-8c51a9a4_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:38.769943Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5361e14e-e58a5b68-a5604796-8c51a9a4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:38.770052Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:38.770072Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3375
2025-10-10T14:40:38.770253Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3375 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:38.770295Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3375 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:38.770307Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3375 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:38.770312Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:38.770707Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3375 sessionId:  describe result for acl check
2025-10-10T14:40:38.770749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:38.770758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:38.770760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:38.770767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559603026981262385:6283] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:38.771390Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559603026981262385:6283] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:38.774620Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559603026981262385:6283] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:38.780718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559603026981262385:6283] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:38.780736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559603026981262385:6283] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:38.780741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559603026981262385:6283] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:38.780751Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3375 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:38.786169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:38.789740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:38.790171Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:38.790187Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:38.790202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:38.790268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:38.790310Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559603026199008425:13372]
2025-10-10T14:40:38.790975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:38.791379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:38.791448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:38.791794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:38.791845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:38.791846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:38.791848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:38.791849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:38.791850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:38.791852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:38.791853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:38.791854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:38.791856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:38.791857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:38.791859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:38.791860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:38.791861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:38.791868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:38.791881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:38.791885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:38.791889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:38.791894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:38.791898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:38.791903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:38.791907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:38.791912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:38.791917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:38.791921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:38.791926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:38.791930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:38.791937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:38.791946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:38.791953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:38.791973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:38.791978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:38.791984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:38.791989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:38.791995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:38.792000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:38.792006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:38.792011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:38.792017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:38.792022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:38.792027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:38.792032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:38.792038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:38.792042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:38.792047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:38.792052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:38.792058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:38.792064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:38.792070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:38.792075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:38.792081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:38.792089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:38.792095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:38.792136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:38.796264Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3374
2025-10-10T14:40:38.795331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:38.796296Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3374
2025-10-10T14:40:38.795836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:38.795841Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:38.795844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:38.795848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:38.795855Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3374 [2:7559603026199008425:13372]
2025-10-10T14:40:38.795868Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:38.795886Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:38.795891Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:38.795895Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:38.795897Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:38.795916Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:38.795923Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:38.795932Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:38.796008Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:38.796010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:38.796012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:38.796014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:38.796085Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:38.796088Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:38.796102Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:38.796116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:38.796135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:38.796158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603026981262555:6283], now have 1 active actors on pipe
2025-10-10T14:40:38.796162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603026981262340:2438], now have 1 active actors on pipe
2025-10-10T14:40:38.796171Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559603026199008419:13372]
2025-10-10T14:40:38.796173Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559603026199008419:13372]
2025-10-10T14:40:38.796176Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559603026199008419:13372]
2025-10-10T14:40:38.796192Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:38.796207Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:38.796224Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:38.796227Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:38.796248Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:38.796252Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:38.796255Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559603026199008419:13372]
2025-10-10T14:40:38.796258Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:38.796263Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:38.796271Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:38.796695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:38.796707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:38.796743Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d4a86cf5-e10a53bd-f9f92ff5-2b37f020_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:38.796751Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:38.796756Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:38.796759Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:38.796772Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:38.796784Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:38.796813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:38.797295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:38.797308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:38.797369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:38.797507Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3375 partition: 0 MaxSeqNo: 40 sessionId: src_id|d4a86cf5-e10a53bd-f9f92ff5-2b37f020_0
2025-10-10T14:40:38.798061Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5361e14e-e58a5b68-a5604796-8c51a9a4_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|d4a86cf5-e10a53bd-f9f92ff5-2b37f020_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:38.801173Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4a86cf5-e10a53bd-f9f92ff5-2b37f020_0] Write session: try to update token
2025-10-10T14:40:38.801194Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4a86cf5-e10a53bd-f9f92ff5-2b37f020_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:38.810317Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:40:38.810339Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:38.810351Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559603026199008419:13372]
2025-10-10T14:40:38.810404Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:40:38.810398Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:40:38.810594Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:40:38.810736Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:38.810870Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:38.811007Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:38.811197Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:40:38.811231Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:40:38.831587Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:38.831610Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:38.831613Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:38.831614Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:38.831624Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559603026199008419:13372]
2025-10-10T14:40:38.831627Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559603026199008419:13372]
2025-10-10T14:40:38.831631Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559603026199008419:13372]
2025-10-10T14:40:38.831677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:38.831690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:38.831690Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:38.831692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:38.831697Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:38.831701Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:38.831832Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:38.830298Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3375 sessionId: src_id|d4a86cf5-e10a53bd-f9f92ff5-2b37f020_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:38.832941Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:38.859021Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559603026981262588:5396]
2025-10-10T14:40:38.859564Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 pipe creation result: OK TabletId: 72075186224037892 Generation: 3374, pipe: [1:7559603026981262588:5396]
2025-10-10T14:40:38.961389Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:38.962089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:38.962111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:38.962138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603026981262588:5396], now have 1 active actors on pipe
2025-10-10T14:40:38.962412Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:40:38.962428Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:40:38.962494Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3375 reason: error at write: Disconnected sessionId: src_id|d4a86cf5-e10a53bd-f9f92ff5-2b37f020_0
2025-10-10T14:40:38.962690Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3375 sessionId: src_id|d4a86cf5-e10a53bd-f9f92ff5-2b37f020_0 is DEAD
2025-10-10T14:40:38.962854Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 73 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559603026981262588:5396]
2025-10-10T14:40:38.962869Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:38.963180Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4a86cf5-e10a53bd-f9f92ff5-2b37f020_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:40:38.963190Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4a86cf5-e10a53bd-f9f92ff5-2b37f020_0] Write session will restart in 0.009955s
2025-10-10T14:40:38.963218Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4a86cf5-e10a53bd-f9f92ff5-2b37f020_0] Write session: Do CDS request
2025-10-10T14:40:38.963225Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4a86cf5-e10a53bd-f9f92ff5-2b37f020_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:38.962546Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:38.974968Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4a86cf5-e10a53bd-f9f92ff5-2b37f020_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:38.975100Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:38.975118Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3376
2025-10-10T14:40:38.975255Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3376 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:38.975307Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3376 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:38.975318Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3376 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:38.975323Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:38.976175Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3376 sessionId:  describe result for acl check
2025-10-10T14:40:38.976217Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:38.976224Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:38.976226Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:38.976234Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559603026981262626:6343] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:38.976823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559603026981262626:6343] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:38.981310Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559603026981262626:6343] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:38.996024Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559603026981262626:6343] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:38.996047Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559603026981262626:6343] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:38.996051Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559603026981262626:6343] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:38.996063Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3376 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:39.000387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:39.002802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:39.003244Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:39.003263Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:39.003279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:39.003366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:39.003418Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559603030493975979:13388]
2025-10-10T14:40:39.004104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:39.004542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:39.004599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:39.004927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:39.005002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:39.005012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:39.005014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:39.005015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:39.005017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:39.005018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:39.005019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:39.005021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:39.005022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:39.005023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:39.005025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:39.005025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:39.005027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:39.005034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:39.005049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:39.005053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:39.005057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:39.005061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:39.005066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:39.005070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:39.005074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:39.005078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:39.005082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:39.005086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:39.005090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:39.005094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:39.005106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:39.005116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:39.005123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:39.005129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:39.005136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:39.005141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:39.005145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:39.005159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:39.005165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:39.005171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:39.005176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:39.005181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:39.005187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:39.005193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:39.005198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:39.005204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:39.005210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:39.005215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:39.005220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:39.005226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:39.005235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:39.005241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:39.005247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:39.005253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:39.005258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:39.005265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:39.005309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:39.008559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:39.009905Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3375
2025-10-10T14:40:39.009937Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3375
2025-10-10T14:40:39.011640Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3376 partition: 0 MaxSeqNo: 40 sessionId: src_id|92cea9e8-d047f175-88af8baa-314717ba_0
2025-10-10T14:40:39.012202Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4a86cf5-e10a53bd-f9f92ff5-2b37f020_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|92cea9e8-d047f175-88af8baa-314717ba_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:39.009185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:39.009206Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:39.009209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:39.009214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:39.009222Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3375 [2:7559603030493975979:13388]
2025-10-10T14:40:39.009238Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:39.009259Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:39.009262Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:39.009266Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:39.009269Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:39.009288Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:39.009296Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:39.009305Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:39.009406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:39.009409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:39.009411Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:39.009414Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:39.009487Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:39.009490Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:39.009508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:39.009523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:39.009543Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:39.009566Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559603026199008678:13388]
2025-10-10T14:40:39.009569Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559603026199008678:13388]
2025-10-10T14:40:39.009571Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559603026199008678:13388]
2025-10-10T14:40:39.009581Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:39.009595Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:39.009613Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:39.009617Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:39.009646Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559603026199008678:13388]
2025-10-10T14:40:39.009649Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:39.009808Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:39.009811Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:39.009813Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:39.009820Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:39.010048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603026981262805:6343], now have 1 active actors on pipe
2025-10-10T14:40:39.010054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603026981262601:2438], now have 1 active actors on pipe
2025-10-10T14:40:39.010549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:39.010556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:39.010593Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|92cea9e8-d047f175-88af8baa-314717ba_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:39.010604Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:39.010608Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:39.010611Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:39.010626Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:39.010640Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:39.010656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:39.011503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:39.011509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:39.011529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:39.015113Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|92cea9e8-d047f175-88af8baa-314717ba_0] Write session: try to update token
2025-10-10T14:40:39.015138Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|92cea9e8-d047f175-88af8baa-314717ba_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:39.041697Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:39.041721Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:39.041725Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:39.041728Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:39.041739Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559603026199008678:13388]
2025-10-10T14:40:39.041744Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559603026199008678:13388]
2025-10-10T14:40:39.041749Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559603026199008678:13388]
2025-10-10T14:40:39.041803Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:39.041810Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:39.041812Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:39.041876Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:39.041892Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:39.041896Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:39.041968Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:39.042467Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3376 sessionId: src_id|92cea9e8-d047f175-88af8baa-314717ba_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:39.045224Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:39.062756Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559603031276230129:5396]
2025-10-10T14:40:39.063113Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 pipe creation result: OK TabletId: 72075186224037892 Generation: 3375, pipe: [1:7559603031276230129:5396]
2025-10-10T14:40:39.157940Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:39.158534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:39.158558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:39.158607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603031276230129:5396], now have 1 active actors on pipe
2025-10-10T14:40:39.158817Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 74 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559603031276230129:5396]
2025-10-10T14:40:39.158821Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:39.159687Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|92cea9e8-d047f175-88af8baa-314717ba_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:40:39.159698Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|92cea9e8-d047f175-88af8baa-314717ba_0] Write session will restart in 0.008723s
2025-10-10T14:40:39.158959Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:40:39.158965Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:40:39.158980Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:39.159032Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3376 reason: error at write: Disconnected sessionId: src_id|92cea9e8-d047f175-88af8baa-314717ba_0
2025-10-10T14:40:39.159249Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3376 sessionId: src_id|92cea9e8-d047f175-88af8baa-314717ba_0 is DEAD
2025-10-10T14:40:39.159726Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|92cea9e8-d047f175-88af8baa-314717ba_0] Write session: Do CDS request
2025-10-10T14:40:39.159736Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|92cea9e8-d047f175-88af8baa-314717ba_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:39.169999Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|92cea9e8-d047f175-88af8baa-314717ba_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:39.170520Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:39.170537Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3377
2025-10-10T14:40:39.170714Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3377 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:39.170760Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3377 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:39.170776Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3377 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:39.170794Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:39.171376Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3377 sessionId:  describe result for acl check
2025-10-10T14:40:39.171412Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:39.171418Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:39.171420Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:39.171426Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559603031276230165:6377] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:39.172004Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559603031276230165:6377] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:39.174795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559603031276230165:6377] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:39.178989Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559603031276230165:6377] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:39.179003Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559603031276230165:6377] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:39.179007Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559603031276230165:6377] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:39.179018Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3377 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:39.181711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:39.185108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:39.185318Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:39.185363Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:39.185376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:39.185439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:39.185489Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559603030493976199:13390]
2025-10-10T14:40:39.186033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:39.186336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:39.186393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:39.186693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:39.186757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:39.186764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:39.186766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:39.186767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:39.186768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:39.186770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:39.186771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:39.186773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:39.186775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:39.186776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:39.186778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:39.186779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:39.186780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:39.186787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:39.186802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:39.186808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:39.186811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:39.186815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:39.186820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:39.186825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:39.186829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:39.186834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:39.186838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:39.186842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:39.186847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:39.186851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:39.186860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:39.186873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:39.186880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:39.186886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:39.186896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:39.186901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:39.186906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:39.186912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:39.186918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:39.186924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:39.186929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:39.186935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:39.186941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:39.186951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:39.186958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:39.186967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:39.186974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:39.186983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:39.186988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:39.186999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:39.187009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:39.187014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:39.187023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:39.187029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:39.187039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:39.187045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:39.187087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:39.189803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:39.192094Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3376
2025-10-10T14:40:39.192142Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3376
2025-10-10T14:40:39.190412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:39.190427Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:39.190429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:39.190434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:39.190442Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3376 [2:7559603030493976199:13390]
2025-10-10T14:40:39.190458Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:39.190479Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:39.190482Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:39.190487Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:39.190489Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:39.190510Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:39.190518Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:39.190526Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:39.190596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:39.190598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:39.190603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:39.190606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:39.190684Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:39.190687Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:39.190700Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:39.190712Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:39.190732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:39.190754Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559603030493976194:13390]
2025-10-10T14:40:39.190756Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559603030493976194:13390]
2025-10-10T14:40:39.190758Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559603030493976194:13390]
2025-10-10T14:40:39.190774Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:39.190788Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:39.190806Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:39.190810Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:39.190839Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559603030493976194:13390]
2025-10-10T14:40:39.190842Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:39.191433Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:39.191437Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:39.191440Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:39.191447Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:39.191616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603031276230131:2438], now have 1 active actors on pipe
2025-10-10T14:40:39.191624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603031276230329:6377], now have 1 active actors on pipe
2025-10-10T14:40:39.192327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:39.192336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:39.192375Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|76aad5d7-17c037c9-4cf1db43-c1dc0fb1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:39.192386Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:39.192392Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:39.192395Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:39.192410Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:39.192428Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:39.192449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:39.192823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:39.192835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:39.192852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:39.193204Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3377 partition: 0 MaxSeqNo: 40 sessionId: src_id|76aad5d7-17c037c9-4cf1db43-c1dc0fb1_0
2025-10-10T14:40:39.193658Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|92cea9e8-d047f175-88af8baa-314717ba_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|76aad5d7-17c037c9-4cf1db43-c1dc0fb1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:39.196661Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|76aad5d7-17c037c9-4cf1db43-c1dc0fb1_0] Write session: try to update token
2025-10-10T14:40:39.196688Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|76aad5d7-17c037c9-4cf1db43-c1dc0fb1_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:39.212646Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:39.212669Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:39.212672Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:39.212675Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:39.212688Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559603030493976194:13390]
2025-10-10T14:40:39.212693Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559603030493976194:13390]
2025-10-10T14:40:39.212696Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559603030493976194:13390]
2025-10-10T14:40:39.212745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:39.212758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:39.212761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:39.212761Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:39.212768Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:39.212773Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:39.212899Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:39.219921Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3377 sessionId: src_id|76aad5d7-17c037c9-4cf1db43-c1dc0fb1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:39.223004Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:39.258848Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559603031276230355:5396]
2025-10-10T14:40:39.259219Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 pipe creation result: OK TabletId: 72075186224037892 Generation: 3376, pipe: [1:7559603031276230355:5396]
2025-10-10T14:40:39.329000Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:39.329599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:39.329620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:39.329647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603031276230355:5396], now have 1 active actors on pipe
2025-10-10T14:40:39.329881Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:39.330829Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|76aad5d7-17c037c9-4cf1db43-c1dc0fb1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:40:39.330842Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|76aad5d7-17c037c9-4cf1db43-c1dc0fb1_0] Write session will restart in 0.009370s
2025-10-10T14:40:39.330869Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|76aad5d7-17c037c9-4cf1db43-c1dc0fb1_0] Write session: Do CDS request
2025-10-10T14:40:39.330874Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|76aad5d7-17c037c9-4cf1db43-c1dc0fb1_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:39.330280Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:39.330339Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 75 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559603031276230355:5396]
2025-10-10T14:40:39.330361Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:40:39.330449Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3377 reason: status is not ok: tablet will be restarted right now sessionId: src_id|76aad5d7-17c037c9-4cf1db43-c1dc0fb1_0
2025-10-10T14:40:39.330684Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3377 sessionId: src_id|76aad5d7-17c037c9-4cf1db43-c1dc0fb1_0 is DEAD
2025-10-10T14:40:39.341926Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|76aad5d7-17c037c9-4cf1db43-c1dc0fb1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:39.342269Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:39.342286Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3378
2025-10-10T14:40:39.342436Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3378 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:39.342478Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3378 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:39.342490Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3378 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:39.342494Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:39.343025Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3378 sessionId:  describe result for acl check
2025-10-10T14:40:39.343065Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:39.343073Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:39.343075Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:39.343081Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559603031276230373:6400] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:39.343659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559603031276230373:6400] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:39.346598Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559603031276230373:6400] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:39.350982Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559603031276230373:6400] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:39.350999Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559603031276230373:6400] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:39.351003Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559603031276230373:6400] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:39.351013Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3378 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:39.356299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:39.358985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:39.359424Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:39.359430Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:39.359443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:39.359515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:39.359569Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559603030493976422:13392]
2025-10-10T14:40:39.360232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:39.360601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:39.360679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:39.361054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:39.361123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:39.361124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:39.361126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:39.361127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:39.361128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:39.361130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:39.361131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:39.361133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:39.361135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:39.361137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:39.361138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:39.361140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:39.361141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:39.361148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:39.361163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:39.361168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:39.361173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:39.361178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:39.361182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:39.361186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:39.361191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:39.361196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:39.361201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:39.361205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:39.361210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:39.361214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:39.361223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:39.361233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:39.361240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:39.361245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:39.361250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:39.361256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:39.361262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:39.361268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:39.361273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:39.361279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:39.361287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:39.361293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:39.361299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:39.361306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:39.361311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:39.361318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:39.361324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:39.361348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:39.361354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:39.361360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:39.361369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:39.361375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:39.361380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:39.361387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:39.361392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:39.361399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:39.361459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:39.364495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:39.365085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:39.365090Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:39.365093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:39.365097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:39.365105Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3377 [2:7559603030493976422:13392]
2025-10-10T14:40:39.365122Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:39.365143Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:39.365147Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:39.365152Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:39.365154Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:39.365173Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:39.365181Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:39.365190Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:39.365261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:39.365264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:39.365265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:39.365268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:39.365372Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:39.365375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:39.365388Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:39.365401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:39.365419Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:39.365444Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559603030493976417:13392]
2025-10-10T14:40:39.365447Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559603030493976417:13392]
2025-10-10T14:40:39.365449Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559603030493976417:13392]
2025-10-10T14:40:39.365467Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:39.365480Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:39.365483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603031276230356:2438], now have 1 active actors on pipe
2025-10-10T14:40:39.365484Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:39.365486Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:39.365489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603031276230500:6400], now have 1 active actors on pipe
2025-10-10T14:40:39.365495Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:39.365512Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:39.365516Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:39.365554Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559603030493976417:13392]
2025-10-10T14:40:39.365563Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:39.365570Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:39.365736Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3377
2025-10-10T14:40:39.365777Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3377
2025-10-10T14:40:39.365909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:39.365924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:39.365957Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3a1a0c11-39ac9e6e-23055076-fc3cca61_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:39.365968Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:39.365972Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:39.365975Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:39.365988Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:39.366002Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:39.366022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:39.366612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:39.366624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:39.366645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:39.366758Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3378 partition: 0 MaxSeqNo: 40 sessionId: src_id|3a1a0c11-39ac9e6e-23055076-fc3cca61_0
2025-10-10T14:40:39.369065Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|76aad5d7-17c037c9-4cf1db43-c1dc0fb1_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|3a1a0c11-39ac9e6e-23055076-fc3cca61_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:39.372220Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3a1a0c11-39ac9e6e-23055076-fc3cca61_0] Write session: try to update token
2025-10-10T14:40:39.372246Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3a1a0c11-39ac9e6e-23055076-fc3cca61_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:39.391037Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:39.391062Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:39.391065Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:39.391067Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:39.391079Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559603030493976417:13392]
2025-10-10T14:40:39.391084Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559603030493976417:13392]
2025-10-10T14:40:39.391088Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559603030493976417:13392]
2025-10-10T14:40:39.391140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:39.391153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:39.391155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:39.391155Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:39.391163Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:39.391168Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:39.391301Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:39.394132Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3378 sessionId: src_id|3a1a0c11-39ac9e6e-23055076-fc3cca61_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:39.397143Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:39.430338Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559603031276230582:5396]
2025-10-10T14:40:39.434060Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 pipe creation result: OK TabletId: 72075186224037892 Generation: 3377, pipe: [1:7559603031276230582:5396]
2025-10-10T14:40:39.516338Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:39.516863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:39.516875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:39.516926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603031276230582:5396], now have 1 active actors on pipe
2025-10-10T14:40:39.517358Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 76 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559603031276230582:5396]
2025-10-10T14:40:39.517391Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:39.517440Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:40:39.517443Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:40:39.517513Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3378 reason: error at write: Disconnected sessionId: src_id|3a1a0c11-39ac9e6e-23055076-fc3cca61_0
2025-10-10T14:40:39.517199Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:39.517922Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a1a0c11-39ac9e6e-23055076-fc3cca61_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:40:39.517935Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a1a0c11-39ac9e6e-23055076-fc3cca61_0] Write session will restart in 0.005710s
2025-10-10T14:40:39.517963Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a1a0c11-39ac9e6e-23055076-fc3cca61_0] Write session: Do CDS request
2025-10-10T14:40:39.517969Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a1a0c11-39ac9e6e-23055076-fc3cca61_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:39.517730Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3378 sessionId: src_id|3a1a0c11-39ac9e6e-23055076-fc3cca61_0 is DEAD
2025-10-10T14:40:39.525963Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3a1a0c11-39ac9e6e-23055076-fc3cca61_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:39.537638Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:39.537661Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3379
2025-10-10T14:40:39.541493Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3379 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:39.541555Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3379 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:39.541561Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3379 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:39.541567Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:39.542018Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3379 sessionId:  describe result for acl check
2025-10-10T14:40:39.542058Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:39.542061Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:39.542063Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:39.542071Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559603031276230725:6424] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:39.542701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559603031276230725:6424] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:39.548046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:39.551897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:39.552409Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:39.552429Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:39.552445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:39.552533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:39.552581Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559603030493976643:13395]
2025-10-10T14:40:39.553229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:39.554124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:39.554182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:39.554565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:39.554635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:39.554636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:39.554637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:39.554639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:39.554640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:39.554642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:39.554643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:39.554645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:39.554646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:39.554648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:39.554649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:39.554650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:39.554651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:39.554658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:39.554673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:39.554678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:39.554682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:39.554686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:39.554690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:39.554695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:39.554700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:39.554705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:39.554708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:39.554712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:39.554715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:39.554719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:39.554730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:39.554739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:39.554747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:39.554754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:39.554759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:39.554765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:39.554784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:39.554790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:39.554796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:39.554802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:39.554808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:39.554813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:39.554819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:39.554825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:39.554830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:39.554836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:39.554841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:39.554847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:39.554852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:39.554857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:39.554863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:39.554868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:39.554873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:39.554878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:39.554882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:39.554888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:39.554927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:39.558326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:39.558666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:39.558684Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:39.558687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:39.558691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:39.558698Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3378 [2:7559603030493976643:13395]
2025-10-10T14:40:39.558713Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:39.558738Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:39.558742Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:39.558746Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:39.558748Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:39.558767Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:39.558775Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:39.558788Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:39.558856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:39.558880Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:39.558882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:39.558885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:39.558951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:39.558961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:39.558976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:39.558992Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:39.559013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:39.559035Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559603030493976638:13395]
2025-10-10T14:40:39.559038Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559603030493976638:13395]
2025-10-10T14:40:39.559040Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559603030493976638:13395]
2025-10-10T14:40:39.559054Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:39.559069Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:39.559088Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:39.559091Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:39.559123Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559603030493976638:13395]
2025-10-10T14:40:39.559132Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:39.559273Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:39.559285Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:39.559287Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:39.559294Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:39.559594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603031276230584:2438], now have 1 active actors on pipe
2025-10-10T14:40:39.561589Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3378
2025-10-10T14:40:39.566430Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559603031276230725:6424] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:39.574086Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559603031276230725:6424] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:39.574103Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559603031276230725:6424] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:39.574107Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559603031276230725:6424] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:39.574118Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3379 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:39.577504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603031276230806:6424], now have 1 active actors on pipe
2025-10-10T14:40:39.577657Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3378
2025-10-10T14:40:39.577800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:39.577827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:39.577866Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6968bd05-cf770f25-16ddbb20-6e403d30_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:39.577897Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:39.577910Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:39.577913Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:39.577930Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:39.577958Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:39.577998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:39.578236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:39.578258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:39.578280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:39.578428Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3379 partition: 0 MaxSeqNo: 40 sessionId: src_id|6968bd05-cf770f25-16ddbb20-6e403d30_0
2025-10-10T14:40:39.578927Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a1a0c11-39ac9e6e-23055076-fc3cca61_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|6968bd05-cf770f25-16ddbb20-6e403d30_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:39.581925Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6968bd05-cf770f25-16ddbb20-6e403d30_0] Write session: try to update token
2025-10-10T14:40:39.581948Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6968bd05-cf770f25-16ddbb20-6e403d30_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:39.587585Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:39.587611Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:39.587615Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:39.587617Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:39.587627Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559603030493976638:13395]
2025-10-10T14:40:39.587634Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559603030493976638:13395]
2025-10-10T14:40:39.587637Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559603030493976638:13395]
2025-10-10T14:40:39.587691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:39.587692Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:39.587699Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:39.587701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:39.587703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:39.587704Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:39.587841Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:39.614387Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3379 sessionId: src_id|6968bd05-cf770f25-16ddbb20-6e403d30_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:39.617142Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:39.621459Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559603031276230810:5396]
2025-10-10T14:40:39.629733Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 pipe creation result: OK TabletId: 72075186224037892 Generation: 3378, pipe: [1:7559603031276230810:5396]
2025-10-10T14:40:39.720125Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:39.720526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:39.720548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:39.720574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603031276230810:5396], now have 1 active actors on pipe
2025-10-10T14:40:39.720869Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:39.720924Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:40:39.721026Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3379 reason: status is not ok: tablet will be restarted right now sessionId: src_id|6968bd05-cf770f25-16ddbb20-6e403d30_0
2025-10-10T14:40:39.721054Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 77 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559603031276230810:5396]
2025-10-10T14:40:39.720814Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:39.721219Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3379 sessionId: src_id|6968bd05-cf770f25-16ddbb20-6e403d30_0 is DEAD
2025-10-10T14:40:39.721479Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6968bd05-cf770f25-16ddbb20-6e403d30_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:40:39.721492Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6968bd05-cf770f25-16ddbb20-6e403d30_0] Write session will restart in 0.006341s
2025-10-10T14:40:39.721518Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6968bd05-cf770f25-16ddbb20-6e403d30_0] Write session: Do CDS request
2025-10-10T14:40:39.721525Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6968bd05-cf770f25-16ddbb20-6e403d30_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:39.729173Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6968bd05-cf770f25-16ddbb20-6e403d30_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:39.729246Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:39.729271Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3380
2025-10-10T14:40:39.729454Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3380 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:39.729505Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3380 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:39.729517Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3380 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:39.729522Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:39.730013Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3380 sessionId:  describe result for acl check
2025-10-10T14:40:39.730055Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:39.730061Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:39.730063Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:39.730069Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559603031276230826:6449] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:39.730660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559603031276230826:6449] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:39.732916Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559603031276230826:6449] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:39.744250Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559603031276230826:6449] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:39.744281Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559603031276230826:6449] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:39.744286Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559603031276230826:6449] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:39.744296Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3380 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:39.747727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:39.750763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:39.751031Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:39.751044Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:39.751056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:39.751120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:39.751171Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559603030493976867:13397]
2025-10-10T14:40:39.751851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:39.752235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:39.752296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:39.752664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:39.752728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:39.752735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:39.752737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:39.752738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:39.752740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:39.752741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:39.752743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:39.752744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:39.752746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:39.752748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:39.752749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:39.752750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:39.752752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:39.752759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:39.752773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:39.752778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:39.752783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:39.752787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:39.752792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:39.752797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:39.752801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:39.752805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:39.752810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:39.752814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:39.752817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:39.752821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:39.752830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:39.752841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:39.752848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:39.752854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:39.752858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:39.752864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:39.752869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:39.752874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:39.752887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:39.752893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:39.752898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:39.752904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:39.752914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:39.752920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:39.752931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:39.752939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:39.752949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:39.752955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:39.752964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:39.752971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:39.752995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:39.753006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:39.753011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:39.753022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:39.753029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:39.753040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:39.753083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:39.756237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:39.756982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:39.756997Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:39.756999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:39.757003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:39.757010Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3379 [2:7559603030493976867:13397]
2025-10-10T14:40:39.757025Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:39.757046Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:39.757049Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:39.757053Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:39.757055Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:39.757073Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:39.757082Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:39.757091Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:39.757161Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:39.757170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:39.757173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:39.757176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:39.757256Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:39.757264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:39.757278Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:39.757297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:39.757321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:39.757365Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559603030493976862:13397]
2025-10-10T14:40:39.757374Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559603030493976862:13397]
2025-10-10T14:40:39.757377Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559603030493976862:13397]
2025-10-10T14:40:39.757394Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:39.757404Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:39.757407Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:39.757410Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:39.757426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603031276230997:6449], now have 1 active actors on pipe
2025-10-10T14:40:39.757431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603031276230815:2438], now have 1 active actors on pipe
2025-10-10T14:40:39.757437Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:39.757455Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:39.757458Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:39.757494Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559603030493976862:13397]
2025-10-10T14:40:39.757503Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:39.757524Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:39.757508Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3379
2025-10-10T14:40:39.757529Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3379
2025-10-10T14:40:39.757824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:39.757840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:39.757891Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|16f94445-ecc05a0a-d9a947bd-2f077258_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:39.757906Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:39.757911Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:39.757914Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:39.757927Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:39.757946Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:39.758173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:39.758414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:39.758426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:39.758446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:39.758542Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3380 partition: 0 MaxSeqNo: 40 sessionId: src_id|16f94445-ecc05a0a-d9a947bd-2f077258_0
2025-10-10T14:40:39.759001Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6968bd05-cf770f25-16ddbb20-6e403d30_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|16f94445-ecc05a0a-d9a947bd-2f077258_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:39.761802Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|16f94445-ecc05a0a-d9a947bd-2f077258_0] Write session: try to update token
2025-10-10T14:40:39.761821Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|16f94445-ecc05a0a-d9a947bd-2f077258_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:39.769761Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:40:39.769786Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:39.769799Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559603030493976862:13397]
2025-10-10T14:40:39.769856Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:40:39.769903Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:40:39.770071Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:40:39.770229Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:39.770380Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:39.770535Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:39.770748Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:40:39.770801Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:40:39.782853Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3380 sessionId: src_id|16f94445-ecc05a0a-d9a947bd-2f077258_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:39.785502Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:39.785764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:39.785793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:39.785848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:40:39.785948Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:40:39.788884Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:39.788903Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:39.788906Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:39.788908Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:39.788920Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559603030493976862:13397]
2025-10-10T14:40:39.788923Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559603030493976862:13397]
2025-10-10T14:40:39.788926Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559603030493976862:13397]
2025-10-10T14:40:39.788978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:39.788991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:39.788991Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:39.788994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:39.789002Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:39.789007Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:39.789138Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:39.821015Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559603031276231041:5396]
2025-10-10T14:40:39.821318Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 pipe creation result: OK TabletId: 72075186224037892 Generation: 3379, pipe: [1:7559603031276231041:5396]
2025-10-10T14:40:39.909155Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:39.918006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:39.918038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:39.918231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:39.918302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:39.918378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:39.918452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:39.918931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:39.918944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:39.919018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:39.919086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:39.919156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:39.919229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:39.919275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:39.919286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:39.919354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:39.919421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:39.919486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:39.919558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:39.919605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:39.919614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:39.919690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:39.919927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:39.920007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:39.920073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:39.920118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:39.920126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:39.920196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:39.920261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:39.920328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:39.920398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:39.920442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:39.920450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:39.920520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:39.920588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:39.920656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:39.920726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:39.920781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:39.920789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:39.920863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:39.920928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:39.921001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:39.921070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:39.921115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:39.921122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:39.921193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:39.921258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:39.922515Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:40:39.922542Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:40:39.922575Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3380 reason: error at write: Disconnected sessionId: src_id|16f94445-ecc05a0a-d9a947bd-2f077258_0
2025-10-10T14:40:39.922793Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3380 sessionId: src_id|16f94445-ecc05a0a-d9a947bd-2f077258_0 is DEAD
2025-10-10T14:40:39.922801Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 78 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559603031276231041:5396]
2025-10-10T14:40:39.922817Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:39.922953Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|16f94445-ecc05a0a-d9a947bd-2f077258_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:40:39.922964Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|16f94445-ecc05a0a-d9a947bd-2f077258_0] Write session will restart in 0.005652s
2025-10-10T14:40:39.922990Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|16f94445-ecc05a0a-d9a947bd-2f077258_0] Write session: Do CDS request
2025-10-10T14:40:39.922996Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|16f94445-ecc05a0a-d9a947bd-2f077258_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:39.921326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:39.921423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:39.921465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:39.921468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:39.921549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:39.921611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:39.921673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:39.921746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:39.921789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:39.921792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:39.921863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:39.921924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:39.921987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:39.922050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:39.922095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:39.922098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:39.922169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603031276231041:5396], now have 1 active actors on pipe
2025-10-10T14:40:39.922649Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:39.930361Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|16f94445-ecc05a0a-d9a947bd-2f077258_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:39.930761Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:39.930778Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3381
2025-10-10T14:40:39.930950Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3381 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:39.931005Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3381 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:39.931011Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3381 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:39.931016Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:39.931578Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3381 sessionId:  describe result for acl check
2025-10-10T14:40:39.931617Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:39.931619Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:39.931621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:39.931627Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559603031276231092:6523] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:39.932205Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559603031276231092:6523] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:39.935147Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559603031276231092:6523] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:39.942267Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559603031276231092:6523] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:39.942286Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559603031276231092:6523] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:39.942290Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559603031276231092:6523] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:39.942300Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3381 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:39.951353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:39.956766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:39.957066Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:39.957078Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:39.957092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:39.957159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:39.957207Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559603030493977141:13413]
2025-10-10T14:40:39.957901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:39.958275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:39.958350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:39.958736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:39.958817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:39.958824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:39.958826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:39.958827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:39.958829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:39.958831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:39.958832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:39.958834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:39.958836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:39.958837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:39.958838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:39.958840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:39.958842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:39.958848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:39.958864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:39.958868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:39.958873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:39.958877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:39.958882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:39.958886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:39.958890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:39.958895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:39.958901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:39.958905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:39.958909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:39.958914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:39.958925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:39.958934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:39.958942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:39.958947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:39.958953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:39.958959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:39.958964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:39.958986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:39.958992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:39.959002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:39.959007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:39.959013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:39.959023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:39.959030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:39.959040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:39.959046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:39.959056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:39.959062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:39.959066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:39.959071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:39.959076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:39.959088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:39.959093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:39.959103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:39.959109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:39.959119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:39.959163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:39.961898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:39.962536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:39.962551Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:39.962554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:39.962558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:39.962565Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3380 [2:7559603030493977141:13413]
2025-10-10T14:40:39.962580Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:39.962599Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:39.962602Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:39.962606Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:39.962608Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:39.962628Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:39.962642Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:39.962655Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:39.962732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:39.962742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:39.962744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:39.962748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:39.962822Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:39.962831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:39.962843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:39.962856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:39.962882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:39.962907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603031276231213:6523], now have 1 active actors on pipe
2025-10-10T14:40:39.962911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603031276231075:2438], now have 1 active actors on pipe
2025-10-10T14:40:39.962920Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559603030493977135:13413]
2025-10-10T14:40:39.962923Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559603030493977135:13413]
2025-10-10T14:40:39.962925Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559603030493977135:13413]
2025-10-10T14:40:39.962941Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:39.962954Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:39.962957Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:39.962958Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:39.962959Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:39.962975Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:39.962979Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:39.963013Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559603030493977135:13413]
2025-10-10T14:40:39.963029Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:39.963019Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3380
2025-10-10T14:40:39.963051Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:39.963363Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3380
2025-10-10T14:40:39.963431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:39.963444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:39.963488Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2392bf3e-deda3bd4-693059f4-60816a26_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:39.963502Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:39.963507Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:39.963510Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:39.963523Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:39.963539Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:39.963569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:39.963969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:39.963990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:39.964013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:39.964187Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3381 partition: 0 MaxSeqNo: 40 sessionId: src_id|2392bf3e-deda3bd4-693059f4-60816a26_0
2025-10-10T14:40:39.964649Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|16f94445-ecc05a0a-d9a947bd-2f077258_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|2392bf3e-deda3bd4-693059f4-60816a26_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:39.967431Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2392bf3e-deda3bd4-693059f4-60816a26_0] Write session: try to update token
2025-10-10T14:40:39.967450Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2392bf3e-deda3bd4-693059f4-60816a26_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:39.975376Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:40:39.975400Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:39.975411Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559603030493977135:13413]
2025-10-10T14:40:39.975462Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:40:39.975642Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:40:39.975780Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:39.975915Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:39.976063Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:39.976251Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:40:39.976292Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:40:39.977142Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:40:39.992479Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3381 sessionId: src_id|2392bf3e-deda3bd4-693059f4-60816a26_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:39.995307Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:39.999770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:39.999806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:39.999835Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:39.999838Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:39.999842Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:39.999845Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:39.999855Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559603030493977135:13413]
2025-10-10T14:40:39.999859Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559603030493977135:13413]
2025-10-10T14:40:39.999864Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559603030493977135:13413]
2025-10-10T14:40:39.999925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:39.999925Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:39.999932Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:39.999937Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:39.999938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:39.999941Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:40.000091Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:40.022698Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559603035571198610:5396]
2025-10-10T14:40:40.023079Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 pipe creation result: OK TabletId: 72075186224037892 Generation: 3380, pipe: [1:7559603035571198610:5396]
2025-10-10T14:40:40.127522Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:40.127965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:40:40.128005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603035571198610:5396], now have 1 active actors on pipe
2025-10-10T14:40:40.128883Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2392bf3e-deda3bd4-693059f4-60816a26_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:40:40.128897Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2392bf3e-deda3bd4-693059f4-60816a26_0] Write session will restart in 0.005585s
2025-10-10T14:40:40.128933Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2392bf3e-deda3bd4-693059f4-60816a26_0] Write session: Do CDS request
2025-10-10T14:40:40.128202Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:40:40.128314Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:40:40.128318Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:40:40.128435Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3381 reason: error at write: Disconnected sessionId: src_id|2392bf3e-deda3bd4-693059f4-60816a26_0
2025-10-10T14:40:40.128636Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3381 sessionId: src_id|2392bf3e-deda3bd4-693059f4-60816a26_0 is DEAD
2025-10-10T14:40:40.128845Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 79 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559603035571198610:5396]
2025-10-10T14:40:40.128872Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:40.128940Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2392bf3e-deda3bd4-693059f4-60816a26_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:40.135919Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2392bf3e-deda3bd4-693059f4-60816a26_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:40.136010Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:40.136028Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3382
2025-10-10T14:40:40.136207Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3382 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:40.136247Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3382 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:40.136258Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3382 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:40.136263Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:40.136740Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3382 sessionId:  describe result for acl check
2025-10-10T14:40:40.136779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:40.136781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:40.136783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:40.136789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559603035571198631:6549] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:40.137354Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559603035571198631:6549] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:40.141268Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559603035571198631:6549] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:40.146211Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559603035571198631:6549] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:40.146235Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559603035571198631:6549] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:40.146240Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559603035571198631:6549] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:40.146250Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3382 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:40.147975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:40.150649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:40.150932Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:40.150947Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:40.150961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:40.151040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:40.151090Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559603034788944662:13415]
2025-10-10T14:40:40.151748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:40.152094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:40.152161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:40.152538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:40.152625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:40.152632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:40.152634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:40.152635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:40.152636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:40.152638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:40.152640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:40.152641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:40.152642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:40.152644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:40.152645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:40.152646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:40.152647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:40.152655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:40.152670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:40.152675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:40.152680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:40.152684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:40.152689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:40.152693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:40.152698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:40.152702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:40.152706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:40.152711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:40.152722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:40.152726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:40.152738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:40.152753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:40.152765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:40.152771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:40.152781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:40.152787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:40.152793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:40.152798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:40.152804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:40.152809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:40.152814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:40.152820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:40.152825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:40.152836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:40.152842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:40.152853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:40.152859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:40.152868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:40.152873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:40.152883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:40.152888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:40.152898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:40.152902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:40.152907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:40.152912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:40.152917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:40.152958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:40.156839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:40.157599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:40.157613Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:40.157616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:40.157620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:40.157628Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3381 [2:7559603034788944662:13415]
2025-10-10T14:40:40.157643Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:40.157664Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:40.157667Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:40.157671Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:40.157673Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:40.157693Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:40.157701Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:40.157717Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:40.157805Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:40.157813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:40.157816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:40.157819Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:40.158117Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3381
2025-10-10T14:40:40.158128Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3381
2025-10-10T14:40:40.157896Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:40.157907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:40.157921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:40.157931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:40.157947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:40.157969Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559603034788944657:13415]
2025-10-10T14:40:40.157972Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559603034788944657:13415]
2025-10-10T14:40:40.157974Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559603034788944657:13415]
2025-10-10T14:40:40.157983Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:40.158000Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:40.158007Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:40.158011Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:40.158013Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:40.158017Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:40.158020Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:40.158032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603035571198827:6549], now have 1 active actors on pipe
2025-10-10T14:40:40.158037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603035571198613:2438], now have 1 active actors on pipe
2025-10-10T14:40:40.158079Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559603034788944657:13415]
2025-10-10T14:40:40.158090Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:40.158123Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:40.158327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:40.158343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:40.158380Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|65167b86-fb42877a-584c9bb9-4f7fef63_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:40.158395Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:40.158401Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:40.158404Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:40.158418Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:40.158436Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:40.158458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:40.158687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:40.158699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:40.158717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:40.158831Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3382 partition: 0 MaxSeqNo: 40 sessionId: src_id|65167b86-fb42877a-584c9bb9-4f7fef63_0
2025-10-10T14:40:40.159278Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2392bf3e-deda3bd4-693059f4-60816a26_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|65167b86-fb42877a-584c9bb9-4f7fef63_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:40.162228Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|65167b86-fb42877a-584c9bb9-4f7fef63_0] Write session: try to update token
2025-10-10T14:40:40.162251Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|65167b86-fb42877a-584c9bb9-4f7fef63_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:40.170983Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:40:40.171008Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:40.171020Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559603034788944657:13415]
2025-10-10T14:40:40.171075Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:40:40.171274Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:40:40.171436Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:40.171593Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:40.171742Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:40.171999Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:40:40.172046Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:40:40.172197Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:40:40.191842Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:40.191868Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:40.191872Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:40.191874Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:40.191887Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559603034788944657:13415]
2025-10-10T14:40:40.191892Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559603034788944657:13415]
2025-10-10T14:40:40.191896Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559603034788944657:13415]
2025-10-10T14:40:40.191962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:40.191971Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:40.191974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:40.192038Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:40.192045Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:40.192052Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:40.192125Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:40.192068Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3382 sessionId: src_id|65167b86-fb42877a-584c9bb9-4f7fef63_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:40.194768Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:40.229119Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559603035571198842:5396]
2025-10-10T14:40:40.229460Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 pipe creation result: OK TabletId: 72075186224037892 Generation: 3381, pipe: [1:7559603035571198842:5396]
2025-10-10T14:40:40.313964Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:40.314400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:40.314422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:40.314451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603035571198842:5396], now have 1 active actors on pipe
2025-10-10T14:40:40.314765Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:40:40.314780Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:40:40.314781Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:40.314833Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 80 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559603035571198842:5396]
2025-10-10T14:40:40.314865Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3382 reason: error at write: Disconnected sessionId: src_id|65167b86-fb42877a-584c9bb9-4f7fef63_0
2025-10-10T14:40:40.314892Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:40.315128Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3382 sessionId: src_id|65167b86-fb42877a-584c9bb9-4f7fef63_0 is DEAD
2025-10-10T14:40:40.315300Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65167b86-fb42877a-584c9bb9-4f7fef63_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:40:40.315311Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65167b86-fb42877a-584c9bb9-4f7fef63_0] Write session will restart in 0.007930s
2025-10-10T14:40:40.315336Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65167b86-fb42877a-584c9bb9-4f7fef63_0] Write session: Do CDS request
2025-10-10T14:40:40.315347Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65167b86-fb42877a-584c9bb9-4f7fef63_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:40.324903Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|65167b86-fb42877a-584c9bb9-4f7fef63_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:40.325051Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:40.325071Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3383
2025-10-10T14:40:40.325231Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3383 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:40.325279Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3383 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:40.325291Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3383 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:40.325295Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:40.326053Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3383 sessionId:  describe result for acl check
2025-10-10T14:40:40.326092Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:40.326094Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:40.326096Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:40.326103Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559603035571198902:6572] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:40.326741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559603035571198902:6572] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:40.330195Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559603035571198902:6572] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:40.333475Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559603035571198902:6572] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:40.333492Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559603035571198902:6572] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:40.333496Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559603035571198902:6572] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:40.333506Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3383 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:40.334771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:40.337921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:40.338281Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:40.338298Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:40.338315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:40.338390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:40.338454Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559603034788944890:13417]
2025-10-10T14:40:40.339251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:40.339632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:40.339685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:40.340052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:40.340110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:40.340116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:40.340118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:40.340119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:40.340120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:40.340122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:40.340123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:40.340124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:40.340126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:40.340127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:40.340128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:40.340129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:40.340131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:40.340137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:40.340151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:40.340155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:40.340160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:40.340164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:40.340168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:40.340172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:40.340176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:40.340180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:40.340185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:40.340189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:40.340193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:40.340197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:40.340205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:40.340215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:40.340222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:40.340230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:40.340236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:40.340242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:40.340247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:40.340253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:40.340258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:40.340264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:40.340268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:40.340274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:40.340279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:40.340284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:40.340289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:40.340294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:40.340299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:40.340304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:40.340309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:40.340322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:40.340327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:40.340332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:40.340337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:40.340342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:40.340347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:40.340353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:40.340395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:40.343237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:40.343591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:40.343603Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:40.343606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:40.343611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:40.343618Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3382 [2:7559603034788944890:13417]
2025-10-10T14:40:40.343633Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:40.343652Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:40.343661Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:40.343665Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:40.343668Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:40.343684Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:40.343697Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:40.343705Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:40.343770Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:40.343778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:40.343780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:40.343783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:40.343858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:40.343865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:40.343881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:40.343898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:40.343929Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:40.343975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603035571199059:6572], now have 1 active actors on pipe
2025-10-10T14:40:40.343984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603035571198844:2438], now have 1 active actors on pipe
2025-10-10T14:40:40.343991Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559603034788944885:13417]
2025-10-10T14:40:40.343994Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559603034788944885:13417]
2025-10-10T14:40:40.343996Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559603034788944885:13417]
2025-10-10T14:40:40.344009Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:40.344026Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:40.344038Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:40.344041Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:40.344044Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:40.344049Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:40.344053Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:40.344081Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559603034788944885:13417]
2025-10-10T14:40:40.344093Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:40.344099Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:40.344118Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3382
2025-10-10T14:40:40.344154Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3382
2025-10-10T14:40:40.344216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:40.344229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:40.344269Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|82d46113-93c0d7ce-2eb1c648-29989f72_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:40.344289Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:40.344299Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:40.344301Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:40.344315Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:40.344332Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:40.344354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:40.344570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:40.344579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:40.344594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:40.344714Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3383 partition: 0 MaxSeqNo: 40 sessionId: src_id|82d46113-93c0d7ce-2eb1c648-29989f72_0
2025-10-10T14:40:40.345152Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65167b86-fb42877a-584c9bb9-4f7fef63_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|82d46113-93c0d7ce-2eb1c648-29989f72_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:40.348052Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|82d46113-93c0d7ce-2eb1c648-29989f72_0] Write session: try to update token
2025-10-10T14:40:40.348073Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|82d46113-93c0d7ce-2eb1c648-29989f72_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:40.368720Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:40.368744Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:40.368748Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:40.368750Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:40.368760Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559603034788944885:13417]
2025-10-10T14:40:40.368766Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559603034788944885:13417]
2025-10-10T14:40:40.368770Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559603034788944885:13417]
2025-10-10T14:40:40.368819Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:40.368827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:40.368829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:40.368825Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:40.368844Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:40.368849Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:40.368979Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:40.380118Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3383 sessionId: src_id|82d46113-93c0d7ce-2eb1c648-29989f72_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:40.382820Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:40.414947Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559603035571199074:5396]
2025-10-10T14:40:40.415370Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 pipe creation result: OK TabletId: 72075186224037892 Generation: 3382, pipe: [1:7559603035571199074:5396]
2025-10-10T14:40:40.490044Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:40.490599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:40.490621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:40.490675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603035571199074:5396], now have 1 active actors on pipe
2025-10-10T14:40:40.490949Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:40.493425Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:40.493436Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 81 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559603035571199074:5396]
2025-10-10T14:40:40.493475Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:40:40.493575Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3383 reason: status is not ok: tablet will be restarted right now sessionId: src_id|82d46113-93c0d7ce-2eb1c648-29989f72_0
2025-10-10T14:40:40.493820Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3383 sessionId: src_id|82d46113-93c0d7ce-2eb1c648-29989f72_0 is DEAD
2025-10-10T14:40:40.494009Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82d46113-93c0d7ce-2eb1c648-29989f72_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:40:40.494022Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82d46113-93c0d7ce-2eb1c648-29989f72_0] Write session will restart in 0.007381s
2025-10-10T14:40:40.494050Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82d46113-93c0d7ce-2eb1c648-29989f72_0] Write session: Do CDS request
2025-10-10T14:40:40.494056Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82d46113-93c0d7ce-2eb1c648-29989f72_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:40.505826Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|82d46113-93c0d7ce-2eb1c648-29989f72_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:40.505932Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:40.505949Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3384
2025-10-10T14:40:40.506086Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3384 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:40.506134Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3384 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:40.506144Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3384 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:40.506148Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:40.506550Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3384 sessionId:  describe result for acl check
2025-10-10T14:40:40.506588Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:40.506596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:40.506598Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:40.506604Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559603035571199091:6631] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:40.507194Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559603035571199091:6631] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:40.512696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559603035571199091:6631] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:40.517000Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559603035571199091:6631] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:40.517019Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559603035571199091:6631] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:40.517022Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559603035571199091:6631] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:40.517031Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3384 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:40.523849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:40.528009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:40.528268Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:40.528274Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:40.528287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:40.528350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:40.528615Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559603034788945119:13420]
2025-10-10T14:40:40.529271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:40.529990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:40.530071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:40.530431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:40.530492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:40.530494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:40.530495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:40.530497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:40.530498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:40.530500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:40.530501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:40.530502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:40.530504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:40.530505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:40.530507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:40.530508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:40.530510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:40.530519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:40.530533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:40.530537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:40.530542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:40.530546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:40.530551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:40.530555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:40.530560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:40.530564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:40.530572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:40.530576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:40.530580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:40.530584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:40.530594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:40.530603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:40.530612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:40.530618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:40.530624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:40.530629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:40.530635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:40.530641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:40.530647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:40.530653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:40.530659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:40.530665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:40.530670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:40.530676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:40.530680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:40.530686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:40.530692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:40.530698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:40.530703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:40.530709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:40.530714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:40.530720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:40.530725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:40.530731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:40.530736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:40.530742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:40.530790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:40.533758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:40.534160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:40.534178Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:40.534181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:40.534186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:40.534193Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3383 [2:7559603034788945119:13420]
2025-10-10T14:40:40.534208Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:40.534229Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:40.534237Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:40.534241Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:40.534243Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:40.534263Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:40.534277Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:40.534290Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:40.534362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:40.534370Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:40.534373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:40.534375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:40.534447Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:40.534454Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:40.534473Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:40.534488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:40.534510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:40.534536Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559603034788945114:13420]
2025-10-10T14:40:40.534543Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559603034788945114:13420]
2025-10-10T14:40:40.534545Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559603034788945114:13420]
2025-10-10T14:40:40.534563Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:40.534583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603035571199218:6631], now have 1 active actors on pipe
2025-10-10T14:40:40.534582Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:40.534586Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:40.534588Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:40.534591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603035571199077:2438], now have 1 active actors on pipe
2025-10-10T14:40:40.534601Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:40.534616Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:40.534619Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:40.534741Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3383
2025-10-10T14:40:40.534792Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3383
2025-10-10T14:40:40.534651Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559603034788945114:13420]
2025-10-10T14:40:40.534664Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:40.534701Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:40.534859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:40.534866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:40.534904Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d831e2f6-2e9fc337-30454151-f689d20e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:40.534920Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:40.534929Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:40.534932Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:40.534943Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:40.534959Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:40.534982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:40.535165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:40.535179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:40.535200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:40.535326Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3384 partition: 0 MaxSeqNo: 40 sessionId: src_id|d831e2f6-2e9fc337-30454151-f689d20e_0
2025-10-10T14:40:40.535810Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82d46113-93c0d7ce-2eb1c648-29989f72_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|d831e2f6-2e9fc337-30454151-f689d20e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:40.538693Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d831e2f6-2e9fc337-30454151-f689d20e_0] Write session: try to update token
2025-10-10T14:40:40.538710Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d831e2f6-2e9fc337-30454151-f689d20e_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:40.556225Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:40.556249Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:40.556253Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:40.556256Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:40.556267Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559603034788945114:13420]
2025-10-10T14:40:40.556273Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559603034788945114:13420]
2025-10-10T14:40:40.556278Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559603034788945114:13420]
2025-10-10T14:40:40.556334Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:40.556343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:40.556346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:40.556350Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:40.556358Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:40.556363Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:40.556493Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:40.560386Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3384 sessionId: src_id|d831e2f6-2e9fc337-30454151-f689d20e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:40.563054Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:40.593639Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559603035571199306:5396]
2025-10-10T14:40:40.594153Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 pipe creation result: OK TabletId: 72075186224037892 Generation: 3383, pipe: [1:7559603035571199306:5396]
2025-10-10T14:40:40.680018Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:40.680440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:40.680460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:40.680509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603035571199306:5396], now have 1 active actors on pipe
2025-10-10T14:40:40.680771Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:40.681351Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d831e2f6-2e9fc337-30454151-f689d20e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:40:40.681361Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d831e2f6-2e9fc337-30454151-f689d20e_0] Write session will restart in 0.005157s
2025-10-10T14:40:40.680816Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 82 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559603035571199306:5396]
2025-10-10T14:40:40.681387Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d831e2f6-2e9fc337-30454151-f689d20e_0] Write session: Do CDS request
2025-10-10T14:40:40.681395Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d831e2f6-2e9fc337-30454151-f689d20e_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:40.680840Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:40:40.680844Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:40:40.680854Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:40.680920Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3384 reason: error at write: Disconnected sessionId: src_id|d831e2f6-2e9fc337-30454151-f689d20e_0
2025-10-10T14:40:40.681176Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3384 sessionId: src_id|d831e2f6-2e9fc337-30454151-f689d20e_0 is DEAD
2025-10-10T14:40:40.687873Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d831e2f6-2e9fc337-30454151-f689d20e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:40.687973Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:40.687998Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3385
2025-10-10T14:40:40.688149Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3385 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:40.688186Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3385 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:40.688192Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3385 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:40.688196Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:40.688753Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3385 sessionId:  describe result for acl check
2025-10-10T14:40:40.688794Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:40.688796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:40.688798Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:40.688805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559603035571199323:6642] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:40.689411Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559603035571199323:6642] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:40.693306Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559603035571199323:6642] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:40.697047Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559603035571199323:6642] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:40.697064Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559603035571199323:6642] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:40.697068Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559603035571199323:6642] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:40.697078Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3385 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:40.700448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:40.703083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:40.703327Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:40.703341Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:40.703353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:40.703412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:40.703464Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559603034788945347:13422]
2025-10-10T14:40:40.704165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:40.704531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:40.704582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:40.704946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:40.705017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:40.705025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:40.705026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:40.705027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:40.705029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:40.705031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:40.705032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:40.705034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:40.705035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:40.705037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:40.705038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:40.705039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:40.705040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:40.705047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:40.705060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:40.705064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:40.705068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:40.705071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:40.705075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:40.705079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:40.705083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:40.705087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:40.705092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:40.705095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:40.705099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:40.705103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:40.705111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:40.705120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:40.705127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:40.705132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:40.705137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:40.705142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:40.705146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:40.705152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:40.705156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:40.705162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:40.705173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:40.705178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:40.705183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:40.705189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:40.705194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:40.705199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:40.705204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:40.705210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:40.705214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:40.705225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:40.705230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:40.705237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:40.705241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:40.705246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:40.705251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:40.705257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:40.705321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:40.707878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:40.708656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:40.708669Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:40.708672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:40.708677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:40.708683Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3384 [2:7559603034788945347:13422]
2025-10-10T14:40:40.708700Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:40.708722Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:40.708730Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:40.708734Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:40.708737Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:40.708754Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:40.708768Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:40.708778Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:40.708839Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:40.708846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:40.708848Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:40.708851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:40.708925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:40.708934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:40.708945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:40.708958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:40.708976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:40.709000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603035571199308:2438], now have 1 active actors on pipe
2025-10-10T14:40:40.709005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603035571199490:6642], now have 1 active actors on pipe
2025-10-10T14:40:40.709084Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3384
2025-10-10T14:40:40.709131Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3384
2025-10-10T14:40:40.709013Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559603034788945342:13422]
2025-10-10T14:40:40.709020Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559603034788945342:13422]
2025-10-10T14:40:40.709023Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559603034788945342:13422]
2025-10-10T14:40:40.709037Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:40.709050Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:40.709052Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:40.709053Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:40.709055Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:40.709069Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:40.709074Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:40.709102Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559603034788945342:13422]
2025-10-10T14:40:40.709109Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:40.709111Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:40.709144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:40.709149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:40.709187Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|89c4e4e7-3ddcfa45-e96f7a1e-f606bdb6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:40.709195Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:40.709199Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:40.709202Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:40.709214Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:40.709225Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:40.709242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:40.709500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:40.709512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:40.709530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:40.709625Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3385 partition: 0 MaxSeqNo: 40 sessionId: src_id|89c4e4e7-3ddcfa45-e96f7a1e-f606bdb6_0
2025-10-10T14:40:40.713571Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d831e2f6-2e9fc337-30454151-f689d20e_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|89c4e4e7-3ddcfa45-e96f7a1e-f606bdb6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:40.716392Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|89c4e4e7-3ddcfa45-e96f7a1e-f606bdb6_0] Write session: try to update token
2025-10-10T14:40:40.716434Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|89c4e4e7-3ddcfa45-e96f7a1e-f606bdb6_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:40.729564Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:40.729587Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:40.729592Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:40.729594Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:40.729605Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559603034788945342:13422]
2025-10-10T14:40:40.729609Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559603034788945342:13422]
2025-10-10T14:40:40.729613Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559603034788945342:13422]
2025-10-10T14:40:40.729667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:40.729665Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:40.729673Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:40.729677Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:40.729680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:40.729683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:40.729823Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:40.740100Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3385 sessionId: src_id|89c4e4e7-3ddcfa45-e96f7a1e-f606bdb6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:40.743017Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:40.781022Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559603035571199540:5396]
2025-10-10T14:40:40.785490Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 pipe creation result: OK TabletId: 72075186224037892 Generation: 3384, pipe: [1:7559603035571199540:5396]
2025-10-10T14:40:40.849249Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:40.849758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:40.849777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:40.849803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603035571199540:5396], now have 1 active actors on pipe
2025-10-10T14:40:40.850043Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:40.850441Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 83 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559603035571199540:5396]
2025-10-10T14:40:40.850487Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:40.850529Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:40:40.850628Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3385 reason: status is not ok: tablet will be restarted right now sessionId: src_id|89c4e4e7-3ddcfa45-e96f7a1e-f606bdb6_0
2025-10-10T14:40:40.850874Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3385 sessionId: src_id|89c4e4e7-3ddcfa45-e96f7a1e-f606bdb6_0 is DEAD
2025-10-10T14:40:40.851041Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89c4e4e7-3ddcfa45-e96f7a1e-f606bdb6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:40:40.851049Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89c4e4e7-3ddcfa45-e96f7a1e-f606bdb6_0] Write session will restart in 0.007769s
2025-10-10T14:40:40.851076Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89c4e4e7-3ddcfa45-e96f7a1e-f606bdb6_0] Write session: Do CDS request
2025-10-10T14:40:40.851084Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89c4e4e7-3ddcfa45-e96f7a1e-f606bdb6_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:40.861887Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|89c4e4e7-3ddcfa45-e96f7a1e-f606bdb6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:40.862041Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:40.862061Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3386
2025-10-10T14:40:40.862262Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3386 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:40.862309Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3386 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:40.862322Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3386 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:40.862327Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:40.862844Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3386 sessionId:  describe result for acl check
2025-10-10T14:40:40.862885Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:40.862892Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:40.862894Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:40.862901Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559603035571199585:6655] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:40.863517Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559603035571199585:6655] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:40.869538Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559603035571199585:6655] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:40.873235Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559603035571199585:6655] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:40.873255Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559603035571199585:6655] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:40.873258Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559603035571199585:6655] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:40.873268Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3386 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:40.874192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:40.876761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:40.876986Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:40.876992Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:40.877004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:40.877061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:40.877104Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559603034788945576:13424]
2025-10-10T14:40:40.877787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:40.878189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:40.878247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:40.878595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:40.878659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:40.878669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:40.878670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:40.878672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:40.878673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:40.878675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:40.878676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:40.878678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:40.878679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:40.878681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:40.878682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:40.878684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:40.878685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:40.878691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:40.878705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:40.878710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:40.878715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:40.878720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:40.878724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:40.878729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:40.878733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:40.878738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:40.878743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:40.878748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:40.878752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:40.878757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:40.878765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:40.878775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:40.878782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:40.878789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:40.878795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:40.878801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:40.878806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:40.878812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:40.878818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:40.878824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:40.878829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:40.878836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:40.878841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:40.878847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:40.878852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:40.878858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:40.878871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:40.878877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:40.878882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:40.878890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:40.878895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:40.878905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:40.878911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:40.878922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:40.878927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:40.878938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:40.878996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:40.881732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:40.882377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:40.882390Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:40.882392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:40.882397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:40.882404Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3385 [2:7559603034788945576:13424]
2025-10-10T14:40:40.882418Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:40.882453Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:40.882462Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:40.882466Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:40.882469Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:40.882487Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:40.882501Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:40.882510Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:40.882571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:40.882578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:40.882580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:40.882583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:40.882676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:40.882684Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:40.882697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:40.882711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:40.882734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:40.882763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603035571199763:6655], now have 1 active actors on pipe
2025-10-10T14:40:40.882773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603035571199541:2438], now have 1 active actors on pipe
2025-10-10T14:40:40.882781Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559603034788945571:13424]
2025-10-10T14:40:40.882783Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559603034788945571:13424]
2025-10-10T14:40:40.882786Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559603034788945571:13424]
2025-10-10T14:40:40.882801Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:40.882813Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:40.882818Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:40.882832Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:40.882834Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:40.882835Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:40.882839Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:40.882839Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3385
2025-10-10T14:40:40.882869Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559603034788945571:13424]
2025-10-10T14:40:40.882878Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:40.882842Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3385
2025-10-10T14:40:40.882889Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:40.882899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:40.882909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:40.882966Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|94060331-94b64b8a-16084f4e-ed6a21b1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:40.882979Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:40.882983Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:40.882986Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:40.882998Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:40.883013Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:40.883037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:40.883185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:40.883196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:40.883212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:40.883297Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3386 partition: 0 MaxSeqNo: 40 sessionId: src_id|94060331-94b64b8a-16084f4e-ed6a21b1_0
2025-10-10T14:40:40.883711Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89c4e4e7-3ddcfa45-e96f7a1e-f606bdb6_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|94060331-94b64b8a-16084f4e-ed6a21b1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:40.886709Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|94060331-94b64b8a-16084f4e-ed6a21b1_0] Write session: try to update token
2025-10-10T14:40:40.886730Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|94060331-94b64b8a-16084f4e-ed6a21b1_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:40.905735Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:40.905764Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:40.905768Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:40.905770Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:40.905781Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559603034788945571:13424]
2025-10-10T14:40:40.905785Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559603034788945571:13424]
2025-10-10T14:40:40.905790Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559603034788945571:13424]
2025-10-10T14:40:40.905848Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:40.905857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:40.905859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:40.905861Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:40.905868Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:40.905873Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:40.906019Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:40.915808Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3386 sessionId: src_id|94060331-94b64b8a-16084f4e-ed6a21b1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:40.918913Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:40.950015Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559603035571199796:5396]
2025-10-10T14:40:40.950711Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 pipe creation result: OK TabletId: 72075186224037892 Generation: 3385, pipe: [1:7559603035571199796:5396]
2025-10-10T14:40:41.086301Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:41.086938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:41.086957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:41.086981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603035571199796:5396], now have 1 active actors on pipe
2025-10-10T14:40:41.087285Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:41.088280Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94060331-94b64b8a-16084f4e-ed6a21b1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:40:41.088293Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94060331-94b64b8a-16084f4e-ed6a21b1_0] Write session will restart in 0.008766s
2025-10-10T14:40:41.088319Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94060331-94b64b8a-16084f4e-ed6a21b1_0] Write session: Do CDS request
2025-10-10T14:40:41.088325Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94060331-94b64b8a-16084f4e-ed6a21b1_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:41.087703Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:41.087771Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 84 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559603035571199796:5396]
2025-10-10T14:40:41.087790Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:40:41.087864Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3386 reason: status is not ok: tablet will be restarted right now sessionId: src_id|94060331-94b64b8a-16084f4e-ed6a21b1_0
2025-10-10T14:40:41.088104Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3386 sessionId: src_id|94060331-94b64b8a-16084f4e-ed6a21b1_0 is DEAD
2025-10-10T14:40:41.098041Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|94060331-94b64b8a-16084f4e-ed6a21b1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:41.098140Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:41.098157Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3387
2025-10-10T14:40:41.098288Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3387 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:41.098319Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3387 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:41.098325Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3387 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:41.098330Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:41.098779Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3387 sessionId:  describe result for acl check
2025-10-10T14:40:41.098807Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:41.098809Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:41.098811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:41.098818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559603039866167133:6717] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:41.099369Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559603039866167133:6717] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:41.106321Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559603039866167133:6717] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:41.113441Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559603039866167133:6717] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:41.113463Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559603039866167133:6717] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:41.113467Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559603039866167133:6717] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:41.113479Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3387 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:41.118802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:41.123968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:41.124268Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:41.124283Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:41.124296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:41.124359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:41.124428Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559603039083913152:13440]
2025-10-10T14:40:41.125103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:41.126416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:41.126487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:41.126839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:41.126905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:41.126909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:41.126910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:41.126911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:41.126913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:41.126915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:41.126916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:41.126918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:41.126920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:41.126921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:41.126922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:41.126924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:41.126925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:41.126932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:41.126946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:41.126951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:41.126955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:41.126959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:41.126963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:41.126968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:41.126974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:41.126978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:41.126983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:41.126989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:41.126993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:41.126998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:41.127006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:41.127019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:41.127032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:41.127038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:41.127045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:41.127055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:41.127060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:41.127072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:41.127077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:41.127083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:41.127088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:41.127093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:41.127101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:41.127106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:41.127110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:41.127116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:41.127127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:41.127133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:41.127137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:41.127143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:41.127147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:41.127153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:41.127157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:41.127163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:41.127173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:41.127178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:41.127221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:41.133099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:41.133755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:41.133772Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:41.133775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:41.133779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:41.133786Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3386 [2:7559603039083913152:13440]
2025-10-10T14:40:41.133802Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:41.133829Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:41.133840Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:41.133844Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:41.133846Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:41.133866Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:41.133873Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:41.133882Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:41.133950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:41.133957Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:41.133960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:41.133962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:41.134038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:41.134046Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:41.134061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:41.134079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:41.134101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:41.134201Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3386
2025-10-10T14:40:41.134253Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3386
2025-10-10T14:40:41.134132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603039866167118:2438], now have 1 active actors on pipe
2025-10-10T14:40:41.134146Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559603039083913147:13440]
2025-10-10T14:40:41.134148Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559603039083913147:13440]
2025-10-10T14:40:41.134150Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559603039083913147:13440]
2025-10-10T14:40:41.134159Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:41.134170Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:41.134173Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:41.134175Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:41.134175Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:41.134191Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:41.134194Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:41.134200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603039866167336:6717], now have 1 active actors on pipe
2025-10-10T14:40:41.134240Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559603039083913147:13440]
2025-10-10T14:40:41.134252Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:41.134337Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:41.138245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:41.138265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:41.138305Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c5d3b4ef-59d5d73f-9020da17-6a221143_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:41.138319Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:41.138325Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:41.138328Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:41.138348Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:41.138376Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:41.138403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:41.141454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:41.141477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:41.141525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:41.141706Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3387 partition: 0 MaxSeqNo: 40 sessionId: src_id|c5d3b4ef-59d5d73f-9020da17-6a221143_0
2025-10-10T14:40:41.145494Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94060331-94b64b8a-16084f4e-ed6a21b1_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|c5d3b4ef-59d5d73f-9020da17-6a221143_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:41.148435Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c5d3b4ef-59d5d73f-9020da17-6a221143_0] Write session: try to update token
2025-10-10T14:40:41.148459Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c5d3b4ef-59d5d73f-9020da17-6a221143_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:41.155254Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:41.155281Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:41.155285Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:41.155288Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:41.155301Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559603039083913147:13440]
2025-10-10T14:40:41.155307Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559603039083913147:13440]
2025-10-10T14:40:41.155311Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559603039083913147:13440]
2025-10-10T14:40:41.155368Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:41.155382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:41.155385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:41.155534Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:41.157514Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:41.157534Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:41.157539Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:41.173761Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3387 sessionId: src_id|c5d3b4ef-59d5d73f-9020da17-6a221143_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:41.176571Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:41.189059Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559603039866167351:5396]
2025-10-10T14:40:41.189372Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 pipe creation result: OK TabletId: 72075186224037892 Generation: 3386, pipe: [1:7559603039866167351:5396]
2025-10-10T14:40:41.276730Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:41.277650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:41.277667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:41.277692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603039866167351:5396], now have 1 active actors on pipe
2025-10-10T14:40:41.277965Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:41.278205Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:41.278251Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 85 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559603039866167351:5396]
2025-10-10T14:40:41.278270Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:40:41.278352Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3387 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c5d3b4ef-59d5d73f-9020da17-6a221143_0
2025-10-10T14:40:41.278531Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3387 sessionId: src_id|c5d3b4ef-59d5d73f-9020da17-6a221143_0 is DEAD
2025-10-10T14:40:41.285435Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5d3b4ef-59d5d73f-9020da17-6a221143_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:40:41.285452Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5d3b4ef-59d5d73f-9020da17-6a221143_0] Write session will restart in 0.005115s
2025-10-10T14:40:41.285481Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5d3b4ef-59d5d73f-9020da17-6a221143_0] Write session: Do CDS request
2025-10-10T14:40:41.285487Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5d3b4ef-59d5d73f-9020da17-6a221143_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:41.297852Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c5d3b4ef-59d5d73f-9020da17-6a221143_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:41.301862Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:41.301881Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3388
2025-10-10T14:40:41.302042Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3388 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:41.302078Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3388 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:41.302083Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3388 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:41.302088Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:41.302875Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3388 sessionId:  describe result for acl check
2025-10-10T14:40:41.302928Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:41.302933Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:41.302935Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:41.302942Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559603039866167370:6724] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:41.303555Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559603039866167370:6724] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:41.308749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559603039866167370:6724] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:41.318693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559603039866167370:6724] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:41.318711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559603039866167370:6724] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:41.318715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559603039866167370:6724] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:41.318726Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3388 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:41.334600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:41.338289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:41.338566Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:41.338579Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:41.338592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:41.338655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:41.338704Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559603039083913385:13442]
2025-10-10T14:40:41.339384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:41.339805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:41.339855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:41.340244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:41.340316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:41.340324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:41.340325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:41.340326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:41.340328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:41.340329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:41.340331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:41.340332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:41.340334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:41.340335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:41.340337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:41.340338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:41.340339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:41.340347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:41.340363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:41.340367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:41.340372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:41.340376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:41.340381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:41.340385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:41.340390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:41.340395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:41.340401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:41.340405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:41.340410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:41.340415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:41.340423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:41.340433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:41.340440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:41.340446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:41.340455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:41.340461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:41.340471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:41.340477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:41.340482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:41.340491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:41.340495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:41.340501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:41.340528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:41.340533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:41.340539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:41.340545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:41.340550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:41.340560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:41.340567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:41.340573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:41.340579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:41.340589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:41.340594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:41.340599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:41.340609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:41.340615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:41.340659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:41.343480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:41.344164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:41.344178Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:41.344182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:41.344186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:41.344194Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3387 [2:7559603039083913385:13442]
2025-10-10T14:40:41.344207Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:41.344225Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:41.344229Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:41.344232Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:41.344235Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:41.344251Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:41.344265Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:41.344273Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:41.344337Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:41.344345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:41.344347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:41.344350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:41.344418Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:41.344426Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:41.344439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:41.344453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:41.344477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:41.344621Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3387
2025-10-10T14:40:41.344651Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3387
2025-10-10T14:40:41.344501Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559603039083913380:13442]
2025-10-10T14:40:41.344509Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559603039083913380:13442]
2025-10-10T14:40:41.344511Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559603039083913380:13442]
2025-10-10T14:40:41.344524Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:41.344533Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:41.344536Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:41.344538Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:41.344540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603039866167466:6724], now have 1 active actors on pipe
2025-10-10T14:40:41.344544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603039866167354:2438], now have 1 active actors on pipe
2025-10-10T14:40:41.344551Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:41.344568Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:41.344571Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:41.344599Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559603039083913380:13442]
2025-10-10T14:40:41.344608Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:41.344620Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:41.344863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:41.344876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:41.344911Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|368fba4a-932d3b88-d44f275c-1bbf2857_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:41.344925Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:41.345082Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:41.345090Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:41.345106Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:41.345119Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:41.345135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:41.350397Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3388 partition: 0 MaxSeqNo: 40 sessionId: src_id|368fba4a-932d3b88-d44f275c-1bbf2857_0
2025-10-10T14:40:41.350899Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5d3b4ef-59d5d73f-9020da17-6a221143_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|368fba4a-932d3b88-d44f275c-1bbf2857_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:41.349647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:41.349674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:41.349706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:41.353640Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|368fba4a-932d3b88-d44f275c-1bbf2857_0] Write session: try to update token
2025-10-10T14:40:41.353660Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|368fba4a-932d3b88-d44f275c-1bbf2857_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:41.365831Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:41.365859Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:41.365864Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:41.365866Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:41.365878Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559603039083913380:13442]
2025-10-10T14:40:41.365884Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559603039083913380:13442]
2025-10-10T14:40:41.365889Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559603039083913380:13442]
2025-10-10T14:40:41.365948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:41.365957Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:41.365960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:41.366112Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:41.369789Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:41.369823Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:41.369828Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:41.378015Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559603039866167589:5396]
2025-10-10T14:40:41.378549Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 pipe creation result: OK TabletId: 72075186224037892 Generation: 3387, pipe: [1:7559603039866167589:5396]
2025-10-10T14:40:41.389694Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3388 sessionId: src_id|368fba4a-932d3b88-d44f275c-1bbf2857_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:41.392258Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:41.501461Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:41.501934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603039866167589:5396], now have 1 active actors on pipe
2025-10-10T14:40:41.501959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:41.501968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:41.502179Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:41.502513Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:40:41.502527Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:40:41.502590Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3388 reason: error at write: Disconnected sessionId: src_id|368fba4a-932d3b88-d44f275c-1bbf2857_0
2025-10-10T14:40:41.502790Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3388 sessionId: src_id|368fba4a-932d3b88-d44f275c-1bbf2857_0 is DEAD
2025-10-10T14:40:41.502929Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:41.502964Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 86 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559603039866167589:5396]
2025-10-10T14:40:41.505769Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|368fba4a-932d3b88-d44f275c-1bbf2857_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:40:41.505784Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|368fba4a-932d3b88-d44f275c-1bbf2857_0] Write session will restart in 0.008131s
2025-10-10T14:40:41.505812Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|368fba4a-932d3b88-d44f275c-1bbf2857_0] Write session: Do CDS request
2025-10-10T14:40:41.505821Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|368fba4a-932d3b88-d44f275c-1bbf2857_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:41.517970Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|368fba4a-932d3b88-d44f275c-1bbf2857_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:41.518657Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:41.518676Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3389
2025-10-10T14:40:41.518902Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3389 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:41.518951Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3389 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:41.518963Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3389 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:41.518968Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:41.519918Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3389 sessionId:  describe result for acl check
2025-10-10T14:40:41.519980Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:41.519987Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:41.519989Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:41.519996Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559603039866167638:6786] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:41.520592Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559603039866167638:6786] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:41.523169Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559603039866167638:6786] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:41.527206Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559603039866167638:6786] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:41.527225Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559603039866167638:6786] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:41.527230Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559603039866167638:6786] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:41.527252Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3389 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:41.531605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:41.534244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:41.534512Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:41.534530Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:41.534545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:41.534617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:41.534663Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559603039083913619:13445]
2025-10-10T14:40:41.535308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:41.535649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:41.535728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:41.536120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:41.536215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:41.536223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:41.536225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:41.536226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:41.536227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:41.536229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:41.536230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:41.536232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:41.536233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:41.536235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:41.536236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:41.536238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:41.536239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:41.536247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:41.536262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:41.536267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:41.536272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:41.536277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:41.536281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:41.536285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:41.536289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:41.536294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:41.536300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:41.536304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:41.536309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:41.536313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:41.536338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:41.536354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:41.536366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:41.536372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:41.536378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:41.536384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:41.536389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:41.536398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:41.536403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:41.536409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:41.536414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:41.536420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:41.536425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:41.536431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:41.536435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:41.536441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:41.536446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:41.536452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:41.536456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:41.536462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:41.536467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:41.536472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:41.536477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:41.536483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:41.536488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:41.536494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:41.536541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:41.539501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:41.540167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:41.540173Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:41.540176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:41.540181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:41.540188Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3388 [2:7559603039083913619:13445]
2025-10-10T14:40:41.540204Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:41.540227Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:41.540230Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:41.540234Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:41.540236Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:41.540255Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:41.540263Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:41.540272Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:41.540340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:41.540343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:41.540345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:41.540348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:41.540427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:41.540431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:41.540444Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:41.540457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:41.540475Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:41.540501Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559603039083913614:13445]
2025-10-10T14:40:41.540503Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559603039083913614:13445]
2025-10-10T14:40:41.540508Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559603039083913614:13445]
2025-10-10T14:40:41.540517Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:41.540528Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:41.540531Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:41.540532Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:41.540534Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:41.540547Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:41.540550Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:41.540561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603039866167594:2438], now have 1 active actors on pipe
2025-10-10T14:40:41.540565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603039866167783:6786], now have 1 active actors on pipe
2025-10-10T14:40:41.540600Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559603039083913614:13445]
2025-10-10T14:40:41.540608Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:41.540865Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:41.544173Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3388
2025-10-10T14:40:41.544230Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3388
2025-10-10T14:40:41.544425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:41.544451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:41.544491Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|136c8df0-33ac1b6c-66203f7f-694a274c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:41.544505Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:41.544511Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:41.544514Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:41.544538Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:41.544556Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:41.544580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:41.545081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:41.545089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:41.545108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:41.545241Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3389 partition: 0 MaxSeqNo: 40 sessionId: src_id|136c8df0-33ac1b6c-66203f7f-694a274c_0
2025-10-10T14:40:41.545719Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|368fba4a-932d3b88-d44f275c-1bbf2857_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|136c8df0-33ac1b6c-66203f7f-694a274c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:41.548509Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|136c8df0-33ac1b6c-66203f7f-694a274c_0] Write session: try to update token
2025-10-10T14:40:41.548529Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|136c8df0-33ac1b6c-66203f7f-694a274c_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:41.564516Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3389 sessionId: src_id|136c8df0-33ac1b6c-66203f7f-694a274c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:41.566778Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:41.566802Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:41.566805Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:41.566807Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:41.566818Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559603039083913614:13445]
2025-10-10T14:40:41.566823Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559603039083913614:13445]
2025-10-10T14:40:41.566827Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559603039083913614:13445]
2025-10-10T14:40:41.566880Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:41.566895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:41.566902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:41.567001Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:41.567031Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:41.567035Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:41.567047Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:41.567326Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:41.605399Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559603039866167830:5396]
2025-10-10T14:40:41.605707Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 pipe creation result: OK TabletId: 72075186224037892 Generation: 3388, pipe: [1:7559603039866167830:5396]
2025-10-10T14:40:41.685571Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:41.685977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:41.685996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:41.686048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603039866167830:5396], now have 1 active actors on pipe
2025-10-10T14:40:41.686654Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:41.686677Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:40:41.686681Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:40:41.686291Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:41.686723Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 87 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559603039866167830:5396]
2025-10-10T14:40:41.686757Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3389 reason: error at write: Disconnected sessionId: src_id|136c8df0-33ac1b6c-66203f7f-694a274c_0
2025-10-10T14:40:41.686987Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3389 sessionId: src_id|136c8df0-33ac1b6c-66203f7f-694a274c_0 is DEAD
2025-10-10T14:40:41.687149Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|136c8df0-33ac1b6c-66203f7f-694a274c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:40:41.687159Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|136c8df0-33ac1b6c-66203f7f-694a274c_0] Write session will restart in 0.007723s
2025-10-10T14:40:41.687184Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|136c8df0-33ac1b6c-66203f7f-694a274c_0] Write session: Do CDS request
2025-10-10T14:40:41.687191Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|136c8df0-33ac1b6c-66203f7f-694a274c_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:41.697160Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|136c8df0-33ac1b6c-66203f7f-694a274c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:41.697413Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:41.697430Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3390
2025-10-10T14:40:41.697604Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3390 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:41.697656Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3390 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:41.697662Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3390 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:41.697667Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:41.698416Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3390 sessionId:  describe result for acl check
2025-10-10T14:40:41.698466Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:41.698476Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:41.698479Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:41.698485Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559603039866167840:6789] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:41.699228Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559603039866167840:6789] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:41.701929Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559603039866167840:6789] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:41.705284Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559603039866167840:6789] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:41.705298Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559603039866167840:6789] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:41.705302Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559603039866167840:6789] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:41.705312Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3390 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:41.720901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:41.723543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:41.723791Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:41.723807Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:41.723821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:41.723882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:41.723938Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559603039083913852:13447]
2025-10-10T14:40:41.724613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:41.724927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:41.724979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:41.725306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:41.725391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:41.725399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:41.725401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:41.725402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:41.725403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:41.725405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:41.725406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:41.725408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:41.725409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:41.725410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:41.725412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:41.725413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:41.725414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:41.725420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:41.725434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:41.725438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:41.725443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:41.725447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:41.725452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:41.725456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:41.725461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:41.725465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:41.725470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:41.725474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:41.725479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:41.725483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:41.725492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:41.725502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:41.725509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:41.725515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:41.725522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:41.725527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:41.725533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:41.725538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:41.725543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:41.725548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:41.725554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:41.725560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:41.725565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:41.725571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:41.725578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:41.725586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:41.725591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:41.725595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:41.725599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:41.725605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:41.725609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:41.725615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:41.725619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:41.725624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:41.725628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:41.725634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:41.725675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:41.728311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:41.728883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:41.728896Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:41.728898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:41.728902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:41.728910Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3389 [2:7559603039083913852:13447]
2025-10-10T14:40:41.728924Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:41.728944Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:41.728947Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:41.728951Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:41.728959Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:41.728978Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:41.728990Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:41.728998Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:41.729066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:41.729074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:41.729076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:41.729078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:41.729151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:41.729158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:41.729171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:41.729188Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:41.729211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:41.729239Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559603039083913847:13447]
2025-10-10T14:40:41.729246Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559603039083913847:13447]
2025-10-10T14:40:41.729249Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559603039083913847:13447]
2025-10-10T14:40:41.729263Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:41.729287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603039866167831:2438], now have 1 active actors on pipe
2025-10-10T14:40:41.729298Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:41.729315Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:41.729322Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:41.729342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603039866167878:6789], now have 1 active actors on pipe
2025-10-10T14:40:41.729412Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3389
2025-10-10T14:40:41.729462Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3389
2025-10-10T14:40:41.729357Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:41.729370Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:41.729370Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559603039083913847:13447]
2025-10-10T14:40:41.729372Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:41.729374Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:41.729379Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:41.729670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:41.729682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:41.729712Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1ce3dbdd-7362ac92-34ac86bb-6370de18_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:41.729725Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:41.729731Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:41.729734Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:41.729746Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:41.729758Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:41.729774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:41.729996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:41.730007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:41.730032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:41.730274Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3390 partition: 0 MaxSeqNo: 40 sessionId: src_id|1ce3dbdd-7362ac92-34ac86bb-6370de18_0
2025-10-10T14:40:41.732604Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|136c8df0-33ac1b6c-66203f7f-694a274c_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|1ce3dbdd-7362ac92-34ac86bb-6370de18_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:41.735828Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1ce3dbdd-7362ac92-34ac86bb-6370de18_0] Write session: try to update token
2025-10-10T14:40:41.735851Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1ce3dbdd-7362ac92-34ac86bb-6370de18_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:41.757791Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:41.757815Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:41.757818Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:41.757821Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:41.757832Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559603039083913847:13447]
2025-10-10T14:40:41.757837Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559603039083913847:13447]
2025-10-10T14:40:41.757841Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559603039083913847:13447]
2025-10-10T14:40:41.757895Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:41.757903Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:41.757910Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:41.757911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:41.757914Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:41.757915Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:41.758058Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:41.773221Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3390 sessionId: src_id|1ce3dbdd-7362ac92-34ac86bb-6370de18_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:41.777505Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:41.789409Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559603039866168069:5396]
2025-10-10T14:40:41.789864Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 pipe creation result: OK TabletId: 72075186224037892 Generation: 3389, pipe: [1:7559603039866168069:5396]
2025-10-10T14:40:41.875464Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:41.875869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:41.875885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:41.875909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603039866168069:5396], now have 1 active actors on pipe
2025-10-10T14:40:41.876131Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:41.876353Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:41.876401Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:40:41.876484Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3390 reason: status is not ok: tablet will be restarted right now sessionId: src_id|1ce3dbdd-7362ac92-34ac86bb-6370de18_0
2025-10-10T14:40:41.876715Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3390 sessionId: src_id|1ce3dbdd-7362ac92-34ac86bb-6370de18_0 is DEAD
2025-10-10T14:40:41.876894Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 88 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559603039866168069:5396]
2025-10-10T14:40:41.877622Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ce3dbdd-7362ac92-34ac86bb-6370de18_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:40:41.877634Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ce3dbdd-7362ac92-34ac86bb-6370de18_0] Write session will restart in 0.008684s
2025-10-10T14:40:41.877658Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ce3dbdd-7362ac92-34ac86bb-6370de18_0] Write session: Do CDS request
2025-10-10T14:40:41.877664Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ce3dbdd-7362ac92-34ac86bb-6370de18_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:41.888013Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1ce3dbdd-7362ac92-34ac86bb-6370de18_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:41.888042Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:41.888061Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3391
2025-10-10T14:40:41.888321Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3391 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:41.888355Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3391 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:41.888361Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3391 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:41.888365Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:41.888900Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3391 sessionId:  describe result for acl check
2025-10-10T14:40:41.888934Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:41.888936Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:41.888938Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:41.888946Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559603039866168092:6843] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:41.889523Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559603039866168092:6843] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:41.895598Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559603039866168092:6843] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:41.902373Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559603039866168092:6843] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:41.902390Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559603039866168092:6843] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:41.902394Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559603039866168092:6843] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:41.902404Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3391 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:41.910211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:41.916267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:41.916576Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:41.916589Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:41.916603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:41.916672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:41.916723Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559603039083914098:13449]
2025-10-10T14:40:41.917425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:41.917832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:41.917883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:41.918220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:41.918297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:41.918308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:41.918309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:41.918310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:41.918312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:41.918314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:41.918316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:41.918317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:41.918319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:41.918320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:41.918322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:41.918324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:41.918325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:41.918332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:41.918348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:41.918352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:41.918356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:41.918361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:41.918366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:41.918370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:41.918375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:41.918379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:41.918384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:41.918389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:41.918393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:41.918398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:41.918407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:41.918417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:41.918430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:41.918436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:41.918442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:41.918453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:41.918458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:41.918463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:41.918468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:41.918474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:41.918479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:41.918491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:41.918496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:41.918508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:41.918512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:41.918518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:41.918526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:41.918532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:41.918538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:41.918549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:41.918554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:41.918565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:41.918570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:41.918576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:41.918586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:41.918592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:41.918636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:41.921398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:41.921999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:41.922015Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:41.922017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:41.922022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:41.922030Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3390 [2:7559603039083914098:13449]
2025-10-10T14:40:41.922046Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:41.922070Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:41.922078Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:41.922082Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:41.922085Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:41.922104Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:41.922117Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:41.922125Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:41.922189Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:41.922196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:41.922198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:41.922200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:41.922272Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:41.922280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:41.922293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:41.922312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:41.922336Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:41.922364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603039866168076:2438], now have 1 active actors on pipe
2025-10-10T14:40:41.922372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603039866168194:6843], now have 1 active actors on pipe
2025-10-10T14:40:41.922381Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559603039083914093:13449]
2025-10-10T14:40:41.922383Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559603039083914093:13449]
2025-10-10T14:40:41.922385Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559603039083914093:13449]
2025-10-10T14:40:41.922399Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:41.922414Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:41.922414Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:41.922418Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:41.922420Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:41.922437Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:41.922446Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:41.922436Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3390
2025-10-10T14:40:41.922472Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559603039083914093:13449]
2025-10-10T14:40:41.922447Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3390
2025-10-10T14:40:41.922484Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:41.922505Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:41.922506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:41.922512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:41.922562Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|136dd932-ab5c1377-cddc4356-c23ff6b7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:41.922576Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:41.922580Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:41.922584Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:41.922596Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:41.922626Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:41.922649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:41.922902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:41.922914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:41.922938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:41.923081Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3391 partition: 0 MaxSeqNo: 40 sessionId: src_id|136dd932-ab5c1377-cddc4356-c23ff6b7_0
2025-10-10T14:40:41.923561Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ce3dbdd-7362ac92-34ac86bb-6370de18_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|136dd932-ab5c1377-cddc4356-c23ff6b7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:41.926557Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|136dd932-ab5c1377-cddc4356-c23ff6b7_0] Write session: try to update token
2025-10-10T14:40:41.926580Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|136dd932-ab5c1377-cddc4356-c23ff6b7_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:41.942779Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:41.942799Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:41.942802Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:41.942805Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:41.942816Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559603039083914093:13449]
2025-10-10T14:40:41.942821Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559603039083914093:13449]
2025-10-10T14:40:41.942826Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559603039083914093:13449]
2025-10-10T14:40:41.942879Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:41.942882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:41.942887Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:41.942890Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:41.942892Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:41.942894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:41.943049Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:41.952426Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3391 sessionId: src_id|136dd932-ab5c1377-cddc4356-c23ff6b7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:41.955203Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:41.977050Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559603039866168319:5396]
2025-10-10T14:40:41.977476Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 pipe creation result: OK TabletId: 72075186224037892 Generation: 3390, pipe: [1:7559603039866168319:5396]
2025-10-10T14:40:42.086516Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:42.086850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:42.086867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:42.086893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603039866168319:5396], now have 1 active actors on pipe
2025-10-10T14:40:42.087510Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:42.088071Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 89 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559603039866168319:5396]
2025-10-10T14:40:42.088312Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:40:42.088410Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3391 reason: status is not ok: tablet will be restarted right now sessionId: src_id|136dd932-ab5c1377-cddc4356-c23ff6b7_0
2025-10-10T14:40:42.088445Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:42.088637Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3391 sessionId: src_id|136dd932-ab5c1377-cddc4356-c23ff6b7_0 is DEAD
2025-10-10T14:40:42.089552Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|136dd932-ab5c1377-cddc4356-c23ff6b7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:40:42.089564Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|136dd932-ab5c1377-cddc4356-c23ff6b7_0] Write session will restart in 0.007979s
2025-10-10T14:40:42.089589Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|136dd932-ab5c1377-cddc4356-c23ff6b7_0] Write session: Do CDS request
2025-10-10T14:40:42.089595Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|136dd932-ab5c1377-cddc4356-c23ff6b7_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:42.098912Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|136dd932-ab5c1377-cddc4356-c23ff6b7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:42.099269Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:42.099286Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3392
2025-10-10T14:40:42.099471Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3392 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:42.099508Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3392 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:42.099514Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3392 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:42.099518Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:42.099933Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3392 sessionId:  describe result for acl check
2025-10-10T14:40:42.099975Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:42.099976Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:42.099978Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:42.099985Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559603044161135672:6916] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:42.100594Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559603044161135672:6916] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:42.104841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559603044161135672:6916] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:42.109404Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559603044161135672:6916] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:42.109425Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559603044161135672:6916] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:42.109430Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559603044161135672:6916] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:42.109441Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3392 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:42.120428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:42.124317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:42.124572Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:42.124579Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:42.124592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:42.124654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:42.124697Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559603043378881666:13465]
2025-10-10T14:40:42.125417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:42.125757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:42.125811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:42.126171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:42.126236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:42.126242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:42.126244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:42.126245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:42.126247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:42.126248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:42.126249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:42.126251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:42.126252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:42.126253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:42.126255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:42.126256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:42.126258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:42.126265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:42.126280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:42.126285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:42.126290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:42.126294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:42.126299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:42.126304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:42.126309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:42.126313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:42.126318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:42.126323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:42.126328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:42.126332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:42.126341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:42.126350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:42.126359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:42.126368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:42.126378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:42.126383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:42.126388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:42.126399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:42.126404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:42.126411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:42.126416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:42.126423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:42.126430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:42.126445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:42.126450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:42.126459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:42.126464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:42.126469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:42.126474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:42.126480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:42.126485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:42.126491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:42.126496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:42.126501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:42.126506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:42.126517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:42.126563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:42.129121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:42.129899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:42.129911Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:42.129915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:42.129919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:42.129929Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3391 [2:7559603043378881666:13465]
2025-10-10T14:40:42.129944Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:42.129963Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:42.129972Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:42.129977Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:42.129979Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:42.129998Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:42.130011Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:42.130023Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:42.130090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:42.130098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:42.130100Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:42.130103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:42.130180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:42.130188Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:42.130203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:42.130222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:42.130247Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:42.130273Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559603043378881661:13465]
2025-10-10T14:40:42.130280Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559603043378881661:13465]
2025-10-10T14:40:42.130282Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559603043378881661:13465]
2025-10-10T14:40:42.130298Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:42.130320Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:42.130324Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:42.130328Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:42.130330Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:42.130339Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:42.130342Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:42.130371Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559603043378881661:13465]
2025-10-10T14:40:42.130374Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:42.130385Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:42.130393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603044161135757:6916], now have 1 active actors on pipe
2025-10-10T14:40:42.130403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603044161135656:2438], now have 1 active actors on pipe
2025-10-10T14:40:42.130853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:42.130864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:42.130903Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d61ea5e-1d96ed12-5ce525e2-e81b93ed_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:42.130913Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:42.130919Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:42.130922Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:42.130935Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:42.130949Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:42.130967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:42.131241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:42.131247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:42.131262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:42.131882Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|136dd932-ab5c1377-cddc4356-c23ff6b7_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|d61ea5e-1d96ed12-5ce525e2-e81b93ed_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:42.130643Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3391
2025-10-10T14:40:42.130677Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3391
2025-10-10T14:40:42.131419Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3392 partition: 0 MaxSeqNo: 40 sessionId: src_id|d61ea5e-1d96ed12-5ce525e2-e81b93ed_0
2025-10-10T14:40:42.134847Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d61ea5e-1d96ed12-5ce525e2-e81b93ed_0] Write session: try to update token
2025-10-10T14:40:42.134870Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d61ea5e-1d96ed12-5ce525e2-e81b93ed_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:42.152543Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:42.152567Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:42.152571Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:42.152574Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:42.152585Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559603043378881661:13465]
2025-10-10T14:40:42.152591Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559603043378881661:13465]
2025-10-10T14:40:42.152595Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559603043378881661:13465]
2025-10-10T14:40:42.152655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:42.152664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:42.152662Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:42.152670Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:42.152671Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:42.152675Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:42.152840Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:42.159862Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3392 sessionId: src_id|d61ea5e-1d96ed12-5ce525e2-e81b93ed_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:42.162789Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:42.187505Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559603044161135891:5396]
2025-10-10T14:40:42.188196Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 pipe creation result: OK TabletId: 72075186224037892 Generation: 3391, pipe: [1:7559603044161135891:5396]
2025-10-10T14:40:42.276712Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:42.277181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:42.277191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:42.277217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603044161135891:5396], now have 1 active actors on pipe
2025-10-10T14:40:42.277476Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:42.277996Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:40:42.278137Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3392 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d61ea5e-1d96ed12-5ce525e2-e81b93ed_0
2025-10-10T14:40:42.278356Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3392 sessionId: src_id|d61ea5e-1d96ed12-5ce525e2-e81b93ed_0 is DEAD
2025-10-10T14:40:42.278557Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 90 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559603044161135891:5396]
2025-10-10T14:40:42.278584Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:42.281682Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d61ea5e-1d96ed12-5ce525e2-e81b93ed_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:40:42.281695Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d61ea5e-1d96ed12-5ce525e2-e81b93ed_0] Write session will restart in 0.005639s
2025-10-10T14:40:42.281724Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d61ea5e-1d96ed12-5ce525e2-e81b93ed_0] Write session: Do CDS request
2025-10-10T14:40:42.281731Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d61ea5e-1d96ed12-5ce525e2-e81b93ed_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:42.288953Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d61ea5e-1d96ed12-5ce525e2-e81b93ed_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:42.289468Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:42.289487Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3393
2025-10-10T14:40:42.289641Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3393 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:42.289689Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3393 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:42.289709Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3393 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:42.289713Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:42.290223Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3393 sessionId:  describe result for acl check
2025-10-10T14:40:42.290265Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:42.290267Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:42.290269Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:42.290276Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559603044161135910:6940] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:42.290907Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559603044161135910:6940] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:42.294418Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559603044161135910:6940] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:42.306559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:42.309507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:42.309743Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:42.309757Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:42.309771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:42.309843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:42.309894Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559603043378881900:13467]
2025-10-10T14:40:42.309903Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559603044161135910:6940] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:42.309924Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559603044161135910:6940] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:42.309928Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559603044161135910:6940] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:42.309938Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3393 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:42.310569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:42.310926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:42.311000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:42.311346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:42.311511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:42.311520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:42.311521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:42.311522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:42.311524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:42.311525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:42.311526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:42.311527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:42.311529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:42.311530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:42.311531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:42.311533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:42.311534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:42.311541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:42.311555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:42.311560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:42.311565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:42.311570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:42.311575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:42.311579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:42.311583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:42.311587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:42.311592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:42.311597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:42.311601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:42.311606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:42.311616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:42.311625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:42.311639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:42.311650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:42.311655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:42.311665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:42.311670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:42.311677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:42.311686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:42.311692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:42.311695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:42.311701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:42.311712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:42.311717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:42.311721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:42.311727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:42.311731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:42.311737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:42.311741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:42.311746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:42.311750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:42.311754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:42.311758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:42.311763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:42.311767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:42.311777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:42.311818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:42.314388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:42.314726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:42.314739Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:42.314742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:42.314746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:42.314752Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3392 [2:7559603043378881900:13467]
2025-10-10T14:40:42.314766Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:42.314784Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:42.314792Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:42.314797Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:42.314799Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:42.314816Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:42.314828Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:42.314840Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:42.314903Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:42.314910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:42.314912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:42.314915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:42.314984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:42.314993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:42.315005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:42.315016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:42.315036Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:42.315079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603044161135894:2438], now have 1 active actors on pipe
2025-10-10T14:40:42.315088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603044161136122:6940], now have 1 active actors on pipe
2025-10-10T14:40:42.315134Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3392
2025-10-10T14:40:42.315154Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3392
2025-10-10T14:40:42.315175Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559603043378881895:13467]
2025-10-10T14:40:42.315183Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559603043378881895:13467]
2025-10-10T14:40:42.315185Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559603043378881895:13467]
2025-10-10T14:40:42.315205Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:42.315221Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:42.315224Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:42.315227Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:42.315228Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:42.315247Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:42.315255Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:42.315275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:42.315290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:42.315331Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559603043378881895:13467]
2025-10-10T14:40:42.315344Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:42.315356Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:42.315367Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|be5d82b6-46b81fc0-5959f178-c9d3340_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:42.315375Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:42.315385Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:42.315387Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:42.315400Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:42.315418Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:42.315464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:42.315764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:42.315774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:42.315795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:42.315907Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3393 partition: 0 MaxSeqNo: 40 sessionId: src_id|be5d82b6-46b81fc0-5959f178-c9d3340_0
2025-10-10T14:40:42.316403Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d61ea5e-1d96ed12-5ce525e2-e81b93ed_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|be5d82b6-46b81fc0-5959f178-c9d3340_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:42.319234Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|be5d82b6-46b81fc0-5959f178-c9d3340_0] Write session: try to update token
2025-10-10T14:40:42.319261Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|be5d82b6-46b81fc0-5959f178-c9d3340_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:42.335351Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:42.335372Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:42.335377Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:42.335380Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:42.335391Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559603043378881895:13467]
2025-10-10T14:40:42.335396Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559603043378881895:13467]
2025-10-10T14:40:42.335400Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559603043378881895:13467]
2025-10-10T14:40:42.335457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:42.335467Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:42.335470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:42.335473Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:42.335479Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:42.335484Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:42.335621Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:42.346425Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3393 sessionId: src_id|be5d82b6-46b81fc0-5959f178-c9d3340_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:42.349211Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:42.378990Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559603044161136134:5396]
2025-10-10T14:40:42.379286Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 pipe creation result: OK TabletId: 72075186224037892 Generation: 3392, pipe: [1:7559603044161136134:5396]
2025-10-10T14:40:42.457088Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:42.457725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:42.457744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:42.457768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603044161136134:5396], now have 1 active actors on pipe
2025-10-10T14:40:42.458030Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:42.458189Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 91 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559603044161136134:5396]
2025-10-10T14:40:42.458224Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:42.458270Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:40:42.458353Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3393 reason: status is not ok: tablet will be restarted right now sessionId: src_id|be5d82b6-46b81fc0-5959f178-c9d3340_0
2025-10-10T14:40:42.458908Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be5d82b6-46b81fc0-5959f178-c9d3340_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:40:42.458920Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be5d82b6-46b81fc0-5959f178-c9d3340_0] Write session will restart in 0.005220s
2025-10-10T14:40:42.458586Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3393 sessionId: src_id|be5d82b6-46b81fc0-5959f178-c9d3340_0 is DEAD
2025-10-10T14:40:42.458946Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be5d82b6-46b81fc0-5959f178-c9d3340_0] Write session: Do CDS request
2025-10-10T14:40:42.458986Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be5d82b6-46b81fc0-5959f178-c9d3340_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:42.465948Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|be5d82b6-46b81fc0-5959f178-c9d3340_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:42.466154Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:42.466172Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3394
2025-10-10T14:40:42.466293Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3394 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:42.466331Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3394 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:42.466343Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3394 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:42.466347Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:42.466901Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3394 sessionId:  describe result for acl check
2025-10-10T14:40:42.466941Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:42.466957Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:42.466960Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:42.466967Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559603044161136148:6945] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:42.467592Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559603044161136148:6945] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:42.470179Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559603044161136148:6945] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:42.479544Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559603044161136148:6945] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:42.479562Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559603044161136148:6945] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:42.479566Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559603044161136148:6945] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:42.479576Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3394 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:42.493044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:42.496147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:42.496435Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:42.496452Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:42.496468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:42.496551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:42.496607Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559603043378882139:13470]
2025-10-10T14:40:42.497280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:42.497716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:42.497781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:42.498140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:42.498233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:42.498241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:42.498243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:42.498244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:42.498246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:42.498247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:42.498248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:42.498250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:42.498251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:42.498253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:42.498254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:42.498256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:42.498257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:42.498265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:42.498278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:42.498283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:42.498287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:42.498291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:42.498295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:42.498298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:42.498302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:42.498306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:42.498311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:42.498315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:42.498319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:42.498323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:42.498332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:42.498341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:42.498349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:42.498355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:42.498360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:42.498365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:42.498370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:42.498383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:42.498389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:42.498400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:42.498407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:42.498417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:42.498424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:42.498430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:42.498442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:42.498452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:42.498457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:42.498463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:42.498468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:42.498473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:42.498478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:42.498493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:42.498498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:42.498504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:42.498508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:42.498514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:42.498554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:42.501279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:42.501853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:42.501867Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:42.501870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:42.501874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:42.501882Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3393 [2:7559603043378882139:13470]
2025-10-10T14:40:42.501897Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:42.501918Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:42.501921Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:42.501925Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:42.501928Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:42.501946Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:42.501976Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:42.501989Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:42.502063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:42.502070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:42.502073Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:42.502076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:42.502146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:42.502154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:42.502169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:42.502182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:42.502200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:42.502230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603044161136222:6945], now have 1 active actors on pipe
2025-10-10T14:40:42.502238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603044161136135:2438], now have 1 active actors on pipe
2025-10-10T14:40:42.502247Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559603043378882134:13470]
2025-10-10T14:40:42.502250Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559603043378882134:13470]
2025-10-10T14:40:42.502252Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559603043378882134:13470]
2025-10-10T14:40:42.502265Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3393
2025-10-10T14:40:42.502281Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3393
2025-10-10T14:40:42.502269Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:42.502291Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:42.502310Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:42.502313Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:42.502314Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:42.502318Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:42.502320Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:42.502360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:42.502365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:42.502385Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559603043378882134:13470]
2025-10-10T14:40:42.502394Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:42.502410Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:42.502430Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|82e46d69-c25ea0d0-5530ccd7-73392f76_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:42.502442Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:42.502558Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:42.502570Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:42.502584Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:42.502598Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:42.502626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:42.502844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:42.502856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:42.502880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:42.503024Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3394 partition: 0 MaxSeqNo: 40 sessionId: src_id|82e46d69-c25ea0d0-5530ccd7-73392f76_0
2025-10-10T14:40:42.503463Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be5d82b6-46b81fc0-5959f178-c9d3340_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|82e46d69-c25ea0d0-5530ccd7-73392f76_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:42.506375Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|82e46d69-c25ea0d0-5530ccd7-73392f76_0] Write session: try to update token
2025-10-10T14:40:42.506411Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|82e46d69-c25ea0d0-5530ccd7-73392f76_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:42.523207Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:42.523273Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:42.523277Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:42.523279Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:42.523291Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559603043378882134:13470]
2025-10-10T14:40:42.523297Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559603043378882134:13470]
2025-10-10T14:40:42.523301Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559603043378882134:13470]
2025-10-10T14:40:42.523356Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:42.523365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:42.523368Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:42.523517Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:42.525593Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:42.525606Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:42.525611Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:42.532033Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3394 sessionId: src_id|82e46d69-c25ea0d0-5530ccd7-73392f76_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:42.535019Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:42.558176Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559603044161136377:5396]
2025-10-10T14:40:42.558535Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 pipe creation result: OK TabletId: 72075186224037892 Generation: 3393, pipe: [1:7559603044161136377:5396]
2025-10-10T14:40:42.647487Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:42.647937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:42.647954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:42.647979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603044161136377:5396], now have 1 active actors on pipe
2025-10-10T14:40:42.648214Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:42.648667Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 92 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559603044161136377:5396]
2025-10-10T14:40:42.648706Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:40:42.648788Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3394 reason: status is not ok: tablet will be restarted right now sessionId: src_id|82e46d69-c25ea0d0-5530ccd7-73392f76_0
2025-10-10T14:40:42.648998Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3394 sessionId: src_id|82e46d69-c25ea0d0-5530ccd7-73392f76_0 is DEAD
2025-10-10T14:40:42.649270Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82e46d69-c25ea0d0-5530ccd7-73392f76_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:40:42.649279Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82e46d69-c25ea0d0-5530ccd7-73392f76_0] Write session will restart in 0.009331s
2025-10-10T14:40:42.649305Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82e46d69-c25ea0d0-5530ccd7-73392f76_0] Write session: Do CDS request
2025-10-10T14:40:42.649312Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82e46d69-c25ea0d0-5530ccd7-73392f76_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:42.649133Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:42.661149Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|82e46d69-c25ea0d0-5530ccd7-73392f76_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:42.661232Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:42.661250Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3395
2025-10-10T14:40:42.661596Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3395 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:42.661638Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3395 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:42.661654Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3395 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:42.661658Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:42.662209Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3395 sessionId:  describe result for acl check
2025-10-10T14:40:42.662242Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:42.662243Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:42.662245Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:42.662251Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559603044161136423:6993] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:42.662877Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559603044161136423:6993] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:42.667607Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559603044161136423:6993] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:42.671188Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559603044161136423:6993] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:42.671204Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559603044161136423:6993] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:42.671208Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559603044161136423:6993] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:42.671217Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3395 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:42.675094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:42.677800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:42.678193Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:42.678207Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:42.678221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:42.678292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:42.678340Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559603043378882377:13472]
2025-10-10T14:40:42.678991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:42.679314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:42.679373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:42.679698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:42.679763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:42.679769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:42.679771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:42.679772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:42.679773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:42.679774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:42.679776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:42.679777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:42.679778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:42.679779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:42.679780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:42.679782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:42.679783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:42.679789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:42.679803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:42.679806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:42.679810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:42.679814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:42.679818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:42.679822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:42.679826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:42.679829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:42.679834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:42.679838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:42.679842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:42.679847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:42.679855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:42.679863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:42.679870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:42.679876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:42.679881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:42.679886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:42.679890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:42.679897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:42.679902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:42.679920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:42.679924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:42.679929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:42.679934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:42.679939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:42.679943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:42.679948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:42.679958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:42.679964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:42.679968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:42.679973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:42.679982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:42.679987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:42.679991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:42.680001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:42.680005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:42.680011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:42.680055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:42.683342Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3394
2025-10-10T14:40:42.683365Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3394
2025-10-10T14:40:42.682526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:42.682968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:42.682973Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:42.682975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:42.682979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:42.682985Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3394 [2:7559603043378882377:13472]
2025-10-10T14:40:42.682997Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:42.683015Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:42.683019Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:42.683022Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:42.683024Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:42.683042Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:42.683052Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:42.683061Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:42.683124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:42.683126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:42.683128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:42.683131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:42.683207Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:42.683210Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:42.683222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:42.683235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:42.683253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:42.683273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603044161136379:2438], now have 1 active actors on pipe
2025-10-10T14:40:42.683276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603044161136572:6993], now have 1 active actors on pipe
2025-10-10T14:40:42.683286Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559603043378882372:13472]
2025-10-10T14:40:42.683288Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559603043378882372:13472]
2025-10-10T14:40:42.683290Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559603043378882372:13472]
2025-10-10T14:40:42.683305Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:42.683319Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:42.683326Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:42.683329Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:42.683332Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:42.683334Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:42.683337Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:42.683360Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559603043378882372:13472]
2025-10-10T14:40:42.683363Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:42.683375Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:42.683400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:42.683405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:42.683445Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|594faa75-e3ee4018-8c07dc1e-c038be64_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:42.683455Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:42.683463Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:42.683465Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:42.683478Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:42.683489Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:42.683505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:42.683709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:42.683716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:42.683742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:42.683869Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3395 partition: 0 MaxSeqNo: 40 sessionId: src_id|594faa75-e3ee4018-8c07dc1e-c038be64_0
2025-10-10T14:40:42.684330Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82e46d69-c25ea0d0-5530ccd7-73392f76_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|594faa75-e3ee4018-8c07dc1e-c038be64_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:42.687286Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|594faa75-e3ee4018-8c07dc1e-c038be64_0] Write session: try to update token
2025-10-10T14:40:42.687304Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|594faa75-e3ee4018-8c07dc1e-c038be64_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:42.704837Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:42.704856Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:42.704860Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:42.704863Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:42.704873Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559603043378882372:13472]
2025-10-10T14:40:42.704879Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559603043378882372:13472]
2025-10-10T14:40:42.704883Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559603043378882372:13472]
2025-10-10T14:40:42.704938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:42.704943Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:42.704947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:42.704949Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:42.704950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:42.704957Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:42.705090Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:42.711518Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3395 sessionId: src_id|594faa75-e3ee4018-8c07dc1e-c038be64_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:42.714676Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:42.748653Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559603044161136620:5396]
2025-10-10T14:40:42.749000Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 pipe creation result: OK TabletId: 72075186224037892 Generation: 3394, pipe: [1:7559603044161136620:5396]
2025-10-10T14:40:42.829244Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:42.829623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:42.829634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:42.829658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603044161136620:5396], now have 1 active actors on pipe
2025-10-10T14:40:42.829919Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:42.830027Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:40:42.830042Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:40:42.830078Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 93 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559603044161136620:5396]
2025-10-10T14:40:42.830100Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:42.830112Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3395 reason: error at write: Disconnected sessionId: src_id|594faa75-e3ee4018-8c07dc1e-c038be64_0
2025-10-10T14:40:42.830369Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3395 sessionId: src_id|594faa75-e3ee4018-8c07dc1e-c038be64_0 is DEAD
2025-10-10T14:40:42.830530Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|594faa75-e3ee4018-8c07dc1e-c038be64_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:40:42.830543Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|594faa75-e3ee4018-8c07dc1e-c038be64_0] Write session will restart in 0.009072s
2025-10-10T14:40:42.830572Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|594faa75-e3ee4018-8c07dc1e-c038be64_0] Write session: Do CDS request
2025-10-10T14:40:42.830583Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|594faa75-e3ee4018-8c07dc1e-c038be64_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:42.840875Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|594faa75-e3ee4018-8c07dc1e-c038be64_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:42.841157Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:42.841172Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3396
2025-10-10T14:40:42.841422Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3396 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:42.841457Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3396 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:42.841463Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3396 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:42.841466Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:42.841870Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3396 sessionId:  describe result for acl check
2025-10-10T14:40:42.841904Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:42.841906Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:42.841907Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:42.841914Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559603044161136673:6996] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:42.842488Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559603044161136673:6996] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:42.849540Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559603044161136673:6996] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:42.855667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559603044161136673:6996] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:42.855682Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559603044161136673:6996] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:42.855686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559603044161136673:6996] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:42.855696Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3396 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:42.857515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:42.861511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:42.861763Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:42.861775Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:42.861788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:42.861845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:42.862026Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559603043378882615:13474]
2025-10-10T14:40:42.862686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:42.863078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:42.863123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:42.863463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:42.863525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:42.863530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:42.863531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:42.863533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:42.863534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:42.863536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:42.863537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:42.863538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:42.863540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:42.863541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:42.863542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:42.863543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:42.863545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:42.863551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:42.863564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:42.863569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:42.863573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:42.863577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:42.863581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:42.863585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:42.863589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:42.863593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:42.863597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:42.863601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:42.863605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:42.863609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:42.863619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:42.863628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:42.863634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:42.863644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:42.863648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:42.863653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:42.863658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:42.863664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:42.863676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:42.863686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:42.863690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:42.863695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:42.863700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:42.863710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:42.863720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:42.863725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:42.863729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:42.863738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:42.863743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:42.863748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:42.863757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:42.863762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:42.863770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:42.863775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:42.863779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:42.863784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:42.863823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:42.866696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:42.867143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:42.867159Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:42.867161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:42.867165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:42.867172Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3395 [2:7559603043378882615:13474]
2025-10-10T14:40:42.867185Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:42.867205Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:42.867213Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:42.867216Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:42.867218Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:42.867236Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:42.867244Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:42.867253Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:42.867315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:42.867324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:42.867326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:42.867329Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:42.867400Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:42.867407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:42.867419Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:42.867432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:42.867454Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:42.867482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603044161136621:2438], now have 1 active actors on pipe
2025-10-10T14:40:42.867490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603044161136849:6996], now have 1 active actors on pipe
2025-10-10T14:40:42.867502Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559603043378882610:13474]
2025-10-10T14:40:42.867509Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559603043378882610:13474]
2025-10-10T14:40:42.867511Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559603043378882610:13474]
2025-10-10T14:40:42.867526Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:42.867545Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:42.867565Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:42.867571Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:42.867600Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559603043378882610:13474]
2025-10-10T14:40:42.867606Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:42.867697Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:42.867707Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:42.867709Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:42.867715Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:42.867772Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3395
2025-10-10T14:40:42.867807Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3395
2025-10-10T14:40:42.868335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:42.868348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:42.868390Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6047e139-54ae6d8e-3ac1a803-82bd0bef_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:42.868400Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:42.868404Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:42.868407Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:42.868431Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:42.868448Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:42.868466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:42.868828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:42.868839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:42.868863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:42.869034Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3396 partition: 0 MaxSeqNo: 40 sessionId: src_id|6047e139-54ae6d8e-3ac1a803-82bd0bef_0
2025-10-10T14:40:42.872505Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|594faa75-e3ee4018-8c07dc1e-c038be64_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|6047e139-54ae6d8e-3ac1a803-82bd0bef_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:42.875436Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6047e139-54ae6d8e-3ac1a803-82bd0bef_0] Write session: try to update token
2025-10-10T14:40:42.875461Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6047e139-54ae6d8e-3ac1a803-82bd0bef_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:42.890246Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:42.890266Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:42.890269Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:42.890271Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:42.890282Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559603043378882610:13474]
2025-10-10T14:40:42.890289Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559603043378882610:13474]
2025-10-10T14:40:42.890293Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559603043378882610:13474]
2025-10-10T14:40:42.890343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:42.890352Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:42.890355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:42.890510Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:42.893516Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:42.893525Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:42.893530Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:42.895847Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3396 sessionId: src_id|6047e139-54ae6d8e-3ac1a803-82bd0bef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:42.898683Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:42.930421Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559603044161136870:5396]
2025-10-10T14:40:42.930741Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 pipe creation result: OK TabletId: 72075186224037892 Generation: 3395, pipe: [1:7559603044161136870:5396]
2025-10-10T14:40:43.010512Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:43.010915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:43.010932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:43.010983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603044161136870:5396], now have 1 active actors on pipe
2025-10-10T14:40:43.011245Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:43.011225Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:43.011253Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 94 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559603044161136870:5396]
2025-10-10T14:40:43.011292Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:40:43.011295Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:40:43.011382Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3396 reason: error at write: Disconnected sessionId: src_id|6047e139-54ae6d8e-3ac1a803-82bd0bef_0
2025-10-10T14:40:43.011633Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3396 sessionId: src_id|6047e139-54ae6d8e-3ac1a803-82bd0bef_0 is DEAD
2025-10-10T14:40:43.011815Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6047e139-54ae6d8e-3ac1a803-82bd0bef_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:40:43.011828Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6047e139-54ae6d8e-3ac1a803-82bd0bef_0] Write session will restart in 0.007492s
2025-10-10T14:40:43.011866Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6047e139-54ae6d8e-3ac1a803-82bd0bef_0] Write session: Do CDS request
2025-10-10T14:40:43.011875Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6047e139-54ae6d8e-3ac1a803-82bd0bef_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:43.020993Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6047e139-54ae6d8e-3ac1a803-82bd0bef_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:43.021420Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:43.021438Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3397
2025-10-10T14:40:43.021628Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3397 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:43.021669Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3397 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:43.021680Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3397 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:43.021685Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:43.023424Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3397 sessionId:  describe result for acl check
2025-10-10T14:40:43.023471Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:43.023473Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:43.023476Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:43.023483Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559603048456104220:7043] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:43.024182Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559603048456104220:7043] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:43.027964Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559603048456104220:7043] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:43.032697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559603048456104220:7043] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:43.032718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559603048456104220:7043] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:43.032722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559603048456104220:7043] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:43.032732Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3397 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:43.036388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:43.039261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:43.039515Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:43.039530Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:43.039543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:43.039609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:43.039649Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559603047673850162:13477]
2025-10-10T14:40:43.040350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:43.040674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:43.040723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:43.041062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:43.041128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:43.041134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:43.041136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:43.041137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:43.041139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:43.041141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:43.041142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:43.041143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:43.041144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:43.041146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:43.041147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:43.041149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:43.041150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:43.041156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:43.041169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:43.041172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:43.041176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:43.041181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:43.041185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:43.041189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:43.041194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:43.041198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:43.041203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:43.041206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:43.041209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:43.041213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:43.041223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:43.041232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:43.041239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:43.041246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:43.041261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:43.041267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:43.041272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:43.041279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:43.041284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:43.041290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:43.041294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:43.041300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:43.041305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:43.041310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:43.041314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:43.041320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:43.041325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:43.041351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:43.041355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:43.041360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:43.041365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:43.041371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:43.041375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:43.041381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:43.041386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:43.041391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:43.041437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:43.044528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:43.045433Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3396
2025-10-10T14:40:43.045468Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3396
2025-10-10T14:40:43.044970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:43.044989Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:43.044991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:43.044996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:43.045002Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3396 [2:7559603047673850162:13477]
2025-10-10T14:40:43.045017Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:43.045036Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:43.045042Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:43.045046Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:43.045048Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:43.045067Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:43.045074Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:43.045082Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:43.045145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:43.045148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:43.045151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:43.045154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:43.045229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:43.045232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:43.045244Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:43.045257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:43.045272Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:43.045295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603048456104370:7043], now have 1 active actors on pipe
2025-10-10T14:40:43.045299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603048456104170:2438], now have 1 active actors on pipe
2025-10-10T14:40:43.045306Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559603047673850157:13477]
2025-10-10T14:40:43.045309Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559603047673850157:13477]
2025-10-10T14:40:43.045311Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559603047673850157:13477]
2025-10-10T14:40:43.045349Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:43.045365Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:43.045380Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:43.045383Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:43.045416Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559603047673850157:13477]
2025-10-10T14:40:43.045422Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:43.045477Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:43.045481Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:43.045483Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:43.045490Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:43.045757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:43.045768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:43.045806Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|22cb0ce9-17af9f51-5414918f-592ec201_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:43.045816Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:43.045822Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:43.045825Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:43.045850Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:43.045863Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:43.045882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:43.046427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:43.046438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:43.046461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:43.046596Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3397 partition: 0 MaxSeqNo: 40 sessionId: src_id|22cb0ce9-17af9f51-5414918f-592ec201_0
2025-10-10T14:40:43.047165Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6047e139-54ae6d8e-3ac1a803-82bd0bef_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|22cb0ce9-17af9f51-5414918f-592ec201_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:43.050147Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|22cb0ce9-17af9f51-5414918f-592ec201_0] Write session: try to update token
2025-10-10T14:40:43.050169Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|22cb0ce9-17af9f51-5414918f-592ec201_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:43.066462Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:43.066477Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:43.066481Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:43.066483Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:43.066494Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559603047673850157:13477]
2025-10-10T14:40:43.066498Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559603047673850157:13477]
2025-10-10T14:40:43.066502Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559603047673850157:13477]
2025-10-10T14:40:43.066551Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:43.066558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:43.066563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:43.066567Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:43.066576Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:43.066580Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:43.066704Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:43.070427Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3397 sessionId: src_id|22cb0ce9-17af9f51-5414918f-592ec201_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:43.073374Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:43.111626Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559603048456104451:5396]
2025-10-10T14:40:43.111980Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 pipe creation result: OK TabletId: 72075186224037892 Generation: 3396, pipe: [1:7559603048456104451:5396]
2025-10-10T14:40:43.180993Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:43.181563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:43.181582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:43.181629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603048456104451:5396], now have 1 active actors on pipe
2025-10-10T14:40:43.182009Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:43.182589Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|22cb0ce9-17af9f51-5414918f-592ec201_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:40:43.182602Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|22cb0ce9-17af9f51-5414918f-592ec201_0] Write session will restart in 0.008666s
2025-10-10T14:40:43.182628Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|22cb0ce9-17af9f51-5414918f-592ec201_0] Write session: Do CDS request
2025-10-10T14:40:43.182636Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|22cb0ce9-17af9f51-5414918f-592ec201_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:43.181861Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 95 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559603048456104451:5396]
2025-10-10T14:40:43.181866Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:40:43.181870Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:40:43.181905Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:43.181942Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3397 reason: error at write: Disconnected sessionId: src_id|22cb0ce9-17af9f51-5414918f-592ec201_0
2025-10-10T14:40:43.182194Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3397 sessionId: src_id|22cb0ce9-17af9f51-5414918f-592ec201_0 is DEAD
2025-10-10T14:40:43.192974Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|22cb0ce9-17af9f51-5414918f-592ec201_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:43.193095Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:43.193111Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3398
2025-10-10T14:40:43.193271Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3398 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:43.193346Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3398 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:43.193353Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3398 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:43.193358Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:43.193867Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3398 sessionId:  describe result for acl check
2025-10-10T14:40:43.193908Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:43.193910Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:43.193912Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:43.193918Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559603048456104477:7106] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:43.194532Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559603048456104477:7106] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:43.198601Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559603048456104477:7106] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:43.202339Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559603048456104477:7106] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:43.202356Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559603048456104477:7106] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:43.202360Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559603048456104477:7106] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:43.202369Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3398 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:43.206513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:43.214066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:43.214385Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:43.214393Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:43.214411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:43.214499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:43.214838Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559603047673850441:13492]
2025-10-10T14:40:43.215508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:43.216213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:43.216289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:43.216717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:43.216796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:43.216798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:43.216799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:43.216801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:43.216803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:43.216804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:43.216806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:43.216807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:43.216809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:43.216810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:43.216811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:43.216813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:43.216815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:43.216823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:43.216838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:43.216843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:43.216847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:43.216851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:43.216855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:43.216859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:43.216863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:43.216867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:43.216873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:43.216877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:43.216882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:43.216886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:43.216899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:43.216910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:43.216938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:43.216945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:43.216951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:43.216957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:43.216962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:43.216968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:43.216976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:43.216982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:43.216987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:43.216993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:43.216998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:43.217003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:43.217008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:43.217014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:43.217019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:43.217025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:43.217031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:43.217037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:43.217042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:43.217048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:43.217053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:43.217058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:43.217063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:43.217068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:43.217112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:43.220143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:43.220493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:43.220508Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:43.220512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:43.220516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:43.220524Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3397 [2:7559603047673850441:13492]
2025-10-10T14:40:43.220542Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:43.220570Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:43.220575Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:43.220580Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:43.220582Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:43.220604Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:43.220617Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:43.220631Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:43.220733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:43.220742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:43.220744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:43.220748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:43.220829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:43.220838Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:43.220853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:43.220871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:43.220892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:43.220914Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559603047673850435:13492]
2025-10-10T14:40:43.220918Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559603047673850435:13492]
2025-10-10T14:40:43.220921Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559603047673850435:13492]
2025-10-10T14:40:43.220937Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:43.220956Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:43.220978Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:43.220986Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:43.220989Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:43.220993Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:43.220995Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:43.221027Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559603047673850435:13492]
2025-10-10T14:40:43.221035Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:43.221091Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:43.221145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603048456104452:2438], now have 1 active actors on pipe
2025-10-10T14:40:43.221166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603048456104666:7106], now have 1 active actors on pipe
2025-10-10T14:40:43.221252Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3397
2025-10-10T14:40:43.221300Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3397
2025-10-10T14:40:43.221624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:43.221647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:43.221689Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|26275a1e-10de08ba-74490f2b-8f418e41_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:43.221714Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:43.221722Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:43.221725Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:43.221745Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:43.221764Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:43.221788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:43.222034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:43.222047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:43.222073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:43.222215Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3398 partition: 0 MaxSeqNo: 40 sessionId: src_id|26275a1e-10de08ba-74490f2b-8f418e41_0
2025-10-10T14:40:43.222838Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|22cb0ce9-17af9f51-5414918f-592ec201_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|26275a1e-10de08ba-74490f2b-8f418e41_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:43.225923Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|26275a1e-10de08ba-74490f2b-8f418e41_0] Write session: try to update token
2025-10-10T14:40:43.225951Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|26275a1e-10de08ba-74490f2b-8f418e41_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:43.240575Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:40:43.240590Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:43.240603Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559603047673850435:13492]
2025-10-10T14:40:43.240663Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:40:43.240877Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:40:43.241027Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:43.241169Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:43.241325Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:43.241584Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:40:43.241628Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:40:43.242931Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:40:43.246736Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3398 sessionId: src_id|26275a1e-10de08ba-74490f2b-8f418e41_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:43.249588Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:43.249958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:43.249977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:43.250017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:40:43.250329Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:40:43.254563Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:43.254584Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:43.254588Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:43.254591Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:43.254601Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559603047673850435:13492]
2025-10-10T14:40:43.254605Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559603047673850435:13492]
2025-10-10T14:40:43.254609Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559603047673850435:13492]
2025-10-10T14:40:43.254659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:43.254664Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:43.254668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:43.254671Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:43.254672Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:43.254689Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:43.254815Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:43.282113Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559603048456104698:5396]
2025-10-10T14:40:43.282418Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 pipe creation result: OK TabletId: 72075186224037892 Generation: 3397, pipe: [1:7559603048456104698:5396]
2025-10-10T14:40:43.381027Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:43.390440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:43.390468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:43.390664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:43.390726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:43.390795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:43.390861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:43.391605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:43.391617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:43.391691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:43.391762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:43.391841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:43.391926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:43.391966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:43.391969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:43.392063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:43.392123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:43.392202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:43.392264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:43.392312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:43.392315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:43.392385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:43.392459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:43.392523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:43.392588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:43.392627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:43.392630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:43.392696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:43.392759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:43.392818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:43.392877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:43.392921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:43.392923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:43.392991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:43.393047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:43.393108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:43.393172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:43.393211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:43.393214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:43.393287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:43.393367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:43.393439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:43.393510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:43.393553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:43.393556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:43.393627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:43.393704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:43.393772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:43.393844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:43.393906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:43.393913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:43.393986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:43.394056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:43.394124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:43.394202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:43.394255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:43.394262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:43.394338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:43.394405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:43.394470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:43.394546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:43.394595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:43.394602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:43.394679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603048456104698:5396], now have 1 active actors on pipe
2025-10-10T14:40:43.395908Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:43.396948Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|26275a1e-10de08ba-74490f2b-8f418e41_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:40:43.396960Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|26275a1e-10de08ba-74490f2b-8f418e41_0] Write session will restart in 0.005283s
2025-10-10T14:40:43.396359Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:43.396434Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 96 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559603048456104698:5396]
2025-10-10T14:40:43.396464Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:40:43.396512Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3398 reason: status is not ok: tablet will be restarted right now sessionId: src_id|26275a1e-10de08ba-74490f2b-8f418e41_0
2025-10-10T14:40:43.396784Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3398 sessionId: src_id|26275a1e-10de08ba-74490f2b-8f418e41_0 is DEAD
2025-10-10T14:40:43.397003Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|26275a1e-10de08ba-74490f2b-8f418e41_0] Write session: Do CDS request
2025-10-10T14:40:43.397009Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|26275a1e-10de08ba-74490f2b-8f418e41_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:43.404206Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|26275a1e-10de08ba-74490f2b-8f418e41_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:43.404279Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:43.404297Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3399
2025-10-10T14:40:43.404489Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3399 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:43.404535Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3399 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:43.404541Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3399 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:43.404546Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:43.405061Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3399 sessionId:  describe result for acl check
2025-10-10T14:40:43.405106Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:43.405116Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:43.405118Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:43.405125Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559603048456104716:7098] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:43.405769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559603048456104716:7098] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:43.410924Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559603048456104716:7098] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:43.420089Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559603048456104716:7098] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:43.420109Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559603048456104716:7098] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:43.420113Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559603048456104716:7098] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:43.420123Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3399 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:43.427833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:43.431455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:43.432026Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:43.432043Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:43.432060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:43.432180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:43.432236Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559603047673850686:13495]
2025-10-10T14:40:43.432943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:43.433398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:43.433454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:43.433815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:43.433882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:43.433891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:43.433892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:43.433893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:43.433895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:43.433896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:43.433897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:43.433899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:43.433900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:43.433901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:43.433903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:43.433904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:43.433905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:43.433912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:43.433926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:43.433931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:43.433935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:43.433939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:43.433944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:43.433949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:43.433953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:43.433958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:43.433965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:43.433969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:43.433973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:43.433978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:43.433986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:43.433995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:43.434003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:43.434009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:43.434013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:43.434019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:43.434025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:43.434031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:43.434036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:43.434043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:43.434048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:43.434054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:43.434060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:43.434065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:43.434070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:43.434076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:43.434081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:43.434087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:43.434091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:43.434097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:43.434117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:43.434122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:43.434127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:43.434133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:43.434139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:43.434145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:43.434190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:43.436888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:43.437706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:43.437721Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:43.437724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:43.437729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:43.437735Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3398 [2:7559603047673850686:13495]
2025-10-10T14:40:43.437750Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:43.437770Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:43.437773Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:43.437777Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:43.437779Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:43.437799Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:43.437806Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:43.437815Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:43.437883Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:43.437892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:43.437894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:43.437897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:43.437973Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:43.437982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:43.437995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:43.438008Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:43.438027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:43.438059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603048456104883:7098], now have 1 active actors on pipe
2025-10-10T14:40:43.438063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603048456104701:2438], now have 1 active actors on pipe
2025-10-10T14:40:43.438071Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559603047673850679:13495]
2025-10-10T14:40:43.438074Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559603047673850679:13495]
2025-10-10T14:40:43.438076Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559603047673850679:13495]
2025-10-10T14:40:43.438090Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:43.438108Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:43.438110Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:43.438119Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:43.438121Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:43.438126Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:43.438130Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:43.438163Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559603047673850679:13495]
2025-10-10T14:40:43.438174Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:43.438474Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3398
2025-10-10T14:40:43.438510Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3398
2025-10-10T14:40:43.438549Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:43.439033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:43.439046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:43.439085Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c4fcfbbd-1f1c7109-5098938b-5a506281_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:43.439099Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:43.439108Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:43.439111Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:43.439124Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:43.439138Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:43.439159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:43.439392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:43.439402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:43.439421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:43.439553Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3399 partition: 0 MaxSeqNo: 40 sessionId: src_id|c4fcfbbd-1f1c7109-5098938b-5a506281_0
2025-10-10T14:40:43.445494Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|26275a1e-10de08ba-74490f2b-8f418e41_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|c4fcfbbd-1f1c7109-5098938b-5a506281_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:43.448237Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c4fcfbbd-1f1c7109-5098938b-5a506281_0] Write session: try to update token
2025-10-10T14:40:43.448262Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c4fcfbbd-1f1c7109-5098938b-5a506281_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:43.459550Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:43.459572Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:43.459577Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:43.459579Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:43.459590Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559603047673850679:13495]
2025-10-10T14:40:43.459596Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559603047673850679:13495]
2025-10-10T14:40:43.459600Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559603047673850679:13495]
2025-10-10T14:40:43.459661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:43.459670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:43.459673Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:43.459683Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:43.459701Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:43.459706Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:43.459823Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:43.470778Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3399 sessionId: src_id|c4fcfbbd-1f1c7109-5098938b-5a506281_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:43.473612Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:43.496628Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559603048456104946:5396]
2025-10-10T14:40:43.496963Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 pipe creation result: OK TabletId: 72075186224037892 Generation: 3398, pipe: [1:7559603048456104946:5396]
2025-10-10T14:40:43.582925Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:43.583247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:43.583262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:43.583288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603048456104946:5396], now have 1 active actors on pipe
2025-10-10T14:40:43.583499Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:40:43.583520Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:40:43.583607Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3399 reason: error at write: Disconnected sessionId: src_id|c4fcfbbd-1f1c7109-5098938b-5a506281_0
2025-10-10T14:40:43.583840Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3399 sessionId: src_id|c4fcfbbd-1f1c7109-5098938b-5a506281_0 is DEAD
2025-10-10T14:40:43.584039Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4fcfbbd-1f1c7109-5098938b-5a506281_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:40:43.584052Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4fcfbbd-1f1c7109-5098938b-5a506281_0] Write session will restart in 0.006480s
2025-10-10T14:40:43.584094Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4fcfbbd-1f1c7109-5098938b-5a506281_0] Write session: Do CDS request
2025-10-10T14:40:43.584100Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4fcfbbd-1f1c7109-5098938b-5a506281_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:43.584177Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 97 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559603048456104946:5396]
2025-10-10T14:40:43.584200Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:43.584281Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:43.591960Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c4fcfbbd-1f1c7109-5098938b-5a506281_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:43.592046Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:43.592063Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3400
2025-10-10T14:40:43.592269Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3400 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:43.592304Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3400 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:43.592311Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3400 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:43.592315Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:43.592773Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3400 sessionId:  describe result for acl check
2025-10-10T14:40:43.592811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:43.592818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:43.592820Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:43.592826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559603048456104965:7125] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:43.593444Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559603048456104965:7125] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:43.599126Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559603048456104965:7125] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:43.604027Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559603048456104965:7125] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:43.604049Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559603048456104965:7125] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:43.604054Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559603048456104965:7125] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:43.604076Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3400 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:43.611017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:43.614231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:43.614712Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:43.614750Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:43.614769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:43.614862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:43.614935Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559603047673850929:13497]
2025-10-10T14:40:43.615627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:43.616058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:43.616112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:43.616495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:43.616559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:43.616565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:43.616566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:43.616567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:43.616568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:43.616569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:43.616571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:43.616572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:43.616573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:43.616574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:43.616576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:43.616577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:43.616578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:43.616586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:43.616599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:43.616602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:43.616607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:43.616610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:43.616614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:43.616618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:43.616621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:43.616625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:43.616629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:43.616634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:43.616637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:43.616641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:43.616652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:43.616660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:43.616667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:43.616673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:43.616678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:43.616684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:43.616689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:43.616694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:43.616700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:43.616705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:43.616709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:43.616715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:43.616720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:43.616725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:43.616730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:43.616736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:43.616741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:43.616748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:43.616761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:43.616772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:43.616776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:43.616782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:43.616786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:43.616791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:43.616796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:43.616804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:43.616843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:43.619342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:43.619796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:43.619811Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:43.619814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:43.619818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:43.619825Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3399 [2:7559603047673850929:13497]
2025-10-10T14:40:43.619838Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:43.619857Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:43.619861Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:43.619864Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:43.619867Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:43.619886Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:43.619910Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:43.619919Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:43.620006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:43.620018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:43.620022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:43.620026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:43.620099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:43.620108Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:43.620124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:43.620144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:43.620164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:43.620193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603048456104950:2438], now have 1 active actors on pipe
2025-10-10T14:40:43.620202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603048456105077:7125], now have 1 active actors on pipe
2025-10-10T14:40:43.620210Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559603047673850924:13497]
2025-10-10T14:40:43.620212Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559603047673850924:13497]
2025-10-10T14:40:43.620214Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559603047673850924:13497]
2025-10-10T14:40:43.620232Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:43.620242Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:43.620221Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3399
2025-10-10T14:40:43.620248Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:43.620260Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:43.620262Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:43.620265Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:43.620269Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:43.620233Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3399
2025-10-10T14:40:43.620324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:43.620336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:43.620352Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559603047673850924:13497]
2025-10-10T14:40:43.620366Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:43.620372Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:43.620398Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1b164f85-826a2bc2-cb69454e-842cb545_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:43.620413Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:43.620423Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:43.620426Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:43.620438Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:43.620453Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:43.620484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:43.620707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:43.620728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:43.620753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:43.620889Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3400 partition: 0 MaxSeqNo: 40 sessionId: src_id|1b164f85-826a2bc2-cb69454e-842cb545_0
2025-10-10T14:40:43.621365Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4fcfbbd-1f1c7109-5098938b-5a506281_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|1b164f85-826a2bc2-cb69454e-842cb545_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:43.624189Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1b164f85-826a2bc2-cb69454e-842cb545_0] Write session: try to update token
2025-10-10T14:40:43.624210Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1b164f85-826a2bc2-cb69454e-842cb545_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:43.640802Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:43.640823Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:43.640828Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:43.640830Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:43.640842Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559603047673850924:13497]
2025-10-10T14:40:43.640848Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559603047673850924:13497]
2025-10-10T14:40:43.640854Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559603047673850924:13497]
2025-10-10T14:40:43.640906Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:43.640909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:43.640913Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:43.640917Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:43.640920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:43.640922Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:43.641070Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:43.641712Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3400 sessionId: src_id|1b164f85-826a2bc2-cb69454e-842cb545_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:43.644405Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:43.684573Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559603048456105196:5396]
2025-10-10T14:40:43.684891Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 pipe creation result: OK TabletId: 72075186224037892 Generation: 3399, pipe: [1:7559603048456105196:5396]
2025-10-10T14:40:43.764080Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:43.764771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:43.764789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:43.764840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603048456105196:5396], now have 1 active actors on pipe
2025-10-10T14:40:43.765031Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:43.765094Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 98 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559603048456105196:5396]
2025-10-10T14:40:43.765140Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:40:43.765143Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:40:43.765220Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3400 reason: error at write: Disconnected sessionId: src_id|1b164f85-826a2bc2-cb69454e-842cb545_0
2025-10-10T14:40:43.765484Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3400 sessionId: src_id|1b164f85-826a2bc2-cb69454e-842cb545_0 is DEAD
2025-10-10T14:40:43.765491Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:43.773454Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b164f85-826a2bc2-cb69454e-842cb545_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:40:43.773482Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b164f85-826a2bc2-cb69454e-842cb545_0] Write session will restart in 0.007427s
2025-10-10T14:40:43.773512Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b164f85-826a2bc2-cb69454e-842cb545_0] Write session: Do CDS request
2025-10-10T14:40:43.773523Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b164f85-826a2bc2-cb69454e-842cb545_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:43.782120Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1b164f85-826a2bc2-cb69454e-842cb545_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:43.785508Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:43.785528Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3401
2025-10-10T14:40:43.785731Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3401 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:43.785793Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3401 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:43.785805Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3401 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:43.785810Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:43.786665Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3401 sessionId:  describe result for acl check
2025-10-10T14:40:43.786706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:43.786714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:43.786717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:43.786723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559603048456105276:6574] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:43.787318Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559603048456105276:6574] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:43.791394Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559603048456105276:6574] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:43.794447Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559603048456105276:6574] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:43.794464Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559603048456105276:6574] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:43.794468Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559603048456105276:6574] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:43.794478Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3401 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:43.796174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:43.801857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:43.802142Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:43.802169Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:43.802189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:43.802259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:43.802329Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559603047673851174:13499]
2025-10-10T14:40:43.803024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:43.803417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:43.803466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:43.803806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:43.803890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:43.803911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:43.803912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:43.803913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:43.803914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:43.803916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:43.803917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:43.803918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:43.803920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:43.803921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:43.803922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:43.803923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:43.803925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:43.803930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:43.803944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:43.803948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:43.803952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:43.803956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:43.803959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:43.803963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:43.803966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:43.803970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:43.803974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:43.803978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:43.803981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:43.803985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:43.803993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:43.804004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:43.804010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:43.804016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:43.804021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:43.804028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:43.804033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:43.804037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:43.804042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:43.804048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:43.804058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:43.804064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:43.804068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:43.804073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:43.804082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:43.804088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:43.804092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:43.804098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:43.804103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:43.804113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:43.804117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:43.804127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:43.804132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:43.804138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:43.804147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:43.804152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:43.804193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:43.806887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:43.807578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:43.807591Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:43.807594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:43.807598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:43.807615Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3400 [2:7559603047673851174:13499]
2025-10-10T14:40:43.807629Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:43.807652Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:43.807661Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:43.807665Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:43.807667Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:43.807686Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:43.807696Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:43.807703Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:43.807766Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:43.807775Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:43.807777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:43.807780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:43.807847Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:43.807849Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:43.807859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:43.807868Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:43.807883Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:43.807916Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559603047673851169:13499]
2025-10-10T14:40:43.807919Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559603047673851169:13499]
2025-10-10T14:40:43.807921Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559603047673851169:13499]
2025-10-10T14:40:43.807931Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:43.807945Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:43.807961Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:43.807965Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:43.807964Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:43.807968Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:43.808080Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3400
2025-10-10T14:40:43.808083Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3400
2025-10-10T14:40:43.807970Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:43.807989Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559603047673851169:13499]
2025-10-10T14:40:43.807993Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:43.807996Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:43.808003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603048456105432:6574], now have 1 active actors on pipe
2025-10-10T14:40:43.808006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603048456105199:2438], now have 1 active actors on pipe
2025-10-10T14:40:43.808201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:43.808212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:43.808244Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dcee125f-28cd5dfb-f313bcb7-76dafc2a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:43.808257Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:43.808263Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:43.808269Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:43.808282Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:43.808294Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:43.808310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:43.808436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:43.808442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:43.808458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:43.808559Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3401 partition: 0 MaxSeqNo: 40 sessionId: src_id|dcee125f-28cd5dfb-f313bcb7-76dafc2a_0
2025-10-10T14:40:43.809046Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b164f85-826a2bc2-cb69454e-842cb545_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|dcee125f-28cd5dfb-f313bcb7-76dafc2a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:43.811869Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dcee125f-28cd5dfb-f313bcb7-76dafc2a_0] Write session: try to update token
2025-10-10T14:40:43.811888Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dcee125f-28cd5dfb-f313bcb7-76dafc2a_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:43.828255Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:43.828278Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:43.828282Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:43.828284Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:43.828298Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559603047673851169:13499]
2025-10-10T14:40:43.828302Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559603047673851169:13499]
2025-10-10T14:40:43.828306Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559603047673851169:13499]
2025-10-10T14:40:43.828380Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:43.828388Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:43.828393Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:43.828395Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:43.828396Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:43.828401Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:43.828568Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:43.835496Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3401 sessionId: src_id|dcee125f-28cd5dfb-f313bcb7-76dafc2a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:43.838339Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:43.865461Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559603048456105448:5396]
2025-10-10T14:40:43.865897Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 pipe creation result: OK TabletId: 72075186224037892 Generation: 3400, pipe: [1:7559603048456105448:5396]
2025-10-10T14:40:43.949276Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:43.949665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:43.949684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:43.949709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603048456105448:5396], now have 1 active actors on pipe
2025-10-10T14:40:43.949949Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:43.949975Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 99 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559603048456105448:5396]
2025-10-10T14:40:43.950000Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:40:43.950005Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:40:43.950008Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:43.950049Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1661: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 closed with error: reason# too much attempts to restart pipe
2025-10-10T14:40:43.950080Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3401 reason: error at write: Disconnected sessionId: src_id|dcee125f-28cd5dfb-f313bcb7-76dafc2a_0
2025-10-10T14:40:43.950163Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 34 consumer shared/user session shared/user_1_34_5982580832181462992_v1 is DEAD
2025-10-10T14:40:43.950185Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3401 sessionId: src_id|dcee125f-28cd5dfb-f313bcb7-76dafc2a_0 is DEAD
2025-10-10T14:40:43.951080Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dcee125f-28cd5dfb-f313bcb7-76dafc2a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:40:43.951091Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dcee125f-28cd5dfb-f313bcb7-76dafc2a_0] Write session will restart in 0.005040s
2025-10-10T14:40:43.951116Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dcee125f-28cd5dfb-f313bcb7-76dafc2a_0] Write session: Do CDS request
2025-10-10T14:40:43.951123Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dcee125f-28cd5dfb-f313bcb7-76dafc2a_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:43.951069Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559602971146673268:5393] disconnected; active server actors: 1
2025-10-10T14:40:43.951079Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559602971146673268:5393] client user disconnected session shared/user_1_34_5982580832181462992_v1
2025-10-10T14:40:43.953412Z :ERROR: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] Got error. Status: UNAVAILABLE. Description: <main>: Error: too much attempts to restart pipe, code: 500027 
2025-10-10T14:40:43.953575Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-10T14:40:43.953581Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-10T14:40:43.953588Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] Reconnecting session to cluster  in 0.007610s
2025-10-10T14:40:43.957868Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dcee125f-28cd5dfb-f313bcb7-76dafc2a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:43.957968Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:43.957983Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3402
2025-10-10T14:40:43.958176Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3402 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:43.958220Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3402 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:43.958227Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3402 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:43.958231Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:43.958832Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3402 sessionId:  describe result for acl check
2025-10-10T14:40:43.958872Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:43.958874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:43.958876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:43.958883Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559603048456105474:7195] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:43.959474Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559603048456105474:7195] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:43.961779Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] Successfully connected. Initializing session
2025-10-10T14:40:43.962023Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-10T14:40:43.962043Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 35
2025-10-10T14:40:43.962214Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 35 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-10T14:40:43.962275Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 35 consumer shared/user session shared/user_1_35_7080413204912763209_v1 read init: from# ipv6:[::1]:37328, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-10T14:40:43.962377Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 35 consumer shared/user session shared/user_1_35_7080413204912763209_v1 auth for : user
2025-10-10T14:40:43.962524Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 35 consumer shared/user session shared/user_1_35_7080413204912763209_v1 Handle describe topics response
2025-10-10T14:40:43.962554Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 35 consumer shared/user session shared/user_1_35_7080413204912763209_v1 auth is DEAD
2025-10-10T14:40:43.962586Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 35 consumer shared/user session shared/user_1_35_7080413204912763209_v1 auth ok: topics# 1, initDone# 0
2025-10-10T14:40:43.962972Z :INFO: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] Got InitResponse. ReadSessionId: shared/user_1_35_7080413204912763209_v1
2025-10-10T14:40:43.962870Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 35 consumer shared/user session shared/user_1_35_7080413204912763209_v1 register session: topic# rt3.dc1--test-topic
2025-10-10T14:40:43.963007Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559603048456105502:7227] connected; active server actors: 1
2025-10-10T14:40:43.963161Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7559603048456105502:7227] session shared/user_1_35_7080413204912763209_v1
2025-10-10T14:40:43.963178Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-10-10T14:40:43.963192Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-10-10T14:40:43.963199Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_35_7080413204912763209_v1" (Sender=[1:7559603048456105492:7227], Pipe=[1:7559603048456105502:7227], Partitions=[], ActiveFamilyCount=0)
2025-10-10T14:40:43.963206Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-10T14:40:43.963219Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-10-10T14:40:43.963232Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_35_7080413204912763209_v1" (Sender=[1:7559603048456105492:7227], Pipe=[1:7559603048456105502:7227], Partitions=[], ActiveFamilyCount=0)
2025-10-10T14:40:43.963248Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_35_7080413204912763209_v1" sender [1:7559603048456105492:7227] lock partition 0 for ReadingSession "shared/user_1_35_7080413204912763209_v1" (Sender=[1:7559603048456105492:7227], Pipe=[1:7559603048456105502:7227], Partitions=[], ActiveFamilyCount=1) generation 1 step 35
2025-10-10T14:40:43.963265Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-10-10T14:40:43.963275Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000048s
2025-10-10T14:40:43.963531Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 35 consumer shared/user session shared/user_1_35_7080413204912763209_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 35 Session: "shared/user_1_35_7080413204912763209_v1" ClientId: "user" PipeClient { RawX1: 7559603048456105502 RawX2: 4503603922345019 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-10T14:40:43.963563Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 35 consumer shared/user session shared/user_1_35_7080413204912763209_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-10T14:40:43.964785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559603048456105474:7195] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:43.969623Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559603048456105474:7195] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:43.969649Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559603048456105474:7195] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:43.969653Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559603048456105474:7195] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:43.969662Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3402 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:43.977643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:43.980837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:43.981086Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:43.981100Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:43.981113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:43.981185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:43.981237Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559603047673851432:13502]
2025-10-10T14:40:43.981946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:43.982335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:43.982384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:43.982721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:43.982788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:43.982789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:43.982791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:43.982792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:43.982794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:43.982795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:43.982797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:43.982798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:43.982800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:43.982801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:43.982803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:43.982804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:43.982805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:43.982812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:43.982827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:43.982832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:43.982837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:43.982841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:43.982846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:43.982850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:43.982854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:43.982858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:43.982863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:43.982868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:43.982872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:43.982877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:43.982887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:43.982896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:43.982905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:43.982912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:43.982920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:43.982926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:43.982931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:43.982937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:43.982943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:43.982949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:43.982954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:43.982961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:43.982966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:43.982972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:43.982977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:43.982983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:43.982989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:43.982995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:43.983001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:43.983008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:43.983013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:43.983019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:43.983025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:43.983031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:43.983036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:43.983042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:43.983085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:43.986442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:43.987109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:43.987123Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:43.987126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:43.987130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:43.987138Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3401 [2:7559603047673851432:13502]
2025-10-10T14:40:43.987155Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:43.987176Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:43.987185Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:43.987189Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:43.987192Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:43.987212Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:43.987226Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:43.987235Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:43.987316Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:43.987325Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:43.987327Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:43.987331Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:43.987405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:43.987413Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:43.987426Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:43.987443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:43.987466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:43.987493Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559603047673851427:13502]
2025-10-10T14:40:43.987501Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559603047673851427:13502]
2025-10-10T14:40:43.987503Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559603047673851427:13502]
2025-10-10T14:40:43.987514Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:43.987535Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:43.987542Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:43.987547Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:43.987550Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:43.987558Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:43.987562Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:43.987574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603048456105620:7195], now have 1 active actors on pipe
2025-10-10T14:40:43.987584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603048456105521:7208], now have 1 active actors on pipe
2025-10-10T14:40:43.987587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603048456105458:2438], now have 1 active actors on pipe
2025-10-10T14:40:43.987623Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559603047673851427:13502]
2025-10-10T14:40:43.987639Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:43.987654Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:43.987669Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3401
2025-10-10T14:40:43.987709Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 35 consumer shared/user session shared/user_1_35_7080413204912763209_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 3401, pipe: [1:7559603048456105521:7208]
2025-10-10T14:40:43.987730Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3401
2025-10-10T14:40:43.987926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:43.987940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:43.987955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_35_7080413204912763209_v1 on pipe: [1:7559603048456105521:7208]
2025-10-10T14:40:43.987986Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_35_7080413204912763209_v1:1 with generation 3401
2025-10-10T14:40:43.987992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:43.987995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:43.988008Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:43.988015Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:43.988020Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:43.988039Z node 2 :PERSQUEUE DEBUG: partition.cpp:3747: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_35_7080413204912763209_v1
2025-10-10T14:40:43.988047Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:43.988100Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ba099950-17099505-ae79363b-572d76f2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:43.988111Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:40:43.988115Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:40:43.992694Z node 2 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:40:43.992733Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:40:43.992745Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:43.992753Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:43.992757Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:43.992771Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:43.992793Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:43.992802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-10T14:40:43.992818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-10T14:40:43.992843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:43.993130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:43.993154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:43.993192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:43.993007Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 35 consumer shared/user session shared/user_1_35_7080413204912763209_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 40 WriteTimestampMS: 1760106661000 SizeLag: 17206678 WriteTimestampEstimateMS: 1760107243987 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-10T14:40:43.993030Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 35 consumer shared/user session shared/user_1_35_7080413204912763209_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 40 readOffset 0 committedOffset 0
2025-10-10T14:40:43.993069Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 35 consumer shared/user session shared/user_1_35_7080413204912763209_v1 sending to client partition status
2025-10-10T14:40:43.993386Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3402 partition: 0 MaxSeqNo: 40 sessionId: src_id|ba099950-17099505-ae79363b-572d76f2_0
2025-10-10T14:40:43.997759Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dcee125f-28cd5dfb-f313bcb7-76dafc2a_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|ba099950-17099505-ae79363b-572d76f2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:44.000658Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ba099950-17099505-ae79363b-572d76f2_0] Write session: try to update token
2025-10-10T14:40:44.000685Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ba099950-17099505-ae79363b-572d76f2_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:44.008006Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:44.008026Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:44.008029Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:44.008032Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:44.008043Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559603047673851427:13502]
2025-10-10T14:40:44.008051Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559603047673851427:13502]
2025-10-10T14:40:44.008055Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559603047673851427:13502]
2025-10-10T14:40:44.008114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:44.008120Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:44.008127Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:44.008130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:44.008131Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:44.008133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:44.008284Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:44.016627Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3402 sessionId: src_id|ba099950-17099505-ae79363b-572d76f2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:44.019390Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:44.132652Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:44.133093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:44.133115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:44.133517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_35_7080413204912763209_v1
2025-10-10T14:40:44.133534Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:44.133885Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_35_7080413204912763209_v1
2025-10-10T14:40:44.136100Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:44.136154Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:40:44.136585Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba099950-17099505-ae79363b-572d76f2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:40:44.136597Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba099950-17099505-ae79363b-572d76f2_0] Write session will restart in 0.007855s
2025-10-10T14:40:44.136629Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba099950-17099505-ae79363b-572d76f2_0] Write session: Do CDS request
2025-10-10T14:40:44.136634Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba099950-17099505-ae79363b-572d76f2_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:44.136233Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3402 reason: status is not ok: tablet will be restarted right now sessionId: src_id|ba099950-17099505-ae79363b-572d76f2_0
2025-10-10T14:40:44.136432Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3402 sessionId: src_id|ba099950-17099505-ae79363b-572d76f2_0 is DEAD
2025-10-10T14:40:44.136786Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 35 consumer shared/user session shared/user_1_35_7080413204912763209_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 0 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559603048456105521:7208]
2025-10-10T14:40:44.145947Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ba099950-17099505-ae79363b-572d76f2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:44.146008Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:44.146030Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3403
2025-10-10T14:40:44.146159Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3403 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:44.146199Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3403 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:44.146210Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3403 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:44.146214Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:44.146688Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3403 sessionId:  describe result for acl check
2025-10-10T14:40:44.146731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:44.146737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:44.146739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:44.146746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559603052751073055:7259] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:44.147277Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559603052751073055:7259] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:44.151049Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559603052751073055:7259] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:44.155837Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559603052751073055:7259] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:44.155853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559603052751073055:7259] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:44.155857Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559603052751073055:7259] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:44.155866Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3403 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:44.162071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:44.164931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:44.165203Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:44.165239Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:44.165258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:44.165356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:44.165414Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559603051968819014:13510]
2025-10-10T14:40:44.166060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:44.166480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:44.166533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:44.166893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:44.166944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:44.166945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:44.166946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:44.166948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:44.166949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:44.166951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:44.166953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:44.166955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:44.166956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:44.166957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:44.166959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:44.166960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:44.166962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:44.166968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:44.166981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:44.166986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:44.166991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:44.166994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:44.166999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:44.167003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:44.167007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:44.167011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:44.167016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:44.167021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:44.167025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:44.167029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:44.167038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:44.167048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:44.167054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:44.167059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:44.167063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:44.167068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:44.167073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:44.167078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:44.167084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:44.167089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:44.167095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:44.167101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:44.167108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:44.167113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:44.167119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:44.167125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:44.167131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:44.167137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:44.167142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:44.167148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:44.167154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:44.167159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:44.167163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:44.167167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:44.167175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:44.167179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:44.167221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:44.172379Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3402
2025-10-10T14:40:44.172400Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3402
2025-10-10T14:40:44.171329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:44.171923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:44.171929Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:44.171932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:44.171937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:44.171944Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3402 [2:7559603051968819014:13510]
2025-10-10T14:40:44.171959Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:44.171980Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:44.171984Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:44.171988Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:44.171990Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:44.172012Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:44.172021Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:44.172029Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:44.172117Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:44.172120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:44.172122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:44.172125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:44.172211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:44.172214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:44.172227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:44.172241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:44.172261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:44.172284Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559603051968819009:13510]
2025-10-10T14:40:44.172290Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559603051968819009:13510]
2025-10-10T14:40:44.172293Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559603051968819009:13510]
2025-10-10T14:40:44.172309Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:44.172320Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:44.172324Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:44.172326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603052751073037:2438], now have 1 active actors on pipe
2025-10-10T14:40:44.172326Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:44.172330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603052751073202:7259], now have 1 active actors on pipe
2025-10-10T14:40:44.172339Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:44.172358Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:44.172362Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:44.172395Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559603051968819009:13510]
2025-10-10T14:40:44.172398Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:44.172417Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:44.172471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:44.172476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:44.172506Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|23861556-93db4cc0-5a9e685f-54792105_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:44.172515Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:44.172519Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:44.172521Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:44.172534Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:44.172545Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:44.172559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:44.172875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:44.172884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:44.172904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:44.173020Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3403 partition: 0 MaxSeqNo: 40 sessionId: src_id|23861556-93db4cc0-5a9e685f-54792105_0
2025-10-10T14:40:44.173547Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba099950-17099505-ae79363b-572d76f2_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|23861556-93db4cc0-5a9e685f-54792105_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:44.176531Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|23861556-93db4cc0-5a9e685f-54792105_0] Write session: try to update token
2025-10-10T14:40:44.176553Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|23861556-93db4cc0-5a9e685f-54792105_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:44.207773Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3403 sessionId: src_id|23861556-93db4cc0-5a9e685f-54792105_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:44.210440Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:44.210731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:44.210756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:44.210802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:40:44.210937Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:40:44.216304Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:44.216320Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:44.216324Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:44.216326Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:44.216336Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559603051968819009:13510]
2025-10-10T14:40:44.216343Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559603051968819009:13510]
2025-10-10T14:40:44.216346Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559603051968819009:13510]
2025-10-10T14:40:44.216397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:44.216404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:44.216406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:44.216405Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:44.216413Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:44.216418Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:44.216541Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:44.233952Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 35 consumer shared/user session shared/user_1_35_7080413204912763209_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559603052751073298:7208]
2025-10-10T14:40:44.234246Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 35 consumer shared/user session shared/user_1_35_7080413204912763209_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 pipe creation result: OK TabletId: 72075186224037892 Generation: 3402, pipe: [1:7559603052751073298:7208]
2025-10-10T14:40:44.333020Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:44.333669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603052751073298:7208], now have 1 active actors on pipe
2025-10-10T14:40:44.341952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:44.341979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:44.342162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:44.342230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:44.342292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:44.342356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:44.342398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:44.342402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:44.342470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:44.342534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:44.342596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:44.342653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:44.342702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:44.342706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:44.342774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:44.342829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:44.342887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:44.342946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:44.342986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:44.342988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:44.345426Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:44.345447Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 35 consumer shared/user session shared/user_1_35_7080413204912763209_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 1 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559603052751073298:7208]
2025-10-10T14:40:44.345484Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:40:44.345487Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:40:44.343051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:44.343103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:44.343160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:44.345531Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3403 reason: error at write: Disconnected sessionId: src_id|23861556-93db4cc0-5a9e685f-54792105_0
2025-10-10T14:40:44.343216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:44.343255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:44.343257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:44.343319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:44.343381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:44.343447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:44.343511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:44.343549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:44.343551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:44.343615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:44.343666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:44.343719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:44.343782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:44.343820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:44.343821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:44.343901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:44.343958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:44.344016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:44.344070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:44.344108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:44.344110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:44.344175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:44.344224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:44.344285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:44.344348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:44.344390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:44.344392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:44.344459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:44.344515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:44.344579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:44.344638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:44.344676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:44.344678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:44.344741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:44.344795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:44.344866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:44.344922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:44.344968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:44.344970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:44.345790Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3403 sessionId: src_id|23861556-93db4cc0-5a9e685f-54792105_0 is DEAD
2025-10-10T14:40:44.345943Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23861556-93db4cc0-5a9e685f-54792105_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:40:44.345955Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23861556-93db4cc0-5a9e685f-54792105_0] Write session will restart in 0.009600s
2025-10-10T14:40:44.345983Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23861556-93db4cc0-5a9e685f-54792105_0] Write session: Do CDS request
2025-10-10T14:40:44.345990Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23861556-93db4cc0-5a9e685f-54792105_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:44.346381Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:44.356947Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|23861556-93db4cc0-5a9e685f-54792105_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:44.357106Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:44.357123Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3404
2025-10-10T14:40:44.357277Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3404 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:44.357344Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3404 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:44.357359Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3404 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:44.357364Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:44.357808Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3404 sessionId:  describe result for acl check
2025-10-10T14:40:44.357845Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:44.357851Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:44.357855Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:44.357861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559603052751073357:7301] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:44.358665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559603052751073357:7301] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:44.363712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559603052751073357:7301] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:44.366973Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559603052751073357:7301] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:44.366992Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559603052751073357:7301] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:44.366996Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559603052751073357:7301] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:44.367005Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3404 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:44.369039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:44.371507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:44.371748Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:44.371760Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:44.371774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:44.371842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:44.371900Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559603051968819264:13519]
2025-10-10T14:40:44.372577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:44.372941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:44.372994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:44.373324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:44.373413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:44.373419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:44.373421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:44.373422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:44.373424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:44.373425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:44.373426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:44.373428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:44.373429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:44.373430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:44.373431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:44.373433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:44.373434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:44.373440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:44.373454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:44.373458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:44.373463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:44.373467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:44.373471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:44.373475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:44.373479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:44.373483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:44.373487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:44.373491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:44.373495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:44.373498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:44.373507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:44.373516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:44.373523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:44.373530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:44.373535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:44.373541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:44.373545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:44.373551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:44.373556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:44.373561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:44.373566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:44.373578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:44.373584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:44.373594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:44.373599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:44.373604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:44.373613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:44.373619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:44.373628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:44.373633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:44.373638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:44.373646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:44.373657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:44.373662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:44.373667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:44.373672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:44.373714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:44.376421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:44.376952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:44.376966Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:44.376969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:44.376974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:44.376981Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3403 [2:7559603051968819264:13519]
2025-10-10T14:40:44.376995Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:44.377015Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:44.377019Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:44.377023Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:44.377025Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:44.377044Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:44.377055Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:44.377069Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:44.377136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:44.377144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:44.377147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:44.377149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:44.377234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:44.377243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:44.377255Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:44.377267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:44.377289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:44.377316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603052751073536:7301], now have 1 active actors on pipe
2025-10-10T14:40:44.377326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603052751073300:2438], now have 1 active actors on pipe
2025-10-10T14:40:44.377351Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559603051968819259:13519]
2025-10-10T14:40:44.377354Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559603051968819259:13519]
2025-10-10T14:40:44.377356Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559603051968819259:13519]
2025-10-10T14:40:44.377403Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3403
2025-10-10T14:40:44.377438Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3403
2025-10-10T14:40:44.377374Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:44.377396Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:44.377398Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:44.377404Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:44.377406Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:44.377412Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:44.377415Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:44.377445Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559603051968819259:13519]
2025-10-10T14:40:44.377454Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:44.377461Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:44.377620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:44.377630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:44.377666Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|11e27a07-e56d1853-faab7d12-927346f6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:44.377675Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:44.377679Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:44.377682Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:44.377695Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:44.377711Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:44.377734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:44.378405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:44.378420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:44.378449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:44.379050Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23861556-93db4cc0-5a9e685f-54792105_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|11e27a07-e56d1853-faab7d12-927346f6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:44.378585Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3404 partition: 0 MaxSeqNo: 40 sessionId: src_id|11e27a07-e56d1853-faab7d12-927346f6_0
2025-10-10T14:40:44.381912Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|11e27a07-e56d1853-faab7d12-927346f6_0] Write session: try to update token
2025-10-10T14:40:44.381932Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|11e27a07-e56d1853-faab7d12-927346f6_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:44.391400Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:40:44.391416Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:44.391427Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559603051968819259:13519]
2025-10-10T14:40:44.391490Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:40:44.391488Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:40:44.391746Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:40:44.391940Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:44.392130Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:44.392302Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:44.392571Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:40:44.392625Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:40:44.400207Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3404 sessionId: src_id|11e27a07-e56d1853-faab7d12-927346f6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:44.403062Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:44.403406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:44.403427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:44.403481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:40:44.403631Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:40:44.414203Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:44.414220Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:44.414223Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:44.414226Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:44.414239Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559603051968819259:13519]
2025-10-10T14:40:44.414243Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559603051968819259:13519]
2025-10-10T14:40:44.414247Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559603051968819259:13519]
2025-10-10T14:40:44.414301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:44.414300Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:44.414310Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:44.414310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:44.414314Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:44.414316Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:44.414461Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:44.445382Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 35 consumer shared/user session shared/user_1_35_7080413204912763209_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559603052751073551:7208]
2025-10-10T14:40:44.445844Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 35 consumer shared/user session shared/user_1_35_7080413204912763209_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 pipe creation result: OK TabletId: 72075186224037892 Generation: 3403, pipe: [1:7559603052751073551:7208]
2025-10-10T14:40:44.533652Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:44.543005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:44.543040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:44.543233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:44.543300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:44.543366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:44.543429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:44.543747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:44.543753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:44.543829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:44.543906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:44.543973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:44.544044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:44.544094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:44.544097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:44.544175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:44.544247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:44.544316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:44.544388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:44.544431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:44.544434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:44.544510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:44.544574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:44.544637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:44.544703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:44.544749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:44.544752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:44.544829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:44.544895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:44.544961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:44.545035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:44.545079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:44.545083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:44.545154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:44.545223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:44.545294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:44.545385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:44.545436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:44.545439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:44.545519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:44.545584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:44.545656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:44.545741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:44.545784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:44.545787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:44.545857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:44.545919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:44.545988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:44.546054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:44.546100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:44.546102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:44.546174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:44.546239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:44.546305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:44.546366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:44.546409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:44.546413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:44.546486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:44.546545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:44.546613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:44.546681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:44.546726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:44.546729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:44.546794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603052751073551:7208], now have 1 active actors on pipe
2025-10-10T14:40:44.548311Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11e27a07-e56d1853-faab7d12-927346f6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:40:44.548327Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11e27a07-e56d1853-faab7d12-927346f6_0] Write session will restart in 0.007902s
2025-10-10T14:40:44.548356Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11e27a07-e56d1853-faab7d12-927346f6_0] Write session: Do CDS request
2025-10-10T14:40:44.548374Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11e27a07-e56d1853-faab7d12-927346f6_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:44.548085Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:44.547710Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:44.547768Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:40:44.547771Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:40:44.547814Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3404 reason: error at write: Disconnected sessionId: src_id|11e27a07-e56d1853-faab7d12-927346f6_0
2025-10-10T14:40:44.547945Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 35 consumer shared/user session shared/user_1_35_7080413204912763209_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 2 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559603052751073551:7208]
2025-10-10T14:40:44.548080Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3404 sessionId: src_id|11e27a07-e56d1853-faab7d12-927346f6_0 is DEAD
2025-10-10T14:40:44.557945Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|11e27a07-e56d1853-faab7d12-927346f6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:44.558444Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:44.558463Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3405
2025-10-10T14:40:44.558620Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3405 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:44.558660Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3405 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:44.558666Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3405 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:44.558682Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:44.559753Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3405 sessionId:  describe result for acl check
2025-10-10T14:40:44.559785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:44.559787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:44.559789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:44.559797Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559603052751073598:7298] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:44.560382Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559603052751073598:7298] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:44.565160Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559603052751073598:7298] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:44.571237Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559603052751073598:7298] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:44.571259Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559603052751073598:7298] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:44.571271Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559603052751073598:7298] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:44.571280Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3405 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:44.582408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:44.587903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:44.588188Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:44.588194Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:44.588206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:44.588263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:44.588307Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559603051968819513:13522]
2025-10-10T14:40:44.588916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:44.589601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:44.589657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:44.590014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:44.590072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:44.590073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:44.590074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:44.590075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:44.590076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:44.590078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:44.590079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:44.590081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:44.590082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:44.590083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:44.590085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:44.590086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:44.590087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:44.590094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:44.590108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:44.590130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:44.590136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:44.590140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:44.590144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:44.590148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:44.590152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:44.590156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:44.590161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:44.590164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:44.590168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:44.590172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:44.590181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:44.590190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:44.590197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:44.590203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:44.590208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:44.590213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:44.590217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:44.590223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:44.590228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:44.590235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:44.590240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:44.590246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:44.590251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:44.590256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:44.590260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:44.590265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:44.590270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:44.590276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:44.590281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:44.590285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:44.590289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:44.590294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:44.590299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:44.590305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:44.590310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:44.590315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:44.590355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:44.593206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:44.594019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:44.594024Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:44.594028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:44.594032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:44.594038Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3404 [2:7559603051968819513:13522]
2025-10-10T14:40:44.594055Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:44.594076Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:44.594080Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:44.594083Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:44.594086Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:44.594104Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:44.594112Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:44.594120Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:44.594187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:44.594189Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:44.594191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:44.594193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:44.594273Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:44.594277Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:44.594289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:44.594299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:44.594314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:44.594337Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559603051968819508:13522]
2025-10-10T14:40:44.594340Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559603051968819508:13522]
2025-10-10T14:40:44.594342Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559603051968819508:13522]
2025-10-10T14:40:44.594354Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:44.594368Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:44.594383Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:44.594386Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:44.594425Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559603051968819508:13522]
2025-10-10T14:40:44.594427Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:44.594511Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:44.594515Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:44.594517Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:44.594524Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:44.595337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603052751073735:7298], now have 1 active actors on pipe
2025-10-10T14:40:44.595355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603052751073555:2438], now have 1 active actors on pipe
2025-10-10T14:40:44.595389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:44.595397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:44.595438Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|97a41a7f-ab19c105-e44723fa-b8dd1b1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:44.595457Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:44.595467Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:44.595471Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:44.595486Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:44.595520Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:44.595546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:44.594908Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3404
2025-10-10T14:40:44.594946Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3404
2025-10-10T14:40:44.606121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:44.606171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:44.606226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:44.610088Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11e27a07-e56d1853-faab7d12-927346f6_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|97a41a7f-ab19c105-e44723fa-b8dd1b1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:44.613149Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|97a41a7f-ab19c105-e44723fa-b8dd1b1_0] Write session: try to update token
2025-10-10T14:40:44.613179Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|97a41a7f-ab19c105-e44723fa-b8dd1b1_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:44.609592Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3405 partition: 0 MaxSeqNo: 40 sessionId: src_id|97a41a7f-ab19c105-e44723fa-b8dd1b1_0
2025-10-10T14:40:44.619703Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:44.619725Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:44.619730Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:44.619732Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:44.619744Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559603051968819508:13522]
2025-10-10T14:40:44.619749Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559603051968819508:13522]
2025-10-10T14:40:44.619754Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559603051968819508:13522]
2025-10-10T14:40:44.619814Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:44.619818Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:44.619822Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:44.619825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:44.619825Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:44.619830Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:44.619995Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:44.633400Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3405 sessionId: src_id|97a41a7f-ab19c105-e44723fa-b8dd1b1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:44.636552Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:44.648165Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 35 consumer shared/user session shared/user_1_35_7080413204912763209_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559603052751073809:7208]
2025-10-10T14:40:44.648509Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 35 consumer shared/user session shared/user_1_35_7080413204912763209_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 pipe creation result: OK TabletId: 72075186224037892 Generation: 3404, pipe: [1:7559603052751073809:7208]
2025-10-10T14:40:44.749237Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:44.749862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:44.749878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:44.749926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603052751073809:7208], now have 1 active actors on pipe
2025-10-10T14:40:44.750159Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:44.750271Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 35 consumer shared/user session shared/user_1_35_7080413204912763209_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 3 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559603052751073809:7208]
2025-10-10T14:40:44.750314Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:40:44.750412Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:44.750485Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3405 reason: status is not ok: tablet will be restarted right now sessionId: src_id|97a41a7f-ab19c105-e44723fa-b8dd1b1_0
2025-10-10T14:40:44.750733Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3405 sessionId: src_id|97a41a7f-ab19c105-e44723fa-b8dd1b1_0 is DEAD
2025-10-10T14:40:44.750950Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97a41a7f-ab19c105-e44723fa-b8dd1b1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:40:44.750962Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97a41a7f-ab19c105-e44723fa-b8dd1b1_0] Write session will restart in 0.005932s
2025-10-10T14:40:44.750989Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97a41a7f-ab19c105-e44723fa-b8dd1b1_0] Write session: Do CDS request
2025-10-10T14:40:44.751006Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97a41a7f-ab19c105-e44723fa-b8dd1b1_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:44.757925Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|97a41a7f-ab19c105-e44723fa-b8dd1b1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:44.758442Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:44.758459Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3406
2025-10-10T14:40:44.758623Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3406 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:44.758659Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3406 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:44.758664Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3406 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:44.758669Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:44.759170Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3406 sessionId:  describe result for acl check
2025-10-10T14:40:44.759207Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:44.759209Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:44.759212Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:44.759219Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559603052751073833:7320] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:44.759807Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559603052751073833:7320] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:44.762123Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559603052751073833:7320] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:44.766901Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559603052751073833:7320] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:44.766920Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559603052751073833:7320] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:44.766924Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559603052751073833:7320] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:44.766933Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3406 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:44.775852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:44.779044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:44.779345Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:44.779357Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:44.779372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:44.779449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:44.779513Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559603051968819763:13524]
2025-10-10T14:40:44.780261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:44.780665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:44.780735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:44.781113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:44.781177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:44.781183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:44.781185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:44.781186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:44.781188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:44.781189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:44.781190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:44.781191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:44.781193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:44.781194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:44.781196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:44.781197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:44.781198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:44.781205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:44.781219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:44.781224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:44.781228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:44.781232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:44.781235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:44.781238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:44.781241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:44.781245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:44.781249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:44.781253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:44.781256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:44.781260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:44.781272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:44.781281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:44.781288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:44.781293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:44.781298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:44.781303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:44.781308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:44.781314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:44.781319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:44.781325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:44.781347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:44.781353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:44.781358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:44.781363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:44.781366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:44.781372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:44.781376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:44.781383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:44.781388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:44.781394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:44.781409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:44.781420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:44.781424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:44.781430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:44.781444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:44.781449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:44.781492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:44.784144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:44.784902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:44.784913Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:44.784916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:44.784920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:44.784927Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3405 [2:7559603051968819763:13524]
2025-10-10T14:40:44.784942Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:44.784961Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:44.784964Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:44.784968Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:44.784971Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:44.784987Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:44.785000Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:44.785009Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:44.785072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:44.785079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:44.785081Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:44.785084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:44.785157Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:44.785164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:44.785174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:44.785186Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:44.785203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:44.785230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603052751073813:2438], now have 1 active actors on pipe
2025-10-10T14:40:44.785238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603052751073914:7320], now have 1 active actors on pipe
2025-10-10T14:40:44.785246Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559603051968819758:13524]
2025-10-10T14:40:44.785253Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559603051968819758:13524]
2025-10-10T14:40:44.785255Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559603051968819758:13524]
2025-10-10T14:40:44.785270Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:44.785285Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:44.785301Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:44.785302Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:44.785307Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:44.785309Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:44.785277Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3405
2025-10-10T14:40:44.785309Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:44.785303Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3405
2025-10-10T14:40:44.785354Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559603051968819758:13524]
2025-10-10T14:40:44.785358Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:44.785366Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:44.785554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:44.785564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:44.785596Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|83e7ac64-9bda0176-43c48eae-2f4e723b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:44.785605Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:44.785609Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:44.785611Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:44.785623Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:44.785644Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:44.785658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:44.785837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:44.785844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:44.785862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:44.786101Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3406 partition: 0 MaxSeqNo: 40 sessionId: src_id|83e7ac64-9bda0176-43c48eae-2f4e723b_0
2025-10-10T14:40:44.786530Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97a41a7f-ab19c105-e44723fa-b8dd1b1_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|83e7ac64-9bda0176-43c48eae-2f4e723b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:44.789290Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|83e7ac64-9bda0176-43c48eae-2f4e723b_0] Write session: try to update token
2025-10-10T14:40:44.789309Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|83e7ac64-9bda0176-43c48eae-2f4e723b_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:44.809847Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:44.809872Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:44.809876Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:44.809879Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:44.809890Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559603051968819758:13524]
2025-10-10T14:40:44.809895Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559603051968819758:13524]
2025-10-10T14:40:44.809899Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559603051968819758:13524]
2025-10-10T14:40:44.809953Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:44.809962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:44.809965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:44.809966Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:44.809973Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:44.809977Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:44.810126Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:44.811561Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3406 sessionId: src_id|83e7ac64-9bda0176-43c48eae-2f4e723b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:44.814448Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:44.850376Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 35 consumer shared/user session shared/user_1_35_7080413204912763209_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559603052751074072:7208]
2025-10-10T14:40:44.850568Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 35 consumer shared/user session shared/user_1_35_7080413204912763209_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 pipe creation result: OK TabletId: 72075186224037892 Generation: 3405, pipe: [1:7559603052751074072:7208]
2025-10-10T14:40:44.932131Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:44.932631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:44.932653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:44.932706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603052751074072:7208], now have 1 active actors on pipe
2025-10-10T14:40:44.932958Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:44.933088Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:44.933089Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:40:44.933094Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:40:44.933161Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3406 reason: error at write: Disconnected sessionId: src_id|83e7ac64-9bda0176-43c48eae-2f4e723b_0
2025-10-10T14:40:44.933163Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 35 consumer shared/user session shared/user_1_35_7080413204912763209_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 4 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559603052751074072:7208]
2025-10-10T14:40:44.933557Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83e7ac64-9bda0176-43c48eae-2f4e723b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:40:44.933569Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83e7ac64-9bda0176-43c48eae-2f4e723b_0] Write session will restart in 0.007321s
2025-10-10T14:40:44.933596Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83e7ac64-9bda0176-43c48eae-2f4e723b_0] Write session: Do CDS request
2025-10-10T14:40:44.933612Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83e7ac64-9bda0176-43c48eae-2f4e723b_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:44.933389Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3406 sessionId: src_id|83e7ac64-9bda0176-43c48eae-2f4e723b_0 is DEAD
2025-10-10T14:40:44.941753Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|83e7ac64-9bda0176-43c48eae-2f4e723b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:44.941908Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:44.941926Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3407
2025-10-10T14:40:44.942062Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3407 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:44.942095Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3407 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:44.942101Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3407 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:44.942106Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:44.942642Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3407 sessionId:  describe result for acl check
2025-10-10T14:40:44.942691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:44.942693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:44.942699Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:44.942706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559603052751074089:7334] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:44.943346Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559603052751074089:7334] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:44.946526Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559603052751074089:7334] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:44.950045Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559603052751074089:7334] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:44.950061Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559603052751074089:7334] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:44.950066Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559603052751074089:7334] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:44.950077Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3407 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:44.963928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:44.966652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:44.966909Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:44.966924Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:44.966937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:44.966997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:44.967206Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559603051968820025:13527]
2025-10-10T14:40:44.967829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:44.968251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:44.968314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:44.968676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:44.968755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:44.968772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:44.968773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:44.968775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:44.968776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:44.968778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:44.968779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:44.968781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:44.968782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:44.968783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:44.968785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:44.968786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:44.968787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:44.968794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:44.968808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:44.968813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:44.968818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:44.968823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:44.968828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:44.968832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:44.968836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:44.968841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:44.968845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:44.968849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:44.968853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:44.968857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:44.968868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:44.968882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:44.968890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:44.968896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:44.968900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:44.968906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:44.968912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:44.968924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:44.968930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:44.968936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:44.968945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:44.968951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:44.968957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:44.968968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:44.968973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:44.968979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:44.968983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:44.968991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:44.968995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:44.969000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:44.969004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:44.969009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:44.969014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:44.969025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:44.969041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:44.969051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:44.969093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:44.971765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:44.972387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:44.972401Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:44.972404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:44.972408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:44.972416Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3406 [2:7559603051968820025:13527]
2025-10-10T14:40:44.972431Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:44.972455Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:44.972464Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:44.972467Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:44.972470Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:44.972487Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:44.972496Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:44.972504Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:44.972567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:44.972574Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:44.972577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:44.972579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:44.972653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:44.972664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:44.972676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:44.972689Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:44.972709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:44.972732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603052751074131:7334], now have 1 active actors on pipe
2025-10-10T14:40:44.972742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603052751074082:2438], now have 1 active actors on pipe
2025-10-10T14:40:44.972751Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559603051968820020:13527]
2025-10-10T14:40:44.972754Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559603051968820020:13527]
2025-10-10T14:40:44.972756Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559603051968820020:13527]
2025-10-10T14:40:44.972770Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:44.972784Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:44.972791Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:44.972794Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:44.972799Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:44.972807Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:44.972810Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:44.972836Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559603051968820020:13527]
2025-10-10T14:40:44.972847Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:44.972853Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:44.972835Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3406
2025-10-10T14:40:44.972843Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3406
2025-10-10T14:40:44.972943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:44.972954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:44.972986Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|80caf414-a6ea1d31-fe20ae0-45ef9ac7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:44.972999Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:44.973004Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:44.973006Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:44.973020Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:44.973031Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:44.973045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:44.973192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:44.973201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:44.973216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:44.973346Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3407 partition: 0 MaxSeqNo: 40 sessionId: src_id|80caf414-a6ea1d31-fe20ae0-45ef9ac7_0
2025-10-10T14:40:44.973782Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83e7ac64-9bda0176-43c48eae-2f4e723b_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|80caf414-a6ea1d31-fe20ae0-45ef9ac7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:44.976552Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|80caf414-a6ea1d31-fe20ae0-45ef9ac7_0] Write session: try to update token
2025-10-10T14:40:44.976571Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|80caf414-a6ea1d31-fe20ae0-45ef9ac7_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:44.985547Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:40:44.985563Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:44.985575Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559603051968820020:13527]
2025-10-10T14:40:44.985633Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:40:44.985632Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:40:44.985845Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:40:44.986005Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:44.986163Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:44.986311Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:44.986511Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:40:44.986558Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:40:44.992280Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3407 sessionId: src_id|80caf414-a6ea1d31-fe20ae0-45ef9ac7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:44.995476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:44.995498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:44.995557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:40:44.995227Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:44.995677Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:40:45.004413Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:45.004435Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:45.004439Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:45.004441Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:45.004454Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559603051968820020:13527]
2025-10-10T14:40:45.004459Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559603051968820020:13527]
2025-10-10T14:40:45.004464Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559603051968820020:13527]
2025-10-10T14:40:45.004519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:45.004527Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:45.004533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:45.004535Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:45.004535Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:45.004540Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:45.004686Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:45.033161Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 35 consumer shared/user session shared/user_1_35_7080413204912763209_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559603057046041634:7208]
2025-10-10T14:40:45.033499Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 35 consumer shared/user session shared/user_1_35_7080413204912763209_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 pipe creation result: OK TabletId: 72075186224037892 Generation: 3406, pipe: [1:7559603057046041634:7208]
2025-10-10T14:40:45.123887Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:45.132752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:45.132785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:45.132981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:45.133050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:45.133122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:45.133190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:45.133231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:45.133238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:45.133312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:45.133482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:45.133557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:45.136976Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|80caf414-a6ea1d31-fe20ae0-45ef9ac7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:40:45.136996Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|80caf414-a6ea1d31-fe20ae0-45ef9ac7_0] Write session will restart in 0.006084s
2025-10-10T14:40:45.137025Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|80caf414-a6ea1d31-fe20ae0-45ef9ac7_0] Write session: Do CDS request
2025-10-10T14:40:45.137032Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|80caf414-a6ea1d31-fe20ae0-45ef9ac7_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:45.133630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:45.133681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:45.133685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:45.133755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:45.133818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:45.133883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:45.133948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:45.133988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:45.133991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:45.134065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:45.134129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:45.134187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:45.134247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:45.134291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:45.134297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:45.136484Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 35 consumer shared/user session shared/user_1_35_7080413204912763209_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 5 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559603057046041634:7208]
2025-10-10T14:40:45.136517Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:45.136528Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:40:45.136533Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:40:45.136570Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3407 reason: error at write: Disconnected sessionId: src_id|80caf414-a6ea1d31-fe20ae0-45ef9ac7_0
2025-10-10T14:40:45.136817Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3407 sessionId: src_id|80caf414-a6ea1d31-fe20ae0-45ef9ac7_0 is DEAD
2025-10-10T14:40:45.134368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:45.134433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:45.134493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:45.134554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:45.134596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:45.134599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:45.134679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:45.134741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:45.134803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:45.134864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:45.134912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:45.134916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:45.134984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:45.135042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:45.135106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:45.135173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:45.135226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:45.135228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:45.135299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:45.135361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:45.135426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:45.135494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:45.135536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:45.135542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:45.135612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:45.135675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:45.135733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:45.135793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:45.135837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:45.135840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:45.135928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:45.135996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:45.136054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:45.136120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:45.136169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:45.136172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:45.136246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603057046041634:7208], now have 1 active actors on pipe
2025-10-10T14:40:45.137298Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:45.143933Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|80caf414-a6ea1d31-fe20ae0-45ef9ac7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:45.144009Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:45.144028Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3408
2025-10-10T14:40:45.144240Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3408 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:45.144274Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3408 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:45.144279Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3408 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:45.144283Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:45.144820Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3408 sessionId:  describe result for acl check
2025-10-10T14:40:45.144862Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:45.144873Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:45.144875Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:45.144881Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559603057046041667:7382] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:45.145535Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559603057046041667:7382] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:45.148408Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559603057046041667:7382] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:45.152915Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559603057046041667:7382] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:45.152933Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559603057046041667:7382] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:45.152936Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559603057046041667:7382] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:45.152957Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3408 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:45.166307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:45.168656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:45.169012Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:45.169029Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:45.169045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:45.169127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:45.169176Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559603056263787585:13529]
2025-10-10T14:40:45.169839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:45.170928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:45.170994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:45.171362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:45.171429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:45.171430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:45.171432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:45.171433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:45.171434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:45.171435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:45.171437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:45.171438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:45.171439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:45.171440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:45.171441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:45.171442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:45.171444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:45.171450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:45.171464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:45.171469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:45.171473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:45.171477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:45.171481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:45.171485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:45.171490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:45.171494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:45.171498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:45.171502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:45.171506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:45.171510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:45.171517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:45.171527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:45.171533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:45.171539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:45.171543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:45.171561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:45.171566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:45.171572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:45.171577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:45.171582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:45.171587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:45.171593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:45.171601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:45.171606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:45.171611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:45.171616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:45.171623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:45.171627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:45.171630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:45.171633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:45.171636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:45.171640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:45.171642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:45.171645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:45.171648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:45.171651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:45.171684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:45.174296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:45.174921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:45.174937Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:45.174940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:45.174945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:45.174951Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3407 [2:7559603056263787585:13529]
2025-10-10T14:40:45.174965Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:45.174988Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:45.174992Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:45.174995Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:45.174998Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:45.175015Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:45.175028Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:45.175036Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:45.175099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:45.175107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:45.175109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:45.175112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:45.175180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:45.175190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:45.175203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:45.175220Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:45.175242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:45.175270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603057046041806:7382], now have 1 active actors on pipe
2025-10-10T14:40:45.175278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603057046041649:2438], now have 1 active actors on pipe
2025-10-10T14:40:45.175286Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559603056263787580:13529]
2025-10-10T14:40:45.175293Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559603056263787580:13529]
2025-10-10T14:40:45.175296Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559603056263787580:13529]
2025-10-10T14:40:45.175312Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:45.175331Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:45.175352Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:45.175360Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:45.175390Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559603056263787580:13529]
2025-10-10T14:40:45.175396Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:45.175337Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3407
2025-10-10T14:40:45.175369Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3407
2025-10-10T14:40:45.175552Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:45.175558Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:45.175560Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:45.175566Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:45.175656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:45.175665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:45.175695Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7740e46e-bdbf5aeb-88b67159-ec72cbc5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:45.175703Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:45.175706Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:45.175708Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:45.175718Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:45.175729Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:45.175741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:45.175990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:45.176004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:45.176022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:45.176245Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3408 partition: 0 MaxSeqNo: 40 sessionId: src_id|7740e46e-bdbf5aeb-88b67159-ec72cbc5_0
2025-10-10T14:40:45.176715Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|80caf414-a6ea1d31-fe20ae0-45ef9ac7_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|7740e46e-bdbf5aeb-88b67159-ec72cbc5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:45.179650Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7740e46e-bdbf5aeb-88b67159-ec72cbc5_0] Write session: try to update token
2025-10-10T14:40:45.179676Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7740e46e-bdbf5aeb-88b67159-ec72cbc5_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:45.197100Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:45.197121Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:45.197125Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:45.197127Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:45.197137Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559603056263787580:13529]
2025-10-10T14:40:45.197142Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559603056263787580:13529]
2025-10-10T14:40:45.197146Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559603056263787580:13529]
2025-10-10T14:40:45.197205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:45.197220Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:45.197227Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:45.197231Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:45.197232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:45.197234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:45.197405Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:45.196695Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3408 sessionId: src_id|7740e46e-bdbf5aeb-88b67159-ec72cbc5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:45.199491Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:45.237524Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 35 consumer shared/user session shared/user_1_35_7080413204912763209_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559603057046041930:7208]
2025-10-10T14:40:45.237905Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 35 consumer shared/user session shared/user_1_35_7080413204912763209_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 pipe creation result: OK TabletId: 72075186224037892 Generation: 3407, pipe: [1:7559603057046041930:7208]
2025-10-10T14:40:45.315791Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:45.316239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:45.316251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:45.316300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603057046041930:7208], now have 1 active actors on pipe
2025-10-10T14:40:45.316815Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 35 consumer shared/user session shared/user_1_35_7080413204912763209_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 6 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559603057046041930:7208]
2025-10-10T14:40:45.316852Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:40:45.316854Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:40:45.316901Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3408 reason: error at write: Disconnected sessionId: src_id|7740e46e-bdbf5aeb-88b67159-ec72cbc5_0
2025-10-10T14:40:45.316599Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:45.317126Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3408 sessionId: src_id|7740e46e-bdbf5aeb-88b67159-ec72cbc5_0 is DEAD
2025-10-10T14:40:45.317289Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:45.317317Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7740e46e-bdbf5aeb-88b67159-ec72cbc5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:40:45.317338Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7740e46e-bdbf5aeb-88b67159-ec72cbc5_0] Write session will restart in 0.009534s
2025-10-10T14:40:45.317365Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7740e46e-bdbf5aeb-88b67159-ec72cbc5_0] Write session: Do CDS request
2025-10-10T14:40:45.317375Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7740e46e-bdbf5aeb-88b67159-ec72cbc5_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:45.327965Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7740e46e-bdbf5aeb-88b67159-ec72cbc5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:45.333568Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:45.333605Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3409
2025-10-10T14:40:45.335057Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3409 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:45.335116Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3409 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:45.335123Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3409 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:45.335128Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:45.335694Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3409 sessionId:  describe result for acl check
2025-10-10T14:40:45.335741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:45.335749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:45.335752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:45.335759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559603057046042015:7457] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:45.336528Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559603057046042015:7457] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:45.341344Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559603057046042015:7457] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:45.345489Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559603057046042015:7457] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:45.345511Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559603057046042015:7457] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:45.345515Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559603057046042015:7457] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:45.345525Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3409 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:45.346568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:45.350014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:45.350272Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:45.350278Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:45.350292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:45.350363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:45.350406Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559603056263787863:13544]
2025-10-10T14:40:45.351054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:45.351414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:45.351467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:45.351816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:45.351901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:45.351902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:45.351904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:45.351905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:45.351907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:45.351908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:45.351910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:45.351911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:45.351912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:45.351913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:45.351915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:45.351917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:45.351918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:45.351924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:45.351939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:45.351943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:45.351946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:45.351950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:45.351954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:45.351959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:45.351963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:45.351968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:45.351973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:45.351977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:45.351981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:45.351984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:45.351994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:45.352003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:45.352010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:45.352019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:45.352024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:45.352030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:45.352036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:45.352041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:45.352047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:45.352053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:45.352058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:45.352063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:45.352069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:45.352074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:45.352079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:45.352084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:45.352090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:45.352096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:45.352102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:45.352108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:45.352113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:45.352117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:45.352121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:45.352127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:45.352132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:45.352138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:45.352183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:45.354713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:45.355213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:45.355220Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:45.355223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:45.355228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:45.355235Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3408 [2:7559603056263787863:13544]
2025-10-10T14:40:45.355251Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:45.355273Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:45.355278Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:45.355282Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:45.355285Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:45.355303Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:45.355313Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:45.355322Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:45.355390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:45.355392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:45.355395Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:45.355398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:45.355480Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:45.355483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:45.355498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:45.355510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:45.355530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:45.355553Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559603056263787858:13544]
2025-10-10T14:40:45.355557Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559603056263787858:13544]
2025-10-10T14:40:45.355559Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559603056263787858:13544]
2025-10-10T14:40:45.355569Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:45.355578Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:45.355581Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:45.355584Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:45.355584Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:45.355603Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:45.355607Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:45.355620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603057046041933:2438], now have 1 active actors on pipe
2025-10-10T14:40:45.355625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603057046042174:7457], now have 1 active actors on pipe
2025-10-10T14:40:45.355658Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559603056263787858:13544]
2025-10-10T14:40:45.355669Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:45.355677Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:45.356144Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3408
2025-10-10T14:40:45.356192Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3408
2025-10-10T14:40:45.357283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:45.357298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:45.357352Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|71877a52-add5d927-c3cd1094-9f465838_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:45.357367Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:45.357373Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:45.357377Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:45.357392Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:45.357412Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:45.357432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:45.358140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:45.358162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:45.358186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:45.358647Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3409 partition: 0 MaxSeqNo: 40 sessionId: src_id|71877a52-add5d927-c3cd1094-9f465838_0
2025-10-10T14:40:45.359817Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7740e46e-bdbf5aeb-88b67159-ec72cbc5_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|71877a52-add5d927-c3cd1094-9f465838_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:45.362643Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|71877a52-add5d927-c3cd1094-9f465838_0] Write session: try to update token
2025-10-10T14:40:45.362668Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|71877a52-add5d927-c3cd1094-9f465838_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:45.380095Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:45.380128Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:45.380132Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:45.380134Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:45.380147Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559603056263787858:13544]
2025-10-10T14:40:45.380152Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559603056263787858:13544]
2025-10-10T14:40:45.380156Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559603056263787858:13544]
2025-10-10T14:40:45.380215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:45.380224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:45.380223Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:45.380227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:45.380231Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:45.380237Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:45.380390Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:45.385421Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3409 sessionId: src_id|71877a52-add5d927-c3cd1094-9f465838_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:45.388744Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:45.415139Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 35 consumer shared/user session shared/user_1_35_7080413204912763209_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559603057046042188:7208]
2025-10-10T14:40:45.416283Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 35 consumer shared/user session shared/user_1_35_7080413204912763209_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 pipe creation result: OK TabletId: 72075186224037892 Generation: 3408, pipe: [1:7559603057046042188:7208]
2025-10-10T14:40:45.500260Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:45.500953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:45.500963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:45.501006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603057046042188:7208], now have 1 active actors on pipe
2025-10-10T14:40:45.501265Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:45.501439Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:45.501500Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:40:45.501581Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3409 reason: status is not ok: tablet will be restarted right now sessionId: src_id|71877a52-add5d927-c3cd1094-9f465838_0
2025-10-10T14:40:45.501806Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3409 sessionId: src_id|71877a52-add5d927-c3cd1094-9f465838_0 is DEAD
2025-10-10T14:40:45.501963Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 35 consumer shared/user session shared/user_1_35_7080413204912763209_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 7 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559603057046042188:7208]
2025-10-10T14:40:45.502196Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71877a52-add5d927-c3cd1094-9f465838_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:40:45.502209Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71877a52-add5d927-c3cd1094-9f465838_0] Write session will restart in 0.009256s
2025-10-10T14:40:45.502236Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71877a52-add5d927-c3cd1094-9f465838_0] Write session: Do CDS request
2025-10-10T14:40:45.502243Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71877a52-add5d927-c3cd1094-9f465838_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:45.514229Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|71877a52-add5d927-c3cd1094-9f465838_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:45.517936Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:45.517953Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3410
2025-10-10T14:40:45.521559Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3410 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:45.521618Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3410 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:45.521624Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3410 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:45.521630Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:45.522856Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3410 sessionId:  describe result for acl check
2025-10-10T14:40:45.522906Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:45.522915Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:45.522917Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:45.522924Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559603057046042200:7469] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:45.523550Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559603057046042200:7469] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:45.527042Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559603057046042200:7469] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:45.530261Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559603057046042200:7469] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:45.530282Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559603057046042200:7469] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:45.530286Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559603057046042200:7469] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:45.530297Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3410 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:45.544747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:45.547957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:45.548255Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:45.548267Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:45.548280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:45.548351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:45.548403Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559603056263788118:13547]
2025-10-10T14:40:45.549049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:45.549729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:45.549799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:45.550178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:45.550274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:45.550282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:45.550284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:45.550285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:45.550286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:45.550289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:45.550290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:45.550291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:45.550293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:45.550294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:45.550296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:45.550297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:45.550298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:45.550312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:45.550327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:45.550331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:45.550336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:45.550340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:45.550345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:45.550349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:45.550354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:45.550358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:45.550376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:45.550381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:45.550385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:45.550390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:45.550401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:45.550411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:45.550424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:45.550431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:45.550437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:45.550444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:45.550450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:45.550462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:45.550469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:45.550481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:45.550488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:45.550500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:45.550506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:45.550515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:45.550521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:45.550527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:45.550533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:45.550539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:45.550544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:45.550551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:45.550555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:45.550561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:45.550581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:45.550593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:45.550599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:45.550609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:45.550660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:45.553619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:45.554399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:45.554416Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:45.554419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:45.554424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:45.554433Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3409 [2:7559603056263788118:13547]
2025-10-10T14:40:45.554451Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:45.554473Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:45.554478Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:45.554482Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:45.554485Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:45.554505Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:45.554521Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:45.554535Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:45.554612Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:45.554620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:45.554623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:45.554626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:45.554701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:45.554709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:45.554723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:45.554735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:45.554752Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:45.554774Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559603056263788113:13547]
2025-10-10T14:40:45.554777Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559603056263788113:13547]
2025-10-10T14:40:45.554780Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559603056263788113:13547]
2025-10-10T14:40:45.554796Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:45.554815Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:45.554833Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:45.554837Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:45.554867Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:45.554871Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:45.554873Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:45.554878Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559603056263788113:13547]
2025-10-10T14:40:45.554881Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:45.554956Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:45.555004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603057046042190:2438], now have 1 active actors on pipe
2025-10-10T14:40:45.555047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603057046042243:7469], now have 1 active actors on pipe
2025-10-10T14:40:45.555124Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3409
2025-10-10T14:40:45.555136Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3409
2025-10-10T14:40:45.555265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:45.555282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:45.555318Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bafef764-b649a528-c34ec201-96b157bf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:45.555333Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:45.555346Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:45.555350Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:45.555363Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:45.555382Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:45.555406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:45.555650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:45.555659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:45.555678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:45.555841Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3410 partition: 0 MaxSeqNo: 40 sessionId: src_id|bafef764-b649a528-c34ec201-96b157bf_0
2025-10-10T14:40:45.557642Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71877a52-add5d927-c3cd1094-9f465838_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|bafef764-b649a528-c34ec201-96b157bf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:45.560630Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bafef764-b649a528-c34ec201-96b157bf_0] Write session: try to update token
2025-10-10T14:40:45.560654Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bafef764-b649a528-c34ec201-96b157bf_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:45.576422Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:40:45.576442Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:45.576454Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559603056263788113:13547]
2025-10-10T14:40:45.576518Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:40:45.576516Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:40:45.576717Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:40:45.576880Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:45.577018Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:45.577157Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:45.577372Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:40:45.577417Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:40:45.579911Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3410 sessionId: src_id|bafef764-b649a528-c34ec201-96b157bf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:45.584080Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:45.584362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:45.584389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:45.584433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:40:45.584570Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:40:45.590491Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:45.590511Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:45.590515Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:45.590518Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:45.590529Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559603056263788113:13547]
2025-10-10T14:40:45.590533Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559603056263788113:13547]
2025-10-10T14:40:45.590537Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559603056263788113:13547]
2025-10-10T14:40:45.590590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:45.590599Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:45.590602Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:45.590612Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:45.590628Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:45.590633Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:45.590750Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:45.602033Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 35 consumer shared/user session shared/user_1_35_7080413204912763209_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559603057046042447:7208]
2025-10-10T14:40:45.603743Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 35 consumer shared/user session shared/user_1_35_7080413204912763209_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 pipe creation result: OK TabletId: 72075186224037892 Generation: 3409, pipe: [1:7559603057046042447:7208]
2025-10-10T14:40:45.718493Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:45.719122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603057046042447:7208], now have 1 active actors on pipe
2025-10-10T14:40:45.727358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:45.727391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:45.727588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:45.727653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:45.727721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:45.727788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:45.727846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:45.727858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:45.727942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:45.728009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:45.728069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:45.728132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:45.728269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:45.728273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:45.728344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:45.728399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:45.728462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:45.728522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:45.728564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:45.728567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:45.728635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:45.728692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:45.728749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:45.728809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:45.728852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:45.728855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:45.728917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:45.728970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:45.729026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:45.729082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:45.729123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:45.729126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:45.729190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:45.729245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:45.729304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:45.729539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:45.729588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:45.729597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:45.729661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:45.729719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:45.729784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:45.729846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:45.729895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:45.729903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:45.729974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:45.730044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:45.730110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:45.730179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:45.730233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:45.730245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:45.730314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:45.730379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:45.730441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:45.730509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:45.730556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:45.730565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:45.730632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:45.730693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:45.730757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:45.730825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:45.730875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:45.730882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:45.731283Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:45.731332Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 35 consumer shared/user session shared/user_1_35_7080413204912763209_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 8 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559603057046042447:7208]
2025-10-10T14:40:45.731347Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:40:45.731351Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:40:45.731391Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3410 reason: error at write: Disconnected sessionId: src_id|bafef764-b649a528-c34ec201-96b157bf_0
2025-10-10T14:40:45.731609Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3410 sessionId: src_id|bafef764-b649a528-c34ec201-96b157bf_0 is DEAD
2025-10-10T14:40:45.731746Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bafef764-b649a528-c34ec201-96b157bf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:40:45.731757Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bafef764-b649a528-c34ec201-96b157bf_0] Write session will restart in 0.008215s
2025-10-10T14:40:45.731783Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bafef764-b649a528-c34ec201-96b157bf_0] Write session: Do CDS request
2025-10-10T14:40:45.731789Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bafef764-b649a528-c34ec201-96b157bf_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:45.732119Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:45.740985Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bafef764-b649a528-c34ec201-96b157bf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:45.741104Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:45.741135Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3411
2025-10-10T14:40:45.741277Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3411 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:45.741339Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3411 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:45.741351Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3411 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:45.741356Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:45.741889Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3411 sessionId:  describe result for acl check
2025-10-10T14:40:45.741932Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:45.741941Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:45.741944Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:45.741951Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559603057046042474:7493] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:45.742553Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559603057046042474:7493] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:45.746715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559603057046042474:7493] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:45.750246Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559603057046042474:7493] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:45.750263Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559603057046042474:7493] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:45.750267Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559603057046042474:7493] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:45.750276Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3411 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:45.754594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:45.757492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:45.757718Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:45.757732Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:45.757744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:45.757809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:45.757873Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559603056263788372:13549]
2025-10-10T14:40:45.758531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:45.758893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:45.758947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:45.759294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:45.759370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:45.759377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:45.759378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:45.759380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:45.759381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:45.759382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:45.759383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:45.759385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:45.759387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:45.759388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:45.759389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:45.759391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:45.759392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:45.759399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:45.759414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:45.759418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:45.759422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:45.759427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:45.759432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:45.759436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:45.759440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:45.759444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:45.759449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:45.759453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:45.759456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:45.759461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:45.759470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:45.759479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:45.759486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:45.759497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:45.759503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:45.759508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:45.759518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:45.759524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:45.759530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:45.759538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:45.759543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:45.759549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:45.759555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:45.759561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:45.759571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:45.759576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:45.759581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:45.759592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:45.759597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:45.759602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:45.759614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:45.759620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:45.759625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:45.759631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:45.759636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:45.759642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:45.759686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:45.762329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:45.763071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:45.763081Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:45.763084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:45.763088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:45.763102Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3410 [2:7559603056263788372:13549]
2025-10-10T14:40:45.763116Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:45.763136Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:45.763145Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:45.763148Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:45.763151Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:45.763169Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:45.763176Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:45.763185Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:45.763241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:45.763248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:45.763251Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:45.763254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:45.763324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:45.763331Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:45.763344Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:45.763362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:45.763383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:45.763411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603057046042450:2438], now have 1 active actors on pipe
2025-10-10T14:40:45.763420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603057046042648:7493], now have 1 active actors on pipe
2025-10-10T14:40:45.763429Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559603056263788367:13549]
2025-10-10T14:40:45.763436Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559603056263788367:13549]
2025-10-10T14:40:45.763438Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559603056263788367:13549]
2025-10-10T14:40:45.763453Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:45.763475Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:45.763482Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:45.763486Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:45.763465Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3410
2025-10-10T14:40:45.763488Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:45.763502Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3410
2025-10-10T14:40:45.763491Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:45.763494Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:45.763520Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559603056263788367:13549]
2025-10-10T14:40:45.763523Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:45.763537Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:45.763560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:45.763570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:45.763606Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|326631b4-59956604-98e1fca5-902fdba4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:45.763621Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:45.763629Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:45.763632Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:45.763645Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:45.763657Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:45.763672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:45.763843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:45.763857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:45.763903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:45.764001Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3411 partition: 0 MaxSeqNo: 40 sessionId: src_id|326631b4-59956604-98e1fca5-902fdba4_0
2025-10-10T14:40:45.764483Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bafef764-b649a528-c34ec201-96b157bf_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|326631b4-59956604-98e1fca5-902fdba4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:45.767344Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|326631b4-59956604-98e1fca5-902fdba4_0] Write session: try to update token
2025-10-10T14:40:45.767366Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|326631b4-59956604-98e1fca5-902fdba4_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:45.784223Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:45.784245Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:45.784249Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:45.784252Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:45.784263Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559603056263788367:13549]
2025-10-10T14:40:45.784269Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559603056263788367:13549]
2025-10-10T14:40:45.784273Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559603056263788367:13549]
2025-10-10T14:40:45.784323Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:45.784326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:45.784335Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:45.784338Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:45.784343Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:45.784348Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:45.784477Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:45.790803Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3411 sessionId: src_id|326631b4-59956604-98e1fca5-902fdba4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:45.793436Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:45.833429Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 35 consumer shared/user session shared/user_1_35_7080413204912763209_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559603057046042708:7208]
2025-10-10T14:40:45.833887Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 35 consumer shared/user session shared/user_1_35_7080413204912763209_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 pipe creation result: OK TabletId: 72075186224037892 Generation: 3410, pipe: [1:7559603057046042708:7208]
2025-10-10T14:40:45.902696Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:45.903052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:45.903069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:45.903094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603057046042708:7208], now have 1 active actors on pipe
2025-10-10T14:40:45.903614Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:45.903819Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 35 consumer shared/user session shared/user_1_35_7080413204912763209_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 9 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559603057046042708:7208]
2025-10-10T14:40:45.903883Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:45.903932Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:40:45.904016Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3411 reason: status is not ok: tablet will be restarted right now sessionId: src_id|326631b4-59956604-98e1fca5-902fdba4_0
2025-10-10T14:40:45.904437Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|326631b4-59956604-98e1fca5-902fdba4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:40:45.904452Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|326631b4-59956604-98e1fca5-902fdba4_0] Write session will restart in 0.007172s
2025-10-10T14:40:45.904489Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|326631b4-59956604-98e1fca5-902fdba4_0] Write session: Do CDS request
2025-10-10T14:40:45.904495Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|326631b4-59956604-98e1fca5-902fdba4_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:45.904259Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3411 sessionId: src_id|326631b4-59956604-98e1fca5-902fdba4_0 is DEAD
2025-10-10T14:40:45.912951Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|326631b4-59956604-98e1fca5-902fdba4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:45.913086Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:45.913109Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3412
2025-10-10T14:40:45.913294Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3412 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:45.913354Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3412 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:45.913360Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3412 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:45.913364Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:45.914468Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3412 sessionId:  describe result for acl check
2025-10-10T14:40:45.914515Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:45.914522Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:45.914524Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:45.914541Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559603057046042741:7513] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:45.915175Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559603057046042741:7513] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:45.919556Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559603057046042741:7513] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:45.922420Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559603057046042741:7513] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:45.922574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559603057046042741:7513] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:45.922584Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559603057046042741:7513] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:45.922605Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3412 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:45.926410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:45.933931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:45.934227Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:45.934245Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:45.934261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:45.934340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:45.934398Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559603056263788639:13551]
2025-10-10T14:40:45.935067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:45.935611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:45.935683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:45.936138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:45.936240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:45.936251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:45.936252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:45.936253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:45.936255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:45.936256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:45.936257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:45.936259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:45.936260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:45.936262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:45.936263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:45.936265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:45.936266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:45.936273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:45.936288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:45.936292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:45.936296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:45.936300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:45.936304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:45.936308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:45.936311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:45.936315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:45.936320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:45.936323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:45.936327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:45.936331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:45.936341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:45.936352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:45.936360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:45.936367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:45.936373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:45.936379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:45.936385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:45.936390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:45.936396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:45.936401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:45.936406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:45.936412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:45.936420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:45.936425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:45.936431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:45.936437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:45.936442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:45.936449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:45.936454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:45.936459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:45.936465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:45.936471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:45.936476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:45.936481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:45.936486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:45.936492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:45.936531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:45.939272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:45.940167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:45.940182Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:45.940185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:45.940190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:45.940198Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3411 [2:7559603056263788639:13551]
2025-10-10T14:40:45.940214Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:45.940238Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:45.940243Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:45.940247Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:45.940250Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:45.940270Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:45.940284Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:45.940298Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:45.940375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:45.940383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:45.940386Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:45.940389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:45.940464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:45.940473Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:45.940486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:45.940503Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:45.940525Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:45.940554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603057046042934:7513], now have 1 active actors on pipe
2025-10-10T14:40:45.940564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603057046042713:2438], now have 1 active actors on pipe
2025-10-10T14:40:45.940573Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559603056263788634:13551]
2025-10-10T14:40:45.940581Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559603056263788634:13551]
2025-10-10T14:40:45.940583Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559603056263788634:13551]
2025-10-10T14:40:45.940598Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:45.940613Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:45.940634Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:45.940635Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:45.940639Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:45.940641Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:45.940642Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:45.940673Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559603056263788634:13551]
2025-10-10T14:40:45.940687Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:45.940720Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:45.940841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:45.940853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:45.940885Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|daee6d74-32c3277-d71232f9-ae328fa0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:45.940895Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:45.940901Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:45.940904Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:45.940917Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:45.940930Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:45.940948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:45.940653Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3411
2025-10-10T14:40:45.941168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:45.941179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:45.940654Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3411
2025-10-10T14:40:45.941198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:45.941356Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3412 partition: 0 MaxSeqNo: 40 sessionId: src_id|daee6d74-32c3277-d71232f9-ae328fa0_0
2025-10-10T14:40:45.941891Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|326631b4-59956604-98e1fca5-902fdba4_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|daee6d74-32c3277-d71232f9-ae328fa0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:45.944797Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|daee6d74-32c3277-d71232f9-ae328fa0_0] Write session: try to update token
2025-10-10T14:40:45.944820Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|daee6d74-32c3277-d71232f9-ae328fa0_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:45.953650Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:40:45.953669Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:45.953680Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559603056263788634:13551]
2025-10-10T14:40:45.953736Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:40:45.954109Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:40:45.954290Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:40:45.954484Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:45.954686Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:45.954855Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:45.955151Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:40:45.955210Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:40:45.965550Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3412 sessionId: src_id|daee6d74-32c3277-d71232f9-ae328fa0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:45.968556Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:45.968777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:45.968815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:45.968861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:40:45.972839Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:45.972862Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:45.972866Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:45.972868Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:45.972880Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559603056263788634:13551]
2025-10-10T14:40:45.972883Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559603056263788634:13551]
2025-10-10T14:40:45.972887Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559603056263788634:13551]
2025-10-10T14:40:45.972940Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:45.972945Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:45.972950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:45.972952Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:45.972953Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:45.972957Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:45.973103Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:45.969183Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:40:46.003935Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 35 consumer shared/user session shared/user_1_35_7080413204912763209_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559603061341010273:7208]
2025-10-10T14:40:46.004308Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 35 consumer shared/user session shared/user_1_35_7080413204912763209_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 pipe creation result: OK TabletId: 72075186224037892 Generation: 3411, pipe: [1:7559603061341010273:7208]
2025-10-10T14:40:46.095965Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:46.104021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:46.104058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:46.104246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:46.104318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:46.104392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:46.104461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:46.104510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:46.104521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:46.104597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:46.104678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:46.104745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:46.104810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:46.104853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:46.104861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:46.104927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:46.104991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:46.105056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:46.105113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:46.105160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:46.105168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:46.105236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:46.105303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:46.105411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:46.105478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:46.105522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:46.105530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:46.105598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:46.105663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:46.105732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:46.107699Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 35 consumer shared/user session shared/user_1_35_7080413204912763209_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 10 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559603061341010273:7208]
2025-10-10T14:40:46.107743Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:40:46.107746Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:40:46.107792Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3412 reason: error at write: Disconnected sessionId: src_id|daee6d74-32c3277-d71232f9-ae328fa0_0
2025-10-10T14:40:46.108043Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:46.108046Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3412 sessionId: src_id|daee6d74-32c3277-d71232f9-ae328fa0_0 is DEAD
2025-10-10T14:40:46.108210Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|daee6d74-32c3277-d71232f9-ae328fa0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:40:46.108222Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|daee6d74-32c3277-d71232f9-ae328fa0_0] Write session will restart in 0.008185s
2025-10-10T14:40:46.108251Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|daee6d74-32c3277-d71232f9-ae328fa0_0] Write session: Do CDS request
2025-10-10T14:40:46.108272Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|daee6d74-32c3277-d71232f9-ae328fa0_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:46.105803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:46.105861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:46.105865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:46.105937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:46.105996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:46.106059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:46.106123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:46.106165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:46.106168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:46.106235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:46.106295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:46.106358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:46.106415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:46.106453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:46.106455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:46.106517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:46.106568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:46.106621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:46.106673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:46.106711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:46.106713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:46.106772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:46.106841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:46.106910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:46.106978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:46.107022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:46.107026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:46.107095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:46.107152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:46.107215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:46.107283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:46.107326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:46.107329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:46.107402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603061341010273:7208], now have 1 active actors on pipe
2025-10-10T14:40:46.108664Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:46.118215Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|daee6d74-32c3277-d71232f9-ae328fa0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:46.118295Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:46.118315Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3413
2025-10-10T14:40:46.121673Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3413 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:46.121737Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3413 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:46.121753Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3413 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:46.121758Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:46.122227Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3413 sessionId:  describe result for acl check
2025-10-10T14:40:46.122267Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:46.122269Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:46.122271Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:46.122279Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559603061341010303:7584] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:46.123001Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559603061341010303:7584] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:46.127969Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559603061341010303:7584] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:46.131586Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559603061341010303:7584] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:46.131608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559603061341010303:7584] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:46.131612Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559603061341010303:7584] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:46.131622Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3413 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:46.149722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:46.154038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:46.154316Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:46.154331Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:46.154345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:46.154410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:46.154464Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559603060558756192:13554]
2025-10-10T14:40:46.155102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:46.155823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:46.155905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:46.156216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:46.156273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:46.156280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:46.156281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:46.156282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:46.156283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:46.156284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:46.156285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:46.156286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:46.156287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:46.156287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:46.156288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:46.156289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:46.156290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:46.156295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:46.156305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:46.156308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:46.156310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:46.156313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:46.156315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:46.156318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:46.156320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:46.156322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:46.156325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:46.156327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:46.156330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:46.156332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:46.156341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:46.156347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:46.156359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:46.156363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:46.156369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:46.156372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:46.156376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:46.156380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:46.156383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:46.156386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:46.156389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:46.156393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:46.156396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:46.156400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:46.156403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:46.156406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:46.156409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:46.156413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:46.156418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:46.156423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:46.156432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:46.156439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:46.156444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:46.156449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:46.156452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:46.156455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:46.156479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:46.160945Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3412
2025-10-10T14:40:46.160977Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3412
2025-10-10T14:40:46.159605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:46.160521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:46.160528Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:46.160531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:46.160535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:46.160543Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3412 [2:7559603060558756192:13554]
2025-10-10T14:40:46.160559Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:46.160581Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:46.160584Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:46.160588Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:46.160591Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:46.160612Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:46.160621Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:46.160628Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:46.160698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:46.160699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:46.160701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:46.160705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:46.160788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:46.160792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:46.160805Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:46.160817Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:46.160835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:46.160859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603061341010337:7584], now have 1 active actors on pipe
2025-10-10T14:40:46.160863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603061341010287:2438], now have 1 active actors on pipe
2025-10-10T14:40:46.160873Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559603060558756186:13554]
2025-10-10T14:40:46.160878Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559603060558756186:13554]
2025-10-10T14:40:46.160880Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559603060558756186:13554]
2025-10-10T14:40:46.160894Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:46.160910Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:46.160927Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:46.160930Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:46.160975Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559603060558756186:13554]
2025-10-10T14:40:46.160978Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:46.161027Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:46.161031Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:46.161033Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:46.161039Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:46.161274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:46.161282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:46.161321Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7f51994f-79227de1-2de0ee02-7f6b244b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:46.161426Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:46.161431Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:46.161434Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:46.161449Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:46.161463Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:46.161486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:46.162424Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3413 partition: 0 MaxSeqNo: 40 sessionId: src_id|7f51994f-79227de1-2de0ee02-7f6b244b_0
2025-10-10T14:40:46.162922Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|daee6d74-32c3277-d71232f9-ae328fa0_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|7f51994f-79227de1-2de0ee02-7f6b244b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:46.162243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:46.162256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:46.162281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:46.165839Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7f51994f-79227de1-2de0ee02-7f6b244b_0] Write session: try to update token
2025-10-10T14:40:46.165858Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7f51994f-79227de1-2de0ee02-7f6b244b_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:46.175091Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:40:46.175110Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:46.175123Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559603060558756186:13554]
2025-10-10T14:40:46.175174Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:40:46.175185Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:40:46.175360Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:40:46.175507Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:46.175653Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:46.175791Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:46.176005Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:40:46.176041Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:40:46.194760Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:46.194781Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:46.194790Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:46.194793Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:46.194805Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559603060558756186:13554]
2025-10-10T14:40:46.194810Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559603060558756186:13554]
2025-10-10T14:40:46.194814Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559603060558756186:13554]
2025-10-10T14:40:46.194869Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:46.194875Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:46.194883Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:46.194887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:46.194888Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:46.194890Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:46.195053Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:46.202329Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3413 sessionId: src_id|7f51994f-79227de1-2de0ee02-7f6b244b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:46.205072Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:46.207757Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 35 consumer shared/user session shared/user_1_35_7080413204912763209_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559603061341010547:7208]
2025-10-10T14:40:46.208215Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 35 consumer shared/user session shared/user_1_35_7080413204912763209_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 pipe creation result: OK TabletId: 72075186224037892 Generation: 3412, pipe: [1:7559603061341010547:7208]
2025-10-10T14:40:46.320701Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:46.321117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:46.321135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:46.321160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603061341010547:7208], now have 1 active actors on pipe
2025-10-10T14:40:46.321412Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:46.321527Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 35 consumer shared/user session shared/user_1_35_7080413204912763209_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 11 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559603061341010547:7208]
2025-10-10T14:40:46.321564Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:40:46.321647Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3413 reason: status is not ok: tablet will be restarted right now sessionId: src_id|7f51994f-79227de1-2de0ee02-7f6b244b_0
2025-10-10T14:40:46.321899Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3413 sessionId: src_id|7f51994f-79227de1-2de0ee02-7f6b244b_0 is DEAD
2025-10-10T14:40:46.321923Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:46.322050Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f51994f-79227de1-2de0ee02-7f6b244b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:40:46.322063Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f51994f-79227de1-2de0ee02-7f6b244b_0] Write session will restart in 0.006059s
2025-10-10T14:40:46.322089Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f51994f-79227de1-2de0ee02-7f6b244b_0] Write session: Do CDS request
2025-10-10T14:40:46.322095Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f51994f-79227de1-2de0ee02-7f6b244b_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:46.328964Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7f51994f-79227de1-2de0ee02-7f6b244b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:46.333763Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:46.333783Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3414
2025-10-10T14:40:46.333996Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3414 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:46.334037Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3414 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:46.334054Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3414 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:46.334060Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:46.335200Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3414 sessionId:  describe result for acl check
2025-10-10T14:40:46.335245Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:46.335247Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:46.335250Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:46.335258Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559603061341010602:7632] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:46.335936Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559603061341010602:7632] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:46.344020Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559603061341010602:7632] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:46.347760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559603061341010602:7632] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:46.347777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559603061341010602:7632] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:46.347781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559603061341010602:7632] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:46.347791Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3414 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:46.351161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:46.353989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:46.354239Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:46.354251Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:46.354263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:46.354324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:46.354369Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559603060558756487:13569]
2025-10-10T14:40:46.354987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:46.355367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:46.355418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:46.355766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:46.355845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:46.355852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:46.355853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:46.355854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:46.355855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:46.355857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:46.355858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:46.355869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:46.355871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:46.355872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:46.355873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:46.355874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:46.355875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:46.355882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:46.355896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:46.355901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:46.355905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:46.355908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:46.355912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:46.355917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:46.355921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:46.355939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:46.355943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:46.355947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:46.355951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:46.355955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:46.355965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:46.355974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:46.355981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:46.355988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:46.355998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:46.356004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:46.356008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:46.356013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:46.356018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:46.356022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:46.356026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:46.356036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:46.356041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:46.356046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:46.356055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:46.356059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:46.356063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:46.356068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:46.356072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:46.356076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:46.356080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:46.356085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:46.356089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:46.356099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:46.356103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:46.356107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:46.356141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:46.362301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:46.362679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:46.362685Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:46.362688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:46.362692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:46.362700Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3413 [2:7559603060558756487:13569]
2025-10-10T14:40:46.362715Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:46.362737Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:46.362741Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:46.362745Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:46.362748Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:46.362768Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:46.362776Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:46.362784Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:46.362856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:46.362858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:46.362861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:46.362863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:46.363305Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3413
2025-10-10T14:40:46.363338Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3413
2025-10-10T14:40:46.364146Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3414 partition: 0 MaxSeqNo: 40 sessionId: src_id|223184e8-8d704deb-95be2d45-46c62eda_0
2025-10-10T14:40:46.364549Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f51994f-79227de1-2de0ee02-7f6b244b_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|223184e8-8d704deb-95be2d45-46c62eda_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:46.367290Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|223184e8-8d704deb-95be2d45-46c62eda_0] Write session: try to update token
2025-10-10T14:40:46.367315Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|223184e8-8d704deb-95be2d45-46c62eda_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:46.363335Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:46.363349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:46.363362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:46.363375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:46.363390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:46.363417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603061341010801:7632], now have 1 active actors on pipe
2025-10-10T14:40:46.363421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603061341010577:2438], now have 1 active actors on pipe
2025-10-10T14:40:46.363439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:46.363445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:46.363480Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559603060558756482:13569]
2025-10-10T14:40:46.363482Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559603060558756482:13569]
2025-10-10T14:40:46.363484Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559603060558756482:13569]
2025-10-10T14:40:46.363499Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:46.363514Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:46.363516Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:46.363518Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:46.363520Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:46.363534Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:46.363538Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:46.363559Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|223184e8-8d704deb-95be2d45-46c62eda_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:46.363566Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:46.363571Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:46.363573Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:46.363586Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:46.363599Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:46.363650Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559603060558756482:13569]
2025-10-10T14:40:46.363659Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:46.363674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:46.363746Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:46.364008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:46.364013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:46.364033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:46.388046Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:46.388068Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:46.388071Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:46.388074Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:46.388085Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559603060558756482:13569]
2025-10-10T14:40:46.388091Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559603060558756482:13569]
2025-10-10T14:40:46.388096Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559603060558756482:13569]
2025-10-10T14:40:46.388150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:46.388154Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:46.388158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:46.388160Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:46.388161Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:46.388164Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:46.388318Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:46.395194Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3414 sessionId: src_id|223184e8-8d704deb-95be2d45-46c62eda_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:46.397937Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:46.421730Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 35 consumer shared/user session shared/user_1_35_7080413204912763209_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559603061341010837:7208]
2025-10-10T14:40:46.422153Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 35 consumer shared/user session shared/user_1_35_7080413204912763209_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 pipe creation result: OK TabletId: 72075186224037892 Generation: 3413, pipe: [1:7559603061341010837:7208]
2025-10-10T14:40:46.506552Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:46.507106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:46.507128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:46.507193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603061341010837:7208], now have 1 active actors on pipe
2025-10-10T14:40:46.507542Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:46.510029Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:46.510039Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:40:46.510044Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:40:46.510107Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 35 consumer shared/user session shared/user_1_35_7080413204912763209_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 12 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559603061341010837:7208]
2025-10-10T14:40:46.510123Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3414 reason: error at write: Disconnected sessionId: src_id|223184e8-8d704deb-95be2d45-46c62eda_0
2025-10-10T14:40:46.510365Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3414 sessionId: src_id|223184e8-8d704deb-95be2d45-46c62eda_0 is DEAD
2025-10-10T14:40:46.510544Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|223184e8-8d704deb-95be2d45-46c62eda_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:40:46.510570Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|223184e8-8d704deb-95be2d45-46c62eda_0] Write session will restart in 0.008806s
2025-10-10T14:40:46.510596Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|223184e8-8d704deb-95be2d45-46c62eda_0] Write session: Do CDS request
2025-10-10T14:40:46.510607Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|223184e8-8d704deb-95be2d45-46c62eda_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:46.520964Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|223184e8-8d704deb-95be2d45-46c62eda_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:46.521139Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:46.521156Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3415
2025-10-10T14:40:46.521280Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3415 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:46.521316Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3415 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:46.521327Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3415 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:46.521345Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:46.521950Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3415 sessionId:  describe result for acl check
2025-10-10T14:40:46.522002Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:46.522011Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:46.522013Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:46.522021Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559603061341010856:7677] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:46.522677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559603061341010856:7677] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:46.526881Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559603061341010856:7677] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:46.536107Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559603061341010856:7677] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:46.536128Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559603061341010856:7677] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:46.536132Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559603061341010856:7677] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:46.536142Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3415 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:46.548715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:46.552697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:46.552969Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:46.552975Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:46.552989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:46.553053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:46.553110Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559603060558756746:13572]
2025-10-10T14:40:46.553819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:46.554247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:46.554301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:46.554667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:46.554733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:46.554735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:46.554736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:46.554738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:46.554739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:46.554741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:46.554742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:46.554743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:46.554745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:46.554746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:46.554747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:46.554749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:46.554751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:46.554758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:46.554772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:46.554776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:46.554781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:46.554785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:46.554789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:46.554794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:46.554797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:46.554802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:46.554807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:46.554811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:46.554815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:46.554818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:46.554827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:46.554850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:46.554859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:46.554865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:46.554870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:46.554876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:46.554882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:46.554888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:46.554893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:46.554899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:46.554904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:46.554910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:46.554915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:46.554921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:46.554926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:46.554931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:46.554936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:46.554943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:46.554947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:46.554953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:46.554958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:46.554964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:46.554968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:46.554973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:46.554978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:46.554984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:46.555040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:46.562598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:46.563672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:46.563692Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:46.563695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:46.563700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:46.563710Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3414 [2:7559603060558756746:13572]
2025-10-10T14:40:46.563727Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:46.563751Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:46.563764Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:46.563768Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:46.563770Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:46.563790Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:46.563805Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:46.563814Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:46.563906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:46.563913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:46.563915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:46.563918Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:46.564002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:46.564010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:46.564024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:46.564038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:46.564058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:46.564086Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559603060558756741:13572]
2025-10-10T14:40:46.564093Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559603060558756741:13572]
2025-10-10T14:40:46.564095Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559603060558756741:13572]
2025-10-10T14:40:46.564115Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:46.564129Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:46.564135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603061341010956:7677], now have 1 active actors on pipe
2025-10-10T14:40:46.564142Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:46.564148Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:46.564151Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:46.564158Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:46.564162Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:46.564174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603061341010840:2438], now have 1 active actors on pipe
2025-10-10T14:40:46.564216Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559603060558756741:13572]
2025-10-10T14:40:46.564228Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:46.564244Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:46.564308Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3414
2025-10-10T14:40:46.564348Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3414
2025-10-10T14:40:46.565546Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3415 partition: 0 MaxSeqNo: 40 sessionId: src_id|8a63bb3a-85aed3e9-493e3a64-80db93e7_0
2025-10-10T14:40:46.569461Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|223184e8-8d704deb-95be2d45-46c62eda_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|8a63bb3a-85aed3e9-493e3a64-80db93e7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:46.564745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:46.564759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:46.564797Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8a63bb3a-85aed3e9-493e3a64-80db93e7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:46.564806Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:46.564812Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:46.564815Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:46.564830Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:46.564844Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:46.564863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:46.565256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:46.565264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:46.565298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:46.572447Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8a63bb3a-85aed3e9-493e3a64-80db93e7_0] Write session: try to update token
2025-10-10T14:40:46.572471Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8a63bb3a-85aed3e9-493e3a64-80db93e7_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:46.585437Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:46.585458Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:46.585462Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:46.585464Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:46.585477Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559603060558756741:13572]
2025-10-10T14:40:46.585482Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559603060558756741:13572]
2025-10-10T14:40:46.585487Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559603060558756741:13572]
2025-10-10T14:40:46.585556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:46.585566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:46.585569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:46.585645Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:46.585652Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:46.585657Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:46.585717Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:46.598065Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3415 sessionId: src_id|8a63bb3a-85aed3e9-493e3a64-80db93e7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:46.601004Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:46.613769Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 35 consumer shared/user session shared/user_1_35_7080413204912763209_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559603061341011101:7208]
2025-10-10T14:40:46.617778Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 35 consumer shared/user session shared/user_1_35_7080413204912763209_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 pipe creation result: OK TabletId: 72075186224037892 Generation: 3414, pipe: [1:7559603061341011101:7208]
2025-10-10T14:40:46.708984Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:46.709571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:46.709592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:46.709616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603061341011101:7208], now have 1 active actors on pipe
2025-10-10T14:40:46.709929Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:46.709944Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:40:46.709948Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:40:46.710001Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 35 consumer shared/user session shared/user_1_35_7080413204912763209_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 13 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559603061341011101:7208]
2025-10-10T14:40:46.710208Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3415 reason: error at write: Disconnected sessionId: src_id|8a63bb3a-85aed3e9-493e3a64-80db93e7_0
2025-10-10T14:40:46.710297Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:46.710420Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3415 sessionId: src_id|8a63bb3a-85aed3e9-493e3a64-80db93e7_0 is DEAD
2025-10-10T14:40:46.710583Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a63bb3a-85aed3e9-493e3a64-80db93e7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:40:46.710594Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a63bb3a-85aed3e9-493e3a64-80db93e7_0] Write session will restart in 0.009915s
2025-10-10T14:40:46.710619Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a63bb3a-85aed3e9-493e3a64-80db93e7_0] Write session: Do CDS request
2025-10-10T14:40:46.710628Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a63bb3a-85aed3e9-493e3a64-80db93e7_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:46.721941Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8a63bb3a-85aed3e9-493e3a64-80db93e7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:46.722051Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:46.722073Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3416
2025-10-10T14:40:46.722254Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3416 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:46.722298Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3416 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:46.722310Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3416 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:46.722315Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:46.722821Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3416 sessionId:  describe result for acl check
2025-10-10T14:40:46.722862Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:46.722869Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:46.722871Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:46.722878Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559603061341011113:7691] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:46.723513Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559603061341011113:7691] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:46.726213Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559603061341011113:7691] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:46.731398Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559603061341011113:7691] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:46.731419Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559603061341011113:7691] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:46.731423Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559603061341011113:7691] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:46.731434Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3416 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:46.750212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:46.753322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:46.753586Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:46.753599Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:46.753622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:46.753684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:46.753731Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559603060558757004:13574]
2025-10-10T14:40:46.754404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:46.754799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:46.754846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:46.755185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:46.755244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:46.755251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:46.755253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:46.755254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:46.755255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:46.755256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:46.755258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:46.755259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:46.755260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:46.755261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:46.755263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:46.755264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:46.755266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:46.755272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:46.755284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:46.755289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:46.755293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:46.755297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:46.755301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:46.755305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:46.755309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:46.755312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:46.755316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:46.755320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:46.755324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:46.755328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:46.755339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:46.755347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:46.755353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:46.755359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:46.755364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:46.755370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:46.755375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:46.755380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:46.755385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:46.755390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:46.755395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:46.755409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:46.755414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:46.755424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:46.755429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:46.755434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:46.755439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:46.755449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:46.755453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:46.755465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:46.755470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:46.755479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:46.755483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:46.755488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:46.755497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:46.755503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:46.755543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:46.758087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:46.758592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:46.758606Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:46.758609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:46.758613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:46.758624Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3415 [2:7559603060558757004:13574]
2025-10-10T14:40:46.758638Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:46.758655Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:46.758658Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:46.758661Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:46.758664Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:46.758681Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:46.758693Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:46.758701Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:46.758762Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:46.758770Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:46.758772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:46.758774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:46.758848Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:46.758856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:46.758868Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:46.758878Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:46.758901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:46.758923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603061341011104:2438], now have 1 active actors on pipe
2025-10-10T14:40:46.758931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603061341011182:7691], now have 1 active actors on pipe
2025-10-10T14:40:46.758939Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559603060558756999:13574]
2025-10-10T14:40:46.758942Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559603060558756999:13574]
2025-10-10T14:40:46.758944Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559603060558756999:13574]
2025-10-10T14:40:46.758956Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:46.758972Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:46.758971Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:46.758975Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:46.758977Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:46.758989Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:46.758995Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:46.759023Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559603060558756999:13574]
2025-10-10T14:40:46.759035Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:46.759042Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:46.759181Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3415
2025-10-10T14:40:46.759227Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3415
2025-10-10T14:40:46.759382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:46.759399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:46.759431Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|50f6a51e-6f3e51f9-f51cff43-221c2f5d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:46.759446Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:46.759451Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:46.759453Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:46.759465Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:46.759497Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:46.759517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:46.759742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:46.759755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:46.759781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:46.759931Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3416 partition: 0 MaxSeqNo: 40 sessionId: src_id|50f6a51e-6f3e51f9-f51cff43-221c2f5d_0
2025-10-10T14:40:46.760388Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a63bb3a-85aed3e9-493e3a64-80db93e7_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|50f6a51e-6f3e51f9-f51cff43-221c2f5d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:46.763205Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|50f6a51e-6f3e51f9-f51cff43-221c2f5d_0] Write session: try to update token
2025-10-10T14:40:46.763223Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|50f6a51e-6f3e51f9-f51cff43-221c2f5d_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:46.778995Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3416 sessionId: src_id|50f6a51e-6f3e51f9-f51cff43-221c2f5d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:46.779775Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:40:46.779796Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:46.779808Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559603060558756999:13574]
2025-10-10T14:40:46.779883Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:40:46.780079Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:40:46.780254Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:46.780425Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:46.780606Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:46.780836Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:40:46.780879Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:40:46.781109Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:40:46.781952Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:46.782391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:46.782419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:46.782459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:40:46.782571Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:40:46.804338Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:46.804359Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:46.804362Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:46.804365Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:46.804376Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559603060558756999:13574]
2025-10-10T14:40:46.804381Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559603060558756999:13574]
2025-10-10T14:40:46.804388Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559603060558756999:13574]
2025-10-10T14:40:46.804443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:46.804454Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:46.804456Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:46.804459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:46.804461Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:46.804466Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:46.804609Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:46.812680Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 35 consumer shared/user session shared/user_1_35_7080413204912763209_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559603061341011366:7208]
2025-10-10T14:40:46.813382Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 35 consumer shared/user session shared/user_1_35_7080413204912763209_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 pipe creation result: OK TabletId: 72075186224037892 Generation: 3415, pipe: [1:7559603061341011366:7208]
2025-10-10T14:40:46.927988Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:46.937919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:46.937948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:46.938148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:46.938207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:46.938269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:46.938342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:46.938387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:46.938392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:46.938472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:46.938535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:46.938604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:46.938671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:46.938714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:46.938718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:46.938789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:46.938850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:46.938912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:46.938974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:46.939015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:46.939021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:46.939099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:46.939177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:46.939244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:46.939308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:46.939352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:46.939355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:46.939429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:46.939493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:46.939556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:46.939618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:46.939664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:46.939668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:46.939737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:46.939801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:46.939883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:46.939949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:46.939992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:46.939995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:46.940064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:46.940125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:46.940192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:46.940277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:46.940321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:46.940324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:46.940392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:46.940454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:46.940515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:46.940581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:46.940632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:46.940635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:46.940705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:46.940792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:46.940865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:46.940937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:46.941120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:46.941131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:46.941204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:46.941265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:46.941349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:46.941416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:46.941463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:46.941466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:46.941542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603061341011366:7208], now have 1 active actors on pipe
2025-10-10T14:40:46.943360Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:46.944048Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 35 consumer shared/user session shared/user_1_35_7080413204912763209_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 14 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559603061341011366:7208]
2025-10-10T14:40:46.944090Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:46.944134Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:40:46.944199Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3416 reason: status is not ok: tablet will be restarted right now sessionId: src_id|50f6a51e-6f3e51f9-f51cff43-221c2f5d_0
2025-10-10T14:40:46.944443Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3416 sessionId: src_id|50f6a51e-6f3e51f9-f51cff43-221c2f5d_0 is DEAD
2025-10-10T14:40:46.945428Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50f6a51e-6f3e51f9-f51cff43-221c2f5d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:40:46.945443Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50f6a51e-6f3e51f9-f51cff43-221c2f5d_0] Write session will restart in 0.006778s
2025-10-10T14:40:46.945471Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50f6a51e-6f3e51f9-f51cff43-221c2f5d_0] Write session: Do CDS request
2025-10-10T14:40:46.945478Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50f6a51e-6f3e51f9-f51cff43-221c2f5d_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:46.954218Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|50f6a51e-6f3e51f9-f51cff43-221c2f5d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:46.954619Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:46.954637Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3417
2025-10-10T14:40:46.955058Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3417 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:46.955102Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3417 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:46.955110Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3417 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:46.955114Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:46.955564Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3417 sessionId:  describe result for acl check
2025-10-10T14:40:46.955593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:46.955596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:46.955598Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:46.955604Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559603061341011395:7704] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:46.956219Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559603061341011395:7704] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:46.962861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559603061341011395:7704] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:46.972258Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559603061341011395:7704] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:46.972276Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559603061341011395:7704] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:46.972280Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559603061341011395:7704] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:46.972290Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3417 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:46.982889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:46.986282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:46.986548Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:46.986560Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:46.986573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:46.986638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:46.986679Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559603060558757275:13577]
2025-10-10T14:40:46.987260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:46.987766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:46.987806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:46.988131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:46.988189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:46.988190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:46.988191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:46.988192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:46.988193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:46.988194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:46.988196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:46.988197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:46.988198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:46.988199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:46.988200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:46.988201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:46.988202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:46.988213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:46.988225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:46.988229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:46.988232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:46.988236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:46.988239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:46.988243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:46.988246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:46.988250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:46.988254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:46.988257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:46.988260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:46.988264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:46.988272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:46.988281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:46.988287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:46.988292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:46.988296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:46.988301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:46.988307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:46.988312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:46.988317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:46.988321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:46.988325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:46.988329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:46.988333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:46.988337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:46.988341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:46.988345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:46.988350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:46.988355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:46.988360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:46.988365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:46.988369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:46.988374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:46.988392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:46.988399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:46.988402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:46.988407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:46.988445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:47.001774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:47.002629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:47.002635Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:47.002637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:47.002640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:47.002646Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3416 [2:7559603060558757275:13577]
2025-10-10T14:40:47.002660Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:47.002676Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:47.002679Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:47.002682Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:47.002683Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:47.002703Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:47.002713Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:47.002723Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:47.002799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:47.002801Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:47.002803Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:47.002805Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:47.002895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:47.002898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:47.002909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:47.002920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:47.002938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:47.002961Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559603060558757270:13577]
2025-10-10T14:40:47.002966Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559603060558757270:13577]
2025-10-10T14:40:47.002968Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559603060558757270:13577]
2025-10-10T14:40:47.002989Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:47.003004Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:47.003020Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:47.003023Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:47.003055Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:47.003059Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:47.003062Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:47.003062Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559603060558757270:13577]
2025-10-10T14:40:47.003064Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:47.003070Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:47.003186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603061341011379:2438], now have 1 active actors on pipe
2025-10-10T14:40:47.003190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603061341011516:7704], now have 1 active actors on pipe
2025-10-10T14:40:47.003563Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3416
2025-10-10T14:40:47.003609Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3416
2025-10-10T14:40:47.007377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:47.007405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:47.007457Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d0d563f6-3171072d-38733372-2ab1e063_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:47.007481Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:47.007492Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:47.007500Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:47.007518Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:47.007545Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:47.007574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:47.016027Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3417 partition: 0 MaxSeqNo: 40 sessionId: src_id|d0d563f6-3171072d-38733372-2ab1e063_0
2025-10-10T14:40:47.013992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:47.014023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:47.014074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:47.017674Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50f6a51e-6f3e51f9-f51cff43-221c2f5d_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|d0d563f6-3171072d-38733372-2ab1e063_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:47.020409Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d0d563f6-3171072d-38733372-2ab1e063_0] Write session: try to update token
2025-10-10T14:40:47.020432Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d0d563f6-3171072d-38733372-2ab1e063_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:47.025241Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:40:47.025267Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:47.025279Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559603060558757270:13577]
2025-10-10T14:40:47.025354Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:40:47.025361Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:40:47.025557Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:40:47.025720Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:47.025873Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:47.026027Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:47.026253Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:40:47.026298Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:40:47.048020Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:47.048052Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:47.048056Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:47.048059Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:47.048072Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559603060558757270:13577]
2025-10-10T14:40:47.048076Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559603060558757270:13577]
2025-10-10T14:40:47.048080Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559603060558757270:13577]
2025-10-10T14:40:47.048132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:47.048141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:47.048144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:47.048297Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:47.049443Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 35 consumer shared/user session shared/user_1_35_7080413204912763209_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559603065635978939:7208]
2025-10-10T14:40:47.049926Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 35 consumer shared/user session shared/user_1_35_7080413204912763209_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 pipe creation result: OK TabletId: 72075186224037892 Generation: 3416, pipe: [1:7559603065635978939:7208]
2025-10-10T14:40:47.049491Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:47.049506Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:47.049511Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:47.061932Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3417 sessionId: src_id|d0d563f6-3171072d-38733372-2ab1e063_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:47.064789Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:47.171567Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:47.171972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603065635978939:7208], now have 1 active actors on pipe
2025-10-10T14:40:47.172140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:47.172158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:47.172431Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:40:47.172439Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:47.172448Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:40:47.172492Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 35 consumer shared/user session shared/user_1_35_7080413204912763209_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 15 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559603065635978939:7208]
2025-10-10T14:40:47.172516Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3417 reason: error at write: Disconnected sessionId: src_id|d0d563f6-3171072d-38733372-2ab1e063_0
2025-10-10T14:40:47.172546Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:47.172774Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3417 sessionId: src_id|d0d563f6-3171072d-38733372-2ab1e063_0 is DEAD
2025-10-10T14:40:47.173429Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d0d563f6-3171072d-38733372-2ab1e063_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:40:47.173443Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d0d563f6-3171072d-38733372-2ab1e063_0] Write session will restart in 0.005493s
2025-10-10T14:40:47.173473Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d0d563f6-3171072d-38733372-2ab1e063_0] Write session: Do CDS request
2025-10-10T14:40:47.173482Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d0d563f6-3171072d-38733372-2ab1e063_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:47.181850Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d0d563f6-3171072d-38733372-2ab1e063_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:47.183886Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:47.183904Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3418
2025-10-10T14:40:47.184097Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3418 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:47.184136Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3418 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:47.184147Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3418 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:47.184151Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:47.184695Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3418 sessionId:  describe result for acl check
2025-10-10T14:40:47.184732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:47.184738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:47.184741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:47.184751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559603065635979003:7738] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:47.185378Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559603065635979003:7738] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:47.188568Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559603065635979003:7738] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:47.193507Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559603065635979003:7738] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:47.193525Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559603065635979003:7738] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:47.193529Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559603065635979003:7738] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:47.193539Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3418 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:47.201401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:47.205026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:47.205283Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:47.205289Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:47.205301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:47.205375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:47.205415Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559603064853724832:13579]
2025-10-10T14:40:47.206051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:47.206435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:47.206499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:47.206870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:47.206950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:47.206956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:47.206958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:47.206959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:47.206961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:47.206962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:47.206963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:47.206964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:47.206965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:47.206966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:47.206968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:47.206969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:47.206985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:47.206993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:47.207007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:47.207011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:47.207015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:47.207019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:47.207029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:47.207033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:47.207037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:47.207042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:47.207046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:47.207050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:47.207053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:47.207057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:47.207070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:47.207084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:47.207092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:47.207098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:47.207103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:47.207110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:47.207115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:47.207121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:47.207127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:47.207138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:47.207144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:47.207149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:47.207155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:47.207165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:47.207170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:47.207180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:47.207185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:47.207196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:47.207206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:47.207212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:47.207223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:47.207234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:47.207243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:47.207249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:47.207259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:47.207264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:47.207318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:47.210227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:47.211051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:47.211064Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:47.211066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:47.211070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:47.211079Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3417 [2:7559603064853724832:13579]
2025-10-10T14:40:47.211094Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:47.211114Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:47.211123Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:47.211127Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:47.211129Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:47.211149Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:47.211163Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:47.211172Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:47.211241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:47.211249Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:47.211251Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:47.211254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:47.211334Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:47.211343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:47.211357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:47.211372Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:47.211389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:47.211417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603065635979130:7738], now have 1 active actors on pipe
2025-10-10T14:40:47.211421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603065635978954:2438], now have 1 active actors on pipe
2025-10-10T14:40:47.211428Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559603064853724827:13579]
2025-10-10T14:40:47.211431Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559603064853724827:13579]
2025-10-10T14:40:47.211433Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559603064853724827:13579]
2025-10-10T14:40:47.211448Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:47.211462Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:47.211466Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:47.211467Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:47.211469Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:47.211483Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:47.211486Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:47.211484Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3417
2025-10-10T14:40:47.211528Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559603064853724827:13579]
2025-10-10T14:40:47.211540Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:47.211548Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:47.211486Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3417
2025-10-10T14:40:47.211561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:47.211570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:47.211631Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4f16d844-36d6b2df-ff4b2b78-699ab2cd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:47.211646Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:47.211651Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:47.211653Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:47.211665Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:47.211682Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:47.211707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:47.211927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:47.211936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:47.211953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:47.212044Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3418 partition: 0 MaxSeqNo: 40 sessionId: src_id|4f16d844-36d6b2df-ff4b2b78-699ab2cd_0
2025-10-10T14:40:47.212507Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d0d563f6-3171072d-38733372-2ab1e063_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|4f16d844-36d6b2df-ff4b2b78-699ab2cd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:47.215479Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4f16d844-36d6b2df-ff4b2b78-699ab2cd_0] Write session: try to update token
2025-10-10T14:40:47.215506Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4f16d844-36d6b2df-ff4b2b78-699ab2cd_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:47.233699Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:47.233719Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:47.233722Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:47.233725Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:47.233736Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559603064853724827:13579]
2025-10-10T14:40:47.233742Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559603064853724827:13579]
2025-10-10T14:40:47.233746Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559603064853724827:13579]
2025-10-10T14:40:47.233796Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:47.233798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:47.233803Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:47.233807Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:47.233807Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:47.233810Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:47.233955Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:47.236584Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3418 sessionId: src_id|4f16d844-36d6b2df-ff4b2b78-699ab2cd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:47.239425Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:47.272828Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 35 consumer shared/user session shared/user_1_35_7080413204912763209_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559603065635979217:7208]
2025-10-10T14:40:47.273322Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 35 consumer shared/user session shared/user_1_35_7080413204912763209_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 pipe creation result: OK TabletId: 72075186224037892 Generation: 3417, pipe: [1:7559603065635979217:7208]
2025-10-10T14:40:47.354643Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:47.355079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:47.355095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:47.355150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603065635979217:7208], now have 1 active actors on pipe
2025-10-10T14:40:47.355474Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:40:47.355479Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 35 consumer shared/user session shared/user_1_35_7080413204912763209_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 16 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559603065635979217:7208]
2025-10-10T14:40:47.355490Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:40:47.355507Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:47.355570Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3418 reason: error at write: Disconnected sessionId: src_id|4f16d844-36d6b2df-ff4b2b78-699ab2cd_0
2025-10-10T14:40:47.355810Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3418 sessionId: src_id|4f16d844-36d6b2df-ff4b2b78-699ab2cd_0 is DEAD
2025-10-10T14:40:47.356046Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f16d844-36d6b2df-ff4b2b78-699ab2cd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:40:47.356058Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f16d844-36d6b2df-ff4b2b78-699ab2cd_0] Write session will restart in 0.007590s
2025-10-10T14:40:47.356084Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f16d844-36d6b2df-ff4b2b78-699ab2cd_0] Write session: Do CDS request
2025-10-10T14:40:47.356091Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f16d844-36d6b2df-ff4b2b78-699ab2cd_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:47.355436Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:47.365001Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4f16d844-36d6b2df-ff4b2b78-699ab2cd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:47.365075Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:47.365094Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3419
2025-10-10T14:40:47.365223Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3419 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:47.365265Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3419 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:47.365274Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3419 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:47.365278Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:47.365815Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3419 sessionId:  describe result for acl check
2025-10-10T14:40:47.365854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:47.365862Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:47.365865Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:47.365871Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559603065635979270:7775] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:47.366475Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559603065635979270:7775] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:47.370731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559603065635979270:7775] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:47.374559Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559603065635979270:7775] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:47.374576Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559603065635979270:7775] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:47.374580Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559603065635979270:7775] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:47.374589Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3419 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:47.378644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:47.381719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:47.381996Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:47.382010Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:47.382025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:47.382092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:47.382142Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559603064853725134:13595]
2025-10-10T14:40:47.382818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:47.383153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:47.383214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:47.383546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:47.383632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:47.383639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:47.383640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:47.383642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:47.383643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:47.383645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:47.383646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:47.383647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:47.383650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:47.383651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:47.383652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:47.383653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:47.383654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:47.383659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:47.383669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:47.383671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:47.383673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:47.383676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:47.383679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:47.383683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:47.383687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:47.383692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:47.383696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:47.383700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:47.383704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:47.383708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:47.383716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:47.383726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:47.383732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:47.383736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:47.383739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:47.383742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:47.383745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:47.383748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:47.383751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:47.383754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:47.383757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:47.383760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:47.383764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:47.383767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:47.383770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:47.383773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:47.383776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:47.383780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:47.383782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:47.383787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:47.383791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:47.383794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:47.383796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:47.383800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:47.383803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:47.383806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:47.383829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:47.386468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:47.387078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:47.387093Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:47.387096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:47.387100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:47.387108Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3418 [2:7559603064853725134:13595]
2025-10-10T14:40:47.387122Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:47.387143Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:47.387146Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:47.387150Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:47.387155Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:47.387173Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:47.387187Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:47.387196Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:47.387261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:47.387268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:47.387270Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:47.387273Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:47.387340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:47.387348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:47.387359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:47.387372Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:47.387394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:47.387420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603065635979246:2438], now have 1 active actors on pipe
2025-10-10T14:40:47.387429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603065635979462:7775], now have 1 active actors on pipe
2025-10-10T14:40:47.387436Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559603064853725129:13595]
2025-10-10T14:40:47.387439Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559603064853725129:13595]
2025-10-10T14:40:47.387441Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559603064853725129:13595]
2025-10-10T14:40:47.387455Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:47.387470Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:47.387481Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:47.387488Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:47.387493Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:47.387494Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:47.387497Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:47.387525Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559603064853725129:13595]
2025-10-10T14:40:47.387533Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:47.387514Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3418
2025-10-10T14:40:47.387536Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3418
2025-10-10T14:40:47.387651Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:47.387702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:47.387712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:47.387747Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3dbbecfb-c831edb6-52e2a757-e6f11bd8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:47.387759Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:47.387768Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:47.387771Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:47.387784Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:47.387795Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:47.388101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:47.388312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:47.388321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:47.388337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:47.388444Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3419 partition: 0 MaxSeqNo: 40 sessionId: src_id|3dbbecfb-c831edb6-52e2a757-e6f11bd8_0
2025-10-10T14:40:47.388875Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f16d844-36d6b2df-ff4b2b78-699ab2cd_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|3dbbecfb-c831edb6-52e2a757-e6f11bd8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:47.391865Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3dbbecfb-c831edb6-52e2a757-e6f11bd8_0] Write session: try to update token
2025-10-10T14:40:47.391890Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3dbbecfb-c831edb6-52e2a757-e6f11bd8_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:47.407199Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3419 sessionId: src_id|3dbbecfb-c831edb6-52e2a757-e6f11bd8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:47.408121Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:47.408140Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:47.408144Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:47.408146Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:47.408156Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559603064853725129:13595]
2025-10-10T14:40:47.408162Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559603064853725129:13595]
2025-10-10T14:40:47.408167Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559603064853725129:13595]
2025-10-10T14:40:47.408219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:47.408220Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:47.408226Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:47.408227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:47.408230Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:47.408230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:47.408384Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:47.410106Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:47.457453Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 35 consumer shared/user session shared/user_1_35_7080413204912763209_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559603065635979508:7208]
2025-10-10T14:40:47.457826Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 35 consumer shared/user session shared/user_1_35_7080413204912763209_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 pipe creation result: OK TabletId: 72075186224037892 Generation: 3418, pipe: [1:7559603065635979508:7208]
2025-10-10T14:40:47.527878Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:40:47.527895Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:40:47.527917Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 35 consumer shared/user session shared/user_1_35_7080413204912763209_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 17 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559603065635979508:7208]
2025-10-10T14:40:47.527940Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:47.528404Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3dbbecfb-c831edb6-52e2a757-e6f11bd8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:40:47.528415Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3dbbecfb-c831edb6-52e2a757-e6f11bd8_0] Write session will restart in 0.008737s
2025-10-10T14:40:47.528440Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3dbbecfb-c831edb6-52e2a757-e6f11bd8_0] Write session: Do CDS request
2025-10-10T14:40:47.528447Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3dbbecfb-c831edb6-52e2a757-e6f11bd8_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:47.527969Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3419 reason: error at write: Disconnected sessionId: src_id|3dbbecfb-c831edb6-52e2a757-e6f11bd8_0
2025-10-10T14:40:47.528221Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3419 sessionId: src_id|3dbbecfb-c831edb6-52e2a757-e6f11bd8_0 is DEAD
2025-10-10T14:40:47.526984Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:47.527459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:47.527471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:47.527521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603065635979508:7208], now have 1 active actors on pipe
2025-10-10T14:40:47.528010Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:47.538979Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3dbbecfb-c831edb6-52e2a757-e6f11bd8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:47.539101Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:47.539119Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3420
2025-10-10T14:40:47.541582Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3420 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:47.541639Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3420 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:47.541650Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3420 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:47.541656Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:47.542180Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3420 sessionId:  describe result for acl check
2025-10-10T14:40:47.542216Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:47.542222Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:47.542225Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:47.542231Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559603065635979525:7817] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:47.542832Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559603065635979525:7817] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:47.548837Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559603065635979525:7817] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:47.552837Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559603065635979525:7817] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:47.552857Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559603065635979525:7817] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:47.552861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559603065635979525:7817] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:47.552870Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3420 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:47.556824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:47.559419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:47.559835Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:47.559856Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:47.559870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:47.559939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:47.559987Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559603064853725397:13597]
2025-10-10T14:40:47.560630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:47.560915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:47.560961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:47.561296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:47.561373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:47.561380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:47.561381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:47.561382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:47.561383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:47.561385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:47.561386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:47.561387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:47.561389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:47.561390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:47.561391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:47.561393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:47.561394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:47.561400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:47.561414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:47.561418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:47.561422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:47.561426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:47.561430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:47.561434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:47.561439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:47.561442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:47.561446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:47.561450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:47.561453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:47.561457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:47.561466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:47.561474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:47.561480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:47.561485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:47.561489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:47.561493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:47.561497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:47.561502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:47.561506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:47.561511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:47.561516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:47.561520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:47.561524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:47.561529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:47.561533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:47.561540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:47.561545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:47.561553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:47.561557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:47.561562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:47.561567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:47.561575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:47.561579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:47.561584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:47.561591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:47.561596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:47.561634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:47.564218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:47.564800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:47.564815Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:47.564818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:47.564821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:47.564828Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3419 [2:7559603064853725397:13597]
2025-10-10T14:40:47.564843Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:47.564863Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:47.564866Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:47.564870Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:47.564873Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:47.564893Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:47.564903Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:47.564915Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:47.564981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:47.564989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:47.564992Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:47.564995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:47.565066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:47.565074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:47.565086Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:47.565097Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:47.565119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:47.565147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603065635979704:7817], now have 1 active actors on pipe
2025-10-10T14:40:47.565156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603065635979511:2438], now have 1 active actors on pipe
2025-10-10T14:40:47.565163Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559603064853725392:13597]
2025-10-10T14:40:47.565166Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559603064853725392:13597]
2025-10-10T14:40:47.565169Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559603064853725392:13597]
2025-10-10T14:40:47.565183Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:47.565198Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:47.565205Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:47.565210Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:47.565212Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:47.565221Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:47.565224Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:47.565193Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3419
2025-10-10T14:40:47.565205Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3419
2025-10-10T14:40:47.565254Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559603064853725392:13597]
2025-10-10T14:40:47.565266Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:47.565274Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:47.565287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:47.565294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:47.565370Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a8b8cb25-ac697e4d-a9664ccd-6b08790c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:47.565389Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:47.565393Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:47.565395Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:47.565407Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:47.565419Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:47.565438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:47.565638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:47.565650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:47.565671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:47.565815Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3420 partition: 0 MaxSeqNo: 40 sessionId: src_id|a8b8cb25-ac697e4d-a9664ccd-6b08790c_0
2025-10-10T14:40:47.566275Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3dbbecfb-c831edb6-52e2a757-e6f11bd8_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|a8b8cb25-ac697e4d-a9664ccd-6b08790c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:47.569388Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a8b8cb25-ac697e4d-a9664ccd-6b08790c_0] Write session: try to update token
2025-10-10T14:40:47.569410Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a8b8cb25-ac697e4d-a9664ccd-6b08790c_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:47.584431Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3420 sessionId: src_id|a8b8cb25-ac697e4d-a9664ccd-6b08790c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:47.584982Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:47.585007Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:47.585010Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:47.585012Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:47.585022Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559603064853725392:13597]
2025-10-10T14:40:47.585027Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559603064853725392:13597]
2025-10-10T14:40:47.585032Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559603064853725392:13597]
2025-10-10T14:40:47.585083Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:47.585084Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:47.585092Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:47.585097Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:47.585107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:47.585109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:47.585260Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:47.587188Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:47.627994Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 35 consumer shared/user session shared/user_1_35_7080413204912763209_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559603065635979777:7208]
2025-10-10T14:40:47.628334Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 35 consumer shared/user session shared/user_1_35_7080413204912763209_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 pipe creation result: OK TabletId: 72075186224037892 Generation: 3419, pipe: [1:7559603065635979777:7208]
2025-10-10T14:40:47.708925Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:47.709561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:47.709581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:47.709631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603065635979777:7208], now have 1 active actors on pipe
2025-10-10T14:40:47.709949Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:47.709910Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:40:47.709932Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:40:47.709943Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 35 consumer shared/user session shared/user_1_35_7080413204912763209_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 18 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559603065635979777:7208]
2025-10-10T14:40:47.709968Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:47.710487Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8b8cb25-ac697e4d-a9664ccd-6b08790c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:40:47.710520Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8b8cb25-ac697e4d-a9664ccd-6b08790c_0] Write session will restart in 0.009612s
2025-10-10T14:40:47.710011Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3420 reason: error at write: Disconnected sessionId: src_id|a8b8cb25-ac697e4d-a9664ccd-6b08790c_0
2025-10-10T14:40:47.710237Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3420 sessionId: src_id|a8b8cb25-ac697e4d-a9664ccd-6b08790c_0 is DEAD
2025-10-10T14:40:47.710548Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8b8cb25-ac697e4d-a9664ccd-6b08790c_0] Write session: Do CDS request
2025-10-10T14:40:47.710555Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8b8cb25-ac697e4d-a9664ccd-6b08790c_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:47.721960Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a8b8cb25-ac697e4d-a9664ccd-6b08790c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:47.722043Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:47.722059Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3421
2025-10-10T14:40:47.722391Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3421 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:47.722443Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3421 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:47.722454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3421 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:47.722459Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:47.722890Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3421 sessionId:  describe result for acl check
2025-10-10T14:40:47.722926Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:47.722933Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:47.722935Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:47.722941Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559603065635979852:7836] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:47.723503Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559603065635979852:7836] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:47.728047Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559603065635979852:7836] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:47.732501Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559603065635979852:7836] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:47.732519Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559603065635979852:7836] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:47.732522Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559603065635979852:7836] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:47.732533Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3421 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:47.735542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:47.738575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:47.738802Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:47.738817Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:47.738830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:47.739086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:47.739155Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559603064853725661:13599]
2025-10-10T14:40:47.739881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:47.740238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:47.740290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:47.740605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:47.740667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:47.740668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:47.740669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:47.740671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:47.740672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:47.740674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:47.740675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:47.740677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:47.740678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:47.740679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:47.740681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:47.740682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:47.740683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:47.740690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:47.740704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:47.740708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:47.740712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:47.740716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:47.740720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:47.740724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:47.740727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:47.740732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:47.740736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:47.740740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:47.740744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:47.740748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:47.740757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:47.740766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:47.740773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:47.740778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:47.740783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:47.740788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:47.740793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:47.740799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:47.740803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:47.740808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:47.740812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:47.740818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:47.740823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:47.740828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:47.740836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:47.740841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:47.740845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:47.740852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:47.740856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:47.740861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:47.740866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:47.740871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:47.740875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:47.740879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:47.740884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:47.740889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:47.740926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:47.743598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:47.743973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:47.743988Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:47.743991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:47.743995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:47.744002Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3420 [2:7559603064853725661:13599]
2025-10-10T14:40:47.744018Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:47.744038Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:47.744047Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:47.744071Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:47.744080Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:47.744099Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:47.744113Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:47.744126Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:47.744190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:47.744198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:47.744201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:47.744204Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:47.744276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:47.744284Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:47.744298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:47.744310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:47.744329Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:47.744359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603065635979779:2438], now have 1 active actors on pipe
2025-10-10T14:40:47.744369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603065635980016:7836], now have 1 active actors on pipe
2025-10-10T14:40:47.744378Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559603064853725656:13599]
2025-10-10T14:40:47.744395Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559603064853725656:13599]
2025-10-10T14:40:47.744403Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559603064853725656:13599]
2025-10-10T14:40:47.744419Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:47.744431Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3420
2025-10-10T14:40:47.744455Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3420
2025-10-10T14:40:47.744438Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:47.744438Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:47.744442Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:47.744444Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:47.744464Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:47.744468Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:47.744509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:47.744515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:47.744538Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559603064853725656:13599]
2025-10-10T14:40:47.744550Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:47.744567Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:47.744592Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|759ca6ad-24a674f-fe4b50b7-d2853187_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:47.744606Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:47.744616Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:47.744619Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:47.744632Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:47.744653Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:47.744915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:47.745093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:47.745102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:47.745121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:47.745262Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3421 partition: 0 MaxSeqNo: 40 sessionId: src_id|759ca6ad-24a674f-fe4b50b7-d2853187_0
2025-10-10T14:40:47.745724Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8b8cb25-ac697e4d-a9664ccd-6b08790c_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|759ca6ad-24a674f-fe4b50b7-d2853187_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:47.748683Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|759ca6ad-24a674f-fe4b50b7-d2853187_0] Write session: try to update token
2025-10-10T14:40:47.748703Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|759ca6ad-24a674f-fe4b50b7-d2853187_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:47.765147Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:47.765170Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:47.765174Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:47.765177Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:47.765188Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559603064853725656:13599]
2025-10-10T14:40:47.765193Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559603064853725656:13599]
2025-10-10T14:40:47.765197Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559603064853725656:13599]
2025-10-10T14:40:47.765255Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:47.765264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:47.765267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:47.765428Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:47.767737Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:47.767755Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:47.767761Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:47.767442Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3421 sessionId: src_id|759ca6ad-24a674f-fe4b50b7-d2853187_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:47.770542Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:47.810233Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 35 consumer shared/user session shared/user_1_35_7080413204912763209_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559603065635980047:7208]
2025-10-10T14:40:47.813825Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 35 consumer shared/user session shared/user_1_35_7080413204912763209_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 pipe creation result: OK TabletId: 72075186224037892 Generation: 3420, pipe: [1:7559603065635980047:7208]
2025-10-10T14:40:47.893179Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:47.893661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:47.893683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:47.893734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603065635980047:7208], now have 1 active actors on pipe
2025-10-10T14:40:47.894267Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:47.894071Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 35 consumer shared/user session shared/user_1_35_7080413204912763209_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 19 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559603065635980047:7208]
2025-10-10T14:40:47.894108Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:40:47.894111Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:40:47.894175Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3421 reason: error at write: Disconnected sessionId: src_id|759ca6ad-24a674f-fe4b50b7-d2853187_0
2025-10-10T14:40:47.894402Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3421 sessionId: src_id|759ca6ad-24a674f-fe4b50b7-d2853187_0 is DEAD
2025-10-10T14:40:47.894560Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:47.897577Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|759ca6ad-24a674f-fe4b50b7-d2853187_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:40:47.897588Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|759ca6ad-24a674f-fe4b50b7-d2853187_0] Write session will restart in 0.005422s
2025-10-10T14:40:47.897615Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|759ca6ad-24a674f-fe4b50b7-d2853187_0] Write session: Do CDS request
2025-10-10T14:40:47.897623Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|759ca6ad-24a674f-fe4b50b7-d2853187_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:47.903917Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|759ca6ad-24a674f-fe4b50b7-d2853187_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:47.904329Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:47.904344Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3422
2025-10-10T14:40:47.904680Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3422 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:47.904731Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3422 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:47.904738Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3422 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:47.904743Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:47.905236Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3422 sessionId:  describe result for acl check
2025-10-10T14:40:47.905268Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:47.905270Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:47.905272Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:47.905279Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559603065635980087:7850] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:47.905960Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559603065635980087:7850] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:47.909997Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559603065635980087:7850] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:47.913598Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559603065635980087:7850] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:47.913613Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559603065635980087:7850] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:47.913617Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559603065635980087:7850] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:47.913626Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3422 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:47.918177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:47.921074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:47.921462Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:47.921469Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:47.921486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:47.921565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:47.921609Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559603064853725938:13601]
2025-10-10T14:40:47.922239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:47.922703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:47.922759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:47.923090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:47.923163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:47.923166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:47.923167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:47.923169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:47.923170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:47.923171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:47.923173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:47.923174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:47.923175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:47.923177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:47.923178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:47.923179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:47.923180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:47.923186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:47.923200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:47.923205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:47.923209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:47.923213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:47.923218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:47.923221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:47.923225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:47.923229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:47.923234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:47.923238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:47.923242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:47.923246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:47.923255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:47.923265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:47.923271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:47.923277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:47.923282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:47.923288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:47.923293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:47.923299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:47.923305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:47.923311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:47.923316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:47.923322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:47.923327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:47.923333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:47.923339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:47.923345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:47.923352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:47.923357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:47.923362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:47.923368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:47.923374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:47.923379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:47.923384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:47.923390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:47.923395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:47.923401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:47.923442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:47.927989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:47.928677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:47.928682Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:47.928685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:47.928690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:47.928698Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3421 [2:7559603064853725938:13601]
2025-10-10T14:40:47.928714Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:47.928734Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:47.928738Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:47.928743Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:47.928746Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:47.928766Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:47.928774Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:47.928782Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:47.928849Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:47.928851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:47.928855Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:47.928858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:47.928939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:47.928941Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:47.928953Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:47.928966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:47.928984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:47.929005Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559603064853725933:13601]
2025-10-10T14:40:47.929008Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559603064853725933:13601]
2025-10-10T14:40:47.929010Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559603064853725933:13601]
2025-10-10T14:40:47.929030Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:47.929047Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:47.929065Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:47.929069Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:47.929103Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559603064853725933:13601]
2025-10-10T14:40:47.929106Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:47.929190Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:47.929196Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:47.929198Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:47.929205Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:47.929501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603065635980052:2438], now have 1 active actors on pipe
2025-10-10T14:40:47.929515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603065635980239:7850], now have 1 active actors on pipe
2025-10-10T14:40:47.929544Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3421
2025-10-10T14:40:47.929546Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3421
2025-10-10T14:40:47.929732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:47.929743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:47.929781Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|62677a85-96f82616-246c68e5-68be64b7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:47.929791Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:47.929797Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:47.929800Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:47.929815Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:47.929828Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:47.929846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:47.930137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:47.930144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:47.930161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:47.930307Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3422 partition: 0 MaxSeqNo: 40 sessionId: src_id|62677a85-96f82616-246c68e5-68be64b7_0
2025-10-10T14:40:47.937561Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|759ca6ad-24a674f-fe4b50b7-d2853187_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|62677a85-96f82616-246c68e5-68be64b7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:47.940424Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|62677a85-96f82616-246c68e5-68be64b7_0] Write session: try to update token
2025-10-10T14:40:47.940453Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|62677a85-96f82616-246c68e5-68be64b7_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:47.953659Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:47.953681Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:47.953685Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:47.953687Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:47.953704Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559603064853725933:13601]
2025-10-10T14:40:47.953708Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559603064853725933:13601]
2025-10-10T14:40:47.953713Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559603064853725933:13601]
2025-10-10T14:40:47.953766Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:47.953774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:47.953777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:47.953854Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:47.953867Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:47.953872Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:47.953930Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:47.962099Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3422 sessionId: src_id|62677a85-96f82616-246c68e5-68be64b7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:47.964819Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:47.994080Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 35 consumer shared/user session shared/user_1_35_7080413204912763209_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559603065635980326:7208]
2025-10-10T14:40:47.994526Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 35 consumer shared/user session shared/user_1_35_7080413204912763209_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 pipe creation result: OK TabletId: 72075186224037892 Generation: 3421, pipe: [1:7559603065635980326:7208]
2025-10-10T14:40:48.074666Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:48.075054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:48.075065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:48.075111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603065635980326:7208], now have 1 active actors on pipe
2025-10-10T14:40:48.075364Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:48.075397Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:48.075454Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 35 consumer shared/user session shared/user_1_35_7080413204912763209_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 20 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559603065635980326:7208]
2025-10-10T14:40:48.075490Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:40:48.075497Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:40:48.075564Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3422 reason: error at write: Disconnected sessionId: src_id|62677a85-96f82616-246c68e5-68be64b7_0
2025-10-10T14:40:48.075780Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3422 sessionId: src_id|62677a85-96f82616-246c68e5-68be64b7_0 is DEAD
2025-10-10T14:40:48.076192Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|62677a85-96f82616-246c68e5-68be64b7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:40:48.076212Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|62677a85-96f82616-246c68e5-68be64b7_0] Write session will restart in 0.009174s
2025-10-10T14:40:48.076239Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|62677a85-96f82616-246c68e5-68be64b7_0] Write session: Do CDS request
2025-10-10T14:40:48.076247Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|62677a85-96f82616-246c68e5-68be64b7_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:48.086967Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|62677a85-96f82616-246c68e5-68be64b7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:48.087113Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:48.087133Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3423
2025-10-10T14:40:48.087304Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3423 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:48.087350Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3423 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:48.087361Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3423 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:48.087365Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:48.087833Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3423 sessionId:  describe result for acl check
2025-10-10T14:40:48.087885Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:48.087893Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:48.087898Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:48.087905Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559603069930947651:7863] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:48.088505Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559603069930947651:7863] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:48.091433Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559603069930947651:7863] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:48.095953Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559603069930947651:7863] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:48.095970Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559603069930947651:7863] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:48.095975Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559603069930947651:7863] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:48.095985Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3423 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:48.116281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:48.119325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:48.119745Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:48.119766Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:48.119781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:48.119861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:48.119907Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559603069148693500:13604]
2025-10-10T14:40:48.120548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:48.120913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:48.120961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:48.121290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:48.121381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:48.121388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:48.121389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:48.121391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:48.121392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:48.121394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:48.121395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:48.121397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:48.121398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:48.121399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:48.121401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:48.121402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:48.121403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:48.121410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:48.121425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:48.121430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:48.121434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:48.121438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:48.121442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:48.121446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:48.121450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:48.121454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:48.121459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:48.121462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:48.121467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:48.121471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:48.121479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:48.121489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:48.121496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:48.121502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:48.121506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:48.121511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:48.121519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:48.121524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:48.121530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:48.121540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:48.121544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:48.121550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:48.121562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:48.121568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:48.121572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:48.121577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:48.121583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:48.121588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:48.121594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:48.121599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:48.121604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:48.121613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:48.121618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:48.121623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:48.121628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:48.121633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:48.121694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:48.124531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:48.125190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:48.125205Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:48.125208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:48.125212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:48.125218Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3422 [2:7559603069148693500:13604]
2025-10-10T14:40:48.125234Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:48.125254Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:48.125258Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:48.125263Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:48.125266Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:48.125284Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:48.125292Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:48.125299Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:48.125383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:48.125392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:48.125394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:48.125397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:48.125473Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:48.125484Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:48.125496Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:48.125507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:48.125525Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:48.125554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603069930947682:7863], now have 1 active actors on pipe
2025-10-10T14:40:48.125563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603069930947637:2438], now have 1 active actors on pipe
2025-10-10T14:40:48.125571Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559603069148693495:13604]
2025-10-10T14:40:48.125574Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559603069148693495:13604]
2025-10-10T14:40:48.125576Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559603069148693495:13604]
2025-10-10T14:40:48.125590Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:48.125609Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:48.125617Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:48.125621Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:48.125623Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:48.125629Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:48.125633Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:48.125667Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559603069148693495:13604]
2025-10-10T14:40:48.125675Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:48.125680Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:48.125706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:48.125716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:48.125759Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|19067ea4-5a6421a4-f2f0efc-a7cc2da6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:48.125772Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:48.125777Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:48.125779Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:48.125791Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:48.125806Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:48.125828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:48.125646Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3422
2025-10-10T14:40:48.125661Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3422
2025-10-10T14:40:48.126062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:48.126072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:48.126092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:48.126308Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3423 partition: 0 MaxSeqNo: 40 sessionId: src_id|19067ea4-5a6421a4-f2f0efc-a7cc2da6_0
2025-10-10T14:40:48.129513Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|62677a85-96f82616-246c68e5-68be64b7_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|19067ea4-5a6421a4-f2f0efc-a7cc2da6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:48.132394Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19067ea4-5a6421a4-f2f0efc-a7cc2da6_0] Write session: try to update token
2025-10-10T14:40:48.132416Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19067ea4-5a6421a4-f2f0efc-a7cc2da6_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:48.147661Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:48.147705Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:48.147709Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:48.147711Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:48.147726Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559603069148693495:13604]
2025-10-10T14:40:48.147730Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559603069148693495:13604]
2025-10-10T14:40:48.147737Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559603069148693495:13604]
2025-10-10T14:40:48.147792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:48.147794Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:48.147801Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:48.147805Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:48.147807Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:48.147809Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:48.147979Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:48.152426Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3423 sessionId: src_id|19067ea4-5a6421a4-f2f0efc-a7cc2da6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:48.155305Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:48.175827Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 35 consumer shared/user session shared/user_1_35_7080413204912763209_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559603069930947907:7208]
2025-10-10T14:40:48.176227Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 35 consumer shared/user session shared/user_1_35_7080413204912763209_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 pipe creation result: OK TabletId: 72075186224037892 Generation: 3422, pipe: [1:7559603069930947907:7208]
2025-10-10T14:40:48.270089Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:48.270503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:48.270514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:48.270568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603069930947907:7208], now have 1 active actors on pipe
2025-10-10T14:40:48.271160Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 35 consumer shared/user session shared/user_1_35_7080413204912763209_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 21 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559603069930947907:7208]
2025-10-10T14:40:48.271188Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:40:48.271191Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:48.271011Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:48.271669Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19067ea4-5a6421a4-f2f0efc-a7cc2da6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:40:48.271682Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19067ea4-5a6421a4-f2f0efc-a7cc2da6_0] Write session will restart in 0.006349s
2025-10-10T14:40:48.271717Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19067ea4-5a6421a4-f2f0efc-a7cc2da6_0] Write session: Do CDS request
2025-10-10T14:40:48.271723Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19067ea4-5a6421a4-f2f0efc-a7cc2da6_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:48.271269Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3423 reason: status is not ok: tablet will be restarted right now sessionId: src_id|19067ea4-5a6421a4-f2f0efc-a7cc2da6_0
2025-10-10T14:40:48.271477Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3423 sessionId: src_id|19067ea4-5a6421a4-f2f0efc-a7cc2da6_0 is DEAD
2025-10-10T14:40:48.278867Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19067ea4-5a6421a4-f2f0efc-a7cc2da6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:48.278983Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:48.278999Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3424
2025-10-10T14:40:48.279155Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3424 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:48.279192Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3424 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:48.279205Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3424 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:48.279209Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:48.279799Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3424 sessionId:  describe result for acl check
2025-10-10T14:40:48.279865Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:48.279868Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:48.279870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:48.279876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559603069930947924:7873] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:48.280471Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559603069930947924:7873] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:48.283298Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559603069930947924:7873] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:48.287951Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559603069930947924:7873] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:48.287967Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559603069930947924:7873] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:48.287971Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559603069930947924:7873] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:48.287981Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3424 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:48.297159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:48.300254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:48.300531Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:48.300545Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:48.300560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:48.300632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:48.300683Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559603069148693767:13606]
2025-10-10T14:40:48.301382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:48.301743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:48.301821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:48.302197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:48.302264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:48.302266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:48.302267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:48.302268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:48.302270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:48.302271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:48.302272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:48.302274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:48.302275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:48.302276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:48.302278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:48.302279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:48.302280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:48.302286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:48.302301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:48.302306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:48.302311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:48.302316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:48.302321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:48.302326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:48.302330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:48.302334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:48.302339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:48.302342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:48.302346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:48.302350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:48.302358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:48.302367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:48.302374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:48.302380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:48.302386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:48.302391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:48.302398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:48.302404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:48.302410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:48.302415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:48.302420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:48.302426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:48.302432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:48.302437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:48.302444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:48.302450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:48.302455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:48.302461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:48.302465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:48.302471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:48.302477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:48.302483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:48.302488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:48.302494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:48.302499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:48.302504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:48.302550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:48.305436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:48.305997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:48.306011Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:48.306013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:48.306019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:48.306026Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3423 [2:7559603069148693767:13606]
2025-10-10T14:40:48.306042Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:48.306062Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:48.306071Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:48.306075Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:48.306077Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:48.306097Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:48.306106Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:48.306114Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:48.306186Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:48.306193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:48.306196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:48.306199Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:48.306284Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:48.306294Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:48.306308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:48.306322Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:48.306341Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:48.306363Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559603069148693762:13606]
2025-10-10T14:40:48.306372Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559603069148693762:13606]
2025-10-10T14:40:48.306374Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559603069148693762:13606]
2025-10-10T14:40:48.306391Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:48.306409Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:48.306431Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:48.306440Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:48.306441Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:48.306448Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:48.306450Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:48.306478Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559603069148693762:13606]
2025-10-10T14:40:48.306487Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:48.306557Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:48.306605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603069930948017:7873], now have 1 active actors on pipe
2025-10-10T14:40:48.306619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603069930947909:2438], now have 1 active actors on pipe
2025-10-10T14:40:48.306711Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3423
2025-10-10T14:40:48.306758Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3423
2025-10-10T14:40:48.306825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:48.306837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:48.306873Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6a064590-7e657def-3236d5b6-31af0524_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:48.306882Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:48.306887Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:48.306889Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:48.306903Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:48.306922Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:48.306943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:48.307115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:48.307122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:48.307137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:48.307233Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3424 partition: 0 MaxSeqNo: 40 sessionId: src_id|6a064590-7e657def-3236d5b6-31af0524_0
2025-10-10T14:40:48.307679Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19067ea4-5a6421a4-f2f0efc-a7cc2da6_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|6a064590-7e657def-3236d5b6-31af0524_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:48.310576Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6a064590-7e657def-3236d5b6-31af0524_0] Write session: try to update token
2025-10-10T14:40:48.310597Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6a064590-7e657def-3236d5b6-31af0524_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:48.326513Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:40:48.326543Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:48.326557Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559603069148693762:13606]
2025-10-10T14:40:48.326614Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:40:48.326667Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:40:48.326808Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:40:48.326975Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:48.327129Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:48.327275Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:48.327488Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:40:48.327536Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:40:48.330383Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3424 sessionId: src_id|6a064590-7e657def-3236d5b6-31af0524_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:48.333298Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:48.333619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:48.333644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:48.333689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:40:48.334163Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:40:48.340845Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:48.340862Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:48.340865Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:48.340867Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:48.340877Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559603069148693762:13606]
2025-10-10T14:40:48.340880Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559603069148693762:13606]
2025-10-10T14:40:48.340884Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559603069148693762:13606]
2025-10-10T14:40:48.340936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:48.340938Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:48.340946Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:48.340950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:48.340951Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:48.340953Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:48.341101Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:48.371420Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 35 consumer shared/user session shared/user_1_35_7080413204912763209_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559603069930948193:7208]
2025-10-10T14:40:48.371873Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 35 consumer shared/user session shared/user_1_35_7080413204912763209_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 pipe creation result: OK TabletId: 72075186224037892 Generation: 3423, pipe: [1:7559603069930948193:7208]
2025-10-10T14:40:48.460360Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:48.468690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:48.468724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:48.468922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:48.468989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:48.469062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:48.469131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:48.469560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:48.469571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:48.469649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:48.469720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:48.469791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:48.469867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:48.469917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:48.469923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:48.469995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:48.470059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:48.470127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:48.470201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:48.470255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:48.470262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:48.470331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:48.470590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:48.470657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:48.470730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:48.470775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:48.470783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:48.470850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:48.470913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:48.470987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:48.471066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:48.471117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:48.471126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:48.471197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:48.471266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:48.471331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:48.471408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:48.471457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:48.471464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:48.471544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:48.471612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:48.471684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:48.471755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:48.471806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:48.471813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:48.471896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:48.471958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:48.472027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:48.472093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:48.473146Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:40:48.473161Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:40:48.473205Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3424 reason: error at write: Disconnected sessionId: src_id|6a064590-7e657def-3236d5b6-31af0524_0
2025-10-10T14:40:48.473240Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:48.473311Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 35 consumer shared/user session shared/user_1_35_7080413204912763209_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 22 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559603069930948193:7208]
2025-10-10T14:40:48.472145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:48.472157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:48.472232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:48.472295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:48.472361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:48.472424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:48.472467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:48.472470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:48.472546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:48.472609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:48.472672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:48.472733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:48.472781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:48.472786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:48.472854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603069930948193:7208], now have 1 active actors on pipe
2025-10-10T14:40:48.473482Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3424 sessionId: src_id|6a064590-7e657def-3236d5b6-31af0524_0 is DEAD
2025-10-10T14:40:48.473641Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a064590-7e657def-3236d5b6-31af0524_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:40:48.473654Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a064590-7e657def-3236d5b6-31af0524_0] Write session will restart in 0.007945s
2025-10-10T14:40:48.473692Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a064590-7e657def-3236d5b6-31af0524_0] Write session: Do CDS request
2025-10-10T14:40:48.473700Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a064590-7e657def-3236d5b6-31af0524_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:48.473460Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:48.482910Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6a064590-7e657def-3236d5b6-31af0524_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:48.483265Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:48.483283Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3425
2025-10-10T14:40:48.483402Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3425 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:48.483448Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3425 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:48.483454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3425 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:48.483458Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:48.483902Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3425 sessionId:  describe result for acl check
2025-10-10T14:40:48.483951Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:48.483957Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:48.483959Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:48.483965Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559603069930948234:7952] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:48.484518Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559603069930948234:7952] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:48.489270Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559603069930948234:7952] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:48.493064Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559603069930948234:7952] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:48.493082Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559603069930948234:7952] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:48.493086Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559603069930948234:7952] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:48.493098Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3425 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:48.499315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:48.502350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:48.502805Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:48.502812Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:48.502826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:48.502894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:48.502939Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559603069148694075:13622]
2025-10-10T14:40:48.503641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:48.504053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:48.504112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:48.504470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:48.504526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:48.504527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:48.504528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:48.504530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:48.504531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:48.504532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:48.504534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:48.504535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:48.504536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:48.504538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:48.504539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:48.504540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:48.504542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:48.504549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:48.504564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:48.504568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:48.504572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:48.504576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:48.504581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:48.504585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:48.504590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:48.504594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:48.504599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:48.504604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:48.504608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:48.504612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:48.504620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:48.504629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:48.504637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:48.504643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:48.504648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:48.504654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:48.504659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:48.504664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:48.504670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:48.504676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:48.504681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:48.504687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:48.504693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:48.504699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:48.504704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:48.504710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:48.504715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:48.504721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:48.504728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:48.504734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:48.504739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:48.504745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:48.504750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:48.504756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:48.504761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:48.504767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:48.504811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:48.507730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:48.508486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:48.508500Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:48.508503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:48.508507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:48.508514Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3424 [2:7559603069148694075:13622]
2025-10-10T14:40:48.508528Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:48.508550Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:48.508559Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:48.508563Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:48.508565Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:48.508585Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:48.508599Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:48.508608Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:48.508674Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:48.508682Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:48.508684Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:48.508687Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:48.508762Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:48.508772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:48.508785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:48.508800Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:48.508900Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3424
2025-10-10T14:40:48.508919Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3424
2025-10-10T14:40:48.508820Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:48.508849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603069930948208:2438], now have 1 active actors on pipe
2025-10-10T14:40:48.508853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603069930948379:7952], now have 1 active actors on pipe
2025-10-10T14:40:48.508862Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559603069148694070:13622]
2025-10-10T14:40:48.508864Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559603069148694070:13622]
2025-10-10T14:40:48.508867Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559603069148694070:13622]
2025-10-10T14:40:48.508880Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:48.508893Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:48.508895Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:48.508896Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:48.508897Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:48.508912Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:48.508916Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:48.508949Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559603069148694070:13622]
2025-10-10T14:40:48.508958Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:48.508967Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:48.508975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:48.508980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:48.509040Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1c12fd54-cb25d858-5685f92b-9c694aad_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:48.509048Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:48.509053Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:48.509055Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:48.509068Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:48.509080Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:48.509098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:48.509242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:48.509251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:48.509271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:48.509387Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3425 partition: 0 MaxSeqNo: 40 sessionId: src_id|1c12fd54-cb25d858-5685f92b-9c694aad_0
2025-10-10T14:40:48.509853Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a064590-7e657def-3236d5b6-31af0524_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|1c12fd54-cb25d858-5685f92b-9c694aad_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:48.512799Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1c12fd54-cb25d858-5685f92b-9c694aad_0] Write session: try to update token
2025-10-10T14:40:48.512818Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1c12fd54-cb25d858-5685f92b-9c694aad_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:48.529324Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:48.529472Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:48.529478Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:48.529480Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:48.529490Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559603069148694070:13622]
2025-10-10T14:40:48.529495Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559603069148694070:13622]
2025-10-10T14:40:48.529503Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559603069148694070:13622]
2025-10-10T14:40:48.529558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:48.529571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:48.529574Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:48.529587Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:48.529594Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:48.529599Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:48.529740Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:48.536087Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3425 sessionId: src_id|1c12fd54-cb25d858-5685f92b-9c694aad_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:48.538883Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:48.573641Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 35 consumer shared/user session shared/user_1_35_7080413204912763209_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559603069930948478:7208]
2025-10-10T14:40:48.573975Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 35 consumer shared/user session shared/user_1_35_7080413204912763209_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 pipe creation result: OK TabletId: 72075186224037892 Generation: 3424, pipe: [1:7559603069930948478:7208]
2025-10-10T14:40:48.653397Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:48.653855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:48.653874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:48.653900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603069930948478:7208], now have 1 active actors on pipe
2025-10-10T14:40:48.654210Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:48.654276Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:40:48.654283Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:40:48.654346Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3425 reason: error at write: Disconnected sessionId: src_id|1c12fd54-cb25d858-5685f92b-9c694aad_0
2025-10-10T14:40:48.654567Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3425 sessionId: src_id|1c12fd54-cb25d858-5685f92b-9c694aad_0 is DEAD
2025-10-10T14:40:48.654656Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 35 consumer shared/user session shared/user_1_35_7080413204912763209_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 23 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559603069930948478:7208]
2025-10-10T14:40:48.654743Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c12fd54-cb25d858-5685f92b-9c694aad_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:40:48.654755Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c12fd54-cb25d858-5685f92b-9c694aad_0] Write session will restart in 0.005896s
2025-10-10T14:40:48.654791Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c12fd54-cb25d858-5685f92b-9c694aad_0] Write session: Do CDS request
2025-10-10T14:40:48.654798Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c12fd54-cb25d858-5685f92b-9c694aad_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:48.655266Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:48.661893Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1c12fd54-cb25d858-5685f92b-9c694aad_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:48.665693Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:48.665710Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3426
2025-10-10T14:40:48.666083Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3426 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:48.666133Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3426 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:48.666139Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3426 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:48.666143Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:48.666658Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3426 sessionId:  describe result for acl check
2025-10-10T14:40:48.666694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:48.666696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:48.666698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:48.666705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559603069930948496:7974] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:48.667294Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559603069930948496:7974] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:48.670824Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559603069930948496:7974] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:48.676199Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559603069930948496:7974] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:48.676215Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559603069930948496:7974] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:48.676219Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559603069930948496:7974] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:48.676230Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3426 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:48.706511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:48.710264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:48.710548Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:48.710560Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:48.710574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:48.710633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:48.710668Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559603069148694345:13624]
2025-10-10T14:40:48.711112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:48.711449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:48.711479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:48.711745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:48.711790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:48.711791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:48.711792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:48.711793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:48.711794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:48.711794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:48.711795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:48.711796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:48.711797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:48.711798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:48.711799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:48.711800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:48.711800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:48.711804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:48.711813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:48.711816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:48.711818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:48.711821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:48.711823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:48.711826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:48.711841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:48.711845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:48.711850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:48.711853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:48.711858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:48.711862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:48.711870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:48.711876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:48.711881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:48.711884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:48.711887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:48.711890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:48.711893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:48.711897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:48.711900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:48.711903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:48.711906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:48.711909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:48.711912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:48.711915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:48.711918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:48.711921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:48.711924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:48.711927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:48.711930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:48.711933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:48.711936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:48.711939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:48.711942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:48.711945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:48.711949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:48.711952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:48.711976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:48.714839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:48.715500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:48.715511Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:48.715513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:48.715516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:48.715521Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3425 [2:7559603069148694345:13624]
2025-10-10T14:40:48.715531Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:48.715549Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:48.715553Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:48.715558Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:48.715561Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:48.715579Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:48.715589Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:48.715598Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:48.715649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:48.715651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:48.715653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:48.715654Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:48.715722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:48.715725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:48.715734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:48.715741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:48.715750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:48.715768Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559603069148694339:13624]
2025-10-10T14:40:48.715769Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559603069148694339:13624]
2025-10-10T14:40:48.715771Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559603069148694339:13624]
2025-10-10T14:40:48.715781Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:48.715795Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:48.715811Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:48.715814Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:48.715857Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559603069148694339:13624]
2025-10-10T14:40:48.715859Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:48.716003Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:48.716005Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:48.716007Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:48.716017Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:48.716597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603069930948578:7974], now have 1 active actors on pipe
2025-10-10T14:40:48.716606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603069930948479:2438], now have 1 active actors on pipe
2025-10-10T14:40:48.717017Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3425
2025-10-10T14:40:48.717056Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3425
2025-10-10T14:40:48.717159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:48.717167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:48.717196Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3477faef-89dcce56-f28c1f0e-f11af0c5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:48.717204Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:48.717208Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:48.717211Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:48.717234Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:48.717248Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:48.717262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:48.717497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:48.717505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:48.717522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:48.717633Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3426 partition: 0 MaxSeqNo: 40 sessionId: src_id|3477faef-89dcce56-f28c1f0e-f11af0c5_0
2025-10-10T14:40:48.718033Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c12fd54-cb25d858-5685f92b-9c694aad_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|3477faef-89dcce56-f28c1f0e-f11af0c5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:48.720852Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3477faef-89dcce56-f28c1f0e-f11af0c5_0] Write session: try to update token
2025-10-10T14:40:48.720870Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3477faef-89dcce56-f28c1f0e-f11af0c5_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:48.739211Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:48.739231Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:48.739234Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:48.739236Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:48.739246Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559603069148694339:13624]
2025-10-10T14:40:48.739251Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559603069148694339:13624]
2025-10-10T14:40:48.739255Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559603069148694339:13624]
2025-10-10T14:40:48.739296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:48.739303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:48.739305Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:48.739422Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:48.741500Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:48.741512Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:48.741515Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:48.742252Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3426 sessionId: src_id|3477faef-89dcce56-f28c1f0e-f11af0c5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:48.745132Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:48.755053Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 35 consumer shared/user session shared/user_1_35_7080413204912763209_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559603069930948752:7208]
2025-10-10T14:40:48.757745Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 35 consumer shared/user session shared/user_1_35_7080413204912763209_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 pipe creation result: OK TabletId: 72075186224037892 Generation: 3425, pipe: [1:7559603069930948752:7208]
2025-10-10T14:40:48.861689Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:48.862327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:48.862361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:48.862391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603069930948752:7208], now have 1 active actors on pipe
2025-10-10T14:40:48.862687Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:48.863200Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 35 consumer shared/user session shared/user_1_35_7080413204912763209_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 24 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559603069930948752:7208]
2025-10-10T14:40:48.863234Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:40:48.863303Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3426 reason: status is not ok: tablet will be restarted right now sessionId: src_id|3477faef-89dcce56-f28c1f0e-f11af0c5_0
2025-10-10T14:40:48.863500Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3426 sessionId: src_id|3477faef-89dcce56-f28c1f0e-f11af0c5_0 is DEAD
2025-10-10T14:40:48.863639Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:48.865559Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3477faef-89dcce56-f28c1f0e-f11af0c5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:40:48.865570Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3477faef-89dcce56-f28c1f0e-f11af0c5_0] Write session will restart in 0.006357s
2025-10-10T14:40:48.865589Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3477faef-89dcce56-f28c1f0e-f11af0c5_0] Write session: Do CDS request
2025-10-10T14:40:48.865594Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3477faef-89dcce56-f28c1f0e-f11af0c5_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:48.872923Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3477faef-89dcce56-f28c1f0e-f11af0c5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:48.873501Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:48.873519Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3427
2025-10-10T14:40:48.873660Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3427 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:48.873694Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3427 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:48.873700Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3427 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:48.873705Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:48.874427Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3427 sessionId:  describe result for acl check
2025-10-10T14:40:48.874460Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:48.874462Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:48.874463Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:48.874470Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559603069930948783:8000] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:48.875047Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559603069930948783:8000] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:48.879087Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559603069930948783:8000] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:48.882912Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559603069930948783:8000] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:48.882926Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559603069930948783:8000] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:48.882930Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559603069930948783:8000] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:48.882939Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3427 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:48.889766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:48.892556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:48.892811Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:48.892823Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:48.892995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:48.893076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:48.893127Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559603069148694615:13626]
2025-10-10T14:40:48.893783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:48.894423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:48.894494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:48.894866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:48.894927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:48.894933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:48.894934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:48.894936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:48.894937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:48.894939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:48.894940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:48.894941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:48.894943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:48.894944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:48.894945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:48.894947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:48.894948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:48.894955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:48.894968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:48.894972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:48.894977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:48.894982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:48.894986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:48.894990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:48.894994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:48.894998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:48.895003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:48.895006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:48.895010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:48.895015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:48.895022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:48.895032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:48.895039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:48.895045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:48.895050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:48.895061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:48.895066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:48.895076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:48.895081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:48.895090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:48.895100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:48.895106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:48.895111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:48.895116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:48.895121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:48.895126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:48.895136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:48.895141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:48.895151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:48.895156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:48.895162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:48.895182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:48.895186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:48.895193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:48.895202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:48.895207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:48.895250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:48.898520Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3426
2025-10-10T14:40:48.898572Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3426
2025-10-10T14:40:48.897803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:48.898123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:48.898129Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:48.898132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:48.898136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:48.898142Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3426 [2:7559603069148694615:13626]
2025-10-10T14:40:48.898156Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:48.898175Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:48.898179Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:48.898183Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:48.898185Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:48.898203Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:48.898211Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:48.898220Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:48.898279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:48.898281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:48.898283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:48.898286Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:48.898358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:48.898361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:48.898374Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:48.898386Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:48.898401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:48.898424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603069930948948:8000], now have 1 active actors on pipe
2025-10-10T14:40:48.898427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603069930948755:2438], now have 1 active actors on pipe
2025-10-10T14:40:48.898434Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559603069148694610:13626]
2025-10-10T14:40:48.898437Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559603069148694610:13626]
2025-10-10T14:40:48.898439Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559603069148694610:13626]
2025-10-10T14:40:48.898452Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:48.898467Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:48.898466Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:48.898469Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:48.898472Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:48.898481Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:48.898484Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:48.898510Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559603069148694610:13626]
2025-10-10T14:40:48.898517Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:48.898524Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:48.898699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:48.898708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:48.898746Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3a681dc0-7734cb9-fb505600-3e06027d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:48.898756Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:48.898762Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:48.898765Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:48.898778Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:48.898792Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:48.898821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:48.899160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:48.899185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:48.899207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:48.899317Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3427 partition: 0 MaxSeqNo: 40 sessionId: src_id|3a681dc0-7734cb9-fb505600-3e06027d_0
2025-10-10T14:40:48.899760Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3477faef-89dcce56-f28c1f0e-f11af0c5_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|3a681dc0-7734cb9-fb505600-3e06027d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:48.902600Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3a681dc0-7734cb9-fb505600-3e06027d_0] Write session: try to update token
2025-10-10T14:40:48.902621Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3a681dc0-7734cb9-fb505600-3e06027d_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:48.919193Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:40:48.919215Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:48.919227Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559603069148694610:13626]
2025-10-10T14:40:48.919279Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:40:48.919283Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:40:48.919479Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:40:48.919641Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:48.919792Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:48.919957Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:48.920177Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:40:48.920239Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:40:48.923359Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3427 sessionId: src_id|3a681dc0-7734cb9-fb505600-3e06027d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:48.926078Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:48.926626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:48.926651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:48.926697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:40:48.926818Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:40:48.929676Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:48.929703Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:48.929708Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:48.929710Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:48.929721Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559603069148694610:13626]
2025-10-10T14:40:48.929728Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559603069148694610:13626]
2025-10-10T14:40:48.929733Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559603069148694610:13626]
2025-10-10T14:40:48.929787Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:48.929790Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:48.929799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:48.929801Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:48.929804Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:48.929808Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:48.929948Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:48.964077Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 35 consumer shared/user session shared/user_1_35_7080413204912763209_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559603069930949036:7208]
2025-10-10T14:40:48.965442Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 35 consumer shared/user session shared/user_1_35_7080413204912763209_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 pipe creation result: OK TabletId: 72075186224037892 Generation: 3426, pipe: [1:7559603069930949036:7208]
2025-10-10T14:40:49.053840Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:49.062565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:49.062600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:49.062791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:49.062863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:49.062944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:49.063014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:49.063580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:49.063594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:49.063677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:49.063747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:49.063820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:49.063906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:49.063958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:49.063965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:49.064039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:49.064105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:49.064169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:49.064234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:49.064280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:49.064286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:49.064359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:49.064434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:49.064503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:49.064577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:49.064624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:49.064630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:49.064702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:49.064768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:49.064842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:49.064912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:49.064959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:49.064965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:49.065039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:49.065111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:49.065173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:49.065247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:49.065298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:49.065305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:49.065482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:49.065551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:49.067667Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a681dc0-7734cb9-fb505600-3e06027d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:40:49.067678Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a681dc0-7734cb9-fb505600-3e06027d_0] Write session will restart in 0.007491s
2025-10-10T14:40:49.067702Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a681dc0-7734cb9-fb505600-3e06027d_0] Write session: Do CDS request
2025-10-10T14:40:49.067717Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a681dc0-7734cb9-fb505600-3e06027d_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:49.065626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:49.065700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:49.065745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:49.065747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:49.065820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:49.065892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:49.065955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:49.066014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:49.066058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:49.066060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:49.066137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:49.066200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:49.066265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:49.066328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:49.066370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:49.066373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:49.066442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:49.066501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:49.066560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:49.066628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:49.066832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:49.066834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:49.066892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603069930949036:7208], now have 1 active actors on pipe
2025-10-10T14:40:49.067329Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:49.067233Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:40:49.067239Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 35 consumer shared/user session shared/user_1_35_7080413204912763209_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 25 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559603069930949036:7208]
2025-10-10T14:40:49.067246Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:40:49.067274Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:49.067292Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3427 reason: error at write: Disconnected sessionId: src_id|3a681dc0-7734cb9-fb505600-3e06027d_0
2025-10-10T14:40:49.067511Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3427 sessionId: src_id|3a681dc0-7734cb9-fb505600-3e06027d_0 is DEAD
2025-10-10T14:40:49.076986Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3a681dc0-7734cb9-fb505600-3e06027d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:49.077576Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:49.077593Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3428
2025-10-10T14:40:49.077845Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3428 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:49.077907Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3428 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:49.077913Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3428 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:49.077919Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:49.078628Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3428 sessionId:  describe result for acl check
2025-10-10T14:40:49.078704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:49.078715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:49.078717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:49.078726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559603074225916379:8057] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:49.079371Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559603074225916379:8057] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:49.083403Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559603074225916379:8057] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:49.087479Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559603074225916379:8057] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:49.087494Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559603074225916379:8057] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:49.087497Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559603074225916379:8057] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:49.087505Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3428 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:49.094191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:49.099017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:49.099498Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:49.099514Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:49.099531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:49.099614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:49.099669Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559603073443662195:13629]
2025-10-10T14:40:49.100342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:49.100851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:49.100921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:49.101298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:49.101390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:49.101398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:49.101400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:49.101401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:49.101403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:49.101404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:49.101406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:49.101408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:49.101410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:49.101411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:49.101412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:49.101414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:49.101415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:49.101424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:49.101439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:49.101444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:49.101449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:49.101454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:49.101459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:49.101464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:49.101469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:49.101474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:49.101480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:49.101484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:49.101489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:49.101494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:49.101502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:49.101511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:49.101519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:49.101525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:49.101532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:49.101538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:49.101544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:49.101550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:49.101560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:49.101566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:49.101577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:49.101583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:49.101589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:49.101602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:49.101608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:49.101614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:49.101620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:49.101626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:49.101631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:49.101638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:49.101643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:49.101650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:49.101656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:49.101668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:49.101673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:49.101684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:49.101730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:49.104781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:49.105354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:49.105369Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:49.105372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:49.105376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:49.105384Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3427 [2:7559603073443662195:13629]
2025-10-10T14:40:49.105398Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:49.105419Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:49.105430Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:49.105434Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:49.105436Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:49.105454Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:49.105462Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:49.105469Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:49.105543Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:49.105545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:49.105547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:49.105550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:49.105628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:49.105631Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:49.105644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:49.105657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:49.105675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:49.105696Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559603073443662190:13629]
2025-10-10T14:40:49.105698Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559603073443662190:13629]
2025-10-10T14:40:49.105700Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559603073443662190:13629]
2025-10-10T14:40:49.105716Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:49.105730Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:49.105746Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:49.105749Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:49.105777Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559603073443662190:13629]
2025-10-10T14:40:49.105780Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:49.105974Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:49.105986Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:49.105988Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:49.105995Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:49.106357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603074225916515:8057], now have 1 active actors on pipe
2025-10-10T14:40:49.106370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603074225916335:2438], now have 1 active actors on pipe
2025-10-10T14:40:49.106371Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3427
2025-10-10T14:40:49.106416Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3427
2025-10-10T14:40:49.106928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:49.106943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:49.106979Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|efc47989-d492d986-2836cf53-c6589efa_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:49.106991Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:49.106996Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:49.106998Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:49.107010Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:49.107024Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:49.107046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:49.107313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:49.107322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:49.107337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:49.107449Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3428 partition: 0 MaxSeqNo: 40 sessionId: src_id|efc47989-d492d986-2836cf53-c6589efa_0
2025-10-10T14:40:49.107910Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a681dc0-7734cb9-fb505600-3e06027d_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|efc47989-d492d986-2836cf53-c6589efa_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:49.110771Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|efc47989-d492d986-2836cf53-c6589efa_0] Write session: try to update token
2025-10-10T14:40:49.110791Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|efc47989-d492d986-2836cf53-c6589efa_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:49.127222Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:49.127244Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:49.127248Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:49.127250Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:49.127266Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559603073443662190:13629]
2025-10-10T14:40:49.127271Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559603073443662190:13629]
2025-10-10T14:40:49.127275Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559603073443662190:13629]
2025-10-10T14:40:49.127330Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:49.127339Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:49.127342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:49.127488Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:49.129437Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:49.129454Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:49.129463Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:49.130291Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3428 sessionId: src_id|efc47989-d492d986-2836cf53-c6589efa_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:49.133166Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:49.168283Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 35 consumer shared/user session shared/user_1_35_7080413204912763209_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559603074225916621:7208]
2025-10-10T14:40:49.168568Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 35 consumer shared/user session shared/user_1_35_7080413204912763209_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 pipe creation result: OK TabletId: 72075186224037892 Generation: 3427, pipe: [1:7559603074225916621:7208]
2025-10-10T14:40:49.253520Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:49.254061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:49.254072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:49.254119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603074225916621:7208], now have 1 active actors on pipe
2025-10-10T14:40:49.254399Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 35 consumer shared/user session shared/user_1_35_7080413204912763209_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 26 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559603074225916621:7208]
2025-10-10T14:40:49.254442Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:49.254488Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:40:49.254576Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3428 reason: status is not ok: tablet will be restarted right now sessionId: src_id|efc47989-d492d986-2836cf53-c6589efa_0
2025-10-10T14:40:49.254798Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3428 sessionId: src_id|efc47989-d492d986-2836cf53-c6589efa_0 is DEAD
2025-10-10T14:40:49.255245Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|efc47989-d492d986-2836cf53-c6589efa_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:40:49.255258Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|efc47989-d492d986-2836cf53-c6589efa_0] Write session will restart in 0.005362s
2025-10-10T14:40:49.255283Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|efc47989-d492d986-2836cf53-c6589efa_0] Write session: Do CDS request
2025-10-10T14:40:49.255289Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|efc47989-d492d986-2836cf53-c6589efa_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:49.254387Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:49.261861Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|efc47989-d492d986-2836cf53-c6589efa_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:49.262288Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:49.262305Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3429
2025-10-10T14:40:49.262445Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3429 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:49.262483Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3429 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:49.262495Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3429 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:49.262500Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:49.262992Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3429 sessionId:  describe result for acl check
2025-10-10T14:40:49.263029Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:49.263038Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:49.263040Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:49.263047Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559603074225916637:8085] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:49.263646Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559603074225916637:8085] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:49.268482Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559603074225916637:8085] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:49.278217Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559603074225916637:8085] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:49.278237Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559603074225916637:8085] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:49.278241Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559603074225916637:8085] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:49.278252Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3429 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:49.286168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:49.289824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:49.290339Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:49.290356Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:49.290373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:49.290457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:49.290516Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559603073443662467:13631]
2025-10-10T14:40:49.291190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:49.291708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:49.291764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:49.292114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:49.292179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:49.292180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:49.292181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:49.292182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:49.292184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:49.292185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:49.292186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:49.292187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:49.292189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:49.292190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:49.292191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:49.292192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:49.292194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:49.292201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:49.292215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:49.292220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:49.292224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:49.292229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:49.292233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:49.292237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:49.292241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:49.292245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:49.292250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:49.292254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:49.292258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:49.292262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:49.292270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:49.292279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:49.292286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:49.292292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:49.292297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:49.292303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:49.292309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:49.292335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:49.292341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:49.292347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:49.292352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:49.292359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:49.292365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:49.292371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:49.292376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:49.292382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:49.292388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:49.292394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:49.292399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:49.292405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:49.292411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:49.292419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:49.292423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:49.292429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:49.292434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:49.292440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:49.292497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:49.299595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:49.300497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:49.300503Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:49.300506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:49.300511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:49.300518Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3428 [2:7559603073443662467:13631]
2025-10-10T14:40:49.300977Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3428
2025-10-10T14:40:49.301019Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3428
2025-10-10T14:40:49.300534Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:49.300555Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:49.300559Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:49.300563Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:49.300567Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:49.300585Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:49.300594Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:49.300602Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:49.300672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:49.300675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:49.300677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:49.300680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:49.300765Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:49.300769Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:49.300784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:49.300798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:49.300818Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:49.300841Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559603073443662462:13631]
2025-10-10T14:40:49.300844Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559603073443662462:13631]
2025-10-10T14:40:49.300846Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559603073443662462:13631]
2025-10-10T14:40:49.300856Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:49.300873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603074225916843:8085], now have 1 active actors on pipe
2025-10-10T14:40:49.300876Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:49.300879Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:49.300880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603074225916624:2438], now have 1 active actors on pipe
2025-10-10T14:40:49.300881Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:49.300886Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:49.300903Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:49.300906Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:49.300949Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559603073443662462:13631]
2025-10-10T14:40:49.300957Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:49.300965Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:49.301207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:49.301224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:49.301265Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5bf1d786-e4f48976-7b3db60e-512809e5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:49.301290Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:49.301295Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:49.301298Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:49.301312Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:49.301343Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:49.301366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:49.301852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:49.301864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:49.301888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:49.302114Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3429 partition: 0 MaxSeqNo: 40 sessionId: src_id|5bf1d786-e4f48976-7b3db60e-512809e5_0
2025-10-10T14:40:49.302570Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|efc47989-d492d986-2836cf53-c6589efa_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|5bf1d786-e4f48976-7b3db60e-512809e5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:49.305267Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5bf1d786-e4f48976-7b3db60e-512809e5_0] Write session: try to update token
2025-10-10T14:40:49.305288Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5bf1d786-e4f48976-7b3db60e-512809e5_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:49.322906Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3429 sessionId: src_id|5bf1d786-e4f48976-7b3db60e-512809e5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:49.325655Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:49.328015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:49.328045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:49.328071Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:49.328075Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:49.328079Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:49.328082Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:49.328091Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559603073443662462:13631]
2025-10-10T14:40:49.328096Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559603073443662462:13631]
2025-10-10T14:40:49.328100Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559603073443662462:13631]
2025-10-10T14:40:49.328165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:49.328173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:49.328176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:49.328317Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:49.329536Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:49.329549Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:49.329553Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:49.354475Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 35 consumer shared/user session shared/user_1_35_7080413204912763209_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559603074225916900:7208]
2025-10-10T14:40:49.357680Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 35 consumer shared/user session shared/user_1_35_7080413204912763209_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 pipe creation result: OK TabletId: 72075186224037892 Generation: 3428, pipe: [1:7559603074225916900:7208]
2025-10-10T14:40:49.445784Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:49.446148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:40:49.446214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603074225916900:7208], now have 1 active actors on pipe
2025-10-10T14:40:49.447136Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5bf1d786-e4f48976-7b3db60e-512809e5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:40:49.447147Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5bf1d786-e4f48976-7b3db60e-512809e5_0] Write session will restart in 0.005422s
2025-10-10T14:40:49.447173Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5bf1d786-e4f48976-7b3db60e-512809e5_0] Write session: Do CDS request
2025-10-10T14:40:49.447180Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5bf1d786-e4f48976-7b3db60e-512809e5_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:49.446635Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:40:49.446730Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:40:49.446733Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:40:49.446807Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3429 reason: error at write: Disconnected sessionId: src_id|5bf1d786-e4f48976-7b3db60e-512809e5_0
2025-10-10T14:40:49.446938Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3429 sessionId: src_id|5bf1d786-e4f48976-7b3db60e-512809e5_0 is DEAD
2025-10-10T14:40:49.447306Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 35 consumer shared/user session shared/user_1_35_7080413204912763209_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 27 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559603074225916900:7208]
2025-10-10T14:40:49.447320Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:49.453895Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5bf1d786-e4f48976-7b3db60e-512809e5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:49.454386Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:49.454404Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3430
2025-10-10T14:40:49.454572Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3430 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:49.454617Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3430 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:49.454628Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3430 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:49.454633Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:49.455061Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3430 sessionId:  describe result for acl check
2025-10-10T14:40:49.455103Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:49.455110Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:49.455112Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:49.455118Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559603074225916925:8123] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:49.455674Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559603074225916925:8123] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:49.457956Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559603074225916925:8123] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:49.462903Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559603074225916925:8123] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:49.462922Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559603074225916925:8123] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:49.462926Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559603074225916925:8123] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:49.462945Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3430 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:49.502332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:49.508825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:49.509323Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:49.509366Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:49.509384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:49.509483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:49.509534Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559603073443662780:13645]
2025-10-10T14:40:49.510192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:49.510753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:49.510822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:49.511171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:49.511253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:49.511260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:49.511262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:49.511263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:49.511264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:49.511266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:49.511268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:49.511270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:49.511272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:49.511274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:49.511275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:49.511276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:49.511278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:49.511285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:49.511299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:49.511304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:49.511308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:49.511312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:49.511317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:49.511321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:49.511368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:49.511372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:49.511377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:49.511382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:49.511386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:49.511391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:49.511399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:49.511408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:49.511415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:49.511427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:49.511433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:49.511438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:49.511444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:49.511450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:49.511456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:49.511462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:49.511466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:49.511472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:49.511478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:49.511484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:49.511489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:49.511494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:49.511502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:49.511507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:49.511512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:49.511517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:49.511523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:49.511528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:49.511533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:49.511538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:49.511543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:49.511549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:49.511593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:49.517122Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3429
2025-10-10T14:40:49.517132Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3429
2025-10-10T14:40:49.515813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:49.516710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:49.516716Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:49.516718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:49.516722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:49.516730Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3429 [2:7559603073443662780:13645]
2025-10-10T14:40:49.516746Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:49.516766Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:49.516770Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:49.516774Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:49.516776Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:49.516798Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:49.516807Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:49.516815Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:49.516884Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:49.516887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:49.516889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:49.516892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:49.516970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:49.516974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:49.516986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:49.517000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:49.517015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:49.517039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603074225916915:2438], now have 1 active actors on pipe
2025-10-10T14:40:49.517045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603074225916968:8123], now have 1 active actors on pipe
2025-10-10T14:40:49.517054Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559603073443662774:13645]
2025-10-10T14:40:49.517057Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559603073443662774:13645]
2025-10-10T14:40:49.517059Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559603073443662774:13645]
2025-10-10T14:40:49.517078Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:49.517093Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:49.517108Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:49.517111Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:49.517117Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:49.517122Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:49.517125Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:49.517143Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559603073443662774:13645]
2025-10-10T14:40:49.517146Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:49.517163Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:49.517183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:49.517188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:49.517231Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3f01e925-4f77251a-e4eb1c85-a4895165_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:49.517241Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:49.517245Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:49.517248Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:49.517261Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:49.517273Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:49.517289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:49.517619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:49.517636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:49.517655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:49.517773Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3430 partition: 0 MaxSeqNo: 40 sessionId: src_id|3f01e925-4f77251a-e4eb1c85-a4895165_0
2025-10-10T14:40:49.518273Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5bf1d786-e4f48976-7b3db60e-512809e5_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|3f01e925-4f77251a-e4eb1c85-a4895165_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:49.521287Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3f01e925-4f77251a-e4eb1c85-a4895165_0] Write session: try to update token
2025-10-10T14:40:49.521309Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3f01e925-4f77251a-e4eb1c85-a4895165_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:49.545933Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 35 consumer shared/user session shared/user_1_35_7080413204912763209_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559603074225917200:7208]
2025-10-10T14:40:49.546207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603074225917200:7208], now have 1 active actors on pipe
2025-10-10T14:40:49.546225Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 35 consumer shared/user session shared/user_1_35_7080413204912763209_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 pipe creation result: OK TabletId: 72075186224037892 Generation: 3429, pipe: [1:7559603074225917200:7208]
2025-10-10T14:40:49.549196Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3430 sessionId: src_id|3f01e925-4f77251a-e4eb1c85-a4895165_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:49.554116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:49.554155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:49.554199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:40:49.556912Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:49.556935Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:49.556938Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:49.556940Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:49.556949Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559603073443662774:13645]
2025-10-10T14:40:49.556955Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559603073443662774:13645]
2025-10-10T14:40:49.556959Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559603073443662774:13645]
2025-10-10T14:40:49.557009Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:49.557018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:49.557018Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:49.557025Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:49.557029Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:49.557029Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:49.557169Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:49.552319Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:49.554311Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:40:49.688577Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:49.697437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:49.697466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:49.697631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:49.697682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:49.697738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:49.697797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:49.697924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:49.697927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:49.697990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:49.698041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:49.698099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:49.698168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:49.698212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:49.698216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:49.698287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:49.698359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:49.698425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:49.698490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:49.698534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:49.698541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:49.698615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:49.698684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:49.698745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:49.698808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:49.698852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:49.698858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:49.698923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:49.698985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:49.699047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:49.699110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:49.699157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:49.699164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:49.699236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:49.699299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:49.699362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:49.699426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:49.699470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:49.699478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:49.699548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:49.699607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:49.699672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:49.699735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:49.699781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:49.699787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:49.699873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:49.699936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:49.699999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:49.700063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:49.700109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:49.700115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:49.700182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:49.700243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:49.700313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:49.700376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:49.700422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:49.700428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:49.700494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:49.700552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:49.700612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:49.700677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:49.700723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:49.700730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:49.701416Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:49.701446Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 35 consumer shared/user session shared/user_1_35_7080413204912763209_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 28 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559603074225917200:7208]
2025-10-10T14:40:49.701479Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:40:49.701482Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:40:49.701512Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3430 reason: error at write: Disconnected sessionId: src_id|3f01e925-4f77251a-e4eb1c85-a4895165_0
2025-10-10T14:40:49.701751Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3430 sessionId: src_id|3f01e925-4f77251a-e4eb1c85-a4895165_0 is DEAD
2025-10-10T14:40:49.701746Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:49.702179Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f01e925-4f77251a-e4eb1c85-a4895165_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:40:49.702185Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f01e925-4f77251a-e4eb1c85-a4895165_0] Write session will restart in 0.009688s
2025-10-10T14:40:49.702211Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f01e925-4f77251a-e4eb1c85-a4895165_0] Write session: Do CDS request
2025-10-10T14:40:49.702217Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f01e925-4f77251a-e4eb1c85-a4895165_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:49.712905Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3f01e925-4f77251a-e4eb1c85-a4895165_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:49.712991Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:49.713022Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3431
2025-10-10T14:40:49.713156Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3431 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:49.713191Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3431 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:49.713202Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3431 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:49.713206Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:49.713643Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3431 sessionId:  describe result for acl check
2025-10-10T14:40:49.713678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:49.713687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:49.713688Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:49.713695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559603074225917266:8142] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:49.714259Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559603074225917266:8142] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:49.717374Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559603074225917266:8142] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:49.722023Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559603074225917266:8142] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:49.722042Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559603074225917266:8142] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:49.722046Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559603074225917266:8142] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:49.722056Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3431 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:49.726095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:49.726633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:49.726837Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:49.726852Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:49.726865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:49.726928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:49.726975Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559603073443663055:13649]
2025-10-10T14:40:49.727649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:49.729603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:49.729678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:49.730050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:49.730137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:49.730144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:49.730145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:49.730147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:49.730149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:49.730150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:49.730152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:49.730154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:49.730155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:49.730156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:49.730158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:49.730159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:49.730160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:49.730167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:49.730180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:49.730183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:49.730188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:49.730191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:49.730196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:49.730199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:49.730203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:49.730207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:49.730211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:49.730215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:49.730219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:49.730223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:49.730231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:49.730240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:49.730247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:49.730253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:49.730257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:49.730273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:49.730278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:49.730283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:49.730288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:49.730294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:49.730299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:49.730304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:49.730309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:49.730319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:49.730323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:49.730328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:49.730332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:49.730337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:49.730342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:49.730347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:49.730352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:49.730358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:49.730363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:49.730368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:49.730377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:49.730382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:49.730422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:49.732998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:49.733669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:49.733697Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:49.733699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:49.733703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:49.733710Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3430 [2:7559603073443663055:13649]
2025-10-10T14:40:49.733729Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:49.733751Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:49.733770Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:49.733778Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:49.733781Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:49.733801Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:49.733810Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:49.733824Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:49.733886Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:49.733894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:49.733896Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:49.733898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:49.733971Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:49.733979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:49.733990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:49.734006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:49.734028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:49.734054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603074225917205:2438], now have 1 active actors on pipe
2025-10-10T14:40:49.734063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603074225917467:8142], now have 1 active actors on pipe
2025-10-10T14:40:49.734070Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559603073443663050:13649]
2025-10-10T14:40:49.734074Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559603073443663050:13649]
2025-10-10T14:40:49.734076Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559603073443663050:13649]
2025-10-10T14:40:49.734091Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:49.734109Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:49.734112Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:49.734115Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:49.734117Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:49.734130Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:49.734133Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:49.734115Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3430
2025-10-10T14:40:49.734122Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3430
2025-10-10T14:40:49.734165Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559603073443663050:13649]
2025-10-10T14:40:49.734177Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:49.734190Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:49.734192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:49.734196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:49.734244Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|16e827d6-b0a7e805-44485fd6-83da35ed_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:49.734258Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:49.734268Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:49.734271Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:49.734282Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:49.734293Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:49.734310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:49.734472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:49.734480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:49.734495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:49.734604Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3431 partition: 0 MaxSeqNo: 40 sessionId: src_id|16e827d6-b0a7e805-44485fd6-83da35ed_0
2025-10-10T14:40:49.735028Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f01e925-4f77251a-e4eb1c85-a4895165_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|16e827d6-b0a7e805-44485fd6-83da35ed_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:49.737886Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|16e827d6-b0a7e805-44485fd6-83da35ed_0] Write session: try to update token
2025-10-10T14:40:49.737907Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|16e827d6-b0a7e805-44485fd6-83da35ed_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:49.753841Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:49.753864Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:49.753868Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:49.753870Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:49.753880Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559603073443663050:13649]
2025-10-10T14:40:49.753886Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559603073443663050:13649]
2025-10-10T14:40:49.753891Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559603073443663050:13649]
2025-10-10T14:40:49.753941Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:49.753944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:49.753948Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:49.753952Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:49.753952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:49.753955Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:49.754097Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:49.754561Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3431 sessionId: src_id|16e827d6-b0a7e805-44485fd6-83da35ed_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:49.757392Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:49.801433Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 35 consumer shared/user session shared/user_1_35_7080413204912763209_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559603074225917482:7208]
2025-10-10T14:40:49.801739Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 35 consumer shared/user session shared/user_1_35_7080413204912763209_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 pipe creation result: OK TabletId: 72075186224037892 Generation: 3430, pipe: [1:7559603074225917482:7208]
2025-10-10T14:40:49.874033Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:49.874425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:49.874443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:49.874490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603074225917482:7208], now have 1 active actors on pipe
2025-10-10T14:40:49.874841Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:49.874877Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:40:49.874881Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:40:49.874906Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 35 consumer shared/user session shared/user_1_35_7080413204912763209_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 29 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559603074225917482:7208]
2025-10-10T14:40:49.874957Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3431 reason: error at write: Disconnected sessionId: src_id|16e827d6-b0a7e805-44485fd6-83da35ed_0
2025-10-10T14:40:49.874844Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:49.875322Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3431 sessionId: src_id|16e827d6-b0a7e805-44485fd6-83da35ed_0 is DEAD
2025-10-10T14:40:49.875382Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|16e827d6-b0a7e805-44485fd6-83da35ed_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:40:49.875394Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|16e827d6-b0a7e805-44485fd6-83da35ed_0] Write session will restart in 0.005231s
2025-10-10T14:40:49.875419Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|16e827d6-b0a7e805-44485fd6-83da35ed_0] Write session: Do CDS request
2025-10-10T14:40:49.875437Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|16e827d6-b0a7e805-44485fd6-83da35ed_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:49.881902Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|16e827d6-b0a7e805-44485fd6-83da35ed_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:49.885577Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:49.885593Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3432
2025-10-10T14:40:49.885805Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3432 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:49.885856Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3432 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:49.885867Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3432 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:49.885871Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:49.886316Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3432 sessionId:  describe result for acl check
2025-10-10T14:40:49.886353Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:49.886355Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:49.886357Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:49.886362Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559603074225917515:8157] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:49.886947Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559603074225917515:8157] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:49.891442Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559603074225917515:8157] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:49.895570Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559603074225917515:8157] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:49.895593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559603074225917515:8157] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:49.895597Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559603074225917515:8157] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:49.895605Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3432 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:49.902639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:49.905556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:49.905974Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:49.905986Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:49.906010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:49.906081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:49.906126Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559603073443663331:13651]
2025-10-10T14:40:49.906768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:49.907074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:49.907121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:49.907466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:49.907525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:49.907531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:49.907533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:49.907534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:49.907535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:49.907536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:49.907537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:49.907539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:49.907540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:49.907542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:49.907543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:49.907544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:49.907546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:49.907552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:49.907566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:49.907570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:49.907575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:49.907579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:49.907584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:49.907588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:49.907593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:49.907596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:49.907601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:49.907605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:49.907609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:49.907613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:49.907621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:49.907629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:49.907636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:49.907642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:49.907651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:49.907657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:49.907662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:49.907668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:49.907677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:49.907683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:49.907692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:49.907698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:49.907707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:49.907711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:49.907719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:49.907724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:49.907734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:49.907739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:49.907743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:49.907748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:49.907753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:49.907759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:49.907763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:49.907767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:49.907772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:49.907782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:49.907834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:49.910420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:49.910966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:49.910977Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:49.910979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:49.910984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:49.910990Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3431 [2:7559603073443663331:13651]
2025-10-10T14:40:49.911004Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:49.911023Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:49.911031Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:49.911035Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:49.911040Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:49.911061Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:49.911072Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:49.911084Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:49.911152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:49.911159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:49.911161Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:49.911164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:49.911232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:49.911244Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:49.911255Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:49.911266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:49.911283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:49.911309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603074225917655:8157], now have 1 active actors on pipe
2025-10-10T14:40:49.911316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603074225917486:2438], now have 1 active actors on pipe
2025-10-10T14:40:49.911324Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559603073443663326:13651]
2025-10-10T14:40:49.911327Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559603073443663326:13651]
2025-10-10T14:40:49.911329Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559603073443663326:13651]
2025-10-10T14:40:49.911343Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:49.911358Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:49.911368Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:49.911373Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:49.911380Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:49.911383Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:49.911383Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:49.911401Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3431
2025-10-10T14:40:49.911409Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559603073443663326:13651]
2025-10-10T14:40:49.911419Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:49.911434Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:49.911513Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3431
2025-10-10T14:40:49.911641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:49.911653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:49.911685Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bc098e69-dd6756ef-da6a849a-862162c7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:49.911698Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:49.911701Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:49.911704Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:49.911715Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:49.911731Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:49.911749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:49.911920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:49.911930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:49.911945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:49.912074Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3432 partition: 0 MaxSeqNo: 40 sessionId: src_id|bc098e69-dd6756ef-da6a849a-862162c7_0
2025-10-10T14:40:49.912532Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|16e827d6-b0a7e805-44485fd6-83da35ed_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|bc098e69-dd6756ef-da6a849a-862162c7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:49.915428Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bc098e69-dd6756ef-da6a849a-862162c7_0] Write session: try to update token
2025-10-10T14:40:49.915450Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bc098e69-dd6756ef-da6a849a-862162c7_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:49.932284Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3432 sessionId: src_id|bc098e69-dd6756ef-da6a849a-862162c7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:49.932680Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:40:49.932698Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:49.932710Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559603073443663326:13651]
2025-10-10T14:40:49.932765Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:40:49.932767Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:40:49.932965Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:40:49.933114Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:49.933261Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:49.933425Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:49.933635Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:40:49.933682Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:40:49.935087Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:49.935293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:49.935314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:49.935352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:40:49.935439Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:40:49.942610Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:49.942634Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:49.942637Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:49.942640Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:49.942652Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559603073443663326:13651]
2025-10-10T14:40:49.942656Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559603073443663326:13651]
2025-10-10T14:40:49.942664Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559603073443663326:13651]
2025-10-10T14:40:49.942709Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:49.942713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:49.942720Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:49.942721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:49.942723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:49.942724Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:49.942862Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:49.975118Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 35 consumer shared/user session shared/user_1_35_7080413204912763209_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559603074225917774:7208]
2025-10-10T14:40:49.977102Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 35 consumer shared/user session shared/user_1_35_7080413204912763209_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 pipe creation result: OK TabletId: 72075186224037892 Generation: 3431, pipe: [1:7559603074225917774:7208]
2025-10-10T14:40:50.061741Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:50.069730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:50.069759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:50.069948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:50.070021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:50.070097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:50.070156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:50.070200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:50.070205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:50.070269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:50.070319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:50.070376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:50.070447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:50.070485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:50.070487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:50.070548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:50.070603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:50.070662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:50.070722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:50.070759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:50.070761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:50.070825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:50.070880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:50.070944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:50.071009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:50.071044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:50.071046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:50.071104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:50.071157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:50.071221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:50.071275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:50.071312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:50.071314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:50.071373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:50.071427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:50.071485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:50.071540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:50.071578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:50.071580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:50.071641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:50.071699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:50.071761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:50.071833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:50.071871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:50.071876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:50.071939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:50.071996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:50.072047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:50.072100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:50.072141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:50.072143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:50.072208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:50.072264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:50.072319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:50.072372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:50.072469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:50.072474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:50.072545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:50.072604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:50.072658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:50.072718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:50.072760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:50.072763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:50.072840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603074225917774:7208], now have 1 active actors on pipe
2025-10-10T14:40:50.073461Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 35 consumer shared/user session shared/user_1_35_7080413204912763209_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 30 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559603074225917774:7208]
2025-10-10T14:40:50.073487Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:50.073508Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:40:50.073511Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:40:50.073544Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3432 reason: error at write: Disconnected sessionId: src_id|bc098e69-dd6756ef-da6a849a-862162c7_0
2025-10-10T14:40:50.073894Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:50.074650Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc098e69-dd6756ef-da6a849a-862162c7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:40:50.074661Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc098e69-dd6756ef-da6a849a-862162c7_0] Write session will restart in 0.009080s
2025-10-10T14:40:50.074680Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc098e69-dd6756ef-da6a849a-862162c7_0] Write session: Do CDS request
2025-10-10T14:40:50.074684Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc098e69-dd6756ef-da6a849a-862162c7_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:50.073961Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3432 sessionId: src_id|bc098e69-dd6756ef-da6a849a-862162c7_0 is DEAD
2025-10-10T14:40:50.085949Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bc098e69-dd6756ef-da6a849a-862162c7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:50.089283Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:50.089302Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3433
2025-10-10T14:40:50.089602Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3433 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:50.089645Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3433 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:50.089651Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3433 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:50.089656Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:50.090217Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3433 sessionId:  describe result for acl check
2025-10-10T14:40:50.090266Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:50.090276Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:50.090278Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:50.090285Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559603078520885096:5180] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:50.090870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559603078520885096:5180] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:50.093779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559603078520885096:5180] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:50.096074Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559603078520885096:5180] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:50.096090Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559603078520885096:5180] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:50.096094Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559603078520885096:5180] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:50.096104Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3433 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:50.113862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:50.117489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:50.117768Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:50.117783Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:50.117798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:50.117866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:50.117918Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559603077738630915:13654]
2025-10-10T14:40:50.118569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:50.118887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:50.118938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:50.119278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:50.119362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:50.119371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:50.119373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:50.119374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:50.119376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:50.119377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:50.119379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:50.119380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:50.119381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:50.119383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:50.119385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:50.119386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:50.119387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:50.119393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:50.119408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:50.119412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:50.119416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:50.119420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:50.119425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:50.119429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:50.119433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:50.119437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:50.119442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:50.119446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:50.119450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:50.119455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:50.119462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:50.119471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:50.119479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:50.119485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:50.119490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:50.119496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:50.119502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:50.119508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:50.119513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:50.119518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:50.119524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:50.119530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:50.119536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:50.119541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:50.119546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:50.119552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:50.119560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:50.119566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:50.119571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:50.119576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:50.119581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:50.119586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:50.119591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:50.119597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:50.119602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:50.119608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:50.119649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:50.122370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:50.123067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:50.123080Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:50.123083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:50.123087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:50.123094Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3432 [2:7559603077738630915:13654]
2025-10-10T14:40:50.123108Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:50.123128Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:50.123132Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:50.123136Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:50.123138Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:50.123157Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:50.123171Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:50.123180Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:50.123249Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:50.123257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:50.123259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:50.123262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:50.123345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:50.123353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:50.123365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:50.123376Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:50.123397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:50.123425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603078520885073:2438], now have 1 active actors on pipe
2025-10-10T14:40:50.123433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603078520885133:5180], now have 1 active actors on pipe
2025-10-10T14:40:50.123442Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559603077738630909:13654]
2025-10-10T14:40:50.123448Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559603077738630909:13654]
2025-10-10T14:40:50.123450Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559603077738630909:13654]
2025-10-10T14:40:50.123465Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:50.123484Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:50.123497Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:50.123506Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:50.123509Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:50.123509Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:50.123512Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:50.123540Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559603077738630909:13654]
2025-10-10T14:40:50.123554Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:50.123581Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:50.123794Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3432
2025-10-10T14:40:50.123853Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3432
2025-10-10T14:40:50.123936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:50.123950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:50.123998Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f6e5da7a-58674609-9a762503-e6ca3c66_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:50.124008Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:50.124012Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:50.124015Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:50.124029Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:50.124057Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:50.124080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:50.124974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:50.124988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:50.125010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:50.129441Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3433 partition: 0 MaxSeqNo: 40 sessionId: src_id|f6e5da7a-58674609-9a762503-e6ca3c66_0
2025-10-10T14:40:50.129968Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc098e69-dd6756ef-da6a849a-862162c7_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|f6e5da7a-58674609-9a762503-e6ca3c66_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:50.132684Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f6e5da7a-58674609-9a762503-e6ca3c66_0] Write session: try to update token
2025-10-10T14:40:50.132702Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f6e5da7a-58674609-9a762503-e6ca3c66_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:50.136110Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:40:50.136127Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:50.136139Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559603077738630909:13654]
2025-10-10T14:40:50.136190Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:40:50.136191Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:40:50.136373Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:40:50.136512Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:50.136657Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:50.136802Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:50.137114Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:40:50.137151Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:40:50.156147Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:50.156174Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:50.156180Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:50.156184Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:50.156198Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559603077738630909:13654]
2025-10-10T14:40:50.156209Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559603077738630909:13654]
2025-10-10T14:40:50.156214Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559603077738630909:13654]
2025-10-10T14:40:50.156267Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:50.156275Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:50.156277Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:50.156280Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:50.156288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:50.156291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:50.156565Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:50.172226Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3433 sessionId: src_id|f6e5da7a-58674609-9a762503-e6ca3c66_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:50.173147Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 35 consumer shared/user session shared/user_1_35_7080413204912763209_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559603078520885363:7208]
2025-10-10T14:40:50.173494Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 35 consumer shared/user session shared/user_1_35_7080413204912763209_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 pipe creation result: OK TabletId: 72075186224037892 Generation: 3432, pipe: [1:7559603078520885363:7208]
2025-10-10T14:40:50.175051Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:50.277475Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:50.278087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603078520885363:7208], now have 1 active actors on pipe
2025-10-10T14:40:50.278119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:50.278126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:50.278391Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:50.278750Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 35 consumer shared/user session shared/user_1_35_7080413204912763209_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 31 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559603078520885363:7208]
2025-10-10T14:40:50.278755Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:40:50.278790Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:50.278847Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3433 reason: status is not ok: tablet will be restarted right now sessionId: src_id|f6e5da7a-58674609-9a762503-e6ca3c66_0
2025-10-10T14:40:50.279061Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3433 sessionId: src_id|f6e5da7a-58674609-9a762503-e6ca3c66_0 is DEAD
2025-10-10T14:40:50.279209Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f6e5da7a-58674609-9a762503-e6ca3c66_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:40:50.279219Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f6e5da7a-58674609-9a762503-e6ca3c66_0] Write session will restart in 0.005781s
2025-10-10T14:40:50.279243Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f6e5da7a-58674609-9a762503-e6ca3c66_0] Write session: Do CDS request
2025-10-10T14:40:50.279249Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f6e5da7a-58674609-9a762503-e6ca3c66_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:50.285897Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f6e5da7a-58674609-9a762503-e6ca3c66_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:50.286029Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:50.286045Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3434
2025-10-10T14:40:50.286217Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3434 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:50.286272Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3434 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:50.286283Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3434 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:50.286287Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:50.286815Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3434 sessionId:  describe result for acl check
2025-10-10T14:40:50.286857Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:50.286866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:50.286868Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:50.286874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559603078520885381:5181] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:50.287460Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559603078520885381:5181] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:50.291847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559603078520885381:5181] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:50.296511Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559603078520885381:5181] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:50.296526Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559603078520885381:5181] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:50.296530Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559603078520885381:5181] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:50.296540Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3434 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:50.306406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:50.309888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:50.310082Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:50.310087Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:50.310096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:50.310133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:50.310169Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559603077738631192:13656]
2025-10-10T14:40:50.310593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:50.310928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:50.310973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:50.311199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:50.311239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:50.311240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:50.311241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:50.311242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:50.311243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:50.311244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:50.311244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:50.311245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:50.311246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:50.311247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:50.311247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:50.311248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:50.311249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:50.311253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:50.311263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:50.311265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:50.311268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:50.311271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:50.311273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:50.311276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:50.311278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:50.311280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:50.311283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:50.311285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:50.311287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:50.311290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:50.311304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:50.311310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:50.311314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:50.311318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:50.311323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:50.311326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:50.311329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:50.311332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:50.311335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:50.311338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:50.311341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:50.311344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:50.311346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:50.311350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:50.311352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:50.311355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:50.311358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:50.311362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:50.311366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:50.311373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:50.311377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:50.311382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:50.311385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:50.311390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:50.311393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:50.311397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:50.311429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:50.313818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:50.314162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:50.314172Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:50.314174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:50.314178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:50.314183Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3433 [2:7559603077738631192:13656]
2025-10-10T14:40:50.314192Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:50.314206Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:50.314208Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:50.314211Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:50.314212Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:50.314226Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:50.314231Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:50.314238Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:50.314285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:50.314291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:50.314293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:50.314295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:50.314379Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:50.314386Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:50.314396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:50.314406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:50.314426Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:50.314451Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559603077738631186:13656]
2025-10-10T14:40:50.314457Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559603077738631186:13656]
2025-10-10T14:40:50.314459Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559603077738631186:13656]
2025-10-10T14:40:50.314471Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:50.314490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603078520885366:2438], now have 1 active actors on pipe
2025-10-10T14:40:50.314496Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:50.314498Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:50.314499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603078520885538:5181], now have 1 active actors on pipe
2025-10-10T14:40:50.314503Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:50.314508Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:50.314522Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:50.314530Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:50.314555Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559603077738631186:13656]
2025-10-10T14:40:50.314564Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:50.314610Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:50.314637Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3433
2025-10-10T14:40:50.314652Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3433
2025-10-10T14:40:50.314819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:50.314840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:50.314875Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|637780f9-e75a017f-eebb7685-41f69399_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:50.314887Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:50.314903Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:50.314905Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:50.314920Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:50.314936Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:50.314954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:50.315243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:50.315252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:50.315268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:50.315402Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3434 partition: 0 MaxSeqNo: 40 sessionId: src_id|637780f9-e75a017f-eebb7685-41f69399_0
2025-10-10T14:40:50.315880Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f6e5da7a-58674609-9a762503-e6ca3c66_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|637780f9-e75a017f-eebb7685-41f69399_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:50.318377Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|637780f9-e75a017f-eebb7685-41f69399_0] Write session: try to update token
2025-10-10T14:40:50.318392Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|637780f9-e75a017f-eebb7685-41f69399_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:50.338873Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3434 sessionId: src_id|637780f9-e75a017f-eebb7685-41f69399_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:50.341497Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:50.341844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:50.341870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:50.341916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:40:50.342114Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:40:50.350339Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:50.350362Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:50.350366Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:50.350368Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:50.350379Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559603077738631186:13656]
2025-10-10T14:40:50.350385Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559603077738631186:13656]
2025-10-10T14:40:50.350391Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559603077738631186:13656]
2025-10-10T14:40:50.350453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:50.350455Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:50.350462Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:50.350466Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:50.350466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:50.350469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:50.350663Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:50.378459Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 35 consumer shared/user session shared/user_1_35_7080413204912763209_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559603078520885647:7208]
2025-10-10T14:40:50.378977Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 35 consumer shared/user session shared/user_1_35_7080413204912763209_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 pipe creation result: OK TabletId: 72075186224037892 Generation: 3433, pipe: [1:7559603078520885647:7208]
2025-10-10T14:40:50.466917Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:50.476573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:50.476608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:50.476808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:50.476890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:50.476960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:50.477030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:50.477082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:50.477087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:50.477169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:50.477233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:50.477302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:50.477475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:50.477530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:50.477533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:50.477613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:50.477685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:50.477762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:50.477837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:50.477885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:50.477887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:50.477967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:50.478041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:50.478111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:50.478185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:50.478230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:50.478232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:50.478317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:50.478391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:50.478487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:50.478564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:50.478615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:50.478618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:50.478702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:50.478772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:50.478843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:50.478914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:50.478957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:50.478960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:50.479040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:50.479107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:50.479182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:50.479251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:50.479297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:50.479300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:50.479386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:50.479453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:50.479520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:50.479588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:50.479637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:50.479640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:50.479722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:50.479788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:50.479875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:50.479943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:50.479992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:50.479995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:50.480075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:50.480139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:50.480210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:50.480281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:50.480327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:50.480331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:50.481986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603078520885647:7208], now have 1 active actors on pipe
2025-10-10T14:40:50.483282Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 35 consumer shared/user session shared/user_1_35_7080413204912763209_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 32 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559603078520885647:7208]
2025-10-10T14:40:50.483321Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:40:50.483323Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:40:50.483354Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3434 reason: error at write: Disconnected sessionId: src_id|637780f9-e75a017f-eebb7685-41f69399_0
2025-10-10T14:40:50.483595Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3434 sessionId: src_id|637780f9-e75a017f-eebb7685-41f69399_0 is DEAD
2025-10-10T14:40:50.484174Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:50.484505Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|637780f9-e75a017f-eebb7685-41f69399_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:40:50.484514Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|637780f9-e75a017f-eebb7685-41f69399_0] Write session will restart in 0.008146s
2025-10-10T14:40:50.484539Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|637780f9-e75a017f-eebb7685-41f69399_0] Write session: Do CDS request
2025-10-10T14:40:50.484545Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|637780f9-e75a017f-eebb7685-41f69399_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:50.483927Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:50.493946Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|637780f9-e75a017f-eebb7685-41f69399_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:50.497506Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:50.497522Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3435
2025-10-10T14:40:50.501520Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3435 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:50.501592Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3435 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:50.501598Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3435 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:50.501604Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:50.502102Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3435 sessionId:  describe result for acl check
2025-10-10T14:40:50.502146Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:50.502149Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:50.502151Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:50.502159Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559603078520885696:5094] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:50.502761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559603078520885696:5094] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:50.507196Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559603078520885696:5094] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:50.514128Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559603078520885696:5094] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:50.514149Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559603078520885696:5094] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:50.514153Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559603078520885696:5094] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:50.514163Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3435 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:50.527215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:50.528275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:50.528495Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:50.528501Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:50.528514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:50.528580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:50.528623Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559603077738631504:13665]
2025-10-10T14:40:50.529235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:50.531247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:50.531302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:50.531653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:50.531705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:50.531706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:50.531707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:50.531708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:50.531709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:50.531711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:50.531712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:50.531713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:50.531714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:50.531716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:50.531717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:50.531718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:50.531719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:50.531726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:50.531740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:50.531744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:50.531748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:50.531752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:50.531756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:50.531761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:50.531765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:50.531769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:50.531774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:50.531778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:50.531782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:50.531786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:50.531794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:50.531803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:50.531821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:50.531826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:50.531831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:50.531837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:50.531841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:50.531847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:50.531851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:50.531857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:50.531863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:50.531868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:50.531873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:50.531878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:50.531882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:50.531888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:50.531893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:50.531899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:50.531903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:50.531908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:50.531914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:50.531919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:50.531924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:50.531929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:50.531934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:50.531939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:50.531981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:50.536102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:50.536731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:50.536737Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:50.536739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:50.536743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:50.536750Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3434 [2:7559603077738631504:13665]
2025-10-10T14:40:50.536765Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:50.536784Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:50.536788Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:50.536792Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:50.536794Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:50.536813Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:50.536821Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:50.536829Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:50.536896Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:50.536899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:50.536901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:50.536903Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:50.536976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:50.536979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:50.536991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:50.537004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:50.537022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:50.537046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603078520885662:2438], now have 1 active actors on pipe
2025-10-10T14:40:50.537050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603078520885813:5094], now have 1 active actors on pipe
2025-10-10T14:40:50.537060Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559603077738631499:13665]
2025-10-10T14:40:50.537062Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559603077738631499:13665]
2025-10-10T14:40:50.537064Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559603077738631499:13665]
2025-10-10T14:40:50.537080Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:50.537094Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:50.537111Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:50.537113Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:50.537115Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:50.537117Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:50.537118Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:50.537146Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559603077738631499:13665]
2025-10-10T14:40:50.537154Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:50.537159Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:50.537390Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3434
2025-10-10T14:40:50.537446Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3434
2025-10-10T14:40:50.537784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:50.537795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:50.537827Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1d189c04-1156ac4-f4aafc8f-4a37a74e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:50.537835Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:50.537840Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:50.537842Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:50.537856Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:50.537869Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:50.537895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:50.538071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:50.538078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:50.538094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:50.538231Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3435 partition: 0 MaxSeqNo: 40 sessionId: src_id|1d189c04-1156ac4-f4aafc8f-4a37a74e_0
2025-10-10T14:40:50.538727Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|637780f9-e75a017f-eebb7685-41f69399_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|1d189c04-1156ac4-f4aafc8f-4a37a74e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:50.541731Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1d189c04-1156ac4-f4aafc8f-4a37a74e_0] Write session: try to update token
2025-10-10T14:40:50.541752Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1d189c04-1156ac4-f4aafc8f-4a37a74e_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:50.564949Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:50.564971Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:50.564975Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:50.564980Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:50.564991Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559603077738631499:13665]
2025-10-10T14:40:50.564996Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559603077738631499:13665]
2025-10-10T14:40:50.565000Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559603077738631499:13665]
2025-10-10T14:40:50.565053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:50.565063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:50.565063Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:50.565065Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:50.565079Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:50.565083Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:50.565230Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:50.569850Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3435 sessionId: src_id|1d189c04-1156ac4-f4aafc8f-4a37a74e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:50.572739Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:50.586391Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 35 consumer shared/user session shared/user_1_35_7080413204912763209_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559603078520885955:7208]
2025-10-10T14:40:50.587137Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 35 consumer shared/user session shared/user_1_35_7080413204912763209_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 pipe creation result: OK TabletId: 72075186224037892 Generation: 3434, pipe: [1:7559603078520885955:7208]
2025-10-10T14:40:50.683928Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:50.684394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:50.684411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:50.684462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603078520885955:7208], now have 1 active actors on pipe
2025-10-10T14:40:50.684719Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:50.685272Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d189c04-1156ac4-f4aafc8f-4a37a74e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:40:50.685282Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d189c04-1156ac4-f4aafc8f-4a37a74e_0] Write session will restart in 0.006017s
2025-10-10T14:40:50.685308Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d189c04-1156ac4-f4aafc8f-4a37a74e_0] Write session: Do CDS request
2025-10-10T14:40:50.685315Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d189c04-1156ac4-f4aafc8f-4a37a74e_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:50.684763Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:40:50.684780Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:40:50.684859Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3435 reason: error at write: Disconnected sessionId: src_id|1d189c04-1156ac4-f4aafc8f-4a37a74e_0
2025-10-10T14:40:50.685101Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3435 sessionId: src_id|1d189c04-1156ac4-f4aafc8f-4a37a74e_0 is DEAD
2025-10-10T14:40:50.685303Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 35 consumer shared/user session shared/user_1_35_7080413204912763209_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 33 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559603078520885955:7208]
2025-10-10T14:40:50.685370Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:50.693034Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1d189c04-1156ac4-f4aafc8f-4a37a74e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:50.693146Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:50.693164Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3436
2025-10-10T14:40:50.693317Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3436 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:50.693366Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3436 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:50.693377Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3436 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:50.693382Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:50.693993Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3436 sessionId:  describe result for acl check
2025-10-10T14:40:50.694041Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:50.694043Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:50.694046Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:50.694053Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559603078520885973:5075] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:50.694679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559603078520885973:5075] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:50.699258Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559603078520885973:5075] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:50.707721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559603078520885973:5075] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:50.707743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559603078520885973:5075] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:50.707747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559603078520885973:5075] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:50.707757Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3436 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:50.714603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:50.718199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:50.718453Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:50.718459Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:50.718472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:50.718538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:50.718583Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559603077738631789:13674]
2025-10-10T14:40:50.719250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:50.719689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:50.719755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:50.720114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:50.720180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:50.720182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:50.720183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:50.720185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:50.720186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:50.720187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:50.720189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:50.720190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:50.720191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:50.720193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:50.720194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:50.720195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:50.720197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:50.720204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:50.720219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:50.720224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:50.720229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:50.720234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:50.720238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:50.720243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:50.720247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:50.720252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:50.720256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:50.720262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:50.720266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:50.720270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:50.720278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:50.720287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:50.720294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:50.720300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:50.720305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:50.720310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:50.720315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:50.720320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:50.720326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:50.720332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:50.720337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:50.720344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:50.720349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:50.720356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:50.720360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:50.720367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:50.720372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:50.720378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:50.720382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:50.720388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:50.720392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:50.720396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:50.720401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:50.720409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:50.720413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:50.720419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:50.720461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:50.723564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:50.723996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:50.724012Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:50.724015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:50.724019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:50.724026Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3435 [2:7559603077738631789:13674]
2025-10-10T14:40:50.724042Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:50.724062Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:50.724071Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:50.724075Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:50.724078Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:50.724097Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:50.724111Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:50.724119Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:50.724200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:50.724213Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:50.724215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:50.724218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:50.724301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:50.724309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:50.724323Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:50.724338Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:50.724362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:50.724484Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3435
2025-10-10T14:40:50.724484Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3435
2025-10-10T14:40:50.724391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603078520885958:2438], now have 1 active actors on pipe
2025-10-10T14:40:50.724404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603078520886117:5075], now have 1 active actors on pipe
2025-10-10T14:40:50.724413Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559603077738631784:13674]
2025-10-10T14:40:50.724415Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559603077738631784:13674]
2025-10-10T14:40:50.724418Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559603077738631784:13674]
2025-10-10T14:40:50.724432Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:50.724447Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:50.724453Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:50.724457Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:50.724459Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:50.724464Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:50.724468Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:50.724500Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559603077738631784:13674]
2025-10-10T14:40:50.724508Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:50.724534Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:50.725092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:50.725111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:50.725150Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|988b4c6e-2eb7b60f-b40b3d43-7eb32ed4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:50.725165Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:50.725170Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:50.725173Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:50.725188Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:50.725207Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:50.725229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:50.725423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:50.725433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:50.725450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:50.725540Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3436 partition: 0 MaxSeqNo: 40 sessionId: src_id|988b4c6e-2eb7b60f-b40b3d43-7eb32ed4_0
2025-10-10T14:40:50.729506Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d189c04-1156ac4-f4aafc8f-4a37a74e_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|988b4c6e-2eb7b60f-b40b3d43-7eb32ed4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:50.732330Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|988b4c6e-2eb7b60f-b40b3d43-7eb32ed4_0] Write session: try to update token
2025-10-10T14:40:50.732350Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|988b4c6e-2eb7b60f-b40b3d43-7eb32ed4_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:50.744958Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:50.744978Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:50.744982Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:50.744984Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:50.744995Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559603077738631784:13674]
2025-10-10T14:40:50.745000Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559603077738631784:13674]
2025-10-10T14:40:50.745004Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559603077738631784:13674]
2025-10-10T14:40:50.745057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:50.745073Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:50.745072Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:50.745079Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:50.745080Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:50.745084Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:50.745220Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:50.761042Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3436 sessionId: src_id|988b4c6e-2eb7b60f-b40b3d43-7eb32ed4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:50.763847Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:50.785475Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 35 consumer shared/user session shared/user_1_35_7080413204912763209_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559603078520886240:7208]
2025-10-10T14:40:50.789550Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 35 consumer shared/user session shared/user_1_35_7080413204912763209_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 pipe creation result: OK TabletId: 72075186224037892 Generation: 3435, pipe: [1:7559603078520886240:7208]
2025-10-10T14:40:50.869665Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:50.870270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:50.870289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:50.870316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603078520886240:7208], now have 1 active actors on pipe
2025-10-10T14:40:50.870545Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:50.872939Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|988b4c6e-2eb7b60f-b40b3d43-7eb32ed4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:40:50.872952Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|988b4c6e-2eb7b60f-b40b3d43-7eb32ed4_0] Write session will restart in 0.009642s
2025-10-10T14:40:50.872978Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|988b4c6e-2eb7b60f-b40b3d43-7eb32ed4_0] Write session: Do CDS request
2025-10-10T14:40:50.872985Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|988b4c6e-2eb7b60f-b40b3d43-7eb32ed4_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:50.872400Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:50.872470Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:40:50.872484Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 35 consumer shared/user session shared/user_1_35_7080413204912763209_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 34 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559603078520886240:7208]
2025-10-10T14:40:50.872541Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3436 reason: status is not ok: tablet will be restarted right now sessionId: src_id|988b4c6e-2eb7b60f-b40b3d43-7eb32ed4_0
2025-10-10T14:40:50.872825Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3436 sessionId: src_id|988b4c6e-2eb7b60f-b40b3d43-7eb32ed4_0 is DEAD
2025-10-10T14:40:50.885868Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|988b4c6e-2eb7b60f-b40b3d43-7eb32ed4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:50.885934Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:50.885955Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3437
2025-10-10T14:40:50.886878Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3437 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:50.886938Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3437 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:50.886950Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3437 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:50.886953Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:50.887416Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3437 sessionId:  describe result for acl check
2025-10-10T14:40:50.887451Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:50.887456Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:50.887459Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:50.887465Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559603078520886334:5012] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:50.888091Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559603078520886334:5012] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:50.891100Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559603078520886334:5012] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:50.894739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559603078520886334:5012] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:50.894763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559603078520886334:5012] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:50.894768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559603078520886334:5012] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:50.894777Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3437 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:50.896463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:50.899498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:50.899780Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:50.899799Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:50.899825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:50.899919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:50.899965Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559603077738632068:13676]
2025-10-10T14:40:50.900624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:50.900981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:50.901043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:50.901402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:50.901502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:50.901510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:50.901511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:50.901512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:50.901514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:50.901515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:50.901516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:50.901518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:50.901519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:50.901521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:50.901522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:50.901524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:50.901525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:50.901532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:50.901547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:50.901551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:50.901556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:50.901560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:50.901564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:50.901568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:50.901573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:50.901577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:50.901582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:50.901586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:50.901591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:50.901594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:50.901604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:50.901613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:50.901620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:50.901626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:50.901631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:50.901638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:50.901643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:50.901649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:50.901654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:50.901660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:50.901664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:50.901669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:50.901674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:50.901680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:50.901697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:50.901703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:50.901708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:50.901714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:50.901719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:50.901726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:50.901732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:50.901738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:50.901749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:50.901754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:50.901758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:50.901783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:50.901827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:50.910791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:50.911133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:50.911150Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:50.911153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:50.911157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:50.911165Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3436 [2:7559603077738632068:13676]
2025-10-10T14:40:50.911181Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:50.911203Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:50.911206Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:50.911210Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:50.911213Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:50.911232Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:50.911241Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:50.911261Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:50.911333Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:50.911342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:50.911344Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:50.911347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:50.911580Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3436
2025-10-10T14:40:50.911630Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3436
2025-10-10T14:40:50.911592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:50.911604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:50.911618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:50.911632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:50.911651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:50.911677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603078520886516:5012], now have 1 active actors on pipe
2025-10-10T14:40:50.911681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603078520886245:2438], now have 1 active actors on pipe
2025-10-10T14:40:50.911748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:50.911753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:50.911774Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559603077738632063:13676]
2025-10-10T14:40:50.911776Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559603077738632063:13676]
2025-10-10T14:40:50.911779Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559603077738632063:13676]
2025-10-10T14:40:50.911788Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:50.911814Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:50.911817Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:50.911818Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:50.911820Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:50.911835Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:50.911839Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:50.911865Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c4461bd3-85e3f76b-293fa637-e8256e42_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:50.911873Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:50.911879Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:50.911881Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:50.911894Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:50.911906Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:50.911957Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559603077738632063:13676]
2025-10-10T14:40:50.911969Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:50.911977Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:50.911985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:50.912180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:50.912187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:50.912211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:50.912400Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3437 partition: 0 MaxSeqNo: 40 sessionId: src_id|c4461bd3-85e3f76b-293fa637-e8256e42_0
2025-10-10T14:40:50.912866Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|988b4c6e-2eb7b60f-b40b3d43-7eb32ed4_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|c4461bd3-85e3f76b-293fa637-e8256e42_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:50.915676Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c4461bd3-85e3f76b-293fa637-e8256e42_0] Write session: try to update token
2025-10-10T14:40:50.915697Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c4461bd3-85e3f76b-293fa637-e8256e42_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:50.930012Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:40:50.930030Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:50.930042Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559603077738632063:13676]
2025-10-10T14:40:50.930088Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:40:50.930093Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:40:50.930279Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:40:50.930433Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:50.930576Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:50.930720Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:50.930918Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:40:50.930967Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:40:50.933758Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3437 sessionId: src_id|c4461bd3-85e3f76b-293fa637-e8256e42_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:50.943089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:50.943127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:50.943180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:40:50.942749Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:50.944552Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:40:50.955636Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:50.955669Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:50.955674Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:50.955676Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:50.955688Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559603077738632063:13676]
2025-10-10T14:40:50.955693Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559603077738632063:13676]
2025-10-10T14:40:50.955698Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559603077738632063:13676]
2025-10-10T14:40:50.955749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:50.955759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:50.955765Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:50.955765Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:50.955774Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:50.955779Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:50.955928Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:50.972382Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 35 consumer shared/user session shared/user_1_35_7080413204912763209_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559603078520886536:7208]
2025-10-10T14:40:50.972767Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 35 consumer shared/user session shared/user_1_35_7080413204912763209_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 pipe creation result: OK TabletId: 72075186224037892 Generation: 3436, pipe: [1:7559603078520886536:7208]
2025-10-10T14:40:51.078658Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:51.079093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603078520886536:7208], now have 1 active actors on pipe
2025-10-10T14:40:51.087459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:51.087491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:51.087692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:51.087766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:51.087853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:51.087927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:51.087968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:51.087973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:51.088044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:51.088103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:51.088165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:51.088230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:51.088269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:51.088272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:51.088343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:51.088399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:51.088458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:51.088514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:51.088561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:51.088564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:51.088634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:51.088691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:51.088750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:51.088814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:51.088851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:51.088858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:51.088930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:51.088990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:51.089048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:51.089105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:51.089149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:51.089153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:51.089220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:51.089278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:51.089370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:51.089434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:51.089476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:51.089479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:51.089549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:51.089611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:51.089690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:51.089757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:51.089803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:51.089813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:51.089885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:51.089954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:51.090019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:51.090085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:51.090131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:51.090143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:51.090220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:51.090282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:51.090346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:51.090410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:51.090454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:51.090457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:51.090529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:51.090591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:51.090656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:51.090723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:51.090766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:51.090769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:51.091077Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:40:51.091108Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:40:51.091143Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3437 reason: error at write: Disconnected sessionId: src_id|c4461bd3-85e3f76b-293fa637-e8256e42_0
2025-10-10T14:40:51.091390Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3437 sessionId: src_id|c4461bd3-85e3f76b-293fa637-e8256e42_0 is DEAD
2025-10-10T14:40:51.091542Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4461bd3-85e3f76b-293fa637-e8256e42_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:40:51.091553Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4461bd3-85e3f76b-293fa637-e8256e42_0] Write session will restart in 0.008209s
2025-10-10T14:40:51.091581Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4461bd3-85e3f76b-293fa637-e8256e42_0] Write session: Do CDS request
2025-10-10T14:40:51.091587Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4461bd3-85e3f76b-293fa637-e8256e42_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:51.091612Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 35 consumer shared/user session shared/user_1_35_7080413204912763209_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 35 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559603078520886536:7208]
2025-10-10T14:40:51.091641Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:51.092083Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:51.100966Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c4461bd3-85e3f76b-293fa637-e8256e42_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:51.101872Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:51.101890Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3438
2025-10-10T14:40:51.105706Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3438 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:51.105767Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3438 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:51.105773Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3438 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:51.105779Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:51.106486Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3438 sessionId:  describe result for acl check
2025-10-10T14:40:51.106527Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:51.106541Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:51.106543Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:51.106549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559603082815853940:4977] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:51.107145Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559603082815853940:4977] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:51.110551Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559603082815853940:4977] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:51.113737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559603082815853940:4977] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:51.113753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559603082815853940:4977] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:51.113766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559603082815853940:4977] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:51.113774Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3438 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:51.117117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:51.120197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:51.120448Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:51.120458Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:51.120470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:51.120520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:51.120564Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559603082033599657:13679]
2025-10-10T14:40:51.121215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:51.121640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:51.121687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:51.122031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:51.122093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:51.122099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:51.122101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:51.122102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:51.122103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:51.122105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:51.122106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:51.122108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:51.122109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:51.122110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:51.122112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:51.122113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:51.122114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:51.122120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:51.122135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:51.122139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:51.122144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:51.122148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:51.122152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:51.122156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:51.122160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:51.122164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:51.122169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:51.122173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:51.122177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:51.122181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:51.122190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:51.122201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:51.122208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:51.122214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:51.122219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:51.122224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:51.122228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:51.122234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:51.122240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:51.122245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:51.122250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:51.122256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:51.122262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:51.122273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:51.122279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:51.122284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:51.122289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:51.122295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:51.122299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:51.122305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:51.122309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:51.122321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:51.122327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:51.122333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:51.122339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:51.122345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:51.122401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:51.125210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:51.126241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:51.126266Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:51.126270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:51.126276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:51.126285Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3437 [2:7559603082033599657:13679]
2025-10-10T14:40:51.126304Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:51.126333Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:51.126346Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:51.126353Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:51.126356Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:51.126379Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:51.126390Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:51.126402Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:51.126499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:51.126517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:51.126520Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:51.126524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:51.126629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:51.126643Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:51.126659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:51.126681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:51.126701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:51.126739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603082815854092:4977], now have 1 active actors on pipe
2025-10-10T14:40:51.126752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603082815853847:2438], now have 1 active actors on pipe
2025-10-10T14:40:51.126761Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559603082033599652:13679]
2025-10-10T14:40:51.126763Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559603082033599652:13679]
2025-10-10T14:40:51.126766Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559603082033599652:13679]
2025-10-10T14:40:51.126784Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:51.126809Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:51.126830Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:51.126837Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:51.126844Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:51.126849Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:51.126852Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:51.126822Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3437
2025-10-10T14:40:51.126832Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3437
2025-10-10T14:40:51.126892Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559603082033599652:13679]
2025-10-10T14:40:51.126908Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:51.126913Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:51.126949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:51.126970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:51.127031Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8252da1d-7bdc6fef-3288ed12-ce7c27b9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:51.127052Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:51.127059Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:51.127062Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:51.127079Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:51.127103Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:51.127146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:51.127405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:51.127421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:51.127442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:51.127569Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3438 partition: 0 MaxSeqNo: 40 sessionId: src_id|8252da1d-7bdc6fef-3288ed12-ce7c27b9_0
2025-10-10T14:40:51.128026Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4461bd3-85e3f76b-293fa637-e8256e42_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|8252da1d-7bdc6fef-3288ed12-ce7c27b9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:51.131032Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8252da1d-7bdc6fef-3288ed12-ce7c27b9_0] Write session: try to update token
2025-10-10T14:40:51.131056Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8252da1d-7bdc6fef-3288ed12-ce7c27b9_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:51.146806Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:51.146834Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:51.146838Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:51.146840Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:51.146852Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559603082033599652:13679]
2025-10-10T14:40:51.146857Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559603082033599652:13679]
2025-10-10T14:40:51.146862Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559603082033599652:13679]
2025-10-10T14:40:51.146916Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:51.146921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:51.146925Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:51.146929Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:51.146930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:51.146933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:51.147073Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:51.150356Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3438 sessionId: src_id|8252da1d-7bdc6fef-3288ed12-ce7c27b9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:51.153634Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:51.193512Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 35 consumer shared/user session shared/user_1_35_7080413204912763209_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559603082815854132:7208]
2025-10-10T14:40:51.196508Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 35 consumer shared/user session shared/user_1_35_7080413204912763209_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 pipe creation result: OK TabletId: 72075186224037892 Generation: 3437, pipe: [1:7559603082815854132:7208]
2025-10-10T14:40:51.269998Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:51.270560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:51.270582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:51.270633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603082815854132:7208], now have 1 active actors on pipe
2025-10-10T14:40:51.270867Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:51.270870Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 35 consumer shared/user session shared/user_1_35_7080413204912763209_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 36 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559603082815854132:7208]
2025-10-10T14:40:51.270884Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:40:51.270888Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:40:51.270915Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:51.270956Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3438 reason: error at write: Disconnected sessionId: src_id|8252da1d-7bdc6fef-3288ed12-ce7c27b9_0
2025-10-10T14:40:51.271176Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3438 sessionId: src_id|8252da1d-7bdc6fef-3288ed12-ce7c27b9_0 is DEAD
2025-10-10T14:40:51.271380Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8252da1d-7bdc6fef-3288ed12-ce7c27b9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:40:51.271391Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8252da1d-7bdc6fef-3288ed12-ce7c27b9_0] Write session will restart in 0.006289s
2025-10-10T14:40:51.271417Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8252da1d-7bdc6fef-3288ed12-ce7c27b9_0] Write session: Do CDS request
2025-10-10T14:40:51.271427Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8252da1d-7bdc6fef-3288ed12-ce7c27b9_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:51.278952Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8252da1d-7bdc6fef-3288ed12-ce7c27b9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:51.279014Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:51.279032Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3439
2025-10-10T14:40:51.279236Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3439 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:51.279283Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3439 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:51.279305Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3439 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:51.279315Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:51.279756Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3439 sessionId:  describe result for acl check
2025-10-10T14:40:51.279790Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:51.279815Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:51.279821Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:51.279827Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559603082815854150:4891] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:51.280407Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559603082815854150:4891] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:51.284145Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559603082815854150:4891] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:51.287439Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559603082815854150:4891] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:51.287455Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559603082815854150:4891] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:51.287478Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559603082815854150:4891] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:51.287487Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3439 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:51.293532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:51.296859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:51.297138Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:51.297151Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:51.297163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:51.297223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:51.297277Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559603082033599938:13681]
2025-10-10T14:40:51.297953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:51.298299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:51.298358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:51.298724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:51.298784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:51.298791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:51.298792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:51.298794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:51.298795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:51.298796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:51.298798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:51.298799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:51.298800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:51.298802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:51.298803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:51.298804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:51.298806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:51.298812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:51.298826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:51.298830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:51.298834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:51.298839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:51.298844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:51.298848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:51.298852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:51.298856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:51.298861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:51.298865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:51.298870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:51.298874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:51.298882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:51.298890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:51.298903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:51.298909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:51.298918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:51.298924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:51.298933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:51.298939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:51.298948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:51.298953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:51.298965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:51.298975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:51.298980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:51.298985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:51.298992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:51.298998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:51.299003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:51.299013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:51.299017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:51.299023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:51.299031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:51.299037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:51.299042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:51.299065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:51.299070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:51.299076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:51.299119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:51.301497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:51.301812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:51.301825Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:51.301828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:51.301831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:51.301839Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3438 [2:7559603082033599938:13681]
2025-10-10T14:40:51.301851Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:51.301870Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:51.301883Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:51.301887Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:51.301890Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:51.301909Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:51.301917Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:51.301926Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:51.301984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:51.301992Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:51.301994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:51.301998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:51.302080Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:51.302090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:51.302103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:51.302114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:51.302135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:51.302158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603082815854292:4891], now have 1 active actors on pipe
2025-10-10T14:40:51.302167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603082815854133:2438], now have 1 active actors on pipe
2025-10-10T14:40:51.302174Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559603082033599933:13681]
2025-10-10T14:40:51.302177Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559603082033599933:13681]
2025-10-10T14:40:51.302179Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559603082033599933:13681]
2025-10-10T14:40:51.302194Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:51.302207Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:51.302214Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:51.302218Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:51.302220Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:51.302231Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:51.302234Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:51.302253Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3438
2025-10-10T14:40:51.302257Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3438
2025-10-10T14:40:51.302260Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559603082033599933:13681]
2025-10-10T14:40:51.302269Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:51.302274Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:51.302304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:51.302308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:51.302341Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6b958159-34c22744-2d55c3f4-551bae2f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:51.302348Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:51.302351Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:51.302354Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:51.302366Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:51.302377Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:51.302391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:51.302542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:51.302569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:51.302596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:51.302714Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3439 partition: 0 MaxSeqNo: 40 sessionId: src_id|6b958159-34c22744-2d55c3f4-551bae2f_0
2025-10-10T14:40:51.303151Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8252da1d-7bdc6fef-3288ed12-ce7c27b9_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|6b958159-34c22744-2d55c3f4-551bae2f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:51.306145Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6b958159-34c22744-2d55c3f4-551bae2f_0] Write session: try to update token
2025-10-10T14:40:51.306166Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6b958159-34c22744-2d55c3f4-551bae2f_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:51.314074Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:40:51.314099Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:51.314111Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559603082033599933:13681]
2025-10-10T14:40:51.314162Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:40:51.314167Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:40:51.314348Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:40:51.314500Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:51.314642Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:51.314781Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:51.314984Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:40:51.315023Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:40:51.321481Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3439 sessionId: src_id|6b958159-34c22744-2d55c3f4-551bae2f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:51.324437Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:51.325368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:51.325392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:51.325437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:40:51.325702Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:40:51.336776Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:51.336801Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:51.336805Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:51.336807Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:51.336820Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559603082033599933:13681]
2025-10-10T14:40:51.336825Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559603082033599933:13681]
2025-10-10T14:40:51.336829Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559603082033599933:13681]
2025-10-10T14:40:51.336885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:51.336894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:51.336897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:51.336932Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:51.336947Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:51.336952Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:51.337037Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:51.371233Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 35 consumer shared/user session shared/user_1_35_7080413204912763209_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559603082815854420:7208]
2025-10-10T14:40:51.371572Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 35 consumer shared/user session shared/user_1_35_7080413204912763209_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 pipe creation result: OK TabletId: 72075186224037892 Generation: 3438, pipe: [1:7559603082815854420:7208]
2025-10-10T14:40:51.461108Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:51.470569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:51.470614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:51.470811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:51.470896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:51.470971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:51.471048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:51.471518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:51.471534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:51.471611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:51.471686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:51.471761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:51.471858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:51.471916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:51.471921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:51.472000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:51.472071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:51.472142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:51.472219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:51.472276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:51.472288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:51.472361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:51.472434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:51.472506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:51.472583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:51.472641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:51.472651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:51.472723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:51.472796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:51.472865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:51.472940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:51.472998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:51.473002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:51.473072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:51.473131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:51.473196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:51.473264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:51.473309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:51.473312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:51.473420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:51.473484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:51.473551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:51.473618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:51.473663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:51.473666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:51.473738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:51.473796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:51.473857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:51.473920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:51.473971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:51.473973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:51.474044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:51.474107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:51.474172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:51.474241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:51.474292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:51.474296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:51.474368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:51.474431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:51.474496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:51.474559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:51.474600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:51.474603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:51.474702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603082815854420:7208], now have 1 active actors on pipe
2025-10-10T14:40:51.474971Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:51.475028Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 35 consumer shared/user session shared/user_1_35_7080413204912763209_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 37 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559603082815854420:7208]
2025-10-10T14:40:51.475064Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:51.475125Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:40:51.475180Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3439 reason: status is not ok: tablet will be restarted right now sessionId: src_id|6b958159-34c22744-2d55c3f4-551bae2f_0
2025-10-10T14:40:51.475594Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b958159-34c22744-2d55c3f4-551bae2f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:40:51.475618Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b958159-34c22744-2d55c3f4-551bae2f_0] Write session will restart in 0.006713s
2025-10-10T14:40:51.475649Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b958159-34c22744-2d55c3f4-551bae2f_0] Write session: Do CDS request
2025-10-10T14:40:51.475656Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b958159-34c22744-2d55c3f4-551bae2f_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:51.475467Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3439 sessionId: src_id|6b958159-34c22744-2d55c3f4-551bae2f_0 is DEAD
2025-10-10T14:40:51.483961Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6b958159-34c22744-2d55c3f4-551bae2f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:51.484052Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:51.484069Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3440
2025-10-10T14:40:51.484211Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3440 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:51.484253Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3440 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:51.484259Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3440 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:51.484264Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:51.484774Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3440 sessionId:  describe result for acl check
2025-10-10T14:40:51.484815Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:51.484822Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:51.484825Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:51.484832Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559603082815854440:4882] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:51.485488Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559603082815854440:4882] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:51.489080Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559603082815854440:4882] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:51.494949Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559603082815854440:4882] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:51.494971Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559603082815854440:4882] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:51.494975Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559603082815854440:4882] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:51.494986Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3440 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:51.513712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:51.517867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:51.518160Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:51.518166Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:51.518193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:51.518264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:51.518310Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559603082033600222:13684]
2025-10-10T14:40:51.518957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:51.524300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:51.524377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:51.524640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:51.524673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:51.524674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:51.524675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:51.524677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:51.524678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:51.524679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:51.524681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:51.524682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:51.524683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:51.524685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:51.524686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:51.524687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:51.524688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:51.524696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:51.524707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:51.524711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:51.524714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:51.524718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:51.524722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:51.524725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:51.524729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:51.524733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:51.524737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:51.524740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:51.524743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:51.524747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:51.524754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:51.524763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:51.524770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:51.524775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:51.524779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:51.524784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:51.524788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:51.524793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:51.524798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:51.524802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:51.524807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:51.524812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:51.524817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:51.524821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:51.524825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:51.524831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:51.524836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:51.524841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:51.524847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:51.524853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:51.524858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:51.524863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:51.524867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:51.524874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:51.524878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:51.524884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:51.524927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:51.535354Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3439
2025-10-10T14:40:51.535401Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3439
2025-10-10T14:40:51.533720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:51.534061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:51.534067Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:51.534069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:51.534074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:51.534082Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3439 [2:7559603082033600222:13684]
2025-10-10T14:40:51.534096Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:51.534118Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:51.534122Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:51.534128Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:51.534130Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:51.534152Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:51.534160Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:51.534169Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:51.534453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:51.534458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:51.534461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:51.534464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:51.534552Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:51.534555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:51.534569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:51.534582Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:51.534599Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:51.534621Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559603082033600216:13684]
2025-10-10T14:40:51.534623Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559603082033600216:13684]
2025-10-10T14:40:51.534625Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559603082033600216:13684]
2025-10-10T14:40:51.534641Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:51.534658Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:51.534674Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:51.534678Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:51.534719Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559603082033600216:13684]
2025-10-10T14:40:51.534721Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:51.534948Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:51.534951Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:51.534953Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:51.534959Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:51.535975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603082815854425:2438], now have 1 active actors on pipe
2025-10-10T14:40:51.535982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603082815854547:4882], now have 1 active actors on pipe
2025-10-10T14:40:51.536003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:51.536011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:51.536044Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b7b42935-e299d955-5590ba2c-bdb0f95c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:51.536054Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:51.536058Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:51.536063Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:51.536077Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:51.536091Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:51.536111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:51.536639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:51.536645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:51.536665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:51.536813Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3440 partition: 0 MaxSeqNo: 40 sessionId: src_id|b7b42935-e299d955-5590ba2c-bdb0f95c_0
2025-10-10T14:40:51.537590Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b958159-34c22744-2d55c3f4-551bae2f_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|b7b42935-e299d955-5590ba2c-bdb0f95c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:51.540351Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b7b42935-e299d955-5590ba2c-bdb0f95c_0] Write session: try to update token
2025-10-10T14:40:51.540372Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b7b42935-e299d955-5590ba2c-bdb0f95c_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:51.563658Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:51.563680Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:51.563684Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:51.563685Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:51.563695Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559603082033600216:13684]
2025-10-10T14:40:51.563702Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559603082033600216:13684]
2025-10-10T14:40:51.563705Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559603082033600216:13684]
2025-10-10T14:40:51.563755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:51.563753Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:51.563760Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:51.563763Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:51.563764Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:51.563765Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:51.563931Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:51.565013Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3440 sessionId: src_id|b7b42935-e299d955-5590ba2c-bdb0f95c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:51.567731Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:51.574981Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 35 consumer shared/user session shared/user_1_35_7080413204912763209_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559603082815854725:7208]
2025-10-10T14:40:51.575279Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 35 consumer shared/user session shared/user_1_35_7080413204912763209_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 pipe creation result: OK TabletId: 72075186224037892 Generation: 3439, pipe: [1:7559603082815854725:7208]
2025-10-10T14:40:51.679499Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:51.680452Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:51.680505Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 35 consumer shared/user session shared/user_1_35_7080413204912763209_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 38 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559603082815854725:7208]
2025-10-10T14:40:51.679939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:51.679958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:51.679979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603082815854725:7208], now have 1 active actors on pipe
2025-10-10T14:40:51.680246Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:51.680528Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:40:51.680607Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3440 reason: status is not ok: tablet will be restarted right now sessionId: src_id|b7b42935-e299d955-5590ba2c-bdb0f95c_0
2025-10-10T14:40:51.680822Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3440 sessionId: src_id|b7b42935-e299d955-5590ba2c-bdb0f95c_0 is DEAD
2025-10-10T14:40:51.681594Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b7b42935-e299d955-5590ba2c-bdb0f95c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:40:51.681607Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b7b42935-e299d955-5590ba2c-bdb0f95c_0] Write session will restart in 0.007340s
2025-10-10T14:40:51.681634Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b7b42935-e299d955-5590ba2c-bdb0f95c_0] Write session: Do CDS request
2025-10-10T14:40:51.681640Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b7b42935-e299d955-5590ba2c-bdb0f95c_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:51.689879Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b7b42935-e299d955-5590ba2c-bdb0f95c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:51.690280Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:51.690296Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3441
2025-10-10T14:40:51.690500Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3441 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:51.690537Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3441 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:51.690543Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3441 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:51.690548Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:51.691107Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3441 sessionId:  describe result for acl check
2025-10-10T14:40:51.691159Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:51.691166Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:51.691168Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:51.691174Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559603082815854754:4774] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:51.691770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559603082815854754:4774] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:51.696518Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559603082815854754:4774] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:51.704761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559603082815854754:4774] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:51.704781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559603082815854754:4774] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:51.704785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559603082815854754:4774] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:51.704796Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3441 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:51.714639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:51.716832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:51.717060Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:51.717066Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:51.717077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:51.717125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:51.717160Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559603082033600544:13699]
2025-10-10T14:40:51.717829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:51.718164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:51.718221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:51.718584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:51.718659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:51.718665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:51.718666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:51.718667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:51.718669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:51.718670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:51.718672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:51.718673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:51.718675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:51.718676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:51.718677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:51.718678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:51.718680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:51.718686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:51.718700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:51.718705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:51.718709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:51.718713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:51.718718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:51.718722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:51.718725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:51.718730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:51.718734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:51.718738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:51.718742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:51.718746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:51.718755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:51.718765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:51.718772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:51.718778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:51.718783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:51.718789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:51.718797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:51.718802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:51.718806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:51.718811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:51.718816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:51.718821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:51.718827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:51.718832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:51.718837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:51.718843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:51.718848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:51.718853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:51.718858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:51.718863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:51.718868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:51.718874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:51.718878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:51.718883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:51.718890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:51.718895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:51.718938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:51.721562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:51.722479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:51.722497Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:51.722499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:51.722503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:51.722510Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3440 [2:7559603082033600544:13699]
2025-10-10T14:40:51.722524Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:51.722542Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:51.722546Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:51.722550Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:51.722552Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:51.722571Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:51.722579Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:51.722586Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:51.722655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:51.722663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:51.722666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:51.722669Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:51.722745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:51.722753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:51.722763Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:51.722774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:51.722793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:51.722819Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559603082033600539:13699]
2025-10-10T14:40:51.722826Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559603082033600539:13699]
2025-10-10T14:40:51.722828Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559603082033600539:13699]
2025-10-10T14:40:51.722839Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:51.722847Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:51.722850Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:51.722853Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:51.722855Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:51.722871Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:51.722879Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:51.722891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603082815854739:2438], now have 1 active actors on pipe
2025-10-10T14:40:51.722899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603082815854941:4774], now have 1 active actors on pipe
2025-10-10T14:40:51.722926Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559603082033600539:13699]
2025-10-10T14:40:51.722939Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:51.722950Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:51.723042Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3440
2025-10-10T14:40:51.723044Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3440
2025-10-10T14:40:51.723209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:51.723222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:51.723254Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bb948471-97e8cba6-606aa943-f2b1203a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:51.723267Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:51.723276Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:51.723279Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:51.723291Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:51.723302Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:51.723322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:51.723540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:51.723562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:51.723591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:51.723715Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3441 partition: 0 MaxSeqNo: 40 sessionId: src_id|bb948471-97e8cba6-606aa943-f2b1203a_0
2025-10-10T14:40:51.724342Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b7b42935-e299d955-5590ba2c-bdb0f95c_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|bb948471-97e8cba6-606aa943-f2b1203a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:51.727172Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb948471-97e8cba6-606aa943-f2b1203a_0] Write session: try to update token
2025-10-10T14:40:51.727193Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb948471-97e8cba6-606aa943-f2b1203a_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:51.742937Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:51.742961Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:51.742964Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:51.742967Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:51.742978Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559603082033600539:13699]
2025-10-10T14:40:51.742983Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559603082033600539:13699]
2025-10-10T14:40:51.742988Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559603082033600539:13699]
2025-10-10T14:40:51.743044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:51.743057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:51.743061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:51.743219Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:51.745134Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3441 sessionId: src_id|bb948471-97e8cba6-606aa943-f2b1203a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:51.745421Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:51.745439Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:51.745444Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:51.747989Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:51.781231Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 35 consumer shared/user session shared/user_1_35_7080413204912763209_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559603082815855026:7208]
2025-10-10T14:40:51.781609Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 35 consumer shared/user session shared/user_1_35_7080413204912763209_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 pipe creation result: OK TabletId: 72075186224037892 Generation: 3440, pipe: [1:7559603082815855026:7208]
2025-10-10T14:40:51.862996Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:51.863015Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:40:51.863020Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:40:51.863059Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 35 consumer shared/user session shared/user_1_35_7080413204912763209_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 39 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559603082815855026:7208]
2025-10-10T14:40:51.863104Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3441 reason: error at write: Disconnected sessionId: src_id|bb948471-97e8cba6-606aa943-f2b1203a_0
2025-10-10T14:40:51.862163Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:51.862470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:51.862481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:51.862534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603082815855026:7208], now have 1 active actors on pipe
2025-10-10T14:40:51.862979Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:51.863704Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb948471-97e8cba6-606aa943-f2b1203a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:40:51.863716Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb948471-97e8cba6-606aa943-f2b1203a_0] Write session will restart in 0.007313s
2025-10-10T14:40:51.863743Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb948471-97e8cba6-606aa943-f2b1203a_0] Write session: Do CDS request
2025-10-10T14:40:51.863750Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb948471-97e8cba6-606aa943-f2b1203a_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:51.863326Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3441 sessionId: src_id|bb948471-97e8cba6-606aa943-f2b1203a_0 is DEAD
2025-10-10T14:40:51.871994Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb948471-97e8cba6-606aa943-f2b1203a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:51.873484Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:51.873505Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3442
2025-10-10T14:40:51.873701Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3442 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:51.873754Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3442 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:51.873760Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3442 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:51.873765Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:51.875678Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3442 sessionId:  describe result for acl check
2025-10-10T14:40:51.875731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:51.875733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:51.875736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:51.875742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559603082815855054:4730] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:51.876401Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559603082815855054:4730] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:51.880126Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559603082815855054:4730] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:51.884125Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559603082815855054:4730] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:51.884144Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559603082815855054:4730] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:51.884147Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559603082815855054:4730] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:51.884157Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3442 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:51.891696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:51.894945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:51.895187Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:51.895199Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:51.895211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:51.895293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:51.895343Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559603082033600829:13701]
2025-10-10T14:40:51.895970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:51.896292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:51.896341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:51.896903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:51.896985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:51.896993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:51.896994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:51.896995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:51.896997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:51.896998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:51.896999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:51.897001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:51.897002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:51.897003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:51.897004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:51.897006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:51.897007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:51.897014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:51.897028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:51.897032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:51.897035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:51.897039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:51.897043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:51.897047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:51.897051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:51.897055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:51.897059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:51.897063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:51.897067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:51.897071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:51.897080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:51.897089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:51.897097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:51.897103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:51.897107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:51.897113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:51.897117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:51.897123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:51.897128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:51.897134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:51.897138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:51.897143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:51.897148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:51.897153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:51.897157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:51.897162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:51.897166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:51.897171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:51.897189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:51.897201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:51.897205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:51.897210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:51.897218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:51.897222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:51.897227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:51.897232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:51.897272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:51.899914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:51.900710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:51.900725Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:51.900727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:51.900732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:51.900739Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3441 [2:7559603082033600829:13701]
2025-10-10T14:40:51.900755Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:51.900775Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:51.900784Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:51.900788Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:51.900791Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:51.900810Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:51.900824Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:51.900837Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:51.900902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:51.900911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:51.900914Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:51.900917Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:51.900994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:51.901002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:51.901015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:51.901033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:51.901057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:51.901086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603082815855029:2438], now have 1 active actors on pipe
2025-10-10T14:40:51.901094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603082815855201:4730], now have 1 active actors on pipe
2025-10-10T14:40:51.901104Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559603082033600824:13701]
2025-10-10T14:40:51.901111Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559603082033600824:13701]
2025-10-10T14:40:51.901114Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559603082033600824:13701]
2025-10-10T14:40:51.901131Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:51.901145Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:51.901151Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:51.901131Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3441
2025-10-10T14:40:51.901156Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:51.901146Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3441
2025-10-10T14:40:51.901158Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:51.901169Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:51.901172Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:51.901201Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559603082033600824:13701]
2025-10-10T14:40:51.901204Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:51.901207Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:51.901226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:51.901237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:51.901288Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fff073c9-d277aec4-a0172797-35649960_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:51.901302Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:51.901312Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:51.901316Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:51.901367Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:51.901389Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:51.901414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:51.901626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:51.901635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:51.901652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:51.901774Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3442 partition: 0 MaxSeqNo: 40 sessionId: src_id|fff073c9-d277aec4-a0172797-35649960_0
2025-10-10T14:40:51.902262Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb948471-97e8cba6-606aa943-f2b1203a_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|fff073c9-d277aec4-a0172797-35649960_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:51.906574Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fff073c9-d277aec4-a0172797-35649960_0] Write session: try to update token
2025-10-10T14:40:51.906597Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fff073c9-d277aec4-a0172797-35649960_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:51.922250Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:51.922274Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:51.922279Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:51.922281Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:51.922293Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559603082033600824:13701]
2025-10-10T14:40:51.922298Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559603082033600824:13701]
2025-10-10T14:40:51.922307Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559603082033600824:13701]
2025-10-10T14:40:51.922360Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:51.922366Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:51.922374Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:51.922375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:51.922378Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:51.922378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:51.922528Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:51.924475Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3442 sessionId: src_id|fff073c9-d277aec4-a0172797-35649960_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:51.927423Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:51.963093Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 35 consumer shared/user session shared/user_1_35_7080413204912763209_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559603082815855325:7208]
2025-10-10T14:40:51.963415Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 35 consumer shared/user session shared/user_1_35_7080413204912763209_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 pipe creation result: OK TabletId: 72075186224037892 Generation: 3441, pipe: [1:7559603082815855325:7208]
2025-10-10T14:40:52.049193Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:52.049857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:52.049876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:52.049927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603082815855325:7208], now have 1 active actors on pipe
2025-10-10T14:40:52.050178Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:52.050784Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fff073c9-d277aec4-a0172797-35649960_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:40:52.050809Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fff073c9-d277aec4-a0172797-35649960_0] Write session will restart in 0.006327s
2025-10-10T14:40:52.050836Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fff073c9-d277aec4-a0172797-35649960_0] Write session: Do CDS request
2025-10-10T14:40:52.050843Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fff073c9-d277aec4-a0172797-35649960_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:52.050209Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:52.050272Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:40:52.050360Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3442 reason: status is not ok: tablet will be restarted right now sessionId: src_id|fff073c9-d277aec4-a0172797-35649960_0
2025-10-10T14:40:52.050625Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3442 sessionId: src_id|fff073c9-d277aec4-a0172797-35649960_0 is DEAD
2025-10-10T14:40:52.050992Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 35 consumer shared/user session shared/user_1_35_7080413204912763209_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 40 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559603082815855325:7208]
2025-10-10T14:40:52.059006Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fff073c9-d277aec4-a0172797-35649960_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:52.059139Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:52.059157Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3443
2025-10-10T14:40:52.059336Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3443 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:52.059379Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3443 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:52.059391Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3443 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:52.059395Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:52.059931Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3443 sessionId:  describe result for acl check
2025-10-10T14:40:52.059975Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:52.059977Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:52.059979Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:52.059986Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559603087110822639:4689] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:52.060671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559603087110822639:4689] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:52.063681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559603087110822639:4689] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:52.070395Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559603087110822639:4689] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:52.070415Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559603087110822639:4689] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:52.070419Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559603087110822639:4689] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:52.070444Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3443 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:52.084945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:52.089219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:52.089661Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:52.089679Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:52.089694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:52.089779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:52.089837Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559603086328568425:13704]
2025-10-10T14:40:52.090590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:52.091101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:52.091177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:52.091601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:52.091718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:52.091731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:52.091733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:52.091734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:52.091736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:52.091737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:52.091739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:52.091741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:52.091742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:52.091744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:52.091745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:52.091746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:52.091748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:52.091757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:52.091771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:52.091775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:52.091779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:52.091783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:52.091802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:52.091806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:52.091810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:52.091814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:52.091818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:52.091821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:52.091825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:52.091828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:52.091843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:52.091852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:52.091860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:52.091868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:52.091872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:52.091876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:52.091880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:52.091885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:52.091889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:52.091894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:52.091898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:52.091903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:52.091908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:52.091913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:52.091917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:52.091922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:52.091928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:52.091947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:52.091961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:52.091967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:52.091972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:52.091977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:52.091982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:52.091987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:52.091992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:52.091998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:52.092041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:52.095635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:52.096496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:52.096511Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:52.096514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:52.096518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:52.096526Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3442 [2:7559603086328568425:13704]
2025-10-10T14:40:52.096543Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:52.096564Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:52.096568Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:52.096573Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:52.096575Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:52.096597Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:52.096605Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:52.096613Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:52.096695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:52.096697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:52.096699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:52.097009Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3442
2025-10-10T14:40:52.097059Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3442
2025-10-10T14:40:52.096702Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:52.096785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:52.096788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:52.096805Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:52.096817Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:52.096836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:52.096860Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559603086328568419:13704]
2025-10-10T14:40:52.096862Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559603086328568419:13704]
2025-10-10T14:40:52.096864Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559603086328568419:13704]
2025-10-10T14:40:52.096874Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:52.096891Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:52.096906Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:52.096906Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:52.096910Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:52.096911Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:52.096914Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:52.096924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603087110822750:4689], now have 1 active actors on pipe
2025-10-10T14:40:52.096928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603087110822624:2438], now have 1 active actors on pipe
2025-10-10T14:40:52.096963Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559603086328568419:13704]
2025-10-10T14:40:52.096972Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:52.096997Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:52.097227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:52.097234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:52.097272Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b6ac1fa9-f3f8f43c-61eb7091-80fc6e4a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:52.097283Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:52.097297Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:52.097301Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:52.097315Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:52.097344Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:52.097365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:52.097741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:52.097756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:52.097777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:52.097915Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3443 partition: 0 MaxSeqNo: 40 sessionId: src_id|b6ac1fa9-f3f8f43c-61eb7091-80fc6e4a_0
2025-10-10T14:40:52.098384Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fff073c9-d277aec4-a0172797-35649960_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|b6ac1fa9-f3f8f43c-61eb7091-80fc6e4a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:52.101573Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b6ac1fa9-f3f8f43c-61eb7091-80fc6e4a_0] Write session: try to update token
2025-10-10T14:40:52.101599Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b6ac1fa9-f3f8f43c-61eb7091-80fc6e4a_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:52.110094Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:40:52.110121Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:52.110134Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559603086328568419:13704]
2025-10-10T14:40:52.110189Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:40:52.110214Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:40:52.110400Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:40:52.110563Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:52.110728Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:52.110882Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:52.111105Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:40:52.111156Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:40:52.128511Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3443 sessionId: src_id|b6ac1fa9-f3f8f43c-61eb7091-80fc6e4a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:52.131215Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:52.132008Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:40:52.131773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:52.131818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:52.131865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:40:52.135178Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:52.135200Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:52.135204Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:52.135206Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:52.135220Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559603086328568419:13704]
2025-10-10T14:40:52.135225Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559603086328568419:13704]
2025-10-10T14:40:52.135229Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559603086328568419:13704]
2025-10-10T14:40:52.135275Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:52.135283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:52.135292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:52.135295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:52.135303Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:52.135308Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:52.135440Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:52.150992Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 35 consumer shared/user session shared/user_1_35_7080413204912763209_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559603087110822925:7208]
2025-10-10T14:40:52.151296Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 35 consumer shared/user session shared/user_1_35_7080413204912763209_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 pipe creation result: OK TabletId: 72075186224037892 Generation: 3442, pipe: [1:7559603087110822925:7208]
2025-10-10T14:40:52.259881Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:52.260395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603087110822925:7208], now have 1 active actors on pipe
2025-10-10T14:40:52.269799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:52.269831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:52.270029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:52.270098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:52.270165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:52.270231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:52.270275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:52.270281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:52.270360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:52.270425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:52.270491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:52.270562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:52.270606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:52.270610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:52.270684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:52.270744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:52.270812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:52.270876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:52.270916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:52.270920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:52.270990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:52.271053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:52.271118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:52.271183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:52.271230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:52.271233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:52.271304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:52.271367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:52.271435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:52.271507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:52.271560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:52.271564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:52.271638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:52.271700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:52.271767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:52.271854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:52.271899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:52.271903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:52.271979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:52.272041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:52.272107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:52.272171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:52.272215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:52.272222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:52.272294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:52.272358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:52.272422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:52.272486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:52.272537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:52.272541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:52.272613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:52.272679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:52.272746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:52.272813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:52.272859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:52.272862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:52.272931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:52.272990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:52.273050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:52.273115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:52.273163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:52.273166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:52.274085Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6ac1fa9-f3f8f43c-61eb7091-80fc6e4a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:40:52.274097Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6ac1fa9-f3f8f43c-61eb7091-80fc6e4a_0] Write session will restart in 0.007610s
2025-10-10T14:40:52.274132Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6ac1fa9-f3f8f43c-61eb7091-80fc6e4a_0] Write session: Do CDS request
2025-10-10T14:40:52.274138Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6ac1fa9-f3f8f43c-61eb7091-80fc6e4a_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:52.274941Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:52.273611Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 35 consumer shared/user session shared/user_1_35_7080413204912763209_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 41 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559603087110822925:7208]
2025-10-10T14:40:52.273663Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:40:52.273668Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:40:52.273702Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3443 reason: error at write: Disconnected sessionId: src_id|b6ac1fa9-f3f8f43c-61eb7091-80fc6e4a_0
2025-10-10T14:40:52.273937Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3443 sessionId: src_id|b6ac1fa9-f3f8f43c-61eb7091-80fc6e4a_0 is DEAD
2025-10-10T14:40:52.273996Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:52.282966Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b6ac1fa9-f3f8f43c-61eb7091-80fc6e4a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:52.284900Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:52.284930Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3444
2025-10-10T14:40:52.285095Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3444 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:52.285146Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3444 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:52.285157Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3444 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:52.285162Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:52.285664Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3444 sessionId:  describe result for acl check
2025-10-10T14:40:52.285713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:52.285725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:52.285728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:52.285734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559603087110822944:4640] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:52.286355Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559603087110822944:4640] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:52.290854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559603087110822944:4640] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:52.297008Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559603087110822944:4640] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:52.297028Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559603087110822944:4640] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:52.297032Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559603087110822944:4640] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:52.297042Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3444 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:52.317129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:52.325371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:52.325676Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:52.325695Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:52.325710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:52.325782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:52.325836Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559603086328568712:13706]
2025-10-10T14:40:52.326577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:52.327252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:52.327318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:52.327721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:52.327825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:52.327832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:52.327834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:52.327836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:52.327838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:52.327840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:52.327842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:52.327844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:52.327845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:52.327847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:52.327848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:52.327850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:52.327851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:52.327859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:52.327875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:52.327880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:52.327885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:52.327889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:52.327894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:52.327899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:52.327904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:52.327908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:52.327913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:52.327918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:52.327923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:52.327927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:52.327936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:52.327946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:52.327954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:52.327960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:52.327966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:52.327973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:52.327978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:52.327985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:52.327991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:52.327998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:52.328003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:52.328010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:52.328016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:52.328031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:52.328037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:52.328043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:52.328053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:52.328060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:52.328070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:52.328079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:52.328089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:52.328100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:52.328105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:52.328111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:52.328120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:52.328125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:52.328167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:52.331640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:52.332627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:52.332644Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:52.332647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:52.332651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:52.332657Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3443 [2:7559603086328568712:13706]
2025-10-10T14:40:52.332673Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:52.332694Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:52.332697Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:52.332700Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:52.332703Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:52.332722Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:52.332729Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:52.332739Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:52.332838Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:52.332857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:52.332860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:52.332864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:52.332972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:52.332982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:52.332997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:52.333010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:52.333030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:52.333055Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559603086328568707:13706]
2025-10-10T14:40:52.333058Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559603086328568707:13706]
2025-10-10T14:40:52.333062Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559603086328568707:13706]
2025-10-10T14:40:52.333082Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:52.333101Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:52.333118Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:52.333127Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:52.333139Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:52.333150Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:52.333153Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:52.333159Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559603086328568707:13706]
2025-10-10T14:40:52.333163Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:52.333230Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:52.333451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603087110823028:4640], now have 1 active actors on pipe
2025-10-10T14:40:52.333463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603087110822928:2438], now have 1 active actors on pipe
2025-10-10T14:40:52.333577Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3443
2025-10-10T14:40:52.333628Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3443
2025-10-10T14:40:52.333695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:52.333707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:52.333745Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ba7c9ffe-be98490d-63c87ac7-cb3f475c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:52.333763Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:52.333768Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:52.333770Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:52.333784Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:52.333802Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:52.333821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:52.334053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:52.334063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:52.334082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:52.334313Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3444 partition: 0 MaxSeqNo: 40 sessionId: src_id|ba7c9ffe-be98490d-63c87ac7-cb3f475c_0
2025-10-10T14:40:52.335061Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6ac1fa9-f3f8f43c-61eb7091-80fc6e4a_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|ba7c9ffe-be98490d-63c87ac7-cb3f475c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:52.338019Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ba7c9ffe-be98490d-63c87ac7-cb3f475c_0] Write session: try to update token
2025-10-10T14:40:52.338043Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ba7c9ffe-be98490d-63c87ac7-cb3f475c_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:52.346036Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:40:52.346063Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:52.346075Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559603086328568707:13706]
2025-10-10T14:40:52.346133Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:40:52.346138Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:40:52.346443Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:40:52.346616Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:52.346767Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:52.346920Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:52.347142Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:40:52.347198Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:40:52.364666Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3444 sessionId: src_id|ba7c9ffe-be98490d-63c87ac7-cb3f475c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:52.367657Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:52.367973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:52.368012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:52.368060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:40:52.368215Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:40:52.372302Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:52.372326Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:52.372331Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:52.372334Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:52.372347Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559603086328568707:13706]
2025-10-10T14:40:52.372353Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559603086328568707:13706]
2025-10-10T14:40:52.372358Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559603086328568707:13706]
2025-10-10T14:40:52.372418Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:52.372419Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:52.372427Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:52.372432Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:52.372433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:52.372436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:52.372597Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:52.373721Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 35 consumer shared/user session shared/user_1_35_7080413204912763209_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559603087110823219:7208]
2025-10-10T14:40:52.374059Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 35 consumer shared/user session shared/user_1_35_7080413204912763209_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 pipe creation result: OK TabletId: 72075186224037892 Generation: 3443, pipe: [1:7559603087110823219:7208]
2025-10-10T14:40:52.493755Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:52.494321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603087110823219:7208], now have 1 active actors on pipe
2025-10-10T14:40:52.503748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:52.503801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:52.504001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:52.504077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:52.504149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:52.504219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:52.504273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:52.504283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:52.504367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:52.504439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:52.504511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:52.504584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:52.504630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:52.504638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:52.504712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:52.504783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:52.504848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:52.504917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:52.504965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:52.504969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:52.505045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:52.505108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:52.505174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:52.505239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:52.505281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:52.505284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:52.505470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:52.505547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:52.505623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:52.508214Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba7c9ffe-be98490d-63c87ac7-cb3f475c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:40:52.508228Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba7c9ffe-be98490d-63c87ac7-cb3f475c_0] Write session will restart in 0.009295s
2025-10-10T14:40:52.508256Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba7c9ffe-be98490d-63c87ac7-cb3f475c_0] Write session: Do CDS request
2025-10-10T14:40:52.508262Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba7c9ffe-be98490d-63c87ac7-cb3f475c_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:52.505690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:52.505740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:52.505744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:52.505821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:52.505883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:52.505955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:52.506026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:52.506072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:52.506075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:52.506152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:52.506217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:52.506286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:52.506358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:52.506404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:52.506406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:52.506482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:52.506551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:52.506620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:52.506688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:52.506736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:52.506740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:52.506815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:52.506878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:52.506946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:52.507012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:52.507057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:52.507061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:52.507137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:52.507199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:52.507260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:52.507326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:52.507371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:52.507374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:52.508915Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:52.507709Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:40:52.507726Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:40:52.507764Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3444 reason: error at write: Disconnected sessionId: src_id|ba7c9ffe-be98490d-63c87ac7-cb3f475c_0
2025-10-10T14:40:52.507764Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 35 consumer shared/user session shared/user_1_35_7080413204912763209_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 42 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559603087110823219:7208]
2025-10-10T14:40:52.507795Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:52.508031Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3444 sessionId: src_id|ba7c9ffe-be98490d-63c87ac7-cb3f475c_0 is DEAD
2025-10-10T14:40:52.518941Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ba7c9ffe-be98490d-63c87ac7-cb3f475c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:52.518970Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:52.518989Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3445
2025-10-10T14:40:52.519194Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3445 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:52.519234Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3445 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:52.519244Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3445 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:52.519249Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:52.519721Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3445 sessionId:  describe result for acl check
2025-10-10T14:40:52.519762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:52.519768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:52.519770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:52.519777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559603087110823260:4622] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:52.520848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559603087110823260:4622] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:52.525744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559603087110823260:4622] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:52.530094Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559603087110823260:4622] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:52.530114Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559603087110823260:4622] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:52.530129Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559603087110823260:4622] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:52.530140Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3445 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:52.533978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:52.537063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:52.537352Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:52.537365Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:52.537380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:52.537446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:52.537524Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559603086328569002:13709]
2025-10-10T14:40:52.538221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:52.538614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:52.538676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:52.539057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:52.539124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:52.539132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:52.539134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:52.539135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:52.539137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:52.539139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:52.539140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:52.539142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:52.539143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:52.539145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:52.539146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:52.539147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:52.539149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:52.539156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:52.539170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:52.539175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:52.539180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:52.539184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:52.539189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:52.539193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:52.539196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:52.539201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:52.539206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:52.539211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:52.539215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:52.539219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:52.539228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:52.539237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:52.539247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:52.539255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:52.539265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:52.539271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:52.539281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:52.539287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:52.539297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:52.539303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:52.539312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:52.539318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:52.539323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:52.539330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:52.539335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:52.539341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:52.539347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:52.539353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:52.539358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:52.539364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:52.539369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:52.539375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:52.539380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:52.539385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:52.539391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:52.539396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:52.539440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:52.542112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:52.542702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:52.542720Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:52.542722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:52.542727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:52.542733Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3444 [2:7559603086328569002:13709]
2025-10-10T14:40:52.542746Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:52.542765Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:52.542769Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:52.542772Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:52.542775Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:52.542794Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:52.542802Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:52.542817Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:52.542879Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:52.542889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:52.542891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:52.542894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:52.542966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:52.542975Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:52.542987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:52.542999Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:52.543016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:52.543046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603087110823471:4622], now have 1 active actors on pipe
2025-10-10T14:40:52.543059Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559603086328568997:13709]
2025-10-10T14:40:52.543066Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559603086328568997:13709]
2025-10-10T14:40:52.543068Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559603086328568997:13709]
2025-10-10T14:40:52.543083Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:52.543098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603087110823221:2438], now have 1 active actors on pipe
2025-10-10T14:40:52.543108Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:52.543122Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:52.543126Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:52.543128Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:52.543129Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:52.543131Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:52.543147Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3444
2025-10-10T14:40:52.543148Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3444
2025-10-10T14:40:52.543165Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559603086328568997:13709]
2025-10-10T14:40:52.543180Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:52.543223Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:52.543421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:52.543434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:52.543472Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9e5ea140-e4c50992-501ac75e-3ad88546_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:52.543482Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:52.543491Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:52.543493Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:52.543505Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:52.543533Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:52.543556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:52.543735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:52.543745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:52.543763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:52.543899Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3445 partition: 0 MaxSeqNo: 40 sessionId: src_id|9e5ea140-e4c50992-501ac75e-3ad88546_0
2025-10-10T14:40:52.544367Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba7c9ffe-be98490d-63c87ac7-cb3f475c_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|9e5ea140-e4c50992-501ac75e-3ad88546_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:52.547246Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9e5ea140-e4c50992-501ac75e-3ad88546_0] Write session: try to update token
2025-10-10T14:40:52.547268Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9e5ea140-e4c50992-501ac75e-3ad88546_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:52.563075Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:52.563098Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:52.563102Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:52.563105Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:52.563116Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559603086328568997:13709]
2025-10-10T14:40:52.563123Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559603086328568997:13709]
2025-10-10T14:40:52.563127Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559603086328568997:13709]
2025-10-10T14:40:52.563179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:52.563186Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:52.563189Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:52.563311Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:52.563322Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:52.563325Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:52.563329Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:52.563520Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3445 sessionId: src_id|9e5ea140-e4c50992-501ac75e-3ad88546_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:52.566653Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:52.607654Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 35 consumer shared/user session shared/user_1_35_7080413204912763209_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559603087110823526:7208]
2025-10-10T14:40:52.608108Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 35 consumer shared/user session shared/user_1_35_7080413204912763209_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 pipe creation result: OK TabletId: 72075186224037892 Generation: 3444, pipe: [1:7559603087110823526:7208]
2025-10-10T14:40:52.681843Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:52.682296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:52.682323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:52.682380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603087110823526:7208], now have 1 active actors on pipe
2025-10-10T14:40:52.682730Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:40:52.682747Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:40:52.682761Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 35 consumer shared/user session shared/user_1_35_7080413204912763209_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 43 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559603087110823526:7208]
2025-10-10T14:40:52.682787Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:52.682827Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3445 reason: error at write: Disconnected sessionId: src_id|9e5ea140-e4c50992-501ac75e-3ad88546_0
2025-10-10T14:40:52.682872Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:52.683068Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3445 sessionId: src_id|9e5ea140-e4c50992-501ac75e-3ad88546_0 is DEAD
2025-10-10T14:40:52.683227Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e5ea140-e4c50992-501ac75e-3ad88546_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:40:52.683250Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e5ea140-e4c50992-501ac75e-3ad88546_0] Write session will restart in 0.007235s
2025-10-10T14:40:52.683276Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e5ea140-e4c50992-501ac75e-3ad88546_0] Write session: Do CDS request
2025-10-10T14:40:52.683285Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e5ea140-e4c50992-501ac75e-3ad88546_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:52.692015Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9e5ea140-e4c50992-501ac75e-3ad88546_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:52.692093Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:52.692107Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3446
2025-10-10T14:40:52.693572Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3446 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:52.693621Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3446 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:52.693634Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3446 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:52.693643Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:52.694247Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3446 sessionId:  describe result for acl check
2025-10-10T14:40:52.694289Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:52.694297Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:52.694300Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:52.694307Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559603087110823585:4493] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:52.694930Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559603087110823585:4493] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:52.698308Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559603087110823585:4493] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:52.706455Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559603087110823585:4493] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:52.706473Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559603087110823585:4493] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:52.706477Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559603087110823585:4493] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:52.706487Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3446 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:52.706737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:52.709810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:52.710059Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:52.710072Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:52.710085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:52.710150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:52.710200Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559603086328569329:13724]
2025-10-10T14:40:52.710850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:52.711361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:52.711427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:52.711759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:52.711839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:52.711845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:52.711846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:52.711847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:52.711849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:52.711850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:52.711852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:52.711853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:52.711855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:52.711856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:52.711858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:52.711859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:52.711860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:52.711867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:52.711881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:52.711885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:52.711890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:52.711893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:52.711898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:52.711902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:52.711906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:52.711910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:52.711915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:52.711920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:52.711924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:52.711928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:52.711936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:52.711944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:52.711953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:52.711959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:52.711963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:52.711968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:52.711973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:52.711978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:52.711984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:52.711990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:52.711994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:52.712000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:52.712005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:52.712011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:52.712015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:52.712021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:52.712028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:52.712038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:52.712043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:52.712047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:52.712052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:52.712057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:52.712062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:52.712067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:52.712071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:52.712076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:52.712117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:52.714730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:52.715671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:52.715684Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:52.715687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:52.715691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:52.715698Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3445 [2:7559603086328569329:13724]
2025-10-10T14:40:52.715712Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:52.715731Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:52.715735Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:52.715738Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:52.715741Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:52.715757Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:52.715770Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:52.715788Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:52.715857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:52.715864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:52.715866Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:52.715869Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:52.715939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:52.715950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:52.715963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:52.715975Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:52.715991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:52.716015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603087110823539:2438], now have 1 active actors on pipe
2025-10-10T14:40:52.716018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603087110823819:4493], now have 1 active actors on pipe
2025-10-10T14:40:52.716025Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559603086328569323:13724]
2025-10-10T14:40:52.716027Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559603086328569323:13724]
2025-10-10T14:40:52.716029Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559603086328569323:13724]
2025-10-10T14:40:52.716046Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:52.716085Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3445
2025-10-10T14:40:52.716112Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3445
2025-10-10T14:40:52.716061Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:52.716071Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:52.716076Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:52.716082Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:52.716085Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:52.716090Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:52.716113Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559603086328569323:13724]
2025-10-10T14:40:52.716117Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:52.716139Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:52.716159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:52.716165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:52.716197Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8b7f3e1d-29074b5b-7c17eaae-8fbdbe42_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:52.716205Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:52.716209Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:52.716212Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:52.716223Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:52.716235Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:52.716251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:52.716422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:52.716437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:52.716468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:52.716597Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3446 partition: 0 MaxSeqNo: 40 sessionId: src_id|8b7f3e1d-29074b5b-7c17eaae-8fbdbe42_0
2025-10-10T14:40:52.717044Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e5ea140-e4c50992-501ac75e-3ad88546_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|8b7f3e1d-29074b5b-7c17eaae-8fbdbe42_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:52.719901Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8b7f3e1d-29074b5b-7c17eaae-8fbdbe42_0] Write session: try to update token
2025-10-10T14:40:52.719922Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8b7f3e1d-29074b5b-7c17eaae-8fbdbe42_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:52.730885Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:40:52.730911Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:52.730923Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559603086328569323:13724]
2025-10-10T14:40:52.730975Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:40:52.730977Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:40:52.731154Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:40:52.731303Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:52.731491Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:52.731713Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:40:52.732023Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:40:52.732089Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:40:52.738705Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3446 sessionId: src_id|8b7f3e1d-29074b5b-7c17eaae-8fbdbe42_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:52.741441Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:52.741688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:52.741716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:52.741760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:40:52.741840Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:40:52.750040Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:52.750062Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:52.750065Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:52.750068Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:52.750080Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559603086328569323:13724]
2025-10-10T14:40:52.750084Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559603086328569323:13724]
2025-10-10T14:40:52.750088Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559603086328569323:13724]
2025-10-10T14:40:52.750130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:52.750133Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:52.750138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:52.750139Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:52.750140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:52.750145Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:52.750281Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:52.781754Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 35 consumer shared/user session shared/user_1_35_7080413204912763209_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559603087110823832:7208]
2025-10-10T14:40:52.782180Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 35 consumer shared/user session shared/user_1_35_7080413204912763209_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 pipe creation result: OK TabletId: 72075186224037892 Generation: 3445, pipe: [1:7559603087110823832:7208]
2025-10-10T14:40:52.867472Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:52.876583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:52.876623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:52.876830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:52.876897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:52.876966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:52.877037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:52.877083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:52.877090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:52.877174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:52.877238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:52.877303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:52.877514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:52.877578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:52.877587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:52.877669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:52.877744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:52.877816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:52.877895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:52.877951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:52.877959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:52.878037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:52.878114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:52.878185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:52.878261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:52.878315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:52.878324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:52.878414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:52.878487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:52.878555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:52.878626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:52.878672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:52.878675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:52.878745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:52.878799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:52.878857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:52.878920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:52.878970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:52.878976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:52.879045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:52.879112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:52.879171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:52.879235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:52.879279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:52.879285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:52.879353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:52.879417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:52.879484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:52.879553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:52.879597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:52.879603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:52.879675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:52.879736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:52.879825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:52.879893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:52.879940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:52.879946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:52.880013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:40:52.880071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:40:52.880134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:40:52.880195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:40:52.880239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:40:52.880245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:40:52.880308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603087110823832:7208], now have 1 active actors on pipe
2025-10-10T14:40:52.880614Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:52.880618Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:40:52.880623Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:40:52.880672Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3446 reason: error at write: Disconnected sessionId: src_id|8b7f3e1d-29074b5b-7c17eaae-8fbdbe42_0
2025-10-10T14:40:52.880689Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 35 consumer shared/user session shared/user_1_35_7080413204912763209_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 44 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559603087110823832:7208]
2025-10-10T14:40:52.880981Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3446 sessionId: src_id|8b7f3e1d-29074b5b-7c17eaae-8fbdbe42_0 is DEAD
2025-10-10T14:40:52.881079Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b7f3e1d-29074b5b-7c17eaae-8fbdbe42_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:40:52.881091Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b7f3e1d-29074b5b-7c17eaae-8fbdbe42_0] Write session will restart in 0.005631s
2025-10-10T14:40:52.881128Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b7f3e1d-29074b5b-7c17eaae-8fbdbe42_0] Write session: Do CDS request
2025-10-10T14:40:52.881134Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b7f3e1d-29074b5b-7c17eaae-8fbdbe42_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:52.881495Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:52.887987Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8b7f3e1d-29074b5b-7c17eaae-8fbdbe42_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:52.888030Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:52.888046Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3447
2025-10-10T14:40:52.888249Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3447 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:52.888301Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3447 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:52.888322Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3447 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:52.888328Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:52.888844Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3447 sessionId:  describe result for acl check
2025-10-10T14:40:52.888884Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:52.888891Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:52.888893Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:52.888899Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559603087110823847:4480] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:52.889658Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559603087110823847:4480] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:52.892656Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559603087110823847:4480] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:52.900253Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559603087110823847:4480] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:52.900274Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559603087110823847:4480] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:52.900279Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559603087110823847:4480] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:52.900287Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3447 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:52.912390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:52.915886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:52.916199Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:52.916217Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:52.916235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:52.916348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:52.916423Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559603086328569620:13726]
2025-10-10T14:40:52.917056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:52.917519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:52.917600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:52.918023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:52.918114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:52.918122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:52.918123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:52.918125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:52.918126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:52.918128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:52.918129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:52.918131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:52.918132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:52.918133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:52.918134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:52.918136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:52.918138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:52.918146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:52.918160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:52.918165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:52.918169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:52.918174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:52.918178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:52.918183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:52.918186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:52.918191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:52.918197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:52.918201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:52.918206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:52.918210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:52.918221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:52.918231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:52.918238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:52.918244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:52.918252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:52.918269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:52.918275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:52.918282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:52.918293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:52.918298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:52.918308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:52.918314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:52.918325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:52.918331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:52.918336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:52.918341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:52.918346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:52.918352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:52.918356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:52.918362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:52.918368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:52.918373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:52.918379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:52.918385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:52.918390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:52.918396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:52.918463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:52.921559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:52.922058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:52.922073Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:52.922076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:52.922080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:52.922088Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3446 [2:7559603086328569620:13726]
2025-10-10T14:40:52.922105Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:52.922126Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:52.922134Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:52.922139Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:52.922141Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:52.922160Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:52.922169Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:52.922178Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:52.922261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:52.922269Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:52.922271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:52.922274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:52.922349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:52.922361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:52.922376Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:52.922391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:52.922411Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:52.922492Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3446
2025-10-10T14:40:52.922526Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3446
2025-10-10T14:40:52.922436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603087110823837:2438], now have 1 active actors on pipe
2025-10-10T14:40:52.922446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603087110823918:4480], now have 1 active actors on pipe
2025-10-10T14:40:52.922455Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559603086328569615:13726]
2025-10-10T14:40:52.922458Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559603086328569615:13726]
2025-10-10T14:40:52.922460Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559603086328569615:13726]
2025-10-10T14:40:52.922474Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:52.922490Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:52.922492Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:52.922494Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:52.922497Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:52.922510Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:52.922513Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:52.922548Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559603086328569615:13726]
2025-10-10T14:40:52.922551Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:52.922564Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:52.922580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:52.922585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:52.922645Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d806cb81-68afc862-b836df44-8b65e74d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:52.922653Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:52.922658Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:52.922660Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:52.922673Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:52.922683Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:52.922705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:52.922991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:52.923024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:52.923057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:52.923165Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3447 partition: 0 MaxSeqNo: 40 sessionId: src_id|d806cb81-68afc862-b836df44-8b65e74d_0
2025-10-10T14:40:52.923659Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b7f3e1d-29074b5b-7c17eaae-8fbdbe42_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|d806cb81-68afc862-b836df44-8b65e74d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:52.934937Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d806cb81-68afc862-b836df44-8b65e74d_0] Write session: try to update token
2025-10-10T14:40:52.934965Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d806cb81-68afc862-b836df44-8b65e74d_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:52.943414Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:52.943440Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:52.943445Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:52.943447Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:52.943460Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559603086328569615:13726]
2025-10-10T14:40:52.943465Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559603086328569615:13726]
2025-10-10T14:40:52.943470Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559603086328569615:13726]
2025-10-10T14:40:52.943529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:52.943544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:52.943547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:52.943693Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:52.948273Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:52.948299Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:52.948304Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:52.952615Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3447 sessionId: src_id|d806cb81-68afc862-b836df44-8b65e74d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:52.955647Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:52.980964Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 35 consumer shared/user session shared/user_1_35_7080413204912763209_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559603087110824138:7208]
2025-10-10T14:40:52.981283Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 35 consumer shared/user session shared/user_1_35_7080413204912763209_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 pipe creation result: OK TabletId: 72075186224037892 Generation: 3446, pipe: [1:7559603087110824138:7208]
2025-10-10T14:40:53.063513Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:53.064069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:53.064087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:53.064113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603087110824138:7208], now have 1 active actors on pipe
2025-10-10T14:40:53.064331Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:53.064778Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 35 consumer shared/user session shared/user_1_35_7080413204912763209_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 45 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559603087110824138:7208]
2025-10-10T14:40:53.064787Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:53.064817Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:40:53.064901Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3447 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d806cb81-68afc862-b836df44-8b65e74d_0
2025-10-10T14:40:53.065371Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d806cb81-68afc862-b836df44-8b65e74d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:40:53.065389Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d806cb81-68afc862-b836df44-8b65e74d_0] Write session will restart in 0.009546s
2025-10-10T14:40:53.065416Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d806cb81-68afc862-b836df44-8b65e74d_0] Write session: Do CDS request
2025-10-10T14:40:53.065423Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d806cb81-68afc862-b836df44-8b65e74d_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:53.065141Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3447 sessionId: src_id|d806cb81-68afc862-b836df44-8b65e74d_0 is DEAD
2025-10-10T14:40:53.075987Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d806cb81-68afc862-b836df44-8b65e74d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:53.077521Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:53.077538Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3448
2025-10-10T14:40:53.081453Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3448 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:53.081513Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3448 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:53.081519Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3448 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:53.081526Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:53.082055Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3448 sessionId:  describe result for acl check
2025-10-10T14:40:53.082104Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:53.082113Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:53.082116Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:53.082122Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559603091405791463:4381] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:53.082736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559603091405791463:4381] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:53.089507Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559603091405791463:4381] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:53.094714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559603091405791463:4381] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:53.094734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559603091405791463:4381] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:53.094738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559603091405791463:4381] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:53.094748Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3448 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:53.105157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:53.108499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:53.108779Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:53.108804Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:53.108817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:53.108894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:53.108936Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559603090623537220:13729]
2025-10-10T14:40:53.109577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:53.109950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:53.110002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:53.110385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:53.110460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:53.110467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:53.110468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:53.110470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:53.110471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:53.110473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:53.110474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:53.110475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:53.110477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:53.110478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:53.110479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:53.110481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:53.110482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:53.110490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:53.110504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:53.110508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:53.110512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:53.110517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:53.110522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:53.110526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:53.110530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:53.110535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:53.110540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:53.110544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:53.110547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:53.110551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:53.110563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:53.110572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:53.110579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:53.110585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:53.110591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:53.110596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:53.110601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:53.110607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:53.110619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:53.110625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:53.110629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:53.110635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:53.110645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:53.110651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:53.110656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:53.110662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:53.110667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:53.110678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:53.110682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:53.110688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:53.110693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:53.110699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:53.110703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:53.110709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:53.110716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:53.110721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:53.110770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:53.114994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:53.115669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:53.115676Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:53.115678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:53.115683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:53.115692Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3447 [2:7559603090623537220:13729]
2025-10-10T14:40:53.115706Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:53.115727Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:53.115731Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:53.115735Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:53.115738Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:53.115757Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:53.115766Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:53.115792Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:53.115857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:53.115861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:53.115863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:53.115867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:53.115949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:53.115953Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:53.115968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:53.115981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:53.115998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:53.116021Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559603090623537215:13729]
2025-10-10T14:40:53.116023Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559603090623537215:13729]
2025-10-10T14:40:53.116025Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559603090623537215:13729]
2025-10-10T14:40:53.116044Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:53.116059Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:53.116077Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:53.116081Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:53.116125Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559603090623537215:13729]
2025-10-10T14:40:53.116129Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:53.116171Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:53.116175Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:53.116177Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:53.116184Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:53.116396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603091405791622:4381], now have 1 active actors on pipe
2025-10-10T14:40:53.116414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603091405791437:2438], now have 1 active actors on pipe
2025-10-10T14:40:53.116580Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3447
2025-10-10T14:40:53.116630Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3447
2025-10-10T14:40:53.116815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:53.116833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:53.116886Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ac1acc41-efe73d8e-cd03bf49-866e9912_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:53.116903Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:53.116908Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:53.116911Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:53.116924Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:53.116941Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:53.116966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:53.117179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:53.117188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:53.117205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:53.117298Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3448 partition: 0 MaxSeqNo: 40 sessionId: src_id|ac1acc41-efe73d8e-cd03bf49-866e9912_0
2025-10-10T14:40:53.117764Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d806cb81-68afc862-b836df44-8b65e74d_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|ac1acc41-efe73d8e-cd03bf49-866e9912_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:53.120662Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ac1acc41-efe73d8e-cd03bf49-866e9912_0] Write session: try to update token
2025-10-10T14:40:53.120679Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ac1acc41-efe73d8e-cd03bf49-866e9912_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:53.135996Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3448 sessionId: src_id|ac1acc41-efe73d8e-cd03bf49-866e9912_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:53.137651Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:53.137678Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:53.137681Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:53.137683Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:53.137693Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559603090623537215:13729]
2025-10-10T14:40:53.137697Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559603090623537215:13729]
2025-10-10T14:40:53.137701Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559603090623537215:13729]
2025-10-10T14:40:53.137753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:53.137768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:53.137768Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:53.137770Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:53.137774Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:53.137778Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:53.137916Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:53.138757Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:53.164759Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 35 consumer shared/user session shared/user_1_35_7080413204912763209_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559603091405791743:7208]
2025-10-10T14:40:53.165069Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 35 consumer shared/user session shared/user_1_35_7080413204912763209_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 pipe creation result: OK TabletId: 72075186224037892 Generation: 3447, pipe: [1:7559603091405791743:7208]
2025-10-10T14:40:53.260050Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:53.260716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:53.260731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:53.260785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603091405791743:7208], now have 1 active actors on pipe
2025-10-10T14:40:53.261046Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:53.261105Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:40:53.261120Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:40:53.261143Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:53.261193Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 35 consumer shared/user session shared/user_1_35_7080413204912763209_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 46 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559603091405791743:7208]
2025-10-10T14:40:53.261200Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3448 reason: error at write: Disconnected sessionId: src_id|ac1acc41-efe73d8e-cd03bf49-866e9912_0
2025-10-10T14:40:53.261422Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3448 sessionId: src_id|ac1acc41-efe73d8e-cd03bf49-866e9912_0 is DEAD
2025-10-10T14:40:53.261711Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac1acc41-efe73d8e-cd03bf49-866e9912_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:40:53.261724Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac1acc41-efe73d8e-cd03bf49-866e9912_0] Write session will restart in 0.007531s
2025-10-10T14:40:53.261754Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac1acc41-efe73d8e-cd03bf49-866e9912_0] Write session: Do CDS request
2025-10-10T14:40:53.261780Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac1acc41-efe73d8e-cd03bf49-866e9912_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:53.271010Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ac1acc41-efe73d8e-cd03bf49-866e9912_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:53.271140Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:53.271174Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3449
2025-10-10T14:40:53.271336Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3449 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:53.271376Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3449 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:53.271383Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3449 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:53.271388Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:53.271867Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3449 sessionId:  describe result for acl check
2025-10-10T14:40:53.271898Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:53.271901Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:53.271903Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:53.271915Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559603091405791761:4371] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:53.272504Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559603091405791761:4371] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:53.275034Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559603091405791761:4371] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:53.278647Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559603091405791761:4371] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:53.278663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559603091405791761:4371] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:53.278667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559603091405791761:4371] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:53.278677Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3449 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:53.290789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:53.294088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:53.294411Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:53.294428Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:53.294441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:53.294505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:53.294559Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559603090623537512:13731]
2025-10-10T14:40:53.295215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:53.295613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:53.295698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:53.296092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:53.296189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:53.296197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:53.296199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:53.296200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:53.296201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:53.296204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:53.296205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:53.296207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:53.296209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:53.296210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:53.296212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:53.296213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:53.296214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:53.296222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:53.296238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:53.296242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:53.296247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:53.296251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:53.296256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:53.296261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:53.296265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:53.296269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:53.296274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:53.296279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:53.296284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:53.296289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:53.296298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:53.296308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:53.296315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:53.296322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:53.296330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:53.296336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:53.296342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:53.296349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:53.296355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:53.296361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:53.296365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:53.296391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:53.296401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:53.296408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:53.296418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:53.296423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:53.296428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:53.296439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:53.296443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:53.296455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:53.296464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:53.296469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:53.296480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:53.296501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:53.296510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:53.296515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:53.296564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:53.299367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:53.300315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:53.300332Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:53.300335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:53.300338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:53.300356Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3448 [2:7559603090623537512:13731]
2025-10-10T14:40:53.300370Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:53.300393Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:53.300402Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:53.300405Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:53.300409Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:53.300430Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:53.300437Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:53.300444Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:53.300513Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:53.300523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:53.300524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:53.300527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:53.300602Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:53.300611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:53.300623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:53.300635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:53.300657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:53.300680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603091405791826:4371], now have 1 active actors on pipe
2025-10-10T14:40:53.300689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603091405791746:2438], now have 1 active actors on pipe
2025-10-10T14:40:53.300696Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559603090623537507:13731]
2025-10-10T14:40:53.300702Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559603090623537507:13731]
2025-10-10T14:40:53.300704Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559603090623537507:13731]
2025-10-10T14:40:53.300720Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:53.300744Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:53.300745Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:53.300748Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:53.300750Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:53.300761Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:53.300765Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:53.300814Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559603090623537507:13731]
2025-10-10T14:40:53.300822Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:53.300805Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3448
2025-10-10T14:40:53.300811Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3448
2025-10-10T14:40:53.300848Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:53.300878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:53.300883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:53.300924Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9e81e55f-8cdc64fd-19814579-f555e24d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:53.300938Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:53.300942Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:53.300948Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:53.300962Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:53.300977Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:53.300991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:53.301125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:53.301136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:53.301152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:53.301250Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3449 partition: 0 MaxSeqNo: 40 sessionId: src_id|9e81e55f-8cdc64fd-19814579-f555e24d_0
2025-10-10T14:40:53.301811Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac1acc41-efe73d8e-cd03bf49-866e9912_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|9e81e55f-8cdc64fd-19814579-f555e24d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:53.304671Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9e81e55f-8cdc64fd-19814579-f555e24d_0] Write session: try to update token
2025-10-10T14:40:53.304698Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9e81e55f-8cdc64fd-19814579-f555e24d_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:53.327622Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:53.327648Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:53.327652Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:53.327654Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:53.327665Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559603090623537507:13731]
2025-10-10T14:40:53.327670Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559603090623537507:13731]
2025-10-10T14:40:53.327675Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559603090623537507:13731]
2025-10-10T14:40:53.327727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:53.327743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:53.327750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:53.327885Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:53.327902Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:53.327911Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:53.327962Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:53.328391Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3449 sessionId: src_id|9e81e55f-8cdc64fd-19814579-f555e24d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:53.331287Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:53.361409Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 35 consumer shared/user session shared/user_1_35_7080413204912763209_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559603091405792042:7208]
2025-10-10T14:40:53.361727Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 35 consumer shared/user session shared/user_1_35_7080413204912763209_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 pipe creation result: OK TabletId: 72075186224037892 Generation: 3448, pipe: [1:7559603091405792042:7208]
2025-10-10T14:40:53.442783Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:53.443947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:53.443967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:53.444016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603091405792042:7208], now have 1 active actors on pipe
2025-10-10T14:40:53.444262Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:40:53.444277Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:40:53.444344Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3449 reason: error at write: Disconnected sessionId: src_id|9e81e55f-8cdc64fd-19814579-f555e24d_0
2025-10-10T14:40:53.444271Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:53.444783Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e81e55f-8cdc64fd-19814579-f555e24d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:40:53.444798Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e81e55f-8cdc64fd-19814579-f555e24d_0] Write session will restart in 0.005981s
2025-10-10T14:40:53.444826Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e81e55f-8cdc64fd-19814579-f555e24d_0] Write session: Do CDS request
2025-10-10T14:40:53.444833Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e81e55f-8cdc64fd-19814579-f555e24d_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:40:53.444584Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3449 sessionId: src_id|9e81e55f-8cdc64fd-19814579-f555e24d_0 is DEAD
2025-10-10T14:40:53.444816Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:53.444860Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 35 consumer shared/user session shared/user_1_35_7080413204912763209_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 47 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559603091405792042:7208]
2025-10-10T14:40:53.452007Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9e81e55f-8cdc64fd-19814579-f555e24d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:53.452058Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:40:53.452075Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3450
2025-10-10T14:40:53.452244Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3450 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:40:53.452284Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3450 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:40:53.452294Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3450 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:40:53.452299Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:40:53.452970Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3450 sessionId:  describe result for acl check
2025-10-10T14:40:53.453012Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:40:53.453028Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:40:53.453030Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:40:53.453036Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559603091405792059:4350] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:40:53.453658Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559603091405792059:4350] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:40:53.456875Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559603091405792059:4350] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:40:53.460632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559603091405792059:4350] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:40:53.460667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559603091405792059:4350] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:40:53.460680Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559603091405792059:4350] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:40:53.460691Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3450 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:40:53.470697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:40:53.474327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:40:53.474624Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:40:53.474634Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:40:53.474647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:40:53.474708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:40:53.474757Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559603090623537807:13734]
2025-10-10T14:40:53.475480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:40:53.475806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:40:53.475848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:40:53.476219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:40:53.476303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:53.476309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:53.476311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:53.476312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:53.476314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:53.476315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:53.476317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:53.476318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:53.476320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:53.476322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:53.476323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:53.476324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:53.476326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:53.476334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:53.476348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:53.476357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:53.476364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:53.476368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:53.476377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:53.476386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:53.476391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:53.476395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:53.476400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:53.476404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:53.476408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:53.476412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:53.476422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:53.476439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:40:53.476446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:53.476452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:40:53.476457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:53.476461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:40:53.476466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:53.476471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:40:53.476475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:53.476480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:40:53.476485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:53.476489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:40:53.476494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:53.476499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:40:53.476503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:53.476509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:40:53.476513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:53.476520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:40:53.476524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:53.476529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:40:53.476532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:53.476537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:53.476541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:53.476546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:53.476550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:53.476555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:53.476592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:40:53.479652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:40:53.480601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:40:53.480616Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:40:53.480619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:40:53.480623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:40:53.480631Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3449 [2:7559603090623537807:13734]
2025-10-10T14:40:53.480648Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:40:53.480667Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:40:53.480671Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:53.480674Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:53.480677Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:53.480697Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:40:53.480710Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:40:53.480718Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:40:53.480784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:53.480790Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:53.480793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:53.480796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:40:53.480865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:40:53.480872Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:53.480885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:40:53.480902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:40:53.480925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:40:53.480953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603091405792044:2438], now have 1 active actors on pipe
2025-10-10T14:40:53.480961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603091405792156:4350], now have 1 active actors on pipe
2025-10-10T14:40:53.480969Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559603090623537802:13734]
2025-10-10T14:40:53.480976Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559603090623537802:13734]
2025-10-10T14:40:53.480978Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559603090623537802:13734]
2025-10-10T14:40:53.480994Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:40:53.481011Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:40:53.481014Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:40:53.481015Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:40:53.481016Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:40:53.481032Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:40:53.481035Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:40:53.481014Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3449
2025-10-10T14:40:53.481026Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3449
2025-10-10T14:40:53.481066Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559603090623537802:13734]
2025-10-10T14:40:53.481078Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:40:53.481083Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:40:53.481212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:53.481223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:53.481257Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8b5d3fd2-1f8ccbc6-d57f59d9-982ed557_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:40:53.481271Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:40:53.481275Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:40:53.481277Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:40:53.481292Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:40:53.481309Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:40:53.481357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:53.481562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:53.481586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:53.481615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:40:53.481727Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3450 partition: 0 MaxSeqNo: 40 sessionId: src_id|8b5d3fd2-1f8ccbc6-d57f59d9-982ed557_0
2025-10-10T14:40:53.482173Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e81e55f-8cdc64fd-19814579-f555e24d_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|8b5d3fd2-1f8ccbc6-d57f59d9-982ed557_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:40:53.485070Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8b5d3fd2-1f8ccbc6-d57f59d9-982ed557_0] Write session: try to update token
2025-10-10T14:40:53.485092Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8b5d3fd2-1f8ccbc6-d57f59d9-982ed557_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:40:53.501058Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3450 sessionId: src_id|8b5d3fd2-1f8ccbc6-d57f59d9-982ed557_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:40:53.504708Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:40:53.504739Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:40:53.504744Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:40:53.504747Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:40:53.504761Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559603090623537802:13734]
2025-10-10T14:40:53.504766Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559603090623537802:13734]
2025-10-10T14:40:53.504771Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559603090623537802:13734]
2025-10-10T14:40:53.504825Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:40:53.504839Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:40:53.504841Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:40:53.504846Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:40:53.504849Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:40:53.504852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:40:53.504928Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:40:53.505015Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:40:53.545172Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 35 consumer shared/user session shared/user_1_35_7080413204912763209_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559603091405792341:7208]
2025-10-10T14:40:53.545475Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 35 consumer shared/user session shared/user_1_35_7080413204912763209_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 pipe creation result: OK TabletId: 72075186224037892 Generation: 3449, pipe: [1:7559603091405792341:7208]
2025-10-10T14:40:53.622014Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:40:53.622406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:40:53.622432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:40:53.622490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559603091405792341:7208], now have 1 active actors on pipe
2025-10-10T14:40:53.622770Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 35 consumer shared/user session shared/user_1_35_7080413204912763209_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 48 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559603091405792341:7208]
2025-10-10T14:40:53.622778Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:40:53.622823Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:40:53.622826Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:40:53.622923Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3450 reason: error at write: Disconnected sessionId: src_id|8b5d3fd2-1f8ccbc6-d57f59d9-982ed557_0
2025-10-10T14:40:53.623174Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3450 sessionId: src_id|8b5d3fd2-1f8ccbc6-d57f59d9-982ed557_0 is DEAD
2025-10-10T14:40:53.623349Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b5d3fd2-1f8ccbc6-d57f59d9-982ed557_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:40:53.623361Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b5d3fd2-1f8ccbc6-d57f59d9-982ed557_0] Write session will restart in 0.006972s
2025-10-10T14:40:53.623390Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b5d3fd2-1f8ccbc6-d57f59d9-982ed557_0] Write session: Do CDS request
2025-10-10T14:40:53.622800Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:40:53.623400Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b5d3fd2-1f8ccbc6-d57f59d9-982ed557_0] Start write session. Will connect to endpoint: localhost:15287

Traceback (most recent call last):
  File "library/python/testing/yatest_common/yatest/common/process.py", line 384, in wait
    wait_for(
  File "library/python/testing/yatest_common/yatest/common/process.py", line 765, in wait_for
    raise TimeoutError(truncate(message, MAX_MESSAGE_LEN))
yatest.common.process.TimeoutError: 600 second(s) wait timeout has expired: Command '['/home/runner/.ya/tools/v4/9750504073/test_tool', 'run_ut', '@/home/runner/.ya/build/build_root/z96o/002b55/ydb/public/sdk/cpp/src/client/federated_topic/ut/test-results/unittest/testing_out_stuff/chunk3/testing_out_stuff/test_tool.args']' stopped by 600 seconds timeout

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "devtools/ya/test/programs/test_tool/run_test/run_test.py", line 1770, in main
    res.wait(check_exit_code=False, timeout=current_run_test_timeout, on_timeout=timeout_callback)
  File "library/python/testing/yatest_common/yatest/common/process.py", line 398, in wait
    raise ExecutionTimeoutError(self, str(e))
yatest.common.process.ExecutionTimeoutError: (("600 second(s) wait timeout has expired: Command '['/home/runner/.ya/tools/v4/9750504073/test_tool', 'run_ut', '@/home/runner/.ya/build/build_root/z96o/002b55/ydb/public/sdk/cpp/src/client/federated_topic/ut/test-results/unittest/testing_out_stuff/chunk3/testing_out_stuff/test_tool.args']' stopped by 600 seconds timeout",), {})
2025-10-10T14:30:54.345414Z :RetryDiscoveryWithCancel INFO: Random seed for debugging is 1760106654345409
2025-10-10T14:30:54.435299Z node 1 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[1:7559600517104972021:2084];send_to=[0:7307199536658146131:7762515];
2025-10-10T14:30:54.435521Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-10-10T14:30:54.438709Z node 1 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-10-10T14:30:54.439478Z node 2 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[2:7559600518448124593:2152];send_to=[0:7307199536658146131:7762515];
2025-10-10T14:30:54.439538Z node 2 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
test_client.cpp: SetPath # /home/runner/.ya/build/build_root/z96o/002b7b/r3tmp/tmpnQ40KT/pdisk_1.dat
2025-10-10T14:30:54.441907Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-10-10T14:30:54.473737Z node 1 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-10T14:30:54.478325Z node 1 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-10-10T14:30:54.481598Z node 2 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
TServer::EnableGrpc on GrpcPort 2916, node 1
2025-10-10T14:30:54.493523Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:190: distributable config is empty, broken or outdated, will use file: /home/runner/.ya/build/build_root/z96o/002b7b/r3tmp/yandexl5mQLk.tmp
2025-10-10T14:30:54.493535Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:196: will try to initialize from file: /home/runner/.ya/build/build_root/z96o/002b7b/r3tmp/yandexl5mQLk.tmp
2025-10-10T14:30:54.494080Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:202: successfully initialized from file: /home/runner/.ya/build/build_root/z96o/002b7b/r3tmp/yandexl5mQLk.tmp
2025-10-10T14:30:54.494126Z node 1 :NET_CLASSIFIER ERROR: net_classifier.cpp:228: got bad distributable configuration
2025-10-10T14:30:54.496964Z INFO: TTestServer started on Port 6151 GrpcPort 2916
TClient is connected to server localhost:6151
PQClient connected to localhost:2916
WaitRootIsUp 'Root'...
TClient::Ls request: Root
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "Root"
    PathId: 1
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 1
    CreateStep: 0
    ParentPathId: 1
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 1
      SubDomainVersion: 0
      SecurityStateVersion: 0
    }
    ChildrenExist: false
  }
  Children {
    Name: ".sys"
    PathId: 18446744073709551615
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 0
    CreateStep: 0
    ParentPathId: 18446744073709551615
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 0
      Pl...
(TRUNCATED)
WaitRootIsUp 'Root' success.
2025-10-10T14:30:54.536882Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-10T14:30:54.536921Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-10T14:30:54.538328Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Connecting -> Connected
2025-10-10T14:30:54.541532Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpAlterSubDomain, opId: 281474976720657:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_alter_subdomain.cpp:311)
2025-10-10T14:30:54.541678Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-10T14:30:54.541710Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-10T14:30:54.542626Z node 1 :HIVE WARN: hive_impl.cpp:811: HIVE#72057594037968897 Handle TEvInterconnect::TEvNodeConnected, NodeId 2 Cookie 2
2025-10-10T14:30:54.542906Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Connecting -> Connected
waiting...
waiting...
waiting...
waiting...
2025-10-10T14:30:54.628116Z node 1 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-10-10T14:30:54.770280Z node 2 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-10-10T14:30:54.824282Z node 2 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:566: Compilation failed, self: [2:7559600518448124782:2289], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-10T14:30:54.824381Z node 2 :KQP_SESSION WARN: kqp_session_actor.cpp:2408: SessionId: ydb://session/3?node_id=2&id=YzE2ZjgxNDctOGViZTdlMjEtNDNhNjQ0OTUtMzQ3ODIzOGQ=, ActorId: [2:7559600518448124780:2288], ActorState: ExecuteState, TraceId: 01k778gb2256wp58vtqskjq6e0, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-10T14:30:54.826967Z node 2 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-10-10T14:30:54.854069Z node 1 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:566: Compilation failed, self: [1:7559600517104972909:2318], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-10T14:30:54.854195Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2408: SessionId: ydb://session/3?node_id=1&id=ZTZjMDI4MTktZWM1NDk3MmUtNzU5NDJmODItNjc1ZmIxNmE=, ActorId: [1:7559600517104972906:2316], ActorState: ExecuteState, TraceId: 01k778gb42a53pqtqzjjcnwbcv, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-10T14:30:54.854333Z node 1 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-10-10T14:30:54.861306Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720661:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-10T14:30:54.881765Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720662:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-10T14:30:54.899782Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720663:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
=== Init DC: UPSERT INTO `/Root/PQ/Config/V2/Cluster` (name, balancer, local, enabled, weight) VALUES ("dc1", "localhost:2916", true, true, 1000), ("dc2", "dc2.logbroker.yandex.net", false, false, 1000);
2025-10-10T14:30:54.934656Z node 1 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976720664. Ctx: { TraceId: 01k778gb62e4c91rkd2p26x5wh, Database: , SessionId: ydb://session/3?node_id=1&id=YzM5NGFiODEtZDQzYzhiNDktNWI0NDhhNzAtNTUyYWRkMDQ=, PoolId: , DatabaseId: /Root}. Database not set, use /Root
=== CheckClustersList. Subcribe to ClusterTracker from [1:7559600517104973284:2887] 
2025-10-10T14:30:55.437274Z node 1 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-10-10T14:30:55.441381Z node 2 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-10-10T14:30:59.435534Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[1:7559600517104972021:2084];send_to=[0:7307199536658146131:7762515];
2025-10-10T14:30:59.435573Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
2025-10-10T14:30:59.439581Z node 2 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[2:7559600518448124593:2152];send_to=[0:7307199536658146131:7762515];
2025-10-10T14:30:59.439609Z node 2 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
=== CheckClustersList. Ok
2025-10-10T14:31:00.049949Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720676:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
waiting...
PQ Client: create topic: rt3.dc1--test-topic with 1 partitions
CallPersQueueGRPC request to localhost:2916
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-10T14:31:00.065314Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
CallPersQueueGRPC request to localhost:2916
MetaRequest {
  CmdCreateTopic {
    Topic: "rt3.dc1--test-topic"
    NumPartitions: 1
    Config {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
  }
}
CallPersQueueGRPC response:
Status: 129
ProxyErrorCode: 53
SchemeStatus: 1
FlatTxId {
  TxId: 281474976720677
  SchemeShardTabletId: 72057594046644480
  PathId: 9
}
ErrorCode: OK
AddTopic: rt3.dc1--test-topic
===Run query:``DECLARE $version as Int64; DECLARE $path AS Utf8; DECLARE $cluster as Utf8; UPSERT INTO `/Root/PQ/Config/V2/Topics` (path, dc) VALUES ($path, $cluster); UPSERT INTO `/Root/PQ/Config/V2/Versions` (name, version) VALUES ("Topics", $version);`` with topic = test-topic, dc = dc1
2025-10-10T14:31:00.070735Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][] pipe [1:7559600542874777568:3180] connected; active server actors: 1
2025-10-10T14:31:00.070843Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1517: [72075186224037893][rt3.dc1--test-topic] updating configuration. Deleted partitions []. Added partitions [0]
2025-10-10T14:31:00.070976Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:940: [72075186224037893][rt3.dc1--test-topic] Discovered subdomain [OwnerId: 72057594046644480, LocalPathId: 1] state, outOfSpace = 0 at RB 72075186224037893
2025-10-10T14:31:00.071119Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:138: [72075186224037893][rt3.dc1--test-topic] BALANCER INIT DONE for rt3.dc1--test-topic: (0, 72075186224037892) 
2025-10-10T14:31:00.072609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:00.073011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:00.073056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:784: [PQ: 72075186224037892] no config, start with empty partitions and default config
2025-10-10T14:31:00.073066Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:00.073074Z node 2 :PERSQUEUE INFO: pq_impl.cpp:609: [PQ: 72075186224037892] doesn't have tx writes info
2025-10-10T14:31:00.073130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600542874777567:3179], now have 1 active actors on pipe
2025-10-10T14:31:00.073137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600542874777591:2437], now have 1 active actors on pipe
2025-10-10T14:31:00.073164Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1
2025-10-10T14:31:00.073259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-10T14:31:00.073890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-10T14:31:00.074837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600542874777626:3227], now have 1 active actors on pipe
2025-10-10T14:31:00.074916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-10T14:31:00.075424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-10T14:31:00.075595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:00.075625Z node 2 :PERSQUEUE DEBUG: partition.cpp:1277: [72075186224037892][Partition][0][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-10-10T14:31:00.075673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:00.075734Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600544217929112:2381]
2025-10-10T14:31:00.076244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:00.076249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:00.076253Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1 [2:7559600544217929112:2381]
2025-10-10T14:31:00.076257Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-10-10T14:31:00.076444Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 1
2025-10-10T14:31:00.076452Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:00.076468Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:00.076474Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:00.076476Z node 2 :PERSQUEUE DEBUG: partition.cpp:2345: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-10T14:31:00.076477Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:00.076478Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:00.076479Z node 2 :PERSQUEUE DEBUG: partition.cpp:2345: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-10T14:31:00.076484Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:00.076557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-10T14:31:00.076581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:31:00.077256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-10T14:31:00.077299Z node 2 :PERSQUEUE DEBUG: partition.cpp:1381: [72075186224037892][Partition][0][StateIdle] Handle TEvPQ::TEvTxCommit Step 1760106660123, TxId 281474976720677
2025-10-10T14:31:00.077308Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:00.077310Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:00.077431Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:00.077497Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:31:00.077900Z node 2 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:31:00.077966Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:31:00.077973Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:00.077975Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:00.077976Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:00.077979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:31:00.078045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:395: [PQ: 72075186224037892] Apply new config PartitionConfig { LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 } PartitionIds: 0 TopicName: "rt3.dc1--test-topic" Version: 0 LocalDC: true Codecs { Ids: 0 Ids: 1 Ids: 2 Codecs: "raw" Codecs: "gzip" Codecs: "lzop" } TopicPath: "/Root/PQ/rt3.dc1--test-topic" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } Consumers { Name: "user" ReadFromTimestampsMs: 0 FormatVersion: 0 Version: 0 Generation: 0 } MonitoringProjectId: ""
2025-10-10T14:31:00.078059Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:00.078095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-10T14:31:00.078899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-10T14:31:00.078917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-10T14:31:00.079245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-10T14:31:00.082502Z node 1 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976720678. Ctx: { TraceId: 01k778gg75e6q02f6bezayydye, Database: , SessionId: ydb://session/3?node_id=1&id=MzlmNGZlMTctYWZkYjRlMjktMTEwODU3MjktMzkzYWMyYzU=, PoolId: , DatabaseId: /Root}. Database not set, use /Root
===Query complete
TClient::Ls request: /Root/PQ/rt3.dc1--test-topic
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976720677
    CreateStep: 1760106660123
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: ...
(TRUNCATED)
GetTopicVersionFromPath:  record Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976720677
    CreateStep: 1760106660123
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      YdbDatabasePath: "/Root"
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
    Partitions {
      PartitionId: 0
      TabletId: 72075186224037892
      Status: Active
    }
    AlterVersion: 1
    BalancerTabletID: 72075186224037893
    NextPartitionId: 1
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 1
      PlanResolution: 7
      Coordinators: 72057594046316545
      TimeCastBucketsPerMediator: 2
      Mediators: 72057594046382081
    }
    DomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    PathsInside: 8
    PathsLimit: 10000
    ShardsInside: 6
    ShardsLimit: 200000
    ResourcesDomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    DiskSpaceUsage {
      Tables {
        TotalSize: 0
        DataSize: 0
        IndexSize: 0
      }
      Topics {
        ReserveSize: 0
        AccountSize: 0
        DataSize: 0
        UsedReserveSize: 0
      }
    }
    PQPartitionsInside: 1
    PQPartitionsLimit: 1000000
    SchemeLimits {
      MaxDepth: 32
      MaxPaths: 10000
      MaxChildrenInDir: 100000
      MaxAclBytesSize: 10240
      MaxTableColumns: 200
      MaxTableColumnNameLength: 255
      MaxTableKeyColumns: 30
      MaxTableIndices: 20
      MaxShards: 200000
      MaxShardsInPath: 35000
      MaxConsistentCopyTargets: 10000
      MaxPathElementLength: 255
      ExtraPathSymbolsAllowed: "!\"#$%&\'()*+,-.:;<=>?@[\\]^_`{|}~"
      MaxPQPartitions: 1000000
      MaxTableCdcStreams: 5
      MaxExports: 10
      MaxImports: 10
      MaxColumnTableColumns: 10000
    }
  }
}
Path: "/Root/PQ/rt3.dc1--test-topic"
 name rt3.dc1--test-topic version1
CallPersQueueGRPC request to localhost:2916
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-10T14:31:00.086920Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-10-10T14:31:00.176406Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:00.176423Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:00.176426Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:00.276741Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:00.276760Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:00.276762Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:00.377104Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:00.377118Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:00.377120Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:00.477449Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:00.477460Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:00.477462Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:00.577798Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:00.577811Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:00.577813Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:2916
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-10T14:31:00.587879Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-10-10T14:31:00.678128Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:00.678142Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:00.678145Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:00.778475Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:00.778493Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:00.778496Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:00.878851Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:00.878864Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:00.878866Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:00.979209Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:00.979219Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:00.979222Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:01.079543Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:01.079554Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:01.079556Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:2916
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-10T14:31:01.089098Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--test-topic"
      NumPartitions: 1
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        TopicPath: "/Root/PQ/rt3.dc1--test-topic"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Version: 0
        }
      }
      ErrorCode: OK
    }
  }
}
=== Topic created, have version: 1
2025-10-10T14:31:01.089959Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: try to update token
2025-10-10T14:31:01.090127Z :INFO: [] MessageGroupId [src] SessionId [] Write session: Do CDS request
2025-10-10T14:31:01.090131Z :INFO: [] MessageGroupId [src] SessionId [] Start write session. Will connect to endpoint: localhost:2916
2025-10-10T14:31:01.090669Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:01.090676Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1
2025-10-10T14:31:01.092070Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src" }
2025-10-10T14:31:01.092246Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src" }
2025-10-10T14:31:01.092289Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1 topic: "test-topic" message_group_id: "src" from ipv6:[::1]:50524
2025-10-10T14:31:01.092295Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:50524 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:01.092297Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:01.092571Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1 sessionId:  describe result for acl check
2025-10-10T14:31:01.092596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:01.092600Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:01.092602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:01.092604Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600547169745091:2471] (SourceId=src, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:01.092976Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600547169745091:2471] (SourceId=src, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:01.111457Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [1:7559600547169745091:2471] (SourceId=src, PreferedPartition=(NULL)) RequestPQRB
2025-10-10T14:31:01.111535Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559600547169745122:2471] connected; active server actors: 1
2025-10-10T14:31:01.111560Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [1:7559600547169745091:2471] (SourceId=src, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=src
2025-10-10T14:31:01.111565Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600547169745091:2471] (SourceId=src, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:01.111636Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559600547169745122:2471] disconnected; active server actors: 1
2025-10-10T14:31:01.111645Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559600547169745122:2471] disconnected no session
2025-10-10T14:31:01.127026Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600547169745091:2471] (SourceId=src, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:01.127039Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600547169745091:2471] (SourceId=src, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-10-10T14:31:01.127042Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600547169745091:2471] (SourceId=src, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:01.127049Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:01.127328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600547169745140:2471], now have 1 active actors on pipe
2025-10-10T14:31:01.127365Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1
2025-10-10T14:31:01.127490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:01.127501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:01.127529Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src|19ee2b14-53b91b20-c0a44cda-71f56d2a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src
2025-10-10T14:31:01.127545Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:01.127553Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:01.127556Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:01.127569Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:01.127583Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:01.127604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:01.127788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:01.127795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:01.127807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:01.127878Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1 partition: 0 MaxSeqNo: 0 sessionId: src|19ee2b14-53b91b20-c0a44cda-71f56d2a_0
2025-10-10T14:31:01.128201Z :INFO: [] MessageGroupId [src] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1760106661128 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-10T14:31:01.128225Z :INFO: [] MessageGroupId [src] SessionId [] Write session established. Init response: session_id: "src|19ee2b14-53b91b20-c0a44cda-71f56d2a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:01.128332Z :INFO: [] MessageGroupId [src] SessionId [src|19ee2b14-53b91b20-c0a44cda-71f56d2a_0] Write session: close. Timeout = 0 ms
2025-10-10T14:31:01.128341Z :INFO: [] MessageGroupId [src] SessionId [src|19ee2b14-53b91b20-c0a44cda-71f56d2a_0] Write session will now close
2025-10-10T14:31:01.128348Z :DEBUG: [] MessageGroupId [src] SessionId [src|19ee2b14-53b91b20-c0a44cda-71f56d2a_0] Write session: aborting
2025-10-10T14:31:01.128466Z :INFO: [] MessageGroupId [src] SessionId [src|19ee2b14-53b91b20-c0a44cda-71f56d2a_0] Write session: gracefully shut down, all writes complete
2025-10-10T14:31:01.128470Z :DEBUG: [] MessageGroupId [src] SessionId [src|19ee2b14-53b91b20-c0a44cda-71f56d2a_0] Write session: destroy
2025-10-10T14:31:01.128556Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId: src|19ee2b14-53b91b20-c0a44cda-71f56d2a_0 grpc read done: success: 0 data: 
2025-10-10T14:31:01.128564Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 1 sessionId: src|19ee2b14-53b91b20-c0a44cda-71f56d2a_0 grpc read failed
2025-10-10T14:31:01.128570Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 1 sessionId: src|19ee2b14-53b91b20-c0a44cda-71f56d2a_0 grpc closed
2025-10-10T14:31:01.128574Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1 sessionId: src|19ee2b14-53b91b20-c0a44cda-71f56d2a_0 is DEAD
2025-10-10T14:31:01.128764Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-10-10T14:31:01.128859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [1:7559600547169745140:2471] destroyed
2025-10-10T14:31:01.128869Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-10-10T14:31:01.128875Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:01.128877Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:01.128879Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:01.179904Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:01.179921Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:01.179924Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
>>> Ready to answer: err
2025-10-10T14:31:01.181674Z :ERROR: [/Root] OnFederationDiscovery: Got error. Status: TRANSPORT_UNAVAILABLE. Description: [ { <main>: Error: GRpc error: (14): mock 'unavailable' } { <main>: Error: Grpc error response on endpoint localhost:24463 } ]
2025-10-10T14:31:01.280274Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:01.280287Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:01.280289Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:01.380626Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:01.380638Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:01.380641Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:01.480976Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:01.480989Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:01.480992Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:01.581359Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:01.581373Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:01.581377Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:01.681688Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:01.681703Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:01.681706Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:01.782031Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:01.782044Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:01.782047Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:01.882333Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:01.882356Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:01.882358Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:01.982726Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:01.982741Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:01.982743Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:02.083082Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:02.083096Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:02.083099Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:02.183450Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:02.183467Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:02.183470Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:02.283796Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:02.283809Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:02.283811Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:02.384146Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:02.384161Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:02.384164Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:02.484491Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:02.484502Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:02.484504Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:02.584855Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:02.584868Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:02.584870Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:02.685195Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:02.685205Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:02.685207Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:02.785544Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:02.785554Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:02.785556Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:02.885872Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:02.885886Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:02.885888Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:02.986255Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:02.986267Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:02.986269Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:03.086601Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:03.086612Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:03.086615Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:03.186951Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:03.186966Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:03.186968Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:03.287308Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:03.287320Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:03.287322Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:03.387648Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:03.387659Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:03.387662Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:03.488013Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:03.488024Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:03.488027Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:03.588363Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:03.588374Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:03.588376Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:03.688705Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:03.688720Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:03.688724Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:03.789069Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:03.789081Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:03.789083Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:03.889392Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:03.889404Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:03.889406Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:03.989768Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:03.989779Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:03.989781Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:04.090101Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:04.090111Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:04.090113Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:04.190461Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:04.190470Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:04.190472Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:04.290834Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:04.290849Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:04.290852Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:04.391166Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:04.391179Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:04.391181Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:04.491518Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:04.491530Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:04.491532Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:04.591878Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:04.591891Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:04.591894Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:04.692239Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:04.692252Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:04.692254Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:04.792542Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:04.792554Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:04.792557Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:04.892928Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:04.892939Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:04.892942Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:04.993294Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:04.993305Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:04.993307Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:05.076772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:31:05.093628Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:05.093641Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:05.093645Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:05.194027Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:05.194044Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:05.194047Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:05.294349Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:05.294361Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:05.294364Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:05.394683Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:05.394702Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:05.394704Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:05.495054Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:05.495066Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:05.495068Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:05.595426Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:05.595444Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:05.595447Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:05.695743Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:05.695754Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:05.695756Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:05.796108Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:05.796123Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:05.796126Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:05.896445Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:05.896456Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:05.896458Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:05.996802Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:05.996814Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:05.996816Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:06.097140Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:06.097150Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:06.097153Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
E1010 14:31:06.186096117 2322687 chttp2_transport.cc:1143]             ipv4:127.0.0.1:24463: Received a GOAWAY with error code ENHANCE_YOUR_CALM and debug data equal to "too_many_pings". Current keepalive time (before throttling): 1250ms
2025-10-10T14:31:06.197499Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:06.197511Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:06.197514Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:06.297870Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:06.297886Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:06.297889Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:06.398230Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:06.398245Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:06.398248Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:06.498551Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:06.498566Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:06.498569Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:06.598935Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:06.598949Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:06.598952Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:06.699290Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:06.699304Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:06.699307Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:06.799619Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:06.799632Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:06.799634Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:06.899990Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:06.900002Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:06.900004Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:07.000345Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:07.000358Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:07.000361Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:07.100681Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:07.100695Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:07.100697Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:07.201043Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:07.201060Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:07.201063Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:07.301386Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:07.301400Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:07.301401Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:07.401743Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:07.401755Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:07.401757Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:07.502098Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:07.502112Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:07.502115Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:07.602456Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:07.602477Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:07.602480Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:07.702796Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:07.702809Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:07.702818Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:07.803167Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:07.803180Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:07.803183Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:07.903529Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:07.903545Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:07.903548Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:08.003854Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:08.003868Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:08.003871Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:08.104200Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:08.104214Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:08.104216Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:08.204548Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:08.204561Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:08.204564Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:08.304896Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:08.304907Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:08.304908Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:08.405251Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:08.405263Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:08.405265Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:08.505605Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:08.505618Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:08.505620Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:08.605945Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:08.605956Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:08.605959Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:08.706295Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:08.706309Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:08.706311Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:08.806653Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:08.806666Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:08.806668Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:08.907026Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:08.907038Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:08.907040Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:09.007371Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:09.007382Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:09.007385Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:09.107722Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:09.107736Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:09.107738Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:09.208083Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:09.208094Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:09.208096Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:09.308423Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:09.308437Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:09.308440Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:09.408783Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:09.408799Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:09.408802Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:09.477361Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard_impl.cpp:7712: Cannot get console configs
2025-10-10T14:31:09.477371Z node 1 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-10-10T14:31:09.509107Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:09.509117Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:09.509120Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:09.609487Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:09.609502Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:09.609505Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:09.709788Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:09.709799Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:09.709801Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:09.810191Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:09.810202Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:09.810205Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:09.910523Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:09.910534Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:09.910543Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:10.010900Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:10.010915Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:10.010917Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:10.076964Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:31:10.111259Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:10.111271Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:10.111273Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:10.211590Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:10.211604Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:10.211610Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
>>> Ready to answer: ok
2025-10-10T14:31:10.311955Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:10.311966Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:10.311968Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:10.412286Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:10.412298Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:10.412300Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:10.512653Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:10.512666Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:10.512668Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:10.612987Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:10.613000Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:10.613002Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:10.713359Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:10.713370Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:10.713372Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:10.813720Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:10.813732Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:10.813734Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:10.914071Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:10.914085Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:10.914088Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:11.014405Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:11.014424Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:11.014426Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:11.114755Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:11.114775Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:11.114777Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:11.215115Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:11.215125Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:11.215128Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:11.315464Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:11.315476Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:11.315478Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:11.415809Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:11.415819Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:11.415821Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:11.516160Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:11.516172Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:11.516174Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:11.616515Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:11.616528Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:11.616531Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:11.716866Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:11.716881Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:11.716884Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:11.817240Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:11.817253Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:11.817257Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:11.917587Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:11.917600Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:11.917603Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:12.017925Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:12.017938Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:12.017941Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:12.118281Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:12.118293Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:12.118295Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:12.218622Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:12.218634Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:12.218635Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:12.318988Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:12.319011Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:12.319014Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:12.419336Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:12.419350Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:12.419351Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:12.519740Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:12.519756Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:12.519759Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:12.620073Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:12.620094Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:12.620097Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:12.720393Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:12.720407Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:12.720409Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:12.820747Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:12.820761Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:12.820772Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:12.921092Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:12.921107Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:12.921116Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:13.021469Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:13.021482Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:13.021485Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:13.121815Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:13.121832Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:13.121835Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:13.222158Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:13.222172Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:13.222178Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:13.322519Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:13.322534Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:13.322537Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:13.422864Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:13.422881Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:13.422884Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:13.523229Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:13.523247Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:13.523250Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:13.623567Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:13.623593Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:13.623596Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:13.723939Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:13.723954Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:13.723958Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:13.824273Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:13.824286Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:13.824288Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:13.924608Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:13.924621Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:13.924624Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:14.024973Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:14.024987Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:14.024991Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
E1010 14:31:14.047808259 2320351 chttp2_transport.cc:1143]             ipv6:%5B::1%5D:24463: Received a GOAWAY with error code ENHANCE_YOUR_CALM and debug data equal to "too_many_pings". Current keepalive time (before throttling): 1250ms
2025-10-10T14:31:14.125364Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:14.125381Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:14.125384Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:14.225661Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:14.225674Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:14.225676Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:14.326037Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:14.326049Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:14.326060Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:14.426373Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:14.426393Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:14.426397Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:14.526741Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:14.526753Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:14.526756Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:14.627081Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:14.627096Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:14.627099Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:14.727453Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:14.727469Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:14.727472Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:14.827794Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:14.827808Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:14.827811Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:14.928084Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:14.928095Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:14.928097Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:15.028506Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:15.028519Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:15.028522Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:15.077175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:31:15.128830Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:15.128842Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:15.128845Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:15.229187Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:15.229200Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:15.229203Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:15.329548Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:15.329564Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:15.329566Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:15.429878Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:15.429889Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:15.429891Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:15.530382Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:15.530393Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:15.530394Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:15.630610Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:15.630622Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:15.630624Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:15.730905Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:15.730916Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:15.730919Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:15.831313Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:15.831325Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:15.831328Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:15.931660Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:15.931671Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:15.931673Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:16.032016Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:16.032028Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:16.032030Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:16.132364Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:16.132377Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:16.132379Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:16.232723Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:16.232734Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:16.232736Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:16.333079Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:16.333096Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:16.333098Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:16.433413Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:16.433426Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:16.433428Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:16.533752Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:16.533771Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:16.533773Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:16.634133Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:16.634147Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:16.634150Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:16.734471Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:16.734484Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:16.734486Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:16.834825Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:16.834837Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:16.834839Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:16.935145Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:16.935155Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:16.935156Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:17.035529Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:17.035541Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:17.035543Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:17.135899Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:17.135911Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:17.135914Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:17.236255Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:17.236268Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:17.236270Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:17.336652Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:17.336665Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:17.336668Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:17.436938Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:17.436950Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:17.436952Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:17.537306Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:17.537320Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:17.537323Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:17.637637Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:17.637650Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:17.637652Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:17.738001Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:17.738013Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:17.738015Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:17.838375Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:17.838392Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:17.838395Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:17.938669Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:17.938688Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:17.938690Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:18.039064Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:18.039081Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:18.039085Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:18.139402Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:18.139415Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:18.139418Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:18.239776Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:18.239792Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:18.239794Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:18.340122Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:18.340147Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:18.340149Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:18.440464Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:18.440485Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:18.440487Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:18.540834Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:18.540850Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:18.540852Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:18.641119Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:18.641142Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:18.641143Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:18.741525Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:18.741538Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:18.741540Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:18.841874Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:18.841888Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:18.841890Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:18.942213Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:18.942226Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:18.942228Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:19.042581Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:19.042604Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:19.042606Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:19.142936Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:19.142952Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:19.142954Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:19.243287Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:19.243303Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:19.243306Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:19.343615Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:19.343637Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:19.343640Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:19.443970Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:19.443986Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:19.443988Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:19.544345Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:19.544363Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:19.544367Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:19.644677Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:19.644690Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:19.644692Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:19.745061Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:19.745078Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:19.745080Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:19.845398Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:19.845414Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:19.845417Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:19.945727Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:19.945743Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:19.945746Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:20.046107Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:20.046134Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:20.046137Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:20.077395Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:31:20.146458Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:20.146472Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:20.146474Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:20.246802Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:20.246820Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:20.246825Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:20.347140Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:20.347154Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:20.347156Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:20.447478Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:20.447492Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:20.447494Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:20.547859Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:20.547879Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:20.547882Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:20.648203Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:20.648218Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:20.648220Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:20.748539Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:20.748555Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:20.748557Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:20.848922Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:20.848935Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:20.848938Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:20.949290Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:20.949305Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:20.949308Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:21.049648Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:21.049666Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:21.049669Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:21.149945Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:21.149974Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:21.149978Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:21.250286Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:21.250303Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:21.250306Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:21.350647Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:21.350666Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:21.350669Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:21.451031Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:21.451044Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:21.451046Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:21.551390Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:21.551403Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:21.551406Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:21.651754Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:21.651771Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:21.651773Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:21.752065Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:21.752079Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:21.752081Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:21.852441Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:21.852455Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:21.852457Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:21.952769Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:21.952782Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:21.952784Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:22.053151Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:22.053174Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:22.053178Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:22.153483Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:22.153504Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:22.153507Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:22.253837Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:22.253849Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:22.253852Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:22.354209Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:22.354221Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:22.354223Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:22.454524Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:22.454535Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:22.454537Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:22.554893Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:22.554907Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:22.554910Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:22.655245Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:22.655258Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:22.655260Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:22.755584Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:22.755598Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:22.755600Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:22.855959Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:22.855977Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:22.855980Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:22.956322Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:22.956336Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:22.956339Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:23.056649Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:23.056664Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:23.056667Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:23.157002Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:23.157016Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:23.157019Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:23.257374Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:23.257399Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:23.257404Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:23.357725Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:23.357741Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:23.357744Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:23.458038Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:23.458051Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:23.458053Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:23.558399Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:23.558410Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:23.558412Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:23.658790Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:23.658807Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:23.658810Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:23.759151Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:23.759167Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:23.759170Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:23.859480Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:23.859498Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:23.859500Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:23.959828Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:23.959843Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:23.959845Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:24.060177Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:24.060194Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:24.060197Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:24.160568Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:24.160588Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:24.160591Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:24.260896Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:24.260912Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:24.260914Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:24.361207Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:24.361226Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:24.361229Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:24.461583Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:24.461599Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:24.461602Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:24.561939Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:24.561955Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:24.561957Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:24.662304Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:24.662321Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:24.662324Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:24.762632Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:24.762649Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:24.762652Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:24.862963Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:24.862977Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:24.862979Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:24.963350Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:24.963365Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:24.963367Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:25.063693Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:25.063706Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:25.063708Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:25.077543Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:31:25.164065Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:25.164079Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:25.164082Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:25.264376Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:25.264389Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:25.264392Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:25.364742Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:25.364754Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:25.364756Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:25.465086Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:25.465097Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:25.465099Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:25.565450Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:25.565464Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:25.565466Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:25.665801Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:25.665816Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:25.665819Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:25.766149Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:25.766161Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:25.766163Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:25.866497Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:25.866509Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:25.866511Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:25.966860Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:25.966875Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:25.966878Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:26.067210Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:26.067223Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:26.067225Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:26.167566Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:26.167578Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:26.167581Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:26.267903Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:26.267917Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:26.267920Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:26.368267Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:26.368282Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:26.368286Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:26.468603Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:26.468616Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:26.468618Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:26.568996Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:26.569012Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:26.569015Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:26.669310Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:26.669321Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:26.669323Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:26.769681Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:26.769696Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:26.769699Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:26.870022Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:26.870035Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:26.870037Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:26.970369Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:26.970380Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:26.970381Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:27.070730Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:27.070742Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:27.070744Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:27.171079Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:27.171091Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:27.171094Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:27.271428Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:27.271440Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:27.271442Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:27.371799Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:27.371821Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:27.371823Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:27.472134Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:27.472145Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:27.472148Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:27.572453Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:27.572466Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:27.572468Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:27.672845Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:27.672859Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:27.672861Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:27.773192Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:27.773206Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:27.773208Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:27.873541Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:27.873553Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:27.873555Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:27.973897Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:27.973911Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:27.973913Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:28.074258Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:28.074272Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:28.074274Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:28.174622Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:28.174637Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:28.174640Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:28.274954Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:28.274975Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:28.274978Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:28.375341Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:28.375356Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:28.375358Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:28.475634Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:28.475650Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:28.475653Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:28.576031Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:28.576047Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:28.576050Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:28.676376Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:28.676388Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:28.676390Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:28.776734Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:28.776747Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:28.776749Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:28.877084Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:28.877101Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:28.877103Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:28.977387Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:28.977398Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:28.977400Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:29.077777Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:29.077792Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:29.077796Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:29.178231Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:29.178257Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:29.178261Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:29.278484Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:29.278498Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:29.278500Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:29.378812Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:29.378832Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:29.378834Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:29.479155Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:29.479167Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:29.479170Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:29.579553Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:29.579568Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:29.579570Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:29.679893Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:29.679908Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:29.679911Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:29.780191Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:29.780205Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:29.780207Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:29.880592Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:29.880610Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:29.880613Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:29.980919Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:29.980936Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:29.980939Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:30.071013Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:155: [72075186224037893][rt3.dc1--test-topic] TPersQueueReadBalancer::HandleWakeup
2025-10-10T14:31:30.071048Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 1
2025-10-10T14:31:30.071285Z node 2 :PERSQUEUE DEBUG: partition.cpp:1000: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 0 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-10-10T14:31:30.071521Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 9 Generation: 1 StatsReportRound: 1 DataSize: 0 UsedReserveSize: 0
2025-10-10T14:31:30.071673Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-10-10T14:31:30.071738Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72057594046644480, NodeId 1, Generation 2
2025-10-10T14:31:30.077729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:31:30.081279Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:30.081291Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:30.081294Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:30.181651Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:30.181668Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:30.181671Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:30.282003Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:30.282025Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:30.282027Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:30.382330Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:30.382344Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:30.382346Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:30.482703Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:30.482718Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:30.482721Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:30.583033Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:30.583047Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:30.583049Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:30.683415Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:30.683437Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:30.683439Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:30.783760Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:30.783775Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:30.783778Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:30.884107Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:30.884123Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:30.884125Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:30.984485Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:30.984505Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:30.984507Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:31.084775Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:31.084792Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:31.084795Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
E1010 14:31:31.138470557 2320316 chttp2_transport.cc:1143]             ipv4:127.0.0.1:24463: Received a GOAWAY with error code ENHANCE_YOUR_CALM and debug data equal to "too_many_pings". Current keepalive time (before throttling): 2500ms
2025-10-10T14:31:31.185179Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:31.185195Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:31.185198Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:31.285529Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:31.285547Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:31.285550Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:31.385857Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:31.385879Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:31.385881Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:31.486266Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:31.486281Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:31.486283Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:31.586552Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:31.586565Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:31.586567Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:31.686881Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:31.686893Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:31.686896Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:31.787284Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:31.787300Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:31.787304Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:31.887620Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:31.887635Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:31.887638Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:31.988071Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:31.988085Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:31.988087Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:32.088333Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:32.088346Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:32.088348Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:32.188678Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:32.188701Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:32.188703Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:32.289021Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:32.289036Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:32.289038Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:32.389398Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:32.389414Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:32.389416Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:32.489755Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:32.489778Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:32.489781Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:32.590117Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:32.590136Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:32.590139Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:32.690461Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:32.690477Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:32.690479Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:32.790824Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:32.790837Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:32.790839Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:32.891135Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:32.891149Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:32.891152Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:32.991520Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:32.991547Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:32.991550Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:33.091861Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:33.091875Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:33.091878Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:33.192197Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:33.192212Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:33.192214Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:33.292578Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:33.292594Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:33.292596Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:33.392906Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:33.392918Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:33.392921Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:33.493219Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:33.493233Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:33.493235Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:33.593631Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:33.593650Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:33.593654Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:33.693971Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:33.693985Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:33.693987Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:33.794323Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:33.794336Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:33.794339Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:33.894672Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:33.894691Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:33.894694Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:33.995047Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:33.995070Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:33.995073Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:34.095362Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:34.095375Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:34.095377Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:34.195718Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:34.195730Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:34.195732Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:34.296081Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:34.296095Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:34.296097Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:34.396423Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:34.396436Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:34.396439Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:34.496739Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:34.496753Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:34.496756Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:34.597130Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:34.597144Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:34.597147Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:34.697491Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:34.697504Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:34.697506Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:34.797832Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:34.797845Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:34.797848Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:34.898193Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:34.898207Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:34.898210Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:34.998543Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:34.998557Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:34.998559Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:35.077960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:31:35.098906Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:35.098920Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:35.098924Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:35.199275Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:35.199295Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:35.199298Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:35.299600Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:35.299614Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:35.299616Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:35.399931Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:35.399953Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:35.399955Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:35.500307Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:35.500322Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:35.500326Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:35.600625Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:35.600637Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:35.600640Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:35.701011Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:35.701025Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:35.701028Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:35.801383Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:35.801396Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:35.801399Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:35.901713Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:35.901725Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:35.901727Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:36.002060Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:36.002073Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:36.002075Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:36.102414Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:36.102426Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:36.102429Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:36.202785Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:36.202800Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:36.202802Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:36.303133Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:36.303149Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:36.303151Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:36.403477Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:36.403490Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:36.403492Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:36.503832Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:36.503847Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:36.503849Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:36.604188Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:36.604201Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:36.604203Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:36.704537Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:36.704557Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:36.704559Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:36.804878Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:36.804896Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:36.804899Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:36.905214Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:36.905228Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:36.905230Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:37.005601Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:37.005622Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:37.005624Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:37.105947Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:37.105966Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:37.105969Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:37.206313Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:37.206328Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:37.206330Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:37.306639Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:37.306653Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:37.306655Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:37.407004Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:37.407021Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:37.407024Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:37.507348Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:37.507370Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:37.507372Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:37.607711Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:37.607728Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:37.607730Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:37.708064Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:37.708079Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:37.708082Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:37.808387Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:37.808408Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:37.808410Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:37.908761Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:37.908774Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:37.908776Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:38.009108Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:38.009133Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:38.009137Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:38.109481Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:38.109495Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:38.109505Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:38.209821Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:38.209838Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:38.209841Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:38.310208Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:38.310224Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:38.310227Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:38.410496Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:38.410514Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:38.410517Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:38.510873Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:38.510889Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:38.510892Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:38.611235Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:38.611254Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:38.611257Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:38.711570Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:38.711590Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:38.711594Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:38.811892Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:38.811906Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:38.811909Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:38.912283Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:38.912301Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:38.912303Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:39.012634Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:39.012649Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:39.012651Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:39.112981Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:39.112994Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:39.112997Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:39.213309Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:39.213325Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:39.213328Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:39.313672Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:39.313685Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:39.313688Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:39.414043Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:39.414073Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:39.414075Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:39.514398Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:39.514417Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:39.514420Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:39.614745Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:39.614766Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:39.614768Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:39.715124Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:39.715140Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:39.715144Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:39.815486Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:39.815500Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:39.815502Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:39.915756Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:39.915771Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:39.915773Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:40.016150Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:40.016173Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:40.016176Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:40.078142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:31:40.116520Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:40.116539Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:40.116541Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:40.216859Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:40.216872Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:40.216875Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:40.317206Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:40.317220Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:40.317222Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
>>> Ready to answer: err
2025-10-10T14:31:40.327935Z :ERROR: [/Root] OnFederationDiscovery: Got error. Status: TRANSPORT_UNAVAILABLE. Description: [ { <main>: Error: GRpc error: (14): mock 'unavailable' } { <main>: Error: Grpc error response on endpoint localhost:24463 } ]
2025-10-10T14:31:40.417558Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:40.417572Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:40.417574Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:40.517891Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:40.517905Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:40.517907Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:40.618257Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:40.618270Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:40.618273Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:40.718596Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:40.718612Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:40.718615Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:40.818967Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:40.818983Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:40.818985Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:40.919331Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:40.919349Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:40.919353Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:41.019687Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:41.019705Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:41.019708Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:41.119979Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:41.119995Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:41.119998Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:41.220393Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:41.220410Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:41.220413Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:41.320734Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:41.320749Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:41.320751Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:41.421076Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:41.421090Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:41.421093Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:41.521404Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:41.521422Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:41.521425Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:41.621785Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:41.621801Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:41.621805Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:41.722158Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:41.722175Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:41.722178Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:41.822477Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:41.822492Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:41.822494Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:41.922839Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:41.922856Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:41.922859Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:42.023184Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:42.023201Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:42.023203Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:42.123548Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:42.123564Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:42.123566Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:42.223924Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:42.223942Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:42.223944Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:42.324252Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:42.324269Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:42.324272Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:42.424578Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:42.424596Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:42.424599Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:42.524960Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:42.524978Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:42.524981Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:42.625318Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:42.625346Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:42.625350Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:42.725613Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:42.725625Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:42.725627Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:42.826003Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:42.826019Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:42.826022Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:42.926382Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:42.926401Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:42.926404Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:43.026713Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:43.026732Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:43.026736Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:43.127068Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:43.127087Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:43.127090Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:43.227417Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:43.227431Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:43.227444Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:43.327767Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:43.327780Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:43.327783Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:43.428119Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:43.428133Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:43.428135Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:43.528470Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:43.528487Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:43.528490Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:43.628837Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:43.628852Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:43.628855Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:43.729170Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:43.729185Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:43.729188Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:43.829532Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:43.829550Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:43.829553Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:43.929888Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:43.929903Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:43.929905Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:44.030223Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:44.030243Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:44.030247Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:44.130583Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:44.130598Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:44.130600Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:44.230943Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:44.230960Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:44.230963Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:44.331284Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:44.331298Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:44.331300Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:44.431633Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:44.431647Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:44.431649Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:44.531991Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:44.532005Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:44.532007Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:44.632315Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:44.632329Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:44.632331Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:44.732715Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:44.732733Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:44.732736Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:44.833038Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:44.833057Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:44.833060Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:44.933417Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:44.933434Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:44.933437Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:45.033742Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:45.033759Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:45.033761Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:45.078386Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:31:45.134117Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:45.134132Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:45.134134Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:45.234473Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:45.234489Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:45.234492Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:45.334816Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:45.334843Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:45.334847Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:45.435211Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:45.435227Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:45.435231Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:45.535520Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:45.535545Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:45.535548Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:45.635858Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:45.635873Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:45.635875Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:45.736222Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:45.736236Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:45.736239Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:45.836567Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:45.836584Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:45.836587Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:45.936919Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:45.936934Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:45.936937Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:46.037262Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:46.037278Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:46.037280Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:46.137582Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:46.137598Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:46.137601Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:46.237985Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:46.238000Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:46.238003Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:46.338333Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:46.338363Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:46.338366Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:46.438685Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:46.438703Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:46.438706Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:46.539025Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:46.539046Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:46.539048Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:46.639365Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:46.639379Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:46.639382Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:46.739737Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:46.739754Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:46.739756Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:46.840067Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:46.840085Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:46.840089Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:46.940446Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:46.940461Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:46.940463Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:47.040752Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:47.040767Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:47.040769Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:47.141142Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:47.141157Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:47.141159Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:47.241473Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:47.241487Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:47.241490Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:47.341846Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:47.341864Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:47.341866Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:47.442188Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:47.442206Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:47.442209Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:47.542517Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:47.542534Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:47.542536Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:47.642892Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:47.642906Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:47.642907Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:47.743254Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:47.743268Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:47.743270Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:47.843590Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:47.843606Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:47.843609Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:47.943959Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:47.943980Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:47.943983Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:48.044292Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:48.044306Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:48.044308Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:48.144660Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:48.144672Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:48.144674Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:48.244971Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:48.244989Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:48.244992Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:48.345376Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:48.345394Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:48.345397Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:48.445725Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:48.445740Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:48.445743Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:48.546071Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:48.546085Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:48.546087Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:48.646435Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:48.646456Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:48.646458Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
>>> Ready to answer: ok
2025-10-10T14:31:48.746770Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:48.746786Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:48.746788Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:48.847135Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:48.847152Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:48.847154Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:48.947499Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:48.947516Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:48.947519Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:49.047822Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:49.047846Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:49.047848Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:49.148195Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:49.148213Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:49.148216Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:49.248527Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:49.248541Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:49.248553Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:49.348832Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:49.348848Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:49.348850Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:49.449220Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:49.449235Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:49.449238Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:49.549605Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:49.549619Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:49.549621Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:49.649960Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:49.649977Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:49.649980Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:49.750304Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:49.750319Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:49.750321Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:49.850646Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:49.850666Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:49.850668Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:49.951008Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:49.951025Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:49.951028Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:50.051363Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:50.051379Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:50.051381Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:50.078510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:31:50.151703Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:50.151730Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:50.151732Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:50.252052Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:50.252066Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:50.252069Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:50.352373Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:50.352386Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:50.352388Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:50.452741Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:50.452756Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:50.452758Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:50.553109Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:50.553122Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:50.553124Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:50.653469Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:50.653483Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:50.653486Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:50.753777Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:50.753791Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:50.753793Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:50.854153Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:50.854166Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:50.854168Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:50.954513Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:50.954529Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:50.954531Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:51.054865Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:51.054888Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:51.054890Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:51.155221Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:51.155243Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:51.155246Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:51.255573Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:51.255588Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:51.255591Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:51.355906Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:51.355925Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:51.355928Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:51.456265Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:51.456281Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:51.456283Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:51.556616Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:51.556631Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:51.556634Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:51.656980Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:51.656995Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:51.656998Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:51.757322Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:51.757347Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:51.757349Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:51.857704Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:51.857717Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:51.857719Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:51.958036Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:51.958051Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:51.958053Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:52.058371Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:52.058384Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:52.058386Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:52.158742Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:52.158759Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:52.158761Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:52.259036Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:52.259049Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:52.259051Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:52.359448Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:52.359464Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:52.359466Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:52.459744Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:52.459768Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:52.459771Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:52.560134Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:52.560151Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:52.560155Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:52.660499Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:52.660518Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:52.660522Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:52.760833Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:52.760861Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:52.760864Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:52.861196Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:52.861207Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:52.861209Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:52.961571Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:52.961585Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:52.961587Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:53.061847Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:53.061862Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:53.061872Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:53.162207Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:53.162229Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:53.162232Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:53.262595Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:53.262615Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:53.262617Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:53.362980Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:53.362996Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:53.362999Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:53.463305Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:53.463317Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:53.463319Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:53.563664Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:53.563679Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:53.563681Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:53.664021Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:53.664037Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:53.664039Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:53.764358Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:53.764374Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:53.764376Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:53.864710Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:53.864723Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:53.864724Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:53.965093Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:53.965111Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:53.965115Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:54.065418Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:54.065433Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:54.065435Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:54.165789Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:54.165805Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:54.165808Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:54.266104Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:54.266121Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:54.266124Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:54.366495Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:54.366514Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:54.366516Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:54.466814Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:54.466829Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:54.466831Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:54.567187Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:54.567204Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:54.567208Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:54.667584Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:54.667601Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:54.667605Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:54.767888Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:54.767903Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:54.767906Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:54.868269Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:54.868286Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:54.868288Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:54.968610Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:54.968630Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:54.968634Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:55.068970Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:55.068986Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:55.068988Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:55.078769Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:31:55.169314Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:55.169327Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:55.169340Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:55.269663Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:55.269692Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:55.269697Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:55.370011Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:55.370026Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:55.370028Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:55.470343Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:55.470363Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:55.470365Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:55.570705Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:55.570719Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:55.570722Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:55.671043Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:55.671059Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:55.671061Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:55.771422Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:55.771439Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:55.771442Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:55.871777Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:55.871798Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:55.871800Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:55.972124Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:55.972141Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:55.972144Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:56.072439Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:56.072456Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:56.072459Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:56.172827Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:56.172844Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:56.172847Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:56.273175Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:56.273190Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:56.273193Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:56.373534Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:56.373551Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:56.373553Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:56.473862Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:56.473885Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:56.473887Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:56.574230Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:56.574252Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:56.574254Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:56.674597Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:56.674613Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:56.674616Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:56.774924Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:56.774939Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:56.774941Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:56.875244Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:56.875259Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:56.875261Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:56.975626Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:56.975642Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:56.975644Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:57.075973Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:57.075987Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:57.075989Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:57.176362Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:57.176383Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:57.176386Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:57.276694Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:57.276710Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:57.276713Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:57.377000Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:57.377014Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:57.377016Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:57.477403Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:57.477417Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:57.477419Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:57.577752Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:57.577767Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:57.577769Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:57.678101Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:57.678124Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:57.678127Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:57.778459Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:57.778478Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:57.778480Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:57.878780Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:57.878849Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:57.878852Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:57.979148Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:57.979162Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:57.979163Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:58.079488Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:58.079523Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:58.079525Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:58.179853Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:58.179875Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:58.179877Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:58.280236Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:58.280256Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:58.280258Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:58.380559Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:58.380579Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:58.380581Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:58.480914Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:58.480935Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:58.480937Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:58.581252Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:58.581265Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:58.581268Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:58.681595Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:58.681608Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:58.681610Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:58.781958Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:58.781970Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:58.781973Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:58.882364Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:58.882387Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:58.882389Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:58.982674Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:58.982690Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:58.982693Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:59.083030Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:59.083046Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:59.083050Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:59.183396Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:59.183410Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:59.183412Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:59.283697Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:59.283710Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:59.283713Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:59.384080Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:59.384095Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:59.384099Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:59.484430Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:59.484443Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:59.484446Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:59.584776Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:59.584789Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:59.584791Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:59.685136Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:59.685149Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:59.685152Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:59.785491Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:59.785507Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:59.785510Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:59.885834Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:59.885848Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:59.885850Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:59.986198Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:59.986213Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:59.986216Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:00.071138Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:155: [72075186224037893][rt3.dc1--test-topic] TPersQueueReadBalancer::HandleWakeup
2025-10-10T14:32:00.071173Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 2
2025-10-10T14:32:00.071387Z node 2 :PERSQUEUE DEBUG: partition.cpp:1000: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 0 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-10-10T14:32:00.071636Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 9 Generation: 1 StatsReportRound: 2 DataSize: 0 UsedReserveSize: 0
2025-10-10T14:32:00.071678Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-10-10T14:32:00.078882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:32:00.086535Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:00.086547Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:00.086549Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:00.186918Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:00.186936Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:00.186938Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:00.287294Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:00.287330Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:00.287335Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:00.387616Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:00.387631Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:00.387633Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:00.487923Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:00.487942Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:00.487944Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:00.588316Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:00.588334Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:00.588338Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:00.688676Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:00.688695Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:00.688698Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:00.789034Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:00.789053Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:00.789057Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:00.889378Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:00.889396Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:00.889399Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:00.989749Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:00.989769Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:00.989772Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:01.090077Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:01.090096Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:01.090099Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:01.190448Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:01.190465Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:01.190467Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:01.290786Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:01.290803Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:01.290806Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:01.391125Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:01.391149Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:01.391153Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:01.491471Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:01.491489Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:01.491492Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:01.591832Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:01.591850Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:01.591853Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:01.692184Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:01.692207Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:01.692211Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:01.792531Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:01.792549Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:01.792552Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:01.892888Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:01.892907Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:01.892910Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:01.993252Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:01.993270Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:01.993272Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:02.093546Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:02.093562Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:02.093564Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:02.193907Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:02.193925Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:02.193927Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:02.294301Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:02.294316Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:02.294318Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:02.394654Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:02.394673Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:02.394675Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:02.495032Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:02.495059Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:02.495063Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:02.595348Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:02.595364Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:02.595368Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:02.695724Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:02.695739Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:02.695742Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:02.796051Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:02.796076Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:02.796079Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:02.896407Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:02.896427Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:02.896430Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:02.996775Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:02.996792Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:02.996794Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:03.097122Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:03.097140Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:03.097142Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:03.197476Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:03.197492Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:03.197494Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:03.297827Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:03.297842Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:03.297844Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:03.398157Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:03.398176Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:03.398178Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:03.498508Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:03.498525Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:03.498527Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:03.598864Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:03.598883Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:03.598887Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:03.699219Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:03.699235Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:03.699238Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:03.799576Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:03.799598Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:03.799601Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:03.899927Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:03.899945Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:03.899948Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:04.000301Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:04.000327Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:04.000330Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:04.100639Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:04.100655Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:04.100657Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:04.200975Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:04.200990Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:04.200992Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:04.301358Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:04.301377Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:04.301380Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:04.401697Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:04.401714Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:04.401716Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:04.502037Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:04.502052Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:04.502055Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:04.602394Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:04.602411Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:04.602421Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:04.702756Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:04.702785Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:04.702789Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:04.803077Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:04.803092Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:04.803094Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:04.903446Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:04.903462Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:04.903465Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:05.003794Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:05.003808Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:05.003811Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:05.079138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:32:05.104126Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:05.104142Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:05.104144Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:05.204489Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:05.204513Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:05.204516Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:05.304888Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:05.304904Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:05.304907Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:05.405206Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:05.405220Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:05.405222Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:05.505560Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:05.505577Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:05.505580Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:05.605903Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:05.605919Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:05.605922Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:05.706259Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:05.706276Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:05.706278Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:05.806621Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:05.806637Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:05.806640Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:05.906965Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:05.906981Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:05.906984Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:06.007328Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:06.007347Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:06.007349Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:06.107659Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:06.107677Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:06.107680Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:06.208007Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:06.208022Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:06.208025Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:06.308369Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:06.308384Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:06.308386Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:06.408724Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:06.408741Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:06.408743Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:06.509066Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:06.509079Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:06.509081Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:06.609434Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:06.609449Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:06.609452Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:06.709772Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:06.709789Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:06.709792Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:06.810121Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:06.810142Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:06.810145Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:06.910495Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:06.910512Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:06.910514Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:07.010836Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:07.010854Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:07.010858Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:07.111168Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:07.111192Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:07.111194Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:07.211542Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:07.211557Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:07.211560Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:07.311890Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:07.311910Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:07.311914Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:07.412255Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:07.412272Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:07.412276Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:07.512591Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:07.512610Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:07.512614Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:07.612937Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:07.612954Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:07.612957Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:07.713309Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:07.713324Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:07.713336Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:07.813623Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:07.813637Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:07.813639Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:07.914017Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:07.914035Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:07.914037Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:08.014310Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:08.014328Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:08.014330Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:08.114703Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:08.114720Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:08.114723Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:08.215065Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:08.215085Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:08.215088Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:08.315416Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:08.315431Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:08.315434Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:08.415773Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:08.415790Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:08.415793Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:08.516082Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:08.516096Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:08.516099Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:08.616465Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:08.616482Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:08.616485Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:08.716826Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:08.716843Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:08.716845Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:08.817180Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:08.817195Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:08.817198Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:08.917531Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:08.917548Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:08.917551Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:09.017895Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:09.017912Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:09.017916Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:09.118218Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:09.118235Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:09.118237Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:09.218596Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:09.218623Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:09.218625Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:09.318927Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:09.318942Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:09.318944Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:09.419277Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:09.419291Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:09.419293Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:09.519625Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:09.519640Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:09.519642Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:09.619991Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:09.620007Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:09.620010Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:09.720322Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:09.720337Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:09.720340Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:09.820669Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:09.820683Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:09.820686Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:09.921064Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:09.921085Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:09.921089Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:10.021404Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:10.021420Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:10.021424Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:10.079284Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:32:10.121739Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:10.121754Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:10.121758Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:10.222093Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:10.222109Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:10.222113Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:10.322440Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:10.322458Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:10.322461Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:10.422802Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:10.422819Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:10.422822Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:10.523159Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:10.523175Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:10.523178Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:10.623526Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:10.623545Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:10.623548Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:10.723865Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:10.723884Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:10.723888Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:10.824209Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:10.824226Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:10.824229Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:10.924551Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:10.924568Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:10.924581Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:11.024935Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:11.024955Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:11.024959Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:11.125286Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:11.125304Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:11.125307Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:11.225620Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:11.225637Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:11.225640Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:11.325973Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:11.325990Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:11.325993Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:11.426320Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:11.426339Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:11.426342Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:11.526685Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:11.526704Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:11.526707Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:11.627038Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:11.627056Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:11.627059Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:11.727395Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:11.727414Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:11.727418Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:11.827737Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:11.827757Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:11.827760Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:11.928100Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:11.928120Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:11.928124Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:12.028465Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:12.028486Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:12.028490Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:12.128776Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:12.128792Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:12.128795Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:12.229168Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:12.229188Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:12.229191Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:12.329486Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:12.329505Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:12.329508Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:12.429844Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:12.429859Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:12.429862Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:12.530188Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:12.530206Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:12.530207Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:12.630542Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:12.630561Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:12.630563Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:12.730900Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:12.730918Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:12.730920Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:12.831233Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:12.831252Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:12.831255Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:12.931605Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:12.931620Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:12.931622Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:13.031960Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:13.031978Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:13.031981Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:13.132307Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:13.132334Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:13.132337Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:13.232622Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:13.232637Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:13.232640Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:13.333025Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:13.333039Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:13.333042Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:13.433377Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:13.433397Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:13.433400Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:13.533720Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:13.533734Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:13.533737Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:13.634074Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:13.634089Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:13.634091Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:13.734418Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:13.734432Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:13.734435Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:13.834767Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:13.834783Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:13.834785Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:13.935133Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:13.935149Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:13.935153Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:14.035504Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:14.035521Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:14.035523Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:14.135840Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:14.135862Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:14.135866Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:14.236188Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:14.236208Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:14.236210Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:14.336547Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:14.336563Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:14.336566Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:14.436889Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:14.436906Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:14.436909Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:14.537227Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:14.537248Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:14.537251Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:14.637598Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:14.637615Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:14.637618Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:14.737954Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:14.737971Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:14.737974Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:14.838302Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:14.838332Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:14.838335Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:14.938641Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:14.938657Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:14.938667Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:15.039005Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:15.039024Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:15.039026Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:15.079435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:32:15.139362Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:15.139379Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:15.139381Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:15.239700Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:15.239716Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:15.239718Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:15.340017Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:15.340038Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:15.340040Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:15.440401Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:15.440416Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:15.440418Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:15.540749Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:15.540763Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:15.540765Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:15.641102Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:15.641120Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:15.641123Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:15.741425Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:15.741438Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:15.741441Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:15.841805Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:15.841821Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:15.841824Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:15.942153Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:15.942165Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:15.942167Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:16.042501Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:16.042517Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:16.042520Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:16.142869Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:16.142882Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:16.142885Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:16.243228Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:16.243242Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:16.243245Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:16.343567Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:16.343578Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:16.343587Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:16.443920Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:16.443933Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:16.443935Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:16.544234Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:16.544250Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:16.544252Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:16.644627Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:16.644639Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:16.644641Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:16.744982Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:16.744997Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:16.744999Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:16.845313Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:16.845328Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:16.845345Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:16.945666Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:16.945680Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:16.945682Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:17.046038Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:17.046051Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:17.046053Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:17.146381Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:17.146404Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:17.146407Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:17.246749Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:17.246762Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:17.246764Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:17.347084Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:17.347100Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:17.347102Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:17.447424Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:17.447439Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:17.447441Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:17.547771Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:17.547783Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:17.547785Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:17.648140Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:17.648154Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:17.648162Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:17.748513Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:17.748527Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:17.748530Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:17.848846Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:17.848858Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:17.848861Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:17.949181Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:17.949194Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:17.949196Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:18.049557Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:18.049573Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:18.049575Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:18.149888Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:18.149908Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:18.149910Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:18.250224Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:18.250238Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:18.250240Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:18.350611Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:18.350625Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:18.350627Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:18.450956Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:18.450970Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:18.450972Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:18.551272Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:18.551286Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:18.551288Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:18.651643Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:18.651656Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:18.651658Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
>>> Ready to answer: err
2025-10-10T14:32:18.721974Z :ERROR: [/Root] OnFederationDiscovery: Got error. Status: TRANSPORT_UNAVAILABLE. Description: [ { <main>: Error: GRpc error: (14): mock 'unavailable' } { <main>: Error: Grpc error response on endpoint localhost:24463 } ]
2025-10-10T14:32:18.752015Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:18.752031Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:18.752033Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:18.852345Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:18.852366Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:18.852368Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:18.952679Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:18.952692Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:18.952694Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:19.053088Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:19.053106Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:19.053109Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:19.153436Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:19.153453Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:19.153456Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:19.253795Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:19.253811Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:19.253814Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:19.354137Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:19.354151Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:19.354154Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:19.454464Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:19.454477Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:19.454479Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:19.554809Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:19.554821Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:19.554824Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:19.655223Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:19.655243Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:19.655245Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:19.755548Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:19.755565Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:19.755568Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:19.855908Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:19.855926Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:19.855929Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:19.956237Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:19.956251Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:19.956254Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:20.056548Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:20.056558Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:20.056560Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:20.079657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:32:20.156959Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:20.156980Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:20.156983Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:20.257302Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:20.257323Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:20.257325Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:20.357637Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:20.357659Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:20.357662Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:20.458008Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:20.458027Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:20.458030Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:20.558333Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:20.558347Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:20.558350Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:20.658702Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:20.658727Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:20.658730Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:20.759074Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:20.759090Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:20.759093Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:20.859407Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:20.859428Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:20.859431Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:20.959757Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:20.959772Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:20.959774Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:21.060061Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:21.060073Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:21.060076Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:21.160465Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:21.160479Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:21.160481Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:21.260808Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:21.260824Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:21.260827Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:21.361166Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:21.361181Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:21.361184Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:21.461516Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:21.461532Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:21.461535Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:21.561872Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:21.561885Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:21.561888Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:21.662231Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:21.662253Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:21.662256Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:21.762554Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:21.762567Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:21.762569Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:21.862935Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:21.862952Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:21.862955Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:21.963292Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:21.963305Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:21.963307Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:22.063630Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:22.063645Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:22.063647Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:22.163993Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:22.164009Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:22.164012Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:22.264320Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:22.264337Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:22.264339Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:22.364682Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:22.364695Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:22.364697Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:22.465002Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:22.465017Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:22.465019Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:22.565364Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:22.565376Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:22.565378Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:22.665715Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:22.665729Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:22.665732Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:22.766083Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:22.766097Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:22.766100Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:22.866439Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:22.866454Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:22.866456Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:22.966801Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:22.966817Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:22.966819Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:23.067156Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:23.067170Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:23.067173Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:23.167517Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:23.167531Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:23.167534Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:23.267852Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:23.267865Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:23.267867Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:23.368214Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:23.368228Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:23.368230Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:23.468556Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:23.468570Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:23.468572Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:23.568908Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:23.568929Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:23.568931Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:23.669267Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:23.669280Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:23.669282Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:23.769633Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:23.769652Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:23.769655Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:23.869975Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:23.869989Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:23.869991Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:23.970329Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:23.970346Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:23.970349Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:24.070676Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:24.070687Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:24.070690Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:24.170999Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:24.171027Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:24.171029Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:24.271339Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:24.271354Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:24.271356Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:24.371731Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:24.371746Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:24.371749Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:24.472043Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:24.472055Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:24.472058Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:24.572428Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:24.572443Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:24.572446Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:24.672793Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:24.672808Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:24.672811Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:24.773132Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:24.773145Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:24.773148Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:24.873486Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:24.873497Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:24.873500Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:24.974008Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:24.974023Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:24.974025Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:25.074189Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:25.074206Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:25.074208Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:25.079836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:32:25.174554Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:25.174571Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:25.174574Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:25.274897Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:25.274917Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:25.274919Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:25.375242Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:25.375258Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:25.375261Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:25.475619Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:25.475636Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:25.475638Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:25.575950Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:25.575965Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:25.575967Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:25.676307Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:25.676326Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:25.676328Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:25.776652Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:25.776669Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:25.776672Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:25.877004Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:25.877020Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:25.877023Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:25.977355Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:25.977369Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:25.977371Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:26.077684Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:26.077696Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:26.077697Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
>>> Ready to answer: ok
2025-10-10T14:32:26.178070Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:26.178086Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:26.178089Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:26.278397Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:26.278414Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:26.278416Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:26.614106Z :RecreateObserver INFO: Random seed for debugging is 1760106746614102
2025-10-10T14:32:26.677854Z node 3 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[3:7559600915422491016:2153];send_to=[0:7307199536658146131:7762515];
2025-10-10T14:32:26.677895Z node 3 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-10-10T14:32:26.679178Z node 4 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[4:7559600913547695992:2155];send_to=[0:7307199536658146131:7762515];
test_client.cpp: SetPath # /home/runner/.ya/build/build_root/z96o/002b7b/r3tmp/tmp3AsEJR/pdisk_1.dat
2025-10-10T14:32:26.679802Z node 3 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-10-10T14:32:26.680617Z node 3 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-10T14:32:26.681063Z node 4 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-10-10T14:32:26.681145Z node 4 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-10-10T14:32:26.681356Z node 4 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-10T14:32:26.691432Z node 3 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-10-10T14:32:26.691477Z node 4 :CONFIGS_DISPATCHER ERROR: configs_dispatcher.cpp:1229: Notification cookie mismatch for subscription [4:7559600913547695864:2073] 1760106746678530 != 1760106746678527
2025-10-10T14:32:26.694716Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(4, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-10T14:32:26.694732Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(4, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-10T14:32:26.695862Z node 3 :HIVE WARN: hive_impl.cpp:811: HIVE#72057594037968897 Handle TEvInterconnect::TEvNodeConnected, NodeId 4 Cookie 4
2025-10-10T14:32:26.696091Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(4, (0,0,0,0)) VolatileState: Connecting -> Connected
TServer::EnableGrpc on GrpcPort 23761, node 3
2025-10-10T14:32:26.701321Z node 3 :NET_CLASSIFIER WARN: net_classifier.cpp:190: distributable config is empty, broken or outdated, will use file: /home/runner/.ya/build/build_root/z96o/002b7b/r3tmp/yandex5MDC8S.tmp
2025-10-10T14:32:26.701344Z node 3 :NET_CLASSIFIER WARN: net_classifier.cpp:196: will try to initialize from file: /home/runner/.ya/build/build_root/z96o/002b7b/r3tmp/yandex5MDC8S.tmp
2025-10-10T14:32:26.701402Z node 3 :NET_CLASSIFIER WARN: net_classifier.cpp:202: successfully initialized from file: /home/runner/.ya/build/build_root/z96o/002b7b/r3tmp/yandex5MDC8S.tmp
2025-10-10T14:32:26.701437Z node 3 :NET_CLASSIFIER ERROR: net_classifier.cpp:228: got bad distributable configuration
2025-10-10T14:32:26.704114Z INFO: TTestServer started on Port 29133 GrpcPort 23761
TClient is connected to server localhost:29133
PQClient connected to localhost:23761
WaitRootIsUp 'Root'...
TClient::Ls request: Root
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "Root"
    PathId: 1
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 1
    CreateStep: 0
    ParentPathId: 1
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 1
      SubDomainVersion: 0
      SecurityStateVersion: 0
    }
    ChildrenExist: false
  }
  Children {
    Name: ".sys"
    PathId: 18446744073709551615
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 0
    CreateStep: 0
    ParentPathId: 18446744073709551615
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 0
      Pl...
(TRUNCATED)
WaitRootIsUp 'Root' success.
2025-10-10T14:32:26.717512Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpAlterSubDomain, opId: 281474976715657:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_alter_subdomain.cpp:311)
waiting...
waiting...
waiting...
waiting...
2025-10-10T14:32:26.779342Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(3, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-10T14:32:26.779372Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(3, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-10T14:32:26.780906Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(3, (0,0,0,0)) VolatileState: Connecting -> Connected
2025-10-10T14:32:26.892780Z node 4 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-10-10T14:32:26.955561Z node 3 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-10-10T14:32:26.972238Z node 3 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:566: Compilation failed, self: [3:7559600915422491820:2318], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-10T14:32:26.972570Z node 3 :KQP_SESSION WARN: kqp_session_actor.cpp:2408: SessionId: ydb://session/3?node_id=3&id=YWQ2YzVlNTMtNWZiYTZkNjUtMTYwZDZkOWItYjEwYmQ1MGM=, ActorId: [3:7559600915422491817:2316], ActorState: ExecuteState, TraceId: 01k778k52rdsmcz3bv6rpha3y2, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-10T14:32:26.972682Z node 3 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-10-10T14:32:26.974599Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715661:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-10T14:32:26.987760Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715662:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-10T14:32:26.998915Z node 4 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:566: Compilation failed, self: [4:7559600913547696237:2291], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:5:17: Error: At function: KiReadTable!
        <main>:5:17: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Versions]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-10T14:32:26.998978Z node 4 :KQP_SESSION WARN: kqp_session_actor.cpp:2408: SessionId: ydb://session/3?node_id=4&id=Zjk5MGIxZDQtODBkMmVjMjYtZDk3MGZjOTEtNWIzZjZkYzQ=, ActorId: [4:7559600913547696233:2290], ActorState: ExecuteState, TraceId: 01k778k53j76rk59htmwqpdnyn, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-10T14:32:26.999084Z node 4 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 5 column: 17 } message: "At function: KiReadTable!" end_position { row: 5 column: 17 } severity: 1 issues { position { row: 5 column: 17 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Versions]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 5 column: 17 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-10-10T14:32:27.009350Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715663:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
=== Init DC: UPSERT INTO `/Root/PQ/Config/V2/Cluster` (name, balancer, local, enabled, weight) VALUES ("dc1", "localhost:23761", true, true, 1000), ("dc2", "dc2.logbroker.yandex.net", false, false, 1000);
2025-10-10T14:32:27.043338Z node 3 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976715664. Ctx: { TraceId: 01k778k54f0afd8bahg2grxskx, Database: , SessionId: ydb://session/3?node_id=3&id=Nzg2OTUxMmEtZjYzMGMzM2ItNzE0MTRmNmYtYzhlZmZiYjc=, PoolId: , DatabaseId: /Root}. Database not set, use /Root
=== CheckClustersList. Subcribe to ClusterTracker from [3:7559600919717459544:2919] 
2025-10-10T14:32:27.679765Z node 3 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-10-10T14:32:27.680801Z node 4 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-10-10T14:32:31.677996Z node 3 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[3:7559600915422491016:2153];send_to=[0:7307199536658146131:7762515];
2025-10-10T14:32:31.678033Z node 3 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
2025-10-10T14:32:31.679463Z node 4 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[4:7559600913547695992:2155];send_to=[0:7307199536658146131:7762515];
2025-10-10T14:32:31.679489Z node 4 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
=== CheckClustersList. Ok
2025-10-10T14:32:32.157110Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715676:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
waiting...
PQ Client: create topic: rt3.dc1--test-topic with 1 partitions
CallPersQueueGRPC request to localhost:23761
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-10T14:32:32.170777Z node 3 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
CallPersQueueGRPC request to localhost:23761
MetaRequest {
  CmdCreateTopic {
    Topic: "rt3.dc1--test-topic"
    NumPartitions: 1
    Config {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
  }
}
CallPersQueueGRPC response:
Status: 129
ProxyErrorCode: 53
SchemeStatus: 1
FlatTxId {
  TxId: 281474976715677
  SchemeShardTabletId: 72057594046644480
  PathId: 9
}
ErrorCode: OK
AddTopic: rt3.dc1--test-topic
===Run query:``DECLARE $version as Int64; DECLARE $path AS Utf8; DECLARE $cluster as Utf8; UPSERT INTO `/Root/PQ/Config/V2/Topics` (path, dc) VALUES ($path, $cluster); UPSERT INTO `/Root/PQ/Config/V2/Versions` (name, version) VALUES ("Topics", $version);`` with topic = test-topic, dc = dc1
2025-10-10T14:32:32.175991Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:32.176323Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:32.176371Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:784: [PQ: 72075186224037892] no config, start with empty partitions and default config
2025-10-10T14:32:32.176384Z node 3 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:32.176397Z node 3 :PERSQUEUE INFO: pq_impl.cpp:609: [PQ: 72075186224037892] doesn't have tx writes info
2025-10-10T14:32:32.176406Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][] pipe [3:7559600941192296591:3242] connected; active server actors: 1
2025-10-10T14:32:32.176535Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [3:7559600941192296590:3241], now have 1 active actors on pipe
2025-10-10T14:32:32.176593Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1517: [72075186224037893][rt3.dc1--test-topic] updating configuration. Deleted partitions []. Added partitions [0]
2025-10-10T14:32:32.176749Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:940: [72075186224037893][rt3.dc1--test-topic] Discovered subdomain [OwnerId: 72057594046644480, LocalPathId: 1] state, outOfSpace = 0 at RB 72075186224037893
2025-10-10T14:32:32.176767Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-10T14:32:32.177016Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [4:7559600939317500404:2371], now have 1 active actors on pipe
2025-10-10T14:32:32.177034Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 3, Generation 1
2025-10-10T14:32:32.177063Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:138: [72075186224037893][rt3.dc1--test-topic] BALANCER INIT DONE for rt3.dc1--test-topic: (0, 72075186224037892) 
2025-10-10T14:32:32.177527Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-10T14:32:32.179681Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [3:7559600941192296662:3296], now have 1 active actors on pipe
2025-10-10T14:32:32.179758Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-10T14:32:32.180391Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-10T14:32:32.180537Z node 3 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:32.180553Z node 3 :PERSQUEUE DEBUG: partition.cpp:1277: [72075186224037892][Partition][0][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-10-10T14:32:32.180591Z node 3 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:32.180621Z node 3 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [3:7559600941192296673:2448]
2025-10-10T14:32:32.181122Z node 3 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:32.181128Z node 3 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:32.181133Z node 3 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1 [3:7559600941192296673:2448]
2025-10-10T14:32:32.181138Z node 3 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-10-10T14:32:32.181319Z node 3 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 1
2025-10-10T14:32:32.181341Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:32.181354Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:32.181356Z node 3 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:32.181358Z node 3 :PERSQUEUE DEBUG: partition.cpp:2345: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-10T14:32:32.181360Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:32.181361Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:32.181362Z node 3 :PERSQUEUE DEBUG: partition.cpp:2345: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-10T14:32:32.181369Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:32.181424Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-10T14:32:32.181443Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:32:32.182186Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-10T14:32:32.182218Z node 3 :PERSQUEUE DEBUG: partition.cpp:1381: [72075186224037892][Partition][0][StateIdle] Handle TEvPQ::TEvTxCommit Step 1760106752229, TxId 281474976715677
2025-10-10T14:32:32.182225Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:32.182227Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:32.182245Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:32.182288Z node 3 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:32:32.182690Z node 3 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:32:32.182785Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:490: [72075186224037892][Partition][0][StateIdle] Received TPartition::Handle TEvHandleWriteResponse.
2025-10-10T14:32:32.182825Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:32:32.182846Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:32.182847Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:32.182848Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:32.182853Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:32:32.182954Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:395: [PQ: 72075186224037892] Apply new config PartitionConfig { LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 } PartitionIds: 0 TopicName: "rt3.dc1--test-topic" Version: 0 LocalDC: true Codecs { Ids: 0 Ids: 1 Ids: 2 Codecs: "raw" Codecs: "gzip" Codecs: "lzop" } TopicPath: "/Root/PQ/rt3.dc1--test-topic" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } Consumers { Name: "user" ReadFromTimestampsMs: 0 FormatVersion: 0 Version: 0 Generation: 0 } MonitoringProjectId: ""
2025-10-10T14:32:32.182978Z node 3 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:32.183021Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-10T14:32:32.183650Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-10T14:32:32.183674Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-10T14:32:32.184065Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-10T14:32:32.189168Z node 3 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976715678. Ctx: { TraceId: 01k778ka5f5fv00fv7qgjrcbdb, Database: , SessionId: ydb://session/3?node_id=3&id=ZGM2Y2VlZTAtYzkxMGE3NWEtNzQ3Y2NjY2ItNzgxMDRlODY=, PoolId: , DatabaseId: /Root}. Database not set, use /Root
===Query complete
TClient::Ls request: /Root/PQ/rt3.dc1--test-topic
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976715677
    CreateStep: 1760106752229
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: ...
(TRUNCATED)
GetTopicVersionFromPath:  record Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976715677
    CreateStep: 1760106752229
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      YdbDatabasePath: "/Root"
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
    Partitions {
      PartitionId: 0
      TabletId: 72075186224037892
      Status: Active
    }
    AlterVersion: 1
    BalancerTabletID: 72075186224037893
    NextPartitionId: 1
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 1
      PlanResolution: 7
      Coordinators: 72057594046316545
      TimeCastBucketsPerMediator: 2
      Mediators: 72057594046382081
    }
    DomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    PathsInside: 8
    PathsLimit: 10000
    ShardsInside: 6
    ShardsLimit: 200000
    ResourcesDomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    DiskSpaceUsage {
      Tables {
        TotalSize: 0
        DataSize: 0
        IndexSize: 0
      }
      Topics {
        ReserveSize: 0
        AccountSize: 0
        DataSize: 0
        UsedReserveSize: 0
      }
    }
    PQPartitionsInside: 1
    PQPartitionsLimit: 1000000
    SchemeLimits {
      MaxDepth: 32
      MaxPaths: 10000
      MaxChildrenInDir: 100000
      MaxAclBytesSize: 10240
      MaxTableColumns: 200
      MaxTableColumnNameLength: 255
      MaxTableKeyColumns: 30
      MaxTableIndices: 20
      MaxShards: 200000
      MaxShardsInPath: 35000
      MaxConsistentCopyTargets: 10000
      MaxPathElementLength: 255
      ExtraPathSymbolsAllowed: "!\"#$%&\'()*+,-.:;<=>?@[\\]^_`{|}~"
      MaxPQPartitions: 1000000
      MaxTableCdcStreams: 5
      MaxExports: 10
      MaxImports: 10
      MaxColumnTableColumns: 10000
    }
  }
}
Path: "/Root/PQ/rt3.dc1--test-topic"
 name rt3.dc1--test-topic version1
CallPersQueueGRPC request to localhost:23761
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-10T14:32:32.194863Z node 3 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-10-10T14:32:32.281631Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:32.281647Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:32.281649Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:32.381967Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:32.381979Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:32.381982Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:32.482325Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:32.482339Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:32.482341Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:32.582680Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:32.582694Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:32.582696Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:32.683006Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:32.683028Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:32.683031Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:23761
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-10T14:32:32.695992Z node 3 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-10-10T14:32:32.783371Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:32.783384Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:32.783387Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:32.883703Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:32.883715Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:32.883717Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:32.984112Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:32.984133Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:32.984137Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:33.084437Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:33.084455Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:33.084457Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:33.184774Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:33.184787Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:33.184789Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:23761
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-10T14:32:33.197798Z node 3 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--test-topic"
      NumPartitions: 1
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        TopicPath: "/Root/PQ/rt3.dc1--test-topic"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Version: 0
        }
      }
      ErrorCode: OK
    }
  }
}
=== Topic created, have version: 1
2025-10-10T14:32:33.199127Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: try to update token
2025-10-10T14:32:33.199334Z :INFO: [] MessageGroupId [src] SessionId [] Write session: Do CDS request
2025-10-10T14:32:33.199341Z :INFO: [] MessageGroupId [src] SessionId [] Start write session. Will connect to endpoint: localhost:23761
2025-10-10T14:32:33.199703Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src" }
2025-10-10T14:32:33.199803Z node 3 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:33.199813Z node 3 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1
2025-10-10T14:32:33.199907Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src" }
2025-10-10T14:32:33.199934Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1 topic: "test-topic" message_group_id: "src" from ipv6:[::1]:35898
2025-10-10T14:32:33.199937Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:35898 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:33.199940Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:33.200297Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1 sessionId:  describe result for acl check
2025-10-10T14:32:33.200325Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:33.200330Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:33.200331Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:33.200335Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [3:7559600945487264160:2483] (SourceId=src, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:33.200714Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [3:7559600945487264160:2483] (SourceId=src, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:33.216824Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [3:7559600945487264160:2483] (SourceId=src, PreferedPartition=(NULL)) RequestPQRB
2025-10-10T14:32:33.216941Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [3:7559600945487264198:2483] connected; active server actors: 1
2025-10-10T14:32:33.217014Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [3:7559600945487264160:2483] (SourceId=src, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=src
2025-10-10T14:32:33.217022Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [3:7559600945487264160:2483] (SourceId=src, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:33.217124Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [3:7559600945487264198:2483] disconnected; active server actors: 1
2025-10-10T14:32:33.217133Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--test-topic] pipe [3:7559600945487264198:2483] disconnected no session
2025-10-10T14:32:33.236542Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [3:7559600945487264160:2483] (SourceId=src, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:33.236558Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [3:7559600945487264160:2483] (SourceId=src, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-10-10T14:32:33.236561Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [3:7559600945487264160:2483] (SourceId=src, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:33.236571Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:33.236725Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [3:7559600945487264213:2483], now have 1 active actors on pipe
2025-10-10T14:32:33.236733Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 3, Generation: 1
2025-10-10T14:32:33.236739Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:33.236746Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:33.236781Z node 3 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src|b4ee7ea2-e1088497-44878fff-7504ad96_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src
2025-10-10T14:32:33.236797Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:33.236807Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:33.236809Z node 3 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:33.236823Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:33.236845Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:33.236868Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:33.236911Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:33.236920Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:33.236941Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:33.236970Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1 partition: 0 MaxSeqNo: 0 sessionId: src|b4ee7ea2-e1088497-44878fff-7504ad96_0
2025-10-10T14:32:33.237294Z :INFO: [] MessageGroupId [src] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1760106753237 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-10T14:32:33.237325Z :INFO: [] MessageGroupId [src] SessionId [] Write session established. Init response: session_id: "src|b4ee7ea2-e1088497-44878fff-7504ad96_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:33.237425Z :INFO: [] MessageGroupId [src] SessionId [src|b4ee7ea2-e1088497-44878fff-7504ad96_0] Write session: close. Timeout = 0 ms
2025-10-10T14:32:33.237436Z :INFO: [] MessageGroupId [src] SessionId [src|b4ee7ea2-e1088497-44878fff-7504ad96_0] Write session will now close
2025-10-10T14:32:33.237442Z :DEBUG: [] MessageGroupId [src] SessionId [src|b4ee7ea2-e1088497-44878fff-7504ad96_0] Write session: aborting
2025-10-10T14:32:33.237585Z :INFO: [] MessageGroupId [src] SessionId [src|b4ee7ea2-e1088497-44878fff-7504ad96_0] Write session: gracefully shut down, all writes complete
2025-10-10T14:32:33.237590Z :DEBUG: [] MessageGroupId [src] SessionId [src|b4ee7ea2-e1088497-44878fff-7504ad96_0] Write session: destroy
2025-10-10T14:32:33.237780Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId: src|b4ee7ea2-e1088497-44878fff-7504ad96_0 grpc read done: success: 0 data: 
2025-10-10T14:32:33.237787Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 1 sessionId: src|b4ee7ea2-e1088497-44878fff-7504ad96_0 grpc read failed
2025-10-10T14:32:33.237792Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 1 sessionId: src|b4ee7ea2-e1088497-44878fff-7504ad96_0 grpc closed
2025-10-10T14:32:33.237795Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1 sessionId: src|b4ee7ea2-e1088497-44878fff-7504ad96_0 is DEAD
2025-10-10T14:32:33.237969Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-10-10T14:32:33.238012Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [3:7559600945487264213:2483] destroyed
2025-10-10T14:32:33.238023Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-10-10T14:32:33.238028Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:33.238031Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:33.238032Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
Session was created
2025-10-10T14:32:33.285138Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:33.285152Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:33.285154Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:33.385481Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:33.385496Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:33.385499Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:33.485819Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:33.485832Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:33.485835Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:33.586176Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:33.586190Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:33.586192Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:33.686517Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:33.686530Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:33.686536Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:33.786894Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:33.786920Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:33.786923Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:33.887217Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:33.887233Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:33.887236Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:33.987629Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:33.987645Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:33.987648Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:34.087974Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:34.087992Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:34.087995Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:34.188326Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:34.188343Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:34.188345Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
>>> Ready to answer: err
2025-10-10T14:32:34.241094Z :ERROR: [/Root] OnFederationDiscovery: Got error. Status: TRANSPORT_UNAVAILABLE. Description: [ { <main>: Error: GRpc error: (14): mock 'unavailable' } { <main>: Error: Grpc error response on endpoint localhost:16449 } ]
2025-10-10T14:32:34.241119Z :ERROR: [/Root] [] [70bf635d-73c79647-96333f8e-301616d3] Federated state update failed. FederationState: { Status: TRANSPORT_UNAVAILABLE SelfLocation: "" Issues: { [ { <main>: Error: GRpc error: (14): mock 'unavailable' } { <main>: Error: Grpc error response on endpoint localhost:16449 } ] } }
>>> Got event: SessionClosed { Status: TRANSPORT_UNAVAILABLE Issues: "<main>: Error: GRpc error: (14): mock 'unavailable' <main>: Error: Grpc error response on endpoint localhost:16449 " }
Session2 was created
2025-10-10T14:32:34.288665Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:34.288683Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:34.288687Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:34.388996Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:34.389013Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:34.389016Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:34.489377Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:34.489392Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:34.489395Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:34.589735Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:34.589755Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:34.589759Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:34.690051Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:34.690065Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:34.690068Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:34.790424Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:34.790440Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:34.790443Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:34.890796Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:34.890812Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:34.890815Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:34.991131Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:34.991148Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:34.991151Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:35.091474Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:35.091500Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:35.091503Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:35.191865Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:35.191883Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:35.191887Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
>>> Ready to answer: ok
2025-10-10T14:32:35.242039Z :INFO: [/Root] [] [adbe51e0-e03ed151-e67c720f-d510af66] Open read subsessions to databases: { name: dc1, endpoint: localhost:23761, path: /Root }, { name: dc2, endpoint: localhost:23761, path: /Root }, { name: dc3, endpoint: localhost:23761, path: /Root }
2025-10-10T14:32:35.244034Z :INFO: [/Root] [/Root] [b176c526-ac883f69-cfb8d472-1ce343bd] Starting read session
2025-10-10T14:32:35.244051Z :DEBUG: [/Root] [/Root] [b176c526-ac883f69-cfb8d472-1ce343bd] Starting single session
2025-10-10T14:32:35.244250Z :DEBUG: [/Root] [/Root] [b176c526-ac883f69-cfb8d472-1ce343bd] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-10T14:32:35.244256Z :DEBUG: [/Root] [/Root] [b176c526-ac883f69-cfb8d472-1ce343bd] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-10T14:32:35.244261Z :DEBUG: [/Root] [/Root] [b176c526-ac883f69-cfb8d472-1ce343bd] [] Reconnecting session to cluster  in 0.000000s
2025-10-10T14:32:35.244787Z :INFO: [/Root] [/Root] [4f883379-f675477d-362ca85b-ec453d56] Starting read session
2025-10-10T14:32:35.244794Z :DEBUG: [/Root] [/Root] [4f883379-f675477d-362ca85b-ec453d56] Starting single session
2025-10-10T14:32:35.244828Z :DEBUG: [/Root] [/Root] [4f883379-f675477d-362ca85b-ec453d56] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-10T14:32:35.244832Z :DEBUG: [/Root] [/Root] [4f883379-f675477d-362ca85b-ec453d56] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-10T14:32:35.244835Z :DEBUG: [/Root] [/Root] [4f883379-f675477d-362ca85b-ec453d56] [] Reconnecting session to cluster  in 0.000000s
2025-10-10T14:32:35.245012Z :INFO: [/Root] [/Root] [28a94af4-bba8911a-f00b7d60-4f0c6d32] Starting read session
2025-10-10T14:32:35.245022Z :DEBUG: [/Root] [/Root] [28a94af4-bba8911a-f00b7d60-4f0c6d32] Starting single session
2025-10-10T14:32:35.245048Z :DEBUG: [/Root] [/Root] [28a94af4-bba8911a-f00b7d60-4f0c6d32] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-10T14:32:35.245052Z :DEBUG: [/Root] [/Root] [28a94af4-bba8911a-f00b7d60-4f0c6d32] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-10T14:32:35.245056Z :DEBUG: [/Root] [/Root] [28a94af4-bba8911a-f00b7d60-4f0c6d32] [] Reconnecting session to cluster  in 0.000000s
2025-10-10T14:32:35.245271Z :DEBUG: [/Root] [/Root] [28a94af4-bba8911a-f00b7d60-4f0c6d32] [] Successfully connected. Initializing session
2025-10-10T14:32:35.245276Z :DEBUG: [/Root] [/Root] [b176c526-ac883f69-cfb8d472-1ce343bd] [] Successfully connected. Initializing session
2025-10-10T14:32:35.245379Z :DEBUG: [/Root] [/Root] [4f883379-f675477d-362ca85b-ec453d56] [] Successfully connected. Initializing session
2025-10-10T14:32:35.245477Z node 3 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-10T14:32:35.245489Z node 3 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 1
2025-10-10T14:32:35.245521Z node 3 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-10T14:32:35.245522Z node 3 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 2
2025-10-10T14:32:35.245529Z node 3 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-10T14:32:35.245530Z node 3 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 3
2025-10-10T14:32:35.247633Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-10T14:32:35.247647Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 2 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-10T14:32:35.247701Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 1 consumer shared/user session shared/user_3_1_13627327046652139611_v1 read init: from# ipv6:[::1]:54268, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-10T14:32:35.247710Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 2 consumer shared/user session shared/user_3_2_16802720391785094166_v1 read init: from# ipv6:[::1]:54268, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-10T14:32:35.247796Z node 3 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 2 consumer shared/user session shared/user_3_2_16802720391785094166_v1 auth for : user
2025-10-10T14:32:35.247811Z node 3 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 1 consumer shared/user session shared/user_3_1_13627327046652139611_v1 auth for : user
2025-10-10T14:32:35.247813Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 3 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-10T14:32:35.247826Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 3 consumer shared/user session shared/user_3_3_14129701347643987409_v1 read init: from# ipv6:[::1]:54268, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-10T14:32:35.247862Z node 3 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 3 consumer shared/user session shared/user_3_3_14129701347643987409_v1 auth for : user
2025-10-10T14:32:35.248027Z node 3 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 2 consumer shared/user session shared/user_3_2_16802720391785094166_v1 Handle describe topics response
2025-10-10T14:32:35.248047Z node 3 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 2 consumer shared/user session shared/user_3_2_16802720391785094166_v1 auth is DEAD
2025-10-10T14:32:35.248063Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 2 consumer shared/user session shared/user_3_2_16802720391785094166_v1 auth ok: topics# 1, initDone# 0
2025-10-10T14:32:35.248325Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 2 consumer shared/user session shared/user_3_2_16802720391785094166_v1 register session: topic# rt3.dc1--test-topic
2025-10-10T14:32:35.248365Z node 3 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 3 consumer shared/user session shared/user_3_3_14129701347643987409_v1 Handle describe topics response
2025-10-10T14:32:35.248376Z node 3 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 3 consumer shared/user session shared/user_3_3_14129701347643987409_v1 auth is DEAD
2025-10-10T14:32:35.248382Z node 3 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 1 consumer shared/user session shared/user_3_1_13627327046652139611_v1 Handle describe topics response
2025-10-10T14:32:35.248388Z node 3 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 1 consumer shared/user session shared/user_3_1_13627327046652139611_v1 auth is DEAD
2025-10-10T14:32:35.248393Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 3 consumer shared/user session shared/user_3_3_14129701347643987409_v1 auth ok: topics# 1, initDone# 0
2025-10-10T14:32:35.248485Z :INFO: [/Root] [/Root] [b176c526-ac883f69-cfb8d472-1ce343bd] [] Got InitResponse. ReadSessionId: shared/user_3_2_16802720391785094166_v1
2025-10-10T14:32:35.248498Z :DEBUG: [/Root] [/Root] [b176c526-ac883f69-cfb8d472-1ce343bd] [] In ContinueReadingDataImpl, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-10T14:32:35.248516Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 3 consumer shared/user session shared/user_3_3_14129701347643987409_v1 register session: topic# rt3.dc1--test-topic
2025-10-10T14:32:35.248535Z :DEBUG: [/Root] [/Root] [b176c526-ac883f69-cfb8d472-1ce343bd] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-10T14:32:35.248537Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 1 consumer shared/user session shared/user_3_1_13627327046652139611_v1 auth ok: topics# 1, initDone# 0
2025-10-10T14:32:35.248602Z :INFO: [/Root] [/Root] [4f883379-f675477d-362ca85b-ec453d56] [] Got InitResponse. ReadSessionId: shared/user_3_3_14129701347643987409_v1
2025-10-10T14:32:35.248607Z :DEBUG: [/Root] [/Root] [4f883379-f675477d-362ca85b-ec453d56] [] In ContinueReadingDataImpl, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-10T14:32:35.248621Z :DEBUG: [/Root] [/Root] [4f883379-f675477d-362ca85b-ec453d56] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-10T14:32:35.248657Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 1 consumer shared/user session shared/user_3_1_13627327046652139611_v1 register session: topic# rt3.dc1--test-topic
2025-10-10T14:32:35.248722Z :INFO: [/Root] [/Root] [28a94af4-bba8911a-f00b7d60-4f0c6d32] [] Got InitResponse. ReadSessionId: shared/user_3_1_13627327046652139611_v1
2025-10-10T14:32:35.248731Z :DEBUG: [/Root] [/Root] [28a94af4-bba8911a-f00b7d60-4f0c6d32] [] In ContinueReadingDataImpl, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-10T14:32:35.248721Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 2 consumer shared/user session shared/user_3_2_16802720391785094166_v1 grpc read done: success# 1, data# { read_request { bytes_size: 524288 } }
2025-10-10T14:32:35.248744Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 2 consumer shared/user session shared/user_3_2_16802720391785094166_v1 got read request: guid# 1bb2dd74-b6bd2a00-5b3e197d-f3309fee
2025-10-10T14:32:35.248814Z :DEBUG: [/Root] [/Root] [28a94af4-bba8911a-f00b7d60-4f0c6d32] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-10T14:32:35.248850Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [3:7559600954077198958:2520] connected; active server actors: 1
2025-10-10T14:32:35.248890Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 3 consumer shared/user session shared/user_3_3_14129701347643987409_v1 grpc read done: success# 1, data# { read_request { bytes_size: 524288 } }
2025-10-10T14:32:35.248869Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [3:7559600954077198960:2519] connected; active server actors: 1
2025-10-10T14:32:35.248872Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [3:7559600954077198959:2521] connected; active server actors: 1
2025-10-10T14:32:35.249018Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 3 consumer shared/user session shared/user_3_3_14129701347643987409_v1 got read request: guid# 7bc5c5bf-2f6c7502-1a6f6edb-61bc1c25
2025-10-10T14:32:35.249035Z node 4 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [3:7559600954077198959:2521] session shared/user_3_3_14129701347643987409_v1
2025-10-10T14:32:35.249050Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-10-10T14:32:35.249062Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-10-10T14:32:35.249070Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_3_3_14129701347643987409_v1" (Sender=[3:7559600954077198942:2521], Pipe=[3:7559600954077198959:2521], Partitions=[], ActiveFamilyCount=0)
2025-10-10T14:32:35.249074Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-10T14:32:35.249085Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-10-10T14:32:35.249078Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_3_1_13627327046652139611_v1 grpc read done: success# 1, data# { read_request { bytes_size: 524288 } }
2025-10-10T14:32:35.249093Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_3_3_14129701347643987409_v1" (Sender=[3:7559600954077198942:2521], Pipe=[3:7559600954077198959:2521], Partitions=[], ActiveFamilyCount=0)
2025-10-10T14:32:35.249108Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_3_3_14129701347643987409_v1" sender [3:7559600954077198942:2521] lock partition 0 for ReadingSession "shared/user_3_3_14129701347643987409_v1" (Sender=[3:7559600954077198942:2521], Pipe=[3:7559600954077198959:2521], Partitions=[], ActiveFamilyCount=1) generation 1 step 1
2025-10-10T14:32:35.249093Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_3_1_13627327046652139611_v1 got read request: guid# b6dea544-85e23910-de2af710-8ca26bb9
2025-10-10T14:32:35.249126Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-10-10T14:32:35.249131Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000043s
2025-10-10T14:32:35.249142Z node 4 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [3:7559600954077198960:2519] session shared/user_3_1_13627327046652139611_v1
2025-10-10T14:32:35.249145Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_3_1_13627327046652139611_v1" (Sender=[3:7559600954077198940:2519], Pipe=[3:7559600954077198960:2519], Partitions=[], ActiveFamilyCount=0)
2025-10-10T14:32:35.249148Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-10T14:32:35.249153Z node 4 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [3:7559600954077198958:2520] session shared/user_3_2_16802720391785094166_v1
2025-10-10T14:32:35.249157Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_3_2_16802720391785094166_v1" (Sender=[3:7559600954077198941:2520], Pipe=[3:7559600954077198958:2520], Partitions=[], ActiveFamilyCount=0)
2025-10-10T14:32:35.249161Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=3, Families=1, UnradableFamilies=0 [], RequireBalancing=0 []
2025-10-10T14:32:35.249164Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=3, desiredFamilyCount=0, allowPlusOne=1
2025-10-10T14:32:35.249167Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000004s
2025-10-10T14:32:35.249449Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 3 consumer shared/user session shared/user_3_3_14129701347643987409_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 1 Session: "shared/user_3_3_14129701347643987409_v1" ClientId: "user" PipeClient { RawX1: 7559600954077198959 RawX2: 4503612512274905 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-10T14:32:35.249484Z node 3 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 3 consumer shared/user session shared/user_3_3_14129701347643987409_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-10T14:32:35.249550Z node 3 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_3_3_14129701347643987409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 1, pipe: [3:7559600954077198962:2532]
2025-10-10T14:32:35.249564Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [3:7559600954077198962:2532], now have 1 active actors on pipe
2025-10-10T14:32:35.249574Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:35.249578Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:35.249591Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_3_3_14129701347643987409_v1 on pipe: [3:7559600954077198962:2532]
2025-10-10T14:32:35.249613Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:35.249623Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:35.249625Z node 3 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:35.249653Z node 3 :PERSQUEUE DEBUG: partition.cpp:3747: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_3_3_14129701347643987409_v1
2025-10-10T14:32:35.249662Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:35.249692Z node 3 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:32:35.249865Z node 3 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_3_3_14129701347643987409_v1:1 with generation 1
2025-10-10T14:32:35.250634Z node 3 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:32:35.250675Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:32:35.250689Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:35.250691Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:35.250692Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:35.250697Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:32:35.250705Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-10T14:32:35.250736Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 3 consumer shared/user session shared/user_3_3_14129701347643987409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 0 SizeLag: 0 WriteTimestampEstimateMS: 1760106755191 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-10T14:32:35.250748Z node 3 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 3 consumer shared/user session shared/user_3_3_14129701347643987409_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 0 readOffset 0 committedOffset 0
2025-10-10T14:32:35.250762Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 3 consumer shared/user session shared/user_3_3_14129701347643987409_v1 sending to client partition status
>>> Got event: StartPartitionSession { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 CommittedOffset: 0 EndOffset: 0 }
2025-10-10T14:32:35.251081Z :INFO: [/Root] [/Root] [b176c526-ac883f69-cfb8d472-1ce343bd] Closing read session. Close timeout: 0.000000s
2025-10-10T14:32:35.251095Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset):
2025-10-10T14:32:35.251104Z :INFO: [/Root] [/Root] [b176c526-ac883f69-cfb8d472-1ce343bd] Counters: { Errors: 0 CurrentSessionLifetimeMs: 7 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-10T14:32:35.251123Z :NOTICE: [/Root] [/Root] [b176c526-ac883f69-cfb8d472-1ce343bd] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Close with zero timeout " }
2025-10-10T14:32:35.251131Z :DEBUG: [/Root] [/Root] [b176c526-ac883f69-cfb8d472-1ce343bd] [] Abort session to cluster
2025-10-10T14:32:35.251256Z :INFO: [/Root] [/Root] [4f883379-f675477d-362ca85b-ec453d56] Closing read session. Close timeout: 0.000000s
2025-10-10T14:32:35.251262Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): -:test-topic:0:1:0:0
2025-10-10T14:32:35.251266Z :INFO: [/Root] [/Root] [4f883379-f675477d-362ca85b-ec453d56] Counters: { Errors: 0 CurrentSessionLifetimeMs: 6 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-10T14:32:35.251272Z :NOTICE: [/Root] [/Root] [4f883379-f675477d-362ca85b-ec453d56] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Close with zero timeout " }
2025-10-10T14:32:35.251274Z :DEBUG: [/Root] [/Root] [4f883379-f675477d-362ca85b-ec453d56] [] Abort session to cluster
2025-10-10T14:32:35.251291Z :INFO: [/Root] [/Root] [28a94af4-bba8911a-f00b7d60-4f0c6d32] Closing read session. Close timeout: 0.000000s
2025-10-10T14:32:35.251296Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset):
2025-10-10T14:32:35.251298Z :INFO: [/Root] [/Root] [28a94af4-bba8911a-f00b7d60-4f0c6d32] Counters: { Errors: 0 CurrentSessionLifetimeMs: 6 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-10T14:32:35.251304Z :NOTICE: [/Root] [/Root] [28a94af4-bba8911a-f00b7d60-4f0c6d32] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Close with zero timeout " }
2025-10-10T14:32:35.251307Z :DEBUG: [/Root] [/Root] [28a94af4-bba8911a-f00b7d60-4f0c6d32] [] Abort session to cluster
2025-10-10T14:32:35.251331Z :INFO: [/Root] [/Root] [28a94af4-bba8911a-f00b7d60-4f0c6d32] Closing read session. Close timeout: 0.000000s
2025-10-10T14:32:35.251333Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset):
2025-10-10T14:32:35.251335Z :INFO: [/Root] [/Root] [28a94af4-bba8911a-f00b7d60-4f0c6d32] Counters: { Errors: 0 CurrentSessionLifetimeMs: 6 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-10T14:32:35.251338Z :NOTICE: [/Root] [/Root] [28a94af4-bba8911a-f00b7d60-4f0c6d32] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
2025-10-10T14:32:35.251355Z :INFO: [/Root] [/Root] [4f883379-f675477d-362ca85b-ec453d56] Closing read session. Close timeout: 0.000000s
2025-10-10T14:32:35.251358Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): -:test-topic:0:1:0:0
2025-10-10T14:32:35.251361Z :INFO: [/Root] [/Root] [4f883379-f675477d-362ca85b-ec453d56] Counters: { Errors: 0 CurrentSessionLifetimeMs: 6 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-10T14:32:35.251365Z :NOTICE: [/Root] [/Root] [4f883379-f675477d-362ca85b-ec453d56] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
2025-10-10T14:32:35.251375Z :INFO: [/Root] [/Root] [b176c526-ac883f69-cfb8d472-1ce343bd] Closing read session. Close timeout: 0.000000s
2025-10-10T14:32:35.251377Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset):
2025-10-10T14:32:35.251380Z :INFO: [/Root] [/Root] [b176c526-ac883f69-cfb8d472-1ce343bd] Counters: { Errors: 0 CurrentSessionLifetimeMs: 7 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-10T14:32:35.251385Z :NOTICE: [/Root] [/Root] [b176c526-ac883f69-cfb8d472-1ce343bd] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
2025-10-10T14:32:35.251403Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 2 consumer shared/user session shared/user_3_2_16802720391785094166_v1 grpc read done: success# 0, data# {  }
2025-10-10T14:32:35.251413Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:125: session cookie 2 consumer shared/user session shared/user_3_2_16802720391785094166_v1 grpc read failed
2025-10-10T14:32:35.251419Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:92: session cookie 2 consumer shared/user session shared/user_3_2_16802720391785094166_v1 grpc closed
2025-10-10T14:32:35.251423Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 2 consumer shared/user session shared/user_3_2_16802720391785094166_v1 is DEAD
2025-10-10T14:32:35.251648Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [3:7559600954077198958:2520] disconnected; active server actors: 1
2025-10-10T14:32:35.251660Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 3 consumer shared/user session shared/user_3_3_14129701347643987409_v1 grpc read done: success# 0, data# {  }
2025-10-10T14:32:35.251659Z node 4 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [3:7559600954077198958:2520] client user disconnected session shared/user_3_2_16802720391785094166_v1
2025-10-10T14:32:35.251665Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:125: session cookie 3 consumer shared/user session shared/user_3_3_14129701347643987409_v1 grpc read failed
2025-10-10T14:32:35.251669Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:1666: session cookie 3 consumer shared/user session shared/user_3_3_14129701347643987409_v1 closed
2025-10-10T14:32:35.251668Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-10T14:32:35.251690Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 3 consumer shared/user session shared/user_3_3_14129701347643987409_v1 is DEAD
2025-10-10T14:32:35.251679Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=2, Families=1, UnradableFamilies=0 [], RequireBalancing=0 []
2025-10-10T14:32:35.251683Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=2, desiredFamilyCount=0, allowPlusOne=1
2025-10-10T14:32:35.251687Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000005s
2025-10-10T14:32:35.251753Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_3_1_13627327046652139611_v1 grpc read done: success# 0, data# {  }
2025-10-10T14:32:35.251762Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:125: session cookie 1 consumer shared/user session shared/user_3_1_13627327046652139611_v1 grpc read failed
2025-10-10T14:32:35.251765Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:92: session cookie 1 consumer shared/user session shared/user_3_1_13627327046652139611_v1 grpc closed
2025-10-10T14:32:35.251767Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 1 consumer shared/user session shared/user_3_1_13627327046652139611_v1 is DEAD
2025-10-10T14:32:35.251827Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [3:7559600954077198959:2521] disconnected; active server actors: 1
2025-10-10T14:32:35.251836Z node 4 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [3:7559600954077198959:2521] client user disconnected session shared/user_3_3_14129701347643987409_v1
2025-10-10T14:32:35.251845Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-10T14:32:35.251853Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-10-10T14:32:35.251860Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_3_1_13627327046652139611_v1" (Sender=[3:7559600954077198940:2519], Pipe=[3:7559600954077198960:2519], Partitions=[], ActiveFamilyCount=0)
2025-10-10T14:32:35.251866Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_3_1_13627327046652139611_v1" sender [3:7559600954077198940:2519] lock partition 0 for ReadingSession "shared/user_3_1_13627327046652139611_v1" (Sender=[3:7559600954077198940:2519], Pipe=[3:7559600954077198960:2519], Partitions=[], ActiveFamilyCount=1) generation 1 step 2
2025-10-10T14:32:35.251873Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-10-10T14:32:35.251858Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_3_3_14129701347643987409_v1
2025-10-10T14:32:35.251875Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000020s
2025-10-10T14:32:35.251877Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [3:7559600954077198960:2519] disconnected; active server actors: 1
2025-10-10T14:32:35.251866Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [3:7559600954077198962:2532] destroyed
2025-10-10T14:32:35.251879Z node 4 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [3:7559600954077198960:2519] client user disconnected session shared/user_3_1_13627327046652139611_v1
2025-10-10T14:32:35.251874Z node 3 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_3_3_14129701347643987409_v1
2025-10-10T14:32:35.292171Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:35.292185Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:35.292190Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:35.392553Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:35.392573Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:35.392576Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:30:55.356725Z :WaitEventBlocksBeforeDiscovery INFO: Random seed for debugging is 1760106655356721
2025-10-10T14:30:55.447232Z node 1 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[1:7559600522151870018:2171];send_to=[0:7307199536658146131:7762515];
2025-10-10T14:30:55.447266Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-10-10T14:30:55.453245Z node 1 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-10-10T14:30:55.454035Z node 2 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[2:7559600521964496648:2155];send_to=[0:7307199536658146131:7762515];
2025-10-10T14:30:55.454082Z node 2 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
test_client.cpp: SetPath # /home/runner/.ya/build/build_root/z96o/002b37/r3tmp/tmp6FZZqF/pdisk_1.dat
2025-10-10T14:30:55.455519Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-10-10T14:30:55.483380Z node 1 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-10T14:30:55.486677Z node 1 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-10-10T14:30:55.492941Z node 2 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
TServer::EnableGrpc on GrpcPort 12256, node 1
2025-10-10T14:30:55.503124Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:190: distributable config is empty, broken or outdated, will use file: /home/runner/.ya/build/build_root/z96o/002b37/r3tmp/yandexQrfGqc.tmp
2025-10-10T14:30:55.503136Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:196: will try to initialize from file: /home/runner/.ya/build/build_root/z96o/002b37/r3tmp/yandexQrfGqc.tmp
2025-10-10T14:30:55.503206Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:202: successfully initialized from file: /home/runner/.ya/build/build_root/z96o/002b37/r3tmp/yandexQrfGqc.tmp
2025-10-10T14:30:55.503248Z node 1 :NET_CLASSIFIER ERROR: net_classifier.cpp:228: got bad distributable configuration
2025-10-10T14:30:55.507361Z INFO: TTestServer started on Port 4879 GrpcPort 12256
TClient is connected to server localhost:4879
PQClient connected to localhost:12256
WaitRootIsUp 'Root'...
TClient::Ls request: Root
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "Root"
    PathId: 1
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 1
    CreateStep: 0
    ParentPathId: 1
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 1
      SubDomainVersion: 0
      SecurityStateVersion: 0
    }
    ChildrenExist: false
  }
  Children {
    Name: ".sys"
    PathId: 18446744073709551615
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 0
    CreateStep: 0
    ParentPathId: 18446744073709551615
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 0
      Pl...
(TRUNCATED)
WaitRootIsUp 'Root' success.
2025-10-10T14:30:55.547951Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-10T14:30:55.547990Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-10T14:30:55.549508Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Connecting -> Connected
2025-10-10T14:30:55.551999Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpAlterSubDomain, opId: 281474976720657:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_alter_subdomain.cpp:311)
waiting...
2025-10-10T14:30:55.556625Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-10T14:30:55.556645Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-10T14:30:55.557883Z node 1 :HIVE WARN: hive_impl.cpp:811: HIVE#72057594037968897 Handle TEvInterconnect::TEvNodeConnected, NodeId 2 Cookie 2
2025-10-10T14:30:55.558104Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Connecting -> Connected
waiting...
waiting...
waiting...
2025-10-10T14:30:55.725273Z node 1 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-10-10T14:30:55.773430Z node 1 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:566: Compilation failed, self: [1:7559600522151870802:2318], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-10T14:30:55.773492Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2408: SessionId: ydb://session/3?node_id=1&id=MjRjY2Q0YmEtMmI5N2QyZjQtODhkMGEzNmUtNzdlZDJiNjg=, ActorId: [1:7559600522151870799:2316], ActorState: ExecuteState, TraceId: 01k778gbzy12sepjg24qcdpcyn, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-10T14:30:55.773799Z node 1 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-10-10T14:30:55.774089Z node 2 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:566: Compilation failed, self: [2:7559600521964496833:2289], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-10T14:30:55.774147Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720661:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-10T14:30:55.774159Z node 2 :KQP_SESSION WARN: kqp_session_actor.cpp:2408: SessionId: ydb://session/3?node_id=2&id=NzIzZDRhNWQtNDBlZTY4M2EtMzJjNWYxMS05NjYyMDNmOQ==, ActorId: [2:7559600521964496831:2288], ActorState: ExecuteState, TraceId: 01k778gbzy28p6hjj6ccenmbx3, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-10T14:30:55.774259Z node 2 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-10-10T14:30:55.793943Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720662:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-10T14:30:55.812870Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720663:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
=== Init DC: UPSERT INTO `/Root/PQ/Config/V2/Cluster` (name, balancer, local, enabled, weight) VALUES ("dc1", "localhost:12256", true, true, 1000), ("dc2", "dc2.logbroker.yandex.net", false, false, 1000);
2025-10-10T14:30:55.855961Z node 1 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976720664. Ctx: { TraceId: 01k778gc2n93npptfh2xc083ww, Database: , SessionId: ydb://session/3?node_id=1&id=ZTI2YjhlYmItOGVjODg0MDQtZWYyYzEwOWQtYmQ4YWFhOWY=, PoolId: , DatabaseId: /Root}. Database not set, use /Root
=== CheckClustersList. Subcribe to ClusterTracker from [1:7559600522151871180:2878] 
2025-10-10T14:30:56.448397Z node 1 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-10-10T14:30:56.455555Z node 2 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-10-10T14:31:00.447620Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[1:7559600522151870018:2171];send_to=[0:7307199536658146131:7762515];
2025-10-10T14:31:00.447647Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
2025-10-10T14:31:00.454281Z node 2 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[2:7559600521964496648:2155];send_to=[0:7307199536658146131:7762515];
2025-10-10T14:31:00.454306Z node 2 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
=== CheckClustersList. Ok
2025-10-10T14:31:00.944649Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720676:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
waiting...
PQ Client: create topic: rt3.dc1--test-topic with 1 partitions
CallPersQueueGRPC request to localhost:12256
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-10T14:31:00.962864Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
CallPersQueueGRPC request to localhost:12256
MetaRequest {
  CmdCreateTopic {
    Topic: "rt3.dc1--test-topic"
    NumPartitions: 1
    Config {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
  }
}
CallPersQueueGRPC response:
Status: 129
ProxyErrorCode: 53
SchemeStatus: 1
FlatTxId {
  TxId: 281474976720677
  SchemeShardTabletId: 72057594046644480
  PathId: 9
}
ErrorCode: OK
AddTopic: rt3.dc1--test-topic
===Run query:``DECLARE $version as Int64; DECLARE $path AS Utf8; DECLARE $cluster as Utf8; UPSERT INTO `/Root/PQ/Config/V2/Topics` (path, dc) VALUES ($path, $cluster); UPSERT INTO `/Root/PQ/Config/V2/Versions` (name, version) VALUES ("Topics", $version);`` with topic = test-topic, dc = dc1
2025-10-10T14:31:00.967616Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][] pipe [1:7559600543626708171:3174] connected; active server actors: 1
2025-10-10T14:31:00.967704Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1517: [72075186224037893][rt3.dc1--test-topic] updating configuration. Deleted partitions []. Added partitions [0]
2025-10-10T14:31:00.967772Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:940: [72075186224037893][rt3.dc1--test-topic] Discovered subdomain [OwnerId: 72057594046644480, LocalPathId: 1] state, outOfSpace = 0 at RB 72075186224037893
2025-10-10T14:31:00.967977Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:138: [72075186224037893][rt3.dc1--test-topic] BALANCER INIT DONE for rt3.dc1--test-topic: (0, 72075186224037892) 
2025-10-10T14:31:00.969506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:00.969934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:00.969992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:784: [PQ: 72075186224037892] no config, start with empty partitions and default config
2025-10-10T14:31:00.970006Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:00.970020Z node 2 :PERSQUEUE INFO: pq_impl.cpp:609: [PQ: 72075186224037892] doesn't have tx writes info
2025-10-10T14:31:00.970110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600543626708193:2438], now have 1 active actors on pipe
2025-10-10T14:31:00.970122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600543626708169:3172], now have 1 active actors on pipe
2025-10-10T14:31:00.970153Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1
2025-10-10T14:31:00.970237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-10T14:31:00.971073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-10T14:31:00.972015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600543626708229:3221], now have 1 active actors on pipe
2025-10-10T14:31:00.972080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-10T14:31:00.972686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-10T14:31:00.972855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:00.972876Z node 2 :PERSQUEUE DEBUG: partition.cpp:1277: [72075186224037892][Partition][0][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-10-10T14:31:00.972911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:00.972967Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600543439333859:2381]
2025-10-10T14:31:00.973449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:00.973456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:00.973461Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1 [2:7559600543439333859:2381]
2025-10-10T14:31:00.973467Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-10-10T14:31:00.973644Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 1
2025-10-10T14:31:00.973651Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:00.973666Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:00.973671Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:00.973674Z node 2 :PERSQUEUE DEBUG: partition.cpp:2345: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-10T14:31:00.973675Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:00.973676Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:00.973677Z node 2 :PERSQUEUE DEBUG: partition.cpp:2345: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-10T14:31:00.973684Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:00.973760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-10T14:31:00.973780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:31:00.980687Z node 1 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976720678. Ctx: { TraceId: 01k778gh362p6bpvh32t0vdm2p, Database: , SessionId: ydb://session/3?node_id=1&id=Mzk3Nzk5OWMtZWRlOTU5OTAtZjE0M2ZkMTEtYTQxMjZhNjM=, PoolId: , DatabaseId: /Root}. Database not set, use /Root
===Query complete
2025-10-10T14:31:00.974383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-10T14:31:00.974400Z node 2 :PERSQUEUE DEBUG: partition.cpp:1381: [72075186224037892][Partition][0][StateIdle] Handle TEvPQ::TEvTxCommit Step 1760106661019, TxId 281474976720677
TClient::Ls request: /Root/PQ/rt3.dc1--test-topic2025-10-10T14:31:00.974403Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:00.974404Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:00.974418Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:00.974449Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:31:00.974830Z node 2 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:31:00.974884Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:31:00.974890Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:00.974893Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:00.974894Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:00.974901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:31:00.974980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:395: [PQ: 72075186224037892] Apply new config PartitionConfig { LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 } PartitionIds: 0 TopicName: "rt3.dc1--test-topic" Version: 0 LocalDC: true Codecs { Ids: 0 Ids: 1 Ids: 2 Codecs: "raw" Codecs: "gzip" Codecs: "lzop" } TopicPath: "/Root/PQ/rt3.dc1--test-topic" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } Consumers { Name: "user" ReadFromTimestampsMs: 0 FormatVersion: 0 Version: 0 Generation: 0 } MonitoringProjectId: ""
2025-10-10T14:31:00.974994Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:00.975031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-10T14:31:00.975824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-10T14:31:00.975839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-10T14:31:00.976157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976720677
    CreateStep: 1760106661019
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: ...
(TRUNCATED)
GetTopicVersionFromPath:  record Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976720677
    CreateStep: 1760106661019
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      YdbDatabasePath: "/Root"
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
    Partitions {
      PartitionId: 0
      TabletId: 72075186224037892
      Status: Active
    }
    AlterVersion: 1
    BalancerTabletID: 72075186224037893
    NextPartitionId: 1
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 1
      PlanResolution: 7
      Coordinators: 72057594046316545
      TimeCastBucketsPerMediator: 2
      Mediators: 72057594046382081
    }
    DomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    PathsInside: 8
    PathsLimit: 10000
    ShardsInside: 6
    ShardsLimit: 200000
    ResourcesDomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    DiskSpaceUsage {
      Tables {
        TotalSize: 0
        DataSize: 0
        IndexSize: 0
      }
      Topics {
        ReserveSize: 0
        AccountSize: 0
        DataSize: 0
        UsedReserveSize: 0
      }
    }
    PQPartitionsInside: 1
    PQPartitionsLimit: 1000000
    SchemeLimits {
      MaxDepth: 32
      MaxPaths: 10000
      MaxChildrenInDir: 100000
      MaxAclBytesSize: 10240
      MaxTableColumns: 200
      MaxTableColumnNameLength: 255
      MaxTableKeyColumns: 30
      MaxTableIndices: 20
      MaxShards: 200000
      MaxShardsInPath: 35000
      MaxConsistentCopyTargets: 10000
      MaxPathElementLength: 255
      ExtraPathSymbolsAllowed: "!\"#$%&\'()*+,-.:;<=>?@[\\]^_`{|}~"
      MaxPQPartitions: 1000000
      MaxTableCdcStreams: 5
      MaxExports: 10
      MaxImports: 10
      MaxColumnTableColumns: 10000
    }
  }
}
Path: "/Root/PQ/rt3.dc1--test-topic"
 name rt3.dc1--test-topic version1
CallPersQueueGRPC request to localhost:12256
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-10T14:31:01.030878Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-10-10T14:31:01.073810Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:01.073821Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:01.073823Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:01.174154Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:01.174171Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:01.174173Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:01.274509Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:01.274526Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:01.274528Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:01.374863Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:01.374875Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:01.374877Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:01.475206Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:01.475219Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:01.475221Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:12256
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-10T14:31:01.532036Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-10-10T14:31:01.575573Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:01.575587Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:01.575590Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:01.675938Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:01.675952Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:01.675954Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:01.776271Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:01.776284Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:01.776286Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:01.876624Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:01.876638Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:01.876640Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:01.976961Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:01.976975Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:01.976977Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:12256
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-10T14:31:02.033538Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--test-topic"
      NumPartitions: 1
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        TopicPath: "/Root/PQ/rt3.dc1--test-topic"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Version: 0
        }
      }
      ErrorCode: OK
    }
  }
}
=== Topic created, have version: 1
2025-10-10T14:31:02.034672Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: try to update token
2025-10-10T14:31:02.034978Z :INFO: [] MessageGroupId [src] SessionId [] Write session: Do CDS request
2025-10-10T14:31:02.034986Z :INFO: [] MessageGroupId [src] SessionId [] Start write session. Will connect to endpoint: localhost:12256
2025-10-10T14:31:02.035566Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:02.035580Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1
2025-10-10T14:31:02.037170Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src" }
2025-10-10T14:31:02.037411Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src" }
2025-10-10T14:31:02.037449Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1 topic: "test-topic" message_group_id: "src" from ipv6:[::1]:58276
2025-10-10T14:31:02.037454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:58276 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:02.037457Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:02.037794Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1 sessionId:  describe result for acl check
2025-10-10T14:31:02.037830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:02.037836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:02.037838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:02.037842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600552216642987:2471] (SourceId=src, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:02.038295Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600552216642987:2471] (SourceId=src, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:02.058739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [1:7559600552216642987:2471] (SourceId=src, PreferedPartition=(NULL)) RequestPQRB
2025-10-10T14:31:02.058837Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559600552216643019:2471] connected; active server actors: 1
2025-10-10T14:31:02.058873Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [1:7559600552216642987:2471] (SourceId=src, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=src
2025-10-10T14:31:02.058878Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600552216642987:2471] (SourceId=src, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:02.058947Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559600552216643019:2471] disconnected; active server actors: 1
2025-10-10T14:31:02.058957Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559600552216643019:2471] disconnected no session
2025-10-10T14:31:02.074206Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600552216642987:2471] (SourceId=src, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:02.074220Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600552216642987:2471] (SourceId=src, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-10-10T14:31:02.074223Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600552216642987:2471] (SourceId=src, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:02.074229Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:02.074505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600552216643037:2471], now have 1 active actors on pipe
2025-10-10T14:31:02.074557Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1
2025-10-10T14:31:02.074625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:02.074635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:02.074658Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src|167f3020-7a76df30-98cf2145-225982fb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src
2025-10-10T14:31:02.074670Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:02.074679Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:02.074682Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:02.074692Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:02.074705Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:02.074724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:02.074874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:02.074879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:02.074888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:02.074955Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1 partition: 0 MaxSeqNo: 0 sessionId: src|167f3020-7a76df30-98cf2145-225982fb_0
2025-10-10T14:31:02.075263Z :INFO: [] MessageGroupId [src] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1760106662075 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-10T14:31:02.075293Z :INFO: [] MessageGroupId [src] SessionId [] Write session established. Init response: session_id: "src|167f3020-7a76df30-98cf2145-225982fb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:02.075385Z :INFO: [] MessageGroupId [src] SessionId [src|167f3020-7a76df30-98cf2145-225982fb_0] Write session: close. Timeout = 0 ms
2025-10-10T14:31:02.075396Z :INFO: [] MessageGroupId [src] SessionId [src|167f3020-7a76df30-98cf2145-225982fb_0] Write session will now close
2025-10-10T14:31:02.075403Z :DEBUG: [] MessageGroupId [src] SessionId [src|167f3020-7a76df30-98cf2145-225982fb_0] Write session: aborting
2025-10-10T14:31:02.075652Z :INFO: [] MessageGroupId [src] SessionId [src|167f3020-7a76df30-98cf2145-225982fb_0] Write session: gracefully shut down, all writes complete
2025-10-10T14:31:02.075655Z :DEBUG: [] MessageGroupId [src] SessionId [src|167f3020-7a76df30-98cf2145-225982fb_0] Write session is aborting and will not restart
2025-10-10T14:31:02.075646Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId: src|167f3020-7a76df30-98cf2145-225982fb_0 grpc read done: success: 0 data: 
2025-10-10T14:31:02.075676Z :DEBUG: [] MessageGroupId [src] SessionId [src|167f3020-7a76df30-98cf2145-225982fb_0] Write session: destroy
2025-10-10T14:31:02.075957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [1:7559600552216643037:2471] destroyed
2025-10-10T14:31:02.075667Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 1 sessionId: src|167f3020-7a76df30-98cf2145-225982fb_0 grpc read failed
2025-10-10T14:31:02.075674Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 1 sessionId: src|167f3020-7a76df30-98cf2145-225982fb_0 grpc closed
2025-10-10T14:31:02.075678Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1 sessionId: src|167f3020-7a76df30-98cf2145-225982fb_0 is DEAD
2025-10-10T14:31:02.075889Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-10-10T14:31:02.075964Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-10-10T14:31:02.075968Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:02.075969Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:02.075971Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:02.077294Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:02.077296Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:02.077297Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
Before ReadSession was created
Session was created
Returned from WaitEvent
2025-10-10T14:31:02.177685Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:02.177698Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:02.177701Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:02.278040Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:02.278054Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:02.278056Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:02.378411Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:02.378427Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:02.378430Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:02.478694Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:02.478714Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:02.478717Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:02.579092Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:02.579105Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:02.579108Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:02.679432Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:02.679444Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:02.679446Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:02.779793Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:02.779805Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:02.779808Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:02.880148Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:02.880163Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:02.880165Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:02.980492Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:02.980505Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:02.980508Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:03.080862Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:03.080877Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:03.080881Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
Session blocked successfully
Session closed gracefully
2025-10-10T14:31:03.181190Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:03.181201Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:03.181203Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:03.281557Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:03.281572Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:03.281576Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:03.381888Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:03.381901Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:03.381903Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:03.482245Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:03.482257Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:03.482259Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:03.582611Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:03.582622Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:03.582624Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:03.682950Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:03.682965Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:03.682967Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:03.783274Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:03.783300Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:03.783303Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:03.883673Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:03.883690Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:03.883693Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:03.984030Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:03.984045Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:03.984048Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:04.084345Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:04.084367Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:04.084370Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:04.184720Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:04.184735Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:04.184738Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:04.285075Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:04.285090Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:04.285093Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:04.385428Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:04.385443Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:04.385445Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:04.485795Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:04.485811Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:04.485814Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:04.586142Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:04.586156Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:04.586158Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:04.686475Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:04.686491Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:04.686493Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:04.786836Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:04.786850Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:04.786853Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:04.887197Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:04.887212Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:04.887214Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:04.987546Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:04.987564Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:04.987566Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:05.087874Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:05.087889Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:05.087891Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:05.188256Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:05.188273Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:05.188276Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:05.288590Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:05.288604Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:05.288607Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:05.388945Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:05.388957Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:05.388959Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:05.489291Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:05.489304Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:05.489306Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:05.589647Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:05.589662Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:05.589664Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:05.690008Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:05.690021Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:05.690023Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:05.790360Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:05.790374Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:05.790376Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:05.890699Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:05.890712Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:05.890714Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:05.973677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:31:05.991042Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:05.991055Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:05.991057Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:06.091387Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:06.091398Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:06.091400Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:06.191752Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:06.191769Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:06.191772Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:06.292103Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:06.292118Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:06.292121Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:06.392477Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:06.392495Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:06.392499Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:06.492817Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:06.492831Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:06.492833Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:06.593147Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:06.593161Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:06.593163Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:06.693518Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:06.693533Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:06.693535Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:06.793840Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:06.793855Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:06.793857Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:06.894227Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:06.894242Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:06.894245Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:06.994572Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:06.994587Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:06.994589Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:07.094936Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:07.094953Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:07.094956Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:07.195285Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:07.195302Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:07.195305Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:07.295596Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:07.295610Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:07.295613Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:07.395960Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:07.395979Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:07.395982Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:07.496326Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:07.496338Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:07.496340Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:07.596693Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:07.596707Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:07.596709Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:07.697030Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:07.697044Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:07.697046Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:07.797399Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:07.797415Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:07.797418Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:07.897714Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:07.897736Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:07.897739Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:07.998101Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:07.998116Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:07.998118Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:08.098470Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:08.098486Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:08.098489Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:08.198780Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:08.198793Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:08.198795Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:08.299158Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:08.299172Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:08.299175Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:08.399518Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:08.399532Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:08.399534Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:08.499857Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:08.499872Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:08.499873Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:08.600207Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:08.600221Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:08.600224Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:08.700556Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:08.700571Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:08.700573Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:08.800909Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:08.800923Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:08.800926Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:08.901270Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:08.901287Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:08.901290Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:09.001625Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:09.001639Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:09.001641Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:09.101973Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:09.101997Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:09.101999Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:09.202323Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:09.202336Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:09.202339Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:09.302658Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:09.302673Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:09.302676Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:09.403028Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:09.403045Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:09.403048Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:09.503379Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:09.503393Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:09.503395Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:09.603723Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:09.603736Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:09.603739Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:09.704086Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:09.704100Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:09.704103Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:09.804437Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:09.804451Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:09.804454Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:09.904783Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:09.904797Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:09.904800Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:10.005113Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:10.005128Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:10.005131Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:10.105494Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:10.105509Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:10.105511Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:10.205839Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:10.205853Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:10.205856Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:10.306209Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:10.306226Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:10.306229Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:10.406545Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:10.406562Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:10.406564Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:10.473109Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard_impl.cpp:7712: Cannot get console configs
2025-10-10T14:31:10.473122Z node 1 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-10-10T14:31:10.506880Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:10.506899Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:10.506902Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:10.607243Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:10.607256Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:10.607258Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:10.707598Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:10.707617Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:10.707619Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:10.807951Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:10.807965Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:10.807967Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:10.908303Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:10.908324Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:10.908327Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:10.973854Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:31:11.008670Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:11.008684Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:11.008687Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:11.109007Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:11.109024Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:11.109027Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:11.209370Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:11.209383Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:11.209386Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:11.309698Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:11.309711Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:11.309713Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:11.410074Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:11.410088Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:11.410090Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:11.510415Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:11.510429Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:11.510431Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:11.610784Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:11.610799Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:11.610802Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:11.711129Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:11.711145Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:11.711147Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:11.811473Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:11.811487Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:11.811490Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:11.911836Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:11.911851Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:11.911854Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:12.012173Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:12.012190Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:12.012193Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:12.112542Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:12.112556Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:12.112563Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:12.212897Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:12.212912Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:12.212914Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:12.313228Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:12.313240Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:12.313242Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:12.413571Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:12.413588Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:12.413590Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:12.513936Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:12.513958Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:12.513961Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:12.614292Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:12.614310Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:12.614313Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:12.714643Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:12.714657Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:12.714660Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:12.814992Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:12.815008Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:12.815010Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:12.915349Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:12.915363Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:12.915366Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:13.015711Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:13.015725Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:13.015727Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:13.116047Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:13.116061Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:13.116063Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:13.216403Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:13.216417Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:13.216420Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:13.316767Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:13.316781Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:13.316784Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:13.417101Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:13.417116Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:13.417119Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:13.517457Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:13.517474Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:13.517477Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:13.617791Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:13.617806Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:13.617809Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:13.718165Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:13.718179Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:13.718182Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:13.818517Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:13.818535Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:13.818537Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:13.918866Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:13.918880Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:13.918883Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:14.019221Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:14.019235Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:14.019237Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:14.119568Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:14.119583Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:14.119585Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:14.219923Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:14.219937Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:14.219940Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:14.320262Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:14.320276Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:14.320278Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:14.420613Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:14.420626Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:14.420627Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:14.520973Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:14.520988Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:14.520991Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:14.621357Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:14.621375Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:14.621378Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:14.721685Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:14.721701Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:14.721704Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:14.822012Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:14.822028Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:14.822031Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:14.922405Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:14.922421Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:14.922424Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:15.022745Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:15.022764Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:15.022767Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:15.123110Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:15.123128Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:15.123132Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:15.223457Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:15.223474Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:15.223477Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:15.323770Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:15.323783Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:15.323785Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:15.424152Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:15.424166Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:15.424169Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:15.524493Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:15.524509Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:15.524512Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:15.624853Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:15.624868Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:15.624870Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:15.725176Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:15.725193Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:15.725196Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:15.825558Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:15.825577Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:15.825580Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:15.925915Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:15.925930Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:15.925933Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:15.974085Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:31:16.026272Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:16.026290Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:16.026293Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:16.126592Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:16.126607Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:16.126611Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:16.226969Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:16.226984Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:16.226987Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:16.327329Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:16.327345Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:16.327348Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:16.427647Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:16.427662Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:16.427664Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:16.528043Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:16.528067Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:16.528070Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:16.628372Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:16.628387Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:16.628390Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:16.728733Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:16.728749Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:16.728752Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:16.829091Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:16.829107Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:16.829110Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:16.929436Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:16.929454Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:16.929457Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:17.029777Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:17.029791Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:17.029794Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:17.130150Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:17.130167Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:17.130170Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:17.230469Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:17.230485Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:17.230488Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:17.330855Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:17.330871Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:17.330874Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:17.431197Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:17.431215Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:17.431218Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:17.531544Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:17.531561Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:17.531565Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:17.631897Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:17.631914Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:17.631917Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:17.732244Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:17.732258Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:17.732261Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:17.832549Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:17.832563Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:17.832566Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:17.932951Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:17.932967Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:17.932969Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:18.033307Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:18.033324Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:18.033350Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:18.133666Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:18.133683Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:18.133686Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:18.234007Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:18.234023Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:18.234025Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:18.334334Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:18.334347Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:18.334350Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:18.434719Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:18.434734Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:18.434736Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:18.535045Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:18.535065Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:18.535067Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:18.635399Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:18.635416Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:18.635420Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:18.735763Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:18.735778Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:18.735781Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:18.836096Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:18.836114Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:18.836116Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:18.936487Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:18.936503Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:18.936507Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:19.036830Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:19.036846Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:19.036848Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:19.137173Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:19.137188Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:19.137190Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:19.237534Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:19.237550Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:19.237553Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:19.337867Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:19.337892Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:19.337894Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:19.438234Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:19.438253Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:19.438256Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:19.538554Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:19.538569Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:19.538571Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:19.638931Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:19.638944Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:19.638946Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:19.739274Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:19.739294Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:19.739296Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:19.839588Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:19.839602Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:19.839604Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:19.939986Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:19.939999Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:19.940001Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:20.040338Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:20.040360Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:20.040362Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:20.140699Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:20.140713Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:20.140716Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:20.241042Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:20.241056Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:20.241058Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:20.341389Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:20.341403Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:20.341405Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:20.441754Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:20.441770Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:20.441773Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:20.542135Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:20.542153Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:20.542156Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:20.642475Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:20.642493Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:20.642496Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:20.742826Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:20.742845Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:20.742848Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:20.843163Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:20.843179Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:20.843182Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:20.943512Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:20.943527Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:20.943530Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:20.974263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:31:21.043865Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:21.043883Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:21.043886Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:21.144225Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:21.144246Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:21.144249Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:21.244579Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:21.244596Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:21.244599Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:21.344899Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:21.344914Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:21.344916Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:21.445265Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:21.445282Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:21.445286Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:21.545597Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:21.545612Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:21.545614Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:21.645976Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:21.646002Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:21.646004Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:21.746324Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:21.746339Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:21.746341Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:21.846679Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:21.846697Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:21.846700Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:21.947010Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:21.947028Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:21.947032Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:22.047421Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:22.047439Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:22.047443Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:22.147711Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:22.147729Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:22.147732Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:22.248088Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:22.248104Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:22.248106Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:22.348438Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:22.348461Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:22.348464Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:22.448798Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:22.448812Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:22.448814Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:22.549151Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:22.549168Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:22.549171Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:22.649486Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:22.649499Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:22.649505Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:22.749866Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:22.749885Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:22.749889Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:22.850215Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:22.850236Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:22.850239Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:22.950702Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:22.950723Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:22.950726Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:23.050911Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:23.050929Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:23.050932Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:23.151256Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:23.151271Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:23.151273Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:23.251613Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:23.251629Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:23.251632Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:23.351957Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:23.351971Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:23.351974Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:23.452295Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:23.452316Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:23.452319Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:23.552667Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:23.552681Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:23.552683Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:23.653021Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:23.653037Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:23.653040Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:23.753378Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:23.753402Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:23.753405Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:23.853722Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:23.853737Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:23.853739Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:23.954085Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:23.954103Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:23.954107Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:24.054425Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:24.054441Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:24.054443Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:24.154767Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:24.154784Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:24.154786Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:24.255124Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:24.255140Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:24.255142Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:24.355464Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:24.355485Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:24.355488Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:24.455818Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:24.455832Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:24.455834Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:24.556164Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:24.556179Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:24.556181Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:24.656477Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:24.656491Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:24.656493Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:24.756855Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:24.756870Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:24.756873Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:24.857219Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:24.857231Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:24.857234Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:24.957585Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:24.957599Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:24.957602Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:25.057937Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:25.057953Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:25.057956Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:25.158296Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:25.158314Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:25.158316Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:25.258630Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:25.258648Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:25.258651Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:25.358992Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:25.359007Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:25.359010Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:25.459322Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:25.459341Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:25.459343Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:25.559699Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:25.559714Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:25.559716Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:25.660042Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:25.660057Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:25.660059Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:25.760394Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:25.760410Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:25.760413Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:25.860741Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:25.860755Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:25.860757Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:25.961101Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:25.961115Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:25.961118Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:25.974446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:31:26.061453Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:26.061469Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:26.061471Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:26.161824Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:26.161844Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:26.161847Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:26.262167Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:26.262192Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:26.262194Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:26.362492Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:26.362514Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:26.362517Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:26.462866Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:26.462882Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:26.462885Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:26.563192Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:26.563207Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:26.563210Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:26.663573Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:26.663589Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:26.663593Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:26.763884Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:26.763901Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:26.763904Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:26.864267Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:26.864283Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:26.864286Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:26.964592Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:26.964608Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:26.964611Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:27.064975Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:27.064997Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:27.065000Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:27.165328Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:27.165354Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:27.165357Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:27.265692Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:27.265706Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:27.265708Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:27.366044Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:27.366067Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:27.366071Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:27.466395Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:27.466413Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:27.466416Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:27.566748Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:27.566767Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:27.566770Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:27.667094Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:27.667118Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:27.667121Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:27.767439Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:27.767453Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:27.767461Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:27.867745Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:27.867759Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:27.867761Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:27.968147Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:27.968162Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:27.968164Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:28.068495Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:28.068510Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:28.068512Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:28.168849Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:28.168866Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:28.168868Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:28.269207Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:28.269222Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:28.269225Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:28.369560Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:28.369577Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:28.369579Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:28.469880Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:28.469894Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:28.469896Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:28.570261Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:28.570276Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:28.570278Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:28.670594Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:28.670609Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:28.670612Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:28.770958Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:28.770973Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:28.770976Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:28.871324Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:28.871341Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:28.871344Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:28.971672Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:28.971687Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:28.971689Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:29.072029Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:29.072048Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:29.072051Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:29.172393Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:29.172409Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:29.172412Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:29.272763Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:29.272788Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:29.272791Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:29.373100Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:29.373119Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:29.373123Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:29.473426Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:29.473440Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:29.473442Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:29.573798Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:29.573811Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:29.573814Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:29.674152Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:29.674167Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:29.674170Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:29.774465Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:29.774480Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:29.774483Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:29.874841Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:29.874859Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:29.874862Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:29.975210Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:29.975225Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:29.975228Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:30.075538Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:30.075551Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:30.075553Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:30.175892Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:30.175905Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:30.175908Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:30.276243Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:30.276263Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:30.276267Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:30.376616Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:30.376634Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:30.376636Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:30.476893Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:30.476906Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:30.476908Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:30.577281Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:30.577294Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:30.577297Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:30.677642Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:30.677657Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:30.677660Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:30.777994Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:30.778008Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:30.778011Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:30.878321Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:30.878335Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:30.878337Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:30.967936Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:155: [72075186224037893][rt3.dc1--test-topic] TPersQueueReadBalancer::HandleWakeup
2025-10-10T14:31:30.967978Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 1
2025-10-10T14:31:30.968422Z node 2 :PERSQUEUE DEBUG: partition.cpp:1000: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 0 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-10-10T14:31:30.968655Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 9 Generation: 1 StatsReportRound: 1 DataSize: 0 UsedReserveSize: 0
2025-10-10T14:31:30.968830Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-10-10T14:31:30.968895Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72057594046644480, NodeId 1, Generation 2
2025-10-10T14:31:30.974623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:31:30.978680Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:30.978689Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:30.978690Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:31.079061Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:31.079082Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:31.079084Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:31.179416Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:31.179432Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:31.179435Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:31.279771Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:31.279785Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:31.279788Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:31.380134Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:31.380153Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:31.380157Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:31.480471Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:31.480490Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:31.480493Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:31.580823Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:31.580837Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:31.580841Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:31.681171Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:31.681183Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:31.681186Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:31.781522Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:31.781534Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:31.781537Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:31.881873Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:31.881885Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:31.881887Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:31.982254Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:31.982271Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:31.982274Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:32.082588Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:32.082608Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:32.082610Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:32.182955Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:32.182973Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:32.182975Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:32.283300Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:32.283319Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:32.283322Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:32.383609Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:32.383627Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:32.383629Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:32.484019Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:32.484035Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:32.484038Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:32.584340Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:32.584353Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:32.584355Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:32.684692Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:32.684706Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:32.684708Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:32.785043Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:32.785057Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:32.785060Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:32.885400Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:32.885416Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:32.885418Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:32.985753Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:32.985776Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:32.985778Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:33.086086Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:33.086099Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:33.086101Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:33.186450Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:33.186464Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:33.186466Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:33.286759Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:33.286772Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:33.286781Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:33.387150Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:33.387168Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:33.387171Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:33.487509Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:33.487523Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:33.487525Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:33.587827Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:33.587843Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:33.587847Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:33.688218Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:33.688234Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:33.688237Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:33.788562Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:33.788576Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:33.788578Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:33.888874Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:33.888891Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:33.888894Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:33.989256Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:33.989273Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:33.989277Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:34.089608Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:34.089620Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:34.089622Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:34.189994Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:34.190007Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:34.190010Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:34.290321Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:34.290342Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:34.290344Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:34.390671Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:34.390683Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:34.390685Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:34.491013Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:34.491034Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:34.491037Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:34.591379Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:34.591392Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:34.591395Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:34.691734Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:34.691750Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:34.691754Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:34.792081Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:34.792107Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:34.792111Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:34.892435Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:34.892451Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:34.892454Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:34.992748Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:34.992761Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:34.992763Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:35.093160Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:35.093179Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:35.093181Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:35.193492Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:35.193517Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:35.193519Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:35.293828Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:35.293841Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:35.293844Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:35.394215Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:35.394233Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:35.394236Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:35.494516Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:35.494532Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:35.494536Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:35.594890Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:35.594904Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:35.594907Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:35.695248Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:35.695263Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:35.695266Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:35.795595Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:35.795610Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:35.795613Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:35.895967Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:35.895981Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:35.895984Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:35.974874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:31:35.996328Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:35.996346Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:35.996349Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:36.096663Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:36.096678Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:36.096682Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:36.197034Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:36.197051Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:36.197054Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:36.297375Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:36.297391Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:36.297393Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:36.397719Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:36.397734Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:36.397737Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:36.498064Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:36.498078Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:36.498080Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:36.598439Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:36.598459Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:36.598463Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:36.698783Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:36.698800Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:36.698803Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:36.799123Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:36.799143Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:36.799145Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:36.899493Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:36.899508Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:36.899510Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:36.999831Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:36.999851Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:36.999854Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:37.100175Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:37.100188Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:37.100191Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:37.218961Z node 1 :KQP_EXECUTER ERROR: kqp_executer_impl.h:1010: ActorId: [1:7559600702540500451:2885] TxId: 281474976720753. Ctx: { TraceId: 01k778hmey69azyg96w0b36626, Database: /Root, SessionId: ydb://session/3?node_id=1&id=MTgyYjg0ZTktYTViMGViMjQtOTk5MGQ4M2MtYzliMjQwOGM=, PoolId: }. UNAVAILABLE: Failed to send EvStartKqpTasksRequest because node is unavailable: 2
2025-10-10T14:31:37.219530Z node 1 :KQP_COMPUTE ERROR: dq_compute_actor_impl.h:1208: SelfId: [1:7559600702540500458:2892], TxId: 281474976720753, task: 2. Ctx: { TraceId : 01k778hmey69azyg96w0b36626.  CustomerSuppliedId : .  RunScriptActorId : [0:0:0].  PoolId : .  SessionId : ydb://session/3?node_id=1&id=MTgyYjg0ZTktYTViMGViMjQtOTk5MGQ4M2MtYzliMjQwOGM=.  CurrentExecutionId : .  Database : /Root.  DatabaseId : /Root. }. Handle abort execution event from: [1:7559600702540500451:2885], status: UNAVAILABLE, reason: { <main>: Error: Terminate execution }
2025-10-10T14:31:37.219544Z node 1 :KQP_COMPUTE ERROR: dq_compute_actor_impl.h:1208: SelfId: [1:7559600702540500459:2893], TxId: 281474976720753, task: 4. Ctx: { TraceId : 01k778hmey69azyg96w0b36626.  RunScriptActorId : [0:0:0].  CustomerSuppliedId : .  PoolId : .  SessionId : ydb://session/3?node_id=1&id=MTgyYjg0ZTktYTViMGViMjQtOTk5MGQ4M2MtYzliMjQwOGM=.  CurrentExecutionId : .  Database : /Root.  DatabaseId : /Root. }. Handle abort execution event from: [1:7559600702540500451:2885], status: UNAVAILABLE, reason: { <main>: Error: Terminate execution }
2025-10-10T14:31:37.472966Z :SimpleHandlers INFO: Random seed for debugging is 1760106697472962
2025-10-10T14:31:37.529563Z node 3 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[3:7559600701114446464:2156];send_to=[0:7307199536658146131:7762515];
2025-10-10T14:31:37.529597Z node 3 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-10-10T14:31:37.530689Z node 4 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[4:7559600701288421932:2147];send_to=[0:7307199536658146131:7762515];
2025-10-10T14:31:37.530707Z node 4 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-10-10T14:31:37.530827Z node 3 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
test_client.cpp: SetPath # /home/runner/.ya/build/build_root/z96o/002b37/r3tmp/tmpU1g7Pw/pdisk_1.dat
2025-10-10T14:31:37.530990Z node 3 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-10T14:31:37.532699Z node 4 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-10-10T14:31:37.533161Z node 4 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-10T14:31:37.543943Z node 3 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-10-10T14:31:37.545744Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(4, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-10T14:31:37.545760Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(4, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-10T14:31:37.546799Z node 3 :HIVE WARN: hive_impl.cpp:811: HIVE#72057594037968897 Handle TEvInterconnect::TEvNodeConnected, NodeId 4 Cookie 4
2025-10-10T14:31:37.547003Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(4, (0,0,0,0)) VolatileState: Connecting -> Connected
TServer::EnableGrpc on GrpcPort 11024, node 3
2025-10-10T14:31:37.552397Z node 3 :NET_CLASSIFIER WARN: net_classifier.cpp:190: distributable config is empty, broken or outdated, will use file: /home/runner/.ya/build/build_root/z96o/002b37/r3tmp/yandexANkmJm.tmp
2025-10-10T14:31:37.552404Z node 3 :NET_CLASSIFIER WARN: net_classifier.cpp:196: will try to initialize from file: /home/runner/.ya/build/build_root/z96o/002b37/r3tmp/yandexANkmJm.tmp
2025-10-10T14:31:37.552446Z node 3 :NET_CLASSIFIER WARN: net_classifier.cpp:202: successfully initialized from file: /home/runner/.ya/build/build_root/z96o/002b37/r3tmp/yandexANkmJm.tmp
2025-10-10T14:31:37.552485Z node 3 :NET_CLASSIFIER ERROR: net_classifier.cpp:228: got bad distributable configuration
2025-10-10T14:31:37.555742Z INFO: TTestServer started on Port 9715 GrpcPort 11024
TClient is connected to server localhost:9715
PQClient connected to localhost:11024
WaitRootIsUp 'Root'...
TClient::Ls request: Root
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "Root"
    PathId: 1
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 1
    CreateStep: 0
    ParentPathId: 1
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 1
      SubDomainVersion: 0
      SecurityStateVersion: 0
    }
    ChildrenExist: false
  }
  Children {
    Name: ".sys"
    PathId: 18446744073709551615
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 0
    CreateStep: 0
    ParentPathId: 18446744073709551615
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 0
      Pl...
(TRUNCATED)
WaitRootIsUp 'Root' success.
2025-10-10T14:31:37.571307Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpAlterSubDomain, opId: 281474976710657:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_alter_subdomain.cpp:311)
waiting...
waiting...
waiting...
waiting...
2025-10-10T14:31:37.631290Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(3, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-10T14:31:37.631319Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(3, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-10T14:31:37.632863Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(3, (0,0,0,0)) VolatileState: Connecting -> Connected
2025-10-10T14:31:37.770178Z node 3 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-10-10T14:31:37.776382Z node 4 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-10-10T14:31:37.831368Z node 3 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:566: Compilation failed, self: [3:7559600701114447277:2318], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-10T14:31:37.831981Z node 3 :KQP_SESSION WARN: kqp_session_actor.cpp:2408: SessionId: ydb://session/3?node_id=3&id=NWJlODAxYWMtODExYWJjYTYtN2IwOWYzZjctNjllYTQwNg==, ActorId: [3:7559600701114447274:2316], ActorState: ExecuteState, TraceId: 01k778hn32c6ynsz9fqea90vxq, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-10T14:31:37.832132Z node 3 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-10-10T14:31:37.834085Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710661:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-10T14:31:37.840738Z node 4 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:566: Compilation failed, self: [4:7559600701288422142:2289], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-10T14:31:37.840854Z node 4 :KQP_SESSION WARN: kqp_session_actor.cpp:2408: SessionId: ydb://session/3?node_id=4&id=YzEwZTQwNzYtZjljYTg5YTYtMmJjMjg2NTMtZTgzYzZiNWQ=, ActorId: [4:7559600701288422140:2288], ActorState: ExecuteState, TraceId: 01k778hn3c8wc92426qfqvcdtf, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-10T14:31:37.840997Z node 4 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-10-10T14:31:37.849930Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710662:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-10T14:31:37.872401Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710663:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
=== Init DC: UPSERT INTO `/Root/PQ/Config/V2/Cluster` (name, balancer, local, enabled, weight) VALUES ("dc1", "localhost:11024", true, true, 1000), ("dc2", "dc2.logbroker.yandex.net", false, false, 1000);
2025-10-10T14:31:37.909565Z node 3 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976710664. Ctx: { TraceId: 01k778hn4z7r7nc4yxsh8csnsn, Database: , SessionId: ydb://session/3?node_id=3&id=MzgzZGEyNWItNTg5OGI4MDktZWU5YmQ1ZTAtNmU0NjA3NzE=, PoolId: , DatabaseId: /Root}. Database not set, use /Root
=== CheckClustersList. Subcribe to ClusterTracker from [3:7559600701114447707:2932] 
2025-10-10T14:31:38.530695Z node 3 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-10-10T14:31:38.532217Z node 4 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-10-10T14:31:42.529930Z node 3 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[3:7559600701114446464:2156];send_to=[0:7307199536658146131:7762515];
2025-10-10T14:31:42.529960Z node 3 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
2025-10-10T14:31:42.530949Z node 4 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[4:7559600701288421932:2147];send_to=[0:7307199536658146131:7762515];
2025-10-10T14:31:42.530977Z node 4 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
=== CheckClustersList. Ok
2025-10-10T14:31:43.018515Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710676:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
waiting...
PQ Client: create topic: rt3.dc1--test-topic with 1 partitions
CallPersQueueGRPC request to localhost:11024
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-10T14:31:43.037237Z node 3 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
CallPersQueueGRPC request to localhost:11024
MetaRequest {
  CmdCreateTopic {
    Topic: "rt3.dc1--test-topic"
    NumPartitions: 1
    Config {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
  }
}
CallPersQueueGRPC response:
Status: 129
ProxyErrorCode: 53
SchemeStatus: 1
FlatTxId {
  TxId: 281474976710677
  SchemeShardTabletId: 72057594046644480
  PathId: 9
}
ErrorCode: OK
AddTopic: rt3.dc1--test-topic
===Run query:``DECLARE $version as Int64; DECLARE $path AS Utf8; DECLARE $cluster as Utf8; UPSERT INTO `/Root/PQ/Config/V2/Topics` (path, dc) VALUES ($path, $cluster); UPSERT INTO `/Root/PQ/Config/V2/Versions` (name, version) VALUES ("Topics", $version);`` with topic = test-topic, dc = dc1
2025-10-10T14:31:43.042819Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:43.043216Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][] pipe [3:7559600726884252035:3240] connected; active server actors: 1
2025-10-10T14:31:43.043480Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1517: [72075186224037893][rt3.dc1--test-topic] updating configuration. Deleted partitions []. Added partitions [0]
2025-10-10T14:31:43.043589Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:940: [72075186224037893][rt3.dc1--test-topic] Discovered subdomain [OwnerId: 72057594046644480, LocalPathId: 1] state, outOfSpace = 0 at RB 72075186224037893
2025-10-10T14:31:43.043590Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:43.043638Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:784: [PQ: 72075186224037892] no config, start with empty partitions and default config
2025-10-10T14:31:43.043651Z node 3 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:43.043658Z node 3 :PERSQUEUE INFO: pq_impl.cpp:609: [PQ: 72075186224037892] doesn't have tx writes info
2025-10-10T14:31:43.043751Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [3:7559600726884252034:3239], now have 1 active actors on pipe
2025-10-10T14:31:43.043938Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 3, Generation 1
2025-10-10T14:31:43.043943Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-10T14:31:43.043956Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [4:7559600727058226343:2370], now have 1 active actors on pipe
2025-10-10T14:31:43.044172Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:138: [72075186224037893][rt3.dc1--test-topic] BALANCER INIT DONE for rt3.dc1--test-topic: (0, 72075186224037892) 
2025-10-10T14:31:43.044658Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-10T14:31:43.047059Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [3:7559600726884252107:3295], now have 1 active actors on pipe
2025-10-10T14:31:43.047144Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-10T14:31:43.047947Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-10T14:31:43.048118Z node 3 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:43.048133Z node 3 :PERSQUEUE DEBUG: partition.cpp:1277: [72075186224037892][Partition][0][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-10-10T14:31:43.048184Z node 3 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:43.048222Z node 3 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [3:7559600726884252119:2448]
2025-10-10T14:31:43.048975Z node 3 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:43.048986Z node 3 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:43.048992Z node 3 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1 [3:7559600726884252119:2448]
2025-10-10T14:31:43.049000Z node 3 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-10-10T14:31:43.049296Z node 3 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 1
2025-10-10T14:31:43.049308Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:43.049325Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:43.049353Z node 3 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:43.049358Z node 3 :PERSQUEUE DEBUG: partition.cpp:2345: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-10T14:31:43.049360Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:43.049362Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:43.049363Z node 3 :PERSQUEUE DEBUG: partition.cpp:2345: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-10T14:31:43.049373Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:43.049438Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-10T14:31:43.049470Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
===Query complete
TClient::Ls request: /Root/PQ/rt3.dc1--test-topic
2025-10-10T14:31:43.050304Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-10T14:31:43.050359Z node 3 :PERSQUEUE DEBUG: partition.cpp:1381: [72075186224037892][Partition][0][StateIdle] Handle TEvPQ::TEvTxCommit Step 1760106703096, TxId 281474976710677
2025-10-10T14:31:43.050364Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:43.050366Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:43.050390Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:43.050425Z node 3 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:31:43.050843Z node 3 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:31:43.050882Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:31:43.050890Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:43.050891Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:43.050893Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:43.050897Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:31:43.051018Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:395: [PQ: 72075186224037892] Apply new config PartitionConfig { LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 } PartitionIds: 0 TopicName: "rt3.dc1--test-topic" Version: 0 LocalDC: true Codecs { Ids: 0 Ids: 1 Ids: 2 Codecs: "raw" Codecs: "gzip" Codecs: "lzop" } TopicPath: "/Root/PQ/rt3.dc1--test-topic" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } Consumers { Name: "user" ReadFromTimestampsMs: 0 FormatVersion: 0 Version: 0 Generation: 0 } MonitoringProjectId: ""
2025-10-10T14:31:43.051035Z node 3 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:43.051071Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-10T14:31:43.051944Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-10T14:31:43.051959Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-10T14:31:43.052358Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-10T14:31:43.056605Z node 3 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976710678. Ctx: { TraceId: 01k778ht6167bx0nrqwj8ja7v1, Database: , SessionId: ydb://session/3?node_id=3&id=ZDk3NGZkMDEtYzk3N2VlNzItNGExZWVhY2YtMmViMjcxOQ==, PoolId: , DatabaseId: /Root}. Database not set, use /Root
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976710677
    CreateStep: 1760106703096
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: ...
(TRUNCATED)
GetTopicVersionFromPath:  record Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976710677
    CreateStep: 1760106703096
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      YdbDatabasePath: "/Root"
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
    Partitions {
      PartitionId: 0
      TabletId: 72075186224037892
      Status: Active
    }
    AlterVersion: 1
    BalancerTabletID: 72075186224037893
    NextPartitionId: 1
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 1
      PlanResolution: 7
      Coordinators: 72057594046316545
      TimeCastBucketsPerMediator: 2
      Mediators: 72057594046382081
    }
    DomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    PathsInside: 8
    PathsLimit: 10000
    ShardsInside: 6
    ShardsLimit: 200000
    ResourcesDomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    DiskSpaceUsage {
      Tables {
        TotalSize: 0
        DataSize: 0
        IndexSize: 0
      }
      Topics {
        ReserveSize: 0
        AccountSize: 0
        DataSize: 0
        UsedReserveSize: 0
      }
    }
    PQPartitionsInside: 1
    PQPartitionsLimit: 1000000
    SchemeLimits {
      MaxDepth: 32
      MaxPaths: 10000
      MaxChildrenInDir: 100000
      MaxAclBytesSize: 10240
      MaxTableColumns: 200
      MaxTableColumnNameLength: 255
      MaxTableKeyColumns: 30
      MaxTableIndices: 20
      MaxShards: 200000
      MaxShardsInPath: 35000
      MaxConsistentCopyTargets: 10000
      MaxPathElementLength: 255
      ExtraPathSymbolsAllowed: "!\"#$%&\'()*+,-.:;<=>?@[\\]^_`{|}~"
      MaxPQPartitions: 1000000
      MaxTableCdcStreams: 5
      MaxExports: 10
      MaxImports: 10
      MaxColumnTableColumns: 10000
    }
  }
}
Path: "/Root/PQ/rt3.dc1--test-topic"
 name rt3.dc1--test-topic version1
CallPersQueueGRPC request to localhost:11024
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-10T14:31:43.074097Z node 3 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-10-10T14:31:43.149460Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:43.149475Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:43.149478Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:43.249827Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:43.249842Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:43.249845Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:43.350193Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:43.350211Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:43.350214Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:43.450533Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:43.450552Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:43.450555Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:43.550861Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:43.550878Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:43.550880Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:11024
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-10T14:31:43.575178Z node 3 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-10-10T14:31:43.651228Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:43.651244Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:43.651245Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:43.751573Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:43.751586Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:43.751588Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:43.851922Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:43.851934Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:43.851936Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:43.952269Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:43.952282Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:43.952284Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:44.052624Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:44.052639Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:44.052642Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:11024
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-10T14:31:44.076721Z node 3 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--test-topic"
      NumPartitions: 1
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        TopicPath: "/Root/PQ/rt3.dc1--test-topic"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Version: 0
        }
      }
      ErrorCode: OK
    }
  }
}
=== Topic created, have version: 1
2025-10-10T14:31:44.077790Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: try to update token
2025-10-10T14:31:44.078014Z :INFO: [] MessageGroupId [src] SessionId [] Write session: Do CDS request
2025-10-10T14:31:44.078020Z :INFO: [] MessageGroupId [src] SessionId [] Start write session. Will connect to endpoint: localhost:11024
2025-10-10T14:31:44.078399Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src" }
2025-10-10T14:31:44.078564Z node 3 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:44.078576Z node 3 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1
2025-10-10T14:31:44.078656Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src" }
2025-10-10T14:31:44.078681Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1 topic: "test-topic" message_group_id: "src" from ipv6:[::1]:39668
2025-10-10T14:31:44.078690Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:39668 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:44.078693Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:44.079025Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1 sessionId:  describe result for acl check
2025-10-10T14:31:44.079062Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:44.079067Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:44.079069Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:44.079073Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [3:7559600731179219612:2485] (SourceId=src, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:44.079541Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [3:7559600731179219612:2485] (SourceId=src, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:44.096490Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [3:7559600731179219612:2485] (SourceId=src, PreferedPartition=(NULL)) RequestPQRB
2025-10-10T14:31:44.096590Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [3:7559600731179219646:2485] connected; active server actors: 1
2025-10-10T14:31:44.096705Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [3:7559600731179219612:2485] (SourceId=src, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=src
2025-10-10T14:31:44.096712Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [3:7559600731179219612:2485] (SourceId=src, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:44.096789Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [3:7559600731179219646:2485] disconnected; active server actors: 1
2025-10-10T14:31:44.096799Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--test-topic] pipe [3:7559600731179219646:2485] disconnected no session
2025-10-10T14:31:44.111588Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [3:7559600731179219612:2485] (SourceId=src, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:44.111606Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [3:7559600731179219612:2485] (SourceId=src, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-10-10T14:31:44.111610Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [3:7559600731179219612:2485] (SourceId=src, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:44.111618Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:44.111764Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 3, Generation: 1
2025-10-10T14:31:44.111769Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [3:7559600731179219661:2485], now have 1 active actors on pipe
2025-10-10T14:31:44.111775Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.111780Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.111804Z node 3 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src|15af6916-a3721da8-310d9d1b-da44f27b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src
2025-10-10T14:31:44.111817Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:44.111822Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:44.111824Z node 3 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:44.111846Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:44.111861Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:44.111878Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:44.111916Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.111926Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.111949Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:44.111986Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1 partition: 0 MaxSeqNo: 0 sessionId: src|15af6916-a3721da8-310d9d1b-da44f27b_0
2025-10-10T14:31:44.112349Z :INFO: [] MessageGroupId [src] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1760106704112 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-10T14:31:44.112416Z :INFO: [] MessageGroupId [src] SessionId [] Write session established. Init response: session_id: "src|15af6916-a3721da8-310d9d1b-da44f27b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:44.112531Z :INFO: [] MessageGroupId [src] SessionId [src|15af6916-a3721da8-310d9d1b-da44f27b_0] Write session: close. Timeout = 0 ms
2025-10-10T14:31:44.112545Z :INFO: [] MessageGroupId [src] SessionId [src|15af6916-a3721da8-310d9d1b-da44f27b_0] Write session will now close
2025-10-10T14:31:44.112551Z :DEBUG: [] MessageGroupId [src] SessionId [src|15af6916-a3721da8-310d9d1b-da44f27b_0] Write session: aborting
2025-10-10T14:31:44.112663Z :INFO: [] MessageGroupId [src] SessionId [src|15af6916-a3721da8-310d9d1b-da44f27b_0] Write session: gracefully shut down, all writes complete
2025-10-10T14:31:44.112667Z :DEBUG: [] MessageGroupId [src] SessionId [src|15af6916-a3721da8-310d9d1b-da44f27b_0] Write session: destroy
2025-10-10T14:31:44.112786Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId: src|15af6916-a3721da8-310d9d1b-da44f27b_0 grpc read done: success: 0 data: 
2025-10-10T14:31:44.112794Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 1 sessionId: src|15af6916-a3721da8-310d9d1b-da44f27b_0 grpc read failed
2025-10-10T14:31:44.112800Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 1 sessionId: src|15af6916-a3721da8-310d9d1b-da44f27b_0 grpc closed
2025-10-10T14:31:44.112806Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1 sessionId: src|15af6916-a3721da8-310d9d1b-da44f27b_0 is DEAD
2025-10-10T14:31:44.113041Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-10-10T14:31:44.113119Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [3:7559600731179219661:2485] destroyed
2025-10-10T14:31:44.113132Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-10-10T14:31:44.113141Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:44.113143Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:44.113146Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
>>> Session was created
2025-10-10T14:31:44.152993Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:44.153010Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:44.153013Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
>>> Ready to answer: ok
2025-10-10T14:31:44.176675Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [] Write session: try to update token
2025-10-10T14:31:44.180287Z :INFO: [/Root] MessageGroupId [src_id] SessionId [] Write session: Do CDS request
2025-10-10T14:31:44.180314Z :INFO: [/Root] MessageGroupId [src_id] SessionId [] Start write session. Will connect to endpoint: localhost:11024
2025-10-10T14:31:44.180613Z :INFO: [/Root] [] [24db9b9d-69f1782b-ab8b7404-3a0423d6] Open read subsessions to databases: { name: dc1, endpoint: localhost:11024, path: /Root }, { name: dc2, endpoint: localhost:11024, path: /Root }, { name: dc3, endpoint: localhost:11024, path: /Root }
2025-10-10T14:31:44.182080Z :INFO: [/Root] [/Root] [5f0e011-85f0ac12-a238a939-c9adead4] Starting read session
2025-10-10T14:31:44.182089Z :DEBUG: [/Root] [/Root] [5f0e011-85f0ac12-a238a939-c9adead4] Starting single session
2025-10-10T14:31:44.182311Z :DEBUG: [/Root] [/Root] [5f0e011-85f0ac12-a238a939-c9adead4] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-10T14:31:44.182315Z :DEBUG: [/Root] [/Root] [5f0e011-85f0ac12-a238a939-c9adead4] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-10T14:31:44.182318Z :DEBUG: [/Root] [/Root] [5f0e011-85f0ac12-a238a939-c9adead4] [] Reconnecting session to cluster  in 0.000000s
2025-10-10T14:31:44.229828Z :INFO: [/Root] [/Root] [58801aae-576286d5-532f2de5-974b64be] Starting read session
2025-10-10T14:31:44.229841Z :DEBUG: [/Root] [/Root] [58801aae-576286d5-532f2de5-974b64be] Starting single session
2025-10-10T14:31:44.229868Z :DEBUG: [/Root] [/Root] [58801aae-576286d5-532f2de5-974b64be] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-10T14:31:44.229871Z :DEBUG: [/Root] [/Root] [58801aae-576286d5-532f2de5-974b64be] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-10T14:31:44.229875Z :DEBUG: [/Root] [/Root] [58801aae-576286d5-532f2de5-974b64be] [] Reconnecting session to cluster  in 0.000000s
2025-10-10T14:31:44.230060Z :DEBUG: [/Root] [/Root] [5f0e011-85f0ac12-a238a939-c9adead4] [] Successfully connected. Initializing session
2025-10-10T14:31:44.230108Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:44.230123Z :INFO: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] Starting read session
2025-10-10T14:31:44.230127Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] Starting single session
2025-10-10T14:31:44.230128Z :DEBUG: [/Root] [/Root] [58801aae-576286d5-532f2de5-974b64be] [] Successfully connected. Initializing session
2025-10-10T14:31:44.230139Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-10T14:31:44.230141Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-10T14:31:44.230143Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Reconnecting session to cluster  in 0.000000s
2025-10-10T14:31:44.230213Z node 3 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:44.230230Z node 3 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2
2025-10-10T14:31:44.230321Z node 3 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-10T14:31:44.230328Z node 3 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 1
2025-10-10T14:31:44.230375Z node 3 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-10T14:31:44.230380Z node 3 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 2
2025-10-10T14:31:44.230494Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Successfully connected. Initializing session
2025-10-10T14:31:44.230693Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:44.230732Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:46198
2025-10-10T14:31:44.230738Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:46198 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:44.230741Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:44.232318Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 2 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-10T14:31:44.232322Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-10T14:31:44.232367Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 2 consumer shared/user session shared/user_3_2_4696609365094200052_v1 read init: from# ipv6:[::1]:46198, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-10T14:31:44.232376Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 1 consumer shared/user session shared/user_3_1_16103991684086808299_v1 read init: from# ipv6:[::1]:46198, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-10T14:31:44.232459Z node 3 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 2 consumer shared/user session shared/user_3_2_4696609365094200052_v1 auth for : user
2025-10-10T14:31:44.232466Z node 3 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 1 consumer shared/user session shared/user_3_1_16103991684086808299_v1 auth for : user
2025-10-10T14:31:44.232478Z node 3 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-10T14:31:44.232480Z node 3 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 3
2025-10-10T14:31:44.232566Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 3 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-10T14:31:44.232605Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 read init: from# ipv6:[::1]:46198, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-10T14:31:44.232659Z node 3 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 auth for : user
2025-10-10T14:31:44.232669Z node 3 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 1 consumer shared/user session shared/user_3_1_16103991684086808299_v1 Handle describe topics response
2025-10-10T14:31:44.232683Z node 3 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 1 consumer shared/user session shared/user_3_1_16103991684086808299_v1 auth is DEAD
2025-10-10T14:31:44.232710Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 1 consumer shared/user session shared/user_3_1_16103991684086808299_v1 auth ok: topics# 1, initDone# 0
2025-10-10T14:31:44.232796Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2 sessionId:  describe result for acl check
2025-10-10T14:31:44.232827Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:44.232833Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:44.232834Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:44.233073Z :INFO: [/Root] [/Root] [5f0e011-85f0ac12-a238a939-c9adead4] [] Got InitResponse. ReadSessionId: shared/user_3_1_16103991684086808299_v1
2025-10-10T14:31:44.233241Z :INFO: [/Root] [/Root] [58801aae-576286d5-532f2de5-974b64be] [] Got InitResponse. ReadSessionId: shared/user_3_2_4696609365094200052_v1
2025-10-10T14:31:44.232838Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [3:7559600731179219685:2502] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:44.281001Z :DEBUG: [/Root] [/Root] [58801aae-576286d5-532f2de5-974b64be] [] In ContinueReadingDataImpl, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-10T14:31:44.238915Z :INFO: [/Root] MessageGroupId [src_id] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1760106704238 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-10T14:31:44.232850Z node 3 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 2 consumer shared/user session shared/user_3_2_4696609365094200052_v1 Handle describe topics response
2025-10-10T14:31:44.232860Z node 3 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 2 consumer shared/user session shared/user_3_2_4696609365094200052_v1 auth is DEAD
2025-10-10T14:31:44.280987Z :DEBUG: [/Root] [/Root] [5f0e011-85f0ac12-a238a939-c9adead4] [] In ContinueReadingDataImpl, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-10T14:31:44.233314Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [3:7559600731179219686:2503] connected; active server actors: 1
2025-10-10T14:31:44.232956Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 1 consumer shared/user session shared/user_3_1_16103991684086808299_v1 register session: topic# rt3.dc1--test-topic
2025-10-10T14:31:44.233005Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 2 consumer shared/user session shared/user_3_2_4696609365094200052_v1 auth ok: topics# 1, initDone# 0
2025-10-10T14:31:44.233135Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 2 consumer shared/user session shared/user_3_2_4696609365094200052_v1 register session: topic# rt3.dc1--test-topic
2025-10-10T14:31:44.233207Z node 3 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 Handle describe topics response
2025-10-10T14:31:44.233220Z node 3 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 auth is DEAD
2025-10-10T14:31:44.233231Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 auth ok: topics# 1, initDone# 0
2025-10-10T14:31:44.281070Z :INFO: [/Root] MessageGroupId [src_id] SessionId [] Write session established. Init response: session_id: "src_id|cf451f1-c205e716-2df7cd75-d9af365e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:44.233389Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [3:7559600731179219685:2502] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:44.233429Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 register session: topic# rt3.dc1--test-topic
2025-10-10T14:31:44.233800Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 1 consumer shared/user session shared/user_3_1_16103991684086808299_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 1 Session: "shared/user_3_1_16103991684086808299_v1" ClientId: "user" PipeClient { RawX1: 7559600731179219686 RawX2: 4503612512274887 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-10T14:31:44.233815Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1576: session cookie 1 consumer shared/user session shared/user_3_1_16103991684086808299_v1 gone release: partition# 0
2025-10-10T14:31:44.233820Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:1561: session cookie 1 consumer shared/user session shared/user_3_1_16103991684086808299_v1 releasing: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-10T14:31:44.233823Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:1721: session cookie 1 consumer shared/user session shared/user_3_1_16103991684086808299_v1 got all from client, actual releasing: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-10T14:31:44.281099Z :DEBUG: [/Root] [/Root] [5f0e011-85f0ac12-a238a939-c9adead4] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-10T14:31:44.233826Z node 3 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 1 consumer shared/user session shared/user_3_1_16103991684086808299_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-10T14:31:44.233827Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:1639: session cookie 1 consumer shared/user session shared/user_3_1_16103991684086808299_v1 released: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-10T14:31:44.234074Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 2 Session: "shared/user_3_3_5041631794065863042_v1" ClientId: "user" PipeClient { RawX1: 7559600731179219691 RawX2: 4503612512274891 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-10T14:31:44.234085Z node 3 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-10T14:31:44.234132Z node 3 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 1, pipe: [3:7559600731179219704:2516]
2025-10-10T14:31:44.234137Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [3:7559600731179219704:2516], now have 1 active actors on pipe
2025-10-10T14:31:44.233346Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [3:7559600731179219687:2504] connected; active server actors: 1
2025-10-10T14:31:44.234142Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.234147Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.234157Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_3_3_5041631794065863042_v1 on pipe: [3:7559600731179219704:2516]
2025-10-10T14:31:44.233440Z node 4 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [3:7559600731179219686:2503] session shared/user_3_1_16103991684086808299_v1
2025-10-10T14:31:44.233449Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-10-10T14:31:44.234168Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:44.234174Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:44.233458Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-10-10T14:31:44.234175Z node 3 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:44.281146Z :INFO: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Got InitResponse. ReadSessionId: shared/user_3_3_5041631794065863042_v1
2025-10-10T14:31:44.281167Z :DEBUG: [/Root] [/Root] [58801aae-576286d5-532f2de5-974b64be] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-10T14:31:44.281669Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] In ContinueReadingDataImpl, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-10T14:31:44.234200Z node 3 :PERSQUEUE DEBUG: partition.cpp:3747: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_3_3_5041631794065863042_v1
2025-10-10T14:31:44.281204Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 1 to 1
2025-10-10T14:31:44.233475Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_3_1_16103991684086808299_v1" (Sender=[3:7559600731179219676:2503], Pipe=[3:7559600731179219686:2503], Partitions=[], ActiveFamilyCount=0)
2025-10-10T14:31:44.233479Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-10T14:31:44.234203Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:44.233488Z node 4 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [3:7559600731179219687:2504] session shared/user_3_2_4696609365094200052_v1
2025-10-10T14:31:44.234230Z node 3 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:31:44.234343Z node 3 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_3_3_5041631794065863042_v1:1 with generation 1
2025-10-10T14:31:44.281713Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-10T14:31:44.234709Z node 3 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:31:44.233492Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_3_2_4696609365094200052_v1" (Sender=[3:7559600731179219677:2504], Pipe=[3:7559600731179219687:2504], Partitions=[], ActiveFamilyCount=0)
2025-10-10T14:31:44.234730Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:31:44.281720Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.233496Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [3:7559600731179219691:2507] connected; active server actors: 1
2025-10-10T14:31:44.234736Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:44.281728Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 1
2025-10-10T14:31:44.233504Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=2, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-10-10T14:31:44.233513Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_3_1_16103991684086808299_v1" (Sender=[3:7559600731179219676:2503], Pipe=[3:7559600731179219686:2503], Partitions=[], ActiveFamilyCount=0)
2025-10-10T14:31:44.234737Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:44.234738Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:44.233523Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_3_1_16103991684086808299_v1" sender [3:7559600731179219676:2503] lock partition 0 for ReadingSession "shared/user_3_1_16103991684086808299_v1" (Sender=[3:7559600731179219676:2503], Pipe=[3:7559600731179219686:2503], Partitions=[], ActiveFamilyCount=1) generation 1 step 1
2025-10-10T14:31:44.234743Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:31:44.233538Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=2, desiredFamilyCount=0, allowPlusOne=1
2025-10-10T14:31:44.234752Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-10T14:31:44.233543Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000036s
2025-10-10T14:31:44.234787Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 0 SizeLag: 0 WriteTimestampEstimateMS: 1760106704152 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-10T14:31:44.233607Z node 4 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [3:7559600731179219691:2507] session shared/user_3_3_5041631794065863042_v1
2025-10-10T14:31:44.234793Z node 3 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 0 readOffset 0 committedOffset 0
2025-10-10T14:31:44.233611Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_3_3_5041631794065863042_v1" (Sender=[3:7559600731179219680:2507], Pipe=[3:7559600731179219691:2507], Partitions=[], ActiveFamilyCount=0)
2025-10-10T14:31:44.234808Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 sending to client partition status
2025-10-10T14:31:44.281773Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 2 to 2
2025-10-10T14:31:44.235141Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [3:7559600731179219685:2502] (SourceId=src_id, PreferedPartition=(NULL)) RequestPQRB
2025-10-10T14:31:44.281780Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.235322Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [3:7559600731179219685:2502] (SourceId=src_id, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=src_id
2025-10-10T14:31:44.235325Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [3:7559600731179219685:2502] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:44.238350Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [3:7559600731179219685:2502] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:44.282050Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 2
2025-10-10T14:31:44.238368Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [3:7559600731179219685:2502] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-10-10T14:31:44.238371Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [3:7559600731179219685:2502] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:44.238378Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:44.281866Z :INFO: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Confirm partition stream create. Partition stream id: 1. Cluster: "-". Topic: "test-topic". Partition: 0. Read offset: (NULL)
2025-10-10T14:31:44.233614Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-10T14:31:44.238496Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 3, Generation: 1
2025-10-10T14:31:44.238507Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [3:7559600731179219726:2502], now have 1 active actors on pipe
2025-10-10T14:31:44.233619Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=3, Families=1, UnradableFamilies=0 [], RequireBalancing=0 []
2025-10-10T14:31:44.238513Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.233622Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=3, desiredFamilyCount=0, allowPlusOne=1
2025-10-10T14:31:44.238518Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.233629Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:175: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_3_1_16103991684086808299_v1" sender [3:7559600731179219676:2503]  release partitions [0]. Target status Free
2025-10-10T14:31:44.238543Z node 3 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:44.233638Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000016s
2025-10-10T14:31:44.238553Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:44.238558Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:44.233891Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1606: [72075186224037893][rt3.dc1--test-topic] client user released partition from pipe [3:7559600731179219686:2503] session shared/user_3_1_16103991684086808299_v1 partition 0
2025-10-10T14:31:44.238560Z node 3 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:44.238572Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:44.238584Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:44.233897Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-10T14:31:44.238599Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:44.238649Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.233901Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=3, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-10-10T14:31:44.238652Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.238663Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:44.233906Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_3_3_5041631794065863042_v1" (Sender=[3:7559600731179219680:2507], Pipe=[3:7559600731179219691:2507], Partitions=[], ActiveFamilyCount=0)
2025-10-10T14:31:44.238691Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2 partition: 0 MaxSeqNo: 0 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0
2025-10-10T14:31:44.253352Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:44.233912Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_3_3_5041631794065863042_v1" sender [3:7559600731179219680:2507] lock partition 0 for ReadingSession "shared/user_3_3_5041631794065863042_v1" (Sender=[3:7559600731179219680:2507], Pipe=[3:7559600731179219691:2507], Partitions=[], ActiveFamilyCount=1) generation 1 step 2
2025-10-10T14:31:44.253359Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:44.233921Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=3, desiredFamilyCount=0, allowPlusOne=1
2025-10-10T14:31:44.253362Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:44.233923Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000021s
2025-10-10T14:31:44.281390Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 2 consumer shared/user session shared/user_3_2_4696609365094200052_v1 grpc read done: success# 1, data# { read_request { bytes_size: 524288 } }
2025-10-10T14:31:44.235232Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [3:7559600731179219717:2502] connected; active server actors: 1
2025-10-10T14:31:44.282136Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 3 to 3
2025-10-10T14:31:44.281401Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_3_1_16103991684086808299_v1 grpc read done: success# 1, data# { read_request { bytes_size: 524288 } }
2025-10-10T14:31:44.235391Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [3:7559600731179219717:2502] disconnected; active server actors: 1
2025-10-10T14:31:44.282455Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.235393Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--test-topic] pipe [3:7559600731179219717:2502] disconnected no session
2025-10-10T14:31:44.282458Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 3
2025-10-10T14:31:44.281430Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 2 consumer shared/user session shared/user_3_2_4696609365094200052_v1 got read request: guid# b448a5c0-c631872e-c297149f-7948fb9f
2025-10-10T14:31:44.281439Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_3_1_16103991684086808299_v1 got read request: guid# 2d9bd84f-645c3ac-31a124f-e25699f8
2025-10-10T14:31:44.281924Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 grpc read done: success# 1, data# { read_request { bytes_size: 524288 } }
2025-10-10T14:31:44.281929Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.281993Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.282022Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 got read request: guid# f89f41ef-38e8875e-5572ea70-9f141916
2025-10-10T14:31:44.282084Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.282094Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.282129Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:31:44.282145Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.282180Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.282183Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.282194Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.282267Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.282314Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 1 partNo : 0 messageNo: 1 size 82 offset: -1
2025-10-10T14:31:44.282321Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.282323Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.282329Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 grpc read done: success# 1, data# { start_partition_session_response { partition_session_id: 1 } }
2025-10-10T14:31:44.282329Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.282342Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:44.282350Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:44.282362Z node 3 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:44.282376Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:539: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 got StartRead from client: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 0, commitOffset# (empty maybe)
2025-10-10T14:31:44.282384Z node 3 :PQ_READ_PROXY INFO: partition_actor.cpp:1023: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 Start reading TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 0 readOffset 0 committedOffset 0 clientCommitOffset (empty maybe) clientReadOffset 0
2025-10-10T14:31:44.282389Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 1 from offset 0
2025-10-10T14:31:44.282515Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 4 to 4
2025-10-10T14:31:44.282394Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 1 partNo 0
2025-10-10T14:31:44.282453Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 1 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 156 count 1 nextOffset 1 batches 1
2025-10-10T14:31:44.282520Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.282459Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:44.282522Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 4
2025-10-10T14:31:44.282513Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 0,1 HeadOffset 0 endOffset 0 curOffset 1 d0000000000_00000000000000000000_00000_0000000001_00000? size 142 WTime 1760106704282
2025-10-10T14:31:44.282548Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 5 to 5
2025-10-10T14:31:44.282551Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.282553Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 5
2025-10-10T14:31:44.282544Z node 3 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:31:44.282564Z node 3 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 0 partNo 0 count 1 size 142
2025-10-10T14:31:44.282573Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 2  requestId: <none> cookie: 2
2025-10-10T14:31:44.282577Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.282582Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.282624Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.282655Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.282661Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.282754Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.282757Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.282766Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 2 partNo : 0 messageNo: 3 size 192 offset: -1
2025-10-10T14:31:44.282770Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.282773Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.282777Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.282778Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.282782Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.282788Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.282794Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 4  requestId: <none> cookie: 3
2025-10-10T14:31:44.282802Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 5  requestId: <none> cookie: 4
2025-10-10T14:31:44.282899Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 6 to 6
2025-10-10T14:31:44.282905Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.282906Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 6
2025-10-10T14:31:44.282806Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.282911Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 7 to 7
2025-10-10T14:31:44.282811Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.282829Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.282830Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.282834Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 3 partNo : 0 messageNo: 6 size 303 offset: -1
2025-10-10T14:31:44.282837Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.282838Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.282841Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 4 partNo : 0 messageNo: 7 size 413 offset: -1
2025-10-10T14:31:44.282925Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.282930Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 7
2025-10-10T14:31:44.282843Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.282845Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.282846Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.282848Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.282983Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.283080Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 8 to 8
2025-10-10T14:31:44.283092Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.283096Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 8
2025-10-10T14:31:44.283087Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.283125Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 9 to 9
2025-10-10T14:31:44.283108Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.283129Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.283131Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 9
2025-10-10T14:31:44.283116Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.283127Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 8  requestId: <none> cookie: 5
2025-10-10T14:31:44.283137Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.283152Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 10 to 10
2025-10-10T14:31:44.283155Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.283207Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.283221Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.283227Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.283237Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.283312Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.283241Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 5 partNo : 0 messageNo: 9 size 523 offset: -1
2025-10-10T14:31:44.283321Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 10
2025-10-10T14:31:44.283247Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.283249Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.283255Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.283264Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.283274Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 10  requestId: <none> cookie: 6
2025-10-10T14:31:44.283283Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.283292Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.283298Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.283314Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.283317Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.283322Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 6 partNo : 0 messageNo: 11 size 633 offset: -1
2025-10-10T14:31:44.283325Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.283325Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.283329Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.283329Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.283337Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.283340Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.283344Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.283347Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.283353Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 12  requestId: <none> cookie: 7
2025-10-10T14:31:44.283356Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 13  requestId: <none> cookie: 8
2025-10-10T14:31:44.283360Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.283365Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.283372Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.283374Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.283376Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.283380Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 7 partNo : 0 messageNo: 14 size 743 offset: -1
2025-10-10T14:31:44.283384Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.283386Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.283389Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.283400Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 11 to 11
2025-10-10T14:31:44.283391Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.283410Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.283396Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 8 partNo : 0 messageNo: 15 size 853 offset: -1
2025-10-10T14:31:44.283412Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 11
2025-10-10T14:31:44.283400Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.283402Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.283406Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.283409Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.283447Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 12 to 12
2025-10-10T14:31:44.283464Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 0 count 1 size 142 actorID [3:7559600726884252064:2448]
2025-10-10T14:31:44.283476Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.283811Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.283477Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 16  requestId: <none> cookie: 9
2025-10-10T14:31:44.283815Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 12
2025-10-10T14:31:44.283481Z node 3 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:31:44.283496Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63' size 142
2025-10-10T14:31:44.283497Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 89 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:31:44.283504Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.283510Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.283511Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 1, partNo: 0, Offset: 0 is stored on disk
2025-10-10T14:31:44.283516Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.283521Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.283542Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:44.283548Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:44.283552Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:44.283561Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:44.283563Z node 3 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (7)
2025-10-10T14:31:44.283565Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.283578Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 2 partNo 0
2025-10-10T14:31:44.283581Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 0 EndOffset 0 newEndOffset 1 commitOffset 0 clientCommitOffset 0 cookie 1 readingFinished 0 firstRead 1
2025-10-10T14:31:44.283585Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 0 endOffset 1
2025-10-10T14:31:44.283601Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 0, endOffset# 1, WTime# 0, sizeLag# 142
2025-10-10T14:31:44.283603Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1TEvPartitionReady. Aval parts: 1
2025-10-10T14:31:44.283605Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 2 partNo 0 FormedBlobsCount 0 NewHead: Offset 1 PartNo 0 PackedSize 266 count 1 nextOffset 2 batches 1
2025-10-10T14:31:44.283611Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 3 partNo 0
2025-10-10T14:31:44.283616Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 3 partNo 0 FormedBlobsCount 0 NewHead: Offset 1 PartNo 0 PackedSize 611 count 2 nextOffset 3 batches 1
2025-10-10T14:31:44.283617Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 performing read request: guid# 76990d5a-397a34d7-b6df2f9f-3070caca, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 1, size# 170, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-10T14:31:44.283620Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 4 partNo 0
2025-10-10T14:31:44.283890Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 13 to 13
2025-10-10T14:31:44.283898Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.283900Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 13
2025-10-10T14:31:44.283625Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 4 partNo 0 FormedBlobsCount 0 NewHead: Offset 1 PartNo 0 PackedSize 1066 count 3 nextOffset 4 batches 1
2025-10-10T14:31:44.283628Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 5 partNo 0
2025-10-10T14:31:44.283632Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 5 partNo 0 FormedBlobsCount 0 NewHead: Offset 1 PartNo 0 PackedSize 1631 count 4 nextOffset 5 batches 1
2025-10-10T14:31:44.283635Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 6 partNo 0
2025-10-10T14:31:44.283949Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session got write response: sequence_numbers: 1 offsets: 0 already_written: false write_statistics { persist_duration_ms: 1 }
2025-10-10T14:31:44.284322Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: acknoledged message 1
2025-10-10T14:31:44.284323Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Got ReadResponse, serverBytesSize = 171, now ReadSizeBudget = 0, ReadSizeServerDelta = 524117
2025-10-10T14:31:44.283640Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 6 partNo 0 FormedBlobsCount 0 NewHead: Offset 1 PartNo 0 PackedSize 2306 count 5 nextOffset 6 batches 1
2025-10-10T14:31:44.283643Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 7 partNo 0
2025-10-10T14:31:44.283647Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 7 partNo 0 FormedBlobsCount 0 NewHead: Offset 1 PartNo 0 PackedSize 3091 count 6 nextOffset 7 batches 1
2025-10-10T14:31:44.283648Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 1 maxSize 170 maxTimeLagMs 0 readTimestampMs 0 readOffset 0 EndOffset 1 ClientCommitOffset 0 committedOffset 0 Guid 76990d5a-397a34d7-b6df2f9f-3070caca
2025-10-10T14:31:44.283650Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 8 partNo 0
2025-10-10T14:31:44.283654Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 8 partNo 0 FormedBlobsCount 0 NewHead: Offset 1 PartNo 0 PackedSize 3986 count 7 nextOffset 8 batches 1
2025-10-10T14:31:44.283657Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:44.283708Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 1,7 HeadOffset 1 endOffset 1 curOffset 8 d0000000000_00000000000000000001_00000_0000000007_00000? size 3821 WTime 1760106704283
2025-10-10T14:31:44.283724Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:182: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:31:44.283731Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-10-10T14:31:44.284348Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] In ContinueReadingDataImpl, ReadSizeBudget = 0, ReadSizeServerDelta = 524117
2025-10-10T14:31:44.283742Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.283744Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.283747Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.283752Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 9 partNo : 0 messageNo: 17 size 963 offset: -1
2025-10-10T14:31:44.283759Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.283761Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.283765Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.283767Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.283779Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.283781Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.283796Z node 3 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:31:44.283806Z node 3 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 1 partNo 0 count 7 size 3821
2025-10-10T14:31:44.283811Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.283815Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.283859Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 1 max time lag 0ms effective offset 0
2025-10-10T14:31:44.283873Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 142 count 1 last offset 0, current partition end offset: 1
2025-10-10T14:31:44.283876Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:44.283881Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 18  requestId: <none> cookie: 10
2025-10-10T14:31:44.283890Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 19  requestId: <none> cookie: 11
2025-10-10T14:31:44.283899Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.283904Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.283911Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 0 partno 0 count 1 parts_count 0 source 1 size 142 accessed 0 times before, last time 2025-10-10T14:31:44.000000Z
2025-10-10T14:31:44.283914Z node 3 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 3. All 1 blobs are from cache.
2025-10-10T14:31:44.283921Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 4 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 170 endOffset 1 max time lag 0ms effective offset 0
2025-10-10T14:31:44.283931Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 4 added 1 blobs, size 142 count 1 last offset 0, current partition end offset: 1
2025-10-10T14:31:44.283932Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 4. Send blob request.
2025-10-10T14:31:44.284419Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (0-0)
2025-10-10T14:31:44.283933Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63'
2025-10-10T14:31:44.284432Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Returning serverBytesSize = 171 to budget
2025-10-10T14:31:44.283938Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:31:44.284713Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] In ContinueReadingDataImpl, ReadSizeBudget = 171, ReadSizeServerDelta = 524117
2025-10-10T14:31:44.284615Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 14 to 14
2025-10-10T14:31:44.283951Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 1 count 1 size 124 from pos 0 cbcount 1
2025-10-10T14:31:44.283966Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.284737Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.283968Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.284741Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 14
2025-10-10T14:31:44.283974Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.283974Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 10 partNo : 0 messageNo: 20 size 1073 offset: -1
2025-10-10T14:31:44.283979Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.283981Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.283985Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 11 partNo : 0 messageNo: 21 size 1183 offset: -1
2025-10-10T14:31:44.283989Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 0 partno 0 count 1 parts_count 0 source 1 size 142 accessed 1 times before, last time 2025-10-10T14:31:44.000000Z
2025-10-10T14:31:44.283991Z node 3 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 4. All 1 blobs are from cache.
2025-10-10T14:31:44.283996Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106704281 queuesize 0 startOffset 0
2025-10-10T14:31:44.284002Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.284005Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63'
2025-10-10T14:31:44.284006Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.284008Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.284010Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.284785Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-10T14:31:44.284010Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.284783Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 15 to 15
2025-10-10T14:31:44.284800Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (0-0)
2025-10-10T14:31:44.284802Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.284808Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 15
2025-10-10T14:31:44.284013Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:31:44.284019Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 1 count 1 size 124 from pos 0 cbcount 1
2025-10-10T14:31:44.284814Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 16 to 16
2025-10-10T14:31:44.284025Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.284034Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.284819Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.284034Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:44.284822Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 16
2025-10-10T14:31:44.284039Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.284041Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
>>> event from dataHandler: 2025-10-10T14:31:44.284827Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 17 to 17
2025-10-10T14:31:44.284848Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.284851Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 17
2025-10-10T14:31:44.284054Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 Message { Data: ..11 bytes.. Information: { Offset: 0 ProducerId: "src_id" SeqNo: 1 CreateTime: 2025-10-10T14:31:44.281000Z WriteTime: 2025-10-10T14:31:44.281000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:46198", "server": "ipv6:[::1]:46198", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } }
2025-10-10T14:31:44.284055Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.284061Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 22  requestId: <none> cookie: 12
2025-10-10T14:31:44.284064Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 23  requestId: <none> cookie: 13
2025-10-10T14:31:44.284878Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] The application data is transferred to the client. Number of messages 1, size 11 bytes
2025-10-10T14:31:44.284072Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.285036Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 18 to 18
2025-10-10T14:31:44.284077Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.284099Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 1 Result { Offset: 0 Data: "... 82 bytes ..." SourceId: "\000src_id" SeqNo: 1 WriteTimestampMS: 1760106704281 CreateTimestampMS: 1760106704281 UncompressedSize: 11 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 18 RealReadOffset: 0 WaitQuotaTimeMs: 0 EndOffset: 1 StartOffset: 0 } Cookie: 0 }
2025-10-10T14:31:44.285172Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Returning serverBytesSize = 0 to budget
2025-10-10T14:31:44.284100Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.284102Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.284107Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 12 partNo : 0 messageNo: 24 size 1293 offset: -1
2025-10-10T14:31:44.284110Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.285174Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.285195Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 18
2025-10-10T14:31:44.284111Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.284116Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 13 partNo : 0 messageNo: 25 size 1403 offset: -1
2025-10-10T14:31:44.284119Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.284122Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.284124Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.284126Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.284135Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 2 from offset 1
2025-10-10T14:31:44.284141Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 1 ReadOffset 1 ReadGuid 76990d5a-397a34d7-b6df2f9f-3070caca has messages 1
2025-10-10T14:31:44.284154Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 read done: guid# 76990d5a-397a34d7-b6df2f9f-3070caca, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 171
2025-10-10T14:31:44.284161Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 response to read: guid# 76990d5a-397a34d7-b6df2f9f-3070caca
2025-10-10T14:31:44.284236Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 Process answer. Aval parts: 0
2025-10-10T14:31:44.284724Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 1 count 7 size 3821 actorID [3:7559600726884252064:2448]
2025-10-10T14:31:44.284748Z node 3 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:31:44.284753Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 1 partno 0 count 7 parts 0 suffix '63' size 3821
2025-10-10T14:31:44.284761Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 3709 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:31:44.284769Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.284777Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 2, partNo: 0, Offset: 1 is stored on disk
2025-10-10T14:31:44.284782Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.285257Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 19 to 19
2025-10-10T14:31:44.284787Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 3, partNo: 0, Offset: 2 is stored on disk
2025-10-10T14:31:44.284789Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.285263Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.284795Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 4, partNo: 0, Offset: 3 is stored on disk
2025-10-10T14:31:44.285266Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 19
2025-10-10T14:31:44.284798Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.284805Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 5, partNo: 0, Offset: 4 is stored on disk
2025-10-10T14:31:44.285272Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 20 to 20
2025-10-10T14:31:44.284807Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.284814Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 6, partNo: 0, Offset: 5 is stored on disk
2025-10-10T14:31:44.284817Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.285278Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.284822Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 7, partNo: 0, Offset: 6 is stored on disk
2025-10-10T14:31:44.284825Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.285619Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 20
2025-10-10T14:31:44.284831Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 8, partNo: 0, Offset: 7 is stored on disk
2025-10-10T14:31:44.284859Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:44.284866Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 grpc read done: success# 1, data# { read_request { bytes_size: 171 } }
2025-10-10T14:31:44.284868Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:44.284871Z node 3 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (5)
2025-10-10T14:31:44.284878Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 got read request: guid# abe4b474-42d0554f-7f2e5640-7afa09ad
2025-10-10T14:31:44.284888Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 9 partNo 0
2025-10-10T14:31:44.284900Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 1 EndOffset 1 newEndOffset 8 commitOffset 0 clientCommitOffset 0 cookie 2 readingFinished 0 firstRead 0
2025-10-10T14:31:44.284903Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 1 endOffset 8
2025-10-10T14:31:44.284910Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 1, endOffset# 8, WTime# 1760106704281, sizeLag# 3821
2025-10-10T14:31:44.284912Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1TEvPartitionReady. Aval parts: 1
2025-10-10T14:31:44.284916Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 9 partNo 0 FormedBlobsCount 0 NewHead: Offset 8 PartNo 0 PackedSize 1037 count 1 nextOffset 9 batches 1
2025-10-10T14:31:44.284920Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 performing read request: guid# fb9b43eb-83b918b0-1aa4f863-c1e6182f, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 8, size# 4585, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-10T14:31:44.284922Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 10 partNo 0
2025-10-10T14:31:44.284928Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 8 maxSize 4585 maxTimeLagMs 0 readTimestampMs 0 readOffset 1 EndOffset 8 ClientCommitOffset 0 committedOffset 0 Guid fb9b43eb-83b918b0-1aa4f863-c1e6182f
2025-10-10T14:31:44.284929Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 10 partNo 0 FormedBlobsCount 0 NewHead: Offset 8 PartNo 0 PackedSize 2152 count 2 nextOffset 10 batches 1
2025-10-10T14:31:44.284933Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 11 partNo 0
2025-10-10T14:31:44.284939Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 11 partNo 0 FormedBlobsCount 0 NewHead: Offset 8 PartNo 0 PackedSize 3377 count 3 nextOffset 11 batches 1
2025-10-10T14:31:44.284940Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.284943Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 12 partNo 0
2025-10-10T14:31:44.284949Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 12 partNo 0 FormedBlobsCount 0 NewHead: Offset 8 PartNo 0 PackedSize 4712 count 4 nextOffset 12 batches 1
2025-10-10T14:31:44.284953Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 13 partNo 0
2025-10-10T14:31:44.284957Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 13 partNo 0 FormedBlobsCount 0 NewHead: Offset 8 PartNo 0 PackedSize 6157 count 5 nextOffset 13 batches 1
2025-10-10T14:31:44.284960Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:44.284969Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.285006Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.285010Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 8,5 HeadOffset 8 endOffset 8 curOffset 13 d0000000000_00000000000000000008_00000_0000000005_00000? size 6057 WTime 1760106704284
2025-10-10T14:31:44.285027Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:182: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:31:44.285681Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 21 to 21
2025-10-10T14:31:44.285697Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Got ReadResponse, serverBytesSize = 3530, now ReadSizeBudget = 0, ReadSizeServerDelta = 520758
2025-10-10T14:31:44.286030Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.286033Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 21
2025-10-10T14:31:44.285039Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 3  requestId: <none> cookie: 2
2025-10-10T14:31:44.285043Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.285047Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 6  requestId: <none> cookie: 3
2025-10-10T14:31:44.285048Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.285051Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 7  requestId: <none> cookie: 4
2025-10-10T14:31:44.285055Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 9  requestId: <none> cookie: 5
2025-10-10T14:31:44.285059Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.285065Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.285069Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.286053Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] In ContinueReadingDataImpl, ReadSizeBudget = 0, ReadSizeServerDelta = 520758
2025-10-10T14:31:44.285075Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 11  requestId: <none> cookie: 6
2025-10-10T14:31:44.285080Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 14  requestId: <none> cookie: 7
2025-10-10T14:31:44.285083Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 15  requestId: <none> cookie: 8
2025-10-10T14:31:44.286073Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 22 to 22
2025-10-10T14:31:44.285093Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.285097Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.286083Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.285107Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.286086Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 22
2025-10-10T14:31:44.285109Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.285114Z node 3 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:31:44.286092Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 23 to 23
2025-10-10T14:31:44.285123Z node 3 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 8 partNo 0 count 5 size 6057
2025-10-10T14:31:44.285128Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.286102Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.285131Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.286105Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 23
2025-10-10T14:31:44.285131Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.285135Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.285138Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.285141Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.285164Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 26  requestId: <none> cookie: 14
2025-10-10T14:31:44.285180Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.285181Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 27  requestId: <none> cookie: 15
2025-10-10T14:31:44.285185Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.286123Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (1-7)
2025-10-10T14:31:44.285186Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 5 Topic 'rt3.dc1--test-topic' partition 0 user user offset 1 count 8 size 4585 endOffset 8 max time lag 0ms effective offset 1
2025-10-10T14:31:44.285197Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.285201Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 5 added 1 blobs, size 3821 count 7 last offset 1, current partition end offset: 8
2025-10-10T14:31:44.286144Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Returning serverBytesSize = 3530 to budget
2025-10-10T14:31:44.285204Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 5. Send blob request.
2025-10-10T14:31:44.286154Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] In ContinueReadingDataImpl, ReadSizeBudget = 3530, ReadSizeServerDelta = 520758
2025-10-10T14:31:44.285211Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 1 partno 0 count 7 parts_count 0 source 1 size 3821 accessed 0 times before, last time 2025-10-10T14:31:44.000000Z
2025-10-10T14:31:44.285214Z node 3 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 5. All 1 blobs are from cache.
2025-10-10T14:31:44.285219Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.286200Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 24 to 24
2025-10-10T14:31:44.286254Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-10T14:31:44.286388Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.285220Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 1 partno 0 count 7 parts 0 suffix '63'
2025-10-10T14:31:44.286393Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 24
2025-10-10T14:31:44.286416Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (1-1)
2025-10-10T14:31:44.285221Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.285230Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 14 partNo : 0 messageNo: 28 size 1513 offset: -1
2025-10-10T14:31:44.285233Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.285234Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.285235Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.285238Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.285239Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.286426Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 1} (2-2)
2025-10-10T14:31:44.285242Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 15 partNo : 0 messageNo: 30 size 1623 offset: -1
2025-10-10T14:31:44.285243Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.285245Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:31:44.285326Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 1 totakecount 7 count 7 size 3801 from pos 0 cbcount 7
2025-10-10T14:31:44.286447Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 2} (3-3)
2025-10-10T14:31:44.285350Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.285360Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.286453Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 3} (4-4)
2025-10-10T14:31:44.285366Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.285367Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.286459Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 4} (5-5)
2025-10-10T14:31:44.285371Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.286462Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 5} (6-6)
2025-10-10T14:31:44.285373Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.285376Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.286468Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 6} (7-7)
2025-10-10T14:31:44.285378Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.285391Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:31:44.285399Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 29  requestId: <none> cookie: 16
2025-10-10T14:31:44.286482Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 25 to 25
2025-10-10T14:31:44.285409Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.285411Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.285412Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.285430Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 31  requestId: <none> cookie: 17
2025-10-10T14:31:44.285434Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.286493Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.286501Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 25
2025-10-10T14:31:44.285436Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.285441Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 16 partNo : 0 messageNo: 33 size 1733 offset: -1
2025-10-10T14:31:44.285445Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 32  requestId: <none> cookie: 18
2025-10-10T14:31:44.285447Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.285450Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.285458Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.285465Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.286525Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 26 to 26
2025-10-10T14:31:44.285473Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.285493Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 8 Result { Offset: 1 Data: "... 192 bytes ..." SourceId: "\000src_id" SeqNo: 2 WriteTimestampMS: 1760106704283 CreateTimestampMS: 1760106704281 UncompressedSize: 121 PartitionKey: "" ExplicitHash: "" } Result { Offset: 2 Data: "... 303 bytes ..." SourceId: "\000src_id" SeqNo: 3 WriteTimestampMS: 1760106704283 CreateTimestampMS: 1760106704282 UncompressedSize: 231 PartitionKey: "" ExplicitHash: "" } Result { Offset: 3 Data: "... 413 bytes ..." SourceId: "\000src_id" SeqNo: 4 WriteTimestampMS: 1760106704283 CreateTimestampMS: 1760106704282 UncompressedSize: 341 PartitionKey: "" ExplicitHash: "" } Result { Offset: 4 Data: "... 523 bytes ..." SourceId: "\000src_id" SeqNo: 5 WriteTimestampMS: 1760106704283 CreateTimestampMS: 1760106704282 UncompressedSize: 451 PartitionKey: "" ExplicitHash: "" } Result { Offset: 5 Data: "... 633 bytes ..." SourceId: "\000src_id" SeqNo: 6 WriteTimestampMS: 1760106704283 CreateTimestampMS: 1760106704282 UncompressedSize: 561 PartitionKey: "" ExplicitHash: "" } Result { Offset: 6 Data: "... 743 bytes ..." SourceId: "\000src_id" SeqNo: 7 WriteTimestampMS: 1760106704283 CreateTimestampMS: 1760106704282 UncompressedSize: 671 PartitionKey: "" ExplicitHash: "" } Result { Offset: 7 Data: "... 853 bytes ..." SourceId: "\000src_id" SeqNo: 8 WriteTimestampMS: 1760106704283 CreateTimestampMS: 1760106704283 UncompressedSize: 781 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 18446744073709551483 RealReadOffset: 7 WaitQuotaTimeMs: 0 EndOffset: 8 StartOffset: 0 } Cookie: 1 }
2025-10-10T14:31:44.286532Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.285500Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
>>> event from dataHandler: 2025-10-10T14:31:44.286854Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 26
2025-10-10T14:31:44.286569Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Got ReadResponse, serverBytesSize = 5860, now ReadSizeBudget = 0, ReadSizeServerDelta = 518428
2025-10-10T14:31:44.285519Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.285521Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.285524Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 3 from offset 8
2025-10-10T14:31:44.285527Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 17 partNo : 0 messageNo: 34 size 1843 offset: -1
2025-10-10T14:31:44.285529Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 8 ReadOffset 8 ReadGuid fb9b43eb-83b918b0-1aa4f863-c1e6182f has messages 1
2025-10-10T14:31:44.285530Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.285532Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.285536Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 35 size 1953 offset: -1
2025-10-10T14:31:44.285543Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 read done: guid# fb9b43eb-83b918b0-1aa4f863-c1e6182f, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 3530
2025-10-10T14:31:44.286889Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] In ContinueReadingDataImpl, ReadSizeBudget = 0, ReadSizeServerDelta = 518428
2025-10-10T14:31:44.285549Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 response to read: guid# fb9b43eb-83b918b0-1aa4f863-c1e6182f
2025-10-10T14:31:44.285601Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 Process answer. Aval parts: 0
2025-10-10T14:31:44.285604Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.285606Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.285611Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.285615Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.285618Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.285621Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.285628Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 36  requestId: <none> cookie: 19
2025-10-10T14:31:44.285635Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.285648Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 Message { Data: ..121 bytes.. Information: { Offset: 1 ProducerId: "src_id" SeqNo: 2 CreateTime: 2025-10-10T14:31:44.281000Z WriteTime: 2025-10-10T14:31:44.283000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:46198", "server": "ipv6:[::1]:46198" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..231 bytes.. Information: { Offset: 2 ProducerId: "src_id" SeqNo: 3 CreateTime: 2025-10-10T14:31:44.282000Z WriteTime: 2025-10-10T14:31:44.283000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:46198", "server": "ipv6:[::1]:46198" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..341 bytes.. Information: { Offset: 3 ProducerId: "src_id" SeqNo: 4 CreateTime: 2025-10-10T14:31:44.282000Z WriteTime: 2025-10-10T14:31:44.283000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:46198", "server": "ipv6:[::1]:46198" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..451 bytes.. Information: { Offset: 4 ProducerId: "src_id" SeqNo: 5 CreateTime: 2025-10-10T14:31:44.282000Z WriteTime: 2025-10-10T14:31:44.283000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:46198", "server": "ipv6:[::1]:46198" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..561 bytes.. Information: { Offset: 5 ProducerId: "src_id" SeqNo: 6 CreateTime: 2025-10-10T14:31:44.282000Z WriteTime: 2025-10-10T14:31:44.283000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:46198", "server": "ipv6:[::1]:46198" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..671 bytes.. Information: { Offset: 6 ProducerId: "src_id" SeqNo: 7 CreateTime: 2025-10-10T14:31:44.282000Z WriteTime: 2025-10-10T14:31:44.283000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:46198", "server": "ipv6:[::1]:46198" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..781 bytes.. Information: { Offset: 7 ProducerId: "src_id" SeqNo: 8 CreateTime: 2025-10-10T14:31:44.283000Z WriteTime: 2025-10-10T14:31:44.283000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:46198", "server": "ipv6:[::1]:46198" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } }
2025-10-10T14:31:44.285650Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.286917Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 27 to 27
2025-10-10T14:31:44.285655Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 37 size 2063 offset: -1
2025-10-10T14:31:44.285658Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.285661Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.286932Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (8-12)
2025-10-10T14:31:44.285737Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.287382Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.287385Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 27
2025-10-10T14:31:44.285801Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.285816Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.287391Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Returning serverBytesSize = 5860 to budget
2025-10-10T14:31:44.285819Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.286939Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] The application data is transferred to the client. Number of messages 7, size 3157 bytes
2025-10-10T14:31:44.287396Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] In ContinueReadingDataImpl, ReadSizeBudget = 5860, ReadSizeServerDelta = 518428
2025-10-10T14:31:44.285826Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 38  requestId: <none> cookie: 20
2025-10-10T14:31:44.285837Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.285853Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.285854Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.285859Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 39 size 2173 offset: -1
2025-10-10T14:31:44.285863Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.285867Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.285902Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 8 count 5 size 6057 actorID [3:7559600726884252064:2448]
2025-10-10T14:31:44.285912Z node 3 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:31:44.285920Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 5950 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:31:44.285924Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 8 partno 0 count 5 parts 0 suffix '63' size 6057
2025-10-10T14:31:44.287422Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-10T14:31:44.285925Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.285930Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 9, partNo: 0, Offset: 8 is stored on disk
2025-10-10T14:31:44.285933Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.285936Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 10, partNo: 0, Offset: 9 is stored on disk
2025-10-10T14:31:44.287444Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (8-8)
2025-10-10T14:31:44.285938Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.285941Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 11, partNo: 0, Offset: 10 is stored on disk
2025-10-10T14:31:44.287448Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Returning serverBytesSize = 0 to budget
2025-10-10T14:31:44.285943Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.287452Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 28 to 28
2025-10-10T14:31:44.287457Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.287458Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 28
2025-10-10T14:31:44.287451Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 1} (9-9)
2025-10-10T14:31:44.287462Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 29 to 29
2025-10-10T14:31:44.287467Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.285946Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 12, partNo: 0, Offset: 11 is stored on disk
2025-10-10T14:31:44.287469Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 29
2025-10-10T14:31:44.285948Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.285951Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 13, partNo: 0, Offset: 12 is stored on disk
2025-10-10T14:31:44.285969Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:44.287479Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 30 to 30
2025-10-10T14:31:44.285974Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:44.285975Z node 3 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (7)
2025-10-10T14:31:44.287684Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.285983Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 14 partNo 0
2025-10-10T14:31:44.285983Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 8 EndOffset 8 newEndOffset 13 commitOffset 0 clientCommitOffset 0 cookie 3 readingFinished 0 firstRead 0
2025-10-10T14:31:44.287688Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 30
2025-10-10T14:31:44.285986Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 8 endOffset 13
2025-10-10T14:31:44.285997Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 14 partNo 0 FormedBlobsCount 0 NewHead: Offset 13 PartNo 0 PackedSize 1587 count 1 nextOffset 14 batches 1
2025-10-10T14:31:44.286000Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 8, endOffset# 13, WTime# 1760106704283, sizeLag# 6057
2025-10-10T14:31:44.286000Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 15 partNo 0
2025-10-10T14:31:44.287469Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 2} (10-10)
2025-10-10T14:31:44.287704Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 31 to 31
2025-10-10T14:31:44.286001Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1TEvPartitionReady. Aval parts: 1
2025-10-10T14:31:44.286003Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 15 partNo 0 FormedBlobsCount 0 NewHead: Offset 13 PartNo 0 PackedSize 3252 count 2 nextOffset 15 batches 1
2025-10-10T14:31:44.287712Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 3} (11-11)
2025-10-10T14:31:44.287707Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.287722Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 31
2025-10-10T14:31:44.286005Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 16 partNo 0
2025-10-10T14:31:44.286008Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 16 partNo 0 FormedBlobsCount 0 NewHead: Offset 13 PartNo 0 PackedSize 5027 count 3 nextOffset 16 batches 1
2025-10-10T14:31:44.286009Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 performing read request: guid# f8e2986d-23a802b1-d94428e5-2221d3eb, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 6, size# 7268, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-10T14:31:44.287725Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 4} (12-12)
2025-10-10T14:31:44.286011Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 17 partNo 0
2025-10-10T14:31:44.287726Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 32 to 32
2025-10-10T14:31:44.286014Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 17 partNo 0 FormedBlobsCount 0 NewHead: Offset 13 PartNo 0 PackedSize 6912 count 4 nextOffset 17 batches 1
2025-10-10T14:31:44.286015Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-10T14:31:44.286016Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 6 maxSize 7268 maxTimeLagMs 0 readTimestampMs 0 readOffset 8 EndOffset 13 ClientCommitOffset 0 committedOffset 0 Guid f8e2986d-23a802b1-d94428e5-2221d3eb
2025-10-10T14:31:44.286018Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 0 FormedBlobsCount 0 NewHead: Offset 13 PartNo 0 PackedSize 8907 count 5 nextOffset 18 batches 1
2025-10-10T14:31:44.287744Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.286021Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-10T14:31:44.287746Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 32
2025-10-10T14:31:44.286024Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 0 FormedBlobsCount 0 NewHead: Offset 13 PartNo 0 PackedSize 11012 count 6 nextOffset 19 batches 1
2025-10-10T14:31:44.286025Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-10T14:31:44.287750Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 33 to 33
2025-10-10T14:31:44.286028Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 0 FormedBlobsCount 0 NewHead: Offset 13 PartNo 0 PackedSize 13227 count 7 nextOffset 20 batches 1
2025-10-10T14:31:44.286029Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:44.286062Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 13,7 HeadOffset 13 endOffset 13 curOffset 20 d0000000000_00000000000000000013_00000_0000000007_00000? size 13063 WTime 1760106704286
2025-10-10T14:31:44.286103Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:182: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:31:44.286111Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 17  requestId: <none> cookie: 9
2025-10-10T14:31:44.286121Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 20  requestId: <none> cookie: 10
2025-10-10T14:31:44.286125Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 21  requestId: <none> cookie: 11
2025-10-10T14:31:44.286127Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.286128Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 24  requestId: <none> cookie: 12
2025-10-10T14:31:44.286131Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 25  requestId: <none> cookie: 13
2025-10-10T14:31:44.287754Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.288181Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 33
2025-10-10T14:31:44.287761Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Got ReadResponse, serverBytesSize = 12772, now ReadSizeBudget = 0, ReadSizeServerDelta = 511516
>>> event from dataHandler: 2025-10-10T14:31:44.286132Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.288228Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] In ContinueReadingDataImpl, ReadSizeBudget = 0, ReadSizeServerDelta = 511516
2025-10-10T14:31:44.286135Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.286137Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.288243Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 34 to 34
2025-10-10T14:31:44.286138Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.286138Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.286142Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.288248Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.286145Z node 3 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:31:44.288250Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 34
2025-10-10T14:31:44.286153Z node 3 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 13 partNo 0 count 7 size 13063
2025-10-10T14:31:44.286192Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 6 Topic 'rt3.dc1--test-topic' partition 0 user user offset 8 count 6 size 7268 endOffset 13 max time lag 0ms effective offset 8
2025-10-10T14:31:44.286199Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 6 added 1 blobs, size 6057 count 5 last offset 8, current partition end offset: 13
DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 Message { Data: ..891 bytes.. Information: { Offset: 8 ProducerId: "src_id" SeqNo: 9 CreateTime: 2025-10-10T14:31:44.283000Z WriteTime: 2025-10-10T14:31:44.284000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:46198", "logtype": "unknown", "server": "ipv6:[::1]:46198" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..1001 bytes.. Information: { Offset: 9 ProducerId: "src_id" SeqNo: 10 CreateTime: 2025-10-10T14:31:44.283000Z WriteTime: 2025-10-10T14:31:44.284000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:46198", "logtype": "unknown", "server": "ipv6:[::1]:46198" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..1111 bytes.. Information: { Offset: 10 ProducerId: "src_id" SeqNo: 11 CreateTime: 2025-10-10T14:31:44.283000Z WriteTime: 2025-10-10T14:31:44.284000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:46198", "logtype": "unknown", "server": "ipv6:[::1]:46198" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..1221 bytes.. Information: { Offset: 11 ProducerId: "src_id" SeqNo: 12 CreateTime: 2025-10-10T14:31:44.283000Z WriteTime: 2025-10-10T14:31:44.284000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:46198", "logtype": "unknown", "server": "ipv6:[::1]:46198" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..1331 bytes.. Information: { Offset: 12 ProducerId: "src_id" SeqNo: 13 CreateTime: 2025-10-10T14:31:44.283000Z WriteTime: 2025-10-10T14:31:44.284000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:46198", "logtype": "unknown", "server": "ipv6:[::1]:46198" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } }
2025-10-10T14:31:44.286200Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 6. Send blob request.
2025-10-10T14:31:44.288255Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 35 to 35
2025-10-10T14:31:44.286206Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 8 partno 0 count 5 parts_count 0 source 1 size 6057 accessed 0 times before, last time 2025-10-10T14:31:44.000000Z
2025-10-10T14:31:44.286215Z node 3 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 6. All 1 blobs are from cache.
2025-10-10T14:31:44.288272Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.286217Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 8 partno 0 count 5 parts 0 suffix '63'
2025-10-10T14:31:44.288274Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (13-19)
2025-10-10T14:31:44.288274Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 35
2025-10-10T14:31:44.288282Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] The application data is transferred to the client. Number of messages 5, size 5555 bytes
2025-10-10T14:31:44.286221Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:31:44.288290Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Returning serverBytesSize = 12772 to budget
2025-10-10T14:31:44.286223Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.286246Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 8 totakecount 5 count 5 size 6037 from pos 0 cbcount 5
2025-10-10T14:31:44.288570Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] In ContinueReadingDataImpl, ReadSizeBudget = 12772, ReadSizeServerDelta = 511516
2025-10-10T14:31:44.286256Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.286263Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 8
2025-10-10T14:31:44.286270Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.286272Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.286273Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.286283Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.286291Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.286293Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.286296Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 40  requestId: <none> cookie: 21
2025-10-10T14:31:44.286300Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 41  requestId: <none> cookie: 22
2025-10-10T14:31:44.286310Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.286314Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.288606Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 36 to 36
2025-10-10T14:31:44.286323Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 13 Result { Offset: 8 Data: "... 963 bytes ..." SourceId: "\000src_id" SeqNo: 9 WriteTimestampMS: 1760106704284 CreateTimestampMS: 1760106704283 UncompressedSize: 891 PartitionKey: "" ExplicitHash: "" } Result { Offset: 9 Data: "... 1073 bytes ..." SourceId: "\000src_id" SeqNo: 10 WriteTimestampMS: 1760106704284 CreateTimestampMS: 1760106704283 UncompressedSize: 1001 PartitionKey: "" ExplicitHash: "" } Result { Offset: 10 Data: "... 1183 bytes ..." SourceId: "\000src_id" SeqNo: 11 WriteTimestampMS: 1760106704284 CreateTimestampMS: 1760106704283 UncompressedSize: 1111 PartitionKey: "" ExplicitHash: "" } Result { Offset: 11 Data: "... 1293 bytes ..." SourceId: "\000src_id" SeqNo: 12 WriteTimestampMS: 1760106704284 CreateTimestampMS: 1760106704283 UncompressedSize: 1221 PartitionKey: "" ExplicitHash: "" } Result { Offset: 12 Data: "... 1403 bytes ..." SourceId: "\000src_id" SeqNo: 13 WriteTimestampMS: 1760106704284 CreateTimestampMS: 1760106704283 UncompressedSize: 1331 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 18446744073709551548 RealReadOffset: 12 WaitQuotaTimeMs: 0 EndOffset: 13 StartOffset: 0 } Cookie: 8 }
2025-10-10T14:31:44.286336Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.288617Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.286338Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.286345Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 42 size 2283 offset: -1
2025-10-10T14:31:44.286348Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.288622Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 36
2025-10-10T14:31:44.286350Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.286361Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 4 from offset 13
2025-10-10T14:31:44.286365Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 43 size 2393 offset: -1
2025-10-10T14:31:44.286366Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 13 ReadOffset 13 ReadGuid f8e2986d-23a802b1-d94428e5-2221d3eb has messages 1
2025-10-10T14:31:44.286369Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.286374Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.286376Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.288658Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-10T14:31:44.288659Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 37 to 37
2025-10-10T14:31:44.288892Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Got ReadResponse, serverBytesSize = 12578, now ReadSizeBudget = 0, ReadSizeServerDelta = 511710
2025-10-10T14:31:44.288899Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (13-13)
2025-10-10T14:31:44.286378Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.288909Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 1} (14-14)
2025-10-10T14:31:44.288904Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.288919Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 37
2025-10-10T14:31:44.286381Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 read done: guid# f8e2986d-23a802b1-d94428e5-2221d3eb, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 5860
2025-10-10T14:31:44.288927Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 2} (15-15)
2025-10-10T14:31:44.286386Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 response to read: guid# f8e2986d-23a802b1-d94428e5-2221d3eb
2025-10-10T14:31:44.288932Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 3} (16-16)
2025-10-10T14:31:44.288938Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 4} (17-17)
2025-10-10T14:31:44.288942Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 5} (18-18)
2025-10-10T14:31:44.288954Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 6} (19-19)
2025-10-10T14:31:44.286391Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.286405Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 Process answer. Aval parts: 0
2025-10-10T14:31:44.286413Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.286423Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.286425Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.288983Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 38 to 38
2025-10-10T14:31:44.286430Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 44  requestId: <none> cookie: 23
2025-10-10T14:31:44.288992Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.286434Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 grpc read done: success# 1, data# { read_request { bytes_size: 3530 } }
2025-10-10T14:31:44.286441Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 got read request: guid# d6529d94-30d4f584-b2d70c60-934cd089
2025-10-10T14:31:44.288995Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 38
2025-10-10T14:31:44.286447Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.286490Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.286491Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.286495Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 45 size 2503 offset: -1
2025-10-10T14:31:44.286497Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.286499Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.286520Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.286544Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.286554Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.286557Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.286562Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 46  requestId: <none> cookie: 24
2025-10-10T14:31:44.289040Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 39 to 39
2025-10-10T14:31:44.289047Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.289049Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 39
2025-10-10T14:31:44.289055Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] In ContinueReadingDataImpl, ReadSizeBudget = 0, ReadSizeServerDelta = 511710
2025-10-10T14:31:44.286571Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.289072Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Returning serverBytesSize = 0 to budget
2025-10-10T14:31:44.289089Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] In ContinueReadingDataImpl, ReadSizeBudget = 0, ReadSizeServerDelta = 511710
2025-10-10T14:31:44.286586Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.286589Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.286593Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 47 size 2613 offset: -1
2025-10-10T14:31:44.286596Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.289105Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 40 to 40
2025-10-10T14:31:44.289103Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (20-24)
2025-10-10T14:31:44.286599Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.289285Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Returning serverBytesSize = 12578 to budget
2025-10-10T14:31:44.289120Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.289291Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] In ContinueReadingDataImpl, ReadSizeBudget = 12578, ReadSizeServerDelta = 511710
2025-10-10T14:31:44.289296Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 40
2025-10-10T14:31:44.286602Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
>>> event from dataHandler: 2025-10-10T14:31:44.286623Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.286640Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.286642Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.286647Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 48  requestId: <none> cookie: 25
2025-10-10T14:31:44.286652Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.289322Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-10T14:31:44.286660Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.286661Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.289353Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 41 to 41
2025-10-10T14:31:44.289357Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (20-20)
2025-10-10T14:31:44.286666Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 49 size 2723 offset: -1
2025-10-10T14:31:44.289360Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.289363Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:44.286669Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.289367Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 0} (21-21)
2025-10-10T14:31:44.286671Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 Message { Data: ..1441 bytes.. Information: { Offset: 13 ProducerId: "src_id" SeqNo: 14 CreateTime: 2025-10-10T14:31:44.283000Z WriteTime: 2025-10-10T14:31:44.285000Z MessageGroupId: "src_id" Meta: { "_ip": "ipv6:[::1]:46198", "server": "ipv6:[::1]:46198", "logtype": "unknown", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..1551 bytes.. Information: { Offset: 14 ProducerId: "src_id" SeqNo: 15 CreateTime: 2025-10-10T14:31:44.284000Z WriteTime: 2025-10-10T14:31:44.285000Z MessageGroupId: "src_id" Meta: { "_ip": "ipv6:[::1]:46198", "server": "ipv6:[::1]:46198", "logtype": "unknown", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..1661 bytes.. Information: { Offset: 15 ProducerId: "src_id" SeqNo: 16 CreateTime: 2025-10-10T14:31:44.284000Z WriteTime: 2025-10-10T14:31:44.285000Z MessageGroupId: "src_id" Meta: { "_ip": "ipv6:[::1]:46198", "server": "ipv6:[::1]:46198", "logtype": "unknown", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..1771 bytes.. Information: { Offset: 16 ProducerId: "src_id" SeqNo: 17 CreateTime: 2025-10-10T14:31:44.284000Z WriteTime: 2025-10-10T14:31:44.285000Z MessageGroupId: "src_id" Meta: { "_ip": "ipv6:[::1]:46198", "server": "ipv6:[::1]:46198", "logtype": "unknown", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..1881 bytes.. Information: { Offset: 17 ProducerId: "src_id" SeqNo: 18 CreateTime: 2025-10-10T14:31:44.285000Z WriteTime: 2025-10-10T14:31:44.285000Z MessageGroupId: "src_id" Meta: { "_ip": "ipv6:[::1]:46198", "server": "ipv6:[::1]:46198", "logtype": "unknown", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..1991 bytes.. Information: { Offset: 18 ProducerId: "src_id" SeqNo: 19 CreateTime: 2025-10-10T14:31:44.285000Z WriteTime: 2025-10-10T14:31:44.285000Z MessageGroupId: "src_id" Meta: { "_ip": "ipv6:[::1]:46198", "server": "ipv6:[::1]:46198", "logtype": "unknown", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..2101 bytes.. Information: { Offset: 19 ProducerId: "src_id" SeqNo: 20 CreateTime: 2025-10-10T14:31:44.285000Z WriteTime: 2025-10-10T14:31:44.285000Z MessageGroupId: "src_id" Meta: { "_ip": "ipv6:[::1]:46198", "server": "ipv6:[::1]:46198", "logtype": "unknown", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } }
2025-10-10T14:31:44.286966Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 13 count 7 size 13063 actorID [3:7559600726884252064:2448]
2025-10-10T14:31:44.286978Z node 3 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:31:44.289374Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 1} (22-22)
2025-10-10T14:31:44.289398Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 2} (23-23)
2025-10-10T14:31:44.289402Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 42 to 42
2025-10-10T14:31:44.289406Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 3} (24-24)
2025-10-10T14:31:44.289408Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.286985Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 12950 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:31:44.289994Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 42
2025-10-10T14:31:44.286988Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 13 partno 0 count 7 parts 0 suffix '63' size 13063
2025-10-10T14:31:44.286987Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.289893Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Got ReadResponse, serverBytesSize = 15210, now ReadSizeBudget = 0, ReadSizeServerDelta = 509078
2025-10-10T14:31:44.286989Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.286994Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 14, partNo: 0, Offset: 13 is stored on disk
2025-10-10T14:31:44.290020Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] The application data is transferred to the client. Number of messages 7, size 12397 bytes
2025-10-10T14:31:44.286997Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.287001Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 15, partNo: 0, Offset: 14 is stored on disk
2025-10-10T14:31:44.287003Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.290032Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] In ContinueReadingDataImpl, ReadSizeBudget = 0, ReadSizeServerDelta = 509078
2025-10-10T14:31:44.287006Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 16, partNo: 0, Offset: 15 is stored on disk
2025-10-10T14:31:44.287008Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.287011Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 17, partNo: 0, Offset: 16 is stored on disk
2025-10-10T14:31:44.290040Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] In ContinueReadingDataImpl, ReadSizeBudget = 0, ReadSizeServerDelta = 509078
2025-10-10T14:31:44.287013Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.287016Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 18, partNo: 0, Offset: 17 is stored on disk
2025-10-10T14:31:44.287018Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.290047Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Returning serverBytesSize = 0 to budget
2025-10-10T14:31:44.290053Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] In ContinueReadingDataImpl, ReadSizeBudget = 0, ReadSizeServerDelta = 509078
2025-10-10T14:31:44.287021Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 19, partNo: 0, Offset: 18 is stored on disk
2025-10-10T14:31:44.290060Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 43 to 43
2025-10-10T14:31:44.287024Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.287027Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 20, partNo: 0, Offset: 19 is stored on disk
2025-10-10T14:31:44.290073Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.287046Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:44.290076Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 43
2025-10-10T14:31:44.290076Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (25-29)
2025-10-10T14:31:44.287047Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.287052Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:44.290084Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Returning serverBytesSize = 15210 to budget
2025-10-10T14:31:44.287054Z node 3 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (5)
2025-10-10T14:31:44.287065Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-10T14:31:44.290090Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] In ContinueReadingDataImpl, ReadSizeBudget = 15210, ReadSizeServerDelta = 509078
2025-10-10T14:31:44.287070Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 13 EndOffset 13 newEndOffset 20 commitOffset 0 clientCommitOffset 0 cookie 4 readingFinished 0 firstRead 0
2025-10-10T14:31:44.287074Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 13 endOffset 20
2025-10-10T14:31:44.287081Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 13, endOffset# 20, WTime# 1760106704284, sizeLag# 13063
2025-10-10T14:31:44.287081Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 0 FormedBlobsCount 0 NewHead: Offset 20 PartNo 0 PackedSize 2357 count 1 nextOffset 21 batches 1
>>> event from dataHandler: 2025-10-10T14:31:44.287083Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1TEvPartitionReady. Aval parts: 1
2025-10-10T14:31:44.287085Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-10T14:31:44.287089Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 0 FormedBlobsCount 0 NewHead: Offset 20 PartNo 0 PackedSize 4792 count 2 nextOffset 22 batches 1
2025-10-10T14:31:44.287091Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 performing read request: guid# b3d3a48-873e05e4-2e6382e1-4ede0044, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 8, size# 15675, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-10T14:31:44.287092Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 Message { Data: ..2211 bytes.. Information: { Offset: 20 ProducerId: "src_id" SeqNo: 21 CreateTime: 2025-10-10T14:31:44.285000Z WriteTime: 2025-10-10T14:31:44.286000Z MessageGroupId: "src_id" Meta: { "_ip": "ipv6:[::1]:46198", "server": "ipv6:[::1]:46198", "logtype": "unknown", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..2321 bytes.. Information: { Offset: 21 ProducerId: "src_id" SeqNo: 22 CreateTime: 2025-10-10T14:31:44.286000Z WriteTime: 2025-10-10T14:31:44.287000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:46198", "logtype": "unknown", "server": "ipv6:[::1]:46198" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..2431 bytes.. Information: { Offset: 22 ProducerId: "src_id" SeqNo: 23 CreateTime: 2025-10-10T14:31:44.286000Z WriteTime: 2025-10-10T14:31:44.287000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:46198", "logtype": "unknown", "server": "ipv6:[::1]:46198" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..2541 bytes.. Information: { Offset: 23 ProducerId: "src_id" SeqNo: 24 CreateTime: 2025-10-10T14:31:44.286000Z WriteTime: 2025-10-10T14:31:44.287000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:46198", "logtype": "unknown", "server": "ipv6:[::1]:46198" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..2651 bytes.. Information: { Offset: 24 ProducerId: "src_id" SeqNo: 25 CreateTime: 2025-10-10T14:31:44.286000Z WriteTime: 2025-10-10T14:31:44.287000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:46198", "logtype": "unknown", "server": "ipv6:[::1]:46198" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } }
2025-10-10T14:31:44.290130Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 44 to 44
2025-10-10T14:31:44.290276Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.290150Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-10T14:31:44.290279Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 44
2025-10-10T14:31:44.290282Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] The application data is transferred to the client. Number of messages 5, size 12155 bytes
2025-10-10T14:31:44.287096Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 0 FormedBlobsCount 0 NewHead: Offset 20 PartNo 0 PackedSize 7337 count 3 nextOffset 23 batches 1
2025-10-10T14:31:44.290294Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (25-25)
2025-10-10T14:31:44.287099Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-10T14:31:44.287100Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 8 maxSize 15675 maxTimeLagMs 0 readTimestampMs 0 readOffset 13 EndOffset 20 ClientCommitOffset 0 committedOffset 0 Guid b3d3a48-873e05e4-2e6382e1-4ede0044
2025-10-10T14:31:44.290301Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 1} (26-26)
2025-10-10T14:31:44.287103Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 0 FormedBlobsCount 0 NewHead: Offset 20 PartNo 0 PackedSize 9992 count 4 nextOffset 24 batches 1
2025-10-10T14:31:44.290291Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Returning serverBytesSize = 0 to budget
2025-10-10T14:31:44.290309Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 2} (27-27)
2025-10-10T14:31:44.287106Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-10T14:31:44.290335Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 3} (28-28)
2025-10-10T14:31:44.287110Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 0 FormedBlobsCount 0 NewHead: Offset 20 PartNo 0 PackedSize 12757 count 5 nextOffset 25 batches 1
2025-10-10T14:31:44.287112Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:44.290348Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 4} (29-29)
2025-10-10T14:31:44.287158Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 20,5 HeadOffset 20 endOffset 20 curOffset 25 d0000000000_00000000000000000020_00000_0000000005_00000? size 12657 WTime 1760106704287
2025-10-10T14:31:44.290365Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 45 to 45
2025-10-10T14:31:44.287181Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:182: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:31:44.290371Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.290374Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 45
2025-10-10T14:31:44.287188Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 28  requestId: <none> cookie: 14
2025-10-10T14:31:44.287198Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 30  requestId: <none> cookie: 15
2025-10-10T14:31:44.287202Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 33  requestId: <none> cookie: 16
2025-10-10T14:31:44.287203Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.287206Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 34  requestId: <none> cookie: 17
>>> event from dataHandler: 2025-10-10T14:31:44.290394Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 46 to 46
2025-10-10T14:31:44.287210Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 35  requestId: <none> cookie: 18
2025-10-10T14:31:44.290698Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.287210Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.290701Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 46
2025-10-10T14:31:44.287213Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 37  requestId: <none> cookie: 19
2025-10-10T14:31:44.287215Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 Message { Data: ..2761 bytes.. Information: { Offset: 25 ProducerId: "src_id" SeqNo: 26 CreateTime: 2025-10-10T14:31:44.286000Z WriteTime: 2025-10-10T14:31:44.288000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:46198", "_ip": "ipv6:[::1]:46198", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..2871 bytes.. Information: { Offset: 26 ProducerId: "src_id" SeqNo: 27 CreateTime: 2025-10-10T14:31:44.286000Z WriteTime: 2025-10-10T14:31:44.288000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:46198", "_ip": "ipv6:[::1]:46198", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..2981 bytes.. Information: { Offset: 27 ProducerId: "src_id" SeqNo: 28 CreateTime: 2025-10-10T14:31:44.287000Z WriteTime: 2025-10-10T14:31:44.288000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:46198", "_ip": "ipv6:[::1]:46198", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..3091 bytes.. Information: { Offset: 28 ProducerId: "src_id" SeqNo: 29 CreateTime: 2025-10-10T14:31:44.287000Z WriteTime: 2025-10-10T14:31:44.288000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:46198", "_ip": "ipv6:[::1]:46198", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..3201 bytes.. Information: { Offset: 29 ProducerId: "src_id" SeqNo: 30 CreateTime: 2025-10-10T14:31:44.287000Z WriteTime: 2025-10-10T14:31:44.288000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:46198", "_ip": "ipv6:[::1]:46198", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } }
2025-10-10T14:31:44.287217Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 39  requestId: <none> cookie: 20
2025-10-10T14:31:44.287220Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.287221Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.290725Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] The application data is transferred to the client. Number of messages 5, size 14905 bytes
2025-10-10T14:31:44.290721Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 47 to 47
2025-10-10T14:31:44.290730Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Returning serverBytesSize = 0 to budget
2025-10-10T14:31:44.290735Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.287224Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.290737Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 47
2025-10-10T14:31:44.287224Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.287229Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.287235Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.290748Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 48 to 48
2025-10-10T14:31:44.287237Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.290752Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.290754Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 48
2025-10-10T14:31:44.287243Z node 3 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:31:44.287251Z node 3 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 0 count 5 size 12657
2025-10-10T14:31:44.290761Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 49 to 49
2025-10-10T14:31:44.287274Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 50  requestId: <none> cookie: 26
2025-10-10T14:31:44.287280Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.290767Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.287295Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 7 Topic 'rt3.dc1--test-topic' partition 0 user user offset 13 count 8 size 15675 endOffset 20 max time lag 0ms effective offset 13
2025-10-10T14:31:44.290768Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 49
2025-10-10T14:31:44.290774Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 50 to 50
2025-10-10T14:31:44.287308Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 7 added 1 blobs, size 13063 count 7 last offset 13, current partition end offset: 20
2025-10-10T14:31:44.287310Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 7. Send blob request.
2025-10-10T14:31:44.287316Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 13 partno 0 count 7 parts_count 0 source 1 size 13063 accessed 0 times before, last time 2025-10-10T14:31:44.000000Z
2025-10-10T14:31:44.290779Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.287319Z node 3 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 7. All 1 blobs are from cache.
2025-10-10T14:31:44.287324Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:31:44.287331Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.291029Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 50
2025-10-10T14:31:44.287356Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 13 totakecount 7 count 7 size 13043 from pos 0 cbcount 7
2025-10-10T14:31:44.287358Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 13 partno 0 count 7 parts 0 suffix '63'
2025-10-10T14:31:44.287372Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.287374Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.287382Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 51 size 2833 offset: -1
2025-10-10T14:31:44.287390Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 13
2025-10-10T14:31:44.287397Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.287403Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.287479Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 20 Result { Offset: 13 Data: "... 1513 bytes ..." SourceId: "\000src_id" SeqNo: 14 WriteTimestampMS: 1760106704285 CreateTimestampMS: 1760106704283 UncompressedSize: 1441 PartitionKey: "" ExplicitHash: "" } Result { Offset: 14 Data: "... 1623 bytes ..." SourceId: "\000src_id" SeqNo: 15 WriteTimestampMS: 1760106704285 CreateTimestampMS: 1760106704284 UncompressedSize: 1551 PartitionKey: "" ExplicitHash: "" } Result { Offset: 15 Data: "... 1733 bytes ..." SourceId: "\000src_id" SeqNo: 16 WriteTimestampMS: 1760106704285 CreateTimestampMS: 1760106704284 UncompressedSize: 1661 PartitionKey: "" ExplicitHash: "" } Result { Offset: 16 Data: "... 1843 bytes ..." SourceId: "\000src_id" SeqNo: 17 WriteTimestampMS: 1760106704285 CreateTimestampMS: 1760106704284 UncompressedSize: 1771 PartitionKey: "" ExplicitHash: "" } Result { Offset: 17 Data: "... 1953 bytes ..." SourceId: "\000src_id" SeqNo: 18 WriteTimestampMS: 1760106704285 CreateTimestampMS: 1760106704285 UncompressedSize: 1881 PartitionKey: "" ExplicitHash: "" } Result { Offset: 18 Data: "... 2063 bytes ..." SourceId: "\000src_id" SeqNo: 19 WriteTimestampMS: 1760106704285 CreateTimestampMS: 1760106704285 UncompressedSize: 1991 PartitionKey: "" ExplicitHash: "" } Result { Offset: 19 Data: "... 2173 bytes ..." SourceId: "\000src_id" SeqNo: 20 WriteTimestampMS: 1760106704285 CreateTimestampMS: 1760106704285 UncompressedSize: 2101 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 18446744073709551484 RealReadOffset: 19 WaitQuotaTimeMs: 0 EndOffset: 20 StartOffset: 0 } Cookie: 13 }
2025-10-10T14:31:44.291120Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Got ReadResponse, serverBytesSize = 21859, now ReadSizeBudget = 0, ReadSizeServerDelta = 502429
2025-10-10T14:31:44.287510Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 5 from offset 20
2025-10-10T14:31:44.287515Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 20 ReadOffset 20 ReadGuid b3d3a48-873e05e4-2e6382e1-4ede0044 has messages 1
2025-10-10T14:31:44.287533Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 read done: guid# b3d3a48-873e05e4-2e6382e1-4ede0044, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 12772
2025-10-10T14:31:44.287539Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 response to read: guid# b3d3a48-873e05e4-2e6382e1-4ede0044
2025-10-10T14:31:44.291151Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] In ContinueReadingDataImpl, ReadSizeBudget = 0, ReadSizeServerDelta = 502429
2025-10-10T14:31:44.287565Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 Process answer. Aval parts: 0
2025-10-10T14:31:44.287629Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.287648Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.287667Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.287668Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 grpc read done: success# 1, data# { read_request { bytes_size: 5860 } }
2025-10-10T14:31:44.287671Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.287684Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 52  requestId: <none> cookie: 27
2025-10-10T14:31:44.291197Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (30-35)
2025-10-10T14:31:44.287698Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 got read request: guid# 9fe48323-afba2907-6cec5a06-b2fa8531
2025-10-10T14:31:44.291168Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 51 to 51
2025-10-10T14:31:44.291413Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Returning serverBytesSize = 21859 to budget
2025-10-10T14:31:44.287700Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.291419Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] In ContinueReadingDataImpl, ReadSizeBudget = 21859, ReadSizeServerDelta = 502429
2025-10-10T14:31:44.287703Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.287727Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.291423Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.287733Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.291432Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 51
2025-10-10T14:31:44.287734Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.287744Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 53 size 2943 offset: -1
2025-10-10T14:31:44.287748Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.287750Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.287754Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.287754Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.287760Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.287764Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 54  requestId: <none> cookie: 28
2025-10-10T14:31:44.287785Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.287797Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.287806Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.291469Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 52 to 52
2025-10-10T14:31:44.287810Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.291472Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-10T14:31:44.287819Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 28 partNo : 0 messageNo: 55 size 3053 offset: -1
2025-10-10T14:31:44.287824Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.287826Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.291482Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (30-30)
2025-10-10T14:31:44.287830Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.291489Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 1} (31-31)
2025-10-10T14:31:44.287836Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.287842Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 56  requestId: <none> cookie: 29
2025-10-10T14:31:44.287846Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.291473Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.291498Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 2} (32-32)
2025-10-10T14:31:44.291500Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 52
2025-10-10T14:31:44.287852Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.291506Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 3} (33-33)
2025-10-10T14:31:44.287881Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.287887Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.291516Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 4} (34-34)
2025-10-10T14:31:44.287889Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.287895Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 29 partNo : 0 messageNo: 57 size 3163 offset: -1
2025-10-10T14:31:44.287898Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.291520Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 5} (35-35)
2025-10-10T14:31:44.287900Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.291530Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 53 to 53
2025-10-10T14:31:44.287903Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.287906Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.287910Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 58  requestId: <none> cookie: 30
2025-10-10T14:31:44.291546Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.287916Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.287924Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.291549Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 53
2025-10-10T14:31:44.287926Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.287931Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 30 partNo : 0 messageNo: 59 size 3273 offset: -1
2025-10-10T14:31:44.287934Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.287937Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
>>> event from dataHandler: 2025-10-10T14:31:44.291641Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 54 to 54
2025-10-10T14:31:44.287953Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.291849Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.287989Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.291853Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 54
2025-10-10T14:31:44.287994Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.288013Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 20 count 5 size 12657 actorID [3:7559600726884252064:2448]
2025-10-10T14:31:44.288022Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.288024Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.288026Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 20 partno 0 count 5 parts 0 suffix '63' size 12657
2025-10-10T14:31:44.288028Z node 3 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 Message { Data: ..3311 bytes.. Information: { Offset: 30 ProducerId: "src_id" SeqNo: 31 CreateTime: 2025-10-10T14:31:44.287000Z WriteTime: 2025-10-10T14:31:44.289000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:46198", "server": "ipv6:[::1]:46198", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..3421 bytes.. Information: { Offset: 31 ProducerId: "src_id" SeqNo: 32 CreateTime: 2025-10-10T14:31:44.287000Z WriteTime: 2025-10-10T14:31:44.289000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:46198", "server": "ipv6:[::1]:46198", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..3531 bytes.. Information: { Offset: 32 ProducerId: "src_id" SeqNo: 33 CreateTime: 2025-10-10T14:31:44.287000Z WriteTime: 2025-10-10T14:31:44.289000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:46198", "server": "ipv6:[::1]:46198", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..3641 bytes.. Information: { Offset: 33 ProducerId: "src_id" SeqNo: 34 CreateTime: 2025-10-10T14:31:44.288000Z WriteTime: 2025-10-10T14:31:44.289000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:46198", "server": "ipv6:[::1]:46198", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..3751 bytes.. Information: { Offset: 34 ProducerId: "src_id" SeqNo: 35 CreateTime: 2025-10-10T14:31:44.288000Z WriteTime: 2025-10-10T14:31:44.289000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:46198", "server": "ipv6:[::1]:46198", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..3861 bytes.. Information: { Offset: 35 ProducerId: "src_id" SeqNo: 36 CreateTime: 2025-10-10T14:31:44.288000Z WriteTime: 2025-10-10T14:31:44.289000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:46198", "server": "ipv6:[::1]:46198", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } }
2025-10-10T14:31:44.288035Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.288036Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 12550 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:31:44.288041Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.288046Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 21, partNo: 0, Offset: 20 is stored on disk
2025-10-10T14:31:44.288048Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.288053Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 22, partNo: 0, Offset: 21 is stored on disk
2025-10-10T14:31:44.291888Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] The application data is transferred to the client. Number of messages 6, size 21516 bytes
2025-10-10T14:31:44.288056Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.292334Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Returning serverBytesSize = 0 to budget
2025-10-10T14:31:44.288059Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 23, partNo: 0, Offset: 22 is stored on disk
2025-10-10T14:31:44.288061Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.291899Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 55 to 55
2025-10-10T14:31:44.288066Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 24, partNo: 0, Offset: 23 is stored on disk
2025-10-10T14:31:44.288068Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.288072Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 25, partNo: 0, Offset: 24 is stored on disk
2025-10-10T14:31:44.288096Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:44.288102Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:44.288104Z node 3 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (5)
2025-10-10T14:31:44.288110Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 20 EndOffset 20 newEndOffset 25 commitOffset 0 clientCommitOffset 0 cookie 5 readingFinished 0 firstRead 0
2025-10-10T14:31:44.288113Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 20 endOffset 25
2025-10-10T14:31:44.292370Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.288115Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-10T14:31:44.292374Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 55
2025-10-10T14:31:44.288120Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 20, endOffset# 25, WTime# 1760106704285, sizeLag# 12657
2025-10-10T14:31:44.288122Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1TEvPartitionReady. Aval parts: 1
2025-10-10T14:31:44.288130Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 performing read request: guid# 9db73793-33bb9559-7a0d0166-fb8bd30e, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 6, size# 15188, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-10T14:31:44.288134Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 0 FormedBlobsCount 0 NewHead: Offset 25 PartNo 0 PackedSize 2907 count 1 nextOffset 26 batches 1
2025-10-10T14:31:44.288139Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 6 maxSize 15188 maxTimeLagMs 0 readTimestampMs 0 readOffset 20 EndOffset 25 ClientCommitOffset 0 committedOffset 0 Guid 9db73793-33bb9559-7a0d0166-fb8bd30e
2025-10-10T14:31:44.288139Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-10T14:31:44.288145Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 0 FormedBlobsCount 0 NewHead: Offset 25 PartNo 0 PackedSize 5892 count 2 nextOffset 27 batches 1
2025-10-10T14:31:44.288148Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 28 partNo 0
2025-10-10T14:31:44.288153Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 28 partNo 0 FormedBlobsCount 0 NewHead: Offset 25 PartNo 0 PackedSize 8987 count 3 nextOffset 28 batches 1
2025-10-10T14:31:44.288156Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 29 partNo 0
2025-10-10T14:31:44.288160Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 29 partNo 0 FormedBlobsCount 0 NewHead: Offset 25 PartNo 0 PackedSize 12192 count 4 nextOffset 29 batches 1
2025-10-10T14:31:44.288163Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 30 partNo 0
2025-10-10T14:31:44.288168Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 30 partNo 0 FormedBlobsCount 0 NewHead: Offset 25 PartNo 0 PackedSize 15507 count 5 nextOffset 30 batches 1
2025-10-10T14:31:44.288170Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:44.288220Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 25,5 HeadOffset 25 endOffset 25 curOffset 30 d0000000000_00000000000000000025_00000_0000000005_00000? size 15407 WTime 1760106704288
2025-10-10T14:31:44.288236Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:182: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:31:44.288244Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.288246Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.292447Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 56 to 56
2025-10-10T14:31:44.292503Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Got ReadResponse, serverBytesSize = 21263, now ReadSizeBudget = 0, ReadSizeServerDelta = 503025
2025-10-10T14:31:44.288252Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 42  requestId: <none> cookie: 21
2025-10-10T14:31:44.292575Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.288262Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 43  requestId: <none> cookie: 22
2025-10-10T14:31:44.292580Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 56
2025-10-10T14:31:44.288267Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 45  requestId: <none> cookie: 23
2025-10-10T14:31:44.288270Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.288271Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 47  requestId: <none> cookie: 24
2025-10-10T14:31:44.288275Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 49  requestId: <none> cookie: 25
2025-10-10T14:31:44.288278Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.292592Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] In ContinueReadingDataImpl, ReadSizeBudget = 0, ReadSizeServerDelta = 503025
2025-10-10T14:31:44.288282Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.288282Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.288284Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.288286Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.288289Z node 3 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:31:44.288293Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.288299Z node 3 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 25 partNo 0 count 5 size 15407
2025-10-10T14:31:44.288303Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 60  requestId: <none> cookie: 31
2025-10-10T14:31:44.288324Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 61  requestId: <none> cookie: 32
2025-10-10T14:31:44.288346Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 8 Topic 'rt3.dc1--test-topic' partition 0 user user offset 20 count 6 size 15188 endOffset 25 max time lag 0ms effective offset 20
2025-10-10T14:31:44.288360Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 8 added 1 blobs, size 12657 count 5 last offset 20, current partition end offset: 25
2025-10-10T14:31:44.288362Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 8. Send blob request.
2025-10-10T14:31:44.288368Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 20 partno 0 count 5 parts_count 0 source 1 size 12657 accessed 0 times before, last time 2025-10-10T14:31:44.000000Z
2025-10-10T14:31:44.288370Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.288370Z node 3 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 8. All 1 blobs are from cache.
2025-10-10T14:31:44.288376Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:31:44.288389Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 20 partno 0 count 5 parts 0 suffix '63'
2025-10-10T14:31:44.288395Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.288398Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.288410Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 20 totakecount 5 count 5 size 12637 from pos 0 cbcount 5
2025-10-10T14:31:44.292637Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (36-40)
2025-10-10T14:31:44.292643Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 57 to 57
2025-10-10T14:31:44.288425Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 20
2025-10-10T14:31:44.292649Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.288426Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.292651Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 57
2025-10-10T14:31:44.288432Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.288434Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.288440Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 31 partNo : 0 messageNo: 62 size 3383 offset: -1
2025-10-10T14:31:44.292650Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Returning serverBytesSize = 21263 to budget
2025-10-10T14:31:44.288444Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.288445Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.292663Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] In ContinueReadingDataImpl, ReadSizeBudget = 21263, ReadSizeServerDelta = 503025
2025-10-10T14:31:44.288448Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.288449Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 32 partNo : 0 messageNo: 63 size 3493 offset: -1
2025-10-10T14:31:44.288463Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.288464Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.288468Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.292685Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-10T14:31:44.288473Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.288474Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.288475Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.288477Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.288482Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.288483Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.292710Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 58 to 58
2025-10-10T14:31:44.292932Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (36-36)
2025-10-10T14:31:44.288486Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 64  requestId: <none> cookie: 33
2025-10-10T14:31:44.292943Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.288490Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 65  requestId: <none> cookie: 34
2025-10-10T14:31:44.292947Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 1} (37-37)
2025-10-10T14:31:44.292949Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 58
2025-10-10T14:31:44.288501Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.288506Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.288525Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.288527Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.292959Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 2} (38-38)
2025-10-10T14:31:44.288531Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 33 partNo : 0 messageNo: 66 size 3603 offset: -1
2025-10-10T14:31:44.288534Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.288536Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.288539Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 34 partNo : 0 messageNo: 67 size 3713 offset: -1
2025-10-10T14:31:44.288542Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.292964Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 3} (39-39)
2025-10-10T14:31:44.288544Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.288544Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 25 Result { Offset: 20 Data: "... 2283 bytes ..." SourceId: "\000src_id" SeqNo: 21 WriteTimestampMS: 1760106704286 CreateTimestampMS: 1760106704285 UncompressedSize: 2211 PartitionKey: "" ExplicitHash: "" } Result { Offset: 21 Data: "... 2393 bytes ..." SourceId: "\000src_id" SeqNo: 22 WriteTimestampMS: 1760106704287 CreateTimestampMS: 1760106704286 UncompressedSize: 2321 PartitionKey: "" ExplicitHash: "" } Result { Offset: 22 Data: "... 2503 bytes ..." SourceId: "\000src_id" SeqNo: 23 WriteTimestampMS: 1760106704287 CreateTimestampMS: 1760106704286 UncompressedSize: 2431 PartitionKey: "" ExplicitHash: "" } Result { Offset: 23 Data: "... 2613 bytes ..." SourceId: "\000src_id" SeqNo: 24 WriteTimestampMS: 1760106704287 CreateTimestampMS: 1760106704286 UncompressedSize: 2541 PartitionKey: "" ExplicitHash: "" } Result { Offset: 24 Data: "... 2723 bytes ..." SourceId: "\000src_id" SeqNo: 25 WriteTimestampMS: 1760106704287 CreateTimestampMS: 1760106704286 UncompressedSize: 2651 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 18446744073709551548 RealReadOffset: 24 WaitQuotaTimeMs: 0 EndOffset: 25 StartOffset: 0 } Cookie: 20 }
2025-10-10T14:31:44.288546Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.288548Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.288577Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 6 from offset 25
2025-10-10T14:31:44.292991Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 4} (40-40)
2025-10-10T14:31:44.288582Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 25 ReadOffset 25 ReadGuid 9db73793-33bb9559-7a0d0166-fb8bd30e has messages 1
2025-10-10T14:31:44.288597Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 read done: guid# 9db73793-33bb9559-7a0d0166-fb8bd30e, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 12578
2025-10-10T14:31:44.288602Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 response to read: guid# 9db73793-33bb9559-7a0d0166-fb8bd30e
2025-10-10T14:31:44.288655Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.293021Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 59 to 59
>>> event from dataHandler: 2025-10-10T14:31:44.293522Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.288680Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.293528Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 59
2025-10-10T14:31:44.288684Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 Process answer. Aval parts: 0
2025-10-10T14:31:44.288757Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.288760Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.288771Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 68  requestId: <none> cookie: 35
DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 Message { Data: ..3971 bytes.. Information: { Offset: 36 ProducerId: "src_id" SeqNo: 37 CreateTime: 2025-10-10T14:31:44.288000Z WriteTime: 2025-10-10T14:31:44.290000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:46198", "_ip": "ipv6:[::1]:46198", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..4081 bytes.. Information: { Offset: 37 ProducerId: "src_id" SeqNo: 38 CreateTime: 2025-10-10T14:31:44.288000Z WriteTime: 2025-10-10T14:31:44.290000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:46198", "_ip": "ipv6:[::1]:46198", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..4191 bytes.. Information: { Offset: 38 ProducerId: "src_id" SeqNo: 39 CreateTime: 2025-10-10T14:31:44.289000Z WriteTime: 2025-10-10T14:31:44.290000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:46198", "_ip": "ipv6:[::1]:46198", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..4301 bytes.. Information: { Offset: 39 ProducerId: "src_id" SeqNo: 40 CreateTime: 2025-10-10T14:31:44.289000Z WriteTime: 2025-10-10T14:31:44.290000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:46198", "_ip": "ipv6:[::1]:46198", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..4411 bytes.. Information: { Offset: 40 ProducerId: "src_id" SeqNo: 41 CreateTime: 2025-10-10T14:31:44.289000Z WriteTime: 2025-10-10T14:31:44.290000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:46198", "_ip": "ipv6:[::1]:46198", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } }
2025-10-10T14:31:44.288784Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.288792Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.288794Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.293564Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 60 to 60
2025-10-10T14:31:44.288802Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 35 partNo : 0 messageNo: 69 size 3823 offset: -1
2025-10-10T14:31:44.288806Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.293573Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] The application data is transferred to the client. Number of messages 5, size 20955 bytes
2025-10-10T14:31:44.288812Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.293570Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.293580Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 60
2025-10-10T14:31:44.293580Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Returning serverBytesSize = 0 to budget
2025-10-10T14:31:44.293599Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 61 to 61
2025-10-10T14:31:44.288829Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 grpc read done: success# 1, data# { read_request { bytes_size: 12772 } }
2025-10-10T14:31:44.288848Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.288875Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.288887Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.288889Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.288893Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 got read request: guid# 7437e4bd-9339116e-b546e63d-d662eaa5
2025-10-10T14:31:44.288897Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 70  requestId: <none> cookie: 36
2025-10-10T14:31:44.293628Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.288903Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.293631Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 61
2025-10-10T14:31:44.288914Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.288916Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.288922Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 36 partNo : 0 messageNo: 71 size 3933 offset: -1
2025-10-10T14:31:44.288925Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.293638Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 62 to 62
2025-10-10T14:31:44.293639Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Got ReadResponse, serverBytesSize = 45097, now ReadSizeBudget = 0, ReadSizeServerDelta = 479191
2025-10-10T14:31:44.293647Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.293650Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 62
2025-10-10T14:31:44.293659Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 63 to 63
2025-10-10T14:31:44.293659Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] In ContinueReadingDataImpl, ReadSizeBudget = 0, ReadSizeServerDelta = 479191
2025-10-10T14:31:44.293676Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.293679Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 63
2025-10-10T14:31:44.293688Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (41-49)
2025-10-10T14:31:44.293700Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Returning serverBytesSize = 45097 to budget
2025-10-10T14:31:44.293704Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] In ContinueReadingDataImpl, ReadSizeBudget = 45097, ReadSizeServerDelta = 479191
2025-10-10T14:31:44.288930Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.289082Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.289120Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 25 count 5 size 15407 actorID [3:7559600726884252064:2448]
2025-10-10T14:31:44.289124Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.289132Z node 3 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:31:44.289142Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 15300 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:31:44.293725Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-10T14:31:44.289144Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 25 partno 0 count 5 parts 0 suffix '63' size 15407
2025-10-10T14:31:44.289145Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.289146Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.289150Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 26, partNo: 0, Offset: 25 is stored on disk
2025-10-10T14:31:44.289152Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.293740Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (41-41)
2025-10-10T14:31:44.289156Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 27, partNo: 0, Offset: 26 is stored on disk
2025-10-10T14:31:44.289157Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.289159Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 28, partNo: 0, Offset: 27 is stored on disk
2025-10-10T14:31:44.293751Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 64 to 64
2025-10-10T14:31:44.293753Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 1} (42-42)
2025-10-10T14:31:44.289161Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.289163Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 29, partNo: 0, Offset: 28 is stored on disk
2025-10-10T14:31:44.293765Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.294591Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 64
2025-10-10T14:31:44.293765Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 2} (43-43)
2025-10-10T14:31:44.294598Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Got ReadResponse, serverBytesSize = 28963, now ReadSizeBudget = 0, ReadSizeServerDelta = 495325
2025-10-10T14:31:44.294609Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 3} (44-44)
2025-10-10T14:31:44.289164Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.289167Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 30, partNo: 0, Offset: 29 is stored on disk
2025-10-10T14:31:44.289172Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.294635Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 4} (45-45)
2025-10-10T14:31:44.289180Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.294644Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 5} (46-46)
2025-10-10T14:31:44.289192Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:44.294650Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 6} (47-47)
2025-10-10T14:31:44.289197Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:44.294655Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 7} (48-48)
2025-10-10T14:31:44.289198Z node 3 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (6)
2025-10-10T14:31:44.289208Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 31 partNo 0
2025-10-10T14:31:44.289218Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.289223Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 31 partNo 0 FormedBlobsCount 0 NewHead: Offset 30 PartNo 0 PackedSize 3457 count 1 nextOffset 31 batches 1
2025-10-10T14:31:44.294666Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 65 to 65
2025-10-10T14:31:44.289227Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 32 partNo 0
2025-10-10T14:31:44.289233Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 25 EndOffset 25 newEndOffset 30 commitOffset 0 clientCommitOffset 0 cookie 6 readingFinished 0 firstRead 0
2025-10-10T14:31:44.294677Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.289236Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 25 endOffset 30
2025-10-10T14:31:44.289241Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 32 partNo 0 FormedBlobsCount 0 NewHead: Offset 30 PartNo 0 PackedSize 6992 count 2 nextOffset 32 batches 1
2025-10-10T14:31:44.289243Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 25, endOffset# 30, WTime# 1760106704287, sizeLag# 15407
2025-10-10T14:31:44.294680Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 65
2025-10-10T14:31:44.289244Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 33 partNo 0
2025-10-10T14:31:44.289245Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1TEvPartitionReady. Aval parts: 1
2025-10-10T14:31:44.289249Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 33 partNo 0 FormedBlobsCount 0 NewHead: Offset 30 PartNo 0 PackedSize 10637 count 3 nextOffset 33 batches 1
2025-10-10T14:31:44.289251Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 34 partNo 0
2025-10-10T14:31:44.289254Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 performing read request: guid# dd8efdba-fdba18d2-21ef6716-346ffeb5, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 6, size# 18488, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-10T14:31:44.289255Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 34 partNo 0 FormedBlobsCount 0 NewHead: Offset 30 PartNo 0 PackedSize 14392 count 4 nextOffset 34 batches 1
2025-10-10T14:31:44.289258Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 35 partNo 0
2025-10-10T14:31:44.289263Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 35 partNo 0 FormedBlobsCount 0 NewHead: Offset 30 PartNo 0 PackedSize 18257 count 5 nextOffset 35 batches 1
2025-10-10T14:31:44.289264Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 6 maxSize 18488 maxTimeLagMs 0 readTimestampMs 0 readOffset 25 EndOffset 30 ClientCommitOffset 0 committedOffset 0 Guid dd8efdba-fdba18d2-21ef6716-346ffeb5
2025-10-10T14:31:44.289267Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 36 partNo 0
2025-10-10T14:31:44.289271Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 36 partNo 0 FormedBlobsCount 0 NewHead: Offset 30 PartNo 0 PackedSize 22232 count 6 nextOffset 36 batches 1
2025-10-10T14:31:44.294715Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 8} (49-49)
2025-10-10T14:31:44.289273Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:44.289343Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 30,6 HeadOffset 30 endOffset 30 curOffset 36 d0000000000_00000000000000000030_00000_0000000006_00000? size 22102 WTime 1760106704289
2025-10-10T14:31:44.289380Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:182: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:31:44.289388Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.289391Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.289403Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 51  requestId: <none> cookie: 26
2025-10-10T14:31:44.289416Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 53  requestId: <none> cookie: 27
2025-10-10T14:31:44.289420Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 55  requestId: <none> cookie: 28
2025-10-10T14:31:44.295399Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] In ContinueReadingDataImpl, ReadSizeBudget = 0, ReadSizeServerDelta = 495325
2025-10-10T14:31:44.294732Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 66 to 66
2025-10-10T14:31:44.289421Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.289424Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 57  requestId: <none> cookie: 29
2025-10-10T14:31:44.295422Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.289427Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.295429Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 66
2025-10-10T14:31:44.289428Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 59  requestId: <none> cookie: 30
2025-10-10T14:31:44.289431Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.289431Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.289433Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.295441Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (50-54)
2025-10-10T14:31:44.289435Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.295455Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Returning serverBytesSize = 28963 to budget
2025-10-10T14:31:44.295459Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] In ContinueReadingDataImpl, ReadSizeBudget = 28963, ReadSizeServerDelta = 495325
2025-10-10T14:31:44.289437Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.289438Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.289438Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.289445Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.289447Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.289454Z node 3 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:31:44.289463Z node 3 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 30 partNo 0 count 6 size 22102
2025-10-10T14:31:44.289489Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 72  requestId: <none> cookie: 37
2025-10-10T14:31:44.295480Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
>>> event from dataHandler: 2025-10-10T14:31:44.289492Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 73  requestId: <none> cookie: 38
2025-10-10T14:31:44.289495Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 74  requestId: <none> cookie: 39
2025-10-10T14:31:44.289516Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 9 Topic 'rt3.dc1--test-topic' partition 0 user user offset 25 count 6 size 18488 endOffset 30 max time lag 0ms effective offset 25
2025-10-10T14:31:44.295497Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (50-50)
2025-10-10T14:31:44.289530Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 9 added 1 blobs, size 15407 count 5 last offset 25, current partition end offset: 30
2025-10-10T14:31:44.289535Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 9. Send blob request.
2025-10-10T14:31:44.289541Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 25 partno 0 count 5 parts_count 0 source 1 size 15407 accessed 0 times before, last time 2025-10-10T14:31:44.000000Z
2025-10-10T14:31:44.295505Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 1} (51-51)
2025-10-10T14:31:44.289549Z node 3 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 9. All 1 blobs are from cache.
2025-10-10T14:31:44.295510Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 2} (52-52)
2025-10-10T14:31:44.289555Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 25 partno 0 count 5 parts 0 suffix '63'
2025-10-10T14:31:44.295513Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 3} (53-53)
2025-10-10T14:31:44.295513Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 67 to 67
2025-10-10T14:31:44.295521Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 4} (54-54)
2025-10-10T14:31:44.289556Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:31:44.295523Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.289581Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 25 totakecount 5 count 5 size 15387 from pos 0 cbcount 5
DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 Message { Data: ..4521 bytes.. Information: { Offset: 41 ProducerId: "src_id" SeqNo: 42 CreateTime: 2025-10-10T14:31:44.289000Z WriteTime: 2025-10-10T14:31:44.291000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "server": "ipv6:[::1]:46198", "_ip": "ipv6:[::1]:46198", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..4631 bytes.. Information: { Offset: 42 ProducerId: "src_id" SeqNo: 43 CreateTime: 2025-10-10T14:31:44.290000Z WriteTime: 2025-10-10T14:31:44.291000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "server": "ipv6:[::1]:46198", "_ip": "ipv6:[::1]:46198", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..4741 bytes.. Information: { Offset: 43 ProducerId: "src_id" SeqNo: 44 CreateTime: 2025-10-10T14:31:44.290000Z WriteTime: 2025-10-10T14:31:44.291000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "server": "ipv6:[::1]:46198", "_ip": "ipv6:[::1]:46198", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..4851 bytes.. Information: { Offset: 44 ProducerId: "src_id" SeqNo: 45 CreateTime: 2025-10-10T14:31:44.290000Z WriteTime: 2025-10-10T14:31:44.291000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "server": "ipv6:[::1]:46198", "_ip": "ipv6:[::1]:46198", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..4961 bytes.. Information: { Offset: 45 ProducerId: "src_id" SeqNo: 46 CreateTime: 2025-10-10T14:31:44.290000Z WriteTime: 2025-10-10T14:31:44.291000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "server": "ipv6:[::1]:46198", "_ip": "ipv6:[::1]:46198", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..5071 bytes.. Information: { Offset: 46 ProducerId: "src_id" SeqNo: 47 CreateTime: 2025-10-10T14:31:44.290000Z WriteTime: 2025-10-10T14:31:44.291000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "server": "ipv6:[::1]:46198", "_ip": "ipv6:[::1]:46198", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..5181 bytes.. Information: { Offset: 47 ProducerId: "src_id" SeqNo: 48 CreateTime: 2025-10-10T14:31:44.290000Z WriteTime: 2025-10-10T14:31:44.291000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "server": "ipv6:[::1]:46198", "_ip": "ipv6:[::1]:46198", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..5291 bytes.. Information: { Offset: 48 ProducerId: "src_id" SeqNo: 49 CreateTime: 2025-10-10T14:31:44.290000Z WriteTime: 2025-10-10T14:31:44.291000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "server": "ipv6:[::1]:46198", "_ip": "ipv6:[::1]:46198", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..5401 bytes.. Information: { Offset: 49 ProducerId: "src_id" SeqNo: 50 CreateTime: 2025-10-10T14:31:44.290000Z WriteTime: 2025-10-10T14:31:44.291000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "server": "ipv6:[::1]:46198", "_ip": "ipv6:[::1]:46198", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } }
2025-10-10T14:31:44.289595Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 25
2025-10-10T14:31:44.289598Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.289603Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.295526Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 67
2025-10-10T14:31:44.289606Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.295827Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] The application data is transferred to the client. Number of messages 9, size 44649 bytes
2025-10-10T14:31:44.295621Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Got ReadResponse, serverBytesSize = 25177, now ReadSizeBudget = 0, ReadSizeServerDelta = 499111
2025-10-10T14:31:44.289608Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.289628Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 grpc read done: success# 1, data# { read_request { bytes_size: 12578 } }
2025-10-10T14:31:44.289644Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 got read request: guid# 6d251f56-72b425d3-e1f9fd4b-96fd9b59
2025-10-10T14:31:44.289658Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.289668Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.295859Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] In ContinueReadingDataImpl, ReadSizeBudget = 0, ReadSizeServerDelta = 499111
2025-10-10T14:31:44.289672Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.295865Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] In ContinueReadingDataImpl, ReadSizeBudget = 0, ReadSizeServerDelta = 499111
2025-10-10T14:31:44.289681Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 75 size 4043 offset: -1
2025-10-10T14:31:44.295875Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Returning serverBytesSize = 0 to budget
2025-10-10T14:31:44.295877Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] In ContinueReadingDataImpl, ReadSizeBudget = 0, ReadSizeServerDelta = 499111
2025-10-10T14:31:44.295878Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 68 to 68
2025-10-10T14:31:44.289685Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.295888Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.289687Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.289691Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 76 size 4153 offset: -1
2025-10-10T14:31:44.289694Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 30 Result { Offset: 25 Data: "... 2833 bytes ..." SourceId: "\000src_id" SeqNo: 26 WriteTimestampMS: 1760106704288 CreateTimestampMS: 1760106704286 UncompressedSize: 2761 PartitionKey: "" ExplicitHash: "" } Result { Offset: 26 Data: "... 2943 bytes ..." SourceId: "\000src_id" SeqNo: 27 WriteTimestampMS: 1760106704288 CreateTimestampMS: 1760106704286 UncompressedSize: 2871 PartitionKey: "" ExplicitHash: "" } Result { Offset: 27 Data: "... 3053 bytes ..." SourceId: "\000src_id" SeqNo: 28 WriteTimestampMS: 1760106704288 CreateTimestampMS: 1760106704287 UncompressedSize: 2981 PartitionKey: "" ExplicitHash: "" } Result { Offset: 28 Data: "... 3163 bytes ..." SourceId: "\000src_id" SeqNo: 29 WriteTimestampMS: 1760106704288 CreateTimestampMS: 1760106704287 UncompressedSize: 3091 PartitionKey: "" ExplicitHash: "" } Result { Offset: 29 Data: "... 3273 bytes ..." SourceId: "\000src_id" SeqNo: 30 WriteTimestampMS: 1760106704288 CreateTimestampMS: 1760106704287 UncompressedSize: 3201 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 18446744073709551548 RealReadOffset: 29 WaitQuotaTimeMs: 0 EndOffset: 30 StartOffset: 0 } Cookie: 25 }
2025-10-10T14:31:44.289694Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.295892Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 68
2025-10-10T14:31:44.289696Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.289699Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 77 size 4263 offset: -1
2025-10-10T14:31:44.289702Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.295920Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (55-58)
2025-10-10T14:31:44.289704Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.295933Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Returning serverBytesSize = 25177 to budget
2025-10-10T14:31:44.295923Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 69 to 69
2025-10-10T14:31:44.295937Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] In ContinueReadingDataImpl, ReadSizeBudget = 25177, ReadSizeServerDelta = 499111
2025-10-10T14:31:44.289710Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.289716Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.295948Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.295954Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 69
2025-10-10T14:31:44.289719Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.289722Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.289722Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 7 from offset 30
>>> event from dataHandler: 2025-10-10T14:31:44.295997Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 70 to 70
2025-10-10T14:31:44.296000Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-10T14:31:44.296364Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 Message { Data: ..5511 bytes.. Information: { Offset: 50 ProducerId: "src_id" SeqNo: 51 CreateTime: 2025-10-10T14:31:44.291000Z WriteTime: 2025-10-10T14:31:44.292000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:46198", "_ip": "ipv6:[::1]:46198" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..5621 bytes.. Information: { Offset: 51 ProducerId: "src_id" SeqNo: 52 CreateTime: 2025-10-10T14:31:44.291000Z WriteTime: 2025-10-10T14:31:44.292000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:46198", "_ip": "ipv6:[::1]:46198" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..5731 bytes.. Information: { Offset: 52 ProducerId: "src_id" SeqNo: 53 CreateTime: 2025-10-10T14:31:44.291000Z WriteTime: 2025-10-10T14:31:44.292000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:46198", "_ip": "ipv6:[::1]:46198" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..5841 bytes.. Information: { Offset: 53 ProducerId: "src_id" SeqNo: 54 CreateTime: 2025-10-10T14:31:44.291000Z WriteTime: 2025-10-10T14:31:44.292000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:46198", "_ip": "ipv6:[::1]:46198" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..5951 bytes.. Information: { Offset: 54 ProducerId: "src_id" SeqNo: 55 CreateTime: 2025-10-10T14:31:44.291000Z WriteTime: 2025-10-10T14:31:44.292000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:46198", "_ip": "ipv6:[::1]:46198" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } }
2025-10-10T14:31:44.296367Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 70
2025-10-10T14:31:44.289723Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.296381Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (55-55)
2025-10-10T14:31:44.289726Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.289727Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 30 ReadOffset 30 ReadGuid dd8efdba-fdba18d2-21ef6716-346ffeb5 has messages 1
2025-10-10T14:31:44.289732Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 78  requestId: <none> cookie: 40
2025-10-10T14:31:44.289740Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.296397Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 1} (56-56)
2025-10-10T14:31:44.296399Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] The application data is transferred to the client. Number of messages 5, size 28655 bytes
2025-10-10T14:31:44.296405Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Returning serverBytesSize = 0 to budget
2025-10-10T14:31:44.289743Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.296409Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 2} (57-57)
2025-10-10T14:31:44.289747Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 read done: guid# dd8efdba-fdba18d2-21ef6716-346ffeb5, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 15210
2025-10-10T14:31:44.296413Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 3} (58-58)
2025-10-10T14:31:44.289753Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 response to read: guid# dd8efdba-fdba18d2-21ef6716-346ffeb5
2025-10-10T14:31:44.289766Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.289773Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.289777Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.289780Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 79 size 4373 offset: -1
2025-10-10T14:31:44.289782Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
>>> event from dataHandler: 2025-10-10T14:31:44.289784Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.289789Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.296438Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 71 to 71
DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 Message { Data: ..6061 bytes.. Information: { Offset: 55 ProducerId: "src_id" SeqNo: 56 CreateTime: 2025-10-10T14:31:44.292000Z WriteTime: 2025-10-10T14:31:44.293000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:46198", "logtype": "unknown", "server": "ipv6:[::1]:46198" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..6171 bytes.. Information: { Offset: 56 ProducerId: "src_id" SeqNo: 57 CreateTime: 2025-10-10T14:31:44.292000Z WriteTime: 2025-10-10T14:31:44.293000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:46198", "logtype": "unknown", "server": "ipv6:[::1]:46198" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..6281 bytes.. Information: { Offset: 57 ProducerId: "src_id" SeqNo: 58 CreateTime: 2025-10-10T14:31:44.292000Z WriteTime: 2025-10-10T14:31:44.293000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:46198", "logtype": "unknown", "server": "ipv6:[::1]:46198" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..6391 bytes.. Information: { Offset: 58 ProducerId: "src_id" SeqNo: 59 CreateTime: 2025-10-10T14:31:44.293000Z WriteTime: 2025-10-10T14:31:44.293000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:46198", "logtype": "unknown", "server": "ipv6:[::1]:46198" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } }
2025-10-10T14:31:44.289791Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.296451Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.296961Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] The application data is transferred to the client. Number of messages 4, size 24904 bytes
2025-10-10T14:31:44.296970Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 71
2025-10-10T14:31:44.296870Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Got ReadResponse, serverBytesSize = 40999, now ReadSizeBudget = 0, ReadSizeServerDelta = 483289
2025-10-10T14:31:44.289794Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 80  requestId: <none> cookie: 41
2025-10-10T14:31:44.289798Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.297003Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] In ContinueReadingDataImpl, ReadSizeBudget = 0, ReadSizeServerDelta = 483289
2025-10-10T14:31:44.289815Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.289817Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.297011Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] In ContinueReadingDataImpl, ReadSizeBudget = 0, ReadSizeServerDelta = 483289
2025-10-10T14:31:44.289821Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 81 size 4483 offset: -1
2025-10-10T14:31:44.289824Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.297016Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Returning serverBytesSize = 0 to budget
2025-10-10T14:31:44.297019Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] In ContinueReadingDataImpl, ReadSizeBudget = 0, ReadSizeServerDelta = 483289
2025-10-10T14:31:44.289826Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.289833Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 Process answer. Aval parts: 0
2025-10-10T14:31:44.290136Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.290189Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.290226Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.290232Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 grpc read done: success# 1, data# { read_request { bytes_size: 15210 } }
2025-10-10T14:31:44.290234Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.290241Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.290245Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.290246Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 got read request: guid# 5b7c5c52-6e6fd730-31f30b21-d64c6098
2025-10-10T14:31:44.297051Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 72 to 72
2025-10-10T14:31:44.290251Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.290254Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.290294Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 82  requestId: <none> cookie: 42
2025-10-10T14:31:44.290309Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 30 count 6 size 22102 actorID [3:7559600726884252064:2448]
2025-10-10T14:31:44.297065Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.290311Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.297074Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 72
2025-10-10T14:31:44.290319Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 83  requestId: <none> cookie: 43
2025-10-10T14:31:44.290323Z node 3 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:31:44.290327Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.297087Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 73 to 73
2025-10-10T14:31:44.297093Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.290330Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 21990 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:31:44.297096Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 73
2025-10-10T14:31:44.290331Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 6 parts 0 suffix '63' size 22102
2025-10-10T14:31:44.290335Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.297107Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (59-64)
2025-10-10T14:31:44.290341Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 31, partNo: 0, Offset: 30 is stored on disk
2025-10-10T14:31:44.297120Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Returning serverBytesSize = 40999 to budget
2025-10-10T14:31:44.290344Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.297111Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 74 to 74
2025-10-10T14:31:44.297124Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] In ContinueReadingDataImpl, ReadSizeBudget = 40999, ReadSizeServerDelta = 483289
2025-10-10T14:31:44.297535Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.290347Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 32, partNo: 0, Offset: 31 is stored on disk
2025-10-10T14:31:44.297540Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 74
2025-10-10T14:31:44.290349Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.290367Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.290372Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 33, partNo: 0, Offset: 32 is stored on disk
2025-10-10T14:31:44.290374Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.290378Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 34, partNo: 0, Offset: 33 is stored on disk
2025-10-10T14:31:44.290380Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.290383Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 35, partNo: 0, Offset: 34 is stored on disk
2025-10-10T14:31:44.297577Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 75 to 75
2025-10-10T14:31:44.290385Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.290387Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 36, partNo: 0, Offset: 35 is stored on disk
2025-10-10T14:31:44.290389Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.290403Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:44.290408Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:44.297589Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.290408Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 30 EndOffset 30 newEndOffset 36 commitOffset 0 clientCommitOffset 0 cookie 7 readingFinished 0 firstRead 0
2025-10-10T14:31:44.297592Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 75
2025-10-10T14:31:44.290409Z node 3 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (5)
2025-10-10T14:31:44.290411Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 30 endOffset 36
2025-10-10T14:31:44.290417Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 30, endOffset# 36, WTime# 1760106704288, sizeLag# 22102
2025-10-10T14:31:44.297606Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-10T14:31:44.290419Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 37 partNo 0
2025-10-10T14:31:44.297609Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 76 to 76
2025-10-10T14:31:44.290419Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1TEvPartitionReady. Aval parts: 1
2025-10-10T14:31:44.290427Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 performing read request: guid# 83da9495-b4e9d73d-f4508d7e-fc4013fc, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 7, size# 26522, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-10T14:31:44.297616Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Got ReadResponse, serverBytesSize = 7326, now ReadSizeBudget = 0, ReadSizeServerDelta = 516962
2025-10-10T14:31:44.297619Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (59-59)
2025-10-10T14:31:44.290433Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 37 partNo 0 FormedBlobsCount 0 NewHead: Offset 36 PartNo 0 PackedSize 4117 count 1 nextOffset 37 batches 1
2025-10-10T14:31:44.297621Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.297655Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 76
2025-10-10T14:31:44.290436Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 7 maxSize 26522 maxTimeLagMs 0 readTimestampMs 0 readOffset 30 EndOffset 36 ClientCommitOffset 0 committedOffset 0 Guid 83da9495-b4e9d73d-f4508d7e-fc4013fc
2025-10-10T14:31:44.290437Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 38 partNo 0
2025-10-10T14:31:44.297663Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 1} (60-60)
2025-10-10T14:31:44.290440Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 38 partNo 0 FormedBlobsCount 0 NewHead: Offset 36 PartNo 0 PackedSize 8312 count 2 nextOffset 38 batches 1
2025-10-10T14:31:44.297666Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 77 to 77
2025-10-10T14:31:44.290442Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 39 partNo 0
2025-10-10T14:31:44.297686Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.297690Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 77
2025-10-10T14:31:44.290446Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 39 partNo 0 FormedBlobsCount 0 NewHead: Offset 36 PartNo 0 PackedSize 12617 count 3 nextOffset 39 batches 1
2025-10-10T14:31:44.297670Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 2} (61-61)
2025-10-10T14:31:44.290447Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 40 partNo 0
2025-10-10T14:31:44.290450Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 40 partNo 0 FormedBlobsCount 0 NewHead: Offset 36 PartNo 0 PackedSize 17032 count 4 nextOffset 40 batches 1
2025-10-10T14:31:44.297713Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 3} (62-62)
2025-10-10T14:31:44.290452Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 41 partNo 0
2025-10-10T14:31:44.290454Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 41 partNo 0 FormedBlobsCount 0 NewHead: Offset 36 PartNo 0 PackedSize 21557 count 5 nextOffset 41 batches 1
2025-10-10T14:31:44.290456Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:44.290477Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.290490Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 36,5 HeadOffset 36 endOffset 36 curOffset 41 d0000000000_00000000000000000036_00000_0000000005_00000? size 21459 WTime 1760106704290
2025-10-10T14:31:44.290515Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:182: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:31:44.290520Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.297748Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 4} (63-63)
2025-10-10T14:31:44.297753Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 5} (64-64)
2025-10-10T14:31:44.290523Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.290530Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.290533Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 84 size 4593 offset: -1
2025-10-10T14:31:44.290538Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.290540Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.290543Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 85 size 4703 offset: -1
2025-10-10T14:31:44.290551Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 62  requestId: <none> cookie: 31
2025-10-10T14:31:44.297778Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] In ContinueReadingDataImpl, ReadSizeBudget = 0, ReadSizeServerDelta = 516962
2025-10-10T14:31:44.290555Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.290557Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 63  requestId: <none> cookie: 32
2025-10-10T14:31:44.290560Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.290561Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 66  requestId: <none> cookie: 33
2025-10-10T14:31:44.290564Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 67  requestId: <none> cookie: 34
2025-10-10T14:31:44.290567Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 69  requestId: <none> cookie: 35
2025-10-10T14:31:44.290571Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 71  requestId: <none> cookie: 36
2025-10-10T14:31:44.290574Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.290576Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.290583Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.290585Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.297807Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (65-65)
2025-10-10T14:31:44.298513Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Returning serverBytesSize = 7326 to budget
2025-10-10T14:31:44.298532Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] In ContinueReadingDataImpl, ReadSizeBudget = 7326, ReadSizeServerDelta = 516962
>>> event from dataHandler: 2025-10-10T14:31:44.290590Z node 3 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:31:44.297816Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 78 to 78
2025-10-10T14:31:44.290599Z node 3 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 36 partNo 0 count 5 size 21459
2025-10-10T14:31:44.290604Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 Message { Data: ..6501 bytes.. Information: { Offset: 59 ProducerId: "src_id" SeqNo: 60 CreateTime: 2025-10-10T14:31:44.293000Z WriteTime: 2025-10-10T14:31:44.294000Z MessageGroupId: "src_id" Meta: { "_ip": "ipv6:[::1]:46198", "logtype": "unknown", "server": "ipv6:[::1]:46198", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..6611 bytes.. Information: { Offset: 60 ProducerId: "src_id" SeqNo: 61 CreateTime: 2025-10-10T14:31:44.293000Z WriteTime: 2025-10-10T14:31:44.294000Z MessageGroupId: "src_id" Meta: { "_ip": "ipv6:[::1]:46198", "logtype": "unknown", "server": "ipv6:[::1]:46198", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..6721 bytes.. Information: { Offset: 61 ProducerId: "src_id" SeqNo: 62 CreateTime: 2025-10-10T14:31:44.293000Z WriteTime: 2025-10-10T14:31:44.294000Z MessageGroupId: "src_id" Meta: { "_ip": "ipv6:[::1]:46198", "logtype": "unknown", "server": "ipv6:[::1]:46198", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..6831 bytes.. Information: { Offset: 62 ProducerId: "src_id" SeqNo: 63 CreateTime: 2025-10-10T14:31:44.293000Z WriteTime: 2025-10-10T14:31:44.294000Z MessageGroupId: "src_id" Meta: { "_ip": "ipv6:[::1]:46198", "logtype": "unknown", "server": "ipv6:[::1]:46198", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..6941 bytes.. Information: { Offset: 63 ProducerId: "src_id" SeqNo: 64 CreateTime: 2025-10-10T14:31:44.293000Z WriteTime: 2025-10-10T14:31:44.294000Z MessageGroupId: "src_id" Meta: { "_ip": "ipv6:[::1]:46198", "logtype": "unknown", "server": "ipv6:[::1]:46198", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..7051 bytes.. Information: { Offset: 64 ProducerId: "src_id" SeqNo: 65 CreateTime: 2025-10-10T14:31:44.294000Z WriteTime: 2025-10-10T14:31:44.294000Z MessageGroupId: "src_id" Meta: { "_ip": "ipv6:[::1]:46198", "logtype": "unknown", "server": "ipv6:[::1]:46198", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } }
2025-10-10T14:31:44.290604Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.298592Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-10T14:31:44.290607Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.298585Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.298597Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] The application data is transferred to the client. Number of messages 6, size 40656 bytes
2025-10-10T14:31:44.298601Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 78
2025-10-10T14:31:44.290609Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.298609Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Returning serverBytesSize = 0 to budget
2025-10-10T14:31:44.290610Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.298612Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (65-65)
2025-10-10T14:31:44.290612Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.290612Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.290615Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.290616Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.290618Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.290639Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 86  requestId: <none> cookie: 44
2025-10-10T14:31:44.290655Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.290659Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 87  requestId: <none> cookie: 45
2025-10-10T14:31:44.290663Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
>>> event from dataHandler: 2025-10-10T14:31:44.290666Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 10 Topic 'rt3.dc1--test-topic' partition 0 user user offset 30 count 7 size 26522 endOffset 36 max time lag 0ms effective offset 30
2025-10-10T14:31:44.290678Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 10 added 1 blobs, size 22102 count 6 last offset 30, current partition end offset: 36
DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 Message { Data: ..7161 bytes.. Information: { Offset: 65 ProducerId: "src_id" SeqNo: 66 CreateTime: 2025-10-10T14:31:44.294000Z WriteTime: 2025-10-10T14:31:44.295000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:46198", "logtype": "unknown", "server": "ipv6:[::1]:46198" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } }
2025-10-10T14:31:44.290681Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 10. Send blob request.
2025-10-10T14:31:44.298926Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] The application data is transferred to the client. Number of messages 1, size 7161 bytes
2025-10-10T14:31:44.298696Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 79 to 79
2025-10-10T14:31:44.298951Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.298759Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Got ReadResponse, serverBytesSize = 30017, now ReadSizeBudget = 0, ReadSizeServerDelta = 494271
2025-10-10T14:31:44.298956Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 79
2025-10-10T14:31:44.290684Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.290686Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.298980Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] In ContinueReadingDataImpl, ReadSizeBudget = 0, ReadSizeServerDelta = 494271
2025-10-10T14:31:44.290690Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 88 size 4813 offset: -1
2025-10-10T14:31:44.290694Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.298986Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] In ContinueReadingDataImpl, ReadSizeBudget = 0, ReadSizeServerDelta = 494271
2025-10-10T14:31:44.290696Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.298991Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Returning serverBytesSize = 0 to budget
2025-10-10T14:31:44.290700Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 89 size 4923 offset: -1
2025-10-10T14:31:44.298994Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] In ContinueReadingDataImpl, ReadSizeBudget = 0, ReadSizeServerDelta = 494271
2025-10-10T14:31:44.290707Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 30 partno 0 count 6 parts_count 0 source 1 size 22102 accessed 0 times before, last time 2025-10-10T14:31:44.000000Z
2025-10-10T14:31:44.290714Z node 3 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 10. All 1 blobs are from cache.
2025-10-10T14:31:44.290718Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.290721Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 6 parts 0 suffix '63'
2025-10-10T14:31:44.290722Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.290724Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.299013Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (66-69)
2025-10-10T14:31:44.299028Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 80 to 80
2025-10-10T14:31:44.299036Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Returning serverBytesSize = 30017 to budget
2025-10-10T14:31:44.290726Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.299041Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.299041Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] In ContinueReadingDataImpl, ReadSizeBudget = 30017, ReadSizeServerDelta = 494271
2025-10-10T14:31:44.290730Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:31:44.290795Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 30 totakecount 6 count 6 size 22080 from pos 0 cbcount 6
2025-10-10T14:31:44.299044Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 80
2025-10-10T14:31:44.290815Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 30
2025-10-10T14:31:44.290897Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 36 Result { Offset: 30 Data: "... 3383 bytes ..." SourceId: "\000src_id" SeqNo: 31 WriteTimestampMS: 1760106704289 CreateTimestampMS: 1760106704287 UncompressedSize: 3311 PartitionKey: "" ExplicitHash: "" } Result { Offset: 31 Data: "... 3493 bytes ..." SourceId: "\000src_id" SeqNo: 32 WriteTimestampMS: 1760106704289 CreateTimestampMS: 1760106704287 UncompressedSize: 3421 PartitionKey: "" ExplicitHash: "" } Result { Offset: 32 Data: "... 3603 bytes ..." SourceId: "\000src_id" SeqNo: 33 WriteTimestampMS: 1760106704289 CreateTimestampMS: 1760106704287 UncompressedSize: 3531 PartitionKey: "" ExplicitHash: "" } Result { Offset: 33 Data: "... 3713 bytes ..." SourceId: "\000src_id" SeqNo: 34 WriteTimestampMS: 1760106704289 CreateTimestampMS: 1760106704288 UncompressedSize: 3641 PartitionKey: "" ExplicitHash: "" } Result { Offset: 34 Data: "... 3823 bytes ..." SourceId: "\000src_id" SeqNo: 35 WriteTimestampMS: 1760106704289 CreateTimestampMS: 1760106704288 UncompressedSize: 3751 PartitionKey: "" ExplicitHash: "" } Result { Offset: 35 Data: "... 3933 bytes ..." SourceId: "\000src_id" SeqNo: 36 WriteTimestampMS: 1760106704289 CreateTimestampMS: 1760106704288 UncompressedSize: 3861 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 18446744073709551518 RealReadOffset: 35 WaitQuotaTimeMs: 0 EndOffset: 36 StartOffset: 0 } Cookie: 30 }
2025-10-10T14:31:44.290930Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 8 from offset 36
2025-10-10T14:31:44.290932Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.290935Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 36 ReadOffset 36 ReadGuid 83da9495-b4e9d73d-f4508d7e-fc4013fc has messages 1
2025-10-10T14:31:44.290952Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 read done: guid# 83da9495-b4e9d73d-f4508d7e-fc4013fc, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 21859
2025-10-10T14:31:44.290957Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 response to read: guid# 83da9495-b4e9d73d-f4508d7e-fc4013fc
2025-10-10T14:31:44.291025Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.299069Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-10T14:31:44.299483Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (66-66)
2025-10-10T14:31:44.299491Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 1} (67-67)
2025-10-10T14:31:44.299497Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 2} (68-68)
2025-10-10T14:31:44.299501Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 3} (69-69)
>>> event from dataHandler: DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 Message { Data: ..7271 bytes.. Information: { Offset: 66 ProducerId: "src_id" SeqNo: 67 CreateTime: 2025-10-10T14:31:44.295000Z WriteTime: 2025-10-10T14:31:44.296000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:46198", "server": "ipv6:[::1]:46198", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..7381 bytes.. Information: { Offset: 67 ProducerId: "src_id" SeqNo: 68 CreateTime: 2025-10-10T14:31:44.295000Z WriteTime: 2025-10-10T14:31:44.296000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:46198", "server": "ipv6:[::1]:46198", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..7491 bytes.. Information: { Offset: 68 ProducerId: "src_id" SeqNo: 69 CreateTime: 2025-10-10T14:31:44.295000Z WriteTime: 2025-10-10T14:31:44.296000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:46198", "server": "ipv6:[::1]:46198", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..7601 bytes.. Information: { Offset: 69 ProducerId: "src_id" SeqNo: 70 CreateTime: 2025-10-10T14:31:44.295000Z WriteTime: 2025-10-10T14:31:44.296000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:46198", "server": "ipv6:[::1]:46198", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } }
2025-10-10T14:31:44.299076Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 81 to 81
2025-10-10T14:31:44.299557Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] The application data is transferred to the client. Number of messages 4, size 29744 bytes
2025-10-10T14:31:44.299562Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Returning serverBytesSize = 0 to budget
2025-10-10T14:31:44.299567Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.299573Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 81
2025-10-10T14:31:44.299658Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 82 to 82
2025-10-10T14:31:44.299666Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.299669Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 82
2025-10-10T14:31:44.299680Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 83 to 83
2025-10-10T14:31:44.291035Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.291061Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 Process answer. Aval parts: 0
2025-10-10T14:31:44.291064Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.299708Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.291098Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.299712Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 83
2025-10-10T14:31:44.291111Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.291122Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.291124Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.291140Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.291213Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.291220Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.291255Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.299731Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Got ReadResponse, serverBytesSize = 23701, now ReadSizeBudget = 0, ReadSizeServerDelta = 500587
2025-10-10T14:31:44.291258Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.291281Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.291284Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.291293Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 90  requestId: <none> cookie: 46
2025-10-10T14:31:44.291299Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 91  requestId: <none> cookie: 47
2025-10-10T14:31:44.291301Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 92  requestId: <none> cookie: 48
2025-10-10T14:31:44.299759Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] In ContinueReadingDataImpl, ReadSizeBudget = 0, ReadSizeServerDelta = 500587
2025-10-10T14:31:44.291309Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.299843Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 84 to 84
2025-10-10T14:31:44.300109Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.291310Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.300112Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 84
2025-10-10T14:31:44.291311Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.291315Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 93  requestId: <none> cookie: 49
2025-10-10T14:31:44.291316Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.291323Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.291330Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.291332Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.291334Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.291336Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.300138Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (70-72)
2025-10-10T14:31:44.291347Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 94 size 5033 offset: -1
2025-10-10T14:31:44.300150Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Returning serverBytesSize = 23701 to budget
2025-10-10T14:31:44.291354Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.300154Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] In ContinueReadingDataImpl, ReadSizeBudget = 23701, ReadSizeServerDelta = 500587
2025-10-10T14:31:44.291356Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.291358Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 95 size 5143 offset: -1
2025-10-10T14:31:44.291361Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.300163Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 85 to 85
2025-10-10T14:31:44.291363Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.300168Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.291368Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 96 size 5253 offset: -1
2025-10-10T14:31:44.300171Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 85
2025-10-10T14:31:44.291372Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.291374Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.300190Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 86 to 86
2025-10-10T14:31:44.291377Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 97 size 5363 offset: -1
2025-10-10T14:31:44.300200Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.291381Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.300203Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 86
2025-10-10T14:31:44.291382Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.291386Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.300209Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-10T14:31:44.291399Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.291401Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.300216Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 87 to 87
2025-10-10T14:31:44.291403Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.300220Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (70-70)
2025-10-10T14:31:44.291404Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.300225Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.291406Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.300227Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 87
2025-10-10T14:31:44.300228Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 1} (71-71)
2025-10-10T14:31:44.291408Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.291409Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.300235Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 2} (72-72)
2025-10-10T14:31:44.300238Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 88 to 88
2025-10-10T14:31:44.291412Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 98  requestId: <none> cookie: 50
2025-10-10T14:31:44.291423Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.300252Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.300626Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 88
>>> event from dataHandler: 2025-10-10T14:31:44.291438Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.291439Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.291443Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 99 size 5473 offset: -1
2025-10-10T14:31:44.291446Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 Message { Data: ..7711 bytes.. Information: { Offset: 70 ProducerId: "src_id" SeqNo: 71 CreateTime: 2025-10-10T14:31:44.296000Z WriteTime: 2025-10-10T14:31:44.297000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:46198", "_ip": "ipv6:[::1]:46198" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..7821 bytes.. Information: { Offset: 71 ProducerId: "src_id" SeqNo: 72 CreateTime: 2025-10-10T14:31:44.297000Z WriteTime: 2025-10-10T14:31:44.297000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:46198", "_ip": "ipv6:[::1]:46198" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..7931 bytes.. Information: { Offset: 72 ProducerId: "src_id" SeqNo: 73 CreateTime: 2025-10-10T14:31:44.297000Z WriteTime: 2025-10-10T14:31:44.297000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:46198", "_ip": "ipv6:[::1]:46198" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } }
2025-10-10T14:31:44.291449Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.291575Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 grpc read done: success# 1, data# { read_request { bytes_size: 21859 } }
2025-10-10T14:31:44.291592Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 got read request: guid# 8b4b6769-5259cc09-1b0e46e1-e0dd22f
2025-10-10T14:31:44.291634Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.300667Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] The application data is transferred to the client. Number of messages 3, size 23463 bytes
2025-10-10T14:31:44.291650Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 36 count 5 size 21459 actorID [3:7559600726884252064:2448]
2025-10-10T14:31:44.300674Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Returning serverBytesSize = 0 to budget
2025-10-10T14:31:44.291662Z node 3 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:31:44.291667Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.291676Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 21350 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:31:44.300701Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 89 to 89
2025-10-10T14:31:44.291683Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.300707Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.291684Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 5 parts 0 suffix '63' size 21459
2025-10-10T14:31:44.300709Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 89
2025-10-10T14:31:44.291689Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 37, partNo: 0, Offset: 36 is stored on disk
2025-10-10T14:31:44.291692Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.291692Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.291694Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 38, partNo: 0, Offset: 37 is stored on disk
2025-10-10T14:31:44.291696Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.291699Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 39, partNo: 0, Offset: 38 is stored on disk
2025-10-10T14:31:44.291700Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.291703Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 40, partNo: 0, Offset: 39 is stored on disk
2025-10-10T14:31:44.291706Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.291708Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 41, partNo: 0, Offset: 40 is stored on disk
2025-10-10T14:31:44.291727Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.300746Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 90 to 90
2025-10-10T14:31:44.291734Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:44.300750Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.291743Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:44.291744Z node 3 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (9)
2025-10-10T14:31:44.301064Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 90
2025-10-10T14:31:44.291744Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 36 EndOffset 36 newEndOffset 41 commitOffset 0 clientCommitOffset 0 cookie 8 readingFinished 0 firstRead 0
2025-10-10T14:31:44.291747Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 36 endOffset 41
2025-10-10T14:31:44.291755Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 36, endOffset# 41, WTime# 1760106704289, sizeLag# 21459
2025-10-10T14:31:44.291757Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1TEvPartitionReady. Aval parts: 1
2025-10-10T14:31:44.291759Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 42 partNo 0
2025-10-10T14:31:44.291766Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 performing read request: guid# 7a04722e-e8a64359-8af461d1-229c12fb, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 6, size# 25750, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-10T14:31:44.291772Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.291796Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 42 partNo 0 FormedBlobsCount 0 NewHead: Offset 41 PartNo 0 PackedSize 4667 count 1 nextOffset 42 batches 1
2025-10-10T14:31:44.291804Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 43 partNo 0
2025-10-10T14:31:44.291809Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 43 partNo 0 FormedBlobsCount 0 NewHead: Offset 41 PartNo 0 PackedSize 9412 count 2 nextOffset 43 batches 1
2025-10-10T14:31:44.291813Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 44 partNo 0
2025-10-10T14:31:44.291816Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 44 partNo 0 FormedBlobsCount 0 NewHead: Offset 41 PartNo 0 PackedSize 14267 count 3 nextOffset 44 batches 1
2025-10-10T14:31:44.291818Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.291818Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 45 partNo 0
2025-10-10T14:31:44.291821Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 45 partNo 0 FormedBlobsCount 0 NewHead: Offset 41 PartNo 0 PackedSize 19232 count 4 nextOffset 45 batches 1
2025-10-10T14:31:44.291823Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 0
2025-10-10T14:31:44.291826Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 46 partNo 0 FormedBlobsCount 0 NewHead: Offset 41 PartNo 0 PackedSize 24307 count 5 nextOffset 46 batches 1
2025-10-10T14:31:44.291828Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 0
2025-10-10T14:31:44.301132Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 91 to 91
2025-10-10T14:31:44.291832Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 47 partNo 0 FormedBlobsCount 0 NewHead: Offset 41 PartNo 0 PackedSize 29492 count 6 nextOffset 47 batches 1
2025-10-10T14:31:44.301138Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.301141Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 91
2025-10-10T14:31:44.291834Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 0
2025-10-10T14:31:44.291834Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 6 maxSize 25750 maxTimeLagMs 0 readTimestampMs 0 readOffset 36 EndOffset 41 ClientCommitOffset 0 committedOffset 0 Guid 7a04722e-e8a64359-8af461d1-229c12fb
2025-10-10T14:31:44.291847Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 48 partNo 0 FormedBlobsCount 0 NewHead: Offset 41 PartNo 0 PackedSize 34787 count 7 nextOffset 48 batches 1
2025-10-10T14:31:44.291850Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 49 partNo 0
2025-10-10T14:31:44.291853Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 49 partNo 0 FormedBlobsCount 0 NewHead: Offset 41 PartNo 0 PackedSize 40192 count 8 nextOffset 49 batches 1
2025-10-10T14:31:44.291855Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 50 partNo 0
2025-10-10T14:31:44.291859Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 50 partNo 0 FormedBlobsCount 0 NewHead: Offset 41 PartNo 0 PackedSize 45707 count 9 nextOffset 50 batches 1
2025-10-10T14:31:44.301178Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 92 to 92
2025-10-10T14:31:44.291861Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:44.291919Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 41,9 HeadOffset 41 endOffset 41 curOffset 50 d0000000000_00000000000000000041_00000_0000000009_00000? size 45481 WTime 1760106704291
2025-10-10T14:31:44.291939Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:182: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:31:44.301406Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.301415Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 92
2025-10-10T14:31:44.291945Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.291947Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.291955Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 75  requestId: <none> cookie: 37
2025-10-10T14:31:44.291958Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.291960Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.291961Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 76  requestId: <none> cookie: 38
2025-10-10T14:31:44.291965Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 77  requestId: <none> cookie: 39
2025-10-10T14:31:44.291969Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 79  requestId: <none> cookie: 40
2025-10-10T14:31:44.291973Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 81  requestId: <none> cookie: 41
2025-10-10T14:31:44.291975Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.291976Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.291981Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.291982Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.291991Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.291992Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.292003Z node 3 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:31:44.292010Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.292012Z node 3 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 41 partNo 0 count 9 size 45481
2025-10-10T14:31:44.292016Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.292020Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.301476Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 93 to 93
2025-10-10T14:31:44.292024Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.292046Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 100  requestId: <none> cookie: 51
2025-10-10T14:31:44.301491Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.292048Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 101  requestId: <none> cookie: 52
2025-10-10T14:31:44.292050Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 102  requestId: <none> cookie: 53
2025-10-10T14:31:44.301493Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 93
2025-10-10T14:31:44.292075Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.292077Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 11 Topic 'rt3.dc1--test-topic' partition 0 user user offset 36 count 6 size 25750 endOffset 41 max time lag 0ms effective offset 36
2025-10-10T14:31:44.292087Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 11 added 1 blobs, size 21459 count 5 last offset 36, current partition end offset: 41
2025-10-10T14:31:44.292089Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 11. Send blob request.
2025-10-10T14:31:44.292097Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 36 partno 0 count 5 parts_count 0 source 1 size 21459 accessed 0 times before, last time 2025-10-10T14:31:44.000000Z
2025-10-10T14:31:44.292105Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.292107Z node 3 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 11. All 1 blobs are from cache.
2025-10-10T14:31:44.292113Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:31:44.292115Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.292117Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.301544Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 94 to 94
2025-10-10T14:31:44.292119Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 5 parts 0 suffix '63'
2025-10-10T14:31:44.301549Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.301749Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 94
2025-10-10T14:31:44.292143Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 36 totakecount 5 count 5 size 21437 from pos 0 cbcount 5
2025-10-10T14:31:44.292164Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 36
2025-10-10T14:31:44.292216Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.292219Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.292225Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.292227Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.292229Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 41 Result { Offset: 36 Data: "... 4043 bytes ..." SourceId: "\000src_id" SeqNo: 37 WriteTimestampMS: 1760106704290 CreateTimestampMS: 1760106704288 UncompressedSize: 3971 PartitionKey: "" ExplicitHash: "" } Result { Offset: 37 Data: "... 4153 bytes ..." SourceId: "\000src_id" SeqNo: 38 WriteTimestampMS: 1760106704290 CreateTimestampMS: 1760106704288 UncompressedSize: 4081 PartitionKey: "" ExplicitHash: "" } Result { Offset: 38 Data: "... 4263 bytes ..." SourceId: "\000src_id" SeqNo: 39 WriteTimestampMS: 1760106704290 CreateTimestampMS: 1760106704289 UncompressedSize: 4191 PartitionKey: "" ExplicitHash: "" } Result { Offset: 39 Data: "... 4373 bytes ..." SourceId: "\000src_id" SeqNo: 40 WriteTimestampMS: 1760106704290 CreateTimestampMS: 1760106704289 UncompressedSize: 4301 PartitionKey: "" ExplicitHash: "" } Result { Offset: 40 Data: "... 4483 bytes ..." SourceId: "\000src_id" SeqNo: 41 WriteTimestampMS: 1760106704290 CreateTimestampMS: 1760106704289 UncompressedSize: 4411 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 18446744073709551550 RealReadOffset: 40 WaitQuotaTimeMs: 0 EndOffset: 41 StartOffset: 0 } Cookie: 36 }
2025-10-10T14:31:44.292236Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 104 size 5583 offset: -1
2025-10-10T14:31:44.292238Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.292240Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.292242Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 105 size 5693 offset: -1
2025-10-10T14:31:44.292246Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.292248Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.292251Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 53 partNo : 0 messageNo: 106 size 5803 offset: -1
2025-10-10T14:31:44.301813Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 95 to 95
2025-10-10T14:31:44.292257Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 9 from offset 41
2025-10-10T14:31:44.301824Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.301827Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 95
2025-10-10T14:31:44.292258Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.292263Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 41 ReadOffset 41 ReadGuid 7a04722e-e8a64359-8af461d1-229c12fb has messages 1
2025-10-10T14:31:44.292264Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.292265Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.292267Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.292268Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.292269Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.292273Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 103  requestId: <none> cookie: 54
2025-10-10T14:31:44.292280Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.292284Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 read done: guid# 7a04722e-e8a64359-8af461d1-229c12fb, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 21263
2025-10-10T14:31:44.292289Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 response to read: guid# 7a04722e-e8a64359-8af461d1-229c12fb
2025-10-10T14:31:44.292291Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.292292Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.292295Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 54 partNo : 0 messageNo: 107 size 5913 offset: -1
2025-10-10T14:31:44.292301Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.292302Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.301879Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 96 to 96
2025-10-10T14:31:44.292380Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 Process answer. Aval parts: 0
2025-10-10T14:31:44.301895Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.292503Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.302184Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 96
2025-10-10T14:31:44.292573Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.292585Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.292588Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.292598Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 108  requestId: <none> cookie: 55
2025-10-10T14:31:44.292607Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.292629Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.292630Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.292636Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 55 partNo : 0 messageNo: 109 size 6023 offset: -1
2025-10-10T14:31:44.292639Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.292644Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.292668Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.292726Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.302226Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Got ReadResponse, serverBytesSize = 41613, now ReadSizeBudget = 0, ReadSizeServerDelta = 482675
2025-10-10T14:31:44.292738Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 41 count 9 size 45481 actorID [3:7559600726884252064:2448]
2025-10-10T14:31:44.292752Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.302231Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 97 to 97
2025-10-10T14:31:44.302252Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] In ContinueReadingDataImpl, ReadSizeBudget = 0, ReadSizeServerDelta = 482675
2025-10-10T14:31:44.292754Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 9 parts 0 suffix '63' size 45481
2025-10-10T14:31:44.292755Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.292761Z node 3 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:31:44.302272Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.302290Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 97
2025-10-10T14:31:44.292771Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 45360 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:31:44.292777Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.292784Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.292784Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 42, partNo: 0, Offset: 41 is stored on disk
2025-10-10T14:31:44.292787Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.302303Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (73-77)
2025-10-10T14:31:44.292790Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 43, partNo: 0, Offset: 42 is stored on disk
2025-10-10T14:31:44.292792Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.302315Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Returning serverBytesSize = 41613 to budget
2025-10-10T14:31:44.302325Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] In ContinueReadingDataImpl, ReadSizeBudget = 41613, ReadSizeServerDelta = 482675
2025-10-10T14:31:44.292796Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 44, partNo: 0, Offset: 43 is stored on disk
2025-10-10T14:31:44.292798Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.292802Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 45, partNo: 0, Offset: 44 is stored on disk
2025-10-10T14:31:44.292804Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.292807Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 46, partNo: 0, Offset: 45 is stored on disk
2025-10-10T14:31:44.292810Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.292813Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 47, partNo: 0, Offset: 46 is stored on disk
2025-10-10T14:31:44.302363Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-10T14:31:44.292815Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.292815Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.302374Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (73-73)
2025-10-10T14:31:44.302380Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 98 to 98
2025-10-10T14:31:44.292819Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 48, partNo: 0, Offset: 47 is stored on disk
2025-10-10T14:31:44.302553Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 1} (74-74)
2025-10-10T14:31:44.302554Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.292822Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.302556Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 98
2025-10-10T14:31:44.292825Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 49, partNo: 0, Offset: 48 is stored on disk
2025-10-10T14:31:44.302570Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 2} (75-75)
2025-10-10T14:31:44.292827Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.302579Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 3} (76-76)
2025-10-10T14:31:44.292831Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 50, partNo: 0, Offset: 49 is stored on disk
2025-10-10T14:31:44.292833Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 grpc read done: success# 1, data# { read_request { bytes_size: 21263 } }
2025-10-10T14:31:44.302593Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 4} (77-77)
2025-10-10T14:31:44.292842Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 got read request: guid# 5f1d0fb7-f73a713-742e62ea-c21f0880
2025-10-10T14:31:44.292849Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:44.292855Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:44.292856Z node 3 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (5)
2025-10-10T14:31:44.292857Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 41 EndOffset 41 newEndOffset 50 commitOffset 0 clientCommitOffset 0 cookie 9 readingFinished 0 firstRead 0
2025-10-10T14:31:44.292863Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 41 endOffset 50
2025-10-10T14:31:44.302618Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 99 to 99
2025-10-10T14:31:44.292865Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 51 partNo 0
2025-10-10T14:31:44.302624Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.302626Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 99
2025-10-10T14:31:44.292872Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 41, endOffset# 50, WTime# 1760106704290, sizeLag# 45481
2025-10-10T14:31:44.292874Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1TEvPartitionReady. Aval parts: 1
2025-10-10T14:31:44.292882Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 51 partNo 0 FormedBlobsCount 0 NewHead: Offset 50 PartNo 0 PackedSize 5657 count 1 nextOffset 51 batches 1
2025-10-10T14:31:44.292884Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 performing read request: guid# 9e2720f8-2b8645cd-c50cb400-88827cef, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 10, size# 54577, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-10T14:31:44.292886Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 52 partNo 0
2025-10-10T14:31:44.292889Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 52 partNo 0 FormedBlobsCount 0 NewHead: Offset 50 PartNo 0 PackedSize 11392 count 2 nextOffset 52 batches 1
2025-10-10T14:31:44.292891Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 53 partNo 0
2025-10-10T14:31:44.292895Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 53 partNo 0 FormedBlobsCount 0 NewHead: Offset 50 PartNo 0 PackedSize 17237 count 3 nextOffset 53 batches 1
2025-10-10T14:31:44.292895Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 10 maxSize 54577 maxTimeLagMs 0 readTimestampMs 0 readOffset 41 EndOffset 50 ClientCommitOffset 0 committedOffset 0 Guid 9e2720f8-2b8645cd-c50cb400-88827cef
2025-10-10T14:31:44.292896Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 54 partNo 0
2025-10-10T14:31:44.292899Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 54 partNo 0 FormedBlobsCount 0 NewHead: Offset 50 PartNo 0 PackedSize 23192 count 4 nextOffset 54 batches 1
2025-10-10T14:31:44.302662Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 100 to 100
2025-10-10T14:31:44.302973Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.302976Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 100
2025-10-10T14:31:44.292901Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 55 partNo 0
2025-10-10T14:31:44.292904Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 55 partNo 0 FormedBlobsCount 0 NewHead: Offset 50 PartNo 0 PackedSize 29257 count 5 nextOffset 55 batches 1
2025-10-10T14:31:44.292906Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:44.292964Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 50,5 HeadOffset 50 endOffset 50 curOffset 55 d0000000000_00000000000000000050_00000_0000000005_00000? size 29159 WTime 1760106704292
2025-10-10T14:31:44.292989Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:182: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:31:44.292998Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 84  requestId: <none> cookie: 42
2025-10-10T14:31:44.293010Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 85  requestId: <none> cookie: 43
>>> event from dataHandler: 2025-10-10T14:31:44.293012Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 88  requestId: <none> cookie: 44
2025-10-10T14:31:44.293014Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 89  requestId: <none> cookie: 45
2025-10-10T14:31:44.293015Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.303016Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 101 to 101
2025-10-10T14:31:44.293017Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 94  requestId: <none> cookie: 46
2025-10-10T14:31:44.293020Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 95  requestId: <none> cookie: 47
2025-10-10T14:31:44.303019Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.303022Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 101
2025-10-10T14:31:44.293021Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.293023Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 96  requestId: <none> cookie: 48
2025-10-10T14:31:44.293024Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.293026Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 97  requestId: <none> cookie: 49
2025-10-10T14:31:44.293029Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.293029Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 99  requestId: <none> cookie: 50
2025-10-10T14:31:44.293031Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 Message { Data: ..8041 bytes.. Information: { Offset: 73 ProducerId: "src_id" SeqNo: 74 CreateTime: 2025-10-10T14:31:44.297000Z WriteTime: 2025-10-10T14:31:44.298000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:46198", "logtype": "unknown", "server": "ipv6:[::1]:46198" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..8151 bytes.. Information: { Offset: 74 ProducerId: "src_id" SeqNo: 75 CreateTime: 2025-10-10T14:31:44.297000Z WriteTime: 2025-10-10T14:31:44.298000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:46198", "logtype": "unknown", "server": "ipv6:[::1]:46198" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..8261 bytes.. Information: { Offset: 75 ProducerId: "src_id" SeqNo: 76 CreateTime: 2025-10-10T14:31:44.297000Z WriteTime: 2025-10-10T14:31:44.298000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:46198", "logtype": "unknown", "server": "ipv6:[::1]:46198" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..8371 bytes.. Information: { Offset: 76 ProducerId: "src_id" SeqNo: 77 CreateTime: 2025-10-10T14:31:44.297000Z WriteTime: 2025-10-10T14:31:44.298000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:46198", "logtype": "unknown", "server": "ipv6:[::1]:46198" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..8481 bytes.. Information: { Offset: 77 ProducerId: "src_id" SeqNo: 78 CreateTime: 2025-10-10T14:31:44.297000Z WriteTime: 2025-10-10T14:31:44.298000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:46198", "logtype": "unknown", "server": "ipv6:[::1]:46198" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } }2025-10-10T14:31:44.293033Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.293034Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.293038Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.293039Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.293040Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.303055Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 102 to 102
2025-10-10T14:31:44.293042Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.303059Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.293044Z node 3 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:31:44.293045Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.293049Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.293051Z node 3 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 50 partNo 0 count 5 size 29159
2025-10-10T14:31:44.293056Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 110  requestId: <none> cookie: 56
2025-10-10T14:31:44.303060Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 102
2025-10-10T14:31:44.303074Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] The application data is transferred to the client. Number of messages 5, size 41305 bytes
2025-10-10T14:31:44.293076Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 111  requestId: <none> cookie: 57
2025-10-10T14:31:44.303465Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Returning serverBytesSize = 0 to budget
2025-10-10T14:31:44.293098Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 12 Topic 'rt3.dc1--test-topic' partition 0 user user offset 41 count 10 size 54577 endOffset 50 max time lag 0ms effective offset 41
2025-10-10T14:31:44.293111Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 12 added 1 blobs, size 45481 count 9 last offset 41, current partition end offset: 50
2025-10-10T14:31:44.293113Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 12. Send blob request.
2025-10-10T14:31:44.293118Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.293119Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 41 partno 0 count 9 parts_count 0 source 1 size 45481 accessed 0 times before, last time 2025-10-10T14:31:44.000000Z
2025-10-10T14:31:44.293127Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.293127Z node 3 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 12. All 1 blobs are from cache.
2025-10-10T14:31:44.293131Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.293132Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:31:44.293136Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 9 parts 0 suffix '63'
2025-10-10T14:31:44.293173Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 41 totakecount 9 count 9 size 45459 from pos 0 cbcount 9
2025-10-10T14:31:44.293180Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.293191Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.293193Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.293202Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 56 partNo : 0 messageNo: 112 size 6133 offset: -1
2025-10-10T14:31:44.293206Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.293208Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.293212Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 57 partNo : 0 messageNo: 113 size 6243 offset: -1
2025-10-10T14:31:44.293215Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.293217Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.293225Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 41
2025-10-10T14:31:44.293232Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.293238Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.293240Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.303545Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 103 to 103
2025-10-10T14:31:44.293241Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.293260Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 114  requestId: <none> cookie: 58
2025-10-10T14:31:44.293269Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.303556Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.293293Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.293296Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.293303Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 58 partNo : 0 messageNo: 115 size 6353 offset: -1
2025-10-10T14:31:44.293306Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.293309Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.303560Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 103
2025-10-10T14:31:44.293350Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 50 Result { Offset: 41 Data: "... 4593 bytes ..." SourceId: "\000src_id" SeqNo: 42 WriteTimestampMS: 1760106704291 CreateTimestampMS: 1760106704289 UncompressedSize: 4521 PartitionKey: "" ExplicitHash: "" } Result { Offset: 42 Data: "... 4703 bytes ..." SourceId: "\000src_id" SeqNo: 43 WriteTimestampMS: 1760106704291 CreateTimestampMS: 1760106704290 UncompressedSize: 4631 PartitionKey: "" ExplicitHash: "" } Result { Offset: 43 Data: "... 4813 bytes ..." SourceId: "\000src_id" SeqNo: 44 WriteTimestampMS: 1760106704291 CreateTimestampMS: 1760106704290 UncompressedSize: 4741 PartitionKey: "" ExplicitHash: "" } Result { Offset: 44 Data: "... 4923 bytes ..." SourceId: "\000src_id" SeqNo: 45 WriteTimestampMS: 1760106704291 CreateTimestampMS: 1760106704290 UncompressedSize: 4851 PartitionKey: "" ExplicitHash: "" } Result { Offset: 45 Data: "... 5033 bytes ..." SourceId: "\000src_id" SeqNo: 46 WriteTimestampMS: 1760106704291 CreateTimestampMS: 1760106704290 UncompressedSize: 4961 PartitionKey: "" ExplicitHash: "" } Result { Offset: 46 Data: "... 5143 bytes ..." SourceId: "\000src_id" SeqNo: 47 WriteTimestampMS: 1760106704291 CreateTimestampMS: 1760106704290 UncompressedSize: 5071 PartitionKey: "" ExplicitHash: "" } Result { Offset: 47 Data: "... 5253 bytes ..." SourceId: "\000src_id" SeqNo: 48 WriteTimestampMS: 1760106704291 CreateTimestampMS: 1760106704290 UncompressedSize: 5181 PartitionKey: "" ExplicitHash: "" } Result { Offset: 48 Data: "... 5363 bytes ..." SourceId: "\000src_id" SeqNo: 49 WriteTimestampMS: 1760106704291 CreateTimestampMS: 1760106704290 UncompressedSize: 5291 PartitionKey: "" ExplicitHash: "" } Result { Offset: 49 Data: "... 5473 bytes ..." SourceId: "\000src_id" SeqNo: 50 WriteTimestampMS: 1760106704291 CreateTimestampMS: 1760106704290 UncompressedSize: 5401 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 18446744073709551422 RealReadOffset: 49 WaitQuotaTimeMs: 0 EndOffset: 50 StartOffset: 0 } Cookie: 41 }
2025-10-10T14:31:44.293396Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 10 from offset 50
2025-10-10T14:31:44.293401Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 50 ReadOffset 50 ReadGuid 9e2720f8-2b8645cd-c50cb400-88827cef has messages 1
2025-10-10T14:31:44.303668Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 104 to 104
2025-10-10T14:31:44.293420Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 read done: guid# 9e2720f8-2b8645cd-c50cb400-88827cef, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 45097
2025-10-10T14:31:44.293426Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 response to read: guid# 9e2720f8-2b8645cd-c50cb400-88827cef
2025-10-10T14:31:44.303783Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.303788Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 104
2025-10-10T14:31:44.303870Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 105 to 105
2025-10-10T14:31:44.303893Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.303896Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 105
2025-10-10T14:31:44.293518Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 Process answer. Aval parts: 0
2025-10-10T14:31:44.293704Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.293764Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.293789Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.293792Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.293801Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 116  requestId: <none> cookie: 59
2025-10-10T14:31:44.293811Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.293822Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.293823Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.293831Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 59 partNo : 0 messageNo: 117 size 6463 offset: -1
2025-10-10T14:31:44.293835Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.293840Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.293875Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 50 count 5 size 29159 actorID [3:7559600726884252064:2448]
2025-10-10T14:31:44.303974Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 106 to 106
2025-10-10T14:31:44.293887Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 grpc read done: success# 1, data# { read_request { bytes_size: 45097 } }
2025-10-10T14:31:44.303986Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.293897Z node 3 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:31:44.303989Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 106
2025-10-10T14:31:44.293897Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 50 partno 0 count 5 parts 0 suffix '63' size 29159
2025-10-10T14:31:44.293904Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 got read request: guid# 77d590a9-388eb893-f6c8816a-1738ad1c
2025-10-10T14:31:44.293906Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 29050 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:31:44.293910Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.293911Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.293916Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 51, partNo: 0, Offset: 50 is stored on disk
2025-10-10T14:31:44.293919Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.293923Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 52, partNo: 0, Offset: 51 is stored on disk
2025-10-10T14:31:44.293925Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.293930Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 53, partNo: 0, Offset: 52 is stored on disk
2025-10-10T14:31:44.304012Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 107 to 107
2025-10-10T14:31:44.293932Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.293936Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 54, partNo: 0, Offset: 53 is stored on disk
2025-10-10T14:31:44.293948Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.304017Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.293951Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 55, partNo: 0, Offset: 54 is stored on disk
2025-10-10T14:31:44.304189Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 107
2025-10-10T14:31:44.293954Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.293961Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.304048Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Got ReadResponse, serverBytesSize = 26341, now ReadSizeBudget = 0, ReadSizeServerDelta = 497947
2025-10-10T14:31:44.293972Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:44.293978Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:44.293980Z node 3 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (4)
2025-10-10T14:31:44.293992Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.304218Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] In ContinueReadingDataImpl, ReadSizeBudget = 0, ReadSizeServerDelta = 497947
2025-10-10T14:31:44.293992Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 56 partNo 0
2025-10-10T14:31:44.293997Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.294015Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 56 partNo 0 FormedBlobsCount 0 NewHead: Offset 55 PartNo 0 PackedSize 6207 count 1 nextOffset 56 batches 1
2025-10-10T14:31:44.294021Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 57 partNo 0
2025-10-10T14:31:44.294025Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.294026Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 57 partNo 0 FormedBlobsCount 0 NewHead: Offset 55 PartNo 0 PackedSize 12492 count 2 nextOffset 57 batches 1
2025-10-10T14:31:44.294029Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 58 partNo 0
2025-10-10T14:31:44.304252Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (78-80)
2025-10-10T14:31:44.294030Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.304267Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Returning serverBytesSize = 26341 to budget
2025-10-10T14:31:44.294033Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 58 partNo 0 FormedBlobsCount 0 NewHead: Offset 55 PartNo 0 PackedSize 18887 count 3 nextOffset 58 batches 1
2025-10-10T14:31:44.304273Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 108 to 108
2025-10-10T14:31:44.294036Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 59 partNo 0
2025-10-10T14:31:44.304273Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] In ContinueReadingDataImpl, ReadSizeBudget = 26341, ReadSizeServerDelta = 497947
2025-10-10T14:31:44.294041Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 59 partNo 0 FormedBlobsCount 0 NewHead: Offset 55 PartNo 0 PackedSize 25392 count 4 nextOffset 59 batches 1
2025-10-10T14:31:44.304281Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.294043Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:44.304285Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 108
2025-10-10T14:31:44.294079Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.294094Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 55,4 HeadOffset 55 endOffset 55 curOffset 59 d0000000000_00000000000000000055_00000_0000000004_00000? size 25326 WTime 1760106704293
2025-10-10T14:31:44.294096Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 50 EndOffset 50 newEndOffset 55 commitOffset 0 clientCommitOffset 0 cookie 10 readingFinished 0 firstRead 0
2025-10-10T14:31:44.294099Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 50 endOffset 55
2025-10-10T14:31:44.294105Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 50, endOffset# 55, WTime# 1760106704291, sizeLag# 29159
2025-10-10T14:31:44.304301Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-10T14:31:44.294107Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1TEvPartitionReady. Aval parts: 1
2025-10-10T14:31:44.294114Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 performing read request: guid# 7c5c8798-82884aec-f70eb920-d2c6d247, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 6, size# 34990, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-10T14:31:44.294123Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 6 maxSize 34990 maxTimeLagMs 0 readTimestampMs 0 readOffset 50 EndOffset 55 ClientCommitOffset 0 committedOffset 0 Guid 7c5c8798-82884aec-f70eb920-d2c6d247
2025-10-10T14:31:44.294131Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:182: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:31:44.294140Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 104  requestId: <none> cookie: 51
2025-10-10T14:31:44.294145Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.294147Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 105  requestId: <none> cookie: 52
2025-10-10T14:31:44.294152Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 106  requestId: <none> cookie: 53
2025-10-10T14:31:44.304323Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 109 to 109
2025-10-10T14:31:44.304317Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (78-78)
2025-10-10T14:31:44.304593Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.304597Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 109
2025-10-10T14:31:44.294152Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.294156Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 107  requestId: <none> cookie: 54
2025-10-10T14:31:44.294161Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 109  requestId: <none> cookie: 55
2025-10-10T14:31:44.294165Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.304612Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 1} (79-79)
2025-10-10T14:31:44.294167Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.294173Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.294175Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.294178Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.294179Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.294183Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.304627Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 2} (80-80)
2025-10-10T14:31:44.294184Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.294188Z node 3 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:31:44.294197Z node 3 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 55 partNo 0 count 4 size 25326
2025-10-10T14:31:44.294206Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.294206Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.294209Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.294211Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.294214Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.294239Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 118  requestId: <none> cookie: 60
2025-10-10T14:31:44.294243Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 119  requestId: <none> cookie: 61
2025-10-10T14:31:44.294246Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 120  requestId: <none> cookie: 62
2025-10-10T14:31:44.294249Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 121  requestId: <none> cookie: 63
2025-10-10T14:31:44.294271Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 13 Topic 'rt3.dc1--test-topic' partition 0 user user offset 50 count 6 size 34990 endOffset 55 max time lag 0ms effective offset 50
2025-10-10T14:31:44.294283Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.294284Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 13 added 1 blobs, size 29159 count 5 last offset 50, current partition end offset: 55
2025-10-10T14:31:44.304661Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 110 to 110
>>> event from dataHandler: 2025-10-10T14:31:44.304670Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.304673Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 110
2025-10-10T14:31:44.294287Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.294287Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 13. Send blob request.
2025-10-10T14:31:44.294290Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 Message { Data: ..8591 bytes.. Information: { Offset: 78 ProducerId: "src_id" SeqNo: 79 CreateTime: 2025-10-10T14:31:44.298000Z WriteTime: 2025-10-10T14:31:44.300000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:46198", "_ip": "ipv6:[::1]:46198" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..8701 bytes.. Information: { Offset: 79 ProducerId: "src_id" SeqNo: 80 CreateTime: 2025-10-10T14:31:44.299000Z WriteTime: 2025-10-10T14:31:44.300000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:46198", "_ip": "ipv6:[::1]:46198" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..8811 bytes.. Information: { Offset: 80 ProducerId: "src_id" SeqNo: 81 CreateTime: 2025-10-10T14:31:44.299000Z WriteTime: 2025-10-10T14:31:44.300000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:46198", "_ip": "ipv6:[::1]:46198" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } }
2025-10-10T14:31:44.294294Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.305005Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] The application data is transferred to the client. Number of messages 3, size 26103 bytes
2025-10-10T14:31:44.305012Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Returning serverBytesSize = 0 to budget
2025-10-10T14:31:44.294294Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 50 partno 0 count 5 parts_count 0 source 1 size 29159 accessed 0 times before, last time 2025-10-10T14:31:44.000000Z
2025-10-10T14:31:44.294297Z node 3 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 13. All 1 blobs are from cache.
2025-10-10T14:31:44.294303Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:31:44.304714Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 111 to 111
2025-10-10T14:31:44.294309Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 50 partno 0 count 5 parts 0 suffix '63'
2025-10-10T14:31:44.305035Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.294341Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 50 totakecount 5 count 5 size 29137 from pos 0 cbcount 5
2025-10-10T14:31:44.305038Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 111
2025-10-10T14:31:44.294371Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 50
2025-10-10T14:31:44.294389Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.294391Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.294399Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 60 partNo : 0 messageNo: 122 size 6573 offset: -1
2025-10-10T14:31:44.294403Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.294405Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.294409Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 61 partNo : 0 messageNo: 123 size 6683 offset: -1
2025-10-10T14:31:44.294412Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.294414Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.294418Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 62 partNo : 0 messageNo: 124 size 6793 offset: -1
2025-10-10T14:31:44.294423Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.294425Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.294429Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 63 partNo : 0 messageNo: 125 size 6903 offset: -1
2025-10-10T14:31:44.294433Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.294436Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 55 Result { Offset: 50 Data: "... 5583 bytes ..." SourceId: "\000src_id" SeqNo: 51 WriteTimestampMS: 1760106704292 CreateTimestampMS: 1760106704291 UncompressedSize: 5511 PartitionKey: "" ExplicitHash: "" } Result { Offset: 51 Data: "... 5693 bytes ..." SourceId: "\000src_id" SeqNo: 52 WriteTimestampMS: 1760106704292 CreateTimestampMS: 1760106704291 UncompressedSize: 5621 PartitionKey: "" ExplicitHash: "" } Result { Offset: 52 Data: "... 5803 bytes ..." SourceId: "\000src_id" SeqNo: 53 WriteTimestampMS: 1760106704292 CreateTimestampMS: 1760106704291 UncompressedSize: 5731 PartitionKey: "" ExplicitHash: "" } Result { Offset: 53 Data: "... 5913 bytes ..." SourceId: "\000src_id" SeqNo: 54 WriteTimestampMS: 1760106704292 CreateTimestampMS: 1760106704291 UncompressedSize: 5841 PartitionKey: "" ExplicitHash: "" } Result { Offset: 54 Data: "... 6023 bytes ..." SourceId: "\000src_id" SeqNo: 55 WriteTimestampMS: 1760106704292 CreateTimestampMS: 1760106704291 UncompressedSize: 5951 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 18446744073709551550 RealReadOffset: 54 WaitQuotaTimeMs: 0 EndOffset: 55 StartOffset: 0 } Cookie: 50 }
2025-10-10T14:31:44.294439Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.294441Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.294443Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.294444Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.294447Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.294448Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.294450Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.294462Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 11 from offset 55
2025-10-10T14:31:44.294466Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 55 ReadOffset 55 ReadGuid 7c5c8798-82884aec-f70eb920-d2c6d247 has messages 1
2025-10-10T14:31:44.294476Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 read done: guid# 7c5c8798-82884aec-f70eb920-d2c6d247, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 28963
2025-10-10T14:31:44.294481Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 response to read: guid# 7c5c8798-82884aec-f70eb920-d2c6d247
2025-10-10T14:31:44.305104Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 112 to 112
2025-10-10T14:31:44.294553Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 Process answer. Aval parts: 0
2025-10-10T14:31:44.294724Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.294783Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.294793Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.305444Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.305450Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 112
2025-10-10T14:31:44.294795Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.294804Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 126  requestId: <none> cookie: 64
2025-10-10T14:31:44.294808Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.294814Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.294852Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.294858Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.294860Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.294866Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 64 partNo : 0 messageNo: 127 size 7013 offset: -1
2025-10-10T14:31:44.294870Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.294872Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.294876Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.294881Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.294886Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 128  requestId: <none> cookie: 65
2025-10-10T14:31:44.294895Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.294909Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.294911Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.294914Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 65 partNo : 0 messageNo: 129 size 7123 offset: -1
2025-10-10T14:31:44.294937Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.294940Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.294946Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 55 count 4 size 25326 actorID [3:7559600726884252064:2448]
2025-10-10T14:31:44.294969Z node 3 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:31:44.294969Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 55 partno 0 count 4 parts 0 suffix '63' size 25326
2025-10-10T14:31:44.294975Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 25220 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:31:44.294978Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.294981Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 56, partNo: 0, Offset: 55 is stored on disk
2025-10-10T14:31:44.305537Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 113 to 113
2025-10-10T14:31:44.305548Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.305554Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 113
2025-10-10T14:31:44.294983Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.294984Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 57, partNo: 0, Offset: 56 is stored on disk
2025-10-10T14:31:44.294985Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.294988Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 58, partNo: 0, Offset: 57 is stored on disk
2025-10-10T14:31:44.305609Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 114 to 114
2025-10-10T14:31:44.294989Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.294992Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 59, partNo: 0, Offset: 58 is stored on disk
2025-10-10T14:31:44.295009Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:44.295016Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:44.295018Z node 3 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (6)
2025-10-10T14:31:44.295029Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 60 partNo 0
2025-10-10T14:31:44.305751Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.305755Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 114
2025-10-10T14:31:44.295034Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 55 EndOffset 55 newEndOffset 59 commitOffset 0 clientCommitOffset 0 cookie 11 readingFinished 0 firstRead 0
2025-10-10T14:31:44.295038Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 55 endOffset 59
2025-10-10T14:31:44.295046Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 55, endOffset# 59, WTime# 1760106704292, sizeLag# 25326
2025-10-10T14:31:44.295046Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 60 partNo 0 FormedBlobsCount 0 NewHead: Offset 59 PartNo 0 PackedSize 6647 count 1 nextOffset 60 batches 1
2025-10-10T14:31:44.295048Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1TEvPartitionReady. Aval parts: 1
2025-10-10T14:31:44.295051Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 61 partNo 0
2025-10-10T14:31:44.295055Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 61 partNo 0 FormedBlobsCount 0 NewHead: Offset 59 PartNo 0 PackedSize 13372 count 2 nextOffset 61 batches 1
2025-10-10T14:31:44.295056Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 performing read request: guid# b630d891-e0521835-a56ee3a1-a9f53b14, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 4, size# 30391, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-10T14:31:44.295058Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 62 partNo 0
2025-10-10T14:31:44.295063Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 62 partNo 0 FormedBlobsCount 0 NewHead: Offset 59 PartNo 0 PackedSize 20207 count 3 nextOffset 62 batches 1
2025-10-10T14:31:44.295065Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 63 partNo 0
2025-10-10T14:31:44.295067Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 4 maxSize 30391 maxTimeLagMs 0 readTimestampMs 0 readOffset 55 EndOffset 59 ClientCommitOffset 0 committedOffset 0 Guid b630d891-e0521835-a56ee3a1-a9f53b14
2025-10-10T14:31:44.295069Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 63 partNo 0 FormedBlobsCount 0 NewHead: Offset 59 PartNo 0 PackedSize 27152 count 4 nextOffset 63 batches 1
2025-10-10T14:31:44.295072Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 64 partNo 0
2025-10-10T14:31:44.295075Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 64 partNo 0 FormedBlobsCount 0 NewHead: Offset 59 PartNo 0 PackedSize 34207 count 5 nextOffset 64 batches 1
2025-10-10T14:31:44.295078Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 65 partNo 0
2025-10-10T14:31:44.295082Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 65 partNo 0 FormedBlobsCount 0 NewHead: Offset 59 PartNo 0 PackedSize 41372 count 6 nextOffset 65 batches 1
2025-10-10T14:31:44.295084Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:44.295143Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 59,6 HeadOffset 59 endOffset 59 curOffset 65 d0000000000_00000000000000000059_00000_0000000006_00000? size 41242 WTime 1760106704294
2025-10-10T14:31:44.305810Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 115 to 115
2025-10-10T14:31:44.295184Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:182: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:31:44.305821Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.295192Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 112  requestId: <none> cookie: 56
2025-10-10T14:31:44.295204Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 113  requestId: <none> cookie: 57
2025-10-10T14:31:44.306179Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 115
2025-10-10T14:31:44.295209Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 115  requestId: <none> cookie: 58
2025-10-10T14:31:44.295213Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 117  requestId: <none> cookie: 59
2025-10-10T14:31:44.295215Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.295220Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.295221Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.295222Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.295224Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.295227Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.295230Z node 3 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:31:44.295238Z node 3 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 59 partNo 0 count 6 size 41242
2025-10-10T14:31:44.295284Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 14 Topic 'rt3.dc1--test-topic' partition 0 user user offset 55 count 4 size 30391 endOffset 59 max time lag 0ms effective offset 55
2025-10-10T14:31:44.295295Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 14 added 1 blobs, size 25326 count 4 last offset 55, current partition end offset: 59
2025-10-10T14:31:44.295298Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 14. Send blob request.
2025-10-10T14:31:44.295304Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 55 partno 0 count 4 parts_count 0 source 1 size 25326 accessed 0 times before, last time 2025-10-10T14:31:44.000000Z
2025-10-10T14:31:44.295311Z node 3 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 14. All 1 blobs are from cache.
2025-10-10T14:31:44.295317Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:31:44.295322Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 55 partno 0 count 4 parts 0 suffix '63'
2025-10-10T14:31:44.295339Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 55 totakecount 4 count 4 size 25304 from pos 0 cbcount 4
2025-10-10T14:31:44.295356Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 55
2025-10-10T14:31:44.295418Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 59 Result { Offset: 55 Data: "... 6133 bytes ..." SourceId: "\000src_id" SeqNo: 56 WriteTimestampMS: 1760106704293 CreateTimestampMS: 1760106704292 UncompressedSize: 6061 PartitionKey: "" ExplicitHash: "" } Result { Offset: 56 Data: "... 6243 bytes ..." SourceId: "\000src_id" SeqNo: 57 WriteTimestampMS: 1760106704293 CreateTimestampMS: 1760106704292 UncompressedSize: 6171 PartitionKey: "" ExplicitHash: "" } Result { Offset: 57 Data: "... 6353 bytes ..." SourceId: "\000src_id" SeqNo: 58 WriteTimestampMS: 1760106704293 CreateTimestampMS: 1760106704292 UncompressedSize: 6281 PartitionKey: "" ExplicitHash: "" } Result { Offset: 58 Data: "... 6463 bytes ..." SourceId: "\000src_id" SeqNo: 59 WriteTimestampMS: 1760106704293 CreateTimestampMS: 1760106704293 UncompressedSize: 6391 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 18446744073709551582 RealReadOffset: 58 WaitQuotaTimeMs: 0 EndOffset: 59 StartOffset: 0 } Cookie: 55 }
2025-10-10T14:31:44.306239Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 116 to 116
2025-10-10T14:31:44.295448Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 12 from offset 59
2025-10-10T14:31:44.295453Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 59 ReadOffset 59 ReadGuid b630d891-e0521835-a56ee3a1-a9f53b14 has messages 1
2025-10-10T14:31:44.295471Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 read done: guid# b630d891-e0521835-a56ee3a1-a9f53b14, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 25177
2025-10-10T14:31:44.295476Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 response to read: guid# b630d891-e0521835-a56ee3a1-a9f53b14
2025-10-10T14:31:44.306249Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.295540Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 Process answer. Aval parts: 0
2025-10-10T14:31:44.306253Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 116
2025-10-10T14:31:44.295631Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.295681Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.295704Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.295707Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.295707Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 grpc read done: success# 1, data# { read_request { bytes_size: 28963 } }
2025-10-10T14:31:44.295718Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 130  requestId: <none> cookie: 66
2025-10-10T14:31:44.295719Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 got read request: guid# debf6d8c-b0693a1-4bedc35c-3734464e
2025-10-10T14:31:44.306271Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 117 to 117
2025-10-10T14:31:44.295726Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.295736Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.295738Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.295744Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 66 partNo : 0 messageNo: 131 size 7233 offset: -1
2025-10-10T14:31:44.295750Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.306368Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Got ReadResponse, serverBytesSize = 156629, now ReadSizeBudget = 0, ReadSizeServerDelta = 367659
2025-10-10T14:31:44.295756Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.295993Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 59 count 6 size 41242 actorID [3:7559600726884252064:2448]
2025-10-10T14:31:44.296006Z node 3 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:31:44.296014Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 41130 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:31:44.296018Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 59 partno 0 count 6 parts 0 suffix '63' size 41242
2025-10-10T14:31:44.306534Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.296019Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.306539Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 117
2025-10-10T14:31:44.296021Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.306543Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] In ContinueReadingDataImpl, ReadSizeBudget = 0, ReadSizeServerDelta = 367659
2025-10-10T14:31:44.296025Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 60, partNo: 0, Offset: 59 is stored on disk
2025-10-10T14:31:44.296028Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.296031Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 61, partNo: 0, Offset: 60 is stored on disk
2025-10-10T14:31:44.296033Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.296037Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 62, partNo: 0, Offset: 61 is stored on disk
2025-10-10T14:31:44.296040Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.296043Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 63, partNo: 0, Offset: 62 is stored on disk
2025-10-10T14:31:44.296045Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.296057Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 64, partNo: 0, Offset: 63 is stored on disk
2025-10-10T14:31:44.296059Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.296065Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 65, partNo: 0, Offset: 64 is stored on disk
2025-10-10T14:31:44.296085Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:44.296089Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:44.306585Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 118 to 118
2025-10-10T14:31:44.296089Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.306594Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.296091Z node 3 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:44.306597Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 118
2025-10-10T14:31:44.296103Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 66 partNo 0
2025-10-10T14:31:44.296110Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 grpc read done: success# 1, data# { read_request { bytes_size: 25177 } }
2025-10-10T14:31:44.306600Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (81-96)
2025-10-10T14:31:44.296119Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 got read request: guid# 25585f72-40443a43-f9ad26c0-db982bef
2025-10-10T14:31:44.306611Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 119 to 119
2025-10-10T14:31:44.296123Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 66 partNo 0 FormedBlobsCount 0 NewHead: Offset 65 PartNo 0 PackedSize 7307 count 1 nextOffset 66 batches 1
2025-10-10T14:31:44.296127Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:44.306615Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Returning serverBytesSize = 156629 to budget
2025-10-10T14:31:44.306852Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] In ContinueReadingDataImpl, ReadSizeBudget = 156629, ReadSizeServerDelta = 367659
2025-10-10T14:31:44.306626Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.296128Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 59 EndOffset 59 newEndOffset 65 commitOffset 0 clientCommitOffset 0 cookie 12 readingFinished 0 firstRead 0
2025-10-10T14:31:44.296131Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 59 endOffset 65
2025-10-10T14:31:44.306866Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 119
2025-10-10T14:31:44.296135Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.296164Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.296170Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 65,1 HeadOffset 65 endOffset 65 curOffset 66 d0000000000_00000000000000000065_00000_0000000001_00000? size 7295 WTime 1760106704295
2025-10-10T14:31:44.296177Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 59, endOffset# 65, WTime# 1760106704293, sizeLag# 41242
2025-10-10T14:31:44.296178Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1TEvPartitionReady. Aval parts: 1
2025-10-10T14:31:44.296183Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:182: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:31:44.296185Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 performing read request: guid# 1d49502c-726f30b1-a9c31a0e-392273bd, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 7, size# 49490, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-10T14:31:44.296191Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 122  requestId: <none> cookie: 60
2025-10-10T14:31:44.296191Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.296197Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 123  requestId: <none> cookie: 61
2025-10-10T14:31:44.296201Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 124  requestId: <none> cookie: 62
2025-10-10T14:31:44.296206Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 125  requestId: <none> cookie: 63
2025-10-10T14:31:44.296210Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 127  requestId: <none> cookie: 64
2025-10-10T14:31:44.296213Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 129  requestId: <none> cookie: 65
2025-10-10T14:31:44.296218Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.306917Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-10T14:31:44.296221Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.296227Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.296227Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.296229Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.306930Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 120 to 120
2025-10-10T14:31:44.296232Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.296233Z node 3 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:31:44.296235Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.306931Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (81-81)
2025-10-10T14:31:44.296239Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.296241Z node 3 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 65 partNo 0 count 1 size 7295
2025-10-10T14:31:44.306941Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.296242Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.306950Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 1} (82-82)
2025-10-10T14:31:44.306952Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 120
2025-10-10T14:31:44.296246Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.296253Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.306960Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 2} (83-83)
2025-10-10T14:31:44.306968Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 121 to 121
2025-10-10T14:31:44.296265Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 132  requestId: <none> cookie: 67
2025-10-10T14:31:44.306970Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 3} (84-84)
2025-10-10T14:31:44.296269Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 133  requestId: <none> cookie: 68
2025-10-10T14:31:44.306976Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.296289Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 7 maxSize 49490 maxTimeLagMs 0 readTimestampMs 0 readOffset 59 EndOffset 65 ClientCommitOffset 0 committedOffset 0 Guid 1d49502c-726f30b1-a9c31a0e-392273bd
2025-10-10T14:31:44.296307Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.296310Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.306984Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 4} (85-85)
2025-10-10T14:31:44.307278Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 121
2025-10-10T14:31:44.296319Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.296321Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.296325Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.296327Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.296329Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.307296Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 5} (86-86)
2025-10-10T14:31:44.296331Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.296336Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 67 partNo : 0 messageNo: 135 size 7343 offset: -1
2025-10-10T14:31:44.296340Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.296341Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.296354Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 68 partNo : 0 messageNo: 136 size 7453 offset: -1
2025-10-10T14:31:44.307306Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 6} (87-87)
2025-10-10T14:31:44.296359Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.307329Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 7} (88-88)
2025-10-10T14:31:44.296363Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.296364Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.296365Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.296370Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 134  requestId: <none> cookie: 69
2025-10-10T14:31:44.296374Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.296375Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 15 Topic 'rt3.dc1--test-topic' partition 0 user user offset 59 count 7 size 49490 endOffset 65 max time lag 0ms effective offset 59
2025-10-10T14:31:44.296383Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 15 added 1 blobs, size 41242 count 6 last offset 59, current partition end offset: 65
2025-10-10T14:31:44.296384Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 15. Send blob request.
2025-10-10T14:31:44.307351Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 122 to 122
2025-10-10T14:31:44.296387Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.296388Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.307356Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 8} (89-89)
2025-10-10T14:31:44.296391Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 69 partNo : 0 messageNo: 137 size 7563 offset: -1
2025-10-10T14:31:44.296396Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 59 partno 0 count 6 parts_count 0 source 1 size 41242 accessed 0 times before, last time 2025-10-10T14:31:44.000000Z
2025-10-10T14:31:44.307361Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 9} (90-90)
2025-10-10T14:31:44.296398Z node 3 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 15. All 1 blobs are from cache.
2025-10-10T14:31:44.296401Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.307365Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 10} (91-91)
2025-10-10T14:31:44.296403Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.296405Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 59 partno 0 count 6 parts 0 suffix '63'
2025-10-10T14:31:44.307370Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 11} (92-92)
2025-10-10T14:31:44.296405Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:31:44.307358Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.307373Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 12} (93-93)
2025-10-10T14:31:44.307374Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 122
2025-10-10T14:31:44.296430Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 59 totakecount 6 count 6 size 41220 from pos 0 cbcount 6
2025-10-10T14:31:44.307381Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 13} (94-94)
2025-10-10T14:31:44.296458Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 59
2025-10-10T14:31:44.296494Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.296534Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 65 Result { Offset: 59 Data: "... 6573 bytes ..." SourceId: "\000src_id" SeqNo: 60 WriteTimestampMS: 1760106704294 CreateTimestampMS: 1760106704293 UncompressedSize: 6501 PartitionKey: "" ExplicitHash: "" } Result { Offset: 60 Data: "... 6683 bytes ..." SourceId: "\000src_id" SeqNo: 61 WriteTimestampMS: 1760106704294 CreateTimestampMS: 1760106704293 UncompressedSize: 6611 PartitionKey: "" ExplicitHash: "" } Result { Offset: 61 Data: "... 6793 bytes ..." SourceId: "\000src_id" SeqNo: 62 WriteTimestampMS: 1760106704294 CreateTimestampMS: 1760106704293 UncompressedSize: 6721 PartitionKey: "" ExplicitHash: "" } Result { Offset: 62 Data: "... 6903 bytes ..." SourceId: "\000src_id" SeqNo: 63 WriteTimestampMS: 1760106704294 CreateTimestampMS: 1760106704293 UncompressedSize: 6831 PartitionKey: "" ExplicitHash: "" } Result { Offset: 63 Data: "... 7013 bytes ..." SourceId: "\000src_id" SeqNo: 64 WriteTimestampMS: 1760106704294 CreateTimestampMS: 1760106704293 UncompressedSize: 6941 PartitionKey: "" ExplicitHash: "" } Result { Offset: 64 Data: "... 7123 bytes ..." SourceId: "\000src_id" SeqNo: 65 WriteTimestampMS: 1760106704294 CreateTimestampMS: 1760106704294 UncompressedSize: 7051 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 18446744073709551518 RealReadOffset: 64 WaitQuotaTimeMs: 0 EndOffset: 65 StartOffset: 0 } Cookie: 59 }
2025-10-10T14:31:44.296554Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.296564Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 13 from offset 65
2025-10-10T14:31:44.307417Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 14} (95-95)
2025-10-10T14:31:44.307427Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 123 to 123
2025-10-10T14:31:44.296567Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.307731Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.307732Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Got ReadResponse, serverBytesSize = 124059, now ReadSizeBudget = 0, ReadSizeServerDelta = 400229
2025-10-10T14:31:44.307739Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 123
2025-10-10T14:31:44.296568Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 65 ReadOffset 65 ReadGuid 1d49502c-726f30b1-a9c31a0e-392273bd has messages 1
2025-10-10T14:31:44.307741Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 15} (96-96)
2025-10-10T14:31:44.296569Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.296580Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 read done: guid# 1d49502c-726f30b1-a9c31a0e-392273bd, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 40999
2025-10-10T14:31:44.296584Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 response to read: guid# 1d49502c-726f30b1-a9c31a0e-392273bd
2025-10-10T14:31:44.296626Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 138  requestId: <none> cookie: 70
2025-10-10T14:31:44.296634Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.296642Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.307770Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] In ContinueReadingDataImpl, ReadSizeBudget = 0, ReadSizeServerDelta = 400229
2025-10-10T14:31:44.296644Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.296649Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 70 partNo : 0 messageNo: 139 size 7673 offset: -1
2025-10-10T14:31:44.296652Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.296655Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.296693Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 Process answer. Aval parts: 0
2025-10-10T14:31:44.296942Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 65 count 1 size 7295 actorID [3:7559600726884252064:2448]
2025-10-10T14:31:44.296951Z node 3 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:31:44.296958Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 7240 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:31:44.296961Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.296965Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 66, partNo: 0, Offset: 65 is stored on disk
2025-10-10T14:31:44.296966Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 65 partno 0 count 1 parts 0 suffix '63' size 7295
2025-10-10T14:31:44.307813Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (97-107)
2025-10-10T14:31:44.307824Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 124 to 124
2025-10-10T14:31:44.307830Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Returning serverBytesSize = 124059 to budget
2025-10-10T14:31:44.307838Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] In ContinueReadingDataImpl, ReadSizeBudget = 124059, ReadSizeServerDelta = 400229
2025-10-10T14:31:44.296983Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:44.296989Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:44.296991Z node 3 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (4)
2025-10-10T14:31:44.307831Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.297000Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 65 EndOffset 65 newEndOffset 66 commitOffset 0 clientCommitOffset 0 cookie 13 readingFinished 0 firstRead 0
2025-10-10T14:31:44.307851Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 124
2025-10-10T14:31:44.297001Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 67 partNo 0
2025-10-10T14:31:44.297005Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 65 endOffset 66
2025-10-10T14:31:44.297013Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 65, endOffset# 66, WTime# 1760106704294, sizeLag# 7295
2025-10-10T14:31:44.297015Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1TEvPartitionReady. Aval parts: 1
2025-10-10T14:31:44.307874Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-10T14:31:44.297021Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 performing read request: guid# 83ed1733-3733d152-2c65217-ca95db6b, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 1, size# 8754, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-10T14:31:44.297029Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 1 maxSize 8754 maxTimeLagMs 0 readTimestampMs 0 readOffset 65 EndOffset 66 ClientCommitOffset 0 committedOffset 0 Guid 83ed1733-3733d152-2c65217-ca95db6b
2025-10-10T14:31:44.307880Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 125 to 125
2025-10-10T14:31:44.297035Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 67 partNo 0 FormedBlobsCount 0 NewHead: Offset 66 PartNo 0 PackedSize 7417 count 1 nextOffset 67 batches 1
>>> event from dataHandler: 2025-10-10T14:31:44.308207Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (97-97)
2025-10-10T14:31:44.308209Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.308229Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 1} (98-98)
2025-10-10T14:31:44.308232Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 125
2025-10-10T14:31:44.297040Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 68 partNo 0
2025-10-10T14:31:44.308237Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 2} (99-99)
2025-10-10T14:31:44.297044Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 68 partNo 0 FormedBlobsCount 0 NewHead: Offset 66 PartNo 0 PackedSize 14912 count 2 nextOffset 68 batches 1
2025-10-10T14:31:44.297047Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 69 partNo 0
2025-10-10T14:31:44.297052Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 69 partNo 0 FormedBlobsCount 0 NewHead: Offset 66 PartNo 0 PackedSize 22517 count 3 nextOffset 69 batches 1
2025-10-10T14:31:44.308259Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 3} (100-100)
2025-10-10T14:31:44.297054Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 70 partNo 0
2025-10-10T14:31:44.297058Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 70 partNo 0 FormedBlobsCount 0 NewHead: Offset 66 PartNo 0 PackedSize 30232 count 4 nextOffset 70 batches 1
2025-10-10T14:31:44.297060Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:44.297094Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 66,4 HeadOffset 66 endOffset 66 curOffset 70 d0000000000_00000000000000000066_00000_0000000004_00000? size 30166 WTime 1760106704296
2025-10-10T14:31:44.297109Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:182: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:31:44.297115Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 131  requestId: <none> cookie: 66
2025-10-10T14:31:44.297130Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.297132Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.297137Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.308298Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 126 to 126
2025-10-10T14:31:44.297140Z node 3 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:31:44.297145Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.297150Z node 3 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 66 partNo 0 count 4 size 30166
2025-10-10T14:31:44.308313Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 4} (101-101)
2025-10-10T14:31:44.297192Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 16 Topic 'rt3.dc1--test-topic' partition 0 user user offset 65 count 1 size 8754 endOffset 66 max time lag 0ms effective offset 65
2025-10-10T14:31:44.297203Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 16 added 1 blobs, size 7295 count 1 last offset 65, current partition end offset: 66
2025-10-10T14:31:44.308321Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 5} (102-102)
2025-10-10T14:31:44.297205Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 16. Send blob request.
2025-10-10T14:31:44.308313Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.308327Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 6} (103-103)
2025-10-10T14:31:44.308328Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 126
2025-10-10T14:31:44.297211Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 65 partno 0 count 1 parts_count 0 source 1 size 7295 accessed 0 times before, last time 2025-10-10T14:31:44.000000Z
2025-10-10T14:31:44.297214Z node 3 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 16. All 1 blobs are from cache.
2025-10-10T14:31:44.297221Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:31:44.297227Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 65 partno 0 count 1 parts 0 suffix '63'
2025-10-10T14:31:44.308340Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 7} (104-104)
2025-10-10T14:31:44.297233Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 65 totakecount 1 count 1 size 7275 from pos 0 cbcount 1
DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 Message { Data: ..8921 bytes.. Information: { Offset: 81 ProducerId: "src_id" SeqNo: 82 CreateTime: 2025-10-10T14:31:44.299000Z WriteTime: 2025-10-10T14:31:44.302000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:46198", "server": "ipv6:[::1]:46198", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..9031 bytes.. Information: { Offset: 82 ProducerId: "src_id" SeqNo: 83 CreateTime: 2025-10-10T14:31:44.299000Z WriteTime: 2025-10-10T14:31:44.302000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:46198", "server": "ipv6:[::1]:46198", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..9141 bytes.. Information: { Offset: 83 ProducerId: "src_id" SeqNo: 84 CreateTime: 2025-10-10T14:31:44.299000Z WriteTime: 2025-10-10T14:31:44.302000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:46198", "server": "ipv6:[::1]:46198", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..9251 bytes.. Information: { Offset: 84 ProducerId: "src_id" SeqNo: 85 CreateTime: 2025-10-10T14:31:44.300000Z WriteTime: 2025-10-10T14:31:44.302000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:46198", "server": "ipv6:[::1]:46198", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..9361 bytes.. Information: { Offset: 85 ProducerId: "src_id" SeqNo: 86 CreateTime: 2025-10-10T14:31:44.300000Z WriteTime: 2025-10-10T14:31:44.302000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:46198", "server": "ipv6:[::1]:46198", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..9471 bytes.. Information: { Offset: 86 ProducerId: "src_id" SeqNo: 87 CreateTime: 2025-10-10T14:31:44.300000Z WriteTime: 2025-10-10T14:31:44.302000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:46198", "server": "ipv6:[::1]:46198", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..9581 bytes.. Information: { Offset: 87 ProducerId: "src_id" SeqNo: 88 CreateTime: 2025-10-10T14:31:44.300000Z WriteTime: 2025-10-10T14:31:44.302000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:46198", "server": "ipv6:[::1]:46198", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..9691 bytes.. Information: { Offset: 88 ProducerId: "src_id" SeqNo: 89 CreateTime: 2025-10-10T14:31:44.300000Z WriteTime: 2025-10-10T14:31:44.302000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:46198", "server": "ipv6:[::1]:46198", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..9801 bytes.. Information: { Offset: 89 ProducerId: "src_id" SeqNo: 90 CreateTime: 2025-10-10T14:31:44.300000Z WriteTime: 2025-10-10T14:31:44.302000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:46198", "server": "ipv6:[::1]:46198", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..9911 bytes.. Information: { Offset: 90 ProducerId: "src_id" SeqNo: 91 CreateTime: 2025-10-10T14:31:44.301000Z WriteTime: 2025-10-10T14:31:44.302000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:46198", "server": "ipv6:[::1]:46198", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..10021 bytes.. Information: { Offset: 91 ProducerId: "src_id" SeqNo: 92 CreateTime: 2025-10-10T14:31:44.301000Z WriteTime: 2025-10-10T14:31:44.302000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:46198", "server": "ipv6:[::1]:46198", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..10131 bytes.. Information: { Offset: 92 ProducerId: "src_id" SeqNo: 93 CreateTime: 2025-10-10T14:31:44.301000Z WriteTime: 2025-10-10T14:31:44.302000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:46198", "server": "ipv6:[::1]:46198", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..10241 bytes.. Information: { Offset: 93 ProducerId: "src_id" SeqNo: 94 CreateTime: 2025-10-10T14:31:44.301000Z WriteTime: 2025-10-10T14:31:44.302000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:46198", "server": "ipv6:[::1]:46198", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..10351 bytes.. Information: { Offset: 94 ProducerId: "src_id" SeqNo: 95 CreateTime: 2025-10-10T14:31:44.301000Z WriteTime: 2025-10-10T14:31:44.302000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:46198", "server": "ipv6:[::1]:46198", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..10461 bytes.. Information: { Offset: 95 ProducerId: "src_id" SeqNo: 96 CreateTime: 2025-10-10T14:31:44.301000Z WriteTime: 2025-10-10T14:31:44.302000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:46198", "server": "ipv6:[::1]:46198", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..10571 bytes.. Information: { Offset: 96 ProducerId: "src_id" SeqNo: 97 CreateTime: 2025-10-10T14:31:44.302000Z WriteTime: 2025-10-10T14:31:44.302000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:46198", "server": "ipv6:[::1]:46198", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } }
2025-10-10T14:31:44.308429Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 8} (105-105)
2025-10-10T14:31:44.308466Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 127 to 127
2025-10-10T14:31:44.308588Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 9} (106-106)
2025-10-10T14:31:44.308534Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Got ReadResponse, serverBytesSize = 73339, now ReadSizeBudget = 0, ReadSizeServerDelta = 450949
2025-10-10T14:31:44.308608Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.308612Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 127
2025-10-10T14:31:44.308613Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 10} (107-107)
2025-10-10T14:31:44.297236Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.308619Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] The application data is transferred to the client. Number of messages 16, size 155936 bytes
2025-10-10T14:31:44.297245Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 65
2025-10-10T14:31:44.309008Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] In ContinueReadingDataImpl, ReadSizeBudget = 0, ReadSizeServerDelta = 450949
2025-10-10T14:31:44.308680Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 128 to 128
2025-10-10T14:31:44.309018Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] In ContinueReadingDataImpl, ReadSizeBudget = 0, ReadSizeServerDelta = 450949
2025-10-10T14:31:44.297252Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.297254Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.309026Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Returning serverBytesSize = 0 to budget
2025-10-10T14:31:44.309026Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.297266Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 140  requestId: <none> cookie: 71
2025-10-10T14:31:44.309031Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 128
2025-10-10T14:31:44.297273Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.297280Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.309029Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] In ContinueReadingDataImpl, ReadSizeBudget = 0, ReadSizeServerDelta = 450949
2025-10-10T14:31:44.297287Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 66 Result { Offset: 65 Data: "... 7233 bytes ..." SourceId: "\000src_id" SeqNo: 66 WriteTimestampMS: 1760106704295 CreateTimestampMS: 1760106704294 UncompressedSize: 7161 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 20 RealReadOffset: 65 WaitQuotaTimeMs: 0 EndOffset: 66 StartOffset: 0 } Cookie: 65 }
2025-10-10T14:31:44.297303Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 14 from offset 66
2025-10-10T14:31:44.297307Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 66 ReadOffset 66 ReadGuid 83ed1733-3733d152-2c65217-ca95db6b has messages 1
2025-10-10T14:31:44.309051Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (108-113)
2025-10-10T14:31:44.297323Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.309067Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Returning serverBytesSize = 73339 to budget
2025-10-10T14:31:44.297323Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.297326Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.309072Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] In ContinueReadingDataImpl, ReadSizeBudget = 73339, ReadSizeServerDelta = 450949
2025-10-10T14:31:44.297352Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 read done: guid# 83ed1733-3733d152-2c65217-ca95db6b, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 7326
2025-10-10T14:31:44.297354Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 71 partNo : 0 messageNo: 141 size 7783 offset: -1
2025-10-10T14:31:44.297356Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 response to read: guid# 83ed1733-3733d152-2c65217-ca95db6b
2025-10-10T14:31:44.297359Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.297361Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.309092Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 129 to 129
2025-10-10T14:31:44.297365Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.297371Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.309097Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.309100Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 129
2025-10-10T14:31:44.297381Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 142  requestId: <none> cookie: 72
2025-10-10T14:31:44.297386Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.297391Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.297414Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 Process answer. Aval parts: 0
2025-10-10T14:31:44.297421Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.297427Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.297428Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.297434Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 72 partNo : 0 messageNo: 143 size 7893 offset: -1
2025-10-10T14:31:44.297439Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.297441Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.309132Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 130 to 130
2025-10-10T14:31:44.297444Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.297449Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.297454Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 144  requestId: <none> cookie: 73
2025-10-10T14:31:44.297459Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.297476Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.309147Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-10T14:31:44.297477Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.297481Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 73 partNo : 0 messageNo: 145 size 8003 offset: -1
2025-10-10T14:31:44.297483Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.297486Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.297730Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 grpc read done: success# 1, data# { read_request { bytes_size: 40999 } }
2025-10-10T14:31:44.309156Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.309175Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 130
2025-10-10T14:31:44.297785Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.309180Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (108-108)
2025-10-10T14:31:44.297786Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 got read request: guid# 12bbaf92-f4bea0b4-f86c3702-8419e427
2025-10-10T14:31:44.309190Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 131 to 131
2025-10-10T14:31:44.297828Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.297864Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.297866Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.297867Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.297878Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 146  requestId: <none> cookie: 74
2025-10-10T14:31:44.309203Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.297926Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.309207Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 131
2025-10-10T14:31:44.297934Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
>>> event from dataHandler: 2025-10-10T14:31:44.297945Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.309207Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 1} (109-109)
2025-10-10T14:31:44.297950Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 66 count 4 size 30166 actorID [3:7559600726884252064:2448]
2025-10-10T14:31:44.297960Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.297962Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.309224Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 2} (110-110)
2025-10-10T14:31:44.297963Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 66 partno 0 count 4 parts 0 suffix '63' size 30166
2025-10-10T14:31:44.309234Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 3} (111-111)
2025-10-10T14:31:44.297970Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 74 partNo : 0 messageNo: 147 size 8113 offset: -1
2025-10-10T14:31:44.297974Z node 3 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:31:44.297981Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 30060 WriteNewSizeFromSupportivePartitions# 0
DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 Message { Data: ..10681 bytes.. Information: { Offset: 97 ProducerId: "src_id" SeqNo: 98 CreateTime: 2025-10-10T14:31:44.302000Z WriteTime: 2025-10-10T14:31:44.304000Z MessageGroupId: "src_id" Meta: { "server": "ipv6:[::1]:46198", "logtype": "unknown", "_ip": "ipv6:[::1]:46198", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..10791 bytes.. Information: { Offset: 98 ProducerId: "src_id" SeqNo: 99 CreateTime: 2025-10-10T14:31:44.302000Z WriteTime: 2025-10-10T14:31:44.304000Z MessageGroupId: "src_id" Meta: { "server": "ipv6:[::1]:46198", "logtype": "unknown", "_ip": "ipv6:[::1]:46198", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..10901 bytes.. Information: { Offset: 99 ProducerId: "src_id" SeqNo: 100 CreateTime: 2025-10-10T14:31:44.302000Z WriteTime: 2025-10-10T14:31:44.304000Z MessageGroupId: "src_id" Meta: { "server": "ipv6:[::1]:46198", "logtype": "unknown", "_ip": "ipv6:[::1]:46198", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..11011 bytes.. Information: { Offset: 100 ProducerId: "src_id" SeqNo: 101 CreateTime: 2025-10-10T14:31:44.303000Z WriteTime: 2025-10-10T14:31:44.304000Z MessageGroupId: "src_id" Meta: { "server": "ipv6:[::1]:46198", "logtype": "unknown", "_ip": "ipv6:[::1]:46198", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..11121 bytes.. Information: { Offset: 101 ProducerId: "src_id" SeqNo: 102 CreateTime: 2025-10-10T14:31:44.303000Z WriteTime: 2025-10-10T14:31:44.304000Z MessageGroupId: "src_id" Meta: { "server": "ipv6:[::1]:46198", "logtype": "unknown", "_ip": "ipv6:[::1]:46198", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..11231 bytes.. Information: { Offset: 102 ProducerId: "src_id" SeqNo: 103 CreateTime: 2025-10-10T14:31:44.303000Z WriteTime: 2025-10-10T14:31:44.304000Z MessageGroupId: "src_id" Meta: { "server": "ipv6:[::1]:46198", "logtype": "unknown", "_ip": "ipv6:[::1]:46198", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..11341 bytes.. Information: { Offset: 103 ProducerId: "src_id" SeqNo: 104 CreateTime: 2025-10-10T14:31:44.303000Z WriteTime: 2025-10-10T14:31:44.304000Z MessageGroupId: "src_id" Meta: { "server": "ipv6:[::1]:46198", "logtype": "unknown", "_ip": "ipv6:[::1]:46198", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..11451 bytes.. Information: { Offset: 104 ProducerId: "src_id" SeqNo: 105 CreateTime: 2025-10-10T14:31:44.303000Z WriteTime: 2025-10-10T14:31:44.304000Z MessageGroupId: "src_id" Meta: { "server": "ipv6:[::1]:46198", "logtype": "unknown", "_ip": "ipv6:[::1]:46198", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..11561 bytes.. Information: { Offset: 105 ProducerId: "src_id" SeqNo: 106 CreateTime: 2025-10-10T14:31:44.303000Z WriteTime: 2025-10-10T14:31:44.304000Z MessageGroupId: "src_id" Meta: { "server": "ipv6:[::1]:46198", "logtype": "unknown", "_ip": "ipv6:[::1]:46198", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..11671 bytes.. Information: { Offset: 106 ProducerId: "src_id" SeqNo: 107 CreateTime: 2025-10-10T14:31:44.304000Z WriteTime: 2025-10-10T14:31:44.304000Z MessageGroupId: "src_id" Meta: { "server": "ipv6:[::1]:46198", "logtype": "unknown", "_ip": "ipv6:[::1]:46198", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..11781 bytes.. Information: { Offset: 107 ProducerId: "src_id" SeqNo: 108 CreateTime: 2025-10-10T14:31:44.304000Z WriteTime: 2025-10-10T14:31:44.304000Z MessageGroupId: "src_id" Meta: { "server": "ipv6:[::1]:46198", "logtype": "unknown", "_ip": "ipv6:[::1]:46198", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } }
2025-10-10T14:31:44.309284Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 4} (112-112)
2025-10-10T14:31:44.309308Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 132 to 132
2025-10-10T14:31:44.309543Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 5} (113-113)
2025-10-10T14:31:44.297985Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.297986Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.297987Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.309571Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.309574Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] The application data is transferred to the client. Number of messages 11, size 123541 bytes
2025-10-10T14:31:44.309581Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 132
2025-10-10T14:31:44.309582Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Returning serverBytesSize = 0 to budget
2025-10-10T14:31:44.297990Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 67, partNo: 0, Offset: 66 is stored on disk
2025-10-10T14:31:44.297993Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.297995Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 68, partNo: 0, Offset: 67 is stored on disk
2025-10-10T14:31:44.297996Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.297998Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 69, partNo: 0, Offset: 68 is stored on disk
2025-10-10T14:31:44.298000Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.298004Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 70, partNo: 0, Offset: 69 is stored on disk
2025-10-10T14:31:44.298022Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:44.298027Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:44.298028Z node 3 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2025-10-10T14:31:44.298031Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.298040Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 71 partNo 0
2025-10-10T14:31:44.298041Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 66 EndOffset 66 newEndOffset 70 commitOffset 0 clientCommitOffset 0 cookie 14 readingFinished 0 firstRead 0
2025-10-10T14:31:44.298044Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 66 endOffset 70
2025-10-10T14:31:44.309634Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 133 to 133
2025-10-10T14:31:44.298050Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 66, endOffset# 70, WTime# 1760106704295, sizeLag# 30166
2025-10-10T14:31:44.298052Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1TEvPartitionReady. Aval parts: 1
2025-10-10T14:31:44.298059Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 performing read request: guid# e236d7-c204d55-103294a6-8066491b, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 4, size# 36199, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-10T14:31:44.298060Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 71 partNo 0 FormedBlobsCount 0 NewHead: Offset 70 PartNo 0 PackedSize 7857 count 1 nextOffset 71 batches 1
2025-10-10T14:31:44.309647Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.298064Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 72 partNo 0
2025-10-10T14:31:44.309650Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 133
2025-10-10T14:31:44.298066Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 4 maxSize 36199 maxTimeLagMs 0 readTimestampMs 0 readOffset 66 EndOffset 70 ClientCommitOffset 0 committedOffset 0 Guid e236d7-c204d55-103294a6-8066491b
2025-10-10T14:31:44.298069Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 72 partNo 0 FormedBlobsCount 0 NewHead: Offset 70 PartNo 0 PackedSize 15792 count 2 nextOffset 72 batches 1
2025-10-10T14:31:44.298072Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 73 partNo 0
>>> event from dataHandler: 2025-10-10T14:31:44.298077Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 73 partNo 0 FormedBlobsCount 0 NewHead: Offset 70 PartNo 0 PackedSize 23837 count 3 nextOffset 73 batches 1
2025-10-10T14:31:44.298080Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:44.298127Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 70,3 HeadOffset 70 endOffset 70 curOffset 73 d0000000000_00000000000000000070_00000_0000000003_00000? size 23803 WTime 1760106704297
2025-10-10T14:31:44.298143Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:182: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 Message { Data: ..11891 bytes.. Information: { Offset: 108 ProducerId: "src_id" SeqNo: 109 CreateTime: 2025-10-10T14:31:44.304000Z WriteTime: 2025-10-10T14:31:44.306000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "server": "ipv6:[::1]:46198", "_ip": "ipv6:[::1]:46198", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..12001 bytes.. Information: { Offset: 109 ProducerId: "src_id" SeqNo: 110 CreateTime: 2025-10-10T14:31:44.304000Z WriteTime: 2025-10-10T14:31:44.306000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "server": "ipv6:[::1]:46198", "_ip": "ipv6:[::1]:46198", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..12111 bytes.. Information: { Offset: 110 ProducerId: "src_id" SeqNo: 111 CreateTime: 2025-10-10T14:31:44.304000Z WriteTime: 2025-10-10T14:31:44.306000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "server": "ipv6:[::1]:46198", "_ip": "ipv6:[::1]:46198", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..12221 bytes.. Information: { Offset: 111 ProducerId: "src_id" SeqNo: 112 CreateTime: 2025-10-10T14:31:44.305000Z WriteTime: 2025-10-10T14:31:44.306000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "server": "ipv6:[::1]:46198", "_ip": "ipv6:[::1]:46198", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..12331 bytes.. Information: { Offset: 112 ProducerId: "src_id" SeqNo: 113 CreateTime: 2025-10-10T14:31:44.305000Z WriteTime: 2025-10-10T14:31:44.306000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "server": "ipv6:[::1]:46198", "_ip": "ipv6:[::1]:46198", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..12441 bytes.. Information: { Offset: 113 ProducerId: "src_id" SeqNo: 114 CreateTime: 2025-10-10T14:31:44.305000Z WriteTime: 2025-10-10T14:31:44.306000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "server": "ipv6:[::1]:46198", "_ip": "ipv6:[::1]:46198", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } }
2025-10-10T14:31:44.309925Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Got ReadResponse, serverBytesSize = 103901, now ReadSizeBudget = 0, ReadSizeServerDelta = 420387
2025-10-10T14:31:44.309683Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session got write response: sequence_numbers: 2 offsets: 1 already_written: false write_statistics { persist_duration_ms: 1 queued_in_partition_duration_ms: 1 }
2025-10-10T14:31:44.310164Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] In ContinueReadingDataImpl, ReadSizeBudget = 0, ReadSizeServerDelta = 420387
2025-10-10T14:31:44.310168Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] The application data is transferred to the client. Number of messages 6, size 72996 bytes
2025-10-10T14:31:44.310172Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: acknoledged message 2
2025-10-10T14:31:44.298147Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.310179Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] In ContinueReadingDataImpl, ReadSizeBudget = 0, ReadSizeServerDelta = 420387
2025-10-10T14:31:44.298152Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.310185Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Returning serverBytesSize = 0 to budget
2025-10-10T14:31:44.298155Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.310188Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] In ContinueReadingDataImpl, ReadSizeBudget = 0, ReadSizeServerDelta = 420387
2025-10-10T14:31:44.298158Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.298164Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 135  requestId: <none> cookie: 67
2025-10-10T14:31:44.298179Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 136  requestId: <none> cookie: 68
2025-10-10T14:31:44.298183Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 137  requestId: <none> cookie: 69
2025-10-10T14:31:44.310203Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (114-121)
2025-10-10T14:31:44.298187Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 139  requestId: <none> cookie: 70
2025-10-10T14:31:44.310219Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Returning serverBytesSize = 103901 to budget
2025-10-10T14:31:44.298192Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.310224Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] In ContinueReadingDataImpl, ReadSizeBudget = 103901, ReadSizeServerDelta = 420387
2025-10-10T14:31:44.298194Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.298193Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.298197Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.310237Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session got write response: sequence_numbers: 3 offsets: 2 already_written: false write_statistics { persist_duration_ms: 1 queued_in_partition_duration_ms: 1 }
2025-10-10T14:31:44.310244Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: acknoledged message 3
2025-10-10T14:31:44.298199Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.298202Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.298206Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.298206Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.310284Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-10T14:31:44.310330Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 134 to 134
2025-10-10T14:31:44.298208Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.310544Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (114-114)
2025-10-10T14:31:44.298210Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.298214Z node 3 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:31:44.298222Z node 3 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 70 partNo 0 count 3 size 23803
2025-10-10T14:31:44.298245Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 148  requestId: <none> cookie: 75
2025-10-10T14:31:44.310562Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 1} (115-115)
2025-10-10T14:31:44.298248Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 149  requestId: <none> cookie: 76
2025-10-10T14:31:44.310562Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.310572Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 2} (116-116)
2025-10-10T14:31:44.298251Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 150  requestId: <none> cookie: 77
2025-10-10T14:31:44.298271Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 17 Topic 'rt3.dc1--test-topic' partition 0 user user offset 66 count 4 size 36199 endOffset 70 max time lag 0ms effective offset 66
2025-10-10T14:31:44.298279Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.310586Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 134
2025-10-10T14:31:44.298283Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.310589Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 3} (117-117)
2025-10-10T14:31:44.298283Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 17 added 1 blobs, size 30166 count 4 last offset 66, current partition end offset: 70
2025-10-10T14:31:44.298285Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 17. Send blob request.
2025-10-10T14:31:44.298286Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.310599Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 4} (118-118)
2025-10-10T14:31:44.298291Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 66 partno 0 count 4 parts_count 0 source 1 size 30166 accessed 0 times before, last time 2025-10-10T14:31:44.000000Z
2025-10-10T14:31:44.298294Z node 3 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 17. All 1 blobs are from cache.
2025-10-10T14:31:44.298299Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:31:44.310608Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 5} (119-119)
2025-10-10T14:31:44.310634Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 6} (120-120)
2025-10-10T14:31:44.298322Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 66 partno 0 count 4 parts 0 suffix '63'
2025-10-10T14:31:44.310638Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 7} (121-121)
2025-10-10T14:31:44.298335Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 66 totakecount 4 count 4 size 30144 from pos 0 cbcount 4
2025-10-10T14:31:44.298365Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.298367Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.298374Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 75 partNo : 0 messageNo: 151 size 8223 offset: -1
2025-10-10T14:31:44.298379Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.298381Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.298385Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 76 partNo : 0 messageNo: 152 size 8333 offset: -1
2025-10-10T14:31:44.298388Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.310663Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 135 to 135
2025-10-10T14:31:44.298390Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.298394Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 77 partNo : 0 messageNo: 153 size 8443 offset: -1
2025-10-10T14:31:44.310673Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.298400Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 66
2025-10-10T14:31:44.310685Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 135
2025-10-10T14:31:44.298406Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.298411Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.298413Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
>>> event from dataHandler: 2025-10-10T14:31:44.298415Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.298418Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.310711Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 136 to 136
2025-10-10T14:31:44.298420Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.310840Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 Message { Data: ..12551 bytes.. Information: { Offset: 114 ProducerId: "src_id" SeqNo: 115 CreateTime: 2025-10-10T14:31:44.305000Z WriteTime: 2025-10-10T14:31:44.307000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:46198", "logtype": "unknown", "server": "ipv6:[::1]:46198" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..12661 bytes.. Information: { Offset: 115 ProducerId: "src_id" SeqNo: 116 CreateTime: 2025-10-10T14:31:44.306000Z WriteTime: 2025-10-10T14:31:44.307000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:46198", "logtype": "unknown", "server": "ipv6:[::1]:46198" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..12771 bytes.. Information: { Offset: 116 ProducerId: "src_id" SeqNo: 117 CreateTime: 2025-10-10T14:31:44.306000Z WriteTime: 2025-10-10T14:31:44.307000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:46198", "logtype": "unknown", "server": "ipv6:[::1]:46198" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..12881 bytes.. Information: { Offset: 117 ProducerId: "src_id" SeqNo: 118 CreateTime: 2025-10-10T14:31:44.306000Z WriteTime: 2025-10-10T14:31:44.307000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:46198", "logtype": "unknown", "server": "ipv6:[::1]:46198" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..12991 bytes.. Information: { Offset: 118 ProducerId: "src_id" SeqNo: 119 CreateTime: 2025-10-10T14:31:44.306000Z WriteTime: 2025-10-10T14:31:44.307000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:46198", "logtype": "unknown", "server": "ipv6:[::1]:46198" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..13101 bytes.. Information: { Offset: 119 ProducerId: "src_id" SeqNo: 120 CreateTime: 2025-10-10T14:31:44.306000Z WriteTime: 2025-10-10T14:31:44.307000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:46198", "logtype": "unknown", "server": "ipv6:[::1]:46198" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..13211 bytes.. Information: { Offset: 120 ProducerId: "src_id" SeqNo: 121 CreateTime: 2025-10-10T14:31:44.306000Z WriteTime: 2025-10-10T14:31:44.307000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:46198", "logtype": "unknown", "server": "ipv6:[::1]:46198" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..13321 bytes.. Information: { Offset: 121 ProducerId: "src_id" SeqNo: 122 CreateTime: 2025-10-10T14:31:44.307000Z WriteTime: 2025-10-10T14:31:44.307000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:46198", "logtype": "unknown", "server": "ipv6:[::1]:46198" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } }
2025-10-10T14:31:44.298492Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 70 Result { Offset: 66 Data: "... 7343 bytes ..." SourceId: "\000src_id" SeqNo: 67 WriteTimestampMS: 1760106704296 CreateTimestampMS: 1760106704295 UncompressedSize: 7271 PartitionKey: "" ExplicitHash: "" } Result { Offset: 67 Data: "... 7453 bytes ..." SourceId: "\000src_id" SeqNo: 68 WriteTimestampMS: 1760106704296 CreateTimestampMS: 1760106704295 UncompressedSize: 7381 PartitionKey: "" ExplicitHash: "" } Result { Offset: 68 Data: "... 7563 bytes ..." SourceId: "\000src_id" SeqNo: 69 WriteTimestampMS: 1760106704296 CreateTimestampMS: 1760106704295 UncompressedSize: 7491 PartitionKey: "" ExplicitHash: "" } Result { Offset: 69 Data: "... 7673 bytes ..." SourceId: "\000src_id" SeqNo: 70 WriteTimestampMS: 1760106704296 CreateTimestampMS: 1760106704295 UncompressedSize: 7601 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 18446744073709551582 RealReadOffset: 69 WaitQuotaTimeMs: 0 EndOffset: 70 StartOffset: 0 } Cookie: 66 }
2025-10-10T14:31:44.298522Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 15 from offset 70
2025-10-10T14:31:44.310843Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 136
2025-10-10T14:31:44.311023Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Got ReadResponse, serverBytesSize = 68563, now ReadSizeBudget = 0, ReadSizeServerDelta = 455725
2025-10-10T14:31:44.298527Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 70 ReadOffset 70 ReadGuid e236d7-c204d55-103294a6-8066491b has messages 1
2025-10-10T14:31:44.298543Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 read done: guid# e236d7-c204d55-103294a6-8066491b, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 30017
2025-10-10T14:31:44.298548Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 response to read: guid# e236d7-c204d55-103294a6-8066491b
2025-10-10T14:31:44.311381Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] The application data is transferred to the client. Number of messages 8, size 103488 bytes
2025-10-10T14:31:44.298613Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 Process answer. Aval parts: 0
2025-10-10T14:31:44.311388Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] In ContinueReadingDataImpl, ReadSizeBudget = 0, ReadSizeServerDelta = 455725
2025-10-10T14:31:44.298670Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 grpc read done: success# 1, data# { read_request { bytes_size: 7326 } }
2025-10-10T14:31:44.298692Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 got read request: guid# b1189678-e093b923-b58d9799-11043872
2025-10-10T14:31:44.311397Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] In ContinueReadingDataImpl, ReadSizeBudget = 0, ReadSizeServerDelta = 455725
2025-10-10T14:31:44.298765Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.298808Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.311402Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Returning serverBytesSize = 0 to budget
2025-10-10T14:31:44.298865Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.311412Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] In ContinueReadingDataImpl, ReadSizeBudget = 0, ReadSizeServerDelta = 455725
2025-10-10T14:31:44.298868Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.311425Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (122-126)
2025-10-10T14:31:44.298880Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 154  requestId: <none> cookie: 78
2025-10-10T14:31:44.311435Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Returning serverBytesSize = 68563 to budget
2025-10-10T14:31:44.311437Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 137 to 137
2025-10-10T14:31:44.311440Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] In ContinueReadingDataImpl, ReadSizeBudget = 68563, ReadSizeServerDelta = 455725
2025-10-10T14:31:44.298891Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.298905Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.298906Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.298914Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 78 partNo : 0 messageNo: 155 size 8553 offset: -1
2025-10-10T14:31:44.311453Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.311456Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 137
2025-10-10T14:31:44.298953Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.298960Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.298968Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 70 count 3 size 23803 actorID [3:7559600726884252064:2448]
2025-10-10T14:31:44.298980Z node 3 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:31:44.311470Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 138 to 138
2025-10-10T14:31:44.298991Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 23700 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:31:44.298997Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.299011Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 71, partNo: 0, Offset: 70 is stored on disk
2025-10-10T14:31:44.299014Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.311482Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.299016Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 72, partNo: 0, Offset: 71 is stored on disk
2025-10-10T14:31:44.311488Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 138
2025-10-10T14:31:44.299018Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.299021Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 73, partNo: 0, Offset: 72 is stored on disk
2025-10-10T14:31:44.299020Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 70 partno 0 count 3 parts 0 suffix '63' size 23803
2025-10-10T14:31:44.311509Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-10T14:31:44.299048Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:44.299055Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:44.311526Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (122-122)
2025-10-10T14:31:44.299057Z node 3 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (5)
2025-10-10T14:31:44.311538Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 1} (123-123)
2025-10-10T14:31:44.299069Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 70 EndOffset 70 newEndOffset 73 commitOffset 0 clientCommitOffset 0 cookie 15 readingFinished 0 firstRead 0
2025-10-10T14:31:44.299070Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 74 partNo 0
2025-10-10T14:31:44.299072Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 70 endOffset 73
2025-10-10T14:31:44.299082Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 70, endOffset# 73, WTime# 1760106704296, sizeLag# 23803
2025-10-10T14:31:44.299084Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1TEvPartitionReady. Aval parts: 1
2025-10-10T14:31:44.311557Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 2} (124-124)
2025-10-10T14:31:44.299091Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 74 partNo 0 FormedBlobsCount 0 NewHead: Offset 73 PartNo 0 PackedSize 8187 count 1 nextOffset 74 batches 1
2025-10-10T14:31:44.299093Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 performing read request: guid# 4b5189cb-61204694-9aff08d-55c11fa4, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 3, size# 28563, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-10T14:31:44.311625Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 139 to 139
2025-10-10T14:31:44.299095Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 75 partNo 0
2025-10-10T14:31:44.311636Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.311639Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 139
2025-10-10T14:31:44.299098Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 75 partNo 0 FormedBlobsCount 0 NewHead: Offset 73 PartNo 0 PackedSize 16452 count 2 nextOffset 75 batches 1
2025-10-10T14:31:44.299100Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 76 partNo 0
2025-10-10T14:31:44.299103Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.299103Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 76 partNo 0 FormedBlobsCount 0 NewHead: Offset 73 PartNo 0 PackedSize 24827 count 3 nextOffset 76 batches 1
2025-10-10T14:31:44.311563Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 3} (125-125)
2025-10-10T14:31:44.299105Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 77 partNo 0
2025-10-10T14:31:44.299108Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 77 partNo 0 FormedBlobsCount 0 NewHead: Offset 73 PartNo 0 PackedSize 33312 count 4 nextOffset 77 batches 1
2025-10-10T14:31:44.299111Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 78 partNo 0
2025-10-10T14:31:44.299114Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 78 partNo 0 FormedBlobsCount 0 NewHead: Offset 73 PartNo 0 PackedSize 41907 count 5 nextOffset 78 batches 1
2025-10-10T14:31:44.311680Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 140 to 140
2025-10-10T14:31:44.299116Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:44.311690Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.311693Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 140
2025-10-10T14:31:44.299163Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 73,5 HeadOffset 73 endOffset 73 curOffset 78 d0000000000_00000000000000000073_00000_0000000005_00000? size 41809 WTime 1760106704298
2025-10-10T14:31:44.299191Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.299206Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 3 maxSize 28563 maxTimeLagMs 0 readTimestampMs 0 readOffset 70 EndOffset 73 ClientCommitOffset 0 committedOffset 0 Guid 4b5189cb-61204694-9aff08d-55c11fa4
2025-10-10T14:31:44.299207Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:182: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:31:44.299214Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 141  requestId: <none> cookie: 71
2025-10-10T14:31:44.299219Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.299220Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 143  requestId: <none> cookie: 72
2025-10-10T14:31:44.299224Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 145  requestId: <none> cookie: 73
2025-10-10T14:31:44.299224Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.299227Z node 3 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:31:44.299229Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.311732Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 4} (126-126)
2025-10-10T14:31:44.299237Z node 3 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 73 partNo 0 count 5 size 41809
2025-10-10T14:31:44.299245Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.299247Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.299258Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.299261Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.299289Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.311753Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 141 to 141
2025-10-10T14:31:44.311762Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.299307Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.311765Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 141
2025-10-10T14:31:44.299312Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 156  requestId: <none> cookie: 79
2025-10-10T14:31:44.299316Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.299323Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 18 Topic 'rt3.dc1--test-topic' partition 0 user user offset 70 count 3 size 28563 endOffset 73 max time lag 0ms effective offset 70
2025-10-10T14:31:44.299332Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 grpc read done: success# 1, data# { read_request { bytes_size: 30017 } }
2025-10-10T14:31:44.311816Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 142 to 142
>>> event from dataHandler: 2025-10-10T14:31:44.312129Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Got ReadResponse, serverBytesSize = 85890, now ReadSizeBudget = 0, ReadSizeServerDelta = 438398
2025-10-10T14:31:44.312119Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 Message { Data: ..13431 bytes.. Information: { Offset: 122 ProducerId: "src_id" SeqNo: 123 CreateTime: 2025-10-10T14:31:44.307000Z WriteTime: 2025-10-10T14:31:44.308000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:46198", "server": "ipv6:[::1]:46198" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..13541 bytes.. Information: { Offset: 123 ProducerId: "src_id" SeqNo: 124 CreateTime: 2025-10-10T14:31:44.307000Z WriteTime: 2025-10-10T14:31:44.308000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:46198", "server": "ipv6:[::1]:46198" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..13651 bytes.. Information: { Offset: 124 ProducerId: "src_id" SeqNo: 125 CreateTime: 2025-10-10T14:31:44.307000Z WriteTime: 2025-10-10T14:31:44.308000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:46198", "server": "ipv6:[::1]:46198" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..13761 bytes.. Information: { Offset: 125 ProducerId: "src_id" SeqNo: 126 CreateTime: 2025-10-10T14:31:44.308000Z WriteTime: 2025-10-10T14:31:44.308000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:46198", "server": "ipv6:[::1]:46198" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..13871 bytes.. Information: { Offset: 126 ProducerId: "src_id" SeqNo: 127 CreateTime: 2025-10-10T14:31:44.308000Z WriteTime: 2025-10-10T14:31:44.308000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:46198", "server": "ipv6:[::1]:46198" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } }
2025-10-10T14:31:44.312153Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 142
2025-10-10T14:31:44.312154Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] In ContinueReadingDataImpl, ReadSizeBudget = 0, ReadSizeServerDelta = 438398
2025-10-10T14:31:44.299333Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 18 added 1 blobs, size 23803 count 3 last offset 70, current partition end offset: 73
2025-10-10T14:31:44.299335Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 18. Send blob request.
2025-10-10T14:31:44.299339Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.312169Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] The application data is transferred to the client. Number of messages 5, size 68255 bytes
2025-10-10T14:31:44.312183Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 143 to 143
2025-10-10T14:31:44.312187Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] In ContinueReadingDataImpl, ReadSizeBudget = 0, ReadSizeServerDelta = 438398
2025-10-10T14:31:44.299340Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.299341Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 got read request: guid# f25d952d-e1974085-4a654e8f-2e78d61e
2025-10-10T14:31:44.312193Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (127-132)
2025-10-10T14:31:44.299344Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.312192Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Returning serverBytesSize = 0 to budget
2025-10-10T14:31:44.299345Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.312202Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] In ContinueReadingDataImpl, ReadSizeBudget = 0, ReadSizeServerDelta = 438398
2025-10-10T14:31:44.299350Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 79 partNo : 0 messageNo: 158 size 8663 offset: -1
2025-10-10T14:31:44.312195Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.312208Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Returning serverBytesSize = 85890 to budget
2025-10-10T14:31:44.312209Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 143
2025-10-10T14:31:44.299358Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 70 partno 0 count 3 parts_count 0 source 1 size 23803 accessed 0 times before, last time 2025-10-10T14:31:44.000000Z
2025-10-10T14:31:44.299368Z node 3 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 18. All 1 blobs are from cache.
2025-10-10T14:31:44.312218Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 144 to 144
2025-10-10T14:31:44.299374Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.312224Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.299377Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.312227Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 144
2025-10-10T14:31:44.299379Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 70 partno 0 count 3 parts 0 suffix '63'
2025-10-10T14:31:44.312213Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] In ContinueReadingDataImpl, ReadSizeBudget = 85890, ReadSizeServerDelta = 438398
2025-10-10T14:31:44.299381Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:31:44.299410Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 70 totakecount 3 count 3 size 23781 from pos 0 cbcount 3
2025-10-10T14:31:44.299428Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 157  requestId: <none> cookie: 80
2025-10-10T14:31:44.312323Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 145 to 145
2025-10-10T14:31:44.299433Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.299434Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 70
2025-10-10T14:31:44.299455Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.312682Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.299457Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.312686Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 145
2025-10-10T14:31:44.299462Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 80 partNo : 0 messageNo: 159 size 8773 offset: -1
2025-10-10T14:31:44.299467Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.312695Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-10T14:31:44.299470Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.299491Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 73 Result { Offset: 70 Data: "... 7783 bytes ..." SourceId: "\000src_id" SeqNo: 71 WriteTimestampMS: 1760106704297 CreateTimestampMS: 1760106704296 UncompressedSize: 7711 PartitionKey: "" ExplicitHash: "" } Result { Offset: 71 Data: "... 7893 bytes ..." SourceId: "\000src_id" SeqNo: 72 WriteTimestampMS: 1760106704297 CreateTimestampMS: 1760106704297 UncompressedSize: 7821 PartitionKey: "" ExplicitHash: "" } Result { Offset: 72 Data: "... 8003 bytes ..." SourceId: "\000src_id" SeqNo: 73 WriteTimestampMS: 1760106704297 CreateTimestampMS: 1760106704297 UncompressedSize: 7931 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 18446744073709551614 RealReadOffset: 72 WaitQuotaTimeMs: 0 EndOffset: 73 StartOffset: 0 } Cookie: 70 }
2025-10-10T14:31:44.299513Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 16 from offset 73
2025-10-10T14:31:44.299516Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 73 ReadOffset 73 ReadGuid 4b5189cb-61204694-9aff08d-55c11fa4 has messages 1
2025-10-10T14:31:44.299533Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 read done: guid# 4b5189cb-61204694-9aff08d-55c11fa4, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 23701
2025-10-10T14:31:44.312719Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (127-127)
2025-10-10T14:31:44.299538Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 response to read: guid# 4b5189cb-61204694-9aff08d-55c11fa4
2025-10-10T14:31:44.299602Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 Process answer. Aval parts: 0
2025-10-10T14:31:44.299806Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.312728Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 1} (128-128)
2025-10-10T14:31:44.299862Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.299875Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.299877Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.312737Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 146 to 146
2025-10-10T14:31:44.299886Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 160  requestId: <none> cookie: 81
2025-10-10T14:31:44.299890Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.312745Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.299896Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.312748Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 146
2025-10-10T14:31:44.299945Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.299967Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.299970Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.299978Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 81 partNo : 0 messageNo: 161 size 8883 offset: -1
2025-10-10T14:31:44.299982Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.299983Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.312769Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 2} (129-129)
2025-10-10T14:31:44.299987Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.299993Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.312773Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 3} (130-130)
2025-10-10T14:31:44.312791Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 147 to 147
2025-10-10T14:31:44.300000Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 162  requestId: <none> cookie: 82
2025-10-10T14:31:44.300000Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.300011Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.300045Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 73 count 5 size 41809 actorID [3:7559600726884252064:2448]
2025-10-10T14:31:44.300057Z node 3 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:31:44.300067Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 41700 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:31:44.300070Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 73 partno 0 count 5 parts 0 suffix '63' size 41809
2025-10-10T14:31:44.300072Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.300076Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 74, partNo: 0, Offset: 73 is stored on disk
2025-10-10T14:31:44.300080Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.300081Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.313144Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.300083Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 75, partNo: 0, Offset: 74 is stored on disk
2025-10-10T14:31:44.313149Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 147
2025-10-10T14:31:44.313161Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 4} (131-131)
2025-10-10T14:31:44.300085Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.300088Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 76, partNo: 0, Offset: 75 is stored on disk
2025-10-10T14:31:44.313168Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 5} (132-132)
2025-10-10T14:31:44.300091Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.300094Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 77, partNo: 0, Offset: 76 is stored on disk
2025-10-10T14:31:44.300096Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.300100Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 78, partNo: 0, Offset: 77 is stored on disk
2025-10-10T14:31:44.313175Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Got ReadResponse, serverBytesSize = 29599, now ReadSizeBudget = 0, ReadSizeServerDelta = 494689
2025-10-10T14:31:44.300218Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.300231Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.300264Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 grpc read done: success# 1, data# { read_request { bytes_size: 23701 } }
2025-10-10T14:31:44.313199Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] In ContinueReadingDataImpl, ReadSizeBudget = 0, ReadSizeServerDelta = 494689
2025-10-10T14:31:44.300273Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 got read request: guid# 5f49a5f7-c1d86505-28a68ad8-8b67bcd
2025-10-10T14:31:44.300332Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.300346Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.300418Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.313211Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 148 to 148
2025-10-10T14:31:44.300468Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.313216Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.300476Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.313219Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 148
2025-10-10T14:31:44.300517Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.300783Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.300873Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.301191Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.301250Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.301320Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:44.301347Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:44.301349Z node 3 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2025-10-10T14:31:44.301350Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 73 EndOffset 73 newEndOffset 78 commitOffset 0 clientCommitOffset 0 cookie 16 readingFinished 0 firstRead 0
2025-10-10T14:31:44.313252Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (133-134)
>>> event from dataHandler: 2025-10-10T14:31:44.313537Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Returning serverBytesSize = 29599 to budget
2025-10-10T14:31:44.313543Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] In ContinueReadingDataImpl, ReadSizeBudget = 29599, ReadSizeServerDelta = 494689
2025-10-10T14:31:44.301355Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 73 endOffset 78
2025-10-10T14:31:44.301361Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 73, endOffset# 78, WTime# 1760106704297, sizeLag# 41809
2025-10-10T14:31:44.301363Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1TEvPartitionReady. Aval parts: 1
2025-10-10T14:31:44.313256Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 149 to 149
2025-10-10T14:31:44.301365Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 79 partNo 0
2025-10-10T14:31:44.301369Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 performing read request: guid# bc7549e2-b4a20ab2-1a5f1b9e-334d94c6, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 6, size# 50170, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-10T14:31:44.313585Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.301377Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 6 maxSize 50170 maxTimeLagMs 0 readTimestampMs 0 readOffset 73 EndOffset 78 ClientCommitOffset 0 committedOffset 0 Guid bc7549e2-b4a20ab2-1a5f1b9e-334d94c6
DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 Message { Data: ..13981 bytes.. Information: { Offset: 127 ProducerId: "src_id" SeqNo: 128 CreateTime: 2025-10-10T14:31:44.308000Z WriteTime: 2025-10-10T14:31:44.310000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:46198", "logtype": "unknown", "server": "ipv6:[::1]:46198" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..14091 bytes.. Information: { Offset: 128 ProducerId: "src_id" SeqNo: 129 CreateTime: 2025-10-10T14:31:44.309000Z WriteTime: 2025-10-10T14:31:44.310000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:46198", "logtype": "unknown", "server": "ipv6:[::1]:46198" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..14201 bytes.. Information: { Offset: 129 ProducerId: "src_id" SeqNo: 130 CreateTime: 2025-10-10T14:31:44.309000Z WriteTime: 2025-10-10T14:31:44.310000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:46198", "logtype": "unknown", "server": "ipv6:[::1]:46198" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..14311 bytes.. Information: { Offset: 130 ProducerId: "src_id" SeqNo: 131 CreateTime: 2025-10-10T14:31:44.309000Z WriteTime: 2025-10-10T14:31:44.310000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:46198", "logtype": "unknown", "server": "ipv6:[::1]:46198" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..14421 bytes.. Information: { Offset: 131 ProducerId: "src_id" SeqNo: 132 CreateTime: 2025-10-10T14:31:44.309000Z WriteTime: 2025-10-10T14:31:44.310000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:46198", "logtype": "unknown", "server": "ipv6:[::1]:46198" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..14531 bytes.. Information: { Offset: 132 ProducerId: "src_id" SeqNo: 133 CreateTime: 2025-10-10T14:31:44.309000Z WriteTime: 2025-10-10T14:31:44.310000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:46198", "logtype": "unknown", "server": "ipv6:[::1]:46198" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } }2025-10-10T14:31:44.301386Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 79 partNo 0 FormedBlobsCount 0 NewHead: Offset 78 PartNo 0 PackedSize 8737 count 1 nextOffset 79 batches 1
2025-10-10T14:31:44.313589Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 149
2025-10-10T14:31:44.301392Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 80 partNo 0
2025-10-10T14:31:44.301397Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 80 partNo 0 FormedBlobsCount 0 NewHead: Offset 78 PartNo 0 PackedSize 17552 count 2 nextOffset 80 batches 1
2025-10-10T14:31:44.301401Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 81 partNo 0
2025-10-10T14:31:44.313613Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-10T14:31:44.301407Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 81 partNo 0 FormedBlobsCount 0 NewHead: Offset 78 PartNo 0 PackedSize 26477 count 3 nextOffset 81 batches 1
2025-10-10T14:31:44.301409Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:44.313960Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (133-133)
2025-10-10T14:31:44.313682Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 150 to 150
2025-10-10T14:31:44.313615Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] The application data is transferred to the client. Number of messages 6, size 85536 bytes
2025-10-10T14:31:44.301463Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 78,3 HeadOffset 78 endOffset 78 curOffset 81 d0000000000_00000000000000000078_00000_0000000003_00000? size 26443 WTime 1760106704301
2025-10-10T14:31:44.301498Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:182: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:31:44.313985Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 1} (134-134)
2025-10-10T14:31:44.301510Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 147  requestId: <none> cookie: 74
2025-10-10T14:31:44.301524Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.313999Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Returning serverBytesSize = 0 to budget
2025-10-10T14:31:44.301527Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.301536Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 82 partNo : 0 messageNo: 163 size 8993 offset: -1
2025-10-10T14:31:44.313993Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.301542Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 151  requestId: <none> cookie: 75
2025-10-10T14:31:44.314012Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 150
2025-10-10T14:31:44.301542Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.301546Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.301547Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.301548Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.301551Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.301553Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 152  requestId: <none> cookie: 76
2025-10-10T14:31:44.301558Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 153  requestId: <none> cookie: 77
2025-10-10T14:31:44.301563Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 155  requestId: <none> cookie: 78
>>> event from dataHandler: 2025-10-10T14:31:44.301566Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.301568Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.301571Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.301573Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.301577Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.301578Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.301582Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 Message { Data: ..14641 bytes.. Information: { Offset: 133 ProducerId: "src_id" SeqNo: 134 CreateTime: 2025-10-10T14:31:44.309000Z WriteTime: 2025-10-10T14:31:44.311000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:46198", "server": "ipv6:[::1]:46198", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..14751 bytes.. Information: { Offset: 134 ProducerId: "src_id" SeqNo: 135 CreateTime: 2025-10-10T14:31:44.310000Z WriteTime: 2025-10-10T14:31:44.311000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:46198", "server": "ipv6:[::1]:46198", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } }
2025-10-10T14:31:44.301582Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.301583Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.301592Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.301594Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.301600Z node 3 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:31:44.314100Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] The application data is transferred to the client. Number of messages 2, size 29392 bytes
2025-10-10T14:31:44.314090Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 151 to 151
2025-10-10T14:31:44.314109Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Returning serverBytesSize = 0 to budget
2025-10-10T14:31:44.314109Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.314113Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 151
2025-10-10T14:31:44.301610Z node 3 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 78 partNo 0 count 3 size 26443
2025-10-10T14:31:44.301614Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.301620Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.301638Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.301642Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.314172Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 152 to 152
2025-10-10T14:31:44.301653Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 164  requestId: <none> cookie: 83
2025-10-10T14:31:44.301656Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 165  requestId: <none> cookie: 84
2025-10-10T14:31:44.301658Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 166  requestId: <none> cookie: 85
2025-10-10T14:31:44.314208Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.301661Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 167  requestId: <none> cookie: 86
2025-10-10T14:31:44.314211Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 152
2025-10-10T14:31:44.301663Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 168  requestId: <none> cookie: 87
2025-10-10T14:31:44.301679Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.301684Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 19 Topic 'rt3.dc1--test-topic' partition 0 user user offset 73 count 6 size 50170 endOffset 78 max time lag 0ms effective offset 73
2025-10-10T14:31:44.301686Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.301691Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.301695Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 19 added 1 blobs, size 41809 count 5 last offset 73, current partition end offset: 78
2025-10-10T14:31:44.301696Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.301697Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 19. Send blob request.
2025-10-10T14:31:44.301701Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.301703Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 73 partno 0 count 5 parts_count 0 source 1 size 41809 accessed 0 times before, last time 2025-10-10T14:31:44.000000Z
2025-10-10T14:31:44.301708Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.301711Z node 3 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 19. All 1 blobs are from cache.
2025-10-10T14:31:44.301719Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:31:44.301736Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 73 partno 0 count 5 parts 0 suffix '63'
2025-10-10T14:31:44.301773Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 73 totakecount 5 count 5 size 41787 from pos 0 cbcount 5
2025-10-10T14:31:44.301794Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 73
2025-10-10T14:31:44.301828Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.301834Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.301838Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.314269Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 153 to 153
2025-10-10T14:31:44.301842Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.301845Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.314275Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.314282Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 153
2025-10-10T14:31:44.301858Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.301861Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.301869Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 83 partNo : 0 messageNo: 169 size 9103 offset: -1
2025-10-10T14:31:44.301874Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.301874Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 78 Result { Offset: 73 Data: "... 8113 bytes ..." SourceId: "\000src_id" SeqNo: 74 WriteTimestampMS: 1760106704298 CreateTimestampMS: 1760106704297 UncompressedSize: 8041 PartitionKey: "" ExplicitHash: "" } Result { Offset: 74 Data: "... 8223 bytes ..." SourceId: "\000src_id" SeqNo: 75 WriteTimestampMS: 1760106704298 CreateTimestampMS: 1760106704297 UncompressedSize: 8151 PartitionKey: "" ExplicitHash: "" } Result { Offset: 75 Data: "... 8333 bytes ..." SourceId: "\000src_id" SeqNo: 76 WriteTimestampMS: 1760106704298 CreateTimestampMS: 1760106704297 UncompressedSize: 8261 PartitionKey: "" ExplicitHash: "" } Result { Offset: 76 Data: "... 8443 bytes ..." SourceId: "\000src_id" SeqNo: 77 WriteTimestampMS: 1760106704298 CreateTimestampMS: 1760106704297 UncompressedSize: 8371 PartitionKey: "" ExplicitHash: "" } Result { Offset: 77 Data: "... 8553 bytes ..." SourceId: "\000src_id" SeqNo: 78 WriteTimestampMS: 1760106704298 CreateTimestampMS: 1760106704297 UncompressedSize: 8481 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 18446744073709551550 RealReadOffset: 77 WaitQuotaTimeMs: 0 EndOffset: 78 StartOffset: 0 } Cookie: 73 }
2025-10-10T14:31:44.301875Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.314335Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 154 to 154
2025-10-10T14:31:44.301879Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 84 partNo : 0 messageNo: 170 size 9213 offset: -1
2025-10-10T14:31:44.301881Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.301882Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.301885Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 85 partNo : 0 messageNo: 171 size 9323 offset: -1
2025-10-10T14:31:44.314706Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.301888Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.314715Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 154
2025-10-10T14:31:44.301889Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.301892Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 86 partNo : 0 messageNo: 172 size 9433 offset: -1
2025-10-10T14:31:44.301895Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.301896Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.301901Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 87 partNo : 0 messageNo: 173 size 9543 offset: -1
2025-10-10T14:31:44.301905Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.301907Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.301910Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.301912Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.301915Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.301916Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.301918Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 17 from offset 78
2025-10-10T14:31:44.301919Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.301920Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.301923Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 78 ReadOffset 78 ReadGuid bc7549e2-b4a20ab2-1a5f1b9e-334d94c6 has messages 1
2025-10-10T14:31:44.301924Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.301926Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.301930Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.301938Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.301940Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.301940Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.301943Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.314777Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 155 to 155
2025-10-10T14:31:44.301945Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.314791Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.301947Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.314793Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 155
2025-10-10T14:31:44.301949Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.301952Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.301953Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.314801Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Got ReadResponse, serverBytesSize = 91171, now ReadSizeBudget = 0, ReadSizeServerDelta = 433117
2025-10-10T14:31:44.314808Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 156 to 156
2025-10-10T14:31:44.301956Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.301970Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 174  requestId: <none> cookie: 88
2025-10-10T14:31:44.314824Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.301975Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 175  requestId: <none> cookie: 89
2025-10-10T14:31:44.314825Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 156
2025-10-10T14:31:44.301977Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 176  requestId: <none> cookie: 90
2025-10-10T14:31:44.301980Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 177  requestId: <none> cookie: 91
2025-10-10T14:31:44.301982Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 178  requestId: <none> cookie: 92
2025-10-10T14:31:44.302000Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 read done: guid# bc7549e2-b4a20ab2-1a5f1b9e-334d94c6, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 41613
2025-10-10T14:31:44.314838Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] In ContinueReadingDataImpl, ReadSizeBudget = 0, ReadSizeServerDelta = 433117
2025-10-10T14:31:44.302004Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 response to read: guid# bc7549e2-b4a20ab2-1a5f1b9e-334d94c6
2025-10-10T14:31:44.302026Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.314874Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (135-140)
2025-10-10T14:31:44.302031Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.302034Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.315050Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 157 to 157
2025-10-10T14:31:44.315276Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Returning serverBytesSize = 91171 to budget
2025-10-10T14:31:44.315281Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] In ContinueReadingDataImpl, ReadSizeBudget = 91171, ReadSizeServerDelta = 433117
2025-10-10T14:31:44.315288Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.315293Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 157
2025-10-10T14:31:44.302038Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.302041Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.302045Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.302073Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.302078Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.302088Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.302099Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 Process answer. Aval parts: 0
2025-10-10T14:31:44.302100Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.302102Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.315333Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 158 to 158
2025-10-10T14:31:44.315340Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-10T14:31:44.302109Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 88 partNo : 0 messageNo: 179 size 9653 offset: -1
2025-10-10T14:31:44.315342Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.315346Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 158
2025-10-10T14:31:44.315351Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (135-135)
2025-10-10T14:31:44.302112Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.302113Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.315359Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 1} (136-136)
2025-10-10T14:31:44.302116Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 89 partNo : 0 messageNo: 180 size 9763 offset: -1
2025-10-10T14:31:44.302119Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.302121Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.302124Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 90 partNo : 0 messageNo: 181 size 9873 offset: -1
2025-10-10T14:31:44.302127Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.315378Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 2} (137-137)
2025-10-10T14:31:44.302128Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.302131Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 91 partNo : 0 messageNo: 182 size 9983 offset: -1
2025-10-10T14:31:44.302133Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.315382Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 159 to 159
2025-10-10T14:31:44.315382Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 3} (138-138)
2025-10-10T14:31:44.315439Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.315446Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 159
2025-10-10T14:31:44.315449Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 4} (139-139)
2025-10-10T14:31:44.302134Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.315471Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 5} (140-140)
2025-10-10T14:31:44.302137Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 92 partNo : 0 messageNo: 183 size 10093 offset: -1
2025-10-10T14:31:44.302139Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.302141Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.302143Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.302144Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.302147Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.302148Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.302234Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.302241Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.302243Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.302245Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.302247Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.302250Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.302252Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.315594Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 160 to 160
>>> event from dataHandler: 2025-10-10T14:31:44.315821Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.302253Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.315827Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 160
2025-10-10T14:31:44.302255Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.302258Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.302266Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 184  requestId: <none> cookie: 93
2025-10-10T14:31:44.302276Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 185  requestId: <none> cookie: 94
2025-10-10T14:31:44.302279Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 186  requestId: <none> cookie: 95
2025-10-10T14:31:44.302281Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.302286Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 Message { Data: ..14861 bytes.. Information: { Offset: 135 ProducerId: "src_id" SeqNo: 136 CreateTime: 2025-10-10T14:31:44.310000Z WriteTime: 2025-10-10T14:31:44.312000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "server": "ipv6:[::1]:46198", "_ip": "ipv6:[::1]:46198", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..14971 bytes.. Information: { Offset: 136 ProducerId: "src_id" SeqNo: 137 CreateTime: 2025-10-10T14:31:44.311000Z WriteTime: 2025-10-10T14:31:44.312000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "server": "ipv6:[::1]:46198", "_ip": "ipv6:[::1]:46198", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..15081 bytes.. Information: { Offset: 137 ProducerId: "src_id" SeqNo: 138 CreateTime: 2025-10-10T14:31:44.311000Z WriteTime: 2025-10-10T14:31:44.312000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "server": "ipv6:[::1]:46198", "_ip": "ipv6:[::1]:46198", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..15191 bytes.. Information: { Offset: 138 ProducerId: "src_id" SeqNo: 139 CreateTime: 2025-10-10T14:31:44.311000Z WriteTime: 2025-10-10T14:31:44.312000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "server": "ipv6:[::1]:46198", "_ip": "ipv6:[::1]:46198", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..15301 bytes.. Information: { Offset: 139 ProducerId: "src_id" SeqNo: 140 CreateTime: 2025-10-10T14:31:44.311000Z WriteTime: 2025-10-10T14:31:44.312000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "server": "ipv6:[::1]:46198", "_ip": "ipv6:[::1]:46198", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..15411 bytes.. Information: { Offset: 140 ProducerId: "src_id" SeqNo: 141 CreateTime: 2025-10-10T14:31:44.311000Z WriteTime: 2025-10-10T14:31:44.312000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "server": "ipv6:[::1]:46198", "_ip": "ipv6:[::1]:46198", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } }
2025-10-10T14:31:44.302289Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.302293Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.302314Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.302316Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.315886Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] The application data is transferred to the client. Number of messages 6, size 90816 bytes
2025-10-10T14:31:44.302322Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 93 partNo : 0 messageNo: 187 size 10203 offset: -1
2025-10-10T14:31:44.302326Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.315893Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Returning serverBytesSize = 0 to budget
2025-10-10T14:31:44.302328Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.316646Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Got ReadResponse, serverBytesSize = 111349, now ReadSizeBudget = 0, ReadSizeServerDelta = 412939
2025-10-10T14:31:44.302362Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.302363Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.302364Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.315907Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 161 to 161
2025-10-10T14:31:44.302369Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 94 partNo : 0 messageNo: 188 size 10313 offset: -1
2025-10-10T14:31:44.316667Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] In ContinueReadingDataImpl, ReadSizeBudget = 0, ReadSizeServerDelta = 412939
2025-10-10T14:31:44.302374Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.302375Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.302378Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 95 partNo : 0 messageNo: 189 size 10423 offset: -1
2025-10-10T14:31:44.316677Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.302382Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.316682Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 161
2025-10-10T14:31:44.302385Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.302388Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.302391Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.302392Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.302393Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.302396Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 190  requestId: <none> cookie: 96
2025-10-10T14:31:44.302407Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.302417Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.302430Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.302433Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.302442Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 96 partNo : 0 messageNo: 191 size 10533 offset: -1
2025-10-10T14:31:44.302447Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.302454Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.302479Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 grpc read done: success# 1, data# { read_request { bytes_size: 41613 } }
2025-10-10T14:31:44.316718Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (141-147)
2025-10-10T14:31:44.316735Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Returning serverBytesSize = 111349 to budget
2025-10-10T14:31:44.302495Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 got read request: guid# 133fde2d-e5d56ba9-56533e9-8a2fcab7
2025-10-10T14:31:44.302506Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.316741Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] In ContinueReadingDataImpl, ReadSizeBudget = 111349, ReadSizeServerDelta = 412939
2025-10-10T14:31:44.302517Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.302520Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.302528Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 192  requestId: <none> cookie: 97
2025-10-10T14:31:44.302536Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.302571Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.302573Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.302583Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 97 partNo : 0 messageNo: 193 size 10643 offset: -1
2025-10-10T14:31:44.302595Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 78 count 3 size 26443 actorID [3:7559600726884252064:2448]
2025-10-10T14:31:44.316758Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 162 to 162
2025-10-10T14:31:44.302611Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.302617Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.316764Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.302620Z node 3 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:31:44.316767Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 162
2025-10-10T14:31:44.302625Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 78 partno 0 count 3 parts 0 suffix '63' size 26443
2025-10-10T14:31:44.302633Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 26340 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:31:44.302642Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.302646Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 79, partNo: 0, Offset: 78 is stored on disk
2025-10-10T14:31:44.302648Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.316817Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-10T14:31:44.302651Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 80, partNo: 0, Offset: 79 is stored on disk
2025-10-10T14:31:44.302652Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.302655Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 81, partNo: 0, Offset: 80 is stored on disk
2025-10-10T14:31:44.302669Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.302672Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:44.302683Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:44.302684Z node 3 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (16)
2025-10-10T14:31:44.302694Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 82 partNo 0
2025-10-10T14:31:44.316989Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (141-141)
2025-10-10T14:31:44.302697Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.302714Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 78 EndOffset 78 newEndOffset 81 commitOffset 0 clientCommitOffset 0 cookie 17 readingFinished 0 firstRead 0
2025-10-10T14:31:44.302716Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 78 endOffset 81
2025-10-10T14:31:44.316998Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 1} (142-142)
2025-10-10T14:31:44.302720Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 82 partNo 0 FormedBlobsCount 0 NewHead: Offset 81 PartNo 0 PackedSize 9067 count 1 nextOffset 82 batches 1
2025-10-10T14:31:44.302723Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 78, endOffset# 81, WTime# 1760106704298, sizeLag# 26443
2025-10-10T14:31:44.302723Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 83 partNo 0
2025-10-10T14:31:44.317006Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 2} (143-143)
2025-10-10T14:31:44.302724Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1TEvPartitionReady. Aval parts: 1
2025-10-10T14:31:44.302726Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 83 partNo 0 FormedBlobsCount 0 NewHead: Offset 81 PartNo 0 PackedSize 18212 count 2 nextOffset 83 batches 1
2025-10-10T14:31:44.317013Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 3} (144-144)
2025-10-10T14:31:44.302728Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 84 partNo 0
2025-10-10T14:31:44.302731Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 performing read request: guid# b8a13272-7753334-45b6b27b-8a850940, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 3, size# 31731, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-10T14:31:44.302732Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 84 partNo 0 FormedBlobsCount 0 NewHead: Offset 81 PartNo 0 PackedSize 27467 count 3 nextOffset 84 batches 1
2025-10-10T14:31:44.302735Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 85 partNo 0
2025-10-10T14:31:44.302737Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.317025Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 4} (145-145)
2025-10-10T14:31:44.302738Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 85 partNo 0 FormedBlobsCount 0 NewHead: Offset 81 PartNo 0 PackedSize 36832 count 4 nextOffset 85 batches 1
2025-10-10T14:31:44.302740Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 86 partNo 0
2025-10-10T14:31:44.317030Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 5} (146-146)
2025-10-10T14:31:44.302743Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 86 partNo 0 FormedBlobsCount 0 NewHead: Offset 81 PartNo 0 PackedSize 46307 count 5 nextOffset 86 batches 1
2025-10-10T14:31:44.302748Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 87 partNo 0
2025-10-10T14:31:44.317035Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 6} (147-147)
2025-10-10T14:31:44.302753Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 87 partNo 0 FormedBlobsCount 0 NewHead: Offset 81 PartNo 0 PackedSize 55892 count 6 nextOffset 87 batches 1
2025-10-10T14:31:44.317037Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 163 to 163
>>> event from dataHandler: 2025-10-10T14:31:44.302756Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 88 partNo 0
2025-10-10T14:31:44.317663Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.317693Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 163
2025-10-10T14:31:44.302759Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 88 partNo 0 FormedBlobsCount 0 NewHead: Offset 81 PartNo 0 PackedSize 65587 count 7 nextOffset 88 batches 1
DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 Message { Data: ..15521 bytes.. Information: { Offset: 141 ProducerId: "src_id" SeqNo: 142 CreateTime: 2025-10-10T14:31:44.311000Z WriteTime: 2025-10-10T14:31:44.313000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:46198", "logtype": "unknown", "_ip": "ipv6:[::1]:46198" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..15631 bytes.. Information: { Offset: 142 ProducerId: "src_id" SeqNo: 143 CreateTime: 2025-10-10T14:31:44.312000Z WriteTime: 2025-10-10T14:31:44.313000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:46198", "logtype": "unknown", "_ip": "ipv6:[::1]:46198" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..15741 bytes.. Information: { Offset: 143 ProducerId: "src_id" SeqNo: 144 CreateTime: 2025-10-10T14:31:44.312000Z WriteTime: 2025-10-10T14:31:44.313000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:46198", "logtype": "unknown", "_ip": "ipv6:[::1]:46198" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..15851 bytes.. Information: { Offset: 144 ProducerId: "src_id" SeqNo: 145 CreateTime: 2025-10-10T14:31:44.312000Z WriteTime: 2025-10-10T14:31:44.313000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:46198", "logtype": "unknown", "_ip": "ipv6:[::1]:46198" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..15961 bytes.. Information: { Offset: 145 ProducerId: "src_id" SeqNo: 146 CreateTime: 2025-10-10T14:31:44.312000Z WriteTime: 2025-10-10T14:31:44.313000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:46198", "logtype": "unknown", "_ip": "ipv6:[::1]:46198" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..16071 bytes.. Information: { Offset: 146 ProducerId: "src_id" SeqNo: 147 CreateTime: 2025-10-10T14:31:44.312000Z WriteTime: 2025-10-10T14:31:44.313000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:46198", "logtype": "unknown", "_ip": "ipv6:[::1]:46198" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..16181 bytes.. Information: { Offset: 147 ProducerId: "src_id" SeqNo: 148 CreateTime: 2025-10-10T14:31:44.313000Z WriteTime: 2025-10-10T14:31:44.313000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:46198", "logtype": "unknown", "_ip": "ipv6:[::1]:46198" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } }
2025-10-10T14:31:44.302763Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 89 partNo 0
2025-10-10T14:31:44.302767Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 89 partNo 0 FormedBlobsCount 0 NewHead: Offset 81 PartNo 0 PackedSize 75392 count 8 nextOffset 89 batches 1
2025-10-10T14:31:44.317737Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] The application data is transferred to the client. Number of messages 7, size 110957 bytes
2025-10-10T14:31:44.302772Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 90 partNo 0
2025-10-10T14:31:44.317747Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Returning serverBytesSize = 0 to budget
2025-10-10T14:31:44.317747Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 164 to 164
2025-10-10T14:31:44.318154Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Got ReadResponse, serverBytesSize = 116757, now ReadSizeBudget = 0, ReadSizeServerDelta = 407531
2025-10-10T14:31:44.318161Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.318164Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 164
2025-10-10T14:31:44.302774Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.302777Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 90 partNo 0 FormedBlobsCount 0 NewHead: Offset 81 PartNo 0 PackedSize 85307 count 9 nextOffset 90 batches 1
2025-10-10T14:31:44.302780Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 91 partNo 0
2025-10-10T14:31:44.302783Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 3 maxSize 31731 maxTimeLagMs 0 readTimestampMs 0 readOffset 78 EndOffset 81 ClientCommitOffset 0 committedOffset 0 Guid b8a13272-7753334-45b6b27b-8a850940
2025-10-10T14:31:44.302784Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 91 partNo 0 FormedBlobsCount 0 NewHead: Offset 81 PartNo 0 PackedSize 95332 count 10 nextOffset 91 batches 1
2025-10-10T14:31:44.302788Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 92 partNo 0
2025-10-10T14:31:44.318177Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] In ContinueReadingDataImpl, ReadSizeBudget = 0, ReadSizeServerDelta = 407531
2025-10-10T14:31:44.302792Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 92 partNo 0 FormedBlobsCount 0 NewHead: Offset 81 PartNo 0 PackedSize 105467 count 11 nextOffset 92 batches 1
2025-10-10T14:31:44.302795Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 93 partNo 0
2025-10-10T14:31:44.302797Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 93 partNo 0 FormedBlobsCount 0 NewHead: Offset 81 PartNo 0 PackedSize 115712 count 12 nextOffset 93 batches 1
2025-10-10T14:31:44.302799Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 94 partNo 0
2025-10-10T14:31:44.302802Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 94 partNo 0 FormedBlobsCount 0 NewHead: Offset 81 PartNo 0 PackedSize 126067 count 13 nextOffset 94 batches 1
2025-10-10T14:31:44.302805Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 95 partNo 0
2025-10-10T14:31:44.302810Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 95 partNo 0 FormedBlobsCount 0 NewHead: Offset 81 PartNo 0 PackedSize 136532 count 14 nextOffset 95 batches 1
2025-10-10T14:31:44.302812Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 96 partNo 0
2025-10-10T14:31:44.318219Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 165 to 165
2025-10-10T14:31:44.318225Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (148-154)
2025-10-10T14:31:44.302814Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 96 partNo 0 FormedBlobsCount 0 NewHead: Offset 81 PartNo 0 PackedSize 147107 count 15 nextOffset 96 batches 1
2025-10-10T14:31:44.318229Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.302817Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 97 partNo 0
2025-10-10T14:31:44.318233Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 165
2025-10-10T14:31:44.302819Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 97 partNo 0 FormedBlobsCount 0 NewHead: Offset 81 PartNo 0 PackedSize 157792 count 16 nextOffset 97 batches 1
2025-10-10T14:31:44.318234Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Returning serverBytesSize = 116757 to budget
2025-10-10T14:31:44.302821Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:44.318248Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] In ContinueReadingDataImpl, ReadSizeBudget = 116757, ReadSizeServerDelta = 407531
2025-10-10T14:31:44.303102Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.303140Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.303151Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.303207Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.303355Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 81,16 HeadOffset 81 endOffset 81 curOffset 97 d0000000000_00000000000000000081_00000_0000000016_00000? size 157342 WTime 1760106704302
2025-10-10T14:31:44.303459Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:182: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:31:44.303471Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 158  requestId: <none> cookie: 79
2025-10-10T14:31:44.303486Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 159  requestId: <none> cookie: 80
2025-10-10T14:31:44.318308Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 166 to 166
2025-10-10T14:31:44.303490Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 161  requestId: <none> cookie: 81
2025-10-10T14:31:44.318406Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.318308Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-10T14:31:44.303493Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.318410Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 166
2025-10-10T14:31:44.303495Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.318425Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (148-148)
2025-10-10T14:31:44.303498Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.303501Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.303502Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.303504Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.303508Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.303511Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.303513Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.303518Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.318451Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 1} (149-149)
2025-10-10T14:31:44.303519Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.303523Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.303524Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.303527Z node 3 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:31:44.303535Z node 3 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 81 partNo 0 count 16 size 157342
2025-10-10T14:31:44.303566Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 194  requestId: <none> cookie: 98
2025-10-10T14:31:44.303574Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 195  requestId: <none> cookie: 99
2025-10-10T14:31:44.303581Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 196  requestId: <none> cookie: 100
2025-10-10T14:31:44.303583Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 197  requestId: <none> cookie: 101
2025-10-10T14:31:44.318484Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 2} (150-150)
2025-10-10T14:31:44.318479Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 167 to 167
2025-10-10T14:31:44.303587Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.318495Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 3} (151-151)
2025-10-10T14:31:44.303594Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.303598Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.318504Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.303601Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 20 Topic 'rt3.dc1--test-topic' partition 0 user user offset 78 count 3 size 31731 endOffset 81 max time lag 0ms effective offset 78
2025-10-10T14:31:44.318524Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 167
2025-10-10T14:31:44.303601Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.303605Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.303610Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 20 added 1 blobs, size 26443 count 3 last offset 78, current partition end offset: 81
2025-10-10T14:31:44.303613Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 20. Send blob request.
2025-10-10T14:31:44.303619Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 78 partno 0 count 3 parts_count 0 source 1 size 26443 accessed 0 times before, last time 2025-10-10T14:31:44.000000Z
2025-10-10T14:31:44.303622Z node 3 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 20. All 1 blobs are from cache.
2025-10-10T14:31:44.303628Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:31:44.303631Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.303653Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 78 totakecount 3 count 3 size 26421 from pos 0 cbcount 3
2025-10-10T14:31:44.303654Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 78 partno 0 count 3 parts 0 suffix '63'
2025-10-10T14:31:44.303665Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.303667Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.303673Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 98 partNo : 0 messageNo: 198 size 10753 offset: -1
2025-10-10T14:31:44.303677Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.303678Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.303681Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 99 partNo : 0 messageNo: 199 size 10863 offset: -1
2025-10-10T14:31:44.303687Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.318582Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 168 to 168
2025-10-10T14:31:44.318581Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 4} (152-152)
2025-10-10T14:31:44.303688Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.318970Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.303691Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 100 partNo : 0 messageNo: 200 size 10973 offset: -1
2025-10-10T14:31:44.318975Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 168
2025-10-10T14:31:44.318974Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 5} (153-153)
2025-10-10T14:31:44.303694Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.303696Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.318988Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 6} (154-154)
2025-10-10T14:31:44.303699Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 101 partNo : 0 messageNo: 201 size 11083 offset: -1
2025-10-10T14:31:44.303702Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.303704Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.303708Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 78
2025-10-10T14:31:44.303713Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.303717Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.303718Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.303719Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.303721Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.303722Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.303724Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.303725Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.303735Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 202  requestId: <none> cookie: 102
2025-10-10T14:31:44.303742Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.319058Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 169 to 169
2025-10-10T14:31:44.319064Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.319066Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 169
2025-10-10T14:31:44.319117Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 170 to 170
2025-10-10T14:31:44.319123Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.319125Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 170
>>> event from dataHandler: DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 Message { Data: ..16291 bytes.. Information: { Offset: 148 ProducerId: "src_id" SeqNo: 149 CreateTime: 2025-10-10T14:31:44.313000Z WriteTime: 2025-10-10T14:31:44.315000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:46198", "server": "ipv6:[::1]:46198" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..16401 bytes.. Information: { Offset: 149 ProducerId: "src_id" SeqNo: 150 CreateTime: 2025-10-10T14:31:44.313000Z WriteTime: 2025-10-10T14:31:44.315000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:46198", "server": "ipv6:[::1]:46198" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..16511 bytes.. Information: { Offset: 150 ProducerId: "src_id" SeqNo: 151 CreateTime: 2025-10-10T14:31:44.314000Z WriteTime: 2025-10-10T14:31:44.315000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:46198", "server": "ipv6:[::1]:46198" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..16621 bytes.. Information: { Offset: 151 ProducerId: "src_id" SeqNo: 152 CreateTime: 2025-10-10T14:31:44.314000Z WriteTime: 2025-10-10T14:31:44.315000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:46198", "server": "ipv6:[::1]:46198" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..16731 bytes.. Information: { Offset: 152 ProducerId: "src_id" SeqNo: 153 CreateTime: 2025-10-10T14:31:44.314000Z WriteTime: 2025-10-10T14:31:44.315000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:46198", "server": "ipv6:[::1]:46198" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..16841 bytes.. Information: { Offset: 153 ProducerId: "src_id" SeqNo: 154 CreateTime: 2025-10-10T14:31:44.314000Z WriteTime: 2025-10-10T14:31:44.315000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:46198", "server": "ipv6:[::1]:46198" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..16951 bytes.. Information: { Offset: 154 ProducerId: "src_id" SeqNo: 155 CreateTime: 2025-10-10T14:31:44.314000Z WriteTime: 2025-10-10T14:31:44.315000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:46198", "server": "ipv6:[::1]:46198" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } }
2025-10-10T14:31:44.319172Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 171 to 171
2025-10-10T14:31:44.303748Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.303787Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 81 Result { Offset: 78 Data: "... 8663 bytes ..." SourceId: "\000src_id" SeqNo: 79 WriteTimestampMS: 1760106704300 CreateTimestampMS: 1760106704298 UncompressedSize: 8591 PartitionKey: "" ExplicitHash: "" } Result { Offset: 79 Data: "... 8773 bytes ..." SourceId: "\000src_id" SeqNo: 80 WriteTimestampMS: 1760106704300 CreateTimestampMS: 1760106704299 UncompressedSize: 8701 PartitionKey: "" ExplicitHash: "" } Result { Offset: 80 Data: "... 8883 bytes ..." SourceId: "\000src_id" SeqNo: 81 WriteTimestampMS: 1760106704300 CreateTimestampMS: 1760106704299 UncompressedSize: 8811 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 18446744073709551614 RealReadOffset: 80 WaitQuotaTimeMs: 0 EndOffset: 81 StartOffset: 0 } Cookie: 78 }
2025-10-10T14:31:44.319517Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.319519Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] The application data is transferred to the client. Number of messages 7, size 116347 bytes
2025-10-10T14:31:44.303809Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 18 from offset 81
2025-10-10T14:31:44.319528Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 171
2025-10-10T14:31:44.303813Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 81 ReadOffset 81 ReadGuid b8a13272-7753334-45b6b27b-8a850940 has messages 1
2025-10-10T14:31:44.303827Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.319529Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Returning serverBytesSize = 0 to budget
2025-10-10T14:31:44.303828Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 read done: guid# b8a13272-7753334-45b6b27b-8a850940, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 26341
2025-10-10T14:31:44.303832Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 response to read: guid# b8a13272-7753334-45b6b27b-8a850940
2025-10-10T14:31:44.303839Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.303842Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.303848Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 102 partNo : 0 messageNo: 203 size 11193 offset: -1
2025-10-10T14:31:44.303857Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.303862Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.303866Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.303870Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.303872Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 Process answer. Aval parts: 0
2025-10-10T14:31:44.303875Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 204  requestId: <none> cookie: 103
2025-10-10T14:31:44.303882Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.303911Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.303913Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.303916Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 103 partNo : 0 messageNo: 205 size 11303 offset: -1
2025-10-10T14:31:44.303918Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.303921Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.303942Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.303990Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.304021Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.304022Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.304027Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 206  requestId: <none> cookie: 104
2025-10-10T14:31:44.304030Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.304032Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.304097Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.304110Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.304112Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.319633Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 172 to 172
2025-10-10T14:31:44.304121Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 104 partNo : 0 messageNo: 207 size 11413 offset: -1
2025-10-10T14:31:44.304124Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.304127Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.304129Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.304133Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.319640Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.320038Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 172
2025-10-10T14:31:44.319814Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Got ReadResponse, serverBytesSize = 86738, now ReadSizeBudget = 0, ReadSizeServerDelta = 437550
2025-10-10T14:31:44.304137Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 208  requestId: <none> cookie: 105
2025-10-10T14:31:44.304141Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.304143Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.320058Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] In ContinueReadingDataImpl, ReadSizeBudget = 0, ReadSizeServerDelta = 437550
2025-10-10T14:31:44.304182Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.304188Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.304190Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.304193Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 105 partNo : 0 messageNo: 209 size 11523 offset: -1
2025-10-10T14:31:44.304196Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.304197Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.304200Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.304202Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.304204Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 210  requestId: <none> cookie: 106
2025-10-10T14:31:44.304213Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.304228Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.304230Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.304234Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 106 partNo : 0 messageNo: 211 size 11633 offset: -1
2025-10-10T14:31:44.304317Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.304321Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.304326Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.320106Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (155-159)
2025-10-10T14:31:44.320114Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 173 to 173
2025-10-10T14:31:44.304353Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.320122Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.320124Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Returning serverBytesSize = 86738 to budget
2025-10-10T14:31:44.304364Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.320130Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] In ContinueReadingDataImpl, ReadSizeBudget = 86738, ReadSizeServerDelta = 437550
2025-10-10T14:31:44.304366Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.304371Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 212  requestId: <none> cookie: 107
2025-10-10T14:31:44.304380Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.320125Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 173
2025-10-10T14:31:44.304389Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.304390Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.304393Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 107 partNo : 0 messageNo: 213 size 11743 offset: -1
2025-10-10T14:31:44.304395Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.304397Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.304420Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.304434Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.304445Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.320168Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-10T14:31:44.304446Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.304447Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 grpc read done: success# 1, data# { read_request { bytes_size: 26341 } }
2025-10-10T14:31:44.320592Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (155-155)
2025-10-10T14:31:44.304449Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 214  requestId: <none> cookie: 108
2025-10-10T14:31:44.304453Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.304460Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 got read request: guid# f8da308-95b2f01f-5c0c4c4-4a053cc6
2025-10-10T14:31:44.320205Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 174 to 174
2025-10-10T14:31:44.304460Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.320606Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 1} (156-156)
2025-10-10T14:31:44.304461Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.304464Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 108 partNo : 0 messageNo: 215 size 11853 offset: -1
2025-10-10T14:31:44.304466Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.320615Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.304468Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.320620Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 2} (157-157)
2025-10-10T14:31:44.304692Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 81 count 16 size 157342 actorID [3:7559600726884252064:2448]
2025-10-10T14:31:44.304702Z node 3 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:31:44.304708Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 157200 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:31:44.320630Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 3} (158-158)
2025-10-10T14:31:44.304712Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.320620Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 174
2025-10-10T14:31:44.304715Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 82, partNo: 0, Offset: 81 is stored on disk
2025-10-10T14:31:44.304717Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.304720Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 83, partNo: 0, Offset: 82 is stored on disk
2025-10-10T14:31:44.304719Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 81 partno 0 count 16 parts 0 suffix '63' size 157342
2025-10-10T14:31:44.304721Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.304724Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 84, partNo: 0, Offset: 83 is stored on disk
2025-10-10T14:31:44.304725Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.320668Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 4} (159-159)
2025-10-10T14:31:44.304727Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 85, partNo: 0, Offset: 84 is stored on disk
2025-10-10T14:31:44.304729Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.304731Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 86, partNo: 0, Offset: 85 is stored on disk
2025-10-10T14:31:44.304733Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.304735Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 87, partNo: 0, Offset: 86 is stored on disk
2025-10-10T14:31:44.304737Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.304739Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 88, partNo: 0, Offset: 87 is stored on disk
2025-10-10T14:31:44.304744Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.304746Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.304747Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 89, partNo: 0, Offset: 88 is stored on disk
2025-10-10T14:31:44.304748Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.320705Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 175 to 175
2025-10-10T14:31:44.320715Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.320721Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 175
2025-10-10T14:31:44.304751Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 90, partNo: 0, Offset: 89 is stored on disk
2025-10-10T14:31:44.304752Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
>>> event from dataHandler: 2025-10-10T14:31:44.320757Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 176 to 176
2025-10-10T14:31:44.304755Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 91, partNo: 0, Offset: 90 is stored on disk
DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 Message { Data: ..17061 bytes.. Information: { Offset: 155 ProducerId: "src_id" SeqNo: 156 CreateTime: 2025-10-10T14:31:44.314000Z WriteTime: 2025-10-10T14:31:44.316000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:46198", "_ip": "ipv6:[::1]:46198" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..17171 bytes.. Information: { Offset: 156 ProducerId: "src_id" SeqNo: 157 CreateTime: 2025-10-10T14:31:44.315000Z WriteTime: 2025-10-10T14:31:44.316000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:46198", "_ip": "ipv6:[::1]:46198" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..17281 bytes.. Information: { Offset: 157 ProducerId: "src_id" SeqNo: 158 CreateTime: 2025-10-10T14:31:44.315000Z WriteTime: 2025-10-10T14:31:44.316000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:46198", "_ip": "ipv6:[::1]:46198" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..17391 bytes.. Information: { Offset: 158 ProducerId: "src_id" SeqNo: 159 CreateTime: 2025-10-10T14:31:44.315000Z WriteTime: 2025-10-10T14:31:44.316000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:46198", "_ip": "ipv6:[::1]:46198" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..17501 bytes.. Information: { Offset: 159 ProducerId: "src_id" SeqNo: 160 CreateTime: 2025-10-10T14:31:44.315000Z WriteTime: 2025-10-10T14:31:44.316000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:46198", "_ip": "ipv6:[::1]:46198" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } }2025-10-10T14:31:44.304756Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.304760Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 92, partNo: 0, Offset: 91 is stored on disk
2025-10-10T14:31:44.304761Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.321173Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.304765Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 93, partNo: 0, Offset: 92 is stored on disk
2025-10-10T14:31:44.321190Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 176
2025-10-10T14:31:44.304766Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.304770Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 94, partNo: 0, Offset: 93 is stored on disk
2025-10-10T14:31:44.304771Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.304773Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 95, partNo: 0, Offset: 94 is stored on disk
2025-10-10T14:31:44.321201Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] The application data is transferred to the client. Number of messages 5, size 86405 bytes
2025-10-10T14:31:44.304774Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.304777Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 96, partNo: 0, Offset: 95 is stored on disk
2025-10-10T14:31:44.304779Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.321200Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Got ReadResponse, serverBytesSize = 53416, now ReadSizeBudget = 0, ReadSizeServerDelta = 470872
2025-10-10T14:31:44.304782Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 97, partNo: 0, Offset: 96 is stored on disk
2025-10-10T14:31:44.304804Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:44.304811Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.304811Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:44.304813Z node 3 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (11)
2025-10-10T14:31:44.304821Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 98 partNo 0
2025-10-10T14:31:44.304833Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 98 partNo 0 FormedBlobsCount 0 NewHead: Offset 97 PartNo 0 PackedSize 10827 count 1 nextOffset 98 batches 1
2025-10-10T14:31:44.321245Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] In ContinueReadingDataImpl, ReadSizeBudget = 0, ReadSizeServerDelta = 470872
2025-10-10T14:31:44.321251Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] In ContinueReadingDataImpl, ReadSizeBudget = 0, ReadSizeServerDelta = 470872
2025-10-10T14:31:44.321259Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 177 to 177
2025-10-10T14:31:44.304836Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 99 partNo 0
2025-10-10T14:31:44.321730Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.321735Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 177
2025-10-10T14:31:44.304839Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 99 partNo 0 FormedBlobsCount 0 NewHead: Offset 97 PartNo 0 PackedSize 21732 count 2 nextOffset 99 batches 1
2025-10-10T14:31:44.321263Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Returning serverBytesSize = 0 to budget
2025-10-10T14:31:44.304841Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 100 partNo 0
2025-10-10T14:31:44.304844Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 100 partNo 0 FormedBlobsCount 0 NewHead: Offset 97 PartNo 0 PackedSize 32747 count 3 nextOffset 100 batches 1
2025-10-10T14:31:44.304849Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 101 partNo 0
2025-10-10T14:31:44.321749Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] In ContinueReadingDataImpl, ReadSizeBudget = 0, ReadSizeServerDelta = 470872
2025-10-10T14:31:44.321284Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (160-162)
2025-10-10T14:31:44.304853Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 101 partNo 0 FormedBlobsCount 0 NewHead: Offset 97 PartNo 0 PackedSize 43872 count 4 nextOffset 101 batches 1
2025-10-10T14:31:44.304856Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 102 partNo 0
2025-10-10T14:31:44.304861Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 102 partNo 0 FormedBlobsCount 0 NewHead: Offset 97 PartNo 0 PackedSize 55107 count 5 nextOffset 102 batches 1
2025-10-10T14:31:44.321771Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Returning serverBytesSize = 53416 to budget
2025-10-10T14:31:44.304864Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 103 partNo 0
2025-10-10T14:31:44.321777Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] In ContinueReadingDataImpl, ReadSizeBudget = 53416, ReadSizeServerDelta = 470872
2025-10-10T14:31:44.304865Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.304868Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 103 partNo 0 FormedBlobsCount 0 NewHead: Offset 97 PartNo 0 PackedSize 66452 count 6 nextOffset 103 batches 1
2025-10-10T14:31:44.304871Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 104 partNo 0
2025-10-10T14:31:44.304875Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 104 partNo 0 FormedBlobsCount 0 NewHead: Offset 97 PartNo 0 PackedSize 77907 count 7 nextOffset 104 batches 1
2025-10-10T14:31:44.304877Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 105 partNo 0
2025-10-10T14:31:44.304881Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.304881Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 105 partNo 0 FormedBlobsCount 0 NewHead: Offset 97 PartNo 0 PackedSize 89472 count 8 nextOffset 105 batches 1
2025-10-10T14:31:44.304884Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 106 partNo 0
2025-10-10T14:31:44.304889Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 106 partNo 0 FormedBlobsCount 0 NewHead: Offset 97 PartNo 0 PackedSize 101147 count 9 nextOffset 106 batches 1
2025-10-10T14:31:44.304892Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 81 EndOffset 81 newEndOffset 97 commitOffset 0 clientCommitOffset 0 cookie 18 readingFinished 0 firstRead 0
2025-10-10T14:31:44.304892Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 107 partNo 0
2025-10-10T14:31:44.304895Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 81 endOffset 97
2025-10-10T14:31:44.304895Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 107 partNo 0 FormedBlobsCount 0 NewHead: Offset 97 PartNo 0 PackedSize 112932 count 10 nextOffset 107 batches 1
2025-10-10T14:31:44.304897Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 108 partNo 0
2025-10-10T14:31:44.304899Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 108 partNo 0 FormedBlobsCount 0 NewHead: Offset 97 PartNo 0 PackedSize 124827 count 11 nextOffset 108 batches 1
2025-10-10T14:31:44.321821Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 178 to 178
2025-10-10T14:31:44.304901Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:44.304902Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 81, endOffset# 97, WTime# 1760106704300, sizeLag# 157342
2025-10-10T14:31:44.321840Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.304904Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1TEvPartitionReady. Aval parts: 1
2025-10-10T14:31:44.304911Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 performing read request: guid# 57bfd374-c13b0076-7f37d99b-36e5beb7, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 19, size# 188810, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-10T14:31:44.322110Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 178
2025-10-10T14:31:44.304922Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 19 maxSize 188810 maxTimeLagMs 0 readTimestampMs 0 readOffset 81 EndOffset 97 ClientCommitOffset 0 committedOffset 0 Guid 57bfd374-c13b0076-7f37d99b-36e5beb7
2025-10-10T14:31:44.321851Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-10T14:31:44.304956Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 97,11 HeadOffset 97 endOffset 97 curOffset 108 d0000000000_00000000000000000097_00000_0000000011_00000? size 124537 WTime 1760106704304
2025-10-10T14:31:44.305153Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.305189Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:182: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:31:44.322132Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (160-160)
2025-10-10T14:31:44.305198Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 163  requestId: <none> cookie: 82
2025-10-10T14:31:44.305203Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 169  requestId: <none> cookie: 83
2025-10-10T14:31:44.305206Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.305212Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 170  requestId: <none> cookie: 84
2025-10-10T14:31:44.305213Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.305216Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 171  requestId: <none> cookie: 85
2025-10-10T14:31:44.305219Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.305221Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 172  requestId: <none> cookie: 86
2025-10-10T14:31:44.305225Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 173  requestId: <none> cookie: 87
2025-10-10T14:31:44.322165Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 1} (161-161)
2025-10-10T14:31:44.305226Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.305229Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 179  requestId: <none> cookie: 88
2025-10-10T14:31:44.322179Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 2} (162-162)
2025-10-10T14:31:44.322180Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 179 to 179
2025-10-10T14:31:44.305233Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 180  requestId: <none> cookie: 89
2025-10-10T14:31:44.322190Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.305236Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.322193Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 179
2025-10-10T14:31:44.305238Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 181  requestId: <none> cookie: 90
2025-10-10T14:31:44.305243Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 182  requestId: <none> cookie: 91
2025-10-10T14:31:44.305243Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.305247Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 183  requestId: <none> cookie: 92
2025-10-10T14:31:44.305251Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 187  requestId: <none> cookie: 93
2025-10-10T14:31:44.305254Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 188  requestId: <none> cookie: 94
2025-10-10T14:31:44.305258Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 189  requestId: <none> cookie: 95
2025-10-10T14:31:44.305262Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 191  requestId: <none> cookie: 96
>>> event from dataHandler: 2025-10-10T14:31:44.305265Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 193  requestId: <none> cookie: 97
2025-10-10T14:31:44.305268Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.305271Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.305275Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.305276Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.305283Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.305285Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.305289Z node 3 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:31:44.305295Z node 3 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 97 partNo 0 count 11 size 124537
2025-10-10T14:31:44.305296Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.305299Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.322247Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 180 to 180
DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 Message { Data: ..17611 bytes.. Information: { Offset: 160 ProducerId: "src_id" SeqNo: 161 CreateTime: 2025-10-10T14:31:44.315000Z WriteTime: 2025-10-10T14:31:44.318000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:46198", "server": "ipv6:[::1]:46198", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..17721 bytes.. Information: { Offset: 161 ProducerId: "src_id" SeqNo: 162 CreateTime: 2025-10-10T14:31:44.316000Z WriteTime: 2025-10-10T14:31:44.318000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:46198", "server": "ipv6:[::1]:46198", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..17831 bytes.. Information: { Offset: 162 ProducerId: "src_id" SeqNo: 163 CreateTime: 2025-10-10T14:31:44.317000Z WriteTime: 2025-10-10T14:31:44.318000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:46198", "server": "ipv6:[::1]:46198", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } }
2025-10-10T14:31:44.322603Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.305300Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.322618Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 180
2025-10-10T14:31:44.305301Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.305306Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.305312Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.305324Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 216  requestId: <none> cookie: 109
2025-10-10T14:31:44.322629Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] The application data is transferred to the client. Number of messages 3, size 53163 bytes
2025-10-10T14:31:44.305344Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 217  requestId: <none> cookie: 110
2025-10-10T14:31:44.305364Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.305367Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 218  requestId: <none> cookie: 111
2025-10-10T14:31:44.322635Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Returning serverBytesSize = 0 to budget
2025-10-10T14:31:44.305369Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.305372Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 21 Topic 'rt3.dc1--test-topic' partition 0 user user offset 81 count 19 size 188810 endOffset 97 max time lag 0ms effective offset 81
2025-10-10T14:31:44.305373Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.305378Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.305383Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.305386Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 21 added 1 blobs, size 157342 count 16 last offset 81, current partition end offset: 97
2025-10-10T14:31:44.305387Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.305389Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 21. Send blob request.
2025-10-10T14:31:44.305391Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.305395Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 81 partno 0 count 16 parts_count 0 source 1 size 157342 accessed 0 times before, last time 2025-10-10T14:31:44.000000Z
2025-10-10T14:31:44.305399Z node 3 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 21. All 1 blobs are from cache.
2025-10-10T14:31:44.305405Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:31:44.305421Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 81 partno 0 count 16 parts 0 suffix '63'
2025-10-10T14:31:44.305465Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.305470Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.322695Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 181 to 181
2025-10-10T14:31:44.305503Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.305562Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 81 totakecount 16 count 16 size 157320 from pos 0 cbcount 16
2025-10-10T14:31:44.322701Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.305608Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 81
2025-10-10T14:31:44.322705Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 181
2025-10-10T14:31:44.305617Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.305618Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.305625Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 109 partNo : 0 messageNo: 219 size 11963 offset: -1
2025-10-10T14:31:44.305629Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.305630Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.305633Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 110 partNo : 0 messageNo: 220 size 12073 offset: -1
2025-10-10T14:31:44.305636Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.305638Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.305641Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 111 partNo : 0 messageNo: 221 size 12183 offset: -1
2025-10-10T14:31:44.305665Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.305669Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.305671Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.305673Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.305675Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.305676Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.305685Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.305718Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.305747Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.305749Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.305754Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 222  requestId: <none> cookie: 112
2025-10-10T14:31:44.305758Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.305766Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.305766Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 97 Result { Offset: 81 Data: "... 8993 bytes ..." SourceId: "\000src_id" SeqNo: 82 WriteTimestampMS: 1760106704302 CreateTimestampMS: 1760106704299 UncompressedSize: 8921 PartitionKey: "" ExplicitHash: "" } Result { Offset: 82 Data: "... 9103 bytes ..." SourceId: "\000src_id" SeqNo: 83 WriteTimestampMS: 1760106704302 CreateTimestampMS: 1760106704299 UncompressedSize: 9031 PartitionKey: "" ExplicitHash: "" } Result { Offset: 83 Data: "... 9213 bytes ..." SourceId: "\000src_id" SeqNo: 84 WriteTimestampMS: 1760106704302 CreateTimestampMS: 1760106704299 UncompressedSize: 9141 PartitionKey: "" ExplicitHash: "" } Result { Offset: 84 Data: "... 9323 bytes ..." SourceId: "\000src_id" SeqNo: 85 WriteTimestampMS: 1760106704302 CreateTimestampMS: 1760106704300 UncompressedSize: 9251 PartitionKey: "" ExplicitHash: "" } Result { Offset: 85 Data: "... 9433 bytes ..." SourceId: "\000src_id" SeqNo: 86 WriteTimestampMS: 1760106704302 CreateTimestampMS: 1760106704300 UncompressedSize: 9361 PartitionKey: "" ExplicitHash: "" } Result { Offset: 86 Data: "... 9543 bytes ..." SourceId: "\000src_id" SeqNo: 87 WriteTimestampMS: 1760106704302 CreateTimestampMS: 1760106704300 UncompressedSize: 9471 PartitionKey: "" ExplicitHash: "" } Result { Offset: 87 Data: "... 9653 bytes ..." SourceId: "\000src_id" SeqNo: 88 WriteTimestampMS: 1760106704302 CreateTimestampMS: 1760106704300 UncompressedSize: 9581 PartitionKey: "" ExplicitHash: "" } Result { Offset: 88 Data: "... 9763 bytes ..." SourceId: "\000src_id" SeqNo: 89 WriteTimestampMS: 1760106704302 CreateTimestampMS: 1760106704300 UncompressedSize: 9691 PartitionKey: "" ExplicitHash: "" } Result { Offset: 89 Data: "... 9873 bytes ..." SourceId: "\000src_id" SeqNo: 90 WriteTimestampMS: 1760106704302 CreateTimestampMS: 1760106704300 UncompressedSize: 9801 PartitionKey: "" ExplicitHash: "" } Result { Offset: 90 Data: "... 9983 bytes ..." SourceId: "\000src_id" SeqNo: 91 WriteTimestampMS: 1760106704302 CreateTimestampMS: 1760106704301 UncompressedSize: 9911 PartitionKey: "" ExplicitHash: "" } Result { Offset: 91 Data: "... 10093 bytes ..." SourceId: "\000src_id" SeqNo: 92 WriteTimestampMS: 1760106704302 CreateTimestampMS: 1760106704301 UncompressedSize: 10021 PartitionKey: "" ExplicitHash: "" } Result { Offset: 92 Data: "... 10203 bytes ..." SourceId: "\000src_id" SeqNo: 93 WriteTimestampMS: 1760106704302 CreateTimestampMS: 1760106704301 UncompressedSize: 10131 PartitionKey: "" ExplicitHash: "" } Result { Offset: 93 Data: "... 10313 bytes ..." SourceId: "\000src_id" SeqNo: 94 WriteTimestampMS: 1760106704302 CreateTimestampMS: 1760106704301 UncompressedSize: 10241 PartitionKey: "" ExplicitHash: "" } Result { Offset: 94 Data: "... 10423 bytes ..." SourceId: "\000src_id" SeqNo: 95 WriteTimestampMS: 1760106704302 CreateTimestampMS: 1760106704301 UncompressedSize: 10351 PartitionKey: "" ExplicitHash: "" } Result { Offset: 95 Data: "... 10533 bytes ..." SourceId: "\000src_id" SeqNo: 96 WriteTimestampMS: 1760106704302 CreateTimestampMS: 1760106704301 UncompressedSize: 10461 PartitionKey: "" ExplicitHash: "" } Result { Offset: 96 Data: "... 10643 bytes ..." SourceId: "\000src_id" SeqNo: 97 WriteTimestampMS: 1760106704302 CreateTimestampMS: 1760106704302 UncompressedSize: 10571 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 18446744073709551198 RealReadOffset: 96 WaitQuotaTimeMs: 0 EndOffset: 97 StartOffset: 0 } Cookie: 81 }
2025-10-10T14:31:44.305767Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.305770Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 112 partNo : 0 messageNo: 223 size 12293 offset: -1
2025-10-10T14:31:44.323276Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Got ReadResponse, serverBytesSize = 147061, now ReadSizeBudget = 0, ReadSizeServerDelta = 377227
2025-10-10T14:31:44.323700Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] In ContinueReadingDataImpl, ReadSizeBudget = 0, ReadSizeServerDelta = 377227
2025-10-10T14:31:44.305773Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.305774Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.305791Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.305802Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.305843Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.305844Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.323306Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 182 to 182
2025-10-10T14:31:44.305850Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 224  requestId: <none> cookie: 113
2025-10-10T14:31:44.305854Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 19 from offset 97
2025-10-10T14:31:44.305854Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.323751Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (163-170)
2025-10-10T14:31:44.305859Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 97 ReadOffset 97 ReadGuid 57bfd374-c13b0076-7f37d99b-36e5beb7 has messages 1
2025-10-10T14:31:44.323757Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.305862Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.323764Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 182
2025-10-10T14:31:44.305863Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.305866Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 113 partNo : 0 messageNo: 225 size 12403 offset: -1
2025-10-10T14:31:44.305868Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.305870Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.323765Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Returning serverBytesSize = 147061 to budget
2025-10-10T14:31:44.305885Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 read done: guid# 57bfd374-c13b0076-7f37d99b-36e5beb7, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 156629
2025-10-10T14:31:44.305892Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 response to read: guid# 57bfd374-c13b0076-7f37d99b-36e5beb7
2025-10-10T14:31:44.305987Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.306027Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.306039Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.323795Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] In ContinueReadingDataImpl, ReadSizeBudget = 147061, ReadSizeServerDelta = 377227
2025-10-10T14:31:44.306039Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 Process answer. Aval parts: 0
2025-10-10T14:31:44.306042Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.306056Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 226  requestId: <none> cookie: 114
2025-10-10T14:31:44.306064Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.306082Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.306085Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.306092Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 114 partNo : 0 messageNo: 227 size 12513 offset: -1
2025-10-10T14:31:44.306096Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.306100Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.306401Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 97 count 11 size 124537 actorID [3:7559600726884252064:2448]
2025-10-10T14:31:44.306415Z node 3 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:31:44.323846Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 183 to 183
2025-10-10T14:31:44.306417Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.306421Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 124410 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:31:44.323852Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.306424Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.306427Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 98, partNo: 0, Offset: 97 is stored on disk
2025-10-10T14:31:44.306429Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.306432Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 99, partNo: 0, Offset: 98 is stored on disk
2025-10-10T14:31:44.306433Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.323855Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 183
2025-10-10T14:31:44.323897Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-10T14:31:44.306435Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 100, partNo: 0, Offset: 99 is stored on disk
2025-10-10T14:31:44.306437Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.306437Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 97 partno 0 count 11 parts 0 suffix '63' size 124537
2025-10-10T14:31:44.306439Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 101, partNo: 0, Offset: 100 is stored on disk
2025-10-10T14:31:44.306440Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.306443Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 102, partNo: 0, Offset: 101 is stored on disk
2025-10-10T14:31:44.306444Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.306447Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 103, partNo: 0, Offset: 102 is stored on disk
2025-10-10T14:31:44.324154Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (163-163)
2025-10-10T14:31:44.306448Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.324162Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 184 to 184
2025-10-10T14:31:44.306450Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 104, partNo: 0, Offset: 103 is stored on disk
2025-10-10T14:31:44.324167Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 1} (164-164)
2025-10-10T14:31:44.306452Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.324170Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.306456Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 105, partNo: 0, Offset: 104 is stored on disk
2025-10-10T14:31:44.324179Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 2} (165-165)
2025-10-10T14:31:44.306457Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.324184Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 3} (166-166)
2025-10-10T14:31:44.306461Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 106, partNo: 0, Offset: 105 is stored on disk
2025-10-10T14:31:44.324174Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 184
2025-10-10T14:31:44.306461Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.306462Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.306465Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 107, partNo: 0, Offset: 106 is stored on disk
2025-10-10T14:31:44.324197Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 4} (167-167)
2025-10-10T14:31:44.306466Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.306469Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 108, partNo: 0, Offset: 107 is stored on disk
2025-10-10T14:31:44.324202Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 5} (168-168)
2025-10-10T14:31:44.306482Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:44.324206Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 185 to 185
2025-10-10T14:31:44.324207Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 6} (169-169)
2025-10-10T14:31:44.306485Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.306487Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:44.306488Z node 3 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (6)
2025-10-10T14:31:44.306496Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 109 partNo 0
2025-10-10T14:31:44.306509Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.324225Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.306509Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 109 partNo 0 FormedBlobsCount 0 NewHead: Offset 108 PartNo 0 PackedSize 12037 count 1 nextOffset 109 batches 1
2025-10-10T14:31:44.324228Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 185
2025-10-10T14:31:44.306513Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 110 partNo 0
2025-10-10T14:31:44.306516Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 110 partNo 0 FormedBlobsCount 0 NewHead: Offset 108 PartNo 0 PackedSize 24152 count 2 nextOffset 110 batches 1
2025-10-10T14:31:44.306518Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 111 partNo 0
2025-10-10T14:31:44.324231Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 7} (170-170)
2025-10-10T14:31:44.324301Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Got ReadResponse, serverBytesSize = 95538, now ReadSizeBudget = 0, ReadSizeServerDelta = 428750
2025-10-10T14:31:44.306521Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 111 partNo 0 FormedBlobsCount 0 NewHead: Offset 108 PartNo 0 PackedSize 36377 count 3 nextOffset 111 batches 1
2025-10-10T14:31:44.306522Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 112 partNo 0
2025-10-10T14:31:44.306525Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 97 EndOffset 97 newEndOffset 108 commitOffset 0 clientCommitOffset 0 cookie 19 readingFinished 0 firstRead 0
2025-10-10T14:31:44.306527Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 112 partNo 0 FormedBlobsCount 0 NewHead: Offset 108 PartNo 0 PackedSize 48712 count 4 nextOffset 112 batches 1
2025-10-10T14:31:44.324805Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] In ContinueReadingDataImpl, ReadSizeBudget = 0, ReadSizeServerDelta = 428750
2025-10-10T14:31:44.306529Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 113 partNo 0
2025-10-10T14:31:44.306529Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 97 endOffset 108
2025-10-10T14:31:44.306531Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 113 partNo 0 FormedBlobsCount 0 NewHead: Offset 108 PartNo 0 PackedSize 61157 count 5 nextOffset 113 batches 1
2025-10-10T14:31:44.306533Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 114 partNo 0
2025-10-10T14:31:44.306537Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 97, endOffset# 108, WTime# 1760106704302, sizeLag# 124537
2025-10-10T14:31:44.306537Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 114 partNo 0 FormedBlobsCount 0 NewHead: Offset 108 PartNo 0 PackedSize 73712 count 6 nextOffset 114 batches 1
2025-10-10T14:31:44.306539Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:44.306539Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1TEvPartitionReady. Aval parts: 1
2025-10-10T14:31:44.306547Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 performing read request: guid# cf678026-49b666df-efd0a5-a0c9544e, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 13, size# 149444, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-10T14:31:44.306555Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 13 maxSize 149444 maxTimeLagMs 0 readTimestampMs 0 readOffset 97 EndOffset 108 ClientCommitOffset 0 committedOffset 0 Guid cf678026-49b666df-efd0a5-a0c9544e
2025-10-10T14:31:44.324839Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (171-175)
2025-10-10T14:31:44.306581Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 108,6 HeadOffset 108 endOffset 108 curOffset 114 d0000000000_00000000000000000108_00000_0000000006_00000? size 73582 WTime 1760106704306
2025-10-10T14:31:44.324853Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Returning serverBytesSize = 95538 to budget
2025-10-10T14:31:44.306658Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:182: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:31:44.306664Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 198  requestId: <none> cookie: 98
2025-10-10T14:31:44.306676Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 199  requestId: <none> cookie: 99
2025-10-10T14:31:44.306680Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 200  requestId: <none> cookie: 100
2025-10-10T14:31:44.324867Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] In ContinueReadingDataImpl, ReadSizeBudget = 95538, ReadSizeServerDelta = 428750
2025-10-10T14:31:44.306682Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.306683Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 201  requestId: <none> cookie: 101
2025-10-10T14:31:44.306686Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 203  requestId: <none> cookie: 102
>>> event from dataHandler: 2025-10-10T14:31:44.324882Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 186 to 186
2025-10-10T14:31:44.306689Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.324894Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.306690Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 205  requestId: <none> cookie: 103
2025-10-10T14:31:44.306694Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 207  requestId: <none> cookie: 104
2025-10-10T14:31:44.306697Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 209  requestId: <none> cookie: 105
2025-10-10T14:31:44.306698Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.306700Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 211  requestId: <none> cookie: 106
2025-10-10T14:31:44.324898Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 186
DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 Message { Data: ..17941 bytes.. Information: { Offset: 163 ProducerId: "src_id" SeqNo: 164 CreateTime: 2025-10-10T14:31:44.317000Z WriteTime: 2025-10-10T14:31:44.319000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:46198", "_ip": "ipv6:[::1]:46198", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..18051 bytes.. Information: { Offset: 164 ProducerId: "src_id" SeqNo: 165 CreateTime: 2025-10-10T14:31:44.318000Z WriteTime: 2025-10-10T14:31:44.319000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:46198", "_ip": "ipv6:[::1]:46198", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..18161 bytes.. Information: { Offset: 165 ProducerId: "src_id" SeqNo: 166 CreateTime: 2025-10-10T14:31:44.318000Z WriteTime: 2025-10-10T14:31:44.319000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:46198", "_ip": "ipv6:[::1]:46198", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..18271 bytes.. Information: { Offset: 166 ProducerId: "src_id" SeqNo: 167 CreateTime: 2025-10-10T14:31:44.318000Z WriteTime: 2025-10-10T14:31:44.319000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:46198", "_ip": "ipv6:[::1]:46198", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..18381 bytes.. Information: { Offset: 167 ProducerId: "src_id" SeqNo: 168 CreateTime: 2025-10-10T14:31:44.318000Z WriteTime: 2025-10-10T14:31:44.319000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:46198", "_ip": "ipv6:[::1]:46198", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..18491 bytes.. Information: { Offset: 168 ProducerId: "src_id" SeqNo: 169 CreateTime: 2025-10-10T14:31:44.319000Z WriteTime: 2025-10-10T14:31:44.319000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:46198", "_ip": "ipv6:[::1]:46198", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..18601 bytes.. Information: { Offset: 169 ProducerId: "src_id" SeqNo: 170 CreateTime: 2025-10-10T14:31:44.319000Z WriteTime: 2025-10-10T14:31:44.319000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:46198", "_ip": "ipv6:[::1]:46198", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..18711 bytes.. Information: { Offset: 170 ProducerId: "src_id" SeqNo: 171 CreateTime: 2025-10-10T14:31:44.319000Z WriteTime: 2025-10-10T14:31:44.319000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:46198", "_ip": "ipv6:[::1]:46198", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } }
2025-10-10T14:31:44.325015Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-10T14:31:44.325507Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Got ReadResponse, serverBytesSize = 78437, now ReadSizeBudget = 0, ReadSizeServerDelta = 445851
2025-10-10T14:31:44.306703Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 213  requestId: <none> cookie: 107
2025-10-10T14:31:44.325525Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] The application data is transferred to the client. Number of messages 8, size 146608 bytes
2025-10-10T14:31:44.306703Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.306706Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 215  requestId: <none> cookie: 108
2025-10-10T14:31:44.325528Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (171-171)
2025-10-10T14:31:44.325559Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 187 to 187
2025-10-10T14:31:44.306708Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.306709Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.306711Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.306716Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.326072Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 1} (172-172)
2025-10-10T14:31:44.306717Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.306718Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.306725Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.326074Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.306727Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.306731Z node 3 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:31:44.306737Z node 3 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 108 partNo 0 count 6 size 73582
2025-10-10T14:31:44.306758Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 228  requestId: <none> cookie: 115
2025-10-10T14:31:44.326094Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 187
2025-10-10T14:31:44.306760Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 229  requestId: <none> cookie: 116
2025-10-10T14:31:44.326107Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 2} (173-173)
2025-10-10T14:31:44.306761Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.326118Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 3} (174-174)
2025-10-10T14:31:44.306765Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.306770Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.306774Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.306777Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 22 Topic 'rt3.dc1--test-topic' partition 0 user user offset 97 count 13 size 149444 endOffset 108 max time lag 0ms effective offset 97
2025-10-10T14:31:44.306780Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.306785Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 22 added 1 blobs, size 124537 count 11 last offset 97, current partition end offset: 108
2025-10-10T14:31:44.306785Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.306787Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 22. Send blob request.
2025-10-10T14:31:44.306792Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 97 partno 0 count 11 parts_count 0 source 1 size 124537 accessed 0 times before, last time 2025-10-10T14:31:44.000000Z
2025-10-10T14:31:44.306795Z node 3 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 22. All 1 blobs are from cache.
2025-10-10T14:31:44.306800Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:31:44.306811Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 97 partno 0 count 11 parts 0 suffix '63'
2025-10-10T14:31:44.306843Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.306847Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.306850Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.306948Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.307021Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.307038Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 grpc read done: success# 1, data# { read_request { bytes_size: 156629 } }
2025-10-10T14:31:44.307048Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 got read request: guid# b78739ae-d826b973-2f975a1b-a823fbe
2025-10-10T14:31:44.307053Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 97 totakecount 11 count 11 size 124515 from pos 0 cbcount 11
2025-10-10T14:31:44.307070Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.326190Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 4} (175-175)
2025-10-10T14:31:44.307072Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.307077Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 115 partNo : 0 messageNo: 230 size 12623 offset: -1
2025-10-10T14:31:44.326202Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 188 to 188
2025-10-10T14:31:44.307081Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.326210Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.307082Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.326214Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 188
2025-10-10T14:31:44.307085Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 116 partNo : 0 messageNo: 231 size 12733 offset: -1
2025-10-10T14:31:44.326218Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] In ContinueReadingDataImpl, ReadSizeBudget = 0, ReadSizeServerDelta = 445851
2025-10-10T14:31:44.307089Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.307091Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.307094Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.326235Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] In ContinueReadingDataImpl, ReadSizeBudget = 0, ReadSizeServerDelta = 445851
2025-10-10T14:31:44.307095Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.307102Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 97
2025-10-10T14:31:44.326252Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Returning serverBytesSize = 0 to budget
2025-10-10T14:31:44.307109Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.326254Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] In ContinueReadingDataImpl, ReadSizeBudget = 0, ReadSizeServerDelta = 445851
2025-10-10T14:31:44.307114Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.307116Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.307118Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.307152Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 232  requestId: <none> cookie: 117
2025-10-10T14:31:44.326269Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (176-179)
2025-10-10T14:31:44.307155Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 233  requestId: <none> cookie: 118
2025-10-10T14:31:44.307164Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.307171Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.326282Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 189 to 189
2025-10-10T14:31:44.307175Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.307207Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.326281Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Returning serverBytesSize = 78437 to budget
2025-10-10T14:31:44.307219Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.326293Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.307222Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.326297Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] In ContinueReadingDataImpl, ReadSizeBudget = 78437, ReadSizeServerDelta = 445851
2025-10-10T14:31:44.307227Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 108 Result { Offset: 97 Data: "... 10753 bytes ..." SourceId: "\000src_id" SeqNo: 98 WriteTimestampMS: 1760106704304 CreateTimestampMS: 1760106704302 UncompressedSize: 10681 PartitionKey: "" ExplicitHash: "" } Result { Offset: 98 Data: "... 10863 bytes ..." SourceId: "\000src_id" SeqNo: 99 WriteTimestampMS: 1760106704304 CreateTimestampMS: 1760106704302 UncompressedSize: 10791 PartitionKey: "" ExplicitHash: "" } Result { Offset: 99 Data: "... 10973 bytes ..." SourceId: "\000src_id" SeqNo: 100 WriteTimestampMS: 1760106704304 CreateTimestampMS: 1760106704302 UncompressedSize: 10901 PartitionKey: "" ExplicitHash: "" } Result { Offset: 100 Data: "... 11083 bytes ..." SourceId: "\000src_id" SeqNo: 101 WriteTimestampMS: 1760106704304 CreateTimestampMS: 1760106704303 UncompressedSize: 11011 PartitionKey: "" ExplicitHash: "" } Result { Offset: 101 Data: "... 11193 bytes ..." SourceId: "\000src_id" SeqNo: 102 WriteTimestampMS: 1760106704304 CreateTimestampMS: 1760106704303 UncompressedSize: 11121 PartitionKey: "" ExplicitHash: "" } Result { Offset: 102 Data: "... 11303 bytes ..." SourceId: "\000src_id" SeqNo: 103 WriteTimestampMS: 1760106704304 CreateTimestampMS: 1760106704303 UncompressedSize: 11231 PartitionKey: "" ExplicitHash: "" } Result { Offset: 103 Data: "... 11413 bytes ..." SourceId: "\000src_id" SeqNo: 104 WriteTimestampMS: 1760106704304 CreateTimestampMS: 1760106704303 UncompressedSize: 11341 PartitionKey: "" ExplicitHash: "" } Result { Offset: 104 Data: "... 11523 bytes ..." SourceId: "\000src_id" SeqNo: 105 WriteTimestampMS: 1760106704304 CreateTimestampMS: 1760106704303 UncompressedSize: 11451 PartitionKey: "" ExplicitHash: "" } Result { Offset: 105 Data: "... 11633 bytes ..." SourceId: "\000src_id" SeqNo: 106 WriteTimestampMS: 1760106704304 CreateTimestampMS: 1760106704303 UncompressedSize: 11561 PartitionKey: "" ExplicitHash: "" } Result { Offset: 106 Data: "... 11743 bytes ..." SourceId: "\000src_id" SeqNo: 107 WriteTimestampMS: 1760106704304 CreateTimestampMS: 1760106704304 UncompressedSize: 11671 PartitionKey: "" ExplicitHash: "" } Result { Offset: 107 Data: "... 11853 bytes ..." SourceId: "\000src_id" SeqNo: 108 WriteTimestampMS: 1760106704304 CreateTimestampMS: 1760106704304 UncompressedSize: 11781 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 18446744073709551358 RealReadOffset: 107 WaitQuotaTimeMs: 0 EndOffset: 108 StartOffset: 0 } Cookie: 97 }
2025-10-10T14:31:44.326297Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 189
2025-10-10T14:31:44.307228Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 117 partNo : 0 messageNo: 234 size 12843 offset: -1
2025-10-10T14:31:44.307232Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.326379Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
>>> event from dataHandler: 2025-10-10T14:31:44.307235Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.327003Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (176-176)
2025-10-10T14:31:44.326975Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Got ReadResponse, serverBytesSize = 39945, now ReadSizeBudget = 0, ReadSizeServerDelta = 484343
2025-10-10T14:31:44.307239Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 118 partNo : 0 messageNo: 235 size 12953 offset: -1
2025-10-10T14:31:44.307243Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 Message { Data: ..18821 bytes.. Information: { Offset: 171 ProducerId: "src_id" SeqNo: 172 CreateTime: 2025-10-10T14:31:44.319000Z WriteTime: 2025-10-10T14:31:44.321000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:46198", "server": "ipv6:[::1]:46198" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..18931 bytes.. Information: { Offset: 172 ProducerId: "src_id" SeqNo: 173 CreateTime: 2025-10-10T14:31:44.320000Z WriteTime: 2025-10-10T14:31:44.321000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:46198", "server": "ipv6:[::1]:46198" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..19041 bytes.. Information: { Offset: 173 ProducerId: "src_id" SeqNo: 174 CreateTime: 2025-10-10T14:31:44.320000Z WriteTime: 2025-10-10T14:31:44.321000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:46198", "server": "ipv6:[::1]:46198" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..19151 bytes.. Information: { Offset: 174 ProducerId: "src_id" SeqNo: 175 CreateTime: 2025-10-10T14:31:44.320000Z WriteTime: 2025-10-10T14:31:44.321000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:46198", "server": "ipv6:[::1]:46198" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..19261 bytes.. Information: { Offset: 175 ProducerId: "src_id" SeqNo: 176 CreateTime: 2025-10-10T14:31:44.320000Z WriteTime: 2025-10-10T14:31:44.321000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:46198", "server": "ipv6:[::1]:46198" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } }
2025-10-10T14:31:44.307245Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.307284Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 20 from offset 108
2025-10-10T14:31:44.327046Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 1} (177-177)
2025-10-10T14:31:44.307288Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 108 ReadOffset 108 ReadGuid cf678026-49b666df-efd0a5-a0c9544e has messages 1
2025-10-10T14:31:44.307305Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.327035Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 190 to 190
2025-10-10T14:31:44.307317Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.327053Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] The application data is transferred to the client. Number of messages 5, size 95205 bytes
2025-10-10T14:31:44.307320Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.327062Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.307321Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.327065Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 190
2025-10-10T14:31:44.307323Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.307327Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.307328Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 236  requestId: <none> cookie: 119
2025-10-10T14:31:44.307335Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.327079Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 2} (178-178)
2025-10-10T14:31:44.307348Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.307349Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 read done: guid# cf678026-49b666df-efd0a5-a0c9544e, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 124059
2025-10-10T14:31:44.327085Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 3} (179-179)
2025-10-10T14:31:44.307352Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.307353Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 response to read: guid# cf678026-49b666df-efd0a5-a0c9544e
2025-10-10T14:31:44.307358Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.307359Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.307370Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 119 partNo : 0 messageNo: 238 size 13063 offset: -1
2025-10-10T14:31:44.327106Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] In ContinueReadingDataImpl, ReadSizeBudget = 0, ReadSizeServerDelta = 484343
2025-10-10T14:31:44.327451Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] In ContinueReadingDataImpl, ReadSizeBudget = 0, ReadSizeServerDelta = 484343
2025-10-10T14:31:44.327119Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 191 to 191
2025-10-10T14:31:44.307380Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.327476Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.327458Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Returning serverBytesSize = 0 to budget
2025-10-10T14:31:44.327480Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 191
2025-10-10T14:31:44.327482Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] In ContinueReadingDataImpl, ReadSizeBudget = 0, ReadSizeServerDelta = 484343
2025-10-10T14:31:44.307388Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.307392Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 237  requestId: <none> cookie: 120
2025-10-10T14:31:44.307398Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.307400Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.307422Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.307428Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.307430Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.307434Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 120 partNo : 0 messageNo: 239 size 13173 offset: -1
2025-10-10T14:31:44.307437Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.307439Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.307442Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.307444Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
>>> event from dataHandler: 2025-10-10T14:31:44.307448Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 240  requestId: <none> cookie: 121
2025-10-10T14:31:44.327529Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (180-181)
DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 Message { Data: ..19371 bytes.. Information: { Offset: 176 ProducerId: "src_id" SeqNo: 177 CreateTime: 2025-10-10T14:31:44.321000Z WriteTime: 2025-10-10T14:31:44.322000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:46198", "server": "ipv6:[::1]:46198" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..19481 bytes.. Information: { Offset: 177 ProducerId: "src_id" SeqNo: 178 CreateTime: 2025-10-10T14:31:44.321000Z WriteTime: 2025-10-10T14:31:44.322000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:46198", "server": "ipv6:[::1]:46198" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..19591 bytes.. Information: { Offset: 178 ProducerId: "src_id" SeqNo: 179 CreateTime: 2025-10-10T14:31:44.322000Z WriteTime: 2025-10-10T14:31:44.322000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:46198", "server": "ipv6:[::1]:46198" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..19701 bytes.. Information: { Offset: 179 ProducerId: "src_id" SeqNo: 180 CreateTime: 2025-10-10T14:31:44.322000Z WriteTime: 2025-10-10T14:31:44.322000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:46198", "server": "ipv6:[::1]:46198" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } }
2025-10-10T14:31:44.327554Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 192 to 192
2025-10-10T14:31:44.327560Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.307453Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.327563Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 192
2025-10-10T14:31:44.327564Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] The application data is transferred to the client. Number of messages 4, size 78144 bytes
2025-10-10T14:31:44.307463Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.307464Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.307467Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 Process answer. Aval parts: 0
2025-10-10T14:31:44.307468Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 121 partNo : 0 messageNo: 241 size 13283 offset: -1
2025-10-10T14:31:44.307471Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.327535Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Got ReadResponse, serverBytesSize = 60676, now ReadSizeBudget = 0, ReadSizeServerDelta = 423667
2025-10-10T14:31:44.307473Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.307560Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.327610Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] In ContinueReadingDataImpl, ReadSizeBudget = 0, ReadSizeServerDelta = 423667
2025-10-10T14:31:44.307602Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.307615Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.307618Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.307625Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 242  requestId: <none> cookie: 122
2025-10-10T14:31:44.327985Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Returning serverBytesSize = 39945 to budget
2025-10-10T14:31:44.307635Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.327620Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 193 to 193
2025-10-10T14:31:44.327994Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] In ContinueReadingDataImpl, ReadSizeBudget = 39945, ReadSizeServerDelta = 423667
2025-10-10T14:31:44.307644Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.307645Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.307650Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 122 partNo : 0 messageNo: 243 size 13393 offset: -1
2025-10-10T14:31:44.328009Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.307653Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.328014Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 193
2025-10-10T14:31:44.307657Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.307722Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 108 count 6 size 73582 actorID [3:7559600726884252064:2448]
2025-10-10T14:31:44.307733Z node 3 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:31:44.307738Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 73470 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:31:44.307741Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.307744Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 109, partNo: 0, Offset: 108 is stored on disk
2025-10-10T14:31:44.328031Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (182-184)
2025-10-10T14:31:44.307745Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 108 partno 0 count 6 parts 0 suffix '63' size 73582
2025-10-10T14:31:44.307746Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.307748Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 110, partNo: 0, Offset: 109 is stored on disk
2025-10-10T14:31:44.307750Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.307752Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 111, partNo: 0, Offset: 110 is stored on disk
2025-10-10T14:31:44.307754Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.307756Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 112, partNo: 0, Offset: 111 is stored on disk
2025-10-10T14:31:44.307760Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.328066Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 463612
2025-10-10T14:31:44.328079Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Returning serverBytesSize = 60676 to budget
2025-10-10T14:31:44.307763Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 113, partNo: 0, Offset: 112 is stored on disk
2025-10-10T14:31:44.307764Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.307768Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 114, partNo: 0, Offset: 113 is stored on disk
2025-10-10T14:31:44.328092Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Got ReadResponse, serverBytesSize = 20534, now ReadSizeBudget = 60676, ReadSizeServerDelta = 443078
2025-10-10T14:31:44.328093Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 194 to 194
2025-10-10T14:31:44.307785Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:44.328115Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.328118Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 194
2025-10-10T14:31:44.307790Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:44.307792Z node 3 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (8)
2025-10-10T14:31:44.328095Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (180-180)
2025-10-10T14:31:44.307799Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 108 EndOffset 108 newEndOffset 114 commitOffset 0 clientCommitOffset 0 cookie 20 readingFinished 0 firstRead 0
2025-10-10T14:31:44.307799Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 115 partNo 0
2025-10-10T14:31:44.307802Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 108 endOffset 114
2025-10-10T14:31:44.328141Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 1} (181-181)
2025-10-10T14:31:44.328179Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 195 to 195
2025-10-10T14:31:44.328592Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (182-182)
2025-10-10T14:31:44.307810Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 108, endOffset# 114, WTime# 1760106704304, sizeLag# 73582
2025-10-10T14:31:44.328602Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 1} (183-183)
2025-10-10T14:31:44.328603Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.307812Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1TEvPartitionReady. Aval parts: 1
2025-10-10T14:31:44.328607Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 195
2025-10-10T14:31:44.307813Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 115 partNo 0 FormedBlobsCount 0 NewHead: Offset 114 PartNo 0 PackedSize 12697 count 1 nextOffset 115 batches 1
2025-10-10T14:31:44.307816Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 116 partNo 0
2025-10-10T14:31:44.307818Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 performing read request: guid# 49323299-67359c1d-a0235679-24f39634, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 7, size# 88298, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-10T14:31:44.307819Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 116 partNo 0 FormedBlobsCount 0 NewHead: Offset 114 PartNo 0 PackedSize 25472 count 2 nextOffset 116 batches 1
2025-10-10T14:31:44.307822Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 117 partNo 0
2025-10-10T14:31:44.307824Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 117 partNo 0 FormedBlobsCount 0 NewHead: Offset 114 PartNo 0 PackedSize 38357 count 3 nextOffset 117 batches 1
2025-10-10T14:31:44.307826Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 118 partNo 0
2025-10-10T14:31:44.307827Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 7 maxSize 88298 maxTimeLagMs 0 readTimestampMs 0 readOffset 108 EndOffset 114 ClientCommitOffset 0 committedOffset 0 Guid 49323299-67359c1d-a0235679-24f39634
2025-10-10T14:31:44.307831Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 118 partNo 0 FormedBlobsCount 0 NewHead: Offset 114 PartNo 0 PackedSize 51352 count 4 nextOffset 118 batches 1
2025-10-10T14:31:44.328630Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 2} (184-184)
2025-10-10T14:31:44.307833Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 119 partNo 0
2025-10-10T14:31:44.307835Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 119 partNo 0 FormedBlobsCount 0 NewHead: Offset 114 PartNo 0 PackedSize 64457 count 5 nextOffset 119 batches 1
2025-10-10T14:31:44.307837Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 120 partNo 0
2025-10-10T14:31:44.307839Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 120 partNo 0 FormedBlobsCount 0 NewHead: Offset 114 PartNo 0 PackedSize 77672 count 6 nextOffset 120 batches 1
2025-10-10T14:31:44.307841Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 121 partNo 0
2025-10-10T14:31:44.307843Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 121 partNo 0 FormedBlobsCount 0 NewHead: Offset 114 PartNo 0 PackedSize 90997 count 7 nextOffset 121 batches 1
2025-10-10T14:31:44.307845Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 122 partNo 0
2025-10-10T14:31:44.307848Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 122 partNo 0 FormedBlobsCount 0 NewHead: Offset 114 PartNo 0 PackedSize 104432 count 8 nextOffset 122 batches 1
2025-10-10T14:31:44.307849Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:44.307896Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 114,8 HeadOffset 114 endOffset 114 curOffset 122 d0000000000_00000000000000000114_00000_0000000008_00000? size 104238 WTime 1760106704307
2025-10-10T14:31:44.307897Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.307917Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:182: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:31:44.307921Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 219  requestId: <none> cookie: 109
2025-10-10T14:31:44.307926Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 220  requestId: <none> cookie: 110
2025-10-10T14:31:44.328668Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 196 to 196
2025-10-10T14:31:44.328672Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] In ContinueReadingDataImpl, ReadSizeBudget = 60676, ReadSizeServerDelta = 443078
2025-10-10T14:31:44.307929Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 221  requestId: <none> cookie: 111
2025-10-10T14:31:44.307933Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 223  requestId: <none> cookie: 112
2025-10-10T14:31:44.307936Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 225  requestId: <none> cookie: 113
2025-10-10T14:31:44.307939Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 227  requestId: <none> cookie: 114
2025-10-10T14:31:44.307945Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.307947Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.307951Z node 3 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:31:44.307956Z node 3 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 114 partNo 0 count 8 size 104238
2025-10-10T14:31:44.307975Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.307982Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.328679Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.307987Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.307989Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 23 Topic 'rt3.dc1--test-topic' partition 0 user user offset 108 count 7 size 88298 endOffset 114 max time lag 0ms effective offset 108
2025-10-10T14:31:44.307991Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.307997Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 23 added 1 blobs, size 73582 count 6 last offset 108, current partition end offset: 114
2025-10-10T14:31:44.329174Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 196
2025-10-10T14:31:44.307998Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 23. Send blob request.
2025-10-10T14:31:44.308003Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 108 partno 0 count 6 parts_count 0 source 1 size 73582 accessed 0 times before, last time 2025-10-10T14:31:44.000000Z
2025-10-10T14:31:44.308006Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.308011Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.308016Z node 3 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 23. All 1 blobs are from cache.
2025-10-10T14:31:44.329185Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 503754
2025-10-10T14:31:44.308020Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.329200Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Returning serverBytesSize = 0 to budget
2025-10-10T14:31:44.308030Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:31:44.308034Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 108 partno 0 count 6 parts 0 suffix '63'
2025-10-10T14:31:44.308064Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 108 totakecount 6 count 6 size 73560 from pos 0 cbcount 6
2025-10-10T14:31:44.308077Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 108
2025-10-10T14:31:44.308104Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 grpc read done: success# 1, data# { read_request { bytes_size: 124059 } }
2025-10-10T14:31:44.308120Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 got read request: guid# 2f8ef3c7-4c088160-d134c6b4-6f2f0f30
2025-10-10T14:31:44.308145Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.308165Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.308175Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 114 Result { Offset: 108 Data: "... 11963 bytes ..." SourceId: "\000src_id" SeqNo: 109 WriteTimestampMS: 1760106704306 CreateTimestampMS: 1760106704304 UncompressedSize: 11891 PartitionKey: "" ExplicitHash: "" } Result { Offset: 109 Data: "... 12073 bytes ..." SourceId: "\000src_id" SeqNo: 110 WriteTimestampMS: 1760106704306 CreateTimestampMS: 1760106704304 UncompressedSize: 12001 PartitionKey: "" ExplicitHash: "" } Result { Offset: 110 Data: "... 12183 bytes ..." SourceId: "\000src_id" SeqNo: 111 WriteTimestampMS: 1760106704306 CreateTimestampMS: 1760106704304 UncompressedSize: 12111 PartitionKey: "" ExplicitHash: "" } Result { Offset: 111 Data: "... 12293 bytes ..." SourceId: "\000src_id" SeqNo: 112 WriteTimestampMS: 1760106704306 CreateTimestampMS: 1760106704305 UncompressedSize: 12221 PartitionKey: "" ExplicitHash: "" } Result { Offset: 112 Data: "... 12403 bytes ..." SourceId: "\000src_id" SeqNo: 113 WriteTimestampMS: 1760106704306 CreateTimestampMS: 1760106704305 UncompressedSize: 12331 PartitionKey: "" ExplicitHash: "" } Result { Offset: 113 Data: "... 12513 bytes ..." SourceId: "\000src_id" SeqNo: 114 WriteTimestampMS: 1760106704306 CreateTimestampMS: 1760106704305 UncompressedSize: 12441 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 18446744073709551518 RealReadOffset: 113 WaitQuotaTimeMs: 0 EndOffset: 114 StartOffset: 0 } Cookie: 108 }
2025-10-10T14:31:44.308183Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.308186Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.308191Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.308193Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.308203Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 244  requestId: <none> cookie: 123
2025-10-10T14:31:44.329253Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (185-185)
2025-10-10T14:31:44.329258Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Got ReadResponse, serverBytesSize = 41265, now ReadSizeBudget = 0, ReadSizeServerDelta = 462489
>>> event from dataHandler: 2025-10-10T14:31:44.329488Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] In ContinueReadingDataImpl, ReadSizeBudget = 0, ReadSizeServerDelta = 462489
2025-10-10T14:31:44.329496Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Returning serverBytesSize = 20534 to budget
2025-10-10T14:31:44.329502Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] In ContinueReadingDataImpl, ReadSizeBudget = 20534, ReadSizeServerDelta = 462489
2025-10-10T14:31:44.329323Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 197 to 197
2025-10-10T14:31:44.308208Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 245  requestId: <none> cookie: 124
DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 Message { Data: ..19811 bytes.. Information: { Offset: 180 ProducerId: "src_id" SeqNo: 181 CreateTime: 2025-10-10T14:31:44.322000Z WriteTime: 2025-10-10T14:31:44.323000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:46198", "logtype": "unknown", "server": "ipv6:[::1]:46198" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..19921 bytes.. Information: { Offset: 181 ProducerId: "src_id" SeqNo: 182 CreateTime: 2025-10-10T14:31:44.323000Z WriteTime: 2025-10-10T14:31:44.323000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:46198", "logtype": "unknown", "server": "ipv6:[::1]:46198" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..20031 bytes.. Information: { Offset: 182 ProducerId: "src_id" SeqNo: 183 CreateTime: 2025-10-10T14:31:44.323000Z WriteTime: 2025-10-10T14:31:44.324000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:46198", "server": "ipv6:[::1]:46198" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..20141 bytes.. Information: { Offset: 183 ProducerId: "src_id" SeqNo: 184 CreateTime: 2025-10-10T14:31:44.324000Z WriteTime: 2025-10-10T14:31:44.324000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:46198", "server": "ipv6:[::1]:46198" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..20251 bytes.. Information: { Offset: 184 ProducerId: "src_id" SeqNo: 185 CreateTime: 2025-10-10T14:31:44.324000Z WriteTime: 2025-10-10T14:31:44.324000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:46198", "server": "ipv6:[::1]:46198" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } }
2025-10-10T14:31:44.308213Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.329521Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (186-187)
2025-10-10T14:31:44.329524Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.329545Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 197
2025-10-10T14:31:44.308214Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 21 from offset 114
2025-10-10T14:31:44.329535Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] The application data is transferred to the client. Number of messages 3, size 60423 bytes
2025-10-10T14:31:44.308217Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.308219Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 114 ReadOffset 114 ReadGuid 49323299-67359c1d-a0235679-24f39634 has messages 1
2025-10-10T14:31:44.308236Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.308238Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.308240Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 read done: guid# 49323299-67359c1d-a0235679-24f39634, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 73339
2025-10-10T14:31:44.308244Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 123 partNo : 0 messageNo: 246 size 13503 offset: -1
2025-10-10T14:31:44.308245Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 response to read: guid# 49323299-67359c1d-a0235679-24f39634
2025-10-10T14:31:44.308248Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.308249Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.308252Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 124 partNo : 0 messageNo: 247 size 13613 offset: -1
2025-10-10T14:31:44.308256Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.308261Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.308263Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.308264Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.308354Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 Process answer. Aval parts: 0
2025-10-10T14:31:44.308458Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.329593Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 198 to 198
2025-10-10T14:31:44.308487Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.329879Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.308543Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.329883Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 198
2025-10-10T14:31:44.308546Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.308557Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 248  requestId: <none> cookie: 125
2025-10-10T14:31:44.329593Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 483023
2025-10-10T14:31:44.308558Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.308561Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.329909Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Got ReadResponse, serverBytesSize = 83717, now ReadSizeBudget = 0, ReadSizeServerDelta = 399306
2025-10-10T14:31:44.329911Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] The application data is transferred to the client. Number of messages 2, size 39732 bytes
2025-10-10T14:31:44.329920Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (185-185)
2025-10-10T14:31:44.308615Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.308624Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.308626Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.308631Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 125 partNo : 0 messageNo: 249 size 13723 offset: -1
2025-10-10T14:31:44.308634Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.308635Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.308638Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.308640Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.308645Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 250  requestId: <none> cookie: 126
2025-10-10T14:31:44.308654Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.308664Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.308665Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.308667Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 126 partNo : 0 messageNo: 251 size 13833 offset: -1
2025-10-10T14:31:44.308669Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.308671Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.329966Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] In ContinueReadingDataImpl, ReadSizeBudget = 0, ReadSizeServerDelta = 399306
2025-10-10T14:31:44.308759Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.308810Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.329974Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Returning serverBytesSize = 41265 to budget
2025-10-10T14:31:44.308822Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.329980Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] In ContinueReadingDataImpl, ReadSizeBudget = 41265, ReadSizeServerDelta = 399306
2025-10-10T14:31:44.308823Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.308829Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 252  requestId: <none> cookie: 127
2025-10-10T14:31:44.329986Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 199 to 199
2025-10-10T14:31:44.308837Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.329998Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (188-191)
2025-10-10T14:31:44.308862Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.308863Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.308866Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 127 partNo : 0 messageNo: 253 size 13943 offset: -1
2025-10-10T14:31:44.308868Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.308871Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.330014Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 440571
2025-10-10T14:31:44.308904Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 114 count 8 size 104238 actorID [3:7559600726884252064:2448]
2025-10-10T14:31:44.308913Z node 3 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:31:44.330019Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Returning serverBytesSize = 83717 to budget
2025-10-10T14:31:44.308918Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 104120 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:31:44.308921Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.308925Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 115, partNo: 0, Offset: 114 is stored on disk
2025-10-10T14:31:44.330022Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.308927Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.308928Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 116, partNo: 0, Offset: 115 is stored on disk
2025-10-10T14:31:44.308929Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 114 partno 0 count 8 parts 0 suffix '63' size 104238
2025-10-10T14:31:44.330315Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 199
2025-10-10T14:31:44.308930Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.330029Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (186-186)
2025-10-10T14:31:44.330027Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Returning serverBytesSize = 0 to budget
2025-10-10T14:31:44.308933Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 117, partNo: 0, Offset: 116 is stored on disk
2025-10-10T14:31:44.308934Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.308936Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 118, partNo: 0, Offset: 117 is stored on disk
2025-10-10T14:31:44.330344Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 1} (187-187)
2025-10-10T14:31:44.308938Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.308939Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 119, partNo: 0, Offset: 118 is stored on disk
2025-10-10T14:31:44.308941Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.308943Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 120, partNo: 0, Offset: 119 is stored on disk
2025-10-10T14:31:44.330367Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Returning serverBytesSize = 0 to budget
2025-10-10T14:31:44.330368Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (188-188)
2025-10-10T14:31:44.308944Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.308946Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 121, partNo: 0, Offset: 120 is stored on disk
2025-10-10T14:31:44.308948Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.330375Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 1} (189-189)
2025-10-10T14:31:44.308950Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 122, partNo: 0, Offset: 121 is stored on disk
2025-10-10T14:31:44.330401Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 2} (190-190)
>>> event from dataHandler: 2025-10-10T14:31:44.330410Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 3} (191-191)
2025-10-10T14:31:44.308966Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 Message { Data: ..20361 bytes.. Information: { Offset: 185 ProducerId: "src_id" SeqNo: 186 CreateTime: 2025-10-10T14:31:44.324000Z WriteTime: 2025-10-10T14:31:44.325000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "_ip": "ipv6:[::1]:46198", "server": "ipv6:[::1]:46198", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } }2025-10-10T14:31:44.308969Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:44.330424Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 200 to 200
2025-10-10T14:31:44.308972Z node 3 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (5)
2025-10-10T14:31:44.308980Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 123 partNo 0
2025-10-10T14:31:44.330432Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] The application data is transferred to the client. Number of messages 1, size 20361 bytes
2025-10-10T14:31:44.308981Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 114 EndOffset 114 newEndOffset 122 commitOffset 0 clientCommitOffset 0 cookie 21 readingFinished 0 firstRead 0
2025-10-10T14:31:44.330435Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.308984Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 114 endOffset 122
2025-10-10T14:31:44.330435Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Returning serverBytesSize = 0 to budget
2025-10-10T14:31:44.330440Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 200
2025-10-10T14:31:44.308991Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 114, endOffset# 122, WTime# 1760106704306, sizeLag# 104238
2025-10-10T14:31:44.308993Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1TEvPartitionReady. Aval parts: 1
>>> event from dataHandler: 2025-10-10T14:31:44.330538Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 201 to 201
2025-10-10T14:31:44.330744Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Got ReadResponse, serverBytesSize = 63976, now ReadSizeBudget = 83717, ReadSizeServerDelta = 376595
2025-10-10T14:31:44.330996Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.331000Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 201
2025-10-10T14:31:44.308994Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 123 partNo 0 FormedBlobsCount 0 NewHead: Offset 122 PartNo 0 PackedSize 13577 count 1 nextOffset 123 batches 1
2025-10-10T14:31:44.331012Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] In ContinueReadingDataImpl, ReadSizeBudget = 83717, ReadSizeServerDelta = 376595
DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 Message { Data: ..20471 bytes.. Information: { Offset: 186 ProducerId: "src_id" SeqNo: 187 CreateTime: 2025-10-10T14:31:44.325000Z WriteTime: 2025-10-10T14:31:44.327000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:46198", "_ip": "ipv6:[::1]:46198", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..20581 bytes.. Information: { Offset: 187 ProducerId: "src_id" SeqNo: 188 CreateTime: 2025-10-10T14:31:44.326000Z WriteTime: 2025-10-10T14:31:44.327000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:46198", "_ip": "ipv6:[::1]:46198", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..20691 bytes.. Information: { Offset: 188 ProducerId: "src_id" SeqNo: 189 CreateTime: 2025-10-10T14:31:44.326000Z WriteTime: 2025-10-10T14:31:44.328000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:46198", "logtype": "unknown", "server": "ipv6:[::1]:46198" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..20801 bytes.. Information: { Offset: 189 ProducerId: "src_id" SeqNo: 190 CreateTime: 2025-10-10T14:31:44.327000Z WriteTime: 2025-10-10T14:31:44.328000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:46198", "logtype": "unknown", "server": "ipv6:[::1]:46198" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..20911 bytes.. Information: { Offset: 190 ProducerId: "src_id" SeqNo: 191 CreateTime: 2025-10-10T14:31:44.327000Z WriteTime: 2025-10-10T14:31:44.328000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:46198", "logtype": "unknown", "server": "ipv6:[::1]:46198" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..21021 bytes.. Information: { Offset: 191 ProducerId: "src_id" SeqNo: 192 CreateTime: 2025-10-10T14:31:44.327000Z WriteTime: 2025-10-10T14:31:44.328000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:46198", "logtype": "unknown", "server": "ipv6:[::1]:46198" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } }
2025-10-10T14:31:44.308997Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 124 partNo 0
2025-10-10T14:31:44.308999Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 124 partNo 0 FormedBlobsCount 0 NewHead: Offset 122 PartNo 0 PackedSize 27232 count 2 nextOffset 124 batches 1
2025-10-10T14:31:44.309000Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 performing read request: guid# 45577047-88658a9-eba37827-1b016377, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 9, size# 125085, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-10T14:31:44.309001Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 125 partNo 0
2025-10-10T14:31:44.309004Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 125 partNo 0 FormedBlobsCount 0 NewHead: Offset 122 PartNo 0 PackedSize 40997 count 3 nextOffset 125 batches 1
2025-10-10T14:31:44.309006Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 126 partNo 0
2025-10-10T14:31:44.331036Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 460312
2025-10-10T14:31:44.309008Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 126 partNo 0 FormedBlobsCount 0 NewHead: Offset 122 PartNo 0 PackedSize 54872 count 4 nextOffset 126 batches 1
2025-10-10T14:31:44.309008Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 9 maxSize 125085 maxTimeLagMs 0 readTimestampMs 0 readOffset 114 EndOffset 122 ClientCommitOffset 0 committedOffset 0 Guid 45577047-88658a9-eba37827-1b016377
2025-10-10T14:31:44.309010Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 127 partNo 0
2025-10-10T14:31:44.309012Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 127 partNo 0 FormedBlobsCount 0 NewHead: Offset 122 PartNo 0 PackedSize 68857 count 5 nextOffset 127 batches 1
2025-10-10T14:31:44.309013Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:44.309079Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 122,5 HeadOffset 122 endOffset 122 curOffset 127 d0000000000_00000000000000000122_00000_0000000005_00000? size 68759 WTime 1760106704308
2025-10-10T14:31:44.331052Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] The application data is transferred to the client. Number of messages 4, size 83424 bytes
2025-10-10T14:31:44.309158Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:182: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:31:44.309167Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 230  requestId: <none> cookie: 115
2025-10-10T14:31:44.331060Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] The application data is transferred to the client. Number of messages 2, size 41052 bytes
2025-10-10T14:31:44.309173Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 231  requestId: <none> cookie: 116
2025-10-10T14:31:44.309179Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 234  requestId: <none> cookie: 117
2025-10-10T14:31:44.331536Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Returning serverBytesSize = 0 to budget
2025-10-10T14:31:44.309180Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.309183Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 235  requestId: <none> cookie: 118
2025-10-10T14:31:44.309188Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 238  requestId: <none> cookie: 119
2025-10-10T14:31:44.309188Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.331061Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (192-194)
2025-10-10T14:31:44.331553Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Returning serverBytesSize = 0 to budget
2025-10-10T14:31:44.331563Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Got ReadResponse, serverBytesSize = 43245, now ReadSizeBudget = 0, ReadSizeServerDelta = 417067
2025-10-10T14:31:44.331087Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 202 to 202
2025-10-10T14:31:44.331577Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] In ContinueReadingDataImpl, ReadSizeBudget = 0, ReadSizeServerDelta = 417067
2025-10-10T14:31:44.309193Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 239  requestId: <none> cookie: 120
2025-10-10T14:31:44.331582Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.331584Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Returning serverBytesSize = 63976 to budget
2025-10-10T14:31:44.309194Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.331589Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] In ContinueReadingDataImpl, ReadSizeBudget = 63976, ReadSizeServerDelta = 417067
2025-10-10T14:31:44.309198Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.331586Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 202
2025-10-10T14:31:44.309198Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 241  requestId: <none> cookie: 121
2025-10-10T14:31:44.309203Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 243  requestId: <none> cookie: 122
2025-10-10T14:31:44.309213Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.309216Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.309225Z node 3 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:31:44.309235Z node 3 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 122 partNo 0 count 5 size 68759
2025-10-10T14:31:44.309271Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.309276Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.309278Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 24 Topic 'rt3.dc1--test-topic' partition 0 user user offset 114 count 9 size 125085 endOffset 122 max time lag 0ms effective offset 114
2025-10-10T14:31:44.309283Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.309289Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.309291Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 24 added 1 blobs, size 104238 count 8 last offset 114, current partition end offset: 122
2025-10-10T14:31:44.309293Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 24. Send blob request.
2025-10-10T14:31:44.331636Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (195-196)
2025-10-10T14:31:44.331641Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 481043
2025-10-10T14:31:44.309295Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.331653Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Returning serverBytesSize = 43245 to budget
2025-10-10T14:31:44.309300Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 114 partno 0 count 8 parts_count 0 source 1 size 104238 accessed 0 times before, last time 2025-10-10T14:31:44.000000Z
2025-10-10T14:31:44.309312Z node 3 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 24. All 1 blobs are from cache.
2025-10-10T14:31:44.331656Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (192-192)
2025-10-10T14:31:44.309319Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:31:44.309340Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 114 partno 0 count 8 parts 0 suffix '63'
2025-10-10T14:31:44.309357Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.331677Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 1} (193-193)
2025-10-10T14:31:44.309385Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.309388Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 114 totakecount 8 count 8 size 104216 from pos 0 cbcount 8
2025-10-10T14:31:44.309405Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.309407Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.331688Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 2} (194-194)
2025-10-10T14:31:44.309418Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 114
2025-10-10T14:31:44.309432Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.309437Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 254  requestId: <none> cookie: 128
2025-10-10T14:31:44.309440Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.309442Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.331698Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 203 to 203
2025-10-10T14:31:44.331694Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (195-195)
2025-10-10T14:31:44.331906Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.331909Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 203
2025-10-10T14:31:44.309445Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 255  requestId: <none> cookie: 129
2025-10-10T14:31:44.309452Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 grpc read done: success# 1, data# { read_request { bytes_size: 73339 } }
2025-10-10T14:31:44.309463Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 got read request: guid# 9ca575d5-66ea5e95-4d9d1d5a-94c72f86
2025-10-10T14:31:44.309469Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.331921Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 1} (196-196)
2025-10-10T14:31:44.309475Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.309497Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.309500Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.309506Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 122 Result { Offset: 114 Data: "... 12623 bytes ..." SourceId: "\000src_id" SeqNo: 115 WriteTimestampMS: 1760106704307 CreateTimestampMS: 1760106704305 UncompressedSize: 12551 PartitionKey: "" ExplicitHash: "" } Result { Offset: 115 Data: "... 12733 bytes ..." SourceId: "\000src_id" SeqNo: 116 WriteTimestampMS: 1760106704307 CreateTimestampMS: 1760106704306 UncompressedSize: 12661 PartitionKey: "" ExplicitHash: "" } Result { Offset: 116 Data: "... 12843 bytes ..." SourceId: "\000src_id" SeqNo: 117 WriteTimestampMS: 1760106704307 CreateTimestampMS: 1760106704306 UncompressedSize: 12771 PartitionKey: "" ExplicitHash: "" } Result { Offset: 117 Data: "... 12953 bytes ..." SourceId: "\000src_id" SeqNo: 118 WriteTimestampMS: 1760106704307 CreateTimestampMS: 1760106704306 UncompressedSize: 12881 PartitionKey: "" ExplicitHash: "" } Result { Offset: 118 Data: "... 13063 bytes ..." SourceId: "\000src_id" SeqNo: 119 WriteTimestampMS: 1760106704307 CreateTimestampMS: 1760106704306 UncompressedSize: 12991 PartitionKey: "" ExplicitHash: "" } Result { Offset: 119 Data: "... 13173 bytes ..." SourceId: "\000src_id" SeqNo: 120 WriteTimestampMS: 1760106704307 CreateTimestampMS: 1760106704306 UncompressedSize: 13101 PartitionKey: "" ExplicitHash: "" } Result { Offset: 120 Data: "... 13283 bytes ..." SourceId: "\000src_id" SeqNo: 121 WriteTimestampMS: 1760106704307 CreateTimestampMS: 1760106704306 UncompressedSize: 13211 PartitionKey: "" ExplicitHash: "" } Result { Offset: 121 Data: "... 13393 bytes ..." SourceId: "\000src_id" SeqNo: 122 WriteTimestampMS: 1760106704307 CreateTimestampMS: 1760106704307 UncompressedSize: 13321 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 18446744073709551454 RealReadOffset: 121 WaitQuotaTimeMs: 0 EndOffset: 122 StartOffset: 0 } Cookie: 114 }
2025-10-10T14:31:44.309511Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 128 partNo : 0 messageNo: 256 size 14054 offset: -1
2025-10-10T14:31:44.309515Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.309517Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.309521Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 129 partNo : 0 messageNo: 257 size 14164 offset: -1
2025-10-10T14:31:44.309525Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.309533Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.309535Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.309538Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.309542Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 22 from offset 122
2025-10-10T14:31:44.309546Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 122 ReadOffset 122 ReadGuid 45577047-88658a9-eba37827-1b016377 has messages 1
2025-10-10T14:31:44.309563Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 read done: guid# 45577047-88658a9-eba37827-1b016377, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 103901
2025-10-10T14:31:44.309565Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
>>> event from dataHandler: 2025-10-10T14:31:44.309568Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 response to read: guid# 45577047-88658a9-eba37827-1b016377
2025-10-10T14:31:44.309608Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 Process answer. Aval parts: 0
2025-10-10T14:31:44.331983Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 204 to 204
2025-10-10T14:31:44.309610Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.331991Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.309629Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.331994Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 204
2025-10-10T14:31:44.309631Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 Message { Data: ..21131 bytes.. Information: { Offset: 192 ProducerId: "src_id" SeqNo: 193 CreateTime: 2025-10-10T14:31:44.327000Z WriteTime: 2025-10-10T14:31:44.329000Z MessageGroupId: "src_id" Meta: { "server": "ipv6:[::1]:46198", "_ip": "ipv6:[::1]:46198", "logtype": "unknown", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..21241 bytes.. Information: { Offset: 193 ProducerId: "src_id" SeqNo: 194 CreateTime: 2025-10-10T14:31:44.328000Z WriteTime: 2025-10-10T14:31:44.329000Z MessageGroupId: "src_id" Meta: { "server": "ipv6:[::1]:46198", "_ip": "ipv6:[::1]:46198", "logtype": "unknown", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..21351 bytes.. Information: { Offset: 194 ProducerId: "src_id" SeqNo: 195 CreateTime: 2025-10-10T14:31:44.328000Z WriteTime: 2025-10-10T14:31:44.329000Z MessageGroupId: "src_id" Meta: { "server": "ipv6:[::1]:46198", "_ip": "ipv6:[::1]:46198", "logtype": "unknown", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..21461 bytes.. Information: { Offset: 195 ProducerId: "src_id" SeqNo: 196 CreateTime: 2025-10-10T14:31:44.328000Z WriteTime: 2025-10-10T14:31:44.330000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:46198", "_ip": "ipv6:[::1]:46198", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..21571 bytes.. Information: { Offset: 196 ProducerId: "src_id" SeqNo: 197 CreateTime: 2025-10-10T14:31:44.329000Z WriteTime: 2025-10-10T14:31:44.330000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:46198", "_ip": "ipv6:[::1]:46198", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } }
2025-10-10T14:31:44.309638Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 258  requestId: <none> cookie: 130
2025-10-10T14:31:44.309651Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.309656Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.332063Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 205 to 205
2025-10-10T14:31:44.309683Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.309689Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.309692Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.332593Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Got ReadResponse, serverBytesSize = 65626, now ReadSizeBudget = 43245, ReadSizeServerDelta = 415417
2025-10-10T14:31:44.332696Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.332699Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 205
2025-10-10T14:31:44.309696Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 130 partNo : 0 messageNo: 259 size 14274 offset: -1
2025-10-10T14:31:44.332700Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] The application data is transferred to the client. Number of messages 3, size 63723 bytes
2025-10-10T14:31:44.309701Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.309702Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.309706Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.332715Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] In ContinueReadingDataImpl, ReadSizeBudget = 43245, ReadSizeServerDelta = 415417
2025-10-10T14:31:44.309710Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.309717Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 260  requestId: <none> cookie: 131
2025-10-10T14:31:44.309728Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.309743Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.309745Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.309751Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 131 partNo : 0 messageNo: 261 size 14384 offset: -1
2025-10-10T14:31:44.332734Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 458662
2025-10-10T14:31:44.309755Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.309761Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.332741Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] The application data is transferred to the client. Number of messages 2, size 43032 bytes
2025-10-10T14:31:44.309784Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.309826Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.332746Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Returning serverBytesSize = 0 to budget
2025-10-10T14:31:44.309843Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.309845Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.309850Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 262  requestId: <none> cookie: 132
2025-10-10T14:31:44.332754Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (197-199)
2025-10-10T14:31:44.309857Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.309866Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.332760Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Returning serverBytesSize = 65626 to budget
2025-10-10T14:31:44.309867Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.309870Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 132 partNo : 0 messageNo: 263 size 14494 offset: -1
2025-10-10T14:31:44.333142Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Returning serverBytesSize = 0 to budget
2025-10-10T14:31:44.309873Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.309876Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.333148Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (197-197)
2025-10-10T14:31:44.332770Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 206 to 206
2025-10-10T14:31:44.309955Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.310025Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.333155Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 1} (198-198)
2025-10-10T14:31:44.333156Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.310054Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.333160Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 206
2025-10-10T14:31:44.310057Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.310065Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 264  requestId: <none> cookie: 133
2025-10-10T14:31:44.333164Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 2} (199-199)
2025-10-10T14:31:44.310078Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.310090Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.310093Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.310102Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 133 partNo : 0 messageNo: 265 size 14604 offset: -1
2025-10-10T14:31:44.310105Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.310110Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.310206Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 122 count 5 size 68759 actorID [3:7559600726884252064:2448]
2025-10-10T14:31:44.310218Z node 3 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:31:44.310226Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 68650 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:31:44.310231Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.310236Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 123, partNo: 0, Offset: 122 is stored on disk
2025-10-10T14:31:44.310236Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 122 partno 0 count 5 parts 0 suffix '63' size 68759
2025-10-10T14:31:44.310238Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.310242Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 124, partNo: 0, Offset: 123 is stored on disk
2025-10-10T14:31:44.310244Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.310247Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 125, partNo: 0, Offset: 124 is stored on disk
2025-10-10T14:31:44.310250Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.310254Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 126, partNo: 0, Offset: 125 is stored on disk
2025-10-10T14:31:44.310256Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
>>> event from dataHandler: 2025-10-10T14:31:44.310259Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 127, partNo: 0, Offset: 126 is stored on disk
2025-10-10T14:31:44.310289Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:44.310296Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 Message { Data: ..21681 bytes.. Information: { Offset: 197 ProducerId: "src_id" SeqNo: 198 CreateTime: 2025-10-10T14:31:44.329000Z WriteTime: 2025-10-10T14:31:44.330000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:46198", "logtype": "unknown", "_ip": "ipv6:[::1]:46198" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..21791 bytes.. Information: { Offset: 198 ProducerId: "src_id" SeqNo: 199 CreateTime: 2025-10-10T14:31:44.329000Z WriteTime: 2025-10-10T14:31:44.330000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:46198", "logtype": "unknown", "_ip": "ipv6:[::1]:46198" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..21901 bytes.. Information: { Offset: 199 ProducerId: "src_id" SeqNo: 200 CreateTime: 2025-10-10T14:31:44.330000Z WriteTime: 2025-10-10T14:31:44.330000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:46198", "logtype": "unknown", "_ip": "ipv6:[::1]:46198" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } }
2025-10-10T14:31:44.310297Z node 3 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (6)
2025-10-10T14:31:44.310300Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 122 EndOffset 122 newEndOffset 127 commitOffset 0 clientCommitOffset 0 cookie 22 readingFinished 0 firstRead 0
2025-10-10T14:31:44.310304Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 122 endOffset 127
2025-10-10T14:31:44.333579Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] The application data is transferred to the client. Number of messages 3, size 65373 bytes
2025-10-10T14:31:44.333250Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 207 to 207
2025-10-10T14:31:44.333588Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Returning serverBytesSize = 0 to budget
2025-10-10T14:31:44.310310Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 128 partNo 0
2025-10-10T14:31:44.310311Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 122, endOffset# 127, WTime# 1760106704307, sizeLag# 68759
2025-10-10T14:31:44.310313Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1TEvPartitionReady. Aval parts: 1
2025-10-10T14:31:44.333599Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Got ReadResponse, serverBytesSize = 22184, now ReadSizeBudget = 65626, ReadSizeServerDelta = 436478
2025-10-10T14:31:44.333605Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.333608Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 207
2025-10-10T14:31:44.310320Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 performing read request: guid# c6e8d7ef-76cf1284-9fef9dc0-835a71d2, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 6, size# 82510, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-10T14:31:44.310326Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 128 partNo 0 FormedBlobsCount 0 NewHead: Offset 127 PartNo 0 PackedSize 14128 count 1 nextOffset 128 batches 1
2025-10-10T14:31:44.310331Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 129 partNo 0
2025-10-10T14:31:44.333618Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] In ContinueReadingDataImpl, ReadSizeBudget = 65626, ReadSizeServerDelta = 436478
2025-10-10T14:31:44.310334Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 129 partNo 0 FormedBlobsCount 0 NewHead: Offset 127 PartNo 0 PackedSize 28334 count 2 nextOffset 129 batches 1
2025-10-10T14:31:44.310335Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 grpc read done: success# 1, data# { read_request { bytes_size: 103901 } }
2025-10-10T14:31:44.310336Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 130 partNo 0
2025-10-10T14:31:44.310339Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 130 partNo 0 FormedBlobsCount 0 NewHead: Offset 127 PartNo 0 PackedSize 42650 count 3 nextOffset 130 batches 1
2025-10-10T14:31:44.310341Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 131 partNo 0
2025-10-10T14:31:44.310344Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 131 partNo 0 FormedBlobsCount 0 NewHead: Offset 127 PartNo 0 PackedSize 57076 count 4 nextOffset 131 batches 1
2025-10-10T14:31:44.310345Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 132 partNo 0
2025-10-10T14:31:44.310348Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 132 partNo 0 FormedBlobsCount 0 NewHead: Offset 127 PartNo 0 PackedSize 71612 count 5 nextOffset 132 batches 1
2025-10-10T14:31:44.310350Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 133 partNo 0
2025-10-10T14:31:44.310364Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 133 partNo 0 FormedBlobsCount 0 NewHead: Offset 127 PartNo 0 PackedSize 86258 count 6 nextOffset 133 batches 1
2025-10-10T14:31:44.310366Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:44.310385Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 got read request: guid# 2a80c724-c1f73f55-f0a53e98-a0122b02
2025-10-10T14:31:44.333670Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 208 to 208
2025-10-10T14:31:44.310392Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 6 maxSize 82510 maxTimeLagMs 0 readTimestampMs 0 readOffset 122 EndOffset 127 ClientCommitOffset 0 committedOffset 0 Guid c6e8d7ef-76cf1284-9fef9dc0-835a71d2
2025-10-10T14:31:44.310408Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 127,6 HeadOffset 127 endOffset 127 curOffset 133 d0000000000_00000000000000000127_00000_0000000006_00000? size 86129 WTime 1760106704310
2025-10-10T14:31:44.333676Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.333678Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 208
2025-10-10T14:31:44.310441Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:182: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:31:44.310450Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 246  requestId: <none> cookie: 123
2025-10-10T14:31:44.333682Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 502104
2025-10-10T14:31:44.333729Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 209 to 209
2025-10-10T14:31:44.310463Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 247  requestId: <none> cookie: 124
2025-10-10T14:31:44.334108Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.334110Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 209
2025-10-10T14:31:44.310467Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 249  requestId: <none> cookie: 125
2025-10-10T14:31:44.310468Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.310472Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 251  requestId: <none> cookie: 126
2025-10-10T14:31:44.310475Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.310477Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 253  requestId: <none> cookie: 127
2025-10-10T14:31:44.310480Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.310486Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.310487Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.334126Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (200-200)
2025-10-10T14:31:44.310489Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.334151Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Returning serverBytesSize = 22184 to budget
2025-10-10T14:31:44.310492Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.310495Z node 3 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:31:44.334161Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 210 to 210
2025-10-10T14:31:44.310501Z node 3 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 127 partNo 0 count 6 size 86129
2025-10-10T14:31:44.334166Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.310534Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 25 Topic 'rt3.dc1--test-topic' partition 0 user user offset 122 count 6 size 82510 endOffset 127 max time lag 0ms effective offset 122
2025-10-10T14:31:44.334167Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (200-200)
2025-10-10T14:31:44.310542Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 25 added 1 blobs, size 68759 count 5 last offset 122, current partition end offset: 127
2025-10-10T14:31:44.310544Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 25. Send blob request.
2025-10-10T14:31:44.310554Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 122 partno 0 count 5 parts_count 0 source 1 size 68759 accessed 0 times before, last time 2025-10-10T14:31:44.000000Z
2025-10-10T14:31:44.310561Z node 3 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 25. All 1 blobs are from cache.
2025-10-10T14:31:44.334168Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 210
2025-10-10T14:31:44.310566Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:31:44.310584Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 122 partno 0 count 5 parts 0 suffix '63'
2025-10-10T14:31:44.310605Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 122 totakecount 5 count 5 size 68737 from pos 0 cbcount 5
2025-10-10T14:31:44.310618Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 122
2025-10-10T14:31:44.310684Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 127 Result { Offset: 122 Data: "... 13503 bytes ..." SourceId: "\000src_id" SeqNo: 123 WriteTimestampMS: 1760106704308 CreateTimestampMS: 1760106704307 UncompressedSize: 13431 PartitionKey: "" ExplicitHash: "" } Result { Offset: 123 Data: "... 13613 bytes ..." SourceId: "\000src_id" SeqNo: 124 WriteTimestampMS: 1760106704308 CreateTimestampMS: 1760106704307 UncompressedSize: 13541 PartitionKey: "" ExplicitHash: "" } Result { Offset: 124 Data: "... 13723 bytes ..." SourceId: "\000src_id" SeqNo: 125 WriteTimestampMS: 1760106704308 CreateTimestampMS: 1760106704307 UncompressedSize: 13651 PartitionKey: "" ExplicitHash: "" } Result { Offset: 125 Data: "... 13833 bytes ..." SourceId: "\000src_id" SeqNo: 126 WriteTimestampMS: 1760106704308 CreateTimestampMS: 1760106704308 UncompressedSize: 13761 PartitionKey: "" ExplicitHash: "" } Result { Offset: 126 Data: "... 13943 bytes ..." SourceId: "\000src_id" SeqNo: 127 WriteTimestampMS: 1760106704308 CreateTimestampMS: 1760106704308 UncompressedSize: 13871 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 18446744073709551550 RealReadOffset: 126 WaitQuotaTimeMs: 0 EndOffset: 127 StartOffset: 0 } Cookie: 122 }
2025-10-10T14:31:44.310724Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 23 from offset 127
2025-10-10T14:31:44.310729Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 127 ReadOffset 127 ReadGuid c6e8d7ef-76cf1284-9fef9dc0-835a71d2 has messages 1
2025-10-10T14:31:44.310750Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
>>> event from dataHandler: 2025-10-10T14:31:44.310752Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 read done: guid# c6e8d7ef-76cf1284-9fef9dc0-835a71d2, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 68563
2025-10-10T14:31:44.310757Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 response to read: guid# c6e8d7ef-76cf1284-9fef9dc0-835a71d2
2025-10-10T14:31:44.310775Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.334246Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 211 to 211
2025-10-10T14:31:44.310801Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.310804Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.310814Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 266  requestId: <none> cookie: 134
2025-10-10T14:31:44.310820Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.334584Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.310842Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.334587Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 211
2025-10-10T14:31:44.310844Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.310851Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 134 partNo : 0 messageNo: 267 size 14714 offset: -1
2025-10-10T14:31:44.310856Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.310861Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.310866Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.310880Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 Message { Data: ..22011 bytes.. Information: { Offset: 200 ProducerId: "src_id" SeqNo: 201 CreateTime: 2025-10-10T14:31:44.330000Z WriteTime: 2025-10-10T14:31:44.331000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:46198", "_ip": "ipv6:[::1]:46198", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } }2025-10-10T14:31:44.310897Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.310899Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.310903Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 268  requestId: <none> cookie: 135
2025-10-10T14:31:44.310908Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.310910Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 Process answer. Aval parts: 0
2025-10-10T14:31:44.334631Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] The application data is transferred to the client. Number of messages 1, size 22011 bytes
2025-10-10T14:31:44.310919Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.334644Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Returning serverBytesSize = 0 to budget
2025-10-10T14:31:44.310921Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.310926Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 135 partNo : 0 messageNo: 269 size 14824 offset: -1
2025-10-10T14:31:44.310929Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.310932Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.311352Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 127 count 6 size 86129 actorID [3:7559600726884252064:2448]
2025-10-10T14:31:44.311364Z node 3 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:31:44.311373Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 86016 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:31:44.311375Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 127 partno 0 count 6 parts 0 suffix '63' size 86129
2025-10-10T14:31:44.311377Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.311383Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 128, partNo: 0, Offset: 127 is stored on disk
2025-10-10T14:31:44.334692Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 212 to 212
2025-10-10T14:31:44.311386Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.334701Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.311388Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 129, partNo: 0, Offset: 128 is stored on disk
2025-10-10T14:31:44.334704Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 212
2025-10-10T14:31:44.311389Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.311391Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 130, partNo: 0, Offset: 129 is stored on disk
2025-10-10T14:31:44.311393Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.311395Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 131, partNo: 0, Offset: 130 is stored on disk
2025-10-10T14:31:44.311399Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.311401Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 132, partNo: 0, Offset: 131 is stored on disk
2025-10-10T14:31:44.311403Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.311407Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 133, partNo: 0, Offset: 132 is stored on disk
2025-10-10T14:31:44.334736Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 213 to 213
2025-10-10T14:31:44.311426Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:44.311430Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:44.311431Z node 3 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (2)
2025-10-10T14:31:44.334800Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Got ReadResponse, serverBytesSize = 66946, now ReadSizeBudget = 22184, ReadSizeServerDelta = 435158
2025-10-10T14:31:44.335189Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.335194Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 213
2025-10-10T14:31:44.311439Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 134 partNo 0
2025-10-10T14:31:44.311453Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 134 partNo 0 FormedBlobsCount 0 NewHead: Offset 133 PartNo 0 PackedSize 14788 count 1 nextOffset 134 batches 1
2025-10-10T14:31:44.335207Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] In ContinueReadingDataImpl, ReadSizeBudget = 22184, ReadSizeServerDelta = 435158
2025-10-10T14:31:44.311455Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 127 EndOffset 127 newEndOffset 133 commitOffset 0 clientCommitOffset 0 cookie 23 readingFinished 0 firstRead 0
2025-10-10T14:31:44.311457Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 135 partNo 0
2025-10-10T14:31:44.311458Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 127 endOffset 133
2025-10-10T14:31:44.311460Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 135 partNo 0 FormedBlobsCount 0 NewHead: Offset 133 PartNo 0 PackedSize 29654 count 2 nextOffset 135 batches 1
2025-10-10T14:31:44.311462Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:44.311467Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 127, endOffset# 133, WTime# 1760106704308, sizeLag# 86129
2025-10-10T14:31:44.335232Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 457342
2025-10-10T14:31:44.311468Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1TEvPartitionReady. Aval parts: 1
2025-10-10T14:31:44.311475Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 performing read request: guid# 201e4fe6-87c07178-2e46776d-920bed34, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 7, size# 103354, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-10T14:31:44.311484Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 7 maxSize 103354 maxTimeLagMs 0 readTimestampMs 0 readOffset 127 EndOffset 133 ClientCommitOffset 0 committedOffset 0 Guid 201e4fe6-87c07178-2e46776d-920bed34
2025-10-10T14:31:44.311505Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 133,2 HeadOffset 133 endOffset 133 curOffset 135 d0000000000_00000000000000000133_00000_0000000002_00000? size 29654 WTime 1760106704311
2025-10-10T14:31:44.311516Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.311523Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:182: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:31:44.311531Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 256  requestId: <none> cookie: 128
2025-10-10T14:31:44.311536Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 257  requestId: <none> cookie: 129
2025-10-10T14:31:44.311539Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 259  requestId: <none> cookie: 130
2025-10-10T14:31:44.311542Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 261  requestId: <none> cookie: 131
2025-10-10T14:31:44.311544Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 263  requestId: <none> cookie: 132
2025-10-10T14:31:44.311547Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.335274Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (201-203)
2025-10-10T14:31:44.335277Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 214 to 214
2025-10-10T14:31:44.311547Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 265  requestId: <none> cookie: 133
2025-10-10T14:31:44.335298Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.335300Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 214
2025-10-10T14:31:44.311550Z node 3 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:31:44.335289Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Returning serverBytesSize = 66946 to budget
2025-10-10T14:31:44.311553Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.311555Z node 3 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 133 partNo 0 count 2 size 29654
2025-10-10T14:31:44.311558Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.311562Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.311564Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.335847Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Got ReadResponse, serverBytesSize = 45225, now ReadSizeBudget = 66946, ReadSizeServerDelta = 412117
2025-10-10T14:31:44.311565Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.311570Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.311584Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.335858Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (201-201)
2025-10-10T14:31:44.311592Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.311598Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 26 Topic 'rt3.dc1--test-topic' partition 0 user user offset 127 count 7 size 103354 endOffset 133 max time lag 0ms effective offset 127
2025-10-10T14:31:44.311605Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 26 added 1 blobs, size 86129 count 6 last offset 127, current partition end offset: 133
2025-10-10T14:31:44.311606Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 26. Send blob request.
2025-10-10T14:31:44.311612Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 127 partno 0 count 6 parts_count 0 source 1 size 86129 accessed 0 times before, last time 2025-10-10T14:31:44.000000Z
2025-10-10T14:31:44.311619Z node 3 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 26. All 1 blobs are from cache.
2025-10-10T14:31:44.311623Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:31:44.311627Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 127 partno 0 count 6 parts 0 suffix '63'
2025-10-10T14:31:44.311650Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 127 totakecount 6 count 6 size 86107 from pos 0 cbcount 6
2025-10-10T14:31:44.311658Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 grpc read done: success# 1, data# { read_request { bytes_size: 68563 } }
2025-10-10T14:31:44.311660Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.311661Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.335898Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 1} (202-202)
2025-10-10T14:31:44.311667Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 got read request: guid# b93ec2a2-7b575feb-13b84056-fe57ddb
2025-10-10T14:31:44.311668Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 127
2025-10-10T14:31:44.311683Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 270  requestId: <none> cookie: 136
2025-10-10T14:31:44.311692Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.311704Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.311705Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.311711Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 136 partNo : 0 messageNo: 271 size 14934 offset: -1
2025-10-10T14:31:44.311714Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.335929Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 2} (203-203)
2025-10-10T14:31:44.311718Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.311731Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.311732Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 133 Result { Offset: 127 Data: "... 14054 bytes ..." SourceId: "\000src_id" SeqNo: 128 WriteTimestampMS: 1760106704310 CreateTimestampMS: 1760106704308 UncompressedSize: 13981 PartitionKey: "" ExplicitHash: "" } Result { Offset: 128 Data: "... 14164 bytes ..." SourceId: "\000src_id" SeqNo: 129 WriteTimestampMS: 1760106704310 CreateTimestampMS: 1760106704309 UncompressedSize: 14091 PartitionKey: "" ExplicitHash: "" } Result { Offset: 129 Data: "... 14274 bytes ..." SourceId: "\000src_id" SeqNo: 130 WriteTimestampMS: 1760106704310 CreateTimestampMS: 1760106704309 UncompressedSize: 14201 PartitionKey: "" ExplicitHash: "" } Result { Offset: 130 Data: "... 14384 bytes ..." SourceId: "\000src_id" SeqNo: 131 WriteTimestampMS: 1760106704310 CreateTimestampMS: 1760106704309 UncompressedSize: 14311 PartitionKey: "" ExplicitHash: "" } Result { Offset: 131 Data: "... 14494 bytes ..." SourceId: "\000src_id" SeqNo: 132 WriteTimestampMS: 1760106704310 CreateTimestampMS: 1760106704309 UncompressedSize: 14421 PartitionKey: "" ExplicitHash: "" } Result { Offset: 132 Data: "... 14604 bytes ..." SourceId: "\000src_id" SeqNo: 133 WriteTimestampMS: 1760106704310 CreateTimestampMS: 1760106704309 UncompressedSize: 14531 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 18446744073709551519 RealReadOffset: 132 WaitQuotaTimeMs: 0 EndOffset: 133 StartOffset: 0 } Cookie: 127 }
2025-10-10T14:31:44.311756Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.311769Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.311770Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.311773Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 272  requestId: <none> cookie: 137
2025-10-10T14:31:44.311774Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 24 from offset 133
2025-10-10T14:31:44.311777Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.311778Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 133 ReadOffset 133 ReadGuid 201e4fe6-87c07178-2e46776d-920bed34 has messages 1
2025-10-10T14:31:44.311791Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 read done: guid# 201e4fe6-87c07178-2e46776d-920bed34, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 85890
2025-10-10T14:31:44.335952Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] In ContinueReadingDataImpl, ReadSizeBudget = 66946, ReadSizeServerDelta = 412117
2025-10-10T14:31:44.335977Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 215 to 215
>>> event from dataHandler: 2025-10-10T14:31:44.336455Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 479063
2025-10-10T14:31:44.311791Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.336458Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 Message { Data: ..22121 bytes.. Information: { Offset: 201 ProducerId: "src_id" SeqNo: 202 CreateTime: 2025-10-10T14:31:44.331000Z WriteTime: 2025-10-10T14:31:44.332000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:46198", "server": "ipv6:[::1]:46198", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..22231 bytes.. Information: { Offset: 202 ProducerId: "src_id" SeqNo: 203 CreateTime: 2025-10-10T14:31:44.331000Z WriteTime: 2025-10-10T14:31:44.332000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:46198", "server": "ipv6:[::1]:46198", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..22341 bytes.. Information: { Offset: 203 ProducerId: "src_id" SeqNo: 204 CreateTime: 2025-10-10T14:31:44.331000Z WriteTime: 2025-10-10T14:31:44.332000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:46198", "server": "ipv6:[::1]:46198", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } }2025-10-10T14:31:44.336476Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 215
2025-10-10T14:31:44.311795Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 response to read: guid# 201e4fe6-87c07178-2e46776d-920bed34
2025-10-10T14:31:44.311794Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.311804Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 137 partNo : 0 messageNo: 273 size 15044 offset: -1
2025-10-10T14:31:44.311811Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.311818Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.336505Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (204-205)
2025-10-10T14:31:44.311826Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.336525Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Returning serverBytesSize = 45225 to budget
2025-10-10T14:31:44.311888Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 Process answer. Aval parts: 0
2025-10-10T14:31:44.336528Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] The application data is transferred to the client. Number of messages 3, size 66693 bytes
2025-10-10T14:31:44.311890Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.311914Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.311915Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.311920Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 274  requestId: <none> cookie: 138
2025-10-10T14:31:44.336546Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Returning serverBytesSize = 0 to budget
2025-10-10T14:31:44.336546Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (204-204)
2025-10-10T14:31:44.311926Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.311935Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.311936Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.336567Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 1} (205-205)
2025-10-10T14:31:44.311940Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.311940Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 138 partNo : 0 messageNo: 275 size 15154 offset: -1
2025-10-10T14:31:44.311943Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.311946Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.311956Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.311967Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.311969Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.311974Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 276  requestId: <none> cookie: 139
2025-10-10T14:31:44.336581Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 216 to 216
2025-10-10T14:31:44.336878Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Got ReadResponse, serverBytesSize = 114788, now ReadSizeBudget = 45225, ReadSizeServerDelta = 364275
2025-10-10T14:31:44.337010Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.337015Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 216
>>> event from dataHandler: 2025-10-10T14:31:44.337022Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] In ContinueReadingDataImpl, ReadSizeBudget = 45225, ReadSizeServerDelta = 364275
2025-10-10T14:31:44.311979Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.311987Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.311989Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.311992Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 139 partNo : 0 messageNo: 277 size 15264 offset: -1
2025-10-10T14:31:44.312000Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 Message { Data: ..22451 bytes.. Information: { Offset: 204 ProducerId: "src_id" SeqNo: 205 CreateTime: 2025-10-10T14:31:44.332000Z WriteTime: 2025-10-10T14:31:44.333000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:46198", "_ip": "ipv6:[::1]:46198" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..22561 bytes.. Information: { Offset: 205 ProducerId: "src_id" SeqNo: 206 CreateTime: 2025-10-10T14:31:44.332000Z WriteTime: 2025-10-10T14:31:44.333000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:46198", "_ip": "ipv6:[::1]:46198" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } }
2025-10-10T14:31:44.337045Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 409500
2025-10-10T14:31:44.312002Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.312043Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.312061Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.312074Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.337059Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] The application data is transferred to the client. Number of messages 2, size 45012 bytes
2025-10-10T14:31:44.312076Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.312079Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 278  requestId: <none> cookie: 140
2025-10-10T14:31:44.337063Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Returning serverBytesSize = 0 to budget
2025-10-10T14:31:44.337067Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (206-210)
2025-10-10T14:31:44.312085Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.312093Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.312094Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.337108Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 217 to 217
2025-10-10T14:31:44.337127Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.312097Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 140 partNo : 0 messageNo: 279 size 15374 offset: -1
2025-10-10T14:31:44.337133Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 217
2025-10-10T14:31:44.337105Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Returning serverBytesSize = 114788 to budget
2025-10-10T14:31:44.312099Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.312101Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.337148Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (206-206)
2025-10-10T14:31:44.312155Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.312178Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.337156Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 1} (207-207)
2025-10-10T14:31:44.312185Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.312187Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.312190Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 280  requestId: <none> cookie: 141
2025-10-10T14:31:44.337167Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 2} (208-208)
2025-10-10T14:31:44.312200Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.312206Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.337177Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 218 to 218
2025-10-10T14:31:44.312207Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.337181Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 3} (209-209)
2025-10-10T14:31:44.337182Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.337658Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 218
2025-10-10T14:31:44.312211Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 141 partNo : 0 messageNo: 281 size 15484 offset: -1
2025-10-10T14:31:44.312214Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.337211Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 4} (210-210)
2025-10-10T14:31:44.337606Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Got ReadResponse, serverBytesSize = 46765, now ReadSizeBudget = 114788, ReadSizeServerDelta = 362735
2025-10-10T14:31:44.312217Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.312316Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.337707Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] In ContinueReadingDataImpl, ReadSizeBudget = 114788, ReadSizeServerDelta = 362735
2025-10-10T14:31:44.312351Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.312376Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.312387Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.312389Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.312399Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 133 count 2 size 29654 actorID [3:7559600726884252064:2448]
2025-10-10T14:31:44.312416Z node 3 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:31:44.312421Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.337741Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 477523
2025-10-10T14:31:44.312423Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 133 partno 0 count 2 parts 0 suffix '63' size 29654
2025-10-10T14:31:44.312424Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 29552 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:31:44.312428Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.312433Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 134, partNo: 0, Offset: 133 is stored on disk
2025-10-10T14:31:44.312435Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.312436Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.337768Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 219 to 219
2025-10-10T14:31:44.312438Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 135, partNo: 0, Offset: 134 is stored on disk
2025-10-10T14:31:44.312459Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:44.337777Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.312464Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:44.337780Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 219
2025-10-10T14:31:44.312466Z node 3 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (6)
2025-10-10T14:31:44.337781Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (211-212)
2025-10-10T14:31:44.337798Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Returning serverBytesSize = 46765 to budget
2025-10-10T14:31:44.337802Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 220 to 220
2025-10-10T14:31:44.337812Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (211-211)
2025-10-10T14:31:44.312476Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 136 partNo 0
2025-10-10T14:31:44.312485Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.312492Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 136 partNo 0 FormedBlobsCount 0 NewHead: Offset 135 PartNo 0 PackedSize 15008 count 1 nextOffset 136 batches 1
2025-10-10T14:31:44.337826Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.312496Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 137 partNo 0
2025-10-10T14:31:44.337829Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 220
2025-10-10T14:31:44.312502Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 137 partNo 0 FormedBlobsCount 0 NewHead: Offset 135 PartNo 0 PackedSize 30094 count 2 nextOffset 137 batches 1
2025-10-10T14:31:44.312504Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 133 EndOffset 133 newEndOffset 135 commitOffset 0 clientCommitOffset 0 cookie 24 readingFinished 0 firstRead 0
2025-10-10T14:31:44.312505Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 138 partNo 0
2025-10-10T14:31:44.312506Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 133 endOffset 135
2025-10-10T14:31:44.312509Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 138 partNo 0 FormedBlobsCount 0 NewHead: Offset 135 PartNo 0 PackedSize 45290 count 3 nextOffset 138 batches 1
2025-10-10T14:31:44.312511Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 139 partNo 0
>>> event from dataHandler: 2025-10-10T14:31:44.337956Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 221 to 221
2025-10-10T14:31:44.337859Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 1} (212-212)
2025-10-10T14:31:44.312514Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 133, endOffset# 135, WTime# 1760106704310, sizeLag# 29654
DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 Message { Data: ..22671 bytes.. Information: { Offset: 206 ProducerId: "src_id" SeqNo: 207 CreateTime: 2025-10-10T14:31:44.333000Z WriteTime: 2025-10-10T14:31:44.334000Z MessageGroupId: "src_id" Meta: { "_ip": "ipv6:[::1]:46198", "logtype": "unknown", "server": "ipv6:[::1]:46198", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..22781 bytes.. Information: { Offset: 207 ProducerId: "src_id" SeqNo: 208 CreateTime: 2025-10-10T14:31:44.333000Z WriteTime: 2025-10-10T14:31:44.334000Z MessageGroupId: "src_id" Meta: { "_ip": "ipv6:[::1]:46198", "logtype": "unknown", "server": "ipv6:[::1]:46198", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..22891 bytes.. Information: { Offset: 208 ProducerId: "src_id" SeqNo: 209 CreateTime: 2025-10-10T14:31:44.333000Z WriteTime: 2025-10-10T14:31:44.334000Z MessageGroupId: "src_id" Meta: { "_ip": "ipv6:[::1]:46198", "logtype": "unknown", "server": "ipv6:[::1]:46198", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..23001 bytes.. Information: { Offset: 209 ProducerId: "src_id" SeqNo: 210 CreateTime: 2025-10-10T14:31:44.334000Z WriteTime: 2025-10-10T14:31:44.334000Z MessageGroupId: "src_id" Meta: { "_ip": "ipv6:[::1]:46198", "logtype": "unknown", "server": "ipv6:[::1]:46198", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..23111 bytes.. Information: { Offset: 210 ProducerId: "src_id" SeqNo: 211 CreateTime: 2025-10-10T14:31:44.334000Z WriteTime: 2025-10-10T14:31:44.334000Z MessageGroupId: "src_id" Meta: { "_ip": "ipv6:[::1]:46198", "logtype": "unknown", "server": "ipv6:[::1]:46198", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } }
2025-10-10T14:31:44.312514Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 139 partNo 0 FormedBlobsCount 0 NewHead: Offset 135 PartNo 0 PackedSize 60596 count 4 nextOffset 139 batches 1
2025-10-10T14:31:44.338383Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.312516Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1TEvPartitionReady. Aval parts: 1
2025-10-10T14:31:44.312517Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 140 partNo 0
2025-10-10T14:31:44.338434Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 221
2025-10-10T14:31:44.338440Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] The application data is transferred to the client. Number of messages 5, size 114455 bytes
2025-10-10T14:31:44.312523Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 performing read request: guid# a7e36306-1f3427dd-f13f7ed5-fc8425b8, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 2, size# 35584, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-10T14:31:44.338445Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Returning serverBytesSize = 0 to budget
2025-10-10T14:31:44.312523Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 140 partNo 0 FormedBlobsCount 0 NewHead: Offset 135 PartNo 0 PackedSize 76012 count 5 nextOffset 140 batches 1
2025-10-10T14:31:44.312526Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 141 partNo 0
2025-10-10T14:31:44.312530Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 141 partNo 0 FormedBlobsCount 0 NewHead: Offset 135 PartNo 0 PackedSize 91538 count 6 nextOffset 141 batches 1
2025-10-10T14:31:44.312532Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
>>> event from dataHandler: 2025-10-10T14:31:44.312533Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 2 maxSize 35584 maxTimeLagMs 0 readTimestampMs 0 readOffset 133 EndOffset 135 ClientCommitOffset 0 committedOffset 0 Guid a7e36306-1f3427dd-f13f7ed5-fc8425b8
DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 Message { Data: ..23221 bytes.. Information: { Offset: 211 ProducerId: "src_id" SeqNo: 212 CreateTime: 2025-10-10T14:31:44.334000Z WriteTime: 2025-10-10T14:31:44.335000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:46198", "logtype": "unknown", "_ip": "ipv6:[::1]:46198" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..23331 bytes.. Information: { Offset: 212 ProducerId: "src_id" SeqNo: 213 CreateTime: 2025-10-10T14:31:44.334000Z WriteTime: 2025-10-10T14:31:44.335000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:46198", "logtype": "unknown", "_ip": "ipv6:[::1]:46198" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } }
2025-10-10T14:31:44.312591Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 135,6 HeadOffset 135 endOffset 135 curOffset 141 d0000000000_00000000000000000135_00000_0000000006_00000? size 91410 WTime 1760106704312
2025-10-10T14:31:44.338971Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] The application data is transferred to the client. Number of messages 2, size 46552 bytes
2025-10-10T14:31:44.312622Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:182: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:31:44.338499Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Got ReadResponse, serverBytesSize = 47205, now ReadSizeBudget = 46765, ReadSizeServerDelta = 430318
2025-10-10T14:31:44.312630Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 282  requestId: <none> cookie: 142
2025-10-10T14:31:44.312644Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.312647Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.338584Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 222 to 222
2025-10-10T14:31:44.312649Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.338998Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] In ContinueReadingDataImpl, ReadSizeBudget = 46765, ReadSizeServerDelta = 430318
2025-10-10T14:31:44.339020Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.312655Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 267  requestId: <none> cookie: 134
2025-10-10T14:31:44.339026Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 222
2025-10-10T14:31:44.312660Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 269  requestId: <none> cookie: 135
2025-10-10T14:31:44.312664Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.312664Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.312667Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.312669Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.312674Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.312676Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.312681Z node 3 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:31:44.312689Z node 3 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 135 partNo 0 count 6 size 91410
2025-10-10T14:31:44.312700Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.312707Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.339066Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 477083
2025-10-10T14:31:44.312714Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 142 partNo : 0 messageNo: 285 size 15594 offset: -1
2025-10-10T14:31:44.339080Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 223 to 223
2025-10-10T14:31:44.312734Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 283  requestId: <none> cookie: 143
2025-10-10T14:31:44.312738Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 284  requestId: <none> cookie: 144
2025-10-10T14:31:44.339080Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Returning serverBytesSize = 0 to budget
2025-10-10T14:31:44.312742Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.312744Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.312747Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.312750Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.339090Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.312771Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 27 Topic 'rt3.dc1--test-topic' partition 0 user user offset 133 count 2 size 35584 endOffset 135 max time lag 0ms effective offset 133
2025-10-10T14:31:44.339107Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 223
2025-10-10T14:31:44.312784Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 27 added 1 blobs, size 29654 count 2 last offset 133, current partition end offset: 135
2025-10-10T14:31:44.312786Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 27. Send blob request.
2025-10-10T14:31:44.312790Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.312792Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.339118Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (213-214)
2025-10-10T14:31:44.339129Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 224 to 224
2025-10-10T14:31:44.312797Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 143 partNo : 0 messageNo: 286 size 15704 offset: -1
2025-10-10T14:31:44.339138Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.312801Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.339142Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 224
2025-10-10T14:31:44.312802Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.339138Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Returning serverBytesSize = 47205 to budget
2025-10-10T14:31:44.312807Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 144 partNo : 0 messageNo: 287 size 15814 offset: -1
2025-10-10T14:31:44.339180Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 225 to 225
2025-10-10T14:31:44.312814Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 133 partno 0 count 2 parts_count 0 source 1 size 29654 accessed 0 times before, last time 2025-10-10T14:31:44.000000Z
2025-10-10T14:31:44.339378Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Got ReadResponse, serverBytesSize = 47645, now ReadSizeBudget = 47205, ReadSizeServerDelta = 429438
2025-10-10T14:31:44.312817Z node 3 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 27. All 1 blobs are from cache.
2025-10-10T14:31:44.339387Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.312822Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.339389Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 225
2025-10-10T14:31:44.339387Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (213-213)
2025-10-10T14:31:44.312825Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.312827Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.312829Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.312830Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 133 partno 0 count 2 parts 0 suffix '63'
2025-10-10T14:31:44.339410Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 1} (214-214)
2025-10-10T14:31:44.312832Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:31:44.312857Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 133 totakecount 2 count 2 size 29631 from pos 0 cbcount 2
2025-10-10T14:31:44.312869Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 133
2025-10-10T14:31:44.312874Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 grpc read done: success# 1, data# { read_request { bytes_size: 85890 } }
2025-10-10T14:31:44.312883Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 got read request: guid# cc2fbd4f-299a24da-d8bf1bb5-61ebcbb2
2025-10-10T14:31:44.312891Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.312918Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 135 Result { Offset: 133 Data: "... 14714 bytes ..." SourceId: "\000src_id" SeqNo: 134 WriteTimestampMS: 1760106704311 CreateTimestampMS: 1760106704309 UncompressedSize: 14641 PartitionKey: "" ExplicitHash: "" } Result { Offset: 134 Data: "... 14824 bytes ..." SourceId: "\000src_id" SeqNo: 135 WriteTimestampMS: 1760106704311 CreateTimestampMS: 1760106704310 UncompressedSize: 14751 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 32 RealReadOffset: 134 WaitQuotaTimeMs: 0 EndOffset: 135 StartOffset: 0 } Cookie: 133 }
2025-10-10T14:31:44.312923Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.312940Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 25 from offset 135
2025-10-10T14:31:44.312941Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.339451Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] In ContinueReadingDataImpl, ReadSizeBudget = 47205, ReadSizeServerDelta = 429438
2025-10-10T14:31:44.339454Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 226 to 226
>>> event from dataHandler: 2025-10-10T14:31:44.339474Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.312944Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.339476Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 226
2025-10-10T14:31:44.312945Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 135 ReadOffset 135 ReadGuid a7e36306-1f3427dd-f13f7ed5-fc8425b8 has messages 1
2025-10-10T14:31:44.312957Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 288  requestId: <none> cookie: 145
2025-10-10T14:31:44.312961Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 read done: guid# a7e36306-1f3427dd-f13f7ed5-fc8425b8, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 29599
DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 Message { Data: ..23441 bytes.. Information: { Offset: 213 ProducerId: "src_id" SeqNo: 214 CreateTime: 2025-10-10T14:31:44.335000Z WriteTime: 2025-10-10T14:31:44.336000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:46198", "logtype": "unknown", "server": "ipv6:[::1]:46198" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..23551 bytes.. Information: { Offset: 214 ProducerId: "src_id" SeqNo: 215 CreateTime: 2025-10-10T14:31:44.335000Z WriteTime: 2025-10-10T14:31:44.336000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:46198", "logtype": "unknown", "server": "ipv6:[::1]:46198" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } }
2025-10-10T14:31:44.312965Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 response to read: guid# a7e36306-1f3427dd-f13f7ed5-fc8425b8
2025-10-10T14:31:44.312967Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.339501Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 476643
2025-10-10T14:31:44.339529Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 227 to 227
2025-10-10T14:31:44.312968Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.340131Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (215-216)
2025-10-10T14:31:44.312987Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.340074Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] The application data is transferred to the client. Number of messages 2, size 46992 bytes
2025-10-10T14:31:44.340144Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.340151Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 227
2025-10-10T14:31:44.312997Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.312998Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.313006Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 145 partNo : 0 messageNo: 289 size 15924 offset: -1
2025-10-10T14:31:44.313008Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.313010Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.340143Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Returning serverBytesSize = 47645 to budget
2025-10-10T14:31:44.313013Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.313019Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.340194Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Returning serverBytesSize = 0 to budget
2025-10-10T14:31:44.313024Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 290  requestId: <none> cookie: 146
2025-10-10T14:31:44.340197Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (215-215)
2025-10-10T14:31:44.313028Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.313048Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.313053Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.313055Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 Process answer. Aval parts: 0
2025-10-10T14:31:44.313063Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 146 partNo : 0 messageNo: 291 size 16034 offset: -1
2025-10-10T14:31:44.313066Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.313069Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.313297Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.313322Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.313362Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.340231Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 1} (216-216)
2025-10-10T14:31:44.313367Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.313370Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.313385Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 292  requestId: <none> cookie: 147
2025-10-10T14:31:44.313416Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.313425Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.313434Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.340254Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 228 to 228
2025-10-10T14:31:44.313438Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.313445Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 147 partNo : 0 messageNo: 293 size 16144 offset: -1
2025-10-10T14:31:44.313450Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.313454Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.340265Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
>>> event from dataHandler: 2025-10-10T14:31:44.340278Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 228
2025-10-10T14:31:44.313458Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.313462Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.313467Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 294  requestId: <none> cookie: 148
DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 Message { Data: ..23661 bytes.. Information: { Offset: 215 ProducerId: "src_id" SeqNo: 216 CreateTime: 2025-10-10T14:31:44.336000Z WriteTime: 2025-10-10T14:31:44.337000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:46198", "_ip": "ipv6:[::1]:46198" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..23771 bytes.. Information: { Offset: 216 ProducerId: "src_id" SeqNo: 217 CreateTime: 2025-10-10T14:31:44.337000Z WriteTime: 2025-10-10T14:31:44.337000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:46198", "_ip": "ipv6:[::1]:46198" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } }
2025-10-10T14:31:44.313477Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.340631Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Got ReadResponse, serverBytesSize = 96477, now ReadSizeBudget = 47645, ReadSizeServerDelta = 380166
2025-10-10T14:31:44.340640Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] The application data is transferred to the client. Number of messages 2, size 47432 bytes
2025-10-10T14:31:44.313487Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.313489Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.340649Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] In ContinueReadingDataImpl, ReadSizeBudget = 47645, ReadSizeServerDelta = 380166
2025-10-10T14:31:44.340364Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 229 to 229
2025-10-10T14:31:44.313498Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 148 partNo : 0 messageNo: 295 size 16254 offset: -1
2025-10-10T14:31:44.313503Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.313508Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.340672Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.340681Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 229
2025-10-10T14:31:44.313687Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 grpc read done: success# 1, data# { read_request { bytes_size: 29599 } }
2025-10-10T14:31:44.313739Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 got read request: guid# 4fa28cb2-5f7aa190-5c1e11a-b398cee0
2025-10-10T14:31:44.313745Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 135 count 6 size 91410 actorID [3:7559600726884252064:2448]
2025-10-10T14:31:44.313747Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.340725Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 427811
2025-10-10T14:31:44.313759Z node 3 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:31:44.313769Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 91296 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:31:44.340734Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Returning serverBytesSize = 0 to budget
2025-10-10T14:31:44.313775Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.313780Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 136, partNo: 0, Offset: 135 is stored on disk
2025-10-10T14:31:44.313782Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.340743Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 230 to 230
2025-10-10T14:31:44.313783Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.313785Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 137, partNo: 0, Offset: 136 is stored on disk
2025-10-10T14:31:44.340749Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (217-220)
2025-10-10T14:31:44.313786Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.313787Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 135 partno 0 count 6 parts 0 suffix '63' size 91410
2025-10-10T14:31:44.313789Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 138, partNo: 0, Offset: 137 is stored on disk
2025-10-10T14:31:44.340763Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Returning serverBytesSize = 96477 to budget
2025-10-10T14:31:44.313790Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.340752Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.313792Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 139, partNo: 0, Offset: 138 is stored on disk
2025-10-10T14:31:44.340771Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 230
2025-10-10T14:31:44.313794Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.313796Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 140, partNo: 0, Offset: 139 is stored on disk
2025-10-10T14:31:44.313798Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.340773Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (217-217)
2025-10-10T14:31:44.313800Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 141, partNo: 0, Offset: 140 is stored on disk
2025-10-10T14:31:44.313834Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:44.313845Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:44.313847Z node 3 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (7)
2025-10-10T14:31:44.340796Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 1} (218-218)
2025-10-10T14:31:44.313849Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 135 EndOffset 135 newEndOffset 141 commitOffset 0 clientCommitOffset 0 cookie 25 readingFinished 0 firstRead 0
2025-10-10T14:31:44.313852Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 135 endOffset 141
2025-10-10T14:31:44.313858Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 135, endOffset# 141, WTime# 1760106704311, sizeLag# 91410
2025-10-10T14:31:44.340809Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 2} (219-219)
2025-10-10T14:31:44.313861Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1TEvPartitionReady. Aval parts: 1
2025-10-10T14:31:44.313866Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 142 partNo 0
2025-10-10T14:31:44.313868Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 performing read request: guid# 64164a3f-e9c6fccb-e0bb45dc-92b78c12, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 7, size# 109692, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-10T14:31:44.313877Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 7 maxSize 109692 maxTimeLagMs 0 readTimestampMs 0 readOffset 135 EndOffset 141 ClientCommitOffset 0 committedOffset 0 Guid 64164a3f-e9c6fccb-e0bb45dc-92b78c12
2025-10-10T14:31:44.341385Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 3} (220-220)
2025-10-10T14:31:44.313891Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 142 partNo 0 FormedBlobsCount 0 NewHead: Offset 141 PartNo 0 PackedSize 15668 count 1 nextOffset 142 batches 1
2025-10-10T14:31:44.340822Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 231 to 231
2025-10-10T14:31:44.313896Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 143 partNo 0
2025-10-10T14:31:44.313900Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 143 partNo 0 FormedBlobsCount 0 NewHead: Offset 141 PartNo 0 PackedSize 31414 count 2 nextOffset 143 batches 1
2025-10-10T14:31:44.313903Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 144 partNo 0
2025-10-10T14:31:44.313908Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 144 partNo 0 FormedBlobsCount 0 NewHead: Offset 141 PartNo 0 PackedSize 47270 count 3 nextOffset 144 batches 1
2025-10-10T14:31:44.341414Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.341423Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 231
2025-10-10T14:31:44.313911Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 145 partNo 0
2025-10-10T14:31:44.313915Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 145 partNo 0 FormedBlobsCount 0 NewHead: Offset 141 PartNo 0 PackedSize 63236 count 4 nextOffset 145 batches 1
>>> event from dataHandler: 2025-10-10T14:31:44.313917Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 146 partNo 0
2025-10-10T14:31:44.313922Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 146 partNo 0 FormedBlobsCount 0 NewHead: Offset 141 PartNo 0 PackedSize 79312 count 5 nextOffset 146 batches 1
2025-10-10T14:31:44.313925Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 147 partNo 0
DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 Message { Data: ..23881 bytes.. Information: { Offset: 217 ProducerId: "src_id" SeqNo: 218 CreateTime: 2025-10-10T14:31:44.337000Z WriteTime: 2025-10-10T14:31:44.338000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:46198", "_ip": "ipv6:[::1]:46198" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..23991 bytes.. Information: { Offset: 218 ProducerId: "src_id" SeqNo: 219 CreateTime: 2025-10-10T14:31:44.337000Z WriteTime: 2025-10-10T14:31:44.338000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:46198", "_ip": "ipv6:[::1]:46198" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..24101 bytes.. Information: { Offset: 219 ProducerId: "src_id" SeqNo: 220 CreateTime: 2025-10-10T14:31:44.337000Z WriteTime: 2025-10-10T14:31:44.338000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:46198", "_ip": "ipv6:[::1]:46198" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..24211 bytes.. Information: { Offset: 220 ProducerId: "src_id" SeqNo: 221 CreateTime: 2025-10-10T14:31:44.337000Z WriteTime: 2025-10-10T14:31:44.338000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:46198", "_ip": "ipv6:[::1]:46198" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } }
2025-10-10T14:31:44.313928Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 147 partNo 0 FormedBlobsCount 0 NewHead: Offset 141 PartNo 0 PackedSize 95498 count 6 nextOffset 147 batches 1
2025-10-10T14:31:44.313931Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 148 partNo 0
2025-10-10T14:31:44.313934Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 148 partNo 0 FormedBlobsCount 0 NewHead: Offset 141 PartNo 0 PackedSize 111794 count 7 nextOffset 148 batches 1
2025-10-10T14:31:44.341474Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 232 to 232
2025-10-10T14:31:44.313936Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:44.342060Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.341496Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] The application data is transferred to the client. Number of messages 4, size 96184 bytes
2025-10-10T14:31:44.342067Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 232
2025-10-10T14:31:44.341895Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Got ReadResponse, serverBytesSize = 123038, now ReadSizeBudget = 96477, ReadSizeServerDelta = 304773
2025-10-10T14:31:44.314030Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 141,7 HeadOffset 141 endOffset 141 curOffset 148 d0000000000_00000000000000000141_00000_0000000007_00000? size 111634 WTime 1760106704313
2025-10-10T14:31:44.314063Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:182: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:31:44.342108Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] In ContinueReadingDataImpl, ReadSizeBudget = 96477, ReadSizeServerDelta = 304773
2025-10-10T14:31:44.314074Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 271  requestId: <none> cookie: 136
2025-10-10T14:31:44.314089Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 273  requestId: <none> cookie: 137
2025-10-10T14:31:44.314094Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 275  requestId: <none> cookie: 138
2025-10-10T14:31:44.314098Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 277  requestId: <none> cookie: 139
2025-10-10T14:31:44.314102Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.314105Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.314105Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.314113Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 279  requestId: <none> cookie: 140
2025-10-10T14:31:44.314113Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.314118Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 281  requestId: <none> cookie: 141
2025-10-10T14:31:44.314119Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.342162Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 233 to 233
2025-10-10T14:31:44.342166Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 401250
2025-10-10T14:31:44.314124Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.342197Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Returning serverBytesSize = 0 to budget
2025-10-10T14:31:44.314129Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.314131Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.342169Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.314131Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.342213Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 233
2025-10-10T14:31:44.314136Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.342219Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (221-225)
2025-10-10T14:31:44.342230Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Returning serverBytesSize = 123038 to budget
2025-10-10T14:31:44.314139Z node 3 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:31:44.314150Z node 3 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 141 partNo 0 count 7 size 111634
2025-10-10T14:31:44.314192Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 296  requestId: <none> cookie: 149
2025-10-10T14:31:44.342241Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (221-221)
2025-10-10T14:31:44.314224Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 28 Topic 'rt3.dc1--test-topic' partition 0 user user offset 135 count 7 size 109692 endOffset 141 max time lag 0ms effective offset 135
2025-10-10T14:31:44.314239Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.314241Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 28 added 1 blobs, size 91410 count 6 last offset 135, current partition end offset: 141
2025-10-10T14:31:44.314244Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 28. Send blob request.
2025-10-10T14:31:44.314253Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 135 partno 0 count 6 parts_count 0 source 1 size 91410 accessed 0 times before, last time 2025-10-10T14:31:44.000000Z
2025-10-10T14:31:44.342257Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 1} (222-222)
2025-10-10T14:31:44.314256Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.314256Z node 3 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 28. All 1 blobs are from cache.
2025-10-10T14:31:44.314264Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:31:44.314274Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 135 partno 0 count 6 parts 0 suffix '63'
2025-10-10T14:31:44.342274Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 2} (223-223)
2025-10-10T14:31:44.314320Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 135 totakecount 6 count 6 size 91387 from pos 0 cbcount 6
2025-10-10T14:31:44.314325Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.342279Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 234 to 234
2025-10-10T14:31:44.314342Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.342480Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 3} (224-224)
2025-10-10T14:31:44.342509Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.342514Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 234
2025-10-10T14:31:44.314344Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.314361Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 149 partNo : 0 messageNo: 297 size 16364 offset: -1
2025-10-10T14:31:44.342532Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 4} (225-225)
2025-10-10T14:31:44.314366Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.314367Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.314368Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.314376Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 135
2025-10-10T14:31:44.314384Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.314389Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.314405Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.314410Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 298  requestId: <none> cookie: 150
2025-10-10T14:31:44.314419Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.314435Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.314439Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.314445Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.314449Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.342598Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 235 to 235
2025-10-10T14:31:44.314457Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 150 partNo : 0 messageNo: 300 size 16475 offset: -1
2025-10-10T14:31:44.342610Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
>>> event from dataHandler: 2025-10-10T14:31:44.342613Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 235
2025-10-10T14:31:44.314465Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 Message { Data: ..24321 bytes.. Information: { Offset: 221 ProducerId: "src_id" SeqNo: 222 CreateTime: 2025-10-10T14:31:44.338000Z WriteTime: 2025-10-10T14:31:44.339000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:46198", "logtype": "unknown", "server": "ipv6:[::1]:46198" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..24431 bytes.. Information: { Offset: 222 ProducerId: "src_id" SeqNo: 223 CreateTime: 2025-10-10T14:31:44.339000Z WriteTime: 2025-10-10T14:31:44.339000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:46198", "logtype": "unknown", "server": "ipv6:[::1]:46198" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..24541 bytes.. Information: { Offset: 223 ProducerId: "src_id" SeqNo: 224 CreateTime: 2025-10-10T14:31:44.339000Z WriteTime: 2025-10-10T14:31:44.339000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:46198", "logtype": "unknown", "server": "ipv6:[::1]:46198" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..24651 bytes.. Information: { Offset: 224 ProducerId: "src_id" SeqNo: 225 CreateTime: 2025-10-10T14:31:44.339000Z WriteTime: 2025-10-10T14:31:44.339000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:46198", "logtype": "unknown", "server": "ipv6:[::1]:46198" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..24761 bytes.. Information: { Offset: 225 ProducerId: "src_id" SeqNo: 226 CreateTime: 2025-10-10T14:31:44.339000Z WriteTime: 2025-10-10T14:31:44.339000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:46198", "logtype": "unknown", "server": "ipv6:[::1]:46198" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } }
2025-10-10T14:31:44.314468Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 141 Result { Offset: 135 Data: "... 14934 bytes ..." SourceId: "\000src_id" SeqNo: 136 WriteTimestampMS: 1760106704312 CreateTimestampMS: 1760106704310 UncompressedSize: 14861 PartitionKey: "" ExplicitHash: "" } Result { Offset: 136 Data: "... 15044 bytes ..." SourceId: "\000src_id" SeqNo: 137 WriteTimestampMS: 1760106704312 CreateTimestampMS: 1760106704311 UncompressedSize: 14971 PartitionKey: "" ExplicitHash: "" } Result { Offset: 137 Data: "... 15154 bytes ..." SourceId: "\000src_id" SeqNo: 138 WriteTimestampMS: 1760106704312 CreateTimestampMS: 1760106704311 UncompressedSize: 15081 PartitionKey: "" ExplicitHash: "" } Result { Offset: 138 Data: "... 15264 bytes ..." SourceId: "\000src_id" SeqNo: 139 WriteTimestampMS: 1760106704312 CreateTimestampMS: 1760106704311 UncompressedSize: 15191 PartitionKey: "" ExplicitHash: "" } Result { Offset: 139 Data: "... 15374 bytes ..." SourceId: "\000src_id" SeqNo: 140 WriteTimestampMS: 1760106704312 CreateTimestampMS: 1760106704311 UncompressedSize: 15301 PartitionKey: "" ExplicitHash: "" } Result { Offset: 140 Data: "... 15484 bytes ..." SourceId: "\000src_id" SeqNo: 141 WriteTimestampMS: 1760106704312 CreateTimestampMS: 1760106704311 UncompressedSize: 15411 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 18446744073709551520 RealReadOffset: 140 WaitQuotaTimeMs: 0 EndOffset: 141 StartOffset: 0 } Cookie: 135 }
2025-10-10T14:31:44.342681Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] The application data is transferred to the client. Number of messages 5, size 122705 bytes
2025-10-10T14:31:44.314472Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.314476Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 299  requestId: <none> cookie: 151
2025-10-10T14:31:44.314482Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.342694Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 236 to 236
2025-10-10T14:31:44.314488Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.342768Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Got ReadResponse, serverBytesSize = 50065, now ReadSizeBudget = 123038, ReadSizeServerDelta = 351185
2025-10-10T14:31:44.343577Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.343592Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 236
2025-10-10T14:31:44.314504Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 26 from offset 141
2025-10-10T14:31:44.343599Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] In ContinueReadingDataImpl, ReadSizeBudget = 123038, ReadSizeServerDelta = 351185
2025-10-10T14:31:44.314508Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 141 ReadOffset 141 ReadGuid 64164a3f-e9c6fccb-e0bb45dc-92b78c12 has messages 1
2025-10-10T14:31:44.314534Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 read done: guid# 64164a3f-e9c6fccb-e0bb45dc-92b78c12, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 91171
2025-10-10T14:31:44.314540Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 response to read: guid# 64164a3f-e9c6fccb-e0bb45dc-92b78c12
2025-10-10T14:31:44.314572Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.314575Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.343622Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 474223
2025-10-10T14:31:44.314598Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 Process answer. Aval parts: 0
2025-10-10T14:31:44.314613Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.314615Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.343635Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Returning serverBytesSize = 0 to budget
2025-10-10T14:31:44.314620Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.343647Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (226-227)
2025-10-10T14:31:44.314623Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 151 partNo : 0 messageNo: 301 size 16585 offset: -1
2025-10-10T14:31:44.314632Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.343659Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Returning serverBytesSize = 50065 to budget
2025-10-10T14:31:44.314637Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.314641Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.314642Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.343671Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (226-226)
2025-10-10T14:31:44.314647Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.314648Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.314656Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 302  requestId: <none> cookie: 152
2025-10-10T14:31:44.343682Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 237 to 237
2025-10-10T14:31:44.343690Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.343697Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 237
2025-10-10T14:31:44.343683Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 1} (227-227)
2025-10-10T14:31:44.314666Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 303  requestId: <none> cookie: 153
2025-10-10T14:31:44.314674Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.314681Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.314703Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.343730Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 238 to 238
2025-10-10T14:31:44.343740Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.314705Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.343744Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 238
2025-10-10T14:31:44.314711Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 152 partNo : 0 messageNo: 304 size 16695 offset: -1
>>> event from dataHandler: 2025-10-10T14:31:44.314714Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.314715Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.314721Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 153 partNo : 0 messageNo: 305 size 16805 offset: -1
2025-10-10T14:31:44.314724Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.343776Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 239 to 239
DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 Message { Data: ..24871 bytes.. Information: { Offset: 226 ProducerId: "src_id" SeqNo: 227 CreateTime: 2025-10-10T14:31:44.339000Z WriteTime: 2025-10-10T14:31:44.340000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:46198", "_ip": "ipv6:[::1]:46198" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..24981 bytes.. Information: { Offset: 227 ProducerId: "src_id" SeqNo: 228 CreateTime: 2025-10-10T14:31:44.340000Z WriteTime: 2025-10-10T14:31:44.340000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:46198", "_ip": "ipv6:[::1]:46198" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } }
2025-10-10T14:31:44.344026Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Got ReadResponse, serverBytesSize = 75856, now ReadSizeBudget = 50065, ReadSizeServerDelta = 398367
2025-10-10T14:31:44.314728Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.314730Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.314732Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.344145Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] The application data is transferred to the client. Number of messages 2, size 49852 bytes
2025-10-10T14:31:44.314889Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.315002Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.315037Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.315040Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.344159Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] In ContinueReadingDataImpl, ReadSizeBudget = 50065, ReadSizeServerDelta = 398367
2025-10-10T14:31:44.315051Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 306  requestId: <none> cookie: 154
2025-10-10T14:31:44.315066Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.344169Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.315078Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.344172Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 239
2025-10-10T14:31:44.315080Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.315087Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 154 partNo : 0 messageNo: 307 size 16915 offset: -1
2025-10-10T14:31:44.315091Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.315095Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.315189Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.315234Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.315247Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.315249Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.315255Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 308  requestId: <none> cookie: 155
2025-10-10T14:31:44.315259Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.315262Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.344211Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 448432
2025-10-10T14:31:44.315292Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.344226Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 240 to 240
2025-10-10T14:31:44.344231Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.315325Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.315329Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.315337Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 155 partNo : 0 messageNo: 309 size 17025 offset: -1
2025-10-10T14:31:44.344224Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Returning serverBytesSize = 0 to budget
2025-10-10T14:31:44.315343Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.315344Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.344249Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (228-230)
2025-10-10T14:31:44.315354Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 141 count 7 size 111634 actorID [3:7559600726884252064:2448]
2025-10-10T14:31:44.315378Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.315384Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.344761Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Returning serverBytesSize = 75856 to budget
2025-10-10T14:31:44.315390Z node 3 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:31:44.344235Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 240
2025-10-10T14:31:44.315401Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 111517 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:31:44.344773Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (228-228)
2025-10-10T14:31:44.344788Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 1} (229-229)
2025-10-10T14:31:44.315407Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.315409Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 141 partno 0 count 7 parts 0 suffix '63' size 111634
2025-10-10T14:31:44.344800Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 2} (230-230)
2025-10-10T14:31:44.315412Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 142, partNo: 0, Offset: 141 is stored on disk
2025-10-10T14:31:44.315415Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.315419Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 143, partNo: 0, Offset: 142 is stored on disk
2025-10-10T14:31:44.315421Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.315424Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 144, partNo: 0, Offset: 143 is stored on disk
2025-10-10T14:31:44.315427Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.315430Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 145, partNo: 0, Offset: 144 is stored on disk
2025-10-10T14:31:44.315432Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.315435Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 146, partNo: 0, Offset: 145 is stored on disk
2025-10-10T14:31:44.315437Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.315441Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 147, partNo: 0, Offset: 146 is stored on disk
2025-10-10T14:31:44.315444Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.315448Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 148, partNo: 0, Offset: 147 is stored on disk
2025-10-10T14:31:44.315449Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 grpc read done: success# 1, data# { read_request { bytes_size: 91171 } }
2025-10-10T14:31:44.315470Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:44.315478Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:44.315479Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 got read request: guid# e60885a2-ed062651-3a8a0c50-7efab3f5
2025-10-10T14:31:44.315481Z node 3 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (7)
>>> event from dataHandler: 2025-10-10T14:31:44.315488Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 141 EndOffset 141 newEndOffset 148 commitOffset 0 clientCommitOffset 0 cookie 26 readingFinished 0 firstRead 0
2025-10-10T14:31:44.344869Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 241 to 241
2025-10-10T14:31:44.344882Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.315490Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 141 endOffset 148
DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 Message { Data: ..25091 bytes.. Information: { Offset: 228 ProducerId: "src_id" SeqNo: 229 CreateTime: 2025-10-10T14:31:44.340000Z WriteTime: 2025-10-10T14:31:44.341000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:46198", "logtype": "unknown", "_ip": "ipv6:[::1]:46198" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..25201 bytes.. Information: { Offset: 229 ProducerId: "src_id" SeqNo: 230 CreateTime: 2025-10-10T14:31:44.340000Z WriteTime: 2025-10-10T14:31:44.341000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:46198", "logtype": "unknown", "_ip": "ipv6:[::1]:46198" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..25311 bytes.. Information: { Offset: 230 ProducerId: "src_id" SeqNo: 231 CreateTime: 2025-10-10T14:31:44.340000Z WriteTime: 2025-10-10T14:31:44.341000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:46198", "logtype": "unknown", "_ip": "ipv6:[::1]:46198" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } }
2025-10-10T14:31:44.315495Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.345291Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] The application data is transferred to the client. Number of messages 3, size 75603 bytes
2025-10-10T14:31:44.315497Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 149 partNo 0
2025-10-10T14:31:44.344887Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 241
2025-10-10T14:31:44.345303Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Got ReadResponse, serverBytesSize = 102637, now ReadSizeBudget = 75856, ReadSizeServerDelta = 345795
2025-10-10T14:31:44.315520Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 149 partNo 0 FormedBlobsCount 0 NewHead: Offset 148 PartNo 0 PackedSize 16438 count 1 nextOffset 149 batches 1
2025-10-10T14:31:44.315525Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 150 partNo 0
2025-10-10T14:31:44.345324Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] In ContinueReadingDataImpl, ReadSizeBudget = 75856, ReadSizeServerDelta = 345795
2025-10-10T14:31:44.315529Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 150 partNo 0 FormedBlobsCount 0 NewHead: Offset 148 PartNo 0 PackedSize 32955 count 2 nextOffset 150 batches 1
2025-10-10T14:31:44.315529Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.315532Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 151 partNo 0
2025-10-10T14:31:44.315536Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 151 partNo 0 FormedBlobsCount 0 NewHead: Offset 148 PartNo 0 PackedSize 49582 count 3 nextOffset 151 batches 1
2025-10-10T14:31:44.315539Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 152 partNo 0
2025-10-10T14:31:44.345356Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 421651
2025-10-10T14:31:44.315542Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 152 partNo 0 FormedBlobsCount 0 NewHead: Offset 148 PartNo 0 PackedSize 66319 count 4 nextOffset 152 batches 1
2025-10-10T14:31:44.345360Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Returning serverBytesSize = 0 to budget
2025-10-10T14:31:44.315543Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 141, endOffset# 148, WTime# 1760106704312, sizeLag# 111634
2025-10-10T14:31:44.315544Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1TEvPartitionReady. Aval parts: 1
2025-10-10T14:31:44.315546Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 153 partNo 0
2025-10-10T14:31:44.315548Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 performing read request: guid# 2c9c4c7d-74d374d2-a5262a5-f68a39c1, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 8, size# 133960, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-10T14:31:44.315550Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 153 partNo 0 FormedBlobsCount 0 NewHead: Offset 148 PartNo 0 PackedSize 83166 count 5 nextOffset 153 batches 1
2025-10-10T14:31:44.315553Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 154 partNo 0
2025-10-10T14:31:44.315554Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.345385Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (231-234)
2025-10-10T14:31:44.345386Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 242 to 242
2025-10-10T14:31:44.345400Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Returning serverBytesSize = 102637 to budget
2025-10-10T14:31:44.345409Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.345413Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 242
2025-10-10T14:31:44.345414Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (231-231)
2025-10-10T14:31:44.315557Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 154 partNo 0 FormedBlobsCount 0 NewHead: Offset 148 PartNo 0 PackedSize 100123 count 6 nextOffset 154 batches 1
2025-10-10T14:31:44.315560Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 155 partNo 0
2025-10-10T14:31:44.315564Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 155 partNo 0 FormedBlobsCount 0 NewHead: Offset 148 PartNo 0 PackedSize 117190 count 7 nextOffset 155 batches 1
2025-10-10T14:31:44.315566Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:44.315593Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.315607Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 8 maxSize 133960 maxTimeLagMs 0 readTimestampMs 0 readOffset 141 EndOffset 148 ClientCommitOffset 0 committedOffset 0 Guid 2c9c4c7d-74d374d2-a5262a5-f68a39c1
2025-10-10T14:31:44.345436Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 1} (232-232)
2025-10-10T14:31:44.315647Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 148,7 HeadOffset 148 endOffset 148 curOffset 155 d0000000000_00000000000000000148_00000_0000000007_00000? size 117036 WTime 1760106704315
2025-10-10T14:31:44.345857Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 2} (233-233)
2025-10-10T14:31:44.315674Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:182: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:31:44.315680Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.345864Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 3} (234-234)
2025-10-10T14:31:44.315682Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 310  requestId: <none> cookie: 156
2025-10-10T14:31:44.315689Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 285  requestId: <none> cookie: 142
2025-10-10T14:31:44.345495Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 243 to 243
2025-10-10T14:31:44.315695Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 286  requestId: <none> cookie: 143
2025-10-10T14:31:44.315700Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 287  requestId: <none> cookie: 144
2025-10-10T14:31:44.315706Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 289  requestId: <none> cookie: 145
2025-10-10T14:31:44.315706Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.315710Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 291  requestId: <none> cookie: 146
2025-10-10T14:31:44.345900Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.315711Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.345907Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 243
2025-10-10T14:31:44.315715Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 293  requestId: <none> cookie: 147
2025-10-10T14:31:44.315716Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
>>> event from dataHandler: 2025-10-10T14:31:44.315720Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.315723Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 295  requestId: <none> cookie: 148
2025-10-10T14:31:44.315726Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.315728Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 Message { Data: ..25421 bytes.. Information: { Offset: 231 ProducerId: "src_id" SeqNo: 232 CreateTime: 2025-10-10T14:31:44.341000Z WriteTime: 2025-10-10T14:31:44.342000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "_ip": "ipv6:[::1]:46198", "server": "ipv6:[::1]:46198", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..25531 bytes.. Information: { Offset: 232 ProducerId: "src_id" SeqNo: 233 CreateTime: 2025-10-10T14:31:44.342000Z WriteTime: 2025-10-10T14:31:44.342000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "_ip": "ipv6:[::1]:46198", "server": "ipv6:[::1]:46198", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..25641 bytes.. Information: { Offset: 233 ProducerId: "src_id" SeqNo: 234 CreateTime: 2025-10-10T14:31:44.342000Z WriteTime: 2025-10-10T14:31:44.342000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "_ip": "ipv6:[::1]:46198", "server": "ipv6:[::1]:46198", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..25751 bytes.. Information: { Offset: 234 ProducerId: "src_id" SeqNo: 235 CreateTime: 2025-10-10T14:31:44.342000Z WriteTime: 2025-10-10T14:31:44.342000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "_ip": "ipv6:[::1]:46198", "server": "ipv6:[::1]:46198", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } }
2025-10-10T14:31:44.315730Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.315738Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.315741Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.315743Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.315744Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.315750Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.315750Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.315752Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.345966Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] The application data is transferred to the client. Number of messages 4, size 102344 bytes
2025-10-10T14:31:44.315756Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.345980Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Returning serverBytesSize = 0 to budget
2025-10-10T14:31:44.315756Z node 3 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:31:44.315766Z node 3 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 148 partNo 0 count 7 size 117036
2025-10-10T14:31:44.315779Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.315780Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.315788Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 156 partNo : 0 messageNo: 313 size 17135 offset: -1
2025-10-10T14:31:44.315812Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 311  requestId: <none> cookie: 157
2025-10-10T14:31:44.315819Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 312  requestId: <none> cookie: 158
2025-10-10T14:31:44.315822Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.346007Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 244 to 244
2025-10-10T14:31:44.315828Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.315842Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.315843Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 29 Topic 'rt3.dc1--test-topic' partition 0 user user offset 141 count 8 size 133960 endOffset 148 max time lag 0ms effective offset 141
2025-10-10T14:31:44.346346Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.315846Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.315856Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 29 added 1 blobs, size 111634 count 7 last offset 141, current partition end offset: 148
2025-10-10T14:31:44.346363Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 244
2025-10-10T14:31:44.346362Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Got ReadResponse, serverBytesSize = 78166, now ReadSizeBudget = 102637, ReadSizeServerDelta = 343485
2025-10-10T14:31:44.315859Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 29. Send blob request.
2025-10-10T14:31:44.315863Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.346380Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] In ContinueReadingDataImpl, ReadSizeBudget = 102637, ReadSizeServerDelta = 343485
2025-10-10T14:31:44.315865Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.315874Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 141 partno 0 count 7 parts_count 0 source 1 size 111634 accessed 0 times before, last time 2025-10-10T14:31:44.000000Z
2025-10-10T14:31:44.315879Z node 3 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 29. All 1 blobs are from cache.
2025-10-10T14:31:44.315888Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:31:44.315898Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 141 partno 0 count 7 parts 0 suffix '63'
2025-10-10T14:31:44.316038Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.316057Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 141 totakecount 7 count 7 size 111611 from pos 0 cbcount 7
2025-10-10T14:31:44.346399Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 446122
2025-10-10T14:31:44.316075Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.316076Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.316079Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.316086Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 157 partNo : 0 messageNo: 315 size 17245 offset: -1
2025-10-10T14:31:44.316091Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 314  requestId: <none> cookie: 159
2025-10-10T14:31:44.316097Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.316098Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.316105Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.316110Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 158 partNo : 0 messageNo: 316 size 17355 offset: -1
2025-10-10T14:31:44.316118Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 141
2025-10-10T14:31:44.316129Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.316130Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.346455Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (235-237)
2025-10-10T14:31:44.316134Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.346462Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Returning serverBytesSize = 78166 to budget
2025-10-10T14:31:44.316140Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.316143Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.346479Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (235-235)
2025-10-10T14:31:44.316145Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.316149Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 159 partNo : 0 messageNo: 318 size 17465 offset: -1
2025-10-10T14:31:44.316154Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.316157Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.316187Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.316189Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.316191Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 317  requestId: <none> cookie: 160
2025-10-10T14:31:44.346504Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 1} (236-236)
2025-10-10T14:31:44.316205Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.316227Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 148 Result { Offset: 141 Data: "... 15594 bytes ..." SourceId: "\000src_id" SeqNo: 142 WriteTimestampMS: 1760106704313 CreateTimestampMS: 1760106704311 UncompressedSize: 15521 PartitionKey: "" ExplicitHash: "" } Result { Offset: 142 Data: "... 15704 bytes ..." SourceId: "\000src_id" SeqNo: 143 WriteTimestampMS: 1760106704313 CreateTimestampMS: 1760106704312 UncompressedSize: 15631 PartitionKey: "" ExplicitHash: "" } Result { Offset: 143 Data: "... 15814 bytes ..." SourceId: "\000src_id" SeqNo: 144 WriteTimestampMS: 1760106704313 CreateTimestampMS: 1760106704312 UncompressedSize: 15741 PartitionKey: "" ExplicitHash: "" } Result { Offset: 144 Data: "... 15924 bytes ..." SourceId: "\000src_id" SeqNo: 145 WriteTimestampMS: 1760106704313 CreateTimestampMS: 1760106704312 UncompressedSize: 15851 PartitionKey: "" ExplicitHash: "" } Result { Offset: 145 Data: "... 16034 bytes ..." SourceId: "\000src_id" SeqNo: 146 WriteTimestampMS: 1760106704313 CreateTimestampMS: 1760106704312 UncompressedSize: 15961 PartitionKey: "" ExplicitHash: "" } Result { Offset: 146 Data: "... 16144 bytes ..." SourceId: "\000src_id" SeqNo: 147 WriteTimestampMS: 1760106704313 CreateTimestampMS: 1760106704312 UncompressedSize: 16071 PartitionKey: "" ExplicitHash: "" } Result { Offset: 147 Data: "... 16254 bytes ..." SourceId: "\000src_id" SeqNo: 148 WriteTimestampMS: 1760106704313 CreateTimestampMS: 1760106704313 UncompressedSize: 16181 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 18446744073709551488 RealReadOffset: 147 WaitQuotaTimeMs: 0 EndOffset: 148 StartOffset: 0 } Cookie: 141 }
2025-10-10T14:31:44.316241Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.316244Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.316249Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 160 partNo : 0 messageNo: 319 size 17575 offset: -1
2025-10-10T14:31:44.316252Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.316254Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.346486Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 245 to 245
2025-10-10T14:31:44.316277Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 27 from offset 148
2025-10-10T14:31:44.346906Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 2} (237-237)
2025-10-10T14:31:44.316280Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 148 ReadOffset 148 ReadGuid 2c9c4c7d-74d374d2-a5262a5-f68a39c1 has messages 1
2025-10-10T14:31:44.316309Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 read done: guid# 2c9c4c7d-74d374d2-a5262a5-f68a39c1, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 111349
2025-10-10T14:31:44.316314Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 response to read: guid# 2c9c4c7d-74d374d2-a5262a5-f68a39c1
2025-10-10T14:31:44.316439Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 Process answer. Aval parts: 0
2025-10-10T14:31:44.316854Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 148 count 7 size 117036 actorID [3:7559600726884252064:2448]
2025-10-10T14:31:44.316859Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.346931Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.316864Z node 3 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:31:44.316872Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 116913 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:31:44.346973Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 245
2025-10-10T14:31:44.316876Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.316880Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 149, partNo: 0, Offset: 148 is stored on disk
2025-10-10T14:31:44.316880Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 148 partno 0 count 7 parts 0 suffix '63' size 117036
2025-10-10T14:31:44.316882Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.316885Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 150, partNo: 0, Offset: 149 is stored on disk
2025-10-10T14:31:44.316887Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.316889Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 151, partNo: 0, Offset: 150 is stored on disk
2025-10-10T14:31:44.316891Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.316893Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 152, partNo: 0, Offset: 151 is stored on disk
2025-10-10T14:31:44.316895Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.316897Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 153, partNo: 0, Offset: 152 is stored on disk
2025-10-10T14:31:44.316899Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.316901Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 154, partNo: 0, Offset: 153 is stored on disk
2025-10-10T14:31:44.316903Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.347104Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 246 to 246
>>> event from dataHandler: 2025-10-10T14:31:44.347567Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.316907Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 155, partNo: 0, Offset: 154 is stored on disk
2025-10-10T14:31:44.316926Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 Message { Data: ..25861 bytes.. Information: { Offset: 235 ProducerId: "src_id" SeqNo: 236 CreateTime: 2025-10-10T14:31:44.342000Z WriteTime: 2025-10-10T14:31:44.344000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:46198", "_ip": "ipv6:[::1]:46198" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..25971 bytes.. Information: { Offset: 236 ProducerId: "src_id" SeqNo: 237 CreateTime: 2025-10-10T14:31:44.343000Z WriteTime: 2025-10-10T14:31:44.344000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:46198", "_ip": "ipv6:[::1]:46198" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..26081 bytes.. Information: { Offset: 237 ProducerId: "src_id" SeqNo: 238 CreateTime: 2025-10-10T14:31:44.343000Z WriteTime: 2025-10-10T14:31:44.344000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:46198", "_ip": "ipv6:[::1]:46198" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } }
2025-10-10T14:31:44.316953Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 grpc read done: success# 1, data# { read_request { bytes_size: 111349 } }
2025-10-10T14:31:44.316963Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 got read request: guid# b5816f99-82af3b4f-af60f3ef-42041a3f
2025-10-10T14:31:44.347574Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 246
2025-10-10T14:31:44.317064Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:44.317071Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:44.317072Z node 3 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (5)
2025-10-10T14:31:44.317084Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 148 EndOffset 148 newEndOffset 155 commitOffset 0 clientCommitOffset 0 cookie 27 readingFinished 0 firstRead 0
2025-10-10T14:31:44.317085Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 156 partNo 0
2025-10-10T14:31:44.347609Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] The application data is transferred to the client. Number of messages 3, size 77913 bytes
2025-10-10T14:31:44.347625Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Returning serverBytesSize = 0 to budget
2025-10-10T14:31:44.317086Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 148 endOffset 155
2025-10-10T14:31:44.317092Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.317105Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 156 partNo 0 FormedBlobsCount 0 NewHead: Offset 155 PartNo 0 PackedSize 17209 count 1 nextOffset 156 batches 1
2025-10-10T14:31:44.317112Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 157 partNo 0
2025-10-10T14:31:44.317116Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 157 partNo 0 FormedBlobsCount 0 NewHead: Offset 155 PartNo 0 PackedSize 34496 count 2 nextOffset 157 batches 1
2025-10-10T14:31:44.317118Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.317120Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 158 partNo 0
2025-10-10T14:31:44.317126Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 158 partNo 0 FormedBlobsCount 0 NewHead: Offset 155 PartNo 0 PackedSize 51893 count 3 nextOffset 158 batches 1
2025-10-10T14:31:44.317129Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 159 partNo 0
2025-10-10T14:31:44.317132Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 148, endOffset# 155, WTime# 1760106704313, sizeLag# 117036
2025-10-10T14:31:44.317132Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 159 partNo 0 FormedBlobsCount 0 NewHead: Offset 155 PartNo 0 PackedSize 69400 count 4 nextOffset 159 batches 1
2025-10-10T14:31:44.317135Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1TEvPartitionReady. Aval parts: 1
2025-10-10T14:31:44.317137Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 160 partNo 0
2025-10-10T14:31:44.317141Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 performing read request: guid# 4af66bd2-9528196e-28353123-2652578c, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 8, size# 140443, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-10T14:31:44.317141Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 160 partNo 0 FormedBlobsCount 0 NewHead: Offset 155 PartNo 0 PackedSize 87017 count 5 nextOffset 160 batches 1
2025-10-10T14:31:44.317144Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:44.317151Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 8 maxSize 140443 maxTimeLagMs 0 readTimestampMs 0 readOffset 148 EndOffset 155 ClientCommitOffset 0 committedOffset 0 Guid 4af66bd2-9528196e-28353123-2652578c
2025-10-10T14:31:44.347738Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 247 to 247
2025-10-10T14:31:44.347747Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Got ReadResponse, serverBytesSize = 52705, now ReadSizeBudget = 78166, ReadSizeServerDelta = 393417
2025-10-10T14:31:44.348164Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.348170Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 247
2025-10-10T14:31:44.317210Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 155,5 HeadOffset 155 endOffset 155 curOffset 160 d0000000000_00000000000000000155_00000_0000000005_00000? size 86926 WTime 1760106704316
2025-10-10T14:31:44.348177Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] In ContinueReadingDataImpl, ReadSizeBudget = 78166, ReadSizeServerDelta = 393417
2025-10-10T14:31:44.317293Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:182: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:31:44.317303Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 297  requestId: <none> cookie: 149
2025-10-10T14:31:44.348196Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 471583
2025-10-10T14:31:44.317317Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 300  requestId: <none> cookie: 150
2025-10-10T14:31:44.317323Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 301  requestId: <none> cookie: 151
2025-10-10T14:31:44.317342Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.317343Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 304  requestId: <none> cookie: 152
2025-10-10T14:31:44.317348Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 305  requestId: <none> cookie: 153
2025-10-10T14:31:44.317350Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.317352Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 307  requestId: <none> cookie: 154
2025-10-10T14:31:44.317355Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.317357Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 309  requestId: <none> cookie: 155
2025-10-10T14:31:44.317360Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.348228Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (238-239)
2025-10-10T14:31:44.317363Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.348245Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 248 to 248
2025-10-10T14:31:44.317366Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.348240Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Returning serverBytesSize = 52705 to budget
2025-10-10T14:31:44.348251Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.348254Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 248
2025-10-10T14:31:44.317368Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.317374Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.317375Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.317377Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.317379Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.317384Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.317385Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.317390Z node 3 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:31:44.317397Z node 3 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 155 partNo 0 count 5 size 86926
2025-10-10T14:31:44.317422Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 320  requestId: <none> cookie: 161
2025-10-10T14:31:44.317424Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 321  requestId: <none> cookie: 162
2025-10-10T14:31:44.317443Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 30 Topic 'rt3.dc1--test-topic' partition 0 user user offset 148 count 8 size 140443 endOffset 155 max time lag 0ms effective offset 148
2025-10-10T14:31:44.348298Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (238-238)
2025-10-10T14:31:44.348299Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 249 to 249
2025-10-10T14:31:44.348305Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.348583Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 249
2025-10-10T14:31:44.317456Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 30 added 1 blobs, size 117036 count 7 last offset 148, current partition end offset: 155
2025-10-10T14:31:44.348596Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Got ReadResponse, serverBytesSize = 79816, now ReadSizeBudget = 52705, ReadSizeServerDelta = 391767
2025-10-10T14:31:44.348311Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 1} (239-239)
2025-10-10T14:31:44.317458Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 30. Send blob request.
2025-10-10T14:31:44.317466Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 148 partno 0 count 7 parts_count 0 source 1 size 117036 accessed 0 times before, last time 2025-10-10T14:31:44.000000Z
2025-10-10T14:31:44.317476Z node 3 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 30. All 1 blobs are from cache.
2025-10-10T14:31:44.317482Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:31:44.317486Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 148 partno 0 count 7 parts 0 suffix '63'
2025-10-10T14:31:44.348631Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] In ContinueReadingDataImpl, ReadSizeBudget = 52705, ReadSizeServerDelta = 391767
2025-10-10T14:31:44.317488Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.317492Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.317539Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 148 totakecount 7 count 7 size 117013 from pos 0 cbcount 7
2025-10-10T14:31:44.317553Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.317555Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.317561Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 161 partNo : 0 messageNo: 322 size 17685 offset: -1
2025-10-10T14:31:44.317564Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.317566Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.317570Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 162 partNo : 0 messageNo: 323 size 17795 offset: -1
2025-10-10T14:31:44.317579Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 148
2025-10-10T14:31:44.317585Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.317590Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.317591Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.317592Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.348674Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 444472
2025-10-10T14:31:44.317692Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 155 Result { Offset: 148 Data: "... 16364 bytes ..." SourceId: "\000src_id" SeqNo: 149 WriteTimestampMS: 1760106704315 CreateTimestampMS: 1760106704313 UncompressedSize: 16291 PartitionKey: "" ExplicitHash: "" } Result { Offset: 149 Data: "... 16475 bytes ..." SourceId: "\000src_id" SeqNo: 150 WriteTimestampMS: 1760106704315 CreateTimestampMS: 1760106704313 UncompressedSize: 16401 PartitionKey: "" ExplicitHash: "" } Result { Offset: 150 Data: "... 16585 bytes ..." SourceId: "\000src_id" SeqNo: 151 WriteTimestampMS: 1760106704315 CreateTimestampMS: 1760106704314 UncompressedSize: 16511 PartitionKey: "" ExplicitHash: "" } Result { Offset: 151 Data: "... 16695 bytes ..." SourceId: "\000src_id" SeqNo: 152 WriteTimestampMS: 1760106704315 CreateTimestampMS: 1760106704314 UncompressedSize: 16621 PartitionKey: "" ExplicitHash: "" } Result { Offset: 152 Data: "... 16805 bytes ..." SourceId: "\000src_id" SeqNo: 153 WriteTimestampMS: 1760106704315 CreateTimestampMS: 1760106704314 UncompressedSize: 16731 PartitionKey: "" ExplicitHash: "" } Result { Offset: 153 Data: "... 16915 bytes ..." SourceId: "\000src_id" SeqNo: 154 WriteTimestampMS: 1760106704315 CreateTimestampMS: 1760106704314 UncompressedSize: 16841 PartitionKey: "" ExplicitHash: "" } Result { Offset: 154 Data: "... 17025 bytes ..." SourceId: "\000src_id" SeqNo: 155 WriteTimestampMS: 1760106704315 CreateTimestampMS: 1760106704314 UncompressedSize: 16951 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 18446744073709551494 RealReadOffset: 154 WaitQuotaTimeMs: 0 EndOffset: 155 StartOffset: 0 } Cookie: 148 }
2025-10-10T14:31:44.317747Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 28 from offset 155
2025-10-10T14:31:44.317752Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 155 ReadOffset 155 ReadGuid 4af66bd2-9528196e-28353123-2652578c has messages 1
2025-10-10T14:31:44.317770Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 read done: guid# 4af66bd2-9528196e-28353123-2652578c, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 116757
2025-10-10T14:31:44.348685Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 250 to 250
2025-10-10T14:31:44.348709Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.348712Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 250
>>> event from dataHandler: 2025-10-10T14:31:44.317775Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 response to read: guid# 4af66bd2-9528196e-28353123-2652578c
2025-10-10T14:31:44.348717Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (240-242)
2025-10-10T14:31:44.317805Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.317824Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 Process answer. Aval parts: 0
DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 Message { Data: ..26191 bytes.. Information: { Offset: 238 ProducerId: "src_id" SeqNo: 239 CreateTime: 2025-10-10T14:31:44.343000Z WriteTime: 2025-10-10T14:31:44.345000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:46198", "_ip": "ipv6:[::1]:46198" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..26301 bytes.. Information: { Offset: 239 ProducerId: "src_id" SeqNo: 240 CreateTime: 2025-10-10T14:31:44.344000Z WriteTime: 2025-10-10T14:31:44.345000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:46198", "_ip": "ipv6:[::1]:46198" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } }2025-10-10T14:31:44.317833Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.349254Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Returning serverBytesSize = 79816 to budget
2025-10-10T14:31:44.317870Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.317872Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.317879Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 324  requestId: <none> cookie: 163
2025-10-10T14:31:44.348741Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 251 to 251
2025-10-10T14:31:44.317891Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.317990Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.317993Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.349294Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.349296Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] The application data is transferred to the client. Number of messages 2, size 52492 bytes
2025-10-10T14:31:44.349309Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Returning serverBytesSize = 0 to budget
2025-10-10T14:31:44.318002Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 163 partNo : 0 messageNo: 325 size 17905 offset: -1
2025-10-10T14:31:44.318006Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.318013Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.349298Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 251
2025-10-10T14:31:44.318301Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.318332Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.318368Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 155 count 5 size 86926 actorID [3:7559600726884252064:2448]
2025-10-10T14:31:44.349352Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (240-240)
2025-10-10T14:31:44.318376Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.318378Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.349368Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 1} (241-241)
2025-10-10T14:31:44.318381Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 155 partno 0 count 5 parts 0 suffix '63' size 86926
2025-10-10T14:31:44.318384Z node 3 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:31:44.349383Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 2} (242-242)
2025-10-10T14:31:44.318395Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 86810 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:31:44.318400Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.318405Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 156, partNo: 0, Offset: 155 is stored on disk
2025-10-10T14:31:44.318409Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.318413Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 157, partNo: 0, Offset: 156 is stored on disk
2025-10-10T14:31:44.318415Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.318418Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 grpc read done: success# 1, data# { read_request { bytes_size: 116757 } }
2025-10-10T14:31:44.318419Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 158, partNo: 0, Offset: 157 is stored on disk
2025-10-10T14:31:44.318422Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.318426Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 159, partNo: 0, Offset: 158 is stored on disk
2025-10-10T14:31:44.318428Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.318431Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 160, partNo: 0, Offset: 159 is stored on disk
2025-10-10T14:31:44.318452Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:44.318454Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 got read request: guid# ed0d76be-ecac8d4-14744c4a-ef281929
2025-10-10T14:31:44.349428Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 252 to 252
>>> event from dataHandler: 2025-10-10T14:31:44.349835Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.349838Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 252
2025-10-10T14:31:44.349555Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Got ReadResponse, serverBytesSize = 53805, now ReadSizeBudget = 79816, ReadSizeServerDelta = 390667
DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 Message { Data: ..26411 bytes.. Information: { Offset: 240 ProducerId: "src_id" SeqNo: 241 CreateTime: 2025-10-10T14:31:44.344000Z WriteTime: 2025-10-10T14:31:44.346000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:46198", "logtype": "unknown", "server": "ipv6:[::1]:46198" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..26521 bytes.. Information: { Offset: 241 ProducerId: "src_id" SeqNo: 242 CreateTime: 2025-10-10T14:31:44.345000Z WriteTime: 2025-10-10T14:31:44.346000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:46198", "logtype": "unknown", "server": "ipv6:[::1]:46198" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..26631 bytes.. Information: { Offset: 242 ProducerId: "src_id" SeqNo: 243 CreateTime: 2025-10-10T14:31:44.345000Z WriteTime: 2025-10-10T14:31:44.346000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:46198", "logtype": "unknown", "server": "ipv6:[::1]:46198" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } }
2025-10-10T14:31:44.349862Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] In ContinueReadingDataImpl, ReadSizeBudget = 79816, ReadSizeServerDelta = 390667
2025-10-10T14:31:44.318458Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:44.318460Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.318461Z node 3 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2025-10-10T14:31:44.318472Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 161 partNo 0
2025-10-10T14:31:44.318486Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.349887Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] The application data is transferred to the client. Number of messages 3, size 79563 bytes
2025-10-10T14:31:44.318490Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 161 partNo 0 FormedBlobsCount 0 NewHead: Offset 160 PartNo 0 PackedSize 17759 count 1 nextOffset 161 batches 1
2025-10-10T14:31:44.318493Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 162 partNo 0
2025-10-10T14:31:44.349907Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 470483
2025-10-10T14:31:44.318495Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 162 partNo 0 FormedBlobsCount 0 NewHead: Offset 160 PartNo 0 PackedSize 35596 count 2 nextOffset 162 batches 1
2025-10-10T14:31:44.318497Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 163 partNo 0
2025-10-10T14:31:44.349914Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Returning serverBytesSize = 0 to budget
2025-10-10T14:31:44.318501Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 163 partNo 0 FormedBlobsCount 0 NewHead: Offset 160 PartNo 0 PackedSize 53543 count 3 nextOffset 163 batches 1
2025-10-10T14:31:44.318502Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:44.318503Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 155 EndOffset 155 newEndOffset 160 commitOffset 0 clientCommitOffset 0 cookie 28 readingFinished 0 firstRead 0
2025-10-10T14:31:44.318506Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 155 endOffset 160
2025-10-10T14:31:44.349931Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (243-244)
2025-10-10T14:31:44.349938Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 253 to 253
2025-10-10T14:31:44.318511Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 155, endOffset# 160, WTime# 1760106704315, sizeLag# 86926
2025-10-10T14:31:44.349944Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.318512Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1TEvPartitionReady. Aval parts: 1
2025-10-10T14:31:44.318517Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 performing read request: guid# 4f5073d3-68debcc7-eb8e4fe3-9c3be029, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 6, size# 104311, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-10T14:31:44.349951Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 253
2025-10-10T14:31:44.349945Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Returning serverBytesSize = 53805 to budget
2025-10-10T14:31:44.318523Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 6 maxSize 104311 maxTimeLagMs 0 readTimestampMs 0 readOffset 155 EndOffset 160 ClientCommitOffset 0 committedOffset 0 Guid 4f5073d3-68debcc7-eb8e4fe3-9c3be029
2025-10-10T14:31:44.350462Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (243-243)
2025-10-10T14:31:44.318536Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.318552Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 160,3 HeadOffset 160 endOffset 160 curOffset 163 d0000000000_00000000000000000160_00000_0000000003_00000? size 53514 WTime 1760106704318
2025-10-10T14:31:44.318553Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.318651Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.350473Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 1} (244-244)
>>> event from dataHandler: DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 Message { Data: ..26741 bytes.. Information: { Offset: 243 ProducerId: "src_id" SeqNo: 244 CreateTime: 2025-10-10T14:31:44.345000Z WriteTime: 2025-10-10T14:31:44.347000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:46198", "server": "ipv6:[::1]:46198" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..26851 bytes.. Information: { Offset: 244 ProducerId: "src_id" SeqNo: 245 CreateTime: 2025-10-10T14:31:44.346000Z WriteTime: 2025-10-10T14:31:44.347000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:46198", "server": "ipv6:[::1]:46198" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } }
2025-10-10T14:31:44.350520Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 254 to 254
2025-10-10T14:31:44.350531Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.350540Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 254
2025-10-10T14:31:44.350531Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] The application data is transferred to the client. Number of messages 2, size 53592 bytes
2025-10-10T14:31:44.350547Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Returning serverBytesSize = 0 to budget
2025-10-10T14:31:44.350610Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 255 to 255
2025-10-10T14:31:44.350615Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.350619Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 255
2025-10-10T14:31:44.350644Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 256 to 256
2025-10-10T14:31:44.350648Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.350649Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 256
2025-10-10T14:31:44.350677Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 257 to 257
2025-10-10T14:31:44.350686Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.350688Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 257
2025-10-10T14:31:44.350711Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 258 to 258
2025-10-10T14:31:44.350720Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.350722Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 258
2025-10-10T14:31:44.318696Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.319068Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:182: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:31:44.319082Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 313  requestId: <none> cookie: 156
2025-10-10T14:31:44.319099Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 315  requestId: <none> cookie: 157
2025-10-10T14:31:44.319104Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 316  requestId: <none> cookie: 158
2025-10-10T14:31:44.319108Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 318  requestId: <none> cookie: 159
2025-10-10T14:31:44.319112Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 319  requestId: <none> cookie: 160
2025-10-10T14:31:44.319118Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.319119Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.319120Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.319127Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.319132Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.319132Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.319133Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.350879Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 259 to 259
2025-10-10T14:31:44.319137Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.319139Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.319141Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.350889Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.319143Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.350892Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 259
2025-10-10T14:31:44.319144Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.319146Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.319149Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.319150Z node 3 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:31:44.319161Z node 3 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 160 partNo 0 count 3 size 53514
2025-10-10T14:31:44.319178Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 326  requestId: <none> cookie: 164
2025-10-10T14:31:44.319212Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 327  requestId: <none> cookie: 165
2025-10-10T14:31:44.319220Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 328  requestId: <none> cookie: 166
2025-10-10T14:31:44.350909Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 260 to 260
2025-10-10T14:31:44.319223Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 329  requestId: <none> cookie: 167
2025-10-10T14:31:44.319241Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 31 Topic 'rt3.dc1--test-topic' partition 0 user user offset 155 count 6 size 104311 endOffset 160 max time lag 0ms effective offset 155
2025-10-10T14:31:44.350916Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.319254Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 31 added 1 blobs, size 86926 count 5 last offset 155, current partition end offset: 160
2025-10-10T14:31:44.350918Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 260
2025-10-10T14:31:44.319257Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 31. Send blob request.
2025-10-10T14:31:44.319265Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 155 partno 0 count 5 parts_count 0 source 1 size 86926 accessed 0 times before, last time 2025-10-10T14:31:44.000000Z
2025-10-10T14:31:44.319268Z node 3 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 31. All 1 blobs are from cache.
2025-10-10T14:31:44.319275Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:31:44.319294Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 155 partno 0 count 5 parts 0 suffix '63'
2025-10-10T14:31:44.319333Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 155 totakecount 5 count 5 size 86903 from pos 0 cbcount 5
2025-10-10T14:31:44.319337Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.350938Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Got ReadResponse, serverBytesSize = 108797, now ReadSizeBudget = 53805, ReadSizeServerDelta = 361686
2025-10-10T14:31:44.319343Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.319348Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.350959Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 261 to 261
2025-10-10T14:31:44.319353Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.319355Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 155
2025-10-10T14:31:44.350964Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] In ContinueReadingDataImpl, ReadSizeBudget = 53805, ReadSizeServerDelta = 361686
2025-10-10T14:31:44.319358Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.350969Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.319376Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.319402Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.319412Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.350983Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 415491
2025-10-10T14:31:44.350971Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 261
2025-10-10T14:31:44.319416Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.319423Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 160 Result { Offset: 155 Data: "... 17135 bytes ..." SourceId: "\000src_id" SeqNo: 156 WriteTimestampMS: 1760106704316 CreateTimestampMS: 1760106704314 UncompressedSize: 17061 PartitionKey: "" ExplicitHash: "" } Result { Offset: 156 Data: "... 17245 bytes ..." SourceId: "\000src_id" SeqNo: 157 WriteTimestampMS: 1760106704316 CreateTimestampMS: 1760106704315 UncompressedSize: 17171 PartitionKey: "" ExplicitHash: "" } Result { Offset: 157 Data: "... 17355 bytes ..." SourceId: "\000src_id" SeqNo: 158 WriteTimestampMS: 1760106704316 CreateTimestampMS: 1760106704315 UncompressedSize: 17281 PartitionKey: "" ExplicitHash: "" } Result { Offset: 158 Data: "... 17465 bytes ..." SourceId: "\000src_id" SeqNo: 159 WriteTimestampMS: 1760106704316 CreateTimestampMS: 1760106704315 UncompressedSize: 17391 PartitionKey: "" ExplicitHash: "" } Result { Offset: 159 Data: "... 17575 bytes ..." SourceId: "\000src_id" SeqNo: 160 WriteTimestampMS: 1760106704316 CreateTimestampMS: 1760106704315 UncompressedSize: 17501 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 18446744073709551557 RealReadOffset: 159 WaitQuotaTimeMs: 0 EndOffset: 160 StartOffset: 0 } Cookie: 155 }
2025-10-10T14:31:44.319425Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 164 partNo : 0 messageNo: 330 size 18015 offset: -1
2025-10-10T14:31:44.319431Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.319432Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.319437Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 165 partNo : 0 messageNo: 331 size 18125 offset: -1
2025-10-10T14:31:44.319440Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.319442Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.319447Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 166 partNo : 0 messageNo: 332 size 18235 offset: -1
2025-10-10T14:31:44.351023Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (245-248)
2025-10-10T14:31:44.351028Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 262 to 262
2025-10-10T14:31:44.319451Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.351038Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.351040Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 262
2025-10-10T14:31:44.351035Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Returning serverBytesSize = 108797 to budget
2025-10-10T14:31:44.319453Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.319459Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 167 partNo : 0 messageNo: 333 size 18345 offset: -1
2025-10-10T14:31:44.319462Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.351053Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (245-245)
2025-10-10T14:31:44.319464Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.319469Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.319471Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.319477Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.351064Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 1} (246-246)
2025-10-10T14:31:44.319485Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 29 from offset 160
2025-10-10T14:31:44.319486Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.319488Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.319490Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.319490Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 160 ReadOffset 160 ReadGuid 4f5073d3-68debcc7-eb8e4fe3-9c3be029 has messages 1
2025-10-10T14:31:44.319491Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.319494Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.351084Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 263 to 263
2025-10-10T14:31:44.319496Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.319498Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.319506Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 334  requestId: <none> cookie: 168
2025-10-10T14:31:44.319509Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.319511Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 335  requestId: <none> cookie: 169
2025-10-10T14:31:44.351751Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Got ReadResponse, serverBytesSize = 55125, now ReadSizeBudget = 108797, ReadSizeServerDelta = 360366
2025-10-10T14:31:44.319518Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.351102Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 2} (247-247)
2025-10-10T14:31:44.352039Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.352043Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 263
2025-10-10T14:31:44.319526Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 read done: guid# 4f5073d3-68debcc7-eb8e4fe3-9c3be029, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 86738
2025-10-10T14:31:44.352044Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 3} (248-248)
2025-10-10T14:31:44.319532Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 response to read: guid# 4f5073d3-68debcc7-eb8e4fe3-9c3be029
2025-10-10T14:31:44.319553Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.319571Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.319582Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.319585Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.319594Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 168 partNo : 0 messageNo: 336 size 18455 offset: -1
2025-10-10T14:31:44.319598Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.319600Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.319612Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 169 partNo : 0 messageNo: 337 size 18565 offset: -1
2025-10-10T14:31:44.352079Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] In ContinueReadingDataImpl, ReadSizeBudget = 108797, ReadSizeServerDelta = 360366
2025-10-10T14:31:44.319616Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.319618Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.319626Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.319632Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.319634Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.352106Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 469163
2025-10-10T14:31:44.319636Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.319648Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 338  requestId: <none> cookie: 170
2025-10-10T14:31:44.319659Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 Process answer. Aval parts: 0
2025-10-10T14:31:44.319683Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.319707Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.319723Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.319724Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.319729Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 170 partNo : 0 messageNo: 339 size 18675 offset: -1
2025-10-10T14:31:44.319733Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.352138Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (249-250)
2025-10-10T14:31:44.319736Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.352149Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Returning serverBytesSize = 55125 to budget
2025-10-10T14:31:44.319755Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.319773Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.319776Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.319786Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 340  requestId: <none> cookie: 171
2025-10-10T14:31:44.319799Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.319810Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.352154Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 264 to 264
2025-10-10T14:31:44.319811Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.319819Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 171 partNo : 0 messageNo: 341 size 18785 offset: -1
2025-10-10T14:31:44.319823Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.319829Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.352161Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (249-249)
2025-10-10T14:31:44.352626Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.352635Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 264
>>> event from dataHandler: 2025-10-10T14:31:44.320050Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 160 count 3 size 53514 actorID [3:7559600726884252064:2448]
2025-10-10T14:31:44.352649Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 1} (250-250)
2025-10-10T14:31:44.320063Z node 3 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:31:44.320077Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 160 partno 0 count 3 parts 0 suffix '63' size 53514
2025-10-10T14:31:44.320083Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 53406 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:31:44.320089Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.320095Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 161, partNo: 0, Offset: 160 is stored on disk
2025-10-10T14:31:44.320098Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.320103Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 162, partNo: 0, Offset: 161 is stored on disk
2025-10-10T14:31:44.320106Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.320111Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 163, partNo: 0, Offset: 162 is stored on disk
2025-10-10T14:31:44.320137Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:44.320146Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:44.320149Z node 3 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (8)
2025-10-10T14:31:44.320158Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 160 EndOffset 160 newEndOffset 163 commitOffset 0 clientCommitOffset 0 cookie 29 readingFinished 0 firstRead 0
2025-10-10T14:31:44.320161Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 164 partNo 0
2025-10-10T14:31:44.320162Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 160 endOffset 163
2025-10-10T14:31:44.320168Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.320197Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 164 partNo 0 FormedBlobsCount 0 NewHead: Offset 163 PartNo 0 PackedSize 18089 count 1 nextOffset 164 batches 1
2025-10-10T14:31:44.320203Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 165 partNo 0
2025-10-10T14:31:44.320208Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 165 partNo 0 FormedBlobsCount 0 NewHead: Offset 163 PartNo 0 PackedSize 36256 count 2 nextOffset 165 batches 1
2025-10-10T14:31:44.320211Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 166 partNo 0
2025-10-10T14:31:44.320216Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 166 partNo 0 FormedBlobsCount 0 NewHead: Offset 163 PartNo 0 PackedSize 54533 count 3 nextOffset 166 batches 1
2025-10-10T14:31:44.320221Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 167 partNo 0
2025-10-10T14:31:44.320225Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 167 partNo 0 FormedBlobsCount 0 NewHead: Offset 163 PartNo 0 PackedSize 72920 count 4 nextOffset 167 batches 1
2025-10-10T14:31:44.320228Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 168 partNo 0
DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 Message { Data: ..26961 bytes.. Information: { Offset: 245 ProducerId: "src_id" SeqNo: 246 CreateTime: 2025-10-10T14:31:44.347000Z WriteTime: 2025-10-10T14:31:44.348000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:46198", "logtype": "unknown", "_ip": "ipv6:[::1]:46198" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..27071 bytes.. Information: { Offset: 246 ProducerId: "src_id" SeqNo: 247 CreateTime: 2025-10-10T14:31:44.347000Z WriteTime: 2025-10-10T14:31:44.348000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:46198", "logtype": "unknown", "_ip": "ipv6:[::1]:46198" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..27181 bytes.. Information: { Offset: 247 ProducerId: "src_id" SeqNo: 248 CreateTime: 2025-10-10T14:31:44.348000Z WriteTime: 2025-10-10T14:31:44.348000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:46198", "logtype": "unknown", "_ip": "ipv6:[::1]:46198" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..27291 bytes.. Information: { Offset: 248 ProducerId: "src_id" SeqNo: 249 CreateTime: 2025-10-10T14:31:44.348000Z WriteTime: 2025-10-10T14:31:44.348000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:46198", "logtype": "unknown", "_ip": "ipv6:[::1]:46198" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } }2025-10-10T14:31:44.320232Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 168 partNo 0 FormedBlobsCount 0 NewHead: Offset 163 PartNo 0 PackedSize 91417 count 5 nextOffset 168 batches 1
2025-10-10T14:31:44.320233Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.320236Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 169 partNo 0
2025-10-10T14:31:44.320239Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 169 partNo 0 FormedBlobsCount 0 NewHead: Offset 163 PartNo 0 PackedSize 110024 count 6 nextOffset 169 batches 1
2025-10-10T14:31:44.320241Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 170 partNo 0
2025-10-10T14:31:44.352754Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 265 to 265
2025-10-10T14:31:44.320244Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 170 partNo 0 FormedBlobsCount 0 NewHead: Offset 163 PartNo 0 PackedSize 128741 count 7 nextOffset 170 batches 1
2025-10-10T14:31:44.353157Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.320246Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 171 partNo 0
2025-10-10T14:31:44.353163Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 265
2025-10-10T14:31:44.320248Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 171 partNo 0 FormedBlobsCount 0 NewHead: Offset 163 PartNo 0 PackedSize 147568 count 8 nextOffset 171 batches 1
2025-10-10T14:31:44.353167Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] The application data is transferred to the client. Number of messages 4, size 108504 bytes
2025-10-10T14:31:44.320250Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:44.320252Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 160, endOffset# 163, WTime# 1760106704316, sizeLag# 53514
2025-10-10T14:31:44.320254Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1TEvPartitionReady. Aval parts: 1
2025-10-10T14:31:44.353175Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Returning serverBytesSize = 0 to budget
2025-10-10T14:31:44.320262Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 performing read request: guid# 24733a76-d05ceea3-7899a8d1-205b593, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 3, size# 64216, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-10T14:31:44.320270Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 3 maxSize 64216 maxTimeLagMs 0 readTimestampMs 0 readOffset 160 EndOffset 163 ClientCommitOffset 0 committedOffset 0 Guid 24733a76-d05ceea3-7899a8d1-205b593
2025-10-10T14:31:44.320307Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 grpc read done: success# 1, data# { read_request { bytes_size: 86738 } }
2025-10-10T14:31:44.320316Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 got read request: guid# 3a324196-baa4b254-7d62b309-f062c815
2025-10-10T14:31:44.320320Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.320337Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.320498Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 163,8 HeadOffset 163 endOffset 163 curOffset 171 d0000000000_00000000000000000163_00000_0000000008_00000? size 147384 WTime 1760106704320
2025-10-10T14:31:44.353196Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Got ReadResponse, serverBytesSize = 139538, now ReadSizeBudget = 55125, ReadSizeServerDelta = 329625
2025-10-10T14:31:44.320612Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:182: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:31:44.353210Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] In ContinueReadingDataImpl, ReadSizeBudget = 55125, ReadSizeServerDelta = 329625
>>> event from dataHandler: 2025-10-10T14:31:44.353260Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 266 to 266
DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 Message { Data: ..27401 bytes.. Information: { Offset: 249 ProducerId: "src_id" SeqNo: 250 CreateTime: 2025-10-10T14:31:44.348000Z WriteTime: 2025-10-10T14:31:44.350000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:46198", "logtype": "unknown", "server": "ipv6:[::1]:46198" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..27511 bytes.. Information: { Offset: 250 ProducerId: "src_id" SeqNo: 251 CreateTime: 2025-10-10T14:31:44.348000Z WriteTime: 2025-10-10T14:31:44.350000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:46198", "logtype": "unknown", "server": "ipv6:[::1]:46198" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } }
2025-10-10T14:31:44.320624Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 322  requestId: <none> cookie: 161
2025-10-10T14:31:44.353771Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] The application data is transferred to the client. Number of messages 2, size 54912 bytes
2025-10-10T14:31:44.320641Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 323  requestId: <none> cookie: 162
2025-10-10T14:31:44.320646Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 325  requestId: <none> cookie: 163
2025-10-10T14:31:44.320649Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.353784Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 384750
2025-10-10T14:31:44.320652Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.353788Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.320655Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.353793Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Returning serverBytesSize = 0 to budget
2025-10-10T14:31:44.320656Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.320660Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.320667Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.320669Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.353793Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 266
2025-10-10T14:31:44.320676Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.353809Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (251-255)
2025-10-10T14:31:44.353820Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Returning serverBytesSize = 139538 to budget
2025-10-10T14:31:44.320678Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.320682Z node 3 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:31:44.320691Z node 3 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 163 partNo 0 count 8 size 147384
2025-10-10T14:31:44.353829Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (251-251)
2025-10-10T14:31:44.320721Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 342  requestId: <none> cookie: 172
2025-10-10T14:31:44.320728Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 343  requestId: <none> cookie: 173
2025-10-10T14:31:44.320748Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 32 Topic 'rt3.dc1--test-topic' partition 0 user user offset 160 count 3 size 64216 endOffset 163 max time lag 0ms effective offset 160
2025-10-10T14:31:44.320752Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.320757Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.320761Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 32 added 1 blobs, size 53514 count 3 last offset 160, current partition end offset: 163
2025-10-10T14:31:44.320764Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 32. Send blob request.
2025-10-10T14:31:44.320772Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 160 partno 0 count 3 parts_count 0 source 1 size 53514 accessed 0 times before, last time 2025-10-10T14:31:44.000000Z
2025-10-10T14:31:44.320778Z node 3 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 32. All 1 blobs are from cache.
2025-10-10T14:31:44.320785Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.320787Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.320790Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 160 partno 0 count 3 parts 0 suffix '63'
2025-10-10T14:31:44.353869Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 1} (252-252)
2025-10-10T14:31:44.320795Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 172 partNo : 0 messageNo: 344 size 18895 offset: -1
2025-10-10T14:31:44.320801Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.353879Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 2} (253-253)
2025-10-10T14:31:44.320802Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.320807Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 173 partNo : 0 messageNo: 345 size 19005 offset: -1
2025-10-10T14:31:44.353883Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 3} (254-254)
2025-10-10T14:31:44.320812Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:31:44.320845Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 160 totakecount 3 count 3 size 53491 from pos 0 cbcount 3
2025-10-10T14:31:44.320858Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.320864Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.320866Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.353911Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 267 to 267
2025-10-10T14:31:44.320866Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.320867Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.354127Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.320871Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 160
2025-10-10T14:31:44.354131Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 267
2025-10-10T14:31:44.320890Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.320912Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.354131Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 4} (255-255)
2025-10-10T14:31:44.320916Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.320927Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 346  requestId: <none> cookie: 174
2025-10-10T14:31:44.320932Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 163 Result { Offset: 160 Data: "... 17685 bytes ..." SourceId: "\000src_id" SeqNo: 161 WriteTimestampMS: 1760106704318 CreateTimestampMS: 1760106704315 UncompressedSize: 17611 PartitionKey: "" ExplicitHash: "" } Result { Offset: 161 Data: "... 17795 bytes ..." SourceId: "\000src_id" SeqNo: 162 WriteTimestampMS: 1760106704318 CreateTimestampMS: 1760106704316 UncompressedSize: 17721 PartitionKey: "" ExplicitHash: "" } Result { Offset: 162 Data: "... 17905 bytes ..." SourceId: "\000src_id" SeqNo: 163 WriteTimestampMS: 1760106704318 CreateTimestampMS: 1760106704317 UncompressedSize: 17831 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 3 RealReadOffset: 162 WaitQuotaTimeMs: 0 EndOffset: 163 StartOffset: 0 } Cookie: 160 }
2025-10-10T14:31:44.320934Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.320945Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.320953Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 30 from offset 163
2025-10-10T14:31:44.320957Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 163 ReadOffset 163 ReadGuid 24733a76-d05ceea3-7899a8d1-205b593 has messages 1
2025-10-10T14:31:44.320959Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.320966Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.320968Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.320972Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 174 partNo : 0 messageNo: 347 size 19115 offset: -1
2025-10-10T14:31:44.320975Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 read done: guid# 24733a76-d05ceea3-7899a8d1-205b593, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 53416
2025-10-10T14:31:44.320977Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.320978Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.320980Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 response to read: guid# 24733a76-d05ceea3-7899a8d1-205b593
2025-10-10T14:31:44.320984Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.320986Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.320992Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 348  requestId: <none> cookie: 175
2025-10-10T14:31:44.354207Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 268 to 268
>>> event from dataHandler: 2025-10-10T14:31:44.354215Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.354237Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 268
DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 Message { Data: ..27621 bytes.. Information: { Offset: 251 ProducerId: "src_id" SeqNo: 252 CreateTime: 2025-10-10T14:31:44.349000Z WriteTime: 2025-10-10T14:31:44.351000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:46198", "server": "ipv6:[::1]:46198", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..27731 bytes.. Information: { Offset: 252 ProducerId: "src_id" SeqNo: 253 CreateTime: 2025-10-10T14:31:44.349000Z WriteTime: 2025-10-10T14:31:44.351000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:46198", "server": "ipv6:[::1]:46198", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..27841 bytes.. Information: { Offset: 253 ProducerId: "src_id" SeqNo: 254 CreateTime: 2025-10-10T14:31:44.350000Z WriteTime: 2025-10-10T14:31:44.351000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:46198", "server": "ipv6:[::1]:46198", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..27951 bytes.. Information: { Offset: 254 ProducerId: "src_id" SeqNo: 255 CreateTime: 2025-10-10T14:31:44.350000Z WriteTime: 2025-10-10T14:31:44.351000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:46198", "server": "ipv6:[::1]:46198", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..28061 bytes.. Information: { Offset: 255 ProducerId: "src_id" SeqNo: 256 CreateTime: 2025-10-10T14:31:44.350000Z WriteTime: 2025-10-10T14:31:44.351000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:46198", "server": "ipv6:[::1]:46198", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } }
2025-10-10T14:31:44.320999Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.321030Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.321032Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.321037Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 175 partNo : 0 messageNo: 349 size 19225 offset: -1
2025-10-10T14:31:44.354278Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 269 to 269
2025-10-10T14:31:44.354434Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Got ReadResponse, serverBytesSize = 171049, now ReadSizeBudget = 139538, ReadSizeServerDelta = 213701
2025-10-10T14:31:44.321040Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.354834Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.354791Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] The application data is transferred to the client. Number of messages 5, size 139205 bytes
2025-10-10T14:31:44.321043Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.354839Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 269
2025-10-10T14:31:44.321102Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 Process answer. Aval parts: 0
2025-10-10T14:31:44.321346Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.354844Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] In ContinueReadingDataImpl, ReadSizeBudget = 139538, ReadSizeServerDelta = 213701
2025-10-10T14:31:44.321381Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.321406Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.321409Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.321481Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 350  requestId: <none> cookie: 176
2025-10-10T14:31:44.321489Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.321500Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.321502Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.321511Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 176 partNo : 0 messageNo: 351 size 19335 offset: -1
2025-10-10T14:31:44.321514Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.321520Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.321865Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 163 count 8 size 147384 actorID [3:7559600726884252064:2448]
2025-10-10T14:31:44.321875Z node 3 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:31:44.321885Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 147256 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:31:44.321888Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 163 partno 0 count 8 parts 0 suffix '63' size 147384
2025-10-10T14:31:44.321889Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.354899Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 270 to 270
2025-10-10T14:31:44.321894Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 164, partNo: 0, Offset: 163 is stored on disk
2025-10-10T14:31:44.321897Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.321900Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 165, partNo: 0, Offset: 164 is stored on disk
2025-10-10T14:31:44.321901Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.321904Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 166, partNo: 0, Offset: 165 is stored on disk
2025-10-10T14:31:44.321906Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.354921Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 353239
2025-10-10T14:31:44.321908Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 167, partNo: 0, Offset: 166 is stored on disk
2025-10-10T14:31:44.354925Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.321910Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.354928Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 270
2025-10-10T14:31:44.321913Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 168, partNo: 0, Offset: 167 is stored on disk
2025-10-10T14:31:44.321914Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.321917Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 169, partNo: 0, Offset: 168 is stored on disk
2025-10-10T14:31:44.354932Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Returning serverBytesSize = 0 to budget
2025-10-10T14:31:44.355363Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Got ReadResponse, serverBytesSize = 87076, now ReadSizeBudget = 0, ReadSizeServerDelta = 266163
2025-10-10T14:31:44.355383Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] In ContinueReadingDataImpl, ReadSizeBudget = 0, ReadSizeServerDelta = 266163
2025-10-10T14:31:44.354958Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 271 to 271
2025-10-10T14:31:44.321918Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.354953Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (256-261)
2025-10-10T14:31:44.321921Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 170, partNo: 0, Offset: 169 is stored on disk
2025-10-10T14:31:44.355429Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Returning serverBytesSize = 171049 to budget
2025-10-10T14:31:44.355416Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (262-264)
2025-10-10T14:31:44.321922Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.321927Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 171, partNo: 0, Offset: 170 is stored on disk
2025-10-10T14:31:44.355438Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.355433Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] In ContinueReadingDataImpl, ReadSizeBudget = 171049, ReadSizeServerDelta = 266163
2025-10-10T14:31:44.355442Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 271
2025-10-10T14:31:44.321950Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:44.321958Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:44.321960Z node 3 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (5)
2025-10-10T14:31:44.321968Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 grpc read done: success# 1, data# { read_request { bytes_size: 53416 } }
2025-10-10T14:31:44.355461Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 437212
2025-10-10T14:31:44.321974Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 172 partNo 0
2025-10-10T14:31:44.355467Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Returning serverBytesSize = 87076 to budget
2025-10-10T14:31:44.355472Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (256-256)
2025-10-10T14:31:44.322002Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 172 partNo 0 FormedBlobsCount 0 NewHead: Offset 171 PartNo 0 PackedSize 18969 count 1 nextOffset 172 batches 1
2025-10-10T14:31:44.322008Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 173 partNo 0
2025-10-10T14:31:44.355487Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 1} (257-257)
2025-10-10T14:31:44.322012Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 173 partNo 0 FormedBlobsCount 0 NewHead: Offset 171 PartNo 0 PackedSize 38016 count 2 nextOffset 173 batches 1
2025-10-10T14:31:44.322015Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 got read request: guid# 717677de-1174be4c-7863d2bb-b65d5865
2025-10-10T14:31:44.355493Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 272 to 272
2025-10-10T14:31:44.322015Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 174 partNo 0
2025-10-10T14:31:44.355496Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 2} (258-258)
2025-10-10T14:31:44.322020Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 174 partNo 0 FormedBlobsCount 0 NewHead: Offset 171 PartNo 0 PackedSize 57173 count 3 nextOffset 174 batches 1
2025-10-10T14:31:44.355500Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 3} (259-259)
2025-10-10T14:31:44.322022Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 175 partNo 0
2025-10-10T14:31:44.322025Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 175 partNo 0 FormedBlobsCount 0 NewHead: Offset 171 PartNo 0 PackedSize 76440 count 4 nextOffset 175 batches 1
2025-10-10T14:31:44.322028Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 176 partNo 0
2025-10-10T14:31:44.355513Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 4} (260-260)
2025-10-10T14:31:44.355519Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 5} (261-261)
2025-10-10T14:31:44.322029Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.355523Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (262-262)
2025-10-10T14:31:44.355526Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.355529Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 272
2025-10-10T14:31:44.355530Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 1} (263-263)
2025-10-10T14:31:44.322032Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 176 partNo 0 FormedBlobsCount 0 NewHead: Offset 171 PartNo 0 PackedSize 95817 count 5 nextOffset 176 batches 1
2025-10-10T14:31:44.322034Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:44.322085Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.355559Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 2} (264-264)
2025-10-10T14:31:44.322112Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 163 EndOffset 163 newEndOffset 171 commitOffset 0 clientCommitOffset 0 cookie 30 readingFinished 0 firstRead 0
2025-10-10T14:31:44.322115Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 163 endOffset 171
2025-10-10T14:31:44.322122Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 163, endOffset# 171, WTime# 1760106704318, sizeLag# 147384
2025-10-10T14:31:44.322124Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1TEvPartitionReady. Aval parts: 1
2025-10-10T14:31:44.355560Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 273 to 273
2025-10-10T14:31:44.322131Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 performing read request: guid# f8817bf4-db78ba78-5bc8b610-3769ea0d, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 9, size# 176860, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-10T14:31:44.322139Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 9 maxSize 176860 maxTimeLagMs 0 readTimestampMs 0 readOffset 163 EndOffset 171 ClientCommitOffset 0 committedOffset 0 Guid f8817bf4-db78ba78-5bc8b610-3769ea0d
2025-10-10T14:31:44.322139Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 171,5 HeadOffset 171 endOffset 171 curOffset 176 d0000000000_00000000000000000171_00000_0000000005_00000? size 95726 WTime 1760106704321
2025-10-10T14:31:44.322225Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:182: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:31:44.322235Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.322237Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 330  requestId: <none> cookie: 164
2025-10-10T14:31:44.356057Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.322245Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 331  requestId: <none> cookie: 165
2025-10-10T14:31:44.356061Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 273
2025-10-10T14:31:44.322251Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 332  requestId: <none> cookie: 166
2025-10-10T14:31:44.322256Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 333  requestId: <none> cookie: 167
2025-10-10T14:31:44.322261Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 336  requestId: <none> cookie: 168
2025-10-10T14:31:44.322265Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 337  requestId: <none> cookie: 169
2025-10-10T14:31:44.322269Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 339  requestId: <none> cookie: 170
2025-10-10T14:31:44.322274Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 341  requestId: <none> cookie: 171
2025-10-10T14:31:44.322278Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.322281Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.322292Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.322293Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.322299Z node 3 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:31:44.322310Z node 3 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 171 partNo 0 count 5 size 95726
2025-10-10T14:31:44.322326Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.356112Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 274 to 274
2025-10-10T14:31:44.322331Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.322335Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.322339Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.322342Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.322344Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.322347Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 352  requestId: <none> cookie: 177
2025-10-10T14:31:44.322347Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.356133Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.322350Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.322368Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.322374Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.356137Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 274
2025-10-10T14:31:44.322380Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.322399Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 33 Topic 'rt3.dc1--test-topic' partition 0 user user offset 163 count 9 size 176860 endOffset 171 max time lag 0ms effective offset 163
2025-10-10T14:31:44.322412Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 33 added 1 blobs, size 147384 count 8 last offset 163, current partition end offset: 171
2025-10-10T14:31:44.322414Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 33. Send blob request.
2025-10-10T14:31:44.322423Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 163 partno 0 count 8 parts_count 0 source 1 size 147384 accessed 0 times before, last time 2025-10-10T14:31:44.000000Z
2025-10-10T14:31:44.322433Z node 3 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 33. All 1 blobs are from cache.
2025-10-10T14:31:44.322441Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:31:44.322458Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 163 partno 0 count 8 parts 0 suffix '63'
2025-10-10T14:31:44.322611Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.322626Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 163 totakecount 8 count 8 size 147361 from pos 0 cbcount 8
2025-10-10T14:31:44.322654Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.356190Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 275 to 275
2025-10-10T14:31:44.322658Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.322667Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 177 partNo : 0 messageNo: 353 size 19445 offset: -1
>>> event from dataHandler: 2025-10-10T14:31:44.356233Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Got ReadResponse, serverBytesSize = 58645, now ReadSizeBudget = 87076, ReadSizeServerDelta = 378567
2025-10-10T14:31:44.322672Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.322673Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.322678Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.322679Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.322692Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 163
2025-10-10T14:31:44.322702Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.322707Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.356853Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] In ContinueReadingDataImpl, ReadSizeBudget = 87076, ReadSizeServerDelta = 378567
2025-10-10T14:31:44.322737Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 354  requestId: <none> cookie: 178
2025-10-10T14:31:44.322741Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 355  requestId: <none> cookie: 179
2025-10-10T14:31:44.322749Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.356864Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.356869Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 275
2025-10-10T14:31:44.322755Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.322758Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.322798Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 171 Result { Offset: 163 Data: "... 18015 bytes ..." SourceId: "\000src_id" SeqNo: 164 WriteTimestampMS: 1760106704319 CreateTimestampMS: 1760106704317 UncompressedSize: 17941 PartitionKey: "" ExplicitHash: "" } Result { Offset: 164 Data: "... 18125 bytes ..." SourceId: "\000src_id" SeqNo: 165 WriteTimestampMS: 1760106704319 CreateTimestampMS: 1760106704318 UncompressedSize: 18051 PartitionKey: "" ExplicitHash: "" } Result { Offset: 165 Data: "... 18235 bytes ..." SourceId: "\000src_id" SeqNo: 166 WriteTimestampMS: 1760106704319 CreateTimestampMS: 1760106704318 UncompressedSize: 18161 PartitionKey: "" ExplicitHash: "" } Result { Offset: 166 Data: "... 18345 bytes ..." SourceId: "\000src_id" SeqNo: 167 WriteTimestampMS: 1760106704319 CreateTimestampMS: 1760106704318 UncompressedSize: 18271 PartitionKey: "" ExplicitHash: "" } Result { Offset: 167 Data: "... 18455 bytes ..." SourceId: "\000src_id" SeqNo: 168 WriteTimestampMS: 1760106704319 CreateTimestampMS: 1760106704318 UncompressedSize: 18381 PartitionKey: "" ExplicitHash: "" } Result { Offset: 168 Data: "... 18565 bytes ..." SourceId: "\000src_id" SeqNo: 169 WriteTimestampMS: 1760106704319 CreateTimestampMS: 1760106704319 UncompressedSize: 18491 PartitionKey: "" ExplicitHash: "" } Result { Offset: 169 Data: "... 18675 bytes ..." SourceId: "\000src_id" SeqNo: 170 WriteTimestampMS: 1760106704319 CreateTimestampMS: 1760106704319 UncompressedSize: 18601 PartitionKey: "" ExplicitHash: "" } Result { Offset: 170 Data: "... 18785 bytes ..." SourceId: "\000src_id" SeqNo: 171 WriteTimestampMS: 1760106704319 CreateTimestampMS: 1760106704319 UncompressedSize: 18711 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 18446744073709551464 RealReadOffset: 170 WaitQuotaTimeMs: 0 EndOffset: 171 StartOffset: 0 } Cookie: 163 }
2025-10-10T14:31:44.322801Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.322808Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.322810Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.322816Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 178 partNo : 0 messageNo: 356 size 19555 offset: -1
2025-10-10T14:31:44.322821Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.322823Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.322828Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 179 partNo : 0 messageNo: 357 size 19665 offset: -1
DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 Message { Data: ..28171 bytes.. Information: { Offset: 256 ProducerId: "src_id" SeqNo: 257 CreateTime: 2025-10-10T14:31:44.350000Z WriteTime: 2025-10-10T14:31:44.352000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "_ip": "ipv6:[::1]:46198", "server": "ipv6:[::1]:46198", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..28281 bytes.. Information: { Offset: 257 ProducerId: "src_id" SeqNo: 258 CreateTime: 2025-10-10T14:31:44.350000Z WriteTime: 2025-10-10T14:31:44.352000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "_ip": "ipv6:[::1]:46198", "server": "ipv6:[::1]:46198", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..28391 bytes.. Information: { Offset: 258 ProducerId: "src_id" SeqNo: 259 CreateTime: 2025-10-10T14:31:44.350000Z WriteTime: 2025-10-10T14:31:44.352000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "_ip": "ipv6:[::1]:46198", "server": "ipv6:[::1]:46198", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..28501 bytes.. Information: { Offset: 259 ProducerId: "src_id" SeqNo: 260 CreateTime: 2025-10-10T14:31:44.350000Z WriteTime: 2025-10-10T14:31:44.352000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "_ip": "ipv6:[::1]:46198", "server": "ipv6:[::1]:46198", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..28611 bytes.. Information: { Offset: 260 ProducerId: "src_id" SeqNo: 261 CreateTime: 2025-10-10T14:31:44.350000Z WriteTime: 2025-10-10T14:31:44.352000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "_ip": "ipv6:[::1]:46198", "server": "ipv6:[::1]:46198", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..28721 bytes.. Information: { Offset: 261 ProducerId: "src_id" SeqNo: 262 CreateTime: 2025-10-10T14:31:44.351000Z WriteTime: 2025-10-10T14:31:44.352000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "_ip": "ipv6:[::1]:46198", "server": "ipv6:[::1]:46198", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..28831 bytes.. Information: { Offset: 262 ProducerId: "src_id" SeqNo: 263 CreateTime: 2025-10-10T14:31:44.351000Z WriteTime: 2025-10-10T14:31:44.353000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:46198", "_ip": "ipv6:[::1]:46198", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..28941 bytes.. Information: { Offset: 263 ProducerId: "src_id" SeqNo: 264 CreateTime: 2025-10-10T14:31:44.352000Z WriteTime: 2025-10-10T14:31:44.353000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:46198", "_ip": "ipv6:[::1]:46198", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..29051 bytes.. Information: { Offset: 264 ProducerId: "src_id" SeqNo: 265 CreateTime: 2025-10-10T14:31:44.352000Z WriteTime: 2025-10-10T14:31:44.353000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:46198", "_ip": "ipv6:[::1]:46198", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } }
2025-10-10T14:31:44.322831Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.322832Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.322836Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.322840Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.322842Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.322845Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.322851Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 31 from offset 171
2025-10-10T14:31:44.322856Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 171 ReadOffset 171 ReadGuid f8817bf4-db78ba78-5bc8b610-3769ea0d has messages 1
2025-10-10T14:31:44.356907Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 276 to 276
2025-10-10T14:31:44.356922Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 465643
2025-10-10T14:31:44.322857Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 358  requestId: <none> cookie: 180
2025-10-10T14:31:44.322871Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.322884Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 read done: guid# f8817bf4-db78ba78-5bc8b610-3769ea0d, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 147061
2025-10-10T14:31:44.357442Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.357450Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 276
2025-10-10T14:31:44.322889Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 response to read: guid# f8817bf4-db78ba78-5bc8b610-3769ea0d
2025-10-10T14:31:44.357453Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] The application data is transferred to the client. Number of messages 3, size 86823 bytes
2025-10-10T14:31:44.322931Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.357460Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] The application data is transferred to the client. Number of messages 6, size 170676 bytes
2025-10-10T14:31:44.322933Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.357464Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Returning serverBytesSize = 0 to budget
2025-10-10T14:31:44.322941Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 180 partNo : 0 messageNo: 359 size 19775 offset: -1
2025-10-10T14:31:44.357466Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (265-266)
2025-10-10T14:31:44.322950Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.357479Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Returning serverBytesSize = 58645 to budget
2025-10-10T14:31:44.322955Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.357484Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Returning serverBytesSize = 0 to budget
2025-10-10T14:31:44.323011Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 Process answer. Aval parts: 0
2025-10-10T14:31:44.323251Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 171 count 5 size 95726 actorID [3:7559600726884252064:2448]
2025-10-10T14:31:44.323260Z node 3 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:31:44.323268Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 95610 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:31:44.323275Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 171 partno 0 count 5 parts 0 suffix '63' size 95726
2025-10-10T14:31:44.323284Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.323288Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 172, partNo: 0, Offset: 171 is stored on disk
2025-10-10T14:31:44.323292Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.323295Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 173, partNo: 0, Offset: 172 is stored on disk
2025-10-10T14:31:44.323296Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.323298Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 174, partNo: 0, Offset: 173 is stored on disk
2025-10-10T14:31:44.357521Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (265-265)
2025-10-10T14:31:44.323300Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.357524Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 277 to 277
2025-10-10T14:31:44.323302Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 175, partNo: 0, Offset: 174 is stored on disk
2025-10-10T14:31:44.323303Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.357531Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.357816Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 277
2025-10-10T14:31:44.323305Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 176, partNo: 0, Offset: 175 is stored on disk
2025-10-10T14:31:44.323323Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:44.323329Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:44.357575Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 1} (266-266)
2025-10-10T14:31:44.323330Z node 3 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (4)
2025-10-10T14:31:44.323341Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 177 partNo 0
2025-10-10T14:31:44.323341Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 171 EndOffset 171 newEndOffset 176 commitOffset 0 clientCommitOffset 0 cookie 31 readingFinished 0 firstRead 0
2025-10-10T14:31:44.323344Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 171 endOffset 176
2025-10-10T14:31:44.357758Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Got ReadResponse, serverBytesSize = 59085, now ReadSizeBudget = 58645, ReadSizeServerDelta = 406558
2025-10-10T14:31:44.323349Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.323358Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 177 partNo 0 FormedBlobsCount 0 NewHead: Offset 176 PartNo 0 PackedSize 19519 count 1 nextOffset 177 batches 1
2025-10-10T14:31:44.323362Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 178 partNo 0
2025-10-10T14:31:44.323366Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 178 partNo 0 FormedBlobsCount 0 NewHead: Offset 176 PartNo 0 PackedSize 39116 count 2 nextOffset 178 batches 1
2025-10-10T14:31:44.323368Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 179 partNo 0
2025-10-10T14:31:44.357869Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] In ContinueReadingDataImpl, ReadSizeBudget = 58645, ReadSizeServerDelta = 406558
2025-10-10T14:31:44.323372Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 179 partNo 0 FormedBlobsCount 0 NewHead: Offset 176 PartNo 0 PackedSize 58823 count 3 nextOffset 179 batches 1
2025-10-10T14:31:44.323374Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 180 partNo 0
2025-10-10T14:31:44.323377Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 180 partNo 0 FormedBlobsCount 0 NewHead: Offset 176 PartNo 0 PackedSize 78640 count 4 nextOffset 180 batches 1
2025-10-10T14:31:44.357882Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 278 to 278
2025-10-10T14:31:44.323380Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:44.323415Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.357890Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.323432Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 171, endOffset# 176, WTime# 1760106704319, sizeLag# 95726
2025-10-10T14:31:44.357893Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 278
2025-10-10T14:31:44.323434Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1TEvPartitionReady. Aval parts: 1
2025-10-10T14:31:44.323441Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 performing read request: guid# d34103a3-42277620-cb33d50f-b3ce8971, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 6, size# 114871, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-10T14:31:44.323449Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 6 maxSize 114871 maxTimeLagMs 0 readTimestampMs 0 readOffset 171 EndOffset 176 ClientCommitOffset 0 committedOffset 0 Guid d34103a3-42277620-cb33d50f-b3ce8971
2025-10-10T14:31:44.323452Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 176,4 HeadOffset 176 endOffset 176 curOffset 180 d0000000000_00000000000000000176_00000_0000000004_00000? size 78580 WTime 1760106704323
2025-10-10T14:31:44.323476Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:182: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:31:44.323486Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 344  requestId: <none> cookie: 172
2025-10-10T14:31:44.323498Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 345  requestId: <none> cookie: 173
2025-10-10T14:31:44.323503Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 347  requestId: <none> cookie: 174
2025-10-10T14:31:44.323505Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.323508Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 349  requestId: <none> cookie: 175
2025-10-10T14:31:44.323510Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.323512Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 351  requestId: <none> cookie: 176
2025-10-10T14:31:44.323514Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.323517Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
>>> event from dataHandler: 2025-10-10T14:31:44.323518Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.323519Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.357924Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 465203
2025-10-10T14:31:44.323522Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.323534Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.357972Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 279 to 279
DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 Message { Data: ..29161 bytes.. Information: { Offset: 265 ProducerId: "src_id" SeqNo: 266 CreateTime: 2025-10-10T14:31:44.353000Z WriteTime: 2025-10-10T14:31:44.354000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "_ip": "ipv6:[::1]:46198", "server": "ipv6:[::1]:46198", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..29271 bytes.. Information: { Offset: 266 ProducerId: "src_id" SeqNo: 267 CreateTime: 2025-10-10T14:31:44.353000Z WriteTime: 2025-10-10T14:31:44.354000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "_ip": "ipv6:[::1]:46198", "server": "ipv6:[::1]:46198", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } }2025-10-10T14:31:44.323536Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.323541Z node 3 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:31:44.323550Z node 3 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 176 partNo 0 count 4 size 78580
2025-10-10T14:31:44.323579Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 360  requestId: <none> cookie: 181
2025-10-10T14:31:44.323600Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 34 Topic 'rt3.dc1--test-topic' partition 0 user user offset 171 count 6 size 114871 endOffset 176 max time lag 0ms effective offset 171
2025-10-10T14:31:44.358403Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.323607Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.358420Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (267-268)
2025-10-10T14:31:44.358423Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 279
2025-10-10T14:31:44.323612Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 34 added 1 blobs, size 95726 count 5 last offset 171, current partition end offset: 176
2025-10-10T14:31:44.323615Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 34. Send blob request.
2025-10-10T14:31:44.358464Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] The application data is transferred to the client. Number of messages 2, size 58432 bytes
2025-10-10T14:31:44.323623Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 171 partno 0 count 5 parts_count 0 source 1 size 95726 accessed 0 times before, last time 2025-10-10T14:31:44.000000Z
2025-10-10T14:31:44.323627Z node 3 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 34. All 1 blobs are from cache.
2025-10-10T14:31:44.358432Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Returning serverBytesSize = 59085 to budget
2025-10-10T14:31:44.323633Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:31:44.323640Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 171 partno 0 count 5 parts 0 suffix '63'
2025-10-10T14:31:44.323677Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 171 totakecount 5 count 5 size 95703 from pos 0 cbcount 5
2025-10-10T14:31:44.358490Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Returning serverBytesSize = 0 to budget
2025-10-10T14:31:44.323691Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.323693Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.323701Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 181 partNo : 0 messageNo: 361 size 19885 offset: -1
2025-10-10T14:31:44.323708Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 171
2025-10-10T14:31:44.323715Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.358500Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (267-267)
2025-10-10T14:31:44.323720Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.323773Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 176 Result { Offset: 171 Data: "... 18895 bytes ..." SourceId: "\000src_id" SeqNo: 172 WriteTimestampMS: 1760106704321 CreateTimestampMS: 1760106704319 UncompressedSize: 18821 PartitionKey: "" ExplicitHash: "" } Result { Offset: 172 Data: "... 19005 bytes ..." SourceId: "\000src_id" SeqNo: 173 WriteTimestampMS: 1760106704321 CreateTimestampMS: 1760106704320 UncompressedSize: 18931 PartitionKey: "" ExplicitHash: "" } Result { Offset: 173 Data: "... 19115 bytes ..." SourceId: "\000src_id" SeqNo: 174 WriteTimestampMS: 1760106704321 CreateTimestampMS: 1760106704320 UncompressedSize: 19041 PartitionKey: "" ExplicitHash: "" } Result { Offset: 174 Data: "... 19225 bytes ..." SourceId: "\000src_id" SeqNo: 175 WriteTimestampMS: 1760106704321 CreateTimestampMS: 1760106704320 UncompressedSize: 19151 PartitionKey: "" ExplicitHash: "" } Result { Offset: 175 Data: "... 19335 bytes ..." SourceId: "\000src_id" SeqNo: 176 WriteTimestampMS: 1760106704321 CreateTimestampMS: 1760106704320 UncompressedSize: 19261 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 18446744073709551557 RealReadOffset: 175 WaitQuotaTimeMs: 0 EndOffset: 176 StartOffset: 0 } Cookie: 171 }
2025-10-10T14:31:44.323808Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 32 from offset 176
2025-10-10T14:31:44.358519Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 1} (268-268)
2025-10-10T14:31:44.323812Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 176 ReadOffset 176 ReadGuid d34103a3-42277620-cb33d50f-b3ce8971 has messages 1
2025-10-10T14:31:44.323831Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 read done: guid# d34103a3-42277620-cb33d50f-b3ce8971, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 95538
2025-10-10T14:31:44.323835Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 response to read: guid# d34103a3-42277620-cb33d50f-b3ce8971
2025-10-10T14:31:44.323900Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.323932Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 Process answer. Aval parts: 0
2025-10-10T14:31:44.323952Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 grpc read done: success# 1, data# { read_request { bytes_size: 147061 } }
2025-10-10T14:31:44.358519Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 280 to 280
>>> event from dataHandler: 2025-10-10T14:31:44.323960Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 got read request: guid# f525f163-54e83f16-b55f00f-d62f7039
2025-10-10T14:31:44.323973Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 Message { Data: ..29381 bytes.. Information: { Offset: 267 ProducerId: "src_id" SeqNo: 268 CreateTime: 2025-10-10T14:31:44.354000Z WriteTime: 2025-10-10T14:31:44.355000Z MessageGroupId: "src_id" Meta: { "server": "ipv6:[::1]:46198", "_ip": "ipv6:[::1]:46198", "logtype": "unknown", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..29491 bytes.. Information: { Offset: 268 ProducerId: "src_id" SeqNo: 269 CreateTime: 2025-10-10T14:31:44.354000Z WriteTime: 2025-10-10T14:31:44.355000Z MessageGroupId: "src_id" Meta: { "server": "ipv6:[::1]:46198", "_ip": "ipv6:[::1]:46198", "logtype": "unknown", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } }2025-10-10T14:31:44.358848Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.358861Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 280
2025-10-10T14:31:44.324030Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.324033Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.324044Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 362  requestId: <none> cookie: 182
2025-10-10T14:31:44.324060Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.358882Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] The application data is transferred to the client. Number of messages 2, size 58872 bytes
2025-10-10T14:31:44.324071Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.358886Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Returning serverBytesSize = 0 to budget
2025-10-10T14:31:44.324073Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.324080Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 182 partNo : 0 messageNo: 363 size 19995 offset: -1
2025-10-10T14:31:44.324083Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.324089Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.324289Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 176 count 4 size 78580 actorID [3:7559600726884252064:2448]
2025-10-10T14:31:44.324299Z node 3 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:31:44.324305Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 78468 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:31:44.324308Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.324311Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 177, partNo: 0, Offset: 176 is stored on disk
2025-10-10T14:31:44.324313Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.324315Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 178, partNo: 0, Offset: 177 is stored on disk
2025-10-10T14:31:44.324316Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.324318Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 179, partNo: 0, Offset: 178 is stored on disk
2025-10-10T14:31:44.358928Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 281 to 281
2025-10-10T14:31:44.359209Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Got ReadResponse, serverBytesSize = 149438, now ReadSizeBudget = 59085, ReadSizeServerDelta = 315765
2025-10-10T14:31:44.324320Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.324323Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 180, partNo: 0, Offset: 179 is stored on disk
2025-10-10T14:31:44.359371Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] In ContinueReadingDataImpl, ReadSizeBudget = 59085, ReadSizeServerDelta = 315765
2025-10-10T14:31:44.324324Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 176 partno 0 count 4 parts 0 suffix '63' size 78580
2025-10-10T14:31:44.359351Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.324338Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.359380Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 281
2025-10-10T14:31:44.324341Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:44.324345Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:44.324346Z node 3 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (2)
2025-10-10T14:31:44.324356Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 181 partNo 0
2025-10-10T14:31:44.324371Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.324373Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 181 partNo 0 FormedBlobsCount 0 NewHead: Offset 180 PartNo 0 PackedSize 19959 count 1 nextOffset 181 batches 1
2025-10-10T14:31:44.324377Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 182 partNo 0
2025-10-10T14:31:44.324381Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 182 partNo 0 FormedBlobsCount 0 NewHead: Offset 180 PartNo 0 PackedSize 39996 count 2 nextOffset 182 batches 1
2025-10-10T14:31:44.359412Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 282 to 282
2025-10-10T14:31:44.324383Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:44.324390Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 176 EndOffset 176 newEndOffset 180 commitOffset 0 clientCommitOffset 0 cookie 32 readingFinished 0 firstRead 0
2025-10-10T14:31:44.359419Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.324393Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 176 endOffset 180
2025-10-10T14:31:44.359421Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 282
2025-10-10T14:31:44.324400Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 176, endOffset# 180, WTime# 1760106704321, sizeLag# 78580
2025-10-10T14:31:44.359426Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 374850
2025-10-10T14:31:44.324402Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1TEvPartitionReady. Aval parts: 1
2025-10-10T14:31:44.324409Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 performing read request: guid# 9d3ea55e-790c9d97-7e1ad258-cbbf243, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 4, size# 94296, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-10T14:31:44.324418Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 4 maxSize 94296 maxTimeLagMs 0 readTimestampMs 0 readOffset 176 EndOffset 180 ClientCommitOffset 0 committedOffset 0 Guid 9d3ea55e-790c9d97-7e1ad258-cbbf243
2025-10-10T14:31:44.324431Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 180,2 HeadOffset 180 endOffset 180 curOffset 182 d0000000000_00000000000000000180_00000_0000000002_00000? size 39987 WTime 1760106704324
2025-10-10T14:31:44.324453Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:182: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:31:44.324460Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 353  requestId: <none> cookie: 177
2025-10-10T14:31:44.324467Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 356  requestId: <none> cookie: 178
2025-10-10T14:31:44.359457Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (269-273)
2025-10-10T14:31:44.324470Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.359769Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Returning serverBytesSize = 149438 to budget
2025-10-10T14:31:44.359459Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 283 to 283
2025-10-10T14:31:44.359784Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (269-269)
2025-10-10T14:31:44.324471Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 357  requestId: <none> cookie: 179
2025-10-10T14:31:44.359790Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Got ReadResponse, serverBytesSize = 60625, now ReadSizeBudget = 149438, ReadSizeServerDelta = 314225
2025-10-10T14:31:44.324475Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 359  requestId: <none> cookie: 180
2025-10-10T14:31:44.324477Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.324479Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.324482Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.359810Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.324483Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.359814Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 283
2025-10-10T14:31:44.324486Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.324491Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.324493Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.324498Z node 3 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:31:44.324507Z node 3 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 180 partNo 0 count 2 size 39987
2025-10-10T14:31:44.324533Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 364  requestId: <none> cookie: 183
2025-10-10T14:31:44.324543Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.359846Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 1} (270-270)
2025-10-10T14:31:44.324550Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.324555Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 35 Topic 'rt3.dc1--test-topic' partition 0 user user offset 176 count 4 size 94296 endOffset 180 max time lag 0ms effective offset 176
2025-10-10T14:31:44.324565Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 35 added 1 blobs, size 78580 count 4 last offset 176, current partition end offset: 180
2025-10-10T14:31:44.324568Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 35. Send blob request.
2025-10-10T14:31:44.324575Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 176 partno 0 count 4 parts_count 0 source 1 size 78580 accessed 0 times before, last time 2025-10-10T14:31:44.000000Z
2025-10-10T14:31:44.324578Z node 3 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 35. All 1 blobs are from cache.
2025-10-10T14:31:44.324585Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:31:44.324590Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 176 partno 0 count 4 parts 0 suffix '63'
2025-10-10T14:31:44.324620Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 176 totakecount 4 count 4 size 78557 from pos 0 cbcount 4
2025-10-10T14:31:44.324634Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.324637Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 176
2025-10-10T14:31:44.359898Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 2} (271-271)
2025-10-10T14:31:44.324644Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.324646Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.359905Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 284 to 284
2025-10-10T14:31:44.324652Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 183 partNo : 0 messageNo: 365 size 20105 offset: -1
2025-10-10T14:31:44.324668Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.359912Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.324669Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.359915Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 284
2025-10-10T14:31:44.359916Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 3} (272-272)
2025-10-10T14:31:44.324673Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.324678Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.324682Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 366  requestId: <none> cookie: 184
2025-10-10T14:31:44.324692Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.324705Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 180 Result { Offset: 176 Data: "... 19445 bytes ..." SourceId: "\000src_id" SeqNo: 177 WriteTimestampMS: 1760106704322 CreateTimestampMS: 1760106704321 UncompressedSize: 19371 PartitionKey: "" ExplicitHash: "" } Result { Offset: 177 Data: "... 19555 bytes ..." SourceId: "\000src_id" SeqNo: 178 WriteTimestampMS: 1760106704322 CreateTimestampMS: 1760106704321 UncompressedSize: 19481 PartitionKey: "" ExplicitHash: "" } Result { Offset: 178 Data: "... 19665 bytes ..." SourceId: "\000src_id" SeqNo: 179 WriteTimestampMS: 1760106704322 CreateTimestampMS: 1760106704322 UncompressedSize: 19591 PartitionKey: "" ExplicitHash: "" } Result { Offset: 179 Data: "... 19775 bytes ..." SourceId: "\000src_id" SeqNo: 180 WriteTimestampMS: 1760106704322 CreateTimestampMS: 1760106704322 UncompressedSize: 19701 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 18446744073709551588 RealReadOffset: 179 WaitQuotaTimeMs: 0 EndOffset: 180 StartOffset: 0 } Cookie: 176 }
2025-10-10T14:31:44.360001Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 285 to 285
2025-10-10T14:31:44.360326Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.360330Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 285
2025-10-10T14:31:44.360010Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 4} (273-273)
2025-10-10T14:31:44.324713Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.324715Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.324719Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 184 partNo : 0 messageNo: 367 size 20215 offset: -1
2025-10-10T14:31:44.324723Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.324725Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.324737Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 33 from offset 180
2025-10-10T14:31:44.324741Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 180 ReadOffset 180 ReadGuid 9d3ea55e-790c9d97-7e1ad258-cbbf243 has messages 1
2025-10-10T14:31:44.324750Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 read done: guid# 9d3ea55e-790c9d97-7e1ad258-cbbf243, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 78437
2025-10-10T14:31:44.324754Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 response to read: guid# 9d3ea55e-790c9d97-7e1ad258-cbbf243
2025-10-10T14:31:44.324868Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 Process answer. Aval parts: 0
2025-10-10T14:31:44.324977Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.360379Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] In ContinueReadingDataImpl, ReadSizeBudget = 149438, ReadSizeServerDelta = 314225
2025-10-10T14:31:44.325017Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.325027Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.325029Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.325037Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 368  requestId: <none> cookie: 185
2025-10-10T14:31:44.325048Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.325066Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.325067Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.325069Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 grpc read done: success# 1, data# { read_request { bytes_size: 95538 } }
2025-10-10T14:31:44.325074Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 185 partNo : 0 messageNo: 369 size 20325 offset: -1
2025-10-10T14:31:44.325079Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.325084Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.325109Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 got read request: guid# 7d68d9d0-3e19ee21-c2e5c3a1-fbbba39e
2025-10-10T14:31:44.325207Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 180 count 2 size 39987 actorID [3:7559600726884252064:2448]
2025-10-10T14:31:44.360421Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 286 to 286
2025-10-10T14:31:44.325219Z node 3 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:31:44.325227Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 39894 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:31:44.360439Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.360439Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 463663
2025-10-10T14:31:44.360442Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 286
2025-10-10T14:31:44.325230Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 180 partno 0 count 2 parts 0 suffix '63' size 39987
2025-10-10T14:31:44.325232Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.325237Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 181, partNo: 0, Offset: 180 is stored on disk
2025-10-10T14:31:44.325239Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.325245Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 182, partNo: 0, Offset: 181 is stored on disk
2025-10-10T14:31:44.325265Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:44.325276Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 180 EndOffset 180 newEndOffset 182 commitOffset 0 clientCommitOffset 0 cookie 33 readingFinished 0 firstRead 0
2025-10-10T14:31:44.360502Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 287 to 287
2025-10-10T14:31:44.325279Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 180 endOffset 182
2025-10-10T14:31:44.325281Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:44.325282Z node 3 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2025-10-10T14:31:44.325286Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 180, endOffset# 182, WTime# 1760106704322, sizeLag# 39987
2025-10-10T14:31:44.325287Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1TEvPartitionReady. Aval parts: 1
2025-10-10T14:31:44.360961Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.325293Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 183 partNo 0
2025-10-10T14:31:44.360965Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 287
2025-10-10T14:31:44.360504Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (274-275)
2025-10-10T14:31:44.360989Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Returning serverBytesSize = 60625 to budget
2025-10-10T14:31:44.360995Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 288 to 288
2025-10-10T14:31:44.325293Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 performing read request: guid# 910d7e7c-dfd6436e-bbb7ef49-98cd9ea0, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 2, size# 47984, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-10T14:31:44.361006Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.361008Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 288
2025-10-10T14:31:44.325301Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 2 maxSize 47984 maxTimeLagMs 0 readTimestampMs 0 readOffset 180 EndOffset 182 ClientCommitOffset 0 committedOffset 0 Guid 910d7e7c-dfd6436e-bbb7ef49-98cd9ea0
2025-10-10T14:31:44.361012Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (274-274)
2025-10-10T14:31:44.325310Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 183 partNo 0 FormedBlobsCount 0 NewHead: Offset 182 PartNo 0 PackedSize 20179 count 1 nextOffset 183 batches 1
2025-10-10T14:31:44.325314Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 184 partNo 0
>>> event from dataHandler: 2025-10-10T14:31:44.361028Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 289 to 289
2025-10-10T14:31:44.361031Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 1} (275-275)
2025-10-10T14:31:44.325319Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 184 partNo 0 FormedBlobsCount 0 NewHead: Offset 182 PartNo 0 PackedSize 40436 count 2 nextOffset 184 batches 1
2025-10-10T14:31:44.361036Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.325321Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 185 partNo 0
2025-10-10T14:31:44.361044Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 289
2025-10-10T14:31:44.325325Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 185 partNo 0 FormedBlobsCount 0 NewHead: Offset 182 PartNo 0 PackedSize 60803 count 3 nextOffset 185 batches 1
2025-10-10T14:31:44.325327Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:44.325395Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 182,3 HeadOffset 182 endOffset 182 curOffset 185 d0000000000_00000000000000000182_00000_0000000003_00000? size 60774 WTime 1760106704324
2025-10-10T14:31:44.361056Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Got ReadResponse, serverBytesSize = 91815, now ReadSizeBudget = 60625, ReadSizeServerDelta = 371848
2025-10-10T14:31:44.325417Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:182: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 Message { Data: ..29601 bytes.. Information: { Offset: 269 ProducerId: "src_id" SeqNo: 270 CreateTime: 2025-10-10T14:31:44.354000Z WriteTime: 2025-10-10T14:31:44.356000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:46198", "_ip": "ipv6:[::1]:46198", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..29711 bytes.. Information: { Offset: 270 ProducerId: "src_id" SeqNo: 271 CreateTime: 2025-10-10T14:31:44.354000Z WriteTime: 2025-10-10T14:31:44.356000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:46198", "_ip": "ipv6:[::1]:46198", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..29821 bytes.. Information: { Offset: 271 ProducerId: "src_id" SeqNo: 272 CreateTime: 2025-10-10T14:31:44.355000Z WriteTime: 2025-10-10T14:31:44.356000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:46198", "_ip": "ipv6:[::1]:46198", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..29931 bytes.. Information: { Offset: 272 ProducerId: "src_id" SeqNo: 273 CreateTime: 2025-10-10T14:31:44.355000Z WriteTime: 2025-10-10T14:31:44.356000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:46198", "_ip": "ipv6:[::1]:46198", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..30041 bytes.. Information: { Offset: 273 ProducerId: "src_id" SeqNo: 274 CreateTime: 2025-10-10T14:31:44.356000Z WriteTime: 2025-10-10T14:31:44.356000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:46198", "_ip": "ipv6:[::1]:46198", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } }
2025-10-10T14:31:44.325424Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 361  requestId: <none> cookie: 181
2025-10-10T14:31:44.325435Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 363  requestId: <none> cookie: 182
2025-10-10T14:31:44.361074Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] In ContinueReadingDataImpl, ReadSizeBudget = 60625, ReadSizeServerDelta = 371848
2025-10-10T14:31:44.361618Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] The application data is transferred to the client. Number of messages 5, size 149105 bytes
2025-10-10T14:31:44.361075Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 290 to 290
2025-10-10T14:31:44.325442Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.325444Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.325447Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.325451Z node 3 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:31:44.325452Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.325459Z node 3 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 182 partNo 0 count 3 size 60774
2025-10-10T14:31:44.325498Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 36 Topic 'rt3.dc1--test-topic' partition 0 user user offset 180 count 2 size 47984 endOffset 182 max time lag 0ms effective offset 180
2025-10-10T14:31:44.325511Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 36 added 1 blobs, size 39987 count 2 last offset 180, current partition end offset: 182
2025-10-10T14:31:44.361662Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.325514Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 36. Send blob request.
2025-10-10T14:31:44.361666Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 290
2025-10-10T14:31:44.325521Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 180 partno 0 count 2 parts_count 0 source 1 size 39987 accessed 0 times before, last time 2025-10-10T14:31:44.000000Z
2025-10-10T14:31:44.325524Z node 3 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 36. All 1 blobs are from cache.
2025-10-10T14:31:44.361690Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 432473
2025-10-10T14:31:44.325530Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:31:44.325533Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 180 partno 0 count 2 parts 0 suffix '63'
2025-10-10T14:31:44.361701Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Returning serverBytesSize = 0 to budget
2025-10-10T14:31:44.325550Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 180 totakecount 2 count 2 size 39964 from pos 0 cbcount 2
2025-10-10T14:31:44.325564Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 180
2025-10-10T14:31:44.325614Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 182 Result { Offset: 180 Data: "... 19885 bytes ..." SourceId: "\000src_id" SeqNo: 181 WriteTimestampMS: 1760106704323 CreateTimestampMS: 1760106704322 UncompressedSize: 19811 PartitionKey: "" ExplicitHash: "" } Result { Offset: 181 Data: "... 19995 bytes ..." SourceId: "\000src_id" SeqNo: 182 WriteTimestampMS: 1760106704323 CreateTimestampMS: 1760106704323 UncompressedSize: 19921 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 23 RealReadOffset: 181 WaitQuotaTimeMs: 0 EndOffset: 182 StartOffset: 0 } Cookie: 180 }
2025-10-10T14:31:44.361721Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (276-278)
2025-10-10T14:31:44.325635Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 34 from offset 182
2025-10-10T14:31:44.361734Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Returning serverBytesSize = 91815 to budget
2025-10-10T14:31:44.325640Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 182 ReadOffset 182 ReadGuid 910d7e7c-dfd6436e-bbb7ef49-98cd9ea0 has messages 1
2025-10-10T14:31:44.361740Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 291 to 291
2025-10-10T14:31:44.325656Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 read done: guid# 910d7e7c-dfd6436e-bbb7ef49-98cd9ea0, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 39945
2025-10-10T14:31:44.325660Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 response to read: guid# 910d7e7c-dfd6436e-bbb7ef49-98cd9ea0
2025-10-10T14:31:44.361746Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.325690Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 Process answer. Aval parts: 0
2025-10-10T14:31:44.361752Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 291
2025-10-10T14:31:44.361746Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (276-276)
2025-10-10T14:31:44.325710Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
>>> event from dataHandler: 2025-10-10T14:31:44.325738Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.361764Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 0} (277-277)
2025-10-10T14:31:44.325757Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.325760Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 Message { Data: ..30151 bytes.. Information: { Offset: 274 ProducerId: "src_id" SeqNo: 275 CreateTime: 2025-10-10T14:31:44.356000Z WriteTime: 2025-10-10T14:31:44.358000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:46198", "server": "ipv6:[::1]:46198" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..30261 bytes.. Information: { Offset: 275 ProducerId: "src_id" SeqNo: 276 CreateTime: 2025-10-10T14:31:44.356000Z WriteTime: 2025-10-10T14:31:44.358000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:46198", "server": "ipv6:[::1]:46198" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } }
2025-10-10T14:31:44.361778Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 1} (278-278)
2025-10-10T14:31:44.362078Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] The application data is transferred to the client. Number of messages 2, size 60412 bytes
2025-10-10T14:31:44.362082Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Returning serverBytesSize = 0 to budget
2025-10-10T14:31:44.361814Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 292 to 292
2025-10-10T14:31:44.325769Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 370  requestId: <none> cookie: 186
2025-10-10T14:31:44.362097Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.362110Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 292
2025-10-10T14:31:44.325774Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.325788Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.325790Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
>>> event from dataHandler: 2025-10-10T14:31:44.325798Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 186 partNo : 0 messageNo: 371 size 20435 offset: -1
2025-10-10T14:31:44.325801Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.325807Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 Message { Data: ..30371 bytes.. Information: { Offset: 276 ProducerId: "src_id" SeqNo: 277 CreateTime: 2025-10-10T14:31:44.357000Z WriteTime: 2025-10-10T14:31:44.358000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:46198", "logtype": "unknown", "_ip": "ipv6:[::1]:46198" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..30481 bytes.. Information: { Offset: 277 ProducerId: "src_id" SeqNo: 278 CreateTime: 2025-10-10T14:31:44.357000Z WriteTime: 2025-10-10T14:31:44.359000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:46198", "logtype": "unknown", "_ip": "ipv6:[::1]:46198" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..30591 bytes.. Information: { Offset: 278 ProducerId: "src_id" SeqNo: 279 CreateTime: 2025-10-10T14:31:44.357000Z WriteTime: 2025-10-10T14:31:44.359000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:46198", "logtype": "unknown", "_ip": "ipv6:[::1]:46198" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } }
2025-10-10T14:31:44.326244Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 182 count 3 size 60774 actorID [3:7559600726884252064:2448]
2025-10-10T14:31:44.326253Z node 3 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:31:44.326259Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 60666 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:31:44.326263Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.362163Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] The application data is transferred to the client. Number of messages 3, size 91443 bytes
2025-10-10T14:31:44.326263Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 182 partno 0 count 3 parts 0 suffix '63' size 60774
2025-10-10T14:31:44.326266Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 183, partNo: 0, Offset: 182 is stored on disk
2025-10-10T14:31:44.362170Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Returning serverBytesSize = 0 to budget
2025-10-10T14:31:44.326268Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.362163Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 293 to 293
2025-10-10T14:31:44.326270Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 184, partNo: 0, Offset: 183 is stored on disk
2025-10-10T14:31:44.326271Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.362179Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.326273Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 185, partNo: 0, Offset: 184 is stored on disk
2025-10-10T14:31:44.362675Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Got ReadResponse, serverBytesSize = 92686, now ReadSizeBudget = 91815, ReadSizeServerDelta = 339787
2025-10-10T14:31:44.362182Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 293
2025-10-10T14:31:44.362691Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] In ContinueReadingDataImpl, ReadSizeBudget = 91815, ReadSizeServerDelta = 339787
2025-10-10T14:31:44.326290Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:44.326293Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:44.326295Z node 3 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:44.326305Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 186 partNo 0
2025-10-10T14:31:44.326306Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.326321Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 186 partNo 0 FormedBlobsCount 0 NewHead: Offset 185 PartNo 0 PackedSize 20509 count 1 nextOffset 186 batches 1
2025-10-10T14:31:44.326324Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:44.326378Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.326407Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 185,1 HeadOffset 185 endOffset 185 curOffset 186 d0000000000_00000000000000000185_00000_0000000001_00000? size 20500 WTime 1760106704325
2025-10-10T14:31:44.326421Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:182: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:31:44.326431Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 365  requestId: <none> cookie: 183
2025-10-10T14:31:44.362740Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 294 to 294
2025-10-10T14:31:44.326437Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.362750Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 431602
2025-10-10T14:31:44.326437Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 367  requestId: <none> cookie: 184
2025-10-10T14:31:44.326441Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 369  requestId: <none> cookie: 185
2025-10-10T14:31:44.362758Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.326446Z node 3 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:31:44.362763Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 294
2025-10-10T14:31:44.326448Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.326452Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.362773Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 295 to 295
2025-10-10T14:31:44.326454Z node 3 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 185 partNo 0 count 1 size 20500
2025-10-10T14:31:44.326455Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.326467Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.326482Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.362782Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.326485Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.362793Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 295
2025-10-10T14:31:44.326491Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.362795Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (279-281)
2025-10-10T14:31:44.362804Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 296 to 296
2025-10-10T14:31:44.326493Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.362810Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Returning serverBytesSize = 92686 to budget
2025-10-10T14:31:44.362813Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.362818Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 296
2025-10-10T14:31:44.326499Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 372  requestId: <none> cookie: 187
2025-10-10T14:31:44.326503Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 373  requestId: <none> cookie: 188
2025-10-10T14:31:44.362824Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (279-279)
2025-10-10T14:31:44.362826Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 297 to 297
2025-10-10T14:31:44.326512Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 182 EndOffset 182 newEndOffset 185 commitOffset 0 clientCommitOffset 0 cookie 34 readingFinished 0 firstRead 0
2025-10-10T14:31:44.326515Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 182 endOffset 185
2025-10-10T14:31:44.326528Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 grpc read done: success# 1, data# { read_request { bytes_size: 78437 } }
2025-10-10T14:31:44.362834Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.326530Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.363137Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 297
2025-10-10T14:31:44.326534Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.326535Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 182, endOffset# 185, WTime# 1760106704323, sizeLag# 60774
2025-10-10T14:31:44.362840Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 1} (280-280)
2025-10-10T14:31:44.326537Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1TEvPartitionReady. Aval parts: 1
2025-10-10T14:31:44.326543Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 performing read request: guid# 96915922-eb9b8e49-25dd02de-d67603de, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 3, size# 72928, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-10T14:31:44.326544Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.326546Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.326554Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 187 partNo : 0 messageNo: 374 size 20545 offset: -1
2025-10-10T14:31:44.363174Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 2} (281-281)
2025-10-10T14:31:44.326555Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 got read request: guid# 9e3b7b7-b72b8573-8fcf175f-afd7f76b
2025-10-10T14:31:44.326557Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.326560Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.326562Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 3 maxSize 72928 maxTimeLagMs 0 readTimestampMs 0 readOffset 182 EndOffset 185 ClientCommitOffset 0 committedOffset 0 Guid 96915922-eb9b8e49-25dd02de-d67603de
2025-10-10T14:31:44.326563Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 188 partNo : 0 messageNo: 375 size 20655 offset: -1
2025-10-10T14:31:44.326567Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.326572Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.363202Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 298 to 298
2025-10-10T14:31:44.326573Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.326575Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.326581Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.326583Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.363211Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.326596Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 37 Topic 'rt3.dc1--test-topic' partition 0 user user offset 182 count 3 size 72928 endOffset 185 max time lag 0ms effective offset 182
2025-10-10T14:31:44.326611Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 37 added 1 blobs, size 60774 count 3 last offset 182, current partition end offset: 185
2025-10-10T14:31:44.363222Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 298
2025-10-10T14:31:44.326613Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 37. Send blob request.
2025-10-10T14:31:44.326619Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 182 partno 0 count 3 parts_count 0 source 1 size 60774 accessed 0 times before, last time 2025-10-10T14:31:44.000000Z
2025-10-10T14:31:44.326627Z node 3 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 37. All 1 blobs are from cache.
2025-10-10T14:31:44.326633Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:31:44.326636Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 182 partno 0 count 3 parts 0 suffix '63'
2025-10-10T14:31:44.326674Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 182 totakecount 3 count 3 size 60751 from pos 0 cbcount 3
2025-10-10T14:31:44.326688Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 182
2025-10-10T14:31:44.326742Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 185 Result { Offset: 182 Data: "... 20105 bytes ..." SourceId: "\000src_id" SeqNo: 183 WriteTimestampMS: 1760106704324 CreateTimestampMS: 1760106704323 UncompressedSize: 20031 PartitionKey: "" ExplicitHash: "" } Result { Offset: 183 Data: "... 20215 bytes ..." SourceId: "\000src_id" SeqNo: 184 WriteTimestampMS: 1760106704324 CreateTimestampMS: 1760106704324 UncompressedSize: 20141 PartitionKey: "" ExplicitHash: "" } Result { Offset: 184 Data: "... 20325 bytes ..." SourceId: "\000src_id" SeqNo: 185 WriteTimestampMS: 1760106704324 CreateTimestampMS: 1760106704324 UncompressedSize: 20251 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 3 RealReadOffset: 184 WaitQuotaTimeMs: 0 EndOffset: 185 StartOffset: 0 } Cookie: 182 }
2025-10-10T14:31:44.326765Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 35 from offset 185
2025-10-10T14:31:44.326770Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 185 ReadOffset 185 ReadGuid 96915922-eb9b8e49-25dd02de-d67603de has messages 1
2025-10-10T14:31:44.326786Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 read done: guid# 96915922-eb9b8e49-25dd02de-d67603de, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 60676
2025-10-10T14:31:44.326790Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 response to read: guid# 96915922-eb9b8e49-25dd02de-d67603de
2025-10-10T14:31:44.326865Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 Process answer. Aval parts: 0
2025-10-10T14:31:44.327086Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 185 count 1 size 20500 actorID [3:7559600726884252064:2448]
2025-10-10T14:31:44.327095Z node 3 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:31:44.327102Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 20442 WriteNewSizeFromSupportivePartitions# 0
>>> event from dataHandler: 2025-10-10T14:31:44.363296Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 299 to 299
2025-10-10T14:31:44.327104Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 185 partno 0 count 1 parts 0 suffix '63' size 20500
2025-10-10T14:31:44.327107Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.327109Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 Message { Data: ..30701 bytes.. Information: { Offset: 279 ProducerId: "src_id" SeqNo: 280 CreateTime: 2025-10-10T14:31:44.358000Z WriteTime: 2025-10-10T14:31:44.359000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:46198", "logtype": "unknown", "server": "ipv6:[::1]:46198" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..30811 bytes.. Information: { Offset: 280 ProducerId: "src_id" SeqNo: 281 CreateTime: 2025-10-10T14:31:44.358000Z WriteTime: 2025-10-10T14:31:44.359000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:46198", "logtype": "unknown", "server": "ipv6:[::1]:46198" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..30921 bytes.. Information: { Offset: 281 ProducerId: "src_id" SeqNo: 282 CreateTime: 2025-10-10T14:31:44.359000Z WriteTime: 2025-10-10T14:31:44.359000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:46198", "logtype": "unknown", "server": "ipv6:[::1]:46198" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } }2025-10-10T14:31:44.327112Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 186, partNo: 0, Offset: 185 is stored on disk
2025-10-10T14:31:44.327132Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:44.327137Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:44.327138Z node 3 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (2)
2025-10-10T14:31:44.327143Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.327161Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 185 EndOffset 185 newEndOffset 186 commitOffset 0 clientCommitOffset 0 cookie 35 readingFinished 0 firstRead 0
2025-10-10T14:31:44.327163Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 185 endOffset 186
2025-10-10T14:31:44.363785Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.327165Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 187 partNo 0
2025-10-10T14:31:44.327167Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.363791Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 299
2025-10-10T14:31:44.327183Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 187 partNo 0 FormedBlobsCount 0 NewHead: Offset 186 PartNo 0 PackedSize 20619 count 1 nextOffset 187 batches 1
2025-10-10T14:31:44.327188Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 188 partNo 0
2025-10-10T14:31:44.363795Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] The application data is transferred to the client. Number of messages 3, size 92433 bytes
2025-10-10T14:31:44.327192Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 188 partNo 0 FormedBlobsCount 0 NewHead: Offset 186 PartNo 0 PackedSize 41316 count 2 nextOffset 188 batches 1
2025-10-10T14:31:44.327194Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:44.327214Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.363804Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Returning serverBytesSize = 0 to budget
2025-10-10T14:31:44.327229Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 185, endOffset# 186, WTime# 1760106704324, sizeLag# 20500
2025-10-10T14:31:44.327230Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1TEvPartitionReady. Aval parts: 1
2025-10-10T14:31:44.327238Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 performing read request: guid# 1dd357dd-22612418-72162ae1-bc67858b, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 1, size# 24600, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-10T14:31:44.327240Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 186,2 HeadOffset 186 endOffset 186 curOffset 188 d0000000000_00000000000000000186_00000_0000000002_00000? size 41307 WTime 1760106704327
2025-10-10T14:31:44.363900Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write 1 messages with Id from 300 to 300
2025-10-10T14:31:44.327247Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 1 maxSize 24600 maxTimeLagMs 0 readTimestampMs 0 readOffset 185 EndOffset 186 ClientCommitOffset 0 committedOffset 0 Guid 1dd357dd-22612418-72162ae1-bc67858b
2025-10-10T14:31:44.327297Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:182: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:31:44.327304Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 371  requestId: <none> cookie: 186
2025-10-10T14:31:44.364239Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: try to update token
2025-10-10T14:31:44.327316Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.364244Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Send 1 message(s) (0 left), first sequence number is 300
2025-10-10T14:31:44.327319Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.327325Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.327326Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.327327Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.327333Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.327335Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.327340Z node 3 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:31:44.327349Z node 3 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 186 partNo 0 count 2 size 41307
2025-10-10T14:31:44.327382Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 376  requestId: <none> cookie: 189
2025-10-10T14:31:44.327386Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 377  requestId: <none> cookie: 190
2025-10-10T14:31:44.327389Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.327394Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.327405Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 38 Topic 'rt3.dc1--test-topic' partition 0 user user offset 185 count 1 size 24600 endOffset 186 max time lag 0ms effective offset 185
2025-10-10T14:31:44.327418Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 38 added 1 blobs, size 20500 count 1 last offset 185, current partition end offset: 186
2025-10-10T14:31:44.327420Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 38. Send blob request.
2025-10-10T14:31:44.327423Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.327425Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.327433Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 189 partNo : 0 messageNo: 378 size 20765 offset: -1
2025-10-10T14:31:44.327440Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 185 partno 0 count 1 parts_count 0 source 1 size 20500 accessed 0 times before, last time 2025-10-10T14:31:44.000000Z
2025-10-10T14:31:44.327442Z node 3 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 38. All 1 blobs are from cache.
2025-10-10T14:31:44.327446Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 185 partno 0 count 1 parts 0 suffix '63'
2025-10-10T14:31:44.327448Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.327449Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.327453Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 190 partNo : 0 messageNo: 379 size 20875 offset: -1
2025-10-10T14:31:44.327455Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.327460Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.327463Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:31:44.327472Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 185 totakecount 1 count 1 size 20477 from pos 0 cbcount 1
2025-10-10T14:31:44.327478Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.327480Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.327482Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 185
2025-10-10T14:31:44.327520Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 186 Result { Offset: 185 Data: "... 20435 bytes ..." SourceId: "\000src_id" SeqNo: 186 WriteTimestampMS: 1760106704325 CreateTimestampMS: 1760106704324 UncompressedSize: 20361 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 23 RealReadOffset: 185 WaitQuotaTimeMs: 0 EndOffset: 186 StartOffset: 0 } Cookie: 185 }
2025-10-10T14:31:44.327535Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 36 from offset 186
2025-10-10T14:31:44.327540Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 186 ReadOffset 186 ReadGuid 1dd357dd-22612418-72162ae1-bc67858b has messages 1
2025-10-10T14:31:44.327554Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 read done: guid# 1dd357dd-22612418-72162ae1-bc67858b, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 20534
2025-10-10T14:31:44.327557Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 response to read: guid# 1dd357dd-22612418-72162ae1-bc67858b
2025-10-10T14:31:44.327629Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 Process answer. Aval parts: 0
2025-10-10T14:31:44.327639Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.327681Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.327693Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.327712Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.327715Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.327725Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 380  requestId: <none> cookie: 191
2025-10-10T14:31:44.327730Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.327736Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.327801Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.327804Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.327810Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 191 partNo : 0 messageNo: 381 size 20985 offset: -1
2025-10-10T14:31:44.327814Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.327816Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.327819Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.327824Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.327828Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 382  requestId: <none> cookie: 192
2025-10-10T14:31:44.327838Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.327848Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.327850Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.327853Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 192 partNo : 0 messageNo: 383 size 21095 offset: -1
2025-10-10T14:31:44.327855Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.327858Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.364867Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Got ReadResponse, serverBytesSize = 188209, now ReadSizeBudget = 92686, ReadSizeServerDelta = 243393
2025-10-10T14:31:44.328117Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 186 count 2 size 41307 actorID [3:7559600726884252064:2448]
2025-10-10T14:31:44.328130Z node 3 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:31:44.328139Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 186 partno 0 count 2 parts 0 suffix '63' size 41307
2025-10-10T14:31:44.364892Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] In ContinueReadingDataImpl, ReadSizeBudget = 92686, ReadSizeServerDelta = 243393
2025-10-10T14:31:44.328146Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 41214 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:31:44.328153Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.328155Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.328159Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 187, partNo: 0, Offset: 186 is stored on disk
2025-10-10T14:31:44.328162Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.328165Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 188, partNo: 0, Offset: 187 is stored on disk
2025-10-10T14:31:44.328184Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.328185Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:44.328190Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:44.328191Z node 3 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (4)
2025-10-10T14:31:44.328196Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.328199Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 189 partNo 0
2025-10-10T14:31:44.328215Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 189 partNo 0 FormedBlobsCount 0 NewHead: Offset 188 PartNo 0 PackedSize 20839 count 1 nextOffset 189 batches 1
2025-10-10T14:31:44.364953Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 336079
2025-10-10T14:31:44.328219Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 190 partNo 0
2025-10-10T14:31:44.328223Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 190 partNo 0 FormedBlobsCount 0 NewHead: Offset 188 PartNo 0 PackedSize 41756 count 2 nextOffset 190 batches 1
2025-10-10T14:31:44.328226Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 191 partNo 0
2025-10-10T14:31:44.328230Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 191 partNo 0 FormedBlobsCount 0 NewHead: Offset 188 PartNo 0 PackedSize 62783 count 3 nextOffset 191 batches 1
2025-10-10T14:31:44.328232Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 192 partNo 0
2025-10-10T14:31:44.328236Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 192 partNo 0 FormedBlobsCount 0 NewHead: Offset 188 PartNo 0 PackedSize 83920 count 4 nextOffset 192 batches 1
2025-10-10T14:31:44.328238Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:44.328241Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.328261Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 grpc read done: success# 1, data# { read_request { bytes_size: 39945 } }
2025-10-10T14:31:44.328271Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 got read request: guid# 7b6bf120-a0e2fffd-9eacc61-3f117f15
2025-10-10T14:31:44.328278Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 188,4 HeadOffset 188 endOffset 188 curOffset 192 d0000000000_00000000000000000188_00000_0000000004_00000? size 83860 WTime 1760106704328
2025-10-10T14:31:44.328280Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 186 EndOffset 186 newEndOffset 188 commitOffset 0 clientCommitOffset 0 cookie 36 readingFinished 0 firstRead 0
2025-10-10T14:31:44.328282Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 186 endOffset 188
2025-10-10T14:31:44.328288Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 186, endOffset# 188, WTime# 1760106704325, sizeLag# 41307
2025-10-10T14:31:44.328290Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1TEvPartitionReady. Aval parts: 1
2025-10-10T14:31:44.328295Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 performing read request: guid# 6c0bce2a-6f69ebef-cc1e3b6a-911f8f66, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 2, size# 49568, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-10T14:31:44.365366Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (282-287)
2025-10-10T14:31:44.328302Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 2 maxSize 49568 maxTimeLagMs 0 readTimestampMs 0 readOffset 186 EndOffset 188 ClientCommitOffset 0 committedOffset 0 Guid 6c0bce2a-6f69ebef-cc1e3b6a-911f8f66
2025-10-10T14:31:44.365389Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Returning serverBytesSize = 188209 to budget
2025-10-10T14:31:44.328310Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:182: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:31:44.328317Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 374  requestId: <none> cookie: 187
2025-10-10T14:31:44.328322Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.328322Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 375  requestId: <none> cookie: 188
2025-10-10T14:31:44.365405Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (282-282)
2025-10-10T14:31:44.328326Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.328326Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.328330Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.328335Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.328336Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.365418Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 1} (283-283)
2025-10-10T14:31:44.328339Z node 3 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:31:44.328344Z node 3 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 188 partNo 0 count 4 size 83860
2025-10-10T14:31:44.328351Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.365437Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 2} (284-284)
2025-10-10T14:31:44.328352Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.328374Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 384  requestId: <none> cookie: 193
2025-10-10T14:31:44.365449Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 3} (285-285)
2025-10-10T14:31:44.328377Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 385  requestId: <none> cookie: 194
2025-10-10T14:31:44.328386Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.328390Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.328393Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 39 Topic 'rt3.dc1--test-topic' partition 0 user user offset 186 count 2 size 49568 endOffset 188 max time lag 0ms effective offset 186
2025-10-10T14:31:44.365477Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 4} (286-286)
2025-10-10T14:31:44.328400Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 39 added 1 blobs, size 41307 count 2 last offset 186, current partition end offset: 188
2025-10-10T14:31:44.328402Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 39. Send blob request.
2025-10-10T14:31:44.328407Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 186 partno 0 count 2 parts_count 0 source 1 size 41307 accessed 0 times before, last time 2025-10-10T14:31:44.000000Z
2025-10-10T14:31:44.328409Z node 3 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 39. All 1 blobs are from cache.
2025-10-10T14:31:44.328412Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 186 partno 0 count 2 parts 0 suffix '63'
2025-10-10T14:31:44.328413Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.328414Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.328434Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 193 partNo : 0 messageNo: 386 size 21205 offset: -1
2025-10-10T14:31:44.365833Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 5} (287-287)
2025-10-10T14:31:44.328437Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.328438Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.328441Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 194 partNo : 0 messageNo: 387 size 21315 offset: -1
2025-10-10T14:31:44.328444Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:31:44.328456Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 186 totakecount 2 count 2 size 41284 from pos 0 cbcount 2
2025-10-10T14:31:44.328463Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.328467Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.328469Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.328471Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.328475Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 186
2025-10-10T14:31:44.328522Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 188 Result { Offset: 186 Data: "... 20545 bytes ..." SourceId: "\000src_id" SeqNo: 187 WriteTimestampMS: 1760106704327 CreateTimestampMS: 1760106704325 UncompressedSize: 20471 PartitionKey: "" ExplicitHash: "" } Result { Offset: 187 Data: "... 20655 bytes ..." SourceId: "\000src_id" SeqNo: 188 WriteTimestampMS: 1760106704327 CreateTimestampMS: 1760106704326 UncompressedSize: 20581 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 23 RealReadOffset: 187 WaitQuotaTimeMs: 0 EndOffset: 188 StartOffset: 0 } Cookie: 186 }
2025-10-10T14:31:44.328542Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 37 from offset 188
2025-10-10T14:31:44.328546Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 188 ReadOffset 188 ReadGuid 6c0bce2a-6f69ebef-cc1e3b6a-911f8f66 has messages 1
2025-10-10T14:31:44.328559Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 read done: guid# 6c0bce2a-6f69ebef-cc1e3b6a-911f8f66, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 41265
2025-10-10T14:31:44.328563Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 response to read: guid# 6c0bce2a-6f69ebef-cc1e3b6a-911f8f66
2025-10-10T14:31:44.328679Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 Process answer. Aval parts: 0
2025-10-10T14:31:44.328752Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.328778Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.328798Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.328801Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.328811Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 388  requestId: <none> cookie: 195
2025-10-10T14:31:44.328822Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.328839Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.328840Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.328847Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 195 partNo : 0 messageNo: 389 size 21425 offset: -1
2025-10-10T14:31:44.328851Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.328856Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.329072Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 188 count 4 size 83860 actorID [3:7559600726884252064:2448]
2025-10-10T14:31:44.329079Z node 3 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:31:44.329084Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 83748 WriteNewSizeFromSupportivePartitions# 0
>>> event from dataHandler: 2025-10-10T14:31:44.329087Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.329091Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 189, partNo: 0, Offset: 188 is stored on disk
2025-10-10T14:31:44.329094Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.329094Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 188 partno 0 count 4 parts 0 suffix '63' size 83860
2025-10-10T14:31:44.329096Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 190, partNo: 0, Offset: 189 is stored on disk
2025-10-10T14:31:44.329097Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.329099Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 191, partNo: 0, Offset: 190 is stored on disk
2025-10-10T14:31:44.329100Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.329102Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 192, partNo: 0, Offset: 191 is stored on disk
2025-10-10T14:31:44.329124Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:44.329129Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:44.329131Z node 3 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2025-10-10T14:31:44.329139Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 193 partNo 0
2025-10-10T14:31:44.329140Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 188 EndOffset 188 newEndOffset 192 commitOffset 0 clientCommitOffset 0 cookie 37 readingFinished 0 firstRead 0
2025-10-10T14:31:44.329143Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 188 endOffset 192
2025-10-10T14:31:44.329150Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 188, endOffset# 192, WTime# 1760106704327, sizeLag# 83860
2025-10-10T14:31:44.329151Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1TEvPartitionReady. Aval parts: 1
2025-10-10T14:31:44.329154Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 193 partNo 0 FormedBlobsCount 0 NewHead: Offset 192 PartNo 0 PackedSize 21279 count 1 nextOffset 193 batches 1
DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 Message { Data: ..31031 bytes.. Information: { Offset: 282 ProducerId: "src_id" SeqNo: 283 CreateTime: 2025-10-10T14:31:44.359000Z WriteTime: 2025-10-10T14:31:44.361000Z MessageGroupId: "src_id" Meta: { "_ip": "ipv6:[::1]:46198", "server": "ipv6:[::1]:46198", "logtype": "unknown", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..31141 bytes.. Information: { Offset: 283 ProducerId: "src_id" SeqNo: 284 CreateTime: 2025-10-10T14:31:44.359000Z WriteTime: 2025-10-10T14:31:44.361000Z MessageGroupId: "src_id" Meta: { "_ip": "ipv6:[::1]:46198", "server": "ipv6:[::1]:46198", "logtype": "unknown", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..31251 bytes.. Information: { Offset: 284 ProducerId: "src_id" SeqNo: 285 CreateTime: 2025-10-10T14:31:44.359000Z WriteTime: 2025-10-10T14:31:44.361000Z MessageGroupId: "src_id" Meta: { "_ip": "ipv6:[::1]:46198", "server": "ipv6:[::1]:46198", "logtype": "unknown", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..31361 bytes.. Information: { Offset: 285 ProducerId: "src_id" SeqNo: 286 CreateTime: 2025-10-10T14:31:44.360000Z WriteTime: 2025-10-10T14:31:44.361000Z MessageGroupId: "src_id" Meta: { "_ip": "ipv6:[::1]:46198", "server": "ipv6:[::1]:46198", "logtype": "unknown", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..31471 bytes.. Information: { Offset: 286 ProducerId: "src_id" SeqNo: 287 CreateTime: 2025-10-10T14:31:44.360000Z WriteTime: 2025-10-10T14:31:44.361000Z MessageGroupId: "src_id" Meta: { "_ip": "ipv6:[::1]:46198", "server": "ipv6:[::1]:46198", "logtype": "unknown", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..31581 bytes.. Information: { Offset: 287 ProducerId: "src_id" SeqNo: 288 CreateTime: 2025-10-10T14:31:44.360000Z WriteTime: 2025-10-10T14:31:44.361000Z MessageGroupId: "src_id" Meta: { "_ip": "ipv6:[::1]:46198", "server": "ipv6:[::1]:46198", "logtype": "unknown", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } }2025-10-10T14:31:44.329158Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 performing read request: guid# d41bd9ab-c143ce73-457a213d-6b07da47, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 4, size# 100632, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-10T14:31:44.329158Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 194 partNo 0
2025-10-10T14:31:44.366336Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Got ReadResponse, serverBytesSize = 159888, now ReadSizeBudget = 188209, ReadSizeServerDelta = 176191
2025-10-10T14:31:44.329162Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 194 partNo 0 FormedBlobsCount 0 NewHead: Offset 192 PartNo 0 PackedSize 42636 count 2 nextOffset 194 batches 1
2025-10-10T14:31:44.329164Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 195 partNo 0
2025-10-10T14:31:44.329166Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 4 maxSize 100632 maxTimeLagMs 0 readTimestampMs 0 readOffset 188 EndOffset 192 ClientCommitOffset 0 committedOffset 0 Guid d41bd9ab-c143ce73-457a213d-6b07da47
2025-10-10T14:31:44.329168Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 195 partNo 0 FormedBlobsCount 0 NewHead: Offset 192 PartNo 0 PackedSize 64103 count 3 nextOffset 195 batches 1
2025-10-10T14:31:44.329169Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:44.329217Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 192,3 HeadOffset 192 endOffset 192 curOffset 195 d0000000000_00000000000000000192_00000_0000000003_00000? size 64074 WTime 1760106704329
2025-10-10T14:31:44.329243Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:182: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:31:44.366776Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] In ContinueReadingDataImpl, ReadSizeBudget = 188209, ReadSizeServerDelta = 176191
2025-10-10T14:31:44.329250Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 grpc read done: success# 1, data# { read_request { bytes_size: 60676 } }
2025-10-10T14:31:44.329251Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 378  requestId: <none> cookie: 189
2025-10-10T14:31:44.329270Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 379  requestId: <none> cookie: 190
2025-10-10T14:31:44.329275Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 381  requestId: <none> cookie: 191
2025-10-10T14:31:44.329279Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 383  requestId: <none> cookie: 192
2025-10-10T14:31:44.366798Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] The application data is transferred to the client. Number of messages 6, size 187836 bytes
2025-10-10T14:31:44.329286Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.329289Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.329296Z node 3 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:31:44.329303Z node 3 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 192 partNo 0 count 3 size 64074
2025-10-10T14:31:44.329325Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 got read request: guid# d1528396-e9afe69e-fe89da73-597582bb
2025-10-10T14:31:44.329356Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.329362Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.329363Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 40 Topic 'rt3.dc1--test-topic' partition 0 user user offset 188 count 4 size 100632 endOffset 192 max time lag 0ms effective offset 188
2025-10-10T14:31:44.366830Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 364400
2025-10-10T14:31:44.329365Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.329367Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.329374Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 40 added 1 blobs, size 83860 count 4 last offset 188, current partition end offset: 192
2025-10-10T14:31:44.329376Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 40. Send blob request.
2025-10-10T14:31:44.329382Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 188 partno 0 count 4 parts_count 0 source 1 size 83860 accessed 0 times before, last time 2025-10-10T14:31:44.000000Z
2025-10-10T14:31:44.329389Z node 3 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 40. All 1 blobs are from cache.
2025-10-10T14:31:44.329394Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:31:44.329396Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 188 partno 0 count 4 parts 0 suffix '63'
2025-10-10T14:31:44.329424Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 188 totakecount 4 count 4 size 83837 from pos 0 cbcount 4
2025-10-10T14:31:44.366849Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Returning serverBytesSize = 0 to budget
2025-10-10T14:31:44.329437Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 188
2025-10-10T14:31:44.329450Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.329473Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.329476Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 192 Result { Offset: 188 Data: "... 20765 bytes ..." SourceId: "\000src_id" SeqNo: 189 WriteTimestampMS: 1760106704328 CreateTimestampMS: 1760106704326 UncompressedSize: 20691 PartitionKey: "" ExplicitHash: "" } Result { Offset: 189 Data: "... 20875 bytes ..." SourceId: "\000src_id" SeqNo: 190 WriteTimestampMS: 1760106704328 CreateTimestampMS: 1760106704327 UncompressedSize: 20801 PartitionKey: "" ExplicitHash: "" } Result { Offset: 190 Data: "... 20985 bytes ..." SourceId: "\000src_id" SeqNo: 191 WriteTimestampMS: 1760106704328 CreateTimestampMS: 1760106704327 UncompressedSize: 20911 PartitionKey: "" ExplicitHash: "" } Result { Offset: 191 Data: "... 21095 bytes ..." SourceId: "\000src_id" SeqNo: 192 WriteTimestampMS: 1760106704328 CreateTimestampMS: 1760106704327 UncompressedSize: 21021 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 18446744073709551588 RealReadOffset: 191 WaitQuotaTimeMs: 0 EndOffset: 192 StartOffset: 0 } Cookie: 188 }
2025-10-10T14:31:44.366869Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (288-292)
2025-10-10T14:31:44.329496Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.329500Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.329513Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 390  requestId: <none> cookie: 196
2025-10-10T14:31:44.367174Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Returning serverBytesSize = 159888 to budget
2025-10-10T14:31:44.329522Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.329530Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.329531Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.329535Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 38 from offset 192
2025-10-10T14:31:44.329538Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 192 ReadOffset 192 ReadGuid d41bd9ab-c143ce73-457a213d-6b07da47 has messages 1
2025-10-10T14:31:44.329539Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 196 partNo : 0 messageNo: 391 size 21535 offset: -1
2025-10-10T14:31:44.329542Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.367191Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (288-288)
2025-10-10T14:31:44.329547Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.329548Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 read done: guid# d41bd9ab-c143ce73-457a213d-6b07da47, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 83717
2025-10-10T14:31:44.329551Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 response to read: guid# d41bd9ab-c143ce73-457a213d-6b07da47
2025-10-10T14:31:44.329588Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 Process answer. Aval parts: 0
2025-10-10T14:31:44.329713Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 grpc read done: success# 1, data# { read_request { bytes_size: 20534 } }
2025-10-10T14:31:44.367211Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 1} (289-289)
2025-10-10T14:31:44.329717Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 got read request: guid# 42df41ac-44fb58a6-2cd39b88-c65c07c1
2025-10-10T14:31:44.329730Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.329762Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.329783Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.329785Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.329793Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 392  requestId: <none> cookie: 197
2025-10-10T14:31:44.329803Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.329813Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.329814Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.329819Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 197 partNo : 0 messageNo: 393 size 21645 offset: -1
2025-10-10T14:31:44.329821Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.329825Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.330052Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.367232Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 2} (290-290)
2025-10-10T14:31:44.330056Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 192 count 3 size 64074 actorID [3:7559600726884252064:2448]
2025-10-10T14:31:44.330067Z node 3 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:31:44.330075Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 63966 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:31:44.330076Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 192 partno 0 count 3 parts 0 suffix '63' size 64074
2025-10-10T14:31:44.367254Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 3} (291-291)
2025-10-10T14:31:44.330080Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.330085Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 193, partNo: 0, Offset: 192 is stored on disk
2025-10-10T14:31:44.330086Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.330088Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.330091Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 194, partNo: 0, Offset: 193 is stored on disk
2025-10-10T14:31:44.330093Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.330095Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 195, partNo: 0, Offset: 194 is stored on disk
2025-10-10T14:31:44.330105Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 grpc read done: success# 1, data# { read_request { bytes_size: 41265 } }
2025-10-10T14:31:44.330122Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:44.330126Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:44.330128Z node 3 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (2)
2025-10-10T14:31:44.330137Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 196 partNo 0
2025-10-10T14:31:44.330144Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 got read request: guid# f23b03ab-71f57c9a-ad259713-f9e00c8f
2025-10-10T14:31:44.330154Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 192 EndOffset 192 newEndOffset 195 commitOffset 0 clientCommitOffset 0 cookie 38 readingFinished 0 firstRead 0
2025-10-10T14:31:44.330154Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 196 partNo 0 FormedBlobsCount 0 NewHead: Offset 195 PartNo 0 PackedSize 21609 count 1 nextOffset 196 batches 1
2025-10-10T14:31:44.367687Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 4} (292-292)
2025-10-10T14:31:44.330157Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 192 endOffset 195
2025-10-10T14:31:44.330159Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 197 partNo 0
2025-10-10T14:31:44.330162Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 197 partNo 0 FormedBlobsCount 0 NewHead: Offset 195 PartNo 0 PackedSize 43296 count 2 nextOffset 197 batches 1
2025-10-10T14:31:44.330163Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 192, endOffset# 195, WTime# 1760106704328, sizeLag# 64074
2025-10-10T14:31:44.330164Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:44.330167Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1TEvPartitionReady. Aval parts: 1
2025-10-10T14:31:44.330172Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 performing read request: guid# 5d9cd97c-b5e2e2fd-9595246d-78589e2f, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 3, size# 76888, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-10T14:31:44.330181Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 3 maxSize 76888 maxTimeLagMs 0 readTimestampMs 0 readOffset 192 EndOffset 195 ClientCommitOffset 0 committedOffset 0 Guid 5d9cd97c-b5e2e2fd-9595246d-78589e2f
2025-10-10T14:31:44.330210Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 195,2 HeadOffset 195 endOffset 195 curOffset 197 d0000000000_00000000000000000195_00000_0000000002_00000? size 43287 WTime 1760106704330
2025-10-10T14:31:44.330251Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:182: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:31:44.330258Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 386  requestId: <none> cookie: 193
2025-10-10T14:31:44.330269Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 387  requestId: <none> cookie: 194
2025-10-10T14:31:44.330272Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.330274Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.330281Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 389  requestId: <none> cookie: 195
2025-10-10T14:31:44.330283Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.330288Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.330288Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.330289Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.330291Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
>>> event from dataHandler: 2025-10-10T14:31:44.330296Z node 3 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:31:44.367918Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Got ReadResponse, serverBytesSize = 228410, now ReadSizeBudget = 159888, ReadSizeServerDelta = 135990
2025-10-10T14:31:44.330304Z node 3 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 195 partNo 0 count 2 size 43287
2025-10-10T14:31:44.330342Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 394  requestId: <none> cookie: 198
2025-10-10T14:31:44.330372Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 41 Topic 'rt3.dc1--test-topic' partition 0 user user offset 192 count 3 size 76888 endOffset 195 max time lag 0ms effective offset 192
2025-10-10T14:31:44.330384Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 41 added 1 blobs, size 64074 count 3 last offset 192, current partition end offset: 195
2025-10-10T14:31:44.330386Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 41. Send blob request.
2025-10-10T14:31:44.330394Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 192 partno 0 count 3 parts_count 0 source 1 size 64074 accessed 0 times before, last time 2025-10-10T14:31:44.000000Z
2025-10-10T14:31:44.330397Z node 3 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 41. All 1 blobs are from cache.
DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 Message { Data: ..31691 bytes.. Information: { Offset: 288 ProducerId: "src_id" SeqNo: 289 CreateTime: 2025-10-10T14:31:44.361000Z WriteTime: 2025-10-10T14:31:44.363000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "_ip": "ipv6:[::1]:46198", "server": "ipv6:[::1]:46198", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..31801 bytes.. Information: { Offset: 289 ProducerId: "src_id" SeqNo: 290 CreateTime: 2025-10-10T14:31:44.361000Z WriteTime: 2025-10-10T14:31:44.363000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "_ip": "ipv6:[::1]:46198", "server": "ipv6:[::1]:46198", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..31911 bytes.. Information: { Offset: 290 ProducerId: "src_id" SeqNo: 291 CreateTime: 2025-10-10T14:31:44.361000Z WriteTime: 2025-10-10T14:31:44.363000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "_ip": "ipv6:[::1]:46198", "server": "ipv6:[::1]:46198", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..32021 bytes.. Information: { Offset: 291 ProducerId: "src_id" SeqNo: 292 CreateTime: 2025-10-10T14:31:44.361000Z WriteTime: 2025-10-10T14:31:44.363000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "_ip": "ipv6:[::1]:46198", "server": "ipv6:[::1]:46198", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..32131 bytes.. Information: { Offset: 292 ProducerId: "src_id" SeqNo: 293 CreateTime: 2025-10-10T14:31:44.362000Z WriteTime: 2025-10-10T14:31:44.363000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "_ip": "ipv6:[::1]:46198", "server": "ipv6:[::1]:46198", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } }
2025-10-10T14:31:44.330403Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 192 partno 0 count 3 parts 0 suffix '63'
2025-10-10T14:31:44.330404Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:31:44.330416Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.330434Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 192 totakecount 3 count 3 size 64051 from pos 0 cbcount 3
2025-10-10T14:31:44.368044Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] In ContinueReadingDataImpl, ReadSizeBudget = 159888, ReadSizeServerDelta = 135990
2025-10-10T14:31:44.330446Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.330448Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.330456Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 198 partNo : 0 messageNo: 395 size 21755 offset: -1
2025-10-10T14:31:44.368077Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] The application data is transferred to the client. Number of messages 5, size 159555 bytes
2025-10-10T14:31:44.330463Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 192
2025-10-10T14:31:44.330469Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.368119Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 295878
2025-10-10T14:31:44.330475Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.330500Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.330527Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 195 Result { Offset: 192 Data: "... 21205 bytes ..." SourceId: "\000src_id" SeqNo: 193 WriteTimestampMS: 1760106704329 CreateTimestampMS: 1760106704327 UncompressedSize: 21131 PartitionKey: "" ExplicitHash: "" } Result { Offset: 193 Data: "... 21315 bytes ..." SourceId: "\000src_id" SeqNo: 194 WriteTimestampMS: 1760106704329 CreateTimestampMS: 1760106704328 UncompressedSize: 21241 PartitionKey: "" ExplicitHash: "" } Result { Offset: 194 Data: "... 21425 bytes ..." SourceId: "\000src_id" SeqNo: 195 WriteTimestampMS: 1760106704329 CreateTimestampMS: 1760106704328 UncompressedSize: 21351 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 3 RealReadOffset: 194 WaitQuotaTimeMs: 0 EndOffset: 195 StartOffset: 0 } Cookie: 192 }
2025-10-10T14:31:44.368388Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Returning serverBytesSize = 0 to budget
2025-10-10T14:31:44.330553Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 39 from offset 195
2025-10-10T14:31:44.330554Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.330558Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 195 ReadOffset 195 ReadGuid 5d9cd97c-b5e2e2fd-9595246d-78589e2f has messages 1
2025-10-10T14:31:44.330565Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.330575Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 read done: guid# 5d9cd97c-b5e2e2fd-9595246d-78589e2f, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 63976
2025-10-10T14:31:44.330579Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 response to read: guid# 5d9cd97c-b5e2e2fd-9595246d-78589e2f
2025-10-10T14:31:44.330631Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.330645Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.330648Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.330653Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 Process answer. Aval parts: 0
2025-10-10T14:31:44.330655Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.330657Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.330670Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 396  requestId: <none> cookie: 199
2025-10-10T14:31:44.330674Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 397  requestId: <none> cookie: 200
2025-10-10T14:31:44.330676Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.330680Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.330748Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.330752Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.368430Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (293-299)
2025-10-10T14:31:44.330760Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 199 partNo : 0 messageNo: 398 size 21865 offset: -1
2025-10-10T14:31:44.330764Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.368446Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Returning serverBytesSize = 228410 to budget
2025-10-10T14:31:44.330765Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.330769Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 200 partNo : 0 messageNo: 399 size 21975 offset: -1
2025-10-10T14:31:44.330774Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.330779Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.330781Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.368463Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (293-293)
2025-10-10T14:31:44.330783Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.331014Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 195 count 2 size 43287 actorID [3:7559600726884252064:2448]
2025-10-10T14:31:44.331023Z node 3 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:31:44.331028Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 43194 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:31:44.331033Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 195 partno 0 count 2 parts 0 suffix '63' size 43287
2025-10-10T14:31:44.368475Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 1} (294-294)
2025-10-10T14:31:44.331034Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.331038Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 196, partNo: 0, Offset: 195 is stored on disk
2025-10-10T14:31:44.331039Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.368493Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 2} (295-295)
2025-10-10T14:31:44.331042Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 197, partNo: 0, Offset: 196 is stored on disk
2025-10-10T14:31:44.331058Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:44.331062Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:44.368645Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 3} (296-296)
2025-10-10T14:31:44.331063Z node 3 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2025-10-10T14:31:44.331072Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 198 partNo 0
2025-10-10T14:31:44.331076Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 195 EndOffset 195 newEndOffset 197 commitOffset 0 clientCommitOffset 0 cookie 39 readingFinished 0 firstRead 0
2025-10-10T14:31:44.331079Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 195 endOffset 197
2025-10-10T14:31:44.331085Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 198 partNo 0 FormedBlobsCount 0 NewHead: Offset 197 PartNo 0 PackedSize 21829 count 1 nextOffset 198 batches 1
2025-10-10T14:31:44.331085Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 195, endOffset# 197, WTime# 1760106704329, sizeLag# 43287
2025-10-10T14:31:44.331087Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1TEvPartitionReady. Aval parts: 1
2025-10-10T14:31:44.331088Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 199 partNo 0
2025-10-10T14:31:44.331091Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 199 partNo 0 FormedBlobsCount 0 NewHead: Offset 197 PartNo 0 PackedSize 43736 count 2 nextOffset 199 batches 1
2025-10-10T14:31:44.331093Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 200 partNo 0
2025-10-10T14:31:44.331093Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 performing read request: guid# 1a8dac1f-5c29edcf-9ae11e1f-f026cb63, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 2, size# 51944, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-10T14:31:44.368672Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 4} (297-297)
2025-10-10T14:31:44.331096Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 200 partNo 0 FormedBlobsCount 0 NewHead: Offset 197 PartNo 0 PackedSize 65753 count 3 nextOffset 200 batches 1
2025-10-10T14:31:44.331097Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:44.331101Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 2 maxSize 51944 maxTimeLagMs 0 readTimestampMs 0 readOffset 195 EndOffset 197 ClientCommitOffset 0 committedOffset 0 Guid 1a8dac1f-5c29edcf-9ae11e1f-f026cb63
2025-10-10T14:31:44.331130Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 197,3 HeadOffset 197 endOffset 197 curOffset 200 d0000000000_00000000000000000197_00000_0000000003_00000? size 65724 WTime 1760106704331
2025-10-10T14:31:44.331144Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:182: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:31:44.331150Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 391  requestId: <none> cookie: 196
2025-10-10T14:31:44.331158Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 393  requestId: <none> cookie: 197
2025-10-10T14:31:44.331164Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.331166Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.331168Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.331172Z node 3 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:31:44.331174Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.331177Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.331178Z node 3 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 197 partNo 0 count 3 size 65724
2025-10-10T14:31:44.331207Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 42 Topic 'rt3.dc1--test-topic' partition 0 user user offset 195 count 2 size 51944 endOffset 197 max time lag 0ms effective offset 195
2025-10-10T14:31:44.331217Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 42 added 1 blobs, size 43287 count 2 last offset 195, current partition end offset: 197
2025-10-10T14:31:44.331219Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 42. Send blob request.
2025-10-10T14:31:44.331225Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 195 partno 0 count 2 parts_count 0 source 1 size 43287 accessed 0 times before, last time 2025-10-10T14:31:44.000000Z
2025-10-10T14:31:44.331228Z node 3 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 42. All 1 blobs are from cache.
2025-10-10T14:31:44.331233Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:31:44.331240Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 195 partno 0 count 2 parts 0 suffix '63'
2025-10-10T14:31:44.331249Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 195 totakecount 2 count 2 size 43264 from pos 0 cbcount 2
2025-10-10T14:31:44.331258Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 195
2025-10-10T14:31:44.331286Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 grpc read done: success# 1, data# { read_request { bytes_size: 83717 } }
2025-10-10T14:31:44.331302Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 got read request: guid# d42b29e3-1e3244e3-e8360d76-d872a328
2025-10-10T14:31:44.331306Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.368714Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 5} (298-298)
2025-10-10T14:31:44.331324Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 197 Result { Offset: 195 Data: "... 21535 bytes ..." SourceId: "\000src_id" SeqNo: 196 WriteTimestampMS: 1760106704330 CreateTimestampMS: 1760106704328 UncompressedSize: 21461 PartitionKey: "" ExplicitHash: "" } Result { Offset: 196 Data: "... 21645 bytes ..." SourceId: "\000src_id" SeqNo: 197 WriteTimestampMS: 1760106704330 CreateTimestampMS: 1760106704329 UncompressedSize: 21571 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 23 RealReadOffset: 196 WaitQuotaTimeMs: 0 EndOffset: 197 StartOffset: 0 } Cookie: 195 }
2025-10-10T14:31:44.331325Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.331327Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.331337Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 400  requestId: <none> cookie: 201
2025-10-10T14:31:44.331342Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.331349Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 40 from offset 197
2025-10-10T14:31:44.331350Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.331351Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.331353Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 197 ReadOffset 197 ReadGuid 1a8dac1f-5c29edcf-9ae11e1f-f026cb63 has messages 1
2025-10-10T14:31:44.331357Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 201 partNo : 0 messageNo: 401 size 22085 offset: -1
2025-10-10T14:31:44.331361Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.331364Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 read done: guid# 1a8dac1f-5c29edcf-9ae11e1f-f026cb63, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 43245
2025-10-10T14:31:44.331365Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.331367Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 response to read: guid# 1a8dac1f-5c29edcf-9ae11e1f-f026cb63
2025-10-10T14:31:44.331451Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 Process answer. Aval parts: 0
2025-10-10T14:31:44.331825Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 grpc read done: success# 1, data# { read_request { bytes_size: 63976 } }
2025-10-10T14:31:44.331854Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.331891Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.331895Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 got read request: guid# c9ee7df6-bbbb2422-bb70d34c-8d47c15c
2025-10-10T14:31:44.331920Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.331923Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.331932Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 197 count 3 size 65724 actorID [3:7559600726884252064:2448]
2025-10-10T14:31:44.331941Z node 3 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:31:44.331946Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 65616 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:31:44.369136Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 6} (299-299)
2025-10-10T14:31:44.331949Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.331949Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 197 partno 0 count 3 parts 0 suffix '63' size 65724
2025-10-10T14:31:44.331952Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 198, partNo: 0, Offset: 197 is stored on disk
2025-10-10T14:31:44.331954Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.331956Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 199, partNo: 0, Offset: 198 is stored on disk
2025-10-10T14:31:44.331957Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
>>> event from dataHandler: 2025-10-10T14:31:44.331959Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 200, partNo: 0, Offset: 199 is stored on disk
2025-10-10T14:31:44.331975Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:44.331979Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:44.331980Z node 3 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:44.331983Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 197 EndOffset 197 newEndOffset 200 commitOffset 0 clientCommitOffset 0 cookie 40 readingFinished 0 firstRead 0
2025-10-10T14:31:44.331985Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 197 endOffset 200
2025-10-10T14:31:44.331990Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 201 partNo 0
2025-10-10T14:31:44.331990Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 197, endOffset# 200, WTime# 1760106704330, sizeLag# 65724
2025-10-10T14:31:44.331991Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1TEvPartitionReady. Aval parts: 1
2025-10-10T14:31:44.331997Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 performing read request: guid# d5bcff64-2110e88c-81818745-67c91952, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 3, size# 78868, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-10T14:31:44.332003Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 3 maxSize 78868 maxTimeLagMs 0 readTimestampMs 0 readOffset 197 EndOffset 200 ClientCommitOffset 0 committedOffset 0 Guid d5bcff64-2110e88c-81818745-67c91952
2025-10-10T14:31:44.332005Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 201 partNo 0 FormedBlobsCount 0 NewHead: Offset 200 PartNo 0 PackedSize 22159 count 1 nextOffset 201 batches 1
2025-10-10T14:31:44.332008Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 Message { Data: ..32241 bytes.. Information: { Offset: 293 ProducerId: "src_id" SeqNo: 294 CreateTime: 2025-10-10T14:31:44.362000Z WriteTime: 2025-10-10T14:31:44.364000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "_ip": "ipv6:[::1]:46198", "server": "ipv6:[::1]:46198", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..32351 bytes.. Information: { Offset: 294 ProducerId: "src_id" SeqNo: 295 CreateTime: 2025-10-10T14:31:44.362000Z WriteTime: 2025-10-10T14:31:44.364000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "_ip": "ipv6:[::1]:46198", "server": "ipv6:[::1]:46198", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..32461 bytes.. Information: { Offset: 295 ProducerId: "src_id" SeqNo: 296 CreateTime: 2025-10-10T14:31:44.362000Z WriteTime: 2025-10-10T14:31:44.364000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "_ip": "ipv6:[::1]:46198", "server": "ipv6:[::1]:46198", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..32571 bytes.. Information: { Offset: 296 ProducerId: "src_id" SeqNo: 297 CreateTime: 2025-10-10T14:31:44.362000Z WriteTime: 2025-10-10T14:31:44.364000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "_ip": "ipv6:[::1]:46198", "server": "ipv6:[::1]:46198", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..32681 bytes.. Information: { Offset: 297 ProducerId: "src_id" SeqNo: 298 CreateTime: 2025-10-10T14:31:44.363000Z WriteTime: 2025-10-10T14:31:44.364000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "_ip": "ipv6:[::1]:46198", "server": "ipv6:[::1]:46198", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..32791 bytes.. Information: { Offset: 298 ProducerId: "src_id" SeqNo: 299 CreateTime: 2025-10-10T14:31:44.363000Z WriteTime: 2025-10-10T14:31:44.364000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "_ip": "ipv6:[::1]:46198", "server": "ipv6:[::1]:46198", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } Message { Data: ..32901 bytes.. Information: { Offset: 299 ProducerId: "src_id" SeqNo: 300 CreateTime: 2025-10-10T14:31:44.363000Z WriteTime: 2025-10-10T14:31:44.364000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "_ip": "ipv6:[::1]:46198", "server": "ipv6:[::1]:46198", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 } }
2025-10-10T14:31:44.332028Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.332067Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 200,1 HeadOffset 200 endOffset 200 curOffset 201 d0000000000_00000000000000000200_00000_0000000001_00000? size 22150 WTime 1760106704331
2025-10-10T14:31:44.332079Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:182: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:31:44.332084Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 402  requestId: <none> cookie: 202
2025-10-10T14:31:44.369511Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] The application data is transferred to the client. Number of messages 7, size 227997 bytes
2025-10-10T14:31:44.369830Z :DEBUG: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] [] Returning serverBytesSize = 0 to budget
2025-10-10T14:31:44.369531Z :INFO: [/Root] [/Root] [5f0e011-85f0ac12-a238a939-c9adead4] Closing read session. Close timeout: 18446744073709.551615s
2025-10-10T14:31:44.332089Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 395  requestId: <none> cookie: 198
2025-10-10T14:31:44.332093Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 398  requestId: <none> cookie: 199
2025-10-10T14:31:44.332097Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 399  requestId: <none> cookie: 200
2025-10-10T14:31:44.332102Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.332103Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.332107Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.332108Z node 3 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:31:44.332114Z node 3 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 200 partNo 0 count 1 size 22150
2025-10-10T14:31:44.369859Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset):
2025-10-10T14:31:44.332117Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.332124Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.332130Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.369868Z :INFO: [/Root] [/Root] [5f0e011-85f0ac12-a238a939-c9adead4] Counters: { Errors: 0 CurrentSessionLifetimeMs: 187 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-10T14:31:44.332143Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 43 Topic 'rt3.dc1--test-topic' partition 0 user user offset 197 count 3 size 78868 endOffset 200 max time lag 0ms effective offset 197
2025-10-10T14:31:44.332149Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 43 added 1 blobs, size 65724 count 3 last offset 197, current partition end offset: 200
2025-10-10T14:31:44.332150Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 43. Send blob request.
2025-10-10T14:31:44.332153Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.332154Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 197 partno 0 count 3 parts_count 0 source 1 size 65724 accessed 0 times before, last time 2025-10-10T14:31:44.000000Z
2025-10-10T14:31:44.332156Z node 3 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 43. All 1 blobs are from cache.
2025-10-10T14:31:44.332159Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.332160Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.332162Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 197 partno 0 count 3 parts 0 suffix '63'
2025-10-10T14:31:44.332165Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 202 partNo : 0 messageNo: 403 size 22195 offset: -1
2025-10-10T14:31:44.332168Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:31:44.332224Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 197 totakecount 3 count 3 size 65701 from pos 0 cbcount 3
2025-10-10T14:31:44.332235Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.332240Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.332244Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 197
2025-10-10T14:31:44.332297Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 200 Result { Offset: 197 Data: "... 21755 bytes ..." SourceId: "\000src_id" SeqNo: 198 WriteTimestampMS: 1760106704330 CreateTimestampMS: 1760106704329 UncompressedSize: 21681 PartitionKey: "" ExplicitHash: "" } Result { Offset: 198 Data: "... 21865 bytes ..." SourceId: "\000src_id" SeqNo: 199 WriteTimestampMS: 1760106704330 CreateTimestampMS: 1760106704329 UncompressedSize: 21791 PartitionKey: "" ExplicitHash: "" } Result { Offset: 199 Data: "... 21975 bytes ..." SourceId: "\000src_id" SeqNo: 200 WriteTimestampMS: 1760106704330 CreateTimestampMS: 1760106704330 UncompressedSize: 21901 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 3 RealReadOffset: 199 WaitQuotaTimeMs: 0 EndOffset: 200 StartOffset: 0 } Cookie: 197 }
2025-10-10T14:31:44.332351Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 41 from offset 200
2025-10-10T14:31:44.332356Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 200 ReadOffset 200 ReadGuid d5bcff64-2110e88c-81818745-67c91952 has messages 1
2025-10-10T14:31:44.332367Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 read done: guid# d5bcff64-2110e88c-81818745-67c91952, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 65626
2025-10-10T14:31:44.332372Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 response to read: guid# d5bcff64-2110e88c-81818745-67c91952
2025-10-10T14:31:44.332391Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.332438Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.332474Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.332478Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.332484Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.332485Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.332504Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 Process answer. Aval parts: 0
2025-10-10T14:31:44.332573Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 404  requestId: <none> cookie: 203
2025-10-10T14:31:44.332582Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 405  requestId: <none> cookie: 204
2025-10-10T14:31:44.332590Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.370059Z :INFO: [/Root] [/Root] [58801aae-576286d5-532f2de5-974b64be] Closing read session. Close timeout: 18446744073709.551615s
2025-10-10T14:31:44.332595Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.332606Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.370071Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset):
2025-10-10T14:31:44.332609Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.332617Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 203 partNo : 0 messageNo: 406 size 22305 offset: -1
2025-10-10T14:31:44.370075Z :INFO: [/Root] [/Root] [58801aae-576286d5-532f2de5-974b64be] Counters: { Errors: 0 CurrentSessionLifetimeMs: 140 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-10T14:31:44.332620Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.332621Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.332624Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 204 partNo : 0 messageNo: 407 size 22415 offset: -1
2025-10-10T14:31:44.332627Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.332632Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.332633Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.332635Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.332830Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 200 count 1 size 22150 actorID [3:7559600726884252064:2448]
2025-10-10T14:31:44.332832Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.332843Z node 3 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:31:44.332850Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 200 partno 0 count 1 parts 0 suffix '63' size 22150
2025-10-10T14:31:44.332852Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 22092 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:31:44.332857Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.370107Z :INFO: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] Closing read session. Close timeout: 18446744073709.551615s
2025-10-10T14:31:44.332863Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.370115Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): -:test-topic:0:1:299:0
2025-10-10T14:31:44.332864Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 201, partNo: 0, Offset: 200 is stored on disk
2025-10-10T14:31:44.370119Z :INFO: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] Counters: { Errors: 0 CurrentSessionLifetimeMs: 139 BytesRead: 4936800 MessagesRead: 300 BytesReadCompressed: 4936800 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-10T14:31:44.332883Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 grpc read done: success# 1, data# { read_request { bytes_size: 43245 } }
2025-10-10T14:31:44.332885Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:44.332892Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:44.332893Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 got read request: guid# 439bbaaa-8762d536-8c4bbf6d-5c2efa07
2025-10-10T14:31:44.332893Z node 3 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2025-10-10T14:31:44.332901Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 200 EndOffset 200 newEndOffset 201 commitOffset 0 clientCommitOffset 0 cookie 41 readingFinished 0 firstRead 0
2025-10-10T14:31:44.332905Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 200 endOffset 201
2025-10-10T14:31:44.332905Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 202 partNo 0
2025-10-10T14:31:44.332910Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 200, endOffset# 201, WTime# 1760106704330, sizeLag# 22150
2025-10-10T14:31:44.332912Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1TEvPartitionReady. Aval parts: 1
2025-10-10T14:31:44.370163Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: close. Timeout = 0 ms
2025-10-10T14:31:44.332917Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 performing read request: guid# 62c9d263-38ffe915-72bb45ce-2c4bf479, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 1, size# 26580, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-10T14:31:44.370442Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session will now close
2025-10-10T14:31:44.332925Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 1 maxSize 26580 maxTimeLagMs 0 readTimestampMs 0 readOffset 200 EndOffset 201 ClientCommitOffset 0 committedOffset 0 Guid 62c9d263-38ffe915-72bb45ce-2c4bf479
2025-10-10T14:31:44.370448Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: aborting
2025-10-10T14:31:44.332928Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 202 partNo 0 FormedBlobsCount 0 NewHead: Offset 201 PartNo 0 PackedSize 22269 count 1 nextOffset 202 batches 1
2025-10-10T14:31:44.332933Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 203 partNo 0
2025-10-10T14:31:44.332937Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 203 partNo 0 FormedBlobsCount 0 NewHead: Offset 201 PartNo 0 PackedSize 44616 count 2 nextOffset 203 batches 1
2025-10-10T14:31:44.332940Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 204 partNo 0
2025-10-10T14:31:44.332944Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 204 partNo 0 FormedBlobsCount 0 NewHead: Offset 201 PartNo 0 PackedSize 67073 count 3 nextOffset 204 batches 1
2025-10-10T14:31:44.332946Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:44.333021Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 201,3 HeadOffset 201 endOffset 201 curOffset 204 d0000000000_00000000000000000201_00000_0000000003_00000? size 67044 WTime 1760106704332
2025-10-10T14:31:44.333102Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:182: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:31:44.333113Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 401  requestId: <none> cookie: 201
2025-10-10T14:31:44.333130Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.370481Z :WARNING: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: could not confirm all writes in time or session aborted, perform hard shutdown
2025-10-10T14:31:44.333133Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.333135Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.333145Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.333147Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.333153Z node 3 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:31:44.333162Z node 3 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 201 partNo 0 count 3 size 67044
2025-10-10T14:31:44.333192Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 408  requestId: <none> cookie: 205
2025-10-10T14:31:44.333197Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.333217Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 44 Topic 'rt3.dc1--test-topic' partition 0 user user offset 200 count 1 size 26580 endOffset 201 max time lag 0ms effective offset 200
2025-10-10T14:31:44.333229Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 44 added 1 blobs, size 22150 count 1 last offset 200, current partition end offset: 201
2025-10-10T14:31:44.333231Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 44. Send blob request.
2025-10-10T14:31:44.333236Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.333238Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.333247Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 205 partNo : 0 messageNo: 409 size 22525 offset: -1
2025-10-10T14:31:44.333256Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 200 partno 0 count 1 parts_count 0 source 1 size 22150 accessed 0 times before, last time 2025-10-10T14:31:44.000000Z
2025-10-10T14:31:44.333260Z node 3 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 44. All 1 blobs are from cache.
2025-10-10T14:31:44.333264Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 200 partno 0 count 1 parts 0 suffix '63'
2025-10-10T14:31:44.333267Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.333275Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.333281Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:31:44.333300Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 200 totakecount 1 count 1 size 22127 from pos 0 cbcount 1
2025-10-10T14:31:44.333318Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 200
2025-10-10T14:31:44.333322Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.333379Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.370649Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [3:7559600731179219686:2503] disconnected; active server actors: 1
2025-10-10T14:31:44.370665Z node 4 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [3:7559600731179219686:2503] client user disconnected session shared/user_3_1_16103991684086808299_v1
2025-10-10T14:31:44.370673Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-10T14:31:44.333386Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 201 Result { Offset: 200 Data: "... 22085 bytes ..." SourceId: "\000src_id" SeqNo: 201 WriteTimestampMS: 1760106704331 CreateTimestampMS: 1760106704330 UncompressedSize: 22011 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 23 RealReadOffset: 200 WaitQuotaTimeMs: 0 EndOffset: 201 StartOffset: 0 } Cookie: 200 }
2025-10-10T14:31:44.370686Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=2, Families=1, UnradableFamilies=0 [], RequireBalancing=0 []
2025-10-10T14:31:44.333404Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.370692Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=2, desiredFamilyCount=0, allowPlusOne=1
2025-10-10T14:31:44.370697Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000007s
2025-10-10T14:31:44.370701Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [3:7559600731179219687:2504] disconnected; active server actors: 1
2025-10-10T14:31:44.333408Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.333420Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 410  requestId: <none> cookie: 206
2025-10-10T14:31:44.370704Z node 4 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [3:7559600731179219687:2504] client user disconnected session shared/user_3_2_4696609365094200052_v1
2025-10-10T14:31:44.333425Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.370706Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-10T14:31:44.333431Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 42 from offset 201
2025-10-10T14:31:44.370710Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=0 [], RequireBalancing=0 []
2025-10-10T14:31:44.370713Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-10-10T14:31:44.370715Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000002s
2025-10-10T14:31:44.333436Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 201 ReadOffset 201 ReadGuid 62c9d263-38ffe915-72bb45ce-2c4bf479 has messages 1
2025-10-10T14:31:44.370737Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [3:7559600731179219691:2507] disconnected; active server actors: 1
2025-10-10T14:31:44.333445Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 read done: guid# 62c9d263-38ffe915-72bb45ce-2c4bf479, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 22184
2025-10-10T14:31:44.333447Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.370741Z node 4 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [3:7559600731179219691:2507] client user disconnected session shared/user_3_3_5041631794065863042_v1
2025-10-10T14:31:44.333449Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 response to read: guid# 62c9d263-38ffe915-72bb45ce-2c4bf479
2025-10-10T14:31:44.333450Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.333458Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 206 partNo : 0 messageNo: 411 size 22635 offset: -1
2025-10-10T14:31:44.333463Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.333468Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.333500Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 Process answer. Aval parts: 0
2025-10-10T14:31:44.333736Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.333787Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 grpc read done: success# 1, data# { read_request { bytes_size: 65626 } }
2025-10-10T14:31:44.333795Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.333797Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 got read request: guid# 91a32861-5f9348fe-6100826c-179da2e
2025-10-10T14:31:44.333837Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.333848Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.333858Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.333863Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.333870Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.333872Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.333882Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 412  requestId: <none> cookie: 207
2025-10-10T14:31:44.333894Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 413  requestId: <none> cookie: 208
2025-10-10T14:31:44.333900Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.333906Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.333928Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 201 count 3 size 67044 actorID [3:7559600726884252064:2448]
2025-10-10T14:31:44.333935Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.333937Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 201 partno 0 count 3 parts 0 suffix '63' size 67044
2025-10-10T14:31:44.333938Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.333946Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 207 partNo : 0 messageNo: 414 size 22745 offset: -1
2025-10-10T14:31:44.333949Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.333951Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.333955Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 208 partNo : 0 messageNo: 415 size 22855 offset: -1
2025-10-10T14:31:44.333959Z node 3 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:31:44.333967Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 66936 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:31:44.333973Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.333978Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 202, partNo: 0, Offset: 201 is stored on disk
2025-10-10T14:31:44.333980Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.333983Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 203, partNo: 0, Offset: 202 is stored on disk
2025-10-10T14:31:44.333985Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.333988Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 204, partNo: 0, Offset: 203 is stored on disk
2025-10-10T14:31:44.334015Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:44.334020Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 201 EndOffset 201 newEndOffset 204 commitOffset 0 clientCommitOffset 0 cookie 42 readingFinished 0 firstRead 0
2025-10-10T14:31:44.334020Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:44.334021Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 201 endOffset 204
2025-10-10T14:31:44.334022Z node 3 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (2)
2025-10-10T14:31:44.334027Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 201, endOffset# 204, WTime# 1760106704331, sizeLag# 67044
2025-10-10T14:31:44.334028Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1TEvPartitionReady. Aval parts: 1
2025-10-10T14:31:44.334033Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 performing read request: guid# 199e8869-9cc6a7aa-e2df51ce-d993f915, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 3, size# 80452, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-10T14:31:44.334034Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 205 partNo 0
2025-10-10T14:31:44.334040Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 3 maxSize 80452 maxTimeLagMs 0 readTimestampMs 0 readOffset 201 EndOffset 204 ClientCommitOffset 0 committedOffset 0 Guid 199e8869-9cc6a7aa-e2df51ce-d993f915
2025-10-10T14:31:44.334054Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 205 partNo 0 FormedBlobsCount 0 NewHead: Offset 204 PartNo 0 PackedSize 22599 count 1 nextOffset 205 batches 1
2025-10-10T14:31:44.334062Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 206 partNo 0
2025-10-10T14:31:44.334066Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 206 partNo 0 FormedBlobsCount 0 NewHead: Offset 204 PartNo 0 PackedSize 45276 count 2 nextOffset 206 batches 1
2025-10-10T14:31:44.334069Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:44.334118Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 204,2 HeadOffset 204 endOffset 204 curOffset 206 d0000000000_00000000000000000204_00000_0000000002_00000? size 45267 WTime 1760106704333
2025-10-10T14:31:44.334142Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:182: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:31:44.334150Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.334157Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.334160Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.334163Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.334169Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 403  requestId: <none> cookie: 202
2025-10-10T14:31:44.334183Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 406  requestId: <none> cookie: 203
2025-10-10T14:31:44.334185Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.334186Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 407  requestId: <none> cookie: 204
2025-10-10T14:31:44.334188Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.334192Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.334198Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.334201Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.334207Z node 3 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:31:44.334216Z node 3 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 204 partNo 0 count 2 size 45267
2025-10-10T14:31:44.334223Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.334243Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.334257Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 45 Topic 'rt3.dc1--test-topic' partition 0 user user offset 201 count 3 size 80452 endOffset 204 max time lag 0ms effective offset 201
2025-10-10T14:31:44.334268Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 45 added 1 blobs, size 67044 count 3 last offset 201, current partition end offset: 204
2025-10-10T14:31:44.334270Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 45. Send blob request.
2025-10-10T14:31:44.334274Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.334276Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.334285Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 201 partno 0 count 3 parts_count 0 source 1 size 67044 accessed 0 times before, last time 2025-10-10T14:31:44.000000Z
2025-10-10T14:31:44.334288Z node 3 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 45. All 1 blobs are from cache.
2025-10-10T14:31:44.334294Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 201 partno 0 count 3 parts 0 suffix '63'
2025-10-10T14:31:44.334298Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:31:44.334329Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.334331Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 201 totakecount 3 count 3 size 67021 from pos 0 cbcount 3
2025-10-10T14:31:44.334345Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.334347Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 416  requestId: <none> cookie: 209
2025-10-10T14:31:44.334365Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 201
2025-10-10T14:31:44.334366Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.334380Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.334382Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.334386Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.334387Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.334394Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 209 partNo : 0 messageNo: 418 size 22965 offset: -1
2025-10-10T14:31:44.334399Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.334404Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.334406Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 417  requestId: <none> cookie: 210
2025-10-10T14:31:44.334413Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 204 Result { Offset: 201 Data: "... 22195 bytes ..." SourceId: "\000src_id" SeqNo: 202 WriteTimestampMS: 1760106704332 CreateTimestampMS: 1760106704331 UncompressedSize: 22121 PartitionKey: "" ExplicitHash: "" } Result { Offset: 202 Data: "... 22305 bytes ..." SourceId: "\000src_id" SeqNo: 203 WriteTimestampMS: 1760106704332 CreateTimestampMS: 1760106704331 UncompressedSize: 22231 PartitionKey: "" ExplicitHash: "" } Result { Offset: 203 Data: "... 22415 bytes ..." SourceId: "\000src_id" SeqNo: 204 WriteTimestampMS: 1760106704332 CreateTimestampMS: 1760106704331 UncompressedSize: 22341 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 3 RealReadOffset: 203 WaitQuotaTimeMs: 0 EndOffset: 204 StartOffset: 0 } Cookie: 201 }
2025-10-10T14:31:44.334414Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.334434Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.334435Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.334438Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 210 partNo : 0 messageNo: 419 size 23075 offset: -1
2025-10-10T14:31:44.334440Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 43 from offset 204
2025-10-10T14:31:44.334440Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.334442Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.334444Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 204 ReadOffset 204 ReadGuid 199e8869-9cc6a7aa-e2df51ce-d993f915 has messages 1
2025-10-10T14:31:44.334456Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 read done: guid# 199e8869-9cc6a7aa-e2df51ce-d993f915, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 66946
2025-10-10T14:31:44.334459Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 response to read: guid# 199e8869-9cc6a7aa-e2df51ce-d993f915
2025-10-10T14:31:44.334592Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 Process answer. Aval parts: 0
2025-10-10T14:31:44.334713Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.334747Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.334756Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.334758Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.334766Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 420  requestId: <none> cookie: 211
2025-10-10T14:31:44.334775Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.334787Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.334788Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.334793Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 211 partNo : 0 messageNo: 421 size 23185 offset: -1
2025-10-10T14:31:44.334795Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.334798Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.334886Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 204 count 2 size 45267 actorID [3:7559600726884252064:2448]
2025-10-10T14:31:44.334893Z node 3 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:31:44.334900Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 45174 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:31:44.334903Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.334906Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 205, partNo: 0, Offset: 204 is stored on disk
2025-10-10T14:31:44.334907Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 204 partno 0 count 2 parts 0 suffix '63' size 45267
2025-10-10T14:31:44.334909Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.334912Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 206, partNo: 0, Offset: 205 is stored on disk
2025-10-10T14:31:44.334915Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.334927Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:44.334932Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:44.334933Z node 3 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (5)
2025-10-10T14:31:44.334944Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 207 partNo 0
2025-10-10T14:31:44.334961Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 207 partNo 0 FormedBlobsCount 0 NewHead: Offset 206 PartNo 0 PackedSize 22819 count 1 nextOffset 207 batches 1
2025-10-10T14:31:44.334966Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 208 partNo 0
2025-10-10T14:31:44.334969Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.334969Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 208 partNo 0 FormedBlobsCount 0 NewHead: Offset 206 PartNo 0 PackedSize 45716 count 2 nextOffset 208 batches 1
2025-10-10T14:31:44.334973Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 209 partNo 0
2025-10-10T14:31:44.334976Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 209 partNo 0 FormedBlobsCount 0 NewHead: Offset 206 PartNo 0 PackedSize 68723 count 3 nextOffset 209 batches 1
2025-10-10T14:31:44.334979Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 210 partNo 0
2025-10-10T14:31:44.334981Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 210 partNo 0 FormedBlobsCount 0 NewHead: Offset 206 PartNo 0 PackedSize 91840 count 4 nextOffset 210 batches 1
2025-10-10T14:31:44.334983Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 211 partNo 0
2025-10-10T14:31:44.334985Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 204 EndOffset 204 newEndOffset 206 commitOffset 0 clientCommitOffset 0 cookie 43 readingFinished 0 firstRead 0
2025-10-10T14:31:44.334987Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 211 partNo 0 FormedBlobsCount 0 NewHead: Offset 206 PartNo 0 PackedSize 115067 count 5 nextOffset 211 batches 1
2025-10-10T14:31:44.334988Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:44.334990Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 204 endOffset 206
2025-10-10T14:31:44.334998Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 204, endOffset# 206, WTime# 1760106704332, sizeLag# 45267
2025-10-10T14:31:44.335000Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1TEvPartitionReady. Aval parts: 1
2025-10-10T14:31:44.335007Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 performing read request: guid# ebe17ec3-16e05f58-b790bc98-7ba01849, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 2, size# 54320, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-10T14:31:44.335015Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 2 maxSize 54320 maxTimeLagMs 0 readTimestampMs 0 readOffset 204 EndOffset 206 ClientCommitOffset 0 committedOffset 0 Guid ebe17ec3-16e05f58-b790bc98-7ba01849
2025-10-10T14:31:44.335037Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 206,5 HeadOffset 206 endOffset 206 curOffset 211 d0000000000_00000000000000000206_00000_0000000005_00000? size 114976 WTime 1760106704334
2025-10-10T14:31:44.335068Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:182: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:31:44.335074Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 409  requestId: <none> cookie: 205
2025-10-10T14:31:44.335083Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 411  requestId: <none> cookie: 206
2025-10-10T14:31:44.335085Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.335087Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.335088Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.335094Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.335094Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.335095Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.335099Z node 3 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:31:44.335105Z node 3 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 206 partNo 0 count 5 size 114976
2025-10-10T14:31:44.335124Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 422  requestId: <none> cookie: 212
2025-10-10T14:31:44.335139Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 46 Topic 'rt3.dc1--test-topic' partition 0 user user offset 204 count 2 size 54320 endOffset 206 max time lag 0ms effective offset 204
2025-10-10T14:31:44.335147Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 46 added 1 blobs, size 45267 count 2 last offset 204, current partition end offset: 206
2025-10-10T14:31:44.335149Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 46. Send blob request.
2025-10-10T14:31:44.335149Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.335153Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 204 partno 0 count 2 parts_count 0 source 1 size 45267 accessed 0 times before, last time 2025-10-10T14:31:44.000000Z
2025-10-10T14:31:44.335155Z node 3 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 46. All 1 blobs are from cache.
2025-10-10T14:31:44.335159Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:31:44.335170Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 204 partno 0 count 2 parts 0 suffix '63'
2025-10-10T14:31:44.335175Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 204 totakecount 2 count 2 size 45244 from pos 0 cbcount 2
2025-10-10T14:31:44.335183Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.335184Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.335189Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 212 partNo : 0 messageNo: 423 size 23295 offset: -1
2025-10-10T14:31:44.335192Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 204
2025-10-10T14:31:44.335195Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.335199Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.335241Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 206 Result { Offset: 204 Data: "... 22525 bytes ..." SourceId: "\000src_id" SeqNo: 205 WriteTimestampMS: 1760106704333 CreateTimestampMS: 1760106704332 UncompressedSize: 22451 PartitionKey: "" ExplicitHash: "" } Result { Offset: 205 Data: "... 22635 bytes ..." SourceId: "\000src_id" SeqNo: 206 WriteTimestampMS: 1760106704333 CreateTimestampMS: 1760106704332 UncompressedSize: 22561 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 23 RealReadOffset: 205 WaitQuotaTimeMs: 0 EndOffset: 206 StartOffset: 0 } Cookie: 204 }
2025-10-10T14:31:44.335262Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 44 from offset 206
2025-10-10T14:31:44.335266Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 206 ReadOffset 206 ReadGuid ebe17ec3-16e05f58-b790bc98-7ba01849 has messages 1
2025-10-10T14:31:44.335285Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 read done: guid# ebe17ec3-16e05f58-b790bc98-7ba01849, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 45225
2025-10-10T14:31:44.335289Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 response to read: guid# ebe17ec3-16e05f58-b790bc98-7ba01849
2025-10-10T14:31:44.335356Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.335357Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 Process answer. Aval parts: 0
2025-10-10T14:31:44.335393Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.335409Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 grpc read done: success# 1, data# { read_request { bytes_size: 22184 } }
2025-10-10T14:31:44.335414Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 got read request: guid# 2b8d6efb-de12f3e5-59383c3e-7c56f8b9
2025-10-10T14:31:44.335415Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.335418Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.335428Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 424  requestId: <none> cookie: 213
2025-10-10T14:31:44.335435Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.335453Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.335454Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.335459Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 213 partNo : 0 messageNo: 425 size 23405 offset: -1
2025-10-10T14:31:44.335462Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.335466Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.336017Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 206 count 5 size 114976 actorID [3:7559600726884252064:2448]
2025-10-10T14:31:44.336035Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.336041Z node 3 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:31:44.336045Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 206 partno 0 count 5 parts 0 suffix '63' size 114976
2025-10-10T14:31:44.336046Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 114860 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:31:44.336050Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.336053Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 207, partNo: 0, Offset: 206 is stored on disk
2025-10-10T14:31:44.336054Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.336058Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 208, partNo: 0, Offset: 207 is stored on disk
2025-10-10T14:31:44.336059Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.336061Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 209, partNo: 0, Offset: 208 is stored on disk
2025-10-10T14:31:44.336062Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.336065Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 210, partNo: 0, Offset: 209 is stored on disk
2025-10-10T14:31:44.336066Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.336068Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 211, partNo: 0, Offset: 210 is stored on disk
2025-10-10T14:31:44.336080Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:44.336084Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:44.336085Z node 3 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (2)
2025-10-10T14:31:44.336099Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 212 partNo 0
2025-10-10T14:31:44.336111Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.336125Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 212 partNo 0 FormedBlobsCount 0 NewHead: Offset 211 PartNo 0 PackedSize 23369 count 1 nextOffset 212 batches 1
2025-10-10T14:31:44.336128Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 213 partNo 0
2025-10-10T14:31:44.336131Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 213 partNo 0 FormedBlobsCount 0 NewHead: Offset 211 PartNo 0 PackedSize 46816 count 2 nextOffset 213 batches 1
2025-10-10T14:31:44.336132Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 206 EndOffset 206 newEndOffset 211 commitOffset 0 clientCommitOffset 0 cookie 44 readingFinished 0 firstRead 0
2025-10-10T14:31:44.336132Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:44.336135Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 206 endOffset 211
2025-10-10T14:31:44.336142Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 206, endOffset# 211, WTime# 1760106704333, sizeLag# 114976
2025-10-10T14:31:44.336143Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1TEvPartitionReady. Aval parts: 1
2025-10-10T14:31:44.336150Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 performing read request: guid# 1f0f6e5b-17ef828d-8818432e-714e39be, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 6, size# 137971, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-10T14:31:44.336157Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 6 maxSize 137971 maxTimeLagMs 0 readTimestampMs 0 readOffset 206 EndOffset 211 ClientCommitOffset 0 committedOffset 0 Guid 1f0f6e5b-17ef828d-8818432e-714e39be
2025-10-10T14:31:44.336162Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 211,2 HeadOffset 211 endOffset 211 curOffset 213 d0000000000_00000000000000000211_00000_0000000002_00000? size 46807 WTime 1760106704335
2025-10-10T14:31:44.336176Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:182: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:31:44.336181Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 414  requestId: <none> cookie: 207
2025-10-10T14:31:44.336186Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 415  requestId: <none> cookie: 208
2025-10-10T14:31:44.336186Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.336189Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 418  requestId: <none> cookie: 209
2025-10-10T14:31:44.336190Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.336192Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 419  requestId: <none> cookie: 210
2025-10-10T14:31:44.336195Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 421  requestId: <none> cookie: 211
2025-10-10T14:31:44.336197Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.336199Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.336204Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.336206Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.336207Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.336207Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.336211Z node 3 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:31:44.336216Z node 3 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 211 partNo 0 count 2 size 46807
2025-10-10T14:31:44.336236Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 426  requestId: <none> cookie: 214
2025-10-10T14:31:44.336250Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 47 Topic 'rt3.dc1--test-topic' partition 0 user user offset 206 count 6 size 137971 endOffset 211 max time lag 0ms effective offset 206
2025-10-10T14:31:44.336256Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 47 added 1 blobs, size 114976 count 5 last offset 206, current partition end offset: 211
2025-10-10T14:31:44.336257Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 47. Send blob request.
2025-10-10T14:31:44.336262Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 206 partno 0 count 5 parts_count 0 source 1 size 114976 accessed 0 times before, last time 2025-10-10T14:31:44.000000Z
2025-10-10T14:31:44.336265Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.336268Z node 3 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 47. All 1 blobs are from cache.
2025-10-10T14:31:44.336271Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 206 partno 0 count 5 parts 0 suffix '63'
2025-10-10T14:31:44.336272Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:31:44.336331Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 206 totakecount 5 count 5 size 114953 from pos 0 cbcount 5
2025-10-10T14:31:44.336343Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 206
2025-10-10T14:31:44.336390Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 211 Result { Offset: 206 Data: "... 22745 bytes ..." SourceId: "\000src_id" SeqNo: 207 WriteTimestampMS: 1760106704334 CreateTimestampMS: 1760106704333 UncompressedSize: 22671 PartitionKey: "" ExplicitHash: "" } Result { Offset: 207 Data: "... 22855 bytes ..." SourceId: "\000src_id" SeqNo: 208 WriteTimestampMS: 1760106704334 CreateTimestampMS: 1760106704333 UncompressedSize: 22781 PartitionKey: "" ExplicitHash: "" } Result { Offset: 208 Data: "... 22965 bytes ..." SourceId: "\000src_id" SeqNo: 209 WriteTimestampMS: 1760106704334 CreateTimestampMS: 1760106704333 UncompressedSize: 22891 PartitionKey: "" ExplicitHash: "" } Result { Offset: 209 Data: "... 23075 bytes ..." SourceId: "\000src_id" SeqNo: 210 WriteTimestampMS: 1760106704334 CreateTimestampMS: 1760106704334 UncompressedSize: 23001 PartitionKey: "" ExplicitHash: "" } Result { Offset: 210 Data: "... 23185 bytes ..." SourceId: "\000src_id" SeqNo: 211 WriteTimestampMS: 1760106704334 CreateTimestampMS: 1760106704334 UncompressedSize: 23111 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 18446744073709551557 RealReadOffset: 210 WaitQuotaTimeMs: 0 EndOffset: 211 StartOffset: 0 } Cookie: 206 }
2025-10-10T14:31:44.336404Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.336483Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.336486Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.336488Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 45 from offset 211
2025-10-10T14:31:44.336492Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 211 ReadOffset 211 ReadGuid 1f0f6e5b-17ef828d-8818432e-714e39be has messages 1
2025-10-10T14:31:44.336495Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 214 partNo : 0 messageNo: 427 size 23515 offset: -1
2025-10-10T14:31:44.336499Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.336503Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 read done: guid# 1f0f6e5b-17ef828d-8818432e-714e39be, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 114788
2025-10-10T14:31:44.336506Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 response to read: guid# 1f0f6e5b-17ef828d-8818432e-714e39be
2025-10-10T14:31:44.336507Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.336550Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 Process answer. Aval parts: 0
2025-10-10T14:31:44.336562Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 grpc read done: success# 1, data# { read_request { bytes_size: 66946 } }
2025-10-10T14:31:44.336569Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 got read request: guid# 5894d31a-67ac759c-e8be5c7c-9e12c576
2025-10-10T14:31:44.336660Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.336718Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.336742Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.336744Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.336753Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 428  requestId: <none> cookie: 215
2025-10-10T14:31:44.336761Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.336769Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.336771Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.336777Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 215 partNo : 0 messageNo: 429 size 23625 offset: -1
2025-10-10T14:31:44.336779Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.336783Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.337036Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 211 count 2 size 46807 actorID [3:7559600726884252064:2448]
2025-10-10T14:31:44.337044Z node 3 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:31:44.337049Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 46714 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:31:44.337053Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.337057Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 212, partNo: 0, Offset: 211 is stored on disk
2025-10-10T14:31:44.337058Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 211 partno 0 count 2 parts 0 suffix '63' size 46807
2025-10-10T14:31:44.337059Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.337062Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 213, partNo: 0, Offset: 212 is stored on disk
2025-10-10T14:31:44.337086Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:44.337089Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:44.337090Z node 3 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (2)
2025-10-10T14:31:44.337098Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 214 partNo 0
2025-10-10T14:31:44.337112Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 214 partNo 0 FormedBlobsCount 0 NewHead: Offset 213 PartNo 0 PackedSize 23589 count 1 nextOffset 214 batches 1
2025-10-10T14:31:44.337115Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 215 partNo 0
2025-10-10T14:31:44.337115Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 211 EndOffset 211 newEndOffset 213 commitOffset 0 clientCommitOffset 0 cookie 45 readingFinished 0 firstRead 0
2025-10-10T14:31:44.337118Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 215 partNo 0 FormedBlobsCount 0 NewHead: Offset 213 PartNo 0 PackedSize 47256 count 2 nextOffset 215 batches 1
2025-10-10T14:31:44.337119Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 211 endOffset 213
2025-10-10T14:31:44.337119Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:44.337127Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 211, endOffset# 213, WTime# 1760106704334, sizeLag# 46807
2025-10-10T14:31:44.337129Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1TEvPartitionReady. Aval parts: 1
2025-10-10T14:31:44.337136Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 performing read request: guid# deac7aef-a0cb25a5-a83ad561-7eef11b0, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 2, size# 56168, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-10T14:31:44.337144Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 2 maxSize 56168 maxTimeLagMs 0 readTimestampMs 0 readOffset 211 EndOffset 213 ClientCommitOffset 0 committedOffset 0 Guid deac7aef-a0cb25a5-a83ad561-7eef11b0
2025-10-10T14:31:44.337149Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 213,2 HeadOffset 213 endOffset 213 curOffset 215 d0000000000_00000000000000000213_00000_0000000002_00000? size 47247 WTime 1760106704336
2025-10-10T14:31:44.337158Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.337159Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:182: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:31:44.337165Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 423  requestId: <none> cookie: 212
2025-10-10T14:31:44.337170Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 425  requestId: <none> cookie: 213
2025-10-10T14:31:44.337172Z node 3 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:31:44.337177Z node 3 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 213 partNo 0 count 2 size 47247
2025-10-10T14:31:44.337184Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.337185Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.337193Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.337198Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.337206Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.337218Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 48 Topic 'rt3.dc1--test-topic' partition 0 user user offset 211 count 2 size 56168 endOffset 213 max time lag 0ms effective offset 211
2025-10-10T14:31:44.337226Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 48 added 1 blobs, size 46807 count 2 last offset 211, current partition end offset: 213
2025-10-10T14:31:44.337227Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 48. Send blob request.
2025-10-10T14:31:44.337233Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 211 partno 0 count 2 parts_count 0 source 1 size 46807 accessed 0 times before, last time 2025-10-10T14:31:44.000000Z
2025-10-10T14:31:44.337235Z node 3 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 48. All 1 blobs are from cache.
2025-10-10T14:31:44.337238Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:31:44.337246Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 grpc read done: success# 1, data# { read_request { bytes_size: 45225 } }
2025-10-10T14:31:44.337253Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 got read request: guid# d3e7adf3-17885bf4-813b9c20-f65b5814
2025-10-10T14:31:44.337255Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 211 totakecount 2 count 2 size 46784 from pos 0 cbcount 2
2025-10-10T14:31:44.337255Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 211 partno 0 count 2 parts 0 suffix '63'
2025-10-10T14:31:44.337262Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.337263Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.337266Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 211
2025-10-10T14:31:44.337277Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 430  requestId: <none> cookie: 216
2025-10-10T14:31:44.337283Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.337291Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.337307Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 213 Result { Offset: 211 Data: "... 23295 bytes ..." SourceId: "\000src_id" SeqNo: 212 WriteTimestampMS: 1760106704335 CreateTimestampMS: 1760106704334 UncompressedSize: 23221 PartitionKey: "" ExplicitHash: "" } Result { Offset: 212 Data: "... 23405 bytes ..." SourceId: "\000src_id" SeqNo: 213 WriteTimestampMS: 1760106704335 CreateTimestampMS: 1760106704334 UncompressedSize: 23331 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 23 RealReadOffset: 212 WaitQuotaTimeMs: 0 EndOffset: 213 StartOffset: 0 } Cookie: 211 }
2025-10-10T14:31:44.337311Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.337321Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.337322Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.337327Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 216 partNo : 0 messageNo: 431 size 23735 offset: -1
2025-10-10T14:31:44.337343Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 46 from offset 213
2025-10-10T14:31:44.337347Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 213 ReadOffset 213 ReadGuid deac7aef-a0cb25a5-a83ad561-7eef11b0 has messages 1
2025-10-10T14:31:44.337353Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.337354Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.337356Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.337360Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.337364Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 read done: guid# deac7aef-a0cb25a5-a83ad561-7eef11b0, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 46765
2025-10-10T14:31:44.337366Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 432  requestId: <none> cookie: 217
2025-10-10T14:31:44.337369Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.337370Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 response to read: guid# deac7aef-a0cb25a5-a83ad561-7eef11b0
2025-10-10T14:31:44.337375Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.337376Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.337383Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 217 partNo : 0 messageNo: 433 size 23845 offset: -1
2025-10-10T14:31:44.337385Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.337386Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.337467Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 Process answer. Aval parts: 0
2025-10-10T14:31:44.337885Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.337907Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 grpc read done: success# 1, data# { read_request { bytes_size: 114788 } }
2025-10-10T14:31:44.337917Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.337943Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 got read request: guid# 3272a38f-84c654b5-9b40c35f-8620cbf7
2025-10-10T14:31:44.337946Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.337948Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.337955Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 213 count 2 size 47247 actorID [3:7559600726884252064:2448]
2025-10-10T14:31:44.337965Z node 3 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:31:44.337970Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 47154 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:31:44.337972Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 213 partno 0 count 2 parts 0 suffix '63' size 47247
2025-10-10T14:31:44.337974Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.337977Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 214, partNo: 0, Offset: 213 is stored on disk
2025-10-10T14:31:44.337979Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.337981Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 215, partNo: 0, Offset: 214 is stored on disk
2025-10-10T14:31:44.337995Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:44.337999Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:44.338000Z node 3 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (2)
2025-10-10T14:31:44.338006Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 213 EndOffset 213 newEndOffset 215 commitOffset 0 clientCommitOffset 0 cookie 46 readingFinished 0 firstRead 0
2025-10-10T14:31:44.338007Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 216 partNo 0
2025-10-10T14:31:44.338008Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 213 endOffset 215
2025-10-10T14:31:44.338013Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.338017Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 216 partNo 0 FormedBlobsCount 0 NewHead: Offset 215 PartNo 0 PackedSize 23809 count 1 nextOffset 216 batches 1
2025-10-10T14:31:44.338020Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 217 partNo 0
2025-10-10T14:31:44.338023Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 217 partNo 0 FormedBlobsCount 0 NewHead: Offset 215 PartNo 0 PackedSize 47696 count 2 nextOffset 217 batches 1
2025-10-10T14:31:44.338024Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:44.338063Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 215,2 HeadOffset 215 endOffset 215 curOffset 217 d0000000000_00000000000000000215_00000_0000000002_00000? size 47687 WTime 1760106704337
2025-10-10T14:31:44.338075Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:182: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:31:44.338075Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.338079Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 434  requestId: <none> cookie: 218
2025-10-10T14:31:44.338083Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 427  requestId: <none> cookie: 214
2025-10-10T14:31:44.338086Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 429  requestId: <none> cookie: 215
2025-10-10T14:31:44.338088Z node 3 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:31:44.338089Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.338093Z node 3 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 215 partNo 0 count 2 size 47687
2025-10-10T14:31:44.338095Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.338096Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.338097Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.338098Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.338102Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.338113Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.338114Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.338118Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 218 partNo : 0 messageNo: 436 size 23955 offset: -1
2025-10-10T14:31:44.338134Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 435  requestId: <none> cookie: 219
2025-10-10T14:31:44.338136Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.338140Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.338146Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 213, endOffset# 215, WTime# 1760106704335, sizeLag# 47247
2025-10-10T14:31:44.338147Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1TEvPartitionReady. Aval parts: 1
2025-10-10T14:31:44.338154Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 performing read request: guid# dc278478-6c0292e7-6dd756bd-1011e612, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 2, size# 56696, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-10T14:31:44.338161Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 2 maxSize 56696 maxTimeLagMs 0 readTimestampMs 0 readOffset 213 EndOffset 215 ClientCommitOffset 0 committedOffset 0 Guid dc278478-6c0292e7-6dd756bd-1011e612
2025-10-10T14:31:44.338172Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.338173Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.338181Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 49 Topic 'rt3.dc1--test-topic' partition 0 user user offset 213 count 2 size 56696 endOffset 215 max time lag 0ms effective offset 213
2025-10-10T14:31:44.338188Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 49 added 1 blobs, size 47247 count 2 last offset 213, current partition end offset: 215
2025-10-10T14:31:44.338189Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 49. Send blob request.
2025-10-10T14:31:44.338193Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 213 partno 0 count 2 parts_count 0 source 1 size 47247 accessed 0 times before, last time 2025-10-10T14:31:44.000000Z
2025-10-10T14:31:44.338195Z node 3 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 49. All 1 blobs are from cache.
2025-10-10T14:31:44.338198Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:31:44.338200Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 213 partno 0 count 2 parts 0 suffix '63'
2025-10-10T14:31:44.338208Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.338212Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 213 totakecount 2 count 2 size 47224 from pos 0 cbcount 2
2025-10-10T14:31:44.338212Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.338220Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 213
2025-10-10T14:31:44.338224Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.338225Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.338228Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 219 partNo : 0 messageNo: 437 size 24065 offset: -1
2025-10-10T14:31:44.338231Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.338232Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.338238Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.338240Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.338242Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 438  requestId: <none> cookie: 220
2025-10-10T14:31:44.338247Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.338260Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.338262Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.338264Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 220 partNo : 0 messageNo: 439 size 24175 offset: -1
2025-10-10T14:31:44.338266Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.338267Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 215 Result { Offset: 213 Data: "... 23515 bytes ..." SourceId: "\000src_id" SeqNo: 214 WriteTimestampMS: 1760106704336 CreateTimestampMS: 1760106704335 UncompressedSize: 23441 PartitionKey: "" ExplicitHash: "" } Result { Offset: 214 Data: "... 23625 bytes ..." SourceId: "\000src_id" SeqNo: 215 WriteTimestampMS: 1760106704336 CreateTimestampMS: 1760106704335 UncompressedSize: 23551 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 23 RealReadOffset: 214 WaitQuotaTimeMs: 0 EndOffset: 215 StartOffset: 0 } Cookie: 213 }
2025-10-10T14:31:44.338267Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.338291Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 47 from offset 215
2025-10-10T14:31:44.338296Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 215 ReadOffset 215 ReadGuid dc278478-6c0292e7-6dd756bd-1011e612 has messages 1
2025-10-10T14:31:44.338311Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 read done: guid# dc278478-6c0292e7-6dd756bd-1011e612, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 47205
2025-10-10T14:31:44.338314Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 response to read: guid# dc278478-6c0292e7-6dd756bd-1011e612
2025-10-10T14:31:44.338436Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 Process answer. Aval parts: 0
2025-10-10T14:31:44.338642Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.338667Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.338684Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.338686Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.338695Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 440  requestId: <none> cookie: 221
2025-10-10T14:31:44.338708Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.338714Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.338715Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.338720Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 221 partNo : 0 messageNo: 441 size 24285 offset: -1
2025-10-10T14:31:44.338722Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.338726Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.338785Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 215 count 2 size 47687 actorID [3:7559600726884252064:2448]
2025-10-10T14:31:44.338794Z node 3 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:31:44.338800Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 47594 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:31:44.338802Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 215 partno 0 count 2 parts 0 suffix '63' size 47687
2025-10-10T14:31:44.338803Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.338805Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 216, partNo: 0, Offset: 215 is stored on disk
2025-10-10T14:31:44.338807Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.338808Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 217, partNo: 0, Offset: 216 is stored on disk
2025-10-10T14:31:44.338830Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:44.338836Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:44.338837Z node 3 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (4)
2025-10-10T14:31:44.338842Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 215 EndOffset 215 newEndOffset 217 commitOffset 0 clientCommitOffset 0 cookie 47 readingFinished 0 firstRead 0
2025-10-10T14:31:44.338844Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 218 partNo 0
2025-10-10T14:31:44.338845Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 215 endOffset 217
2025-10-10T14:31:44.338852Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 215, endOffset# 217, WTime# 1760106704336, sizeLag# 47687
2025-10-10T14:31:44.338853Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1TEvPartitionReady. Aval parts: 1
2025-10-10T14:31:44.338856Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 218 partNo 0 FormedBlobsCount 0 NewHead: Offset 217 PartNo 0 PackedSize 24029 count 1 nextOffset 218 batches 1
2025-10-10T14:31:44.338859Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 219 partNo 0
2025-10-10T14:31:44.338860Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 219 partNo 0 FormedBlobsCount 0 NewHead: Offset 217 PartNo 0 PackedSize 48136 count 2 nextOffset 219 batches 1
2025-10-10T14:31:44.338860Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 performing read request: guid# 7d0adbed-e6318f65-56bc7686-ea7df51c, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 2, size# 57224, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-10T14:31:44.338862Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 220 partNo 0
2025-10-10T14:31:44.338865Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 220 partNo 0 FormedBlobsCount 0 NewHead: Offset 217 PartNo 0 PackedSize 72353 count 3 nextOffset 220 batches 1
2025-10-10T14:31:44.338866Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 221 partNo 0
2025-10-10T14:31:44.338869Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 2 maxSize 57224 maxTimeLagMs 0 readTimestampMs 0 readOffset 215 EndOffset 217 ClientCommitOffset 0 committedOffset 0 Guid 7d0adbed-e6318f65-56bc7686-ea7df51c
2025-10-10T14:31:44.338869Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 221 partNo 0 FormedBlobsCount 0 NewHead: Offset 217 PartNo 0 PackedSize 96680 count 4 nextOffset 221 batches 1
2025-10-10T14:31:44.338870Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:44.338915Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 217,4 HeadOffset 217 endOffset 217 curOffset 221 d0000000000_00000000000000000217_00000_0000000004_00000? size 96620 WTime 1760106704338
2025-10-10T14:31:44.338987Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:182: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:31:44.338993Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 431  requestId: <none> cookie: 216
2025-10-10T14:31:44.339001Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 433  requestId: <none> cookie: 217
2025-10-10T14:31:44.339007Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.339008Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.339009Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.339013Z node 3 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:31:44.339014Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.339019Z node 3 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 217 partNo 0 count 4 size 96620
2025-10-10T14:31:44.339048Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 50 Topic 'rt3.dc1--test-topic' partition 0 user user offset 215 count 2 size 57224 endOffset 217 max time lag 0ms effective offset 215
2025-10-10T14:31:44.339055Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 50 added 1 blobs, size 47687 count 2 last offset 215, current partition end offset: 217
2025-10-10T14:31:44.339057Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 50. Send blob request.
2025-10-10T14:31:44.339062Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 215 partno 0 count 2 parts_count 0 source 1 size 47687 accessed 0 times before, last time 2025-10-10T14:31:44.000000Z
2025-10-10T14:31:44.339064Z node 3 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 50. All 1 blobs are from cache.
2025-10-10T14:31:44.339068Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:31:44.339077Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 215 partno 0 count 2 parts 0 suffix '63'
2025-10-10T14:31:44.339090Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 215 totakecount 2 count 2 size 47664 from pos 0 cbcount 2
2025-10-10T14:31:44.339098Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 215
2025-10-10T14:31:44.339124Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 grpc read done: success# 1, data# { read_request { bytes_size: 46765 } }
2025-10-10T14:31:44.339135Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 got read request: guid# 2c693c29-56cef041-bf79be53-cd3a0981
2025-10-10T14:31:44.339138Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 217 Result { Offset: 215 Data: "... 23735 bytes ..." SourceId: "\000src_id" SeqNo: 216 WriteTimestampMS: 1760106704337 CreateTimestampMS: 1760106704336 UncompressedSize: 23661 PartitionKey: "" ExplicitHash: "" } Result { Offset: 216 Data: "... 23845 bytes ..." SourceId: "\000src_id" SeqNo: 217 WriteTimestampMS: 1760106704337 CreateTimestampMS: 1760106704337 UncompressedSize: 23771 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 23 RealReadOffset: 216 WaitQuotaTimeMs: 0 EndOffset: 217 StartOffset: 0 } Cookie: 215 }
2025-10-10T14:31:44.339161Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 48 from offset 217
2025-10-10T14:31:44.339165Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 217 ReadOffset 217 ReadGuid 7d0adbed-e6318f65-56bc7686-ea7df51c has messages 1
2025-10-10T14:31:44.339182Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 read done: guid# 7d0adbed-e6318f65-56bc7686-ea7df51c, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 47645
2025-10-10T14:31:44.339184Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 response to read: guid# 7d0adbed-e6318f65-56bc7686-ea7df51c
2025-10-10T14:31:44.339248Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.339248Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 Process answer. Aval parts: 0
2025-10-10T14:31:44.339295Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.339301Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.339347Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.339352Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.339368Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.339373Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.339381Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.339382Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.339394Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 442  requestId: <none> cookie: 222
2025-10-10T14:31:44.339399Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 443  requestId: <none> cookie: 223
2025-10-10T14:31:44.339402Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.339408Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.339420Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.339432Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.339438Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.339448Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 222 partNo : 0 messageNo: 444 size 24395 offset: -1
2025-10-10T14:31:44.339453Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.339454Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.339460Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 223 partNo : 0 messageNo: 445 size 24505 offset: -1
2025-10-10T14:31:44.339463Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.339465Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.339470Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.339477Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.339479Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.339481Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.339486Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.339488Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 446  requestId: <none> cookie: 224
2025-10-10T14:31:44.339548Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.339585Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.339602Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.339604Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.339609Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 224 partNo : 0 messageNo: 447 size 24615 offset: -1
2025-10-10T14:31:44.339613Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.339615Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.339618Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.339621Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.339625Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 448  requestId: <none> cookie: 225
2025-10-10T14:31:44.339632Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.339637Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.339641Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 grpc read done: success# 1, data# { read_request { bytes_size: 47205 } }
2025-10-10T14:31:44.339651Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 got read request: guid# ce8f9d86-aa810a9a-6f6e6027-5594798e
2025-10-10T14:31:44.339695Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.339702Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.339705Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.339714Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 225 partNo : 0 messageNo: 449 size 24725 offset: -1
2025-10-10T14:31:44.339718Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.339721Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.339725Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.339731Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.339737Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 450  requestId: <none> cookie: 226
2025-10-10T14:31:44.339748Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.339767Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.339769Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.339773Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 226 partNo : 0 messageNo: 451 size 24835 offset: -1
2025-10-10T14:31:44.339776Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.339780Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.339890Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 217 count 4 size 96620 actorID [3:7559600726884252064:2448]
2025-10-10T14:31:44.339900Z node 3 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:31:44.339907Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 96508 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:31:44.339909Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 217 partno 0 count 4 parts 0 suffix '63' size 96620
2025-10-10T14:31:44.339911Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.339917Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 218, partNo: 0, Offset: 217 is stored on disk
2025-10-10T14:31:44.339927Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.339937Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 219, partNo: 0, Offset: 218 is stored on disk
2025-10-10T14:31:44.339939Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.339942Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 220, partNo: 0, Offset: 219 is stored on disk
2025-10-10T14:31:44.339944Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.339956Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 221, partNo: 0, Offset: 220 is stored on disk
2025-10-10T14:31:44.339981Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:44.339986Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:44.339987Z node 3 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (5)
2025-10-10T14:31:44.339997Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 222 partNo 0
2025-10-10T14:31:44.340003Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 217 EndOffset 217 newEndOffset 221 commitOffset 0 clientCommitOffset 0 cookie 48 readingFinished 0 firstRead 0
2025-10-10T14:31:44.340008Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 217 endOffset 221
2025-10-10T14:31:44.340012Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 222 partNo 0 FormedBlobsCount 0 NewHead: Offset 221 PartNo 0 PackedSize 24469 count 1 nextOffset 222 batches 1
2025-10-10T14:31:44.340014Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 217, endOffset# 221, WTime# 1760106704337, sizeLag# 96620
2025-10-10T14:31:44.340015Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1TEvPartitionReady. Aval parts: 1
2025-10-10T14:31:44.340016Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 223 partNo 0
2025-10-10T14:31:44.340019Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 223 partNo 0 FormedBlobsCount 0 NewHead: Offset 221 PartNo 0 PackedSize 49016 count 2 nextOffset 223 batches 1
2025-10-10T14:31:44.340021Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 performing read request: guid# 7e191150-3b1b707b-b9b881e0-dd3ebb03, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 4, size# 115944, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-10T14:31:44.340022Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 224 partNo 0
2025-10-10T14:31:44.340025Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 224 partNo 0 FormedBlobsCount 0 NewHead: Offset 221 PartNo 0 PackedSize 73673 count 3 nextOffset 224 batches 1
2025-10-10T14:31:44.340028Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 225 partNo 0
2025-10-10T14:31:44.340028Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 4 maxSize 115944 maxTimeLagMs 0 readTimestampMs 0 readOffset 217 EndOffset 221 ClientCommitOffset 0 committedOffset 0 Guid 7e191150-3b1b707b-b9b881e0-dd3ebb03
2025-10-10T14:31:44.340031Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 225 partNo 0 FormedBlobsCount 0 NewHead: Offset 221 PartNo 0 PackedSize 98440 count 4 nextOffset 225 batches 1
2025-10-10T14:31:44.340033Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 226 partNo 0
2025-10-10T14:31:44.340037Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 226 partNo 0 FormedBlobsCount 0 NewHead: Offset 221 PartNo 0 PackedSize 123317 count 5 nextOffset 226 batches 1
2025-10-10T14:31:44.340039Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:44.340107Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 221,5 HeadOffset 221 endOffset 221 curOffset 226 d0000000000_00000000000000000221_00000_0000000005_00000? size 123226 WTime 1760106704339
2025-10-10T14:31:44.340137Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:182: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:31:44.340144Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 436  requestId: <none> cookie: 218
2025-10-10T14:31:44.340155Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 437  requestId: <none> cookie: 219
2025-10-10T14:31:44.340160Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 439  requestId: <none> cookie: 220
2025-10-10T14:31:44.340161Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.340163Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 441  requestId: <none> cookie: 221
2025-10-10T14:31:44.340165Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.340169Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.340171Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.340173Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.340174Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.340179Z node 3 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:31:44.340188Z node 3 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 221 partNo 0 count 5 size 123226
2025-10-10T14:31:44.340221Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 51 Topic 'rt3.dc1--test-topic' partition 0 user user offset 217 count 4 size 115944 endOffset 221 max time lag 0ms effective offset 217
2025-10-10T14:31:44.340228Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 51 added 1 blobs, size 96620 count 4 last offset 217, current partition end offset: 221
2025-10-10T14:31:44.340229Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 51. Send blob request.
2025-10-10T14:31:44.340234Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 217 partno 0 count 4 parts_count 0 source 1 size 96620 accessed 0 times before, last time 2025-10-10T14:31:44.000000Z
2025-10-10T14:31:44.340239Z node 3 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 51. All 1 blobs are from cache.
2025-10-10T14:31:44.340243Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:31:44.340269Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 217 partno 0 count 4 parts 0 suffix '63'
2025-10-10T14:31:44.340282Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 217 totakecount 4 count 4 size 96597 from pos 0 cbcount 4
2025-10-10T14:31:44.340293Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 217
2025-10-10T14:31:44.340351Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.340364Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 221 Result { Offset: 217 Data: "... 23955 bytes ..." SourceId: "\000src_id" SeqNo: 218 WriteTimestampMS: 1760106704338 CreateTimestampMS: 1760106704337 UncompressedSize: 23881 PartitionKey: "" ExplicitHash: "" } Result { Offset: 218 Data: "... 24065 bytes ..." SourceId: "\000src_id" SeqNo: 219 WriteTimestampMS: 1760106704338 CreateTimestampMS: 1760106704337 UncompressedSize: 23991 PartitionKey: "" ExplicitHash: "" } Result { Offset: 219 Data: "... 24175 bytes ..." SourceId: "\000src_id" SeqNo: 220 WriteTimestampMS: 1760106704338 CreateTimestampMS: 1760106704337 UncompressedSize: 24101 PartitionKey: "" ExplicitHash: "" } Result { Offset: 220 Data: "... 24285 bytes ..." SourceId: "\000src_id" SeqNo: 221 WriteTimestampMS: 1760106704338 CreateTimestampMS: 1760106704337 UncompressedSize: 24211 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 18446744073709551588 RealReadOffset: 220 WaitQuotaTimeMs: 0 EndOffset: 221 StartOffset: 0 } Cookie: 217 }
2025-10-10T14:31:44.340385Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.340390Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 49 from offset 221
2025-10-10T14:31:44.340393Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 221 ReadOffset 221 ReadGuid 7e191150-3b1b707b-b9b881e0-dd3ebb03 has messages 1
2025-10-10T14:31:44.340402Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.340404Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.340408Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 read done: guid# 7e191150-3b1b707b-b9b881e0-dd3ebb03, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 96477
2025-10-10T14:31:44.340412Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 response to read: guid# 7e191150-3b1b707b-b9b881e0-dd3ebb03
2025-10-10T14:31:44.340415Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 452  requestId: <none> cookie: 227
2025-10-10T14:31:44.340421Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.340428Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.340448Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.340459Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.340462Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.340468Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 227 partNo : 0 messageNo: 453 size 24945 offset: -1
2025-10-10T14:31:44.340472Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.340473Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.340477Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.340482Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.340486Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 454  requestId: <none> cookie: 228
2025-10-10T14:31:44.340502Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.340509Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 Process answer. Aval parts: 0
2025-10-10T14:31:44.340518Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.340520Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.340524Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 228 partNo : 0 messageNo: 455 size 25055 offset: -1
2025-10-10T14:31:44.340526Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.340529Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.340771Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 grpc read done: success# 1, data# { read_request { bytes_size: 47645 } }
2025-10-10T14:31:44.340832Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 got read request: guid# 97ac260a-7331ce6e-ad3995ea-c36a213f
2025-10-10T14:31:44.340981Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.341031Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.341037Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.341057Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.341065Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.341068Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.341099Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.341102Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.341115Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 221 count 5 size 123226 actorID [3:7559600726884252064:2448]
2025-10-10T14:31:44.341129Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 456  requestId: <none> cookie: 229
2025-10-10T14:31:44.341137Z node 3 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:31:44.341137Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 221 partno 0 count 5 parts 0 suffix '63' size 123226
2025-10-10T14:31:44.341144Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 123110 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:31:44.341148Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.341147Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.341152Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 222, partNo: 0, Offset: 221 is stored on disk
2025-10-10T14:31:44.341154Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.341157Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 223, partNo: 0, Offset: 222 is stored on disk
2025-10-10T14:31:44.341159Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.341163Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 224, partNo: 0, Offset: 223 is stored on disk
2025-10-10T14:31:44.341164Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.341168Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 225, partNo: 0, Offset: 224 is stored on disk
2025-10-10T14:31:44.341169Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.341172Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 226, partNo: 0, Offset: 225 is stored on disk
2025-10-10T14:31:44.341194Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:44.341198Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:44.341199Z node 3 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (2)
2025-10-10T14:31:44.341200Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 221 EndOffset 221 newEndOffset 226 commitOffset 0 clientCommitOffset 0 cookie 49 readingFinished 0 firstRead 0
2025-10-10T14:31:44.341202Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 221 endOffset 226
2025-10-10T14:31:44.341206Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 221, endOffset# 226, WTime# 1760106704338, sizeLag# 123226
2025-10-10T14:31:44.341207Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1TEvPartitionReady. Aval parts: 1
2025-10-10T14:31:44.341212Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 performing read request: guid# 5faa3109-5607d509-aeac1b31-5553a703, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 6, size# 147871, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-10T14:31:44.341212Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 227 partNo 0
2025-10-10T14:31:44.341218Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 6 maxSize 147871 maxTimeLagMs 0 readTimestampMs 0 readOffset 221 EndOffset 226 ClientCommitOffset 0 committedOffset 0 Guid 5faa3109-5607d509-aeac1b31-5553a703
2025-10-10T14:31:44.341227Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 227 partNo 0 FormedBlobsCount 0 NewHead: Offset 226 PartNo 0 PackedSize 25019 count 1 nextOffset 227 batches 1
2025-10-10T14:31:44.341230Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 228 partNo 0
2025-10-10T14:31:44.341233Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 228 partNo 0 FormedBlobsCount 0 NewHead: Offset 226 PartNo 0 PackedSize 50116 count 2 nextOffset 228 batches 1
2025-10-10T14:31:44.341234Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:44.341284Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 226,2 HeadOffset 226 endOffset 226 curOffset 228 d0000000000_00000000000000000226_00000_0000000002_00000? size 50107 WTime 1760106704340
2025-10-10T14:31:44.341303Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:182: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:31:44.341309Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 457  requestId: <none> cookie: 230
2025-10-10T14:31:44.341318Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 444  requestId: <none> cookie: 222
2025-10-10T14:31:44.341321Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 445  requestId: <none> cookie: 223
2025-10-10T14:31:44.341323Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.341325Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.341347Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.341348Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 229 partNo : 0 messageNo: 458 size 25165 offset: -1
2025-10-10T14:31:44.341353Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.341354Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 447  requestId: <none> cookie: 224
2025-10-10T14:31:44.341357Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.341362Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 449  requestId: <none> cookie: 225
2025-10-10T14:31:44.341366Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 451  requestId: <none> cookie: 226
2025-10-10T14:31:44.341370Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.341373Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.341374Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.341378Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.341379Z node 3 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:31:44.341381Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.341388Z node 3 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 226 partNo 0 count 2 size 50107
2025-10-10T14:31:44.341392Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.341398Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.341403Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.341405Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.341408Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 230 partNo : 0 messageNo: 459 size 25275 offset: -1
2025-10-10T14:31:44.341432Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.341434Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.341450Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 52 Topic 'rt3.dc1--test-topic' partition 0 user user offset 221 count 6 size 147871 endOffset 226 max time lag 0ms effective offset 221
2025-10-10T14:31:44.341462Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 52 added 1 blobs, size 123226 count 5 last offset 221, current partition end offset: 226
2025-10-10T14:31:44.341463Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 52. Send blob request.
2025-10-10T14:31:44.341468Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 221 partno 0 count 5 parts_count 0 source 1 size 123226 accessed 0 times before, last time 2025-10-10T14:31:44.000000Z
2025-10-10T14:31:44.341470Z node 3 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 52. All 1 blobs are from cache.
2025-10-10T14:31:44.341474Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:31:44.341491Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 221 partno 0 count 5 parts 0 suffix '63'
2025-10-10T14:31:44.341515Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 221 totakecount 5 count 5 size 123203 from pos 0 cbcount 5
2025-10-10T14:31:44.341533Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 221
2025-10-10T14:31:44.341595Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 226 Result { Offset: 221 Data: "... 24395 bytes ..." SourceId: "\000src_id" SeqNo: 222 WriteTimestampMS: 1760106704339 CreateTimestampMS: 1760106704338 UncompressedSize: 24321 PartitionKey: "" ExplicitHash: "" } Result { Offset: 222 Data: "... 24505 bytes ..." SourceId: "\000src_id" SeqNo: 223 WriteTimestampMS: 1760106704339 CreateTimestampMS: 1760106704339 UncompressedSize: 24431 PartitionKey: "" ExplicitHash: "" } Result { Offset: 223 Data: "... 24615 bytes ..." SourceId: "\000src_id" SeqNo: 224 WriteTimestampMS: 1760106704339 CreateTimestampMS: 1760106704339 UncompressedSize: 24541 PartitionKey: "" ExplicitHash: "" } Result { Offset: 224 Data: "... 24725 bytes ..." SourceId: "\000src_id" SeqNo: 225 WriteTimestampMS: 1760106704339 CreateTimestampMS: 1760106704339 UncompressedSize: 24651 PartitionKey: "" ExplicitHash: "" } Result { Offset: 225 Data: "... 24835 bytes ..." SourceId: "\000src_id" SeqNo: 226 WriteTimestampMS: 1760106704339 CreateTimestampMS: 1760106704339 UncompressedSize: 24761 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 18446744073709551557 RealReadOffset: 225 WaitQuotaTimeMs: 0 EndOffset: 226 StartOffset: 0 } Cookie: 221 }
2025-10-10T14:31:44.341636Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 50 from offset 226
2025-10-10T14:31:44.341640Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 226 ReadOffset 226 ReadGuid 5faa3109-5607d509-aeac1b31-5553a703 has messages 1
2025-10-10T14:31:44.341660Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.341661Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 read done: guid# 5faa3109-5607d509-aeac1b31-5553a703, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 123038
2025-10-10T14:31:44.341665Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 response to read: guid# 5faa3109-5607d509-aeac1b31-5553a703
2025-10-10T14:31:44.341686Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.341703Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.341705Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.341713Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 460  requestId: <none> cookie: 231
2025-10-10T14:31:44.341717Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.341723Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.341724Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.341729Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 231 partNo : 0 messageNo: 461 size 25385 offset: -1
2025-10-10T14:31:44.341732Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.341736Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.341768Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 Process answer. Aval parts: 0
2025-10-10T14:31:44.342093Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 226 count 2 size 50107 actorID [3:7559600726884252064:2448]
2025-10-10T14:31:44.342104Z node 3 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:31:44.342111Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 50014 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:31:44.342114Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 226 partno 0 count 2 parts 0 suffix '63' size 50107
2025-10-10T14:31:44.342115Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.342120Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 227, partNo: 0, Offset: 226 is stored on disk
2025-10-10T14:31:44.342124Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.342126Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 228, partNo: 0, Offset: 227 is stored on disk
2025-10-10T14:31:44.342149Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:44.342153Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:44.342154Z node 3 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2025-10-10T14:31:44.342164Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 226 EndOffset 226 newEndOffset 228 commitOffset 0 clientCommitOffset 0 cookie 50 readingFinished 0 firstRead 0
2025-10-10T14:31:44.342164Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 229 partNo 0
2025-10-10T14:31:44.342167Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 226 endOffset 228
2025-10-10T14:31:44.342173Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 226, endOffset# 228, WTime# 1760106704339, sizeLag# 50107
2025-10-10T14:31:44.342174Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1TEvPartitionReady. Aval parts: 1
2025-10-10T14:31:44.342180Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 performing read request: guid# 80b15b9f-647c04b4-c6e92f52-cabc6bb7, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 2, size# 60128, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-10T14:31:44.342180Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 229 partNo 0 FormedBlobsCount 0 NewHead: Offset 228 PartNo 0 PackedSize 25239 count 1 nextOffset 229 batches 1
2025-10-10T14:31:44.342185Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 230 partNo 0
2025-10-10T14:31:44.342188Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 230 partNo 0 FormedBlobsCount 0 NewHead: Offset 228 PartNo 0 PackedSize 50556 count 2 nextOffset 230 batches 1
2025-10-10T14:31:44.342192Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 231 partNo 0
2025-10-10T14:31:44.342194Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 2 maxSize 60128 maxTimeLagMs 0 readTimestampMs 0 readOffset 226 EndOffset 228 ClientCommitOffset 0 committedOffset 0 Guid 80b15b9f-647c04b4-c6e92f52-cabc6bb7
2025-10-10T14:31:44.342196Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 231 partNo 0 FormedBlobsCount 0 NewHead: Offset 228 PartNo 0 PackedSize 75983 count 3 nextOffset 231 batches 1
2025-10-10T14:31:44.342199Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:44.342252Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 228,3 HeadOffset 228 endOffset 228 curOffset 231 d0000000000_00000000000000000228_00000_0000000003_00000? size 75954 WTime 1760106704341
2025-10-10T14:31:44.342282Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:182: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:31:44.342289Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 453  requestId: <none> cookie: 227
2025-10-10T14:31:44.342301Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 455  requestId: <none> cookie: 228
2025-10-10T14:31:44.342308Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.342311Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.342311Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.342316Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.342318Z node 3 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:31:44.342322Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.342326Z node 3 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 228 partNo 0 count 3 size 75954
2025-10-10T14:31:44.342373Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 53 Topic 'rt3.dc1--test-topic' partition 0 user user offset 226 count 2 size 60128 endOffset 228 max time lag 0ms effective offset 226
2025-10-10T14:31:44.342384Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 53 added 1 blobs, size 50107 count 2 last offset 226, current partition end offset: 228
2025-10-10T14:31:44.342385Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 53. Send blob request.
2025-10-10T14:31:44.342390Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 226 partno 0 count 2 parts_count 0 source 1 size 50107 accessed 0 times before, last time 2025-10-10T14:31:44.000000Z
2025-10-10T14:31:44.342392Z node 3 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 53. All 1 blobs are from cache.
2025-10-10T14:31:44.342396Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:31:44.342409Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 226 totakecount 2 count 2 size 50084 from pos 0 cbcount 2
2025-10-10T14:31:44.342416Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 226 partno 0 count 2 parts 0 suffix '63'
2025-10-10T14:31:44.342418Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 226
2025-10-10T14:31:44.342443Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 grpc read done: success# 1, data# { read_request { bytes_size: 96477 } }
2025-10-10T14:31:44.342460Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.342460Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 got read request: guid# b66457e9-b13fee60-9f8b650d-c5e0de73
2025-10-10T14:31:44.342476Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.342484Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.342494Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.342497Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.342505Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 228 Result { Offset: 226 Data: "... 24945 bytes ..." SourceId: "\000src_id" SeqNo: 227 WriteTimestampMS: 1760106704340 CreateTimestampMS: 1760106704339 UncompressedSize: 24871 PartitionKey: "" ExplicitHash: "" } Result { Offset: 227 Data: "... 25055 bytes ..." SourceId: "\000src_id" SeqNo: 228 WriteTimestampMS: 1760106704340 CreateTimestampMS: 1760106704340 UncompressedSize: 24981 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 23 RealReadOffset: 227 WaitQuotaTimeMs: 0 EndOffset: 228 StartOffset: 0 } Cookie: 226 }
2025-10-10T14:31:44.342510Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.342512Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.342521Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 462  requestId: <none> cookie: 232
2025-10-10T14:31:44.342526Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 463  requestId: <none> cookie: 233
2025-10-10T14:31:44.342526Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 51 from offset 228
2025-10-10T14:31:44.342530Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.342530Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 228 ReadOffset 228 ReadGuid 80b15b9f-647c04b4-c6e92f52-cabc6bb7 has messages 1
2025-10-10T14:31:44.342534Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.342545Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 read done: guid# 80b15b9f-647c04b4-c6e92f52-cabc6bb7, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 50065
2025-10-10T14:31:44.342549Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 response to read: guid# 80b15b9f-647c04b4-c6e92f52-cabc6bb7
2025-10-10T14:31:44.342550Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.342553Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.342561Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 232 partNo : 0 messageNo: 464 size 25495 offset: -1
2025-10-10T14:31:44.342566Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.342568Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.342573Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 233 partNo : 0 messageNo: 465 size 25605 offset: -1
2025-10-10T14:31:44.342578Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.342587Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.342590Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.342592Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.342649Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.342658Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 Process answer. Aval parts: 0
2025-10-10T14:31:44.342677Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.342701Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.342704Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.342714Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 466  requestId: <none> cookie: 234
2025-10-10T14:31:44.342728Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.342735Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.342793Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.342793Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.342796Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.342803Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 234 partNo : 0 messageNo: 467 size 25715 offset: -1
2025-10-10T14:31:44.342807Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.342810Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.342814Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.342819Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.342825Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 468  requestId: <none> cookie: 235
2025-10-10T14:31:44.342834Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.342844Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.342845Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.342848Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 235 partNo : 0 messageNo: 469 size 25825 offset: -1
2025-10-10T14:31:44.342851Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.342853Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.343114Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 228 count 3 size 75954 actorID [3:7559600726884252064:2448]
2025-10-10T14:31:44.343129Z node 3 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:31:44.343138Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 228 partno 0 count 3 parts 0 suffix '63' size 75954
2025-10-10T14:31:44.343139Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 75846 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:31:44.343143Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.343150Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 229, partNo: 0, Offset: 228 is stored on disk
2025-10-10T14:31:44.343153Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.343157Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 230, partNo: 0, Offset: 229 is stored on disk
2025-10-10T14:31:44.343160Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.343163Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 231, partNo: 0, Offset: 230 is stored on disk
2025-10-10T14:31:44.343190Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:44.343198Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:44.343199Z node 3 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (4)
2025-10-10T14:31:44.343206Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 228 EndOffset 228 newEndOffset 231 commitOffset 0 clientCommitOffset 0 cookie 51 readingFinished 0 firstRead 0
2025-10-10T14:31:44.343209Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 228 endOffset 231
2025-10-10T14:31:44.343212Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 232 partNo 0
2025-10-10T14:31:44.343215Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 228, endOffset# 231, WTime# 1760106704340, sizeLag# 75954
2025-10-10T14:31:44.343216Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1TEvPartitionReady. Aval parts: 1
2025-10-10T14:31:44.343223Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 performing read request: guid# 6bac12e0-e02d296d-d8be9484-c89c12f4, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 3, size# 91144, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-10T14:31:44.343231Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 232 partNo 0 FormedBlobsCount 0 NewHead: Offset 231 PartNo 0 PackedSize 25569 count 1 nextOffset 232 batches 1
2025-10-10T14:31:44.343231Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 3 maxSize 91144 maxTimeLagMs 0 readTimestampMs 0 readOffset 228 EndOffset 231 ClientCommitOffset 0 committedOffset 0 Guid 6bac12e0-e02d296d-d8be9484-c89c12f4
2025-10-10T14:31:44.343235Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 233 partNo 0
2025-10-10T14:31:44.343239Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 233 partNo 0 FormedBlobsCount 0 NewHead: Offset 231 PartNo 0 PackedSize 51216 count 2 nextOffset 233 batches 1
2025-10-10T14:31:44.343252Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 234 partNo 0
2025-10-10T14:31:44.343258Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 234 partNo 0 FormedBlobsCount 0 NewHead: Offset 231 PartNo 0 PackedSize 76973 count 3 nextOffset 234 batches 1
2025-10-10T14:31:44.343261Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 235 partNo 0
2025-10-10T14:31:44.343264Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 235 partNo 0 FormedBlobsCount 0 NewHead: Offset 231 PartNo 0 PackedSize 102840 count 4 nextOffset 235 batches 1
2025-10-10T14:31:44.343266Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:44.343328Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 231,4 HeadOffset 231 endOffset 231 curOffset 235 d0000000000_00000000000000000231_00000_0000000004_00000? size 102780 WTime 1760106704342
2025-10-10T14:31:44.343366Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:182: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:31:44.343377Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 458  requestId: <none> cookie: 229
2025-10-10T14:31:44.343394Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 459  requestId: <none> cookie: 230
2025-10-10T14:31:44.343400Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 461  requestId: <none> cookie: 231
2025-10-10T14:31:44.343405Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.343409Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.343410Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.343413Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.343413Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.343421Z node 3 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:31:44.343429Z node 3 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 231 partNo 0 count 4 size 102780
2025-10-10T14:31:44.343479Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 54 Topic 'rt3.dc1--test-topic' partition 0 user user offset 228 count 3 size 91144 endOffset 231 max time lag 0ms effective offset 228
2025-10-10T14:31:44.343492Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 54 added 1 blobs, size 75954 count 3 last offset 228, current partition end offset: 231
2025-10-10T14:31:44.343495Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 54. Send blob request.
2025-10-10T14:31:44.343503Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 228 partno 0 count 3 parts_count 0 source 1 size 75954 accessed 0 times before, last time 2025-10-10T14:31:44.000000Z
2025-10-10T14:31:44.343506Z node 3 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 54. All 1 blobs are from cache.
2025-10-10T14:31:44.343514Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:31:44.343520Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 228 partno 0 count 3 parts 0 suffix '63'
2025-10-10T14:31:44.343559Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 228 totakecount 3 count 3 size 75931 from pos 0 cbcount 3
2025-10-10T14:31:44.343578Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 228
2025-10-10T14:31:44.343652Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 231 Result { Offset: 228 Data: "... 25165 bytes ..." SourceId: "\000src_id" SeqNo: 229 WriteTimestampMS: 1760106704341 CreateTimestampMS: 1760106704340 UncompressedSize: 25091 PartitionKey: "" ExplicitHash: "" } Result { Offset: 229 Data: "... 25275 bytes ..." SourceId: "\000src_id" SeqNo: 230 WriteTimestampMS: 1760106704341 CreateTimestampMS: 1760106704340 UncompressedSize: 25201 PartitionKey: "" ExplicitHash: "" } Result { Offset: 230 Data: "... 25385 bytes ..." SourceId: "\000src_id" SeqNo: 231 WriteTimestampMS: 1760106704341 CreateTimestampMS: 1760106704340 UncompressedSize: 25311 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 3 RealReadOffset: 230 WaitQuotaTimeMs: 0 EndOffset: 231 StartOffset: 0 } Cookie: 228 }
2025-10-10T14:31:44.343684Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 52 from offset 231
2025-10-10T14:31:44.343688Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 231 ReadOffset 231 ReadGuid 6bac12e0-e02d296d-d8be9484-c89c12f4 has messages 1
2025-10-10T14:31:44.343712Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 read done: guid# 6bac12e0-e02d296d-d8be9484-c89c12f4, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 75856
2025-10-10T14:31:44.343717Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 response to read: guid# 6bac12e0-e02d296d-d8be9484-c89c12f4
2025-10-10T14:31:44.343742Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.343805Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.343830Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.343835Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.343853Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 470  requestId: <none> cookie: 236
2025-10-10T14:31:44.343855Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 Process answer. Aval parts: 0
2025-10-10T14:31:44.343862Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.343879Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 grpc read done: success# 1, data# { read_request { bytes_size: 123038 } }
2025-10-10T14:31:44.343880Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.343882Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.343890Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 got read request: guid# fbdedbbb-73162c64-459df789-bab0ae80
2025-10-10T14:31:44.343894Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 236 partNo : 0 messageNo: 471 size 25935 offset: -1
2025-10-10T14:31:44.343898Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.343900Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.343910Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.343936Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.343965Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.343991Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.344004Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.344008Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.344016Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.344018Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.344026Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 472  requestId: <none> cookie: 237
2025-10-10T14:31:44.344032Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 473  requestId: <none> cookie: 238
2025-10-10T14:31:44.344042Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.344050Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.344066Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.344068Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.344076Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 237 partNo : 0 messageNo: 474 size 26045 offset: -1
2025-10-10T14:31:44.344079Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.344080Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.344085Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 238 partNo : 0 messageNo: 475 size 26155 offset: -1
2025-10-10T14:31:44.344090Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.344097Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.344100Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.344104Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.344280Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 grpc read done: success# 1, data# { read_request { bytes_size: 50065 } }
2025-10-10T14:31:44.344295Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 got read request: guid# ebb33db0-36fe79e1-eb8471b5-62b09d3
2025-10-10T14:31:44.344336Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 231 count 4 size 102780 actorID [3:7559600726884252064:2448]
2025-10-10T14:31:44.344359Z node 3 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:31:44.344360Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.344365Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 231 partno 0 count 4 parts 0 suffix '63' size 102780
2025-10-10T14:31:44.344367Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 102668 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:31:44.344371Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.344377Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 232, partNo: 0, Offset: 231 is stored on disk
2025-10-10T14:31:44.344380Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.344384Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 233, partNo: 0, Offset: 232 is stored on disk
2025-10-10T14:31:44.344386Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.344392Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 234, partNo: 0, Offset: 233 is stored on disk
2025-10-10T14:31:44.344394Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.344397Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 235, partNo: 0, Offset: 234 is stored on disk
2025-10-10T14:31:44.344418Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:44.344422Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:44.344424Z node 3 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2025-10-10T14:31:44.344439Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 236 partNo 0
2025-10-10T14:31:44.344445Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.344456Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 236 partNo 0 FormedBlobsCount 0 NewHead: Offset 235 PartNo 0 PackedSize 26009 count 1 nextOffset 236 batches 1
2025-10-10T14:31:44.344462Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 237 partNo 0
2025-10-10T14:31:44.344465Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 237 partNo 0 FormedBlobsCount 0 NewHead: Offset 235 PartNo 0 PackedSize 52096 count 2 nextOffset 237 batches 1
2025-10-10T14:31:44.344468Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 238 partNo 0
2025-10-10T14:31:44.344470Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 231 EndOffset 231 newEndOffset 235 commitOffset 0 clientCommitOffset 0 cookie 52 readingFinished 0 firstRead 0
2025-10-10T14:31:44.344472Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 238 partNo 0 FormedBlobsCount 0 NewHead: Offset 235 PartNo 0 PackedSize 78293 count 3 nextOffset 238 batches 1
2025-10-10T14:31:44.344472Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 231 endOffset 235
2025-10-10T14:31:44.344474Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:44.344479Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 231, endOffset# 235, WTime# 1760106704341, sizeLag# 102780
2025-10-10T14:31:44.344481Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1TEvPartitionReady. Aval parts: 1
2025-10-10T14:31:44.344491Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 performing read request: guid# f3e3b026-f627b8c-d980b7d6-7c2306ef, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 4, size# 123336, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-10T14:31:44.344500Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 4 maxSize 123336 maxTimeLagMs 0 readTimestampMs 0 readOffset 231 EndOffset 235 ClientCommitOffset 0 committedOffset 0 Guid f3e3b026-f627b8c-d980b7d6-7c2306ef
2025-10-10T14:31:44.344533Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 235,3 HeadOffset 235 endOffset 235 curOffset 238 d0000000000_00000000000000000235_00000_0000000003_00000? size 78264 WTime 1760106704344
2025-10-10T14:31:44.344616Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:182: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:31:44.344627Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 464  requestId: <none> cookie: 232
2025-10-10T14:31:44.344645Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 465  requestId: <none> cookie: 233
2025-10-10T14:31:44.344661Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.344665Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 467  requestId: <none> cookie: 234
2025-10-10T14:31:44.344668Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.344672Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 469  requestId: <none> cookie: 235
2025-10-10T14:31:44.344673Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.344678Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.344681Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.344690Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.344693Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.344698Z node 3 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:31:44.344711Z node 3 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 235 partNo 0 count 3 size 78264
2025-10-10T14:31:44.344734Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.344738Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 476  requestId: <none> cookie: 239
2025-10-10T14:31:44.344748Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.344758Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 55 Topic 'rt3.dc1--test-topic' partition 0 user user offset 231 count 4 size 123336 endOffset 235 max time lag 0ms effective offset 231
2025-10-10T14:31:44.344770Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 55 added 1 blobs, size 102780 count 4 last offset 231, current partition end offset: 235
2025-10-10T14:31:44.344772Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 55. Send blob request.
2025-10-10T14:31:44.344778Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 231 partno 0 count 4 parts_count 0 source 1 size 102780 accessed 0 times before, last time 2025-10-10T14:31:44.000000Z
2025-10-10T14:31:44.344780Z node 3 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 55. All 1 blobs are from cache.
2025-10-10T14:31:44.344784Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 231 partno 0 count 4 parts 0 suffix '63'
2025-10-10T14:31:44.344786Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.344788Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.344795Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 239 partNo : 0 messageNo: 477 size 26265 offset: -1
2025-10-10T14:31:44.344799Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:31:44.344861Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 231 totakecount 4 count 4 size 102757 from pos 0 cbcount 4
2025-10-10T14:31:44.344874Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.344879Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.344884Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 231
2025-10-10T14:31:44.344913Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.344949Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 235 Result { Offset: 231 Data: "... 25495 bytes ..." SourceId: "\000src_id" SeqNo: 232 WriteTimestampMS: 1760106704342 CreateTimestampMS: 1760106704341 UncompressedSize: 25421 PartitionKey: "" ExplicitHash: "" } Result { Offset: 232 Data: "... 25605 bytes ..." SourceId: "\000src_id" SeqNo: 233 WriteTimestampMS: 1760106704342 CreateTimestampMS: 1760106704342 UncompressedSize: 25531 PartitionKey: "" ExplicitHash: "" } Result { Offset: 233 Data: "... 25715 bytes ..." SourceId: "\000src_id" SeqNo: 234 WriteTimestampMS: 1760106704342 CreateTimestampMS: 1760106704342 UncompressedSize: 25641 PartitionKey: "" ExplicitHash: "" } Result { Offset: 234 Data: "... 25825 bytes ..." SourceId: "\000src_id" SeqNo: 235 WriteTimestampMS: 1760106704342 CreateTimestampMS: 1760106704342 UncompressedSize: 25751 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 18446744073709551588 RealReadOffset: 234 WaitQuotaTimeMs: 0 EndOffset: 235 StartOffset: 0 } Cookie: 231 }
2025-10-10T14:31:44.344967Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.344983Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 53 from offset 235
2025-10-10T14:31:44.344988Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 235 ReadOffset 235 ReadGuid f3e3b026-f627b8c-d980b7d6-7c2306ef has messages 1
2025-10-10T14:31:44.344998Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 read done: guid# f3e3b026-f627b8c-d980b7d6-7c2306ef, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 102637
2025-10-10T14:31:44.344998Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.345001Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.345002Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 response to read: guid# f3e3b026-f627b8c-d980b7d6-7c2306ef
2025-10-10T14:31:44.345016Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 478  requestId: <none> cookie: 240
2025-10-10T14:31:44.345023Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.345040Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.345042Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.345048Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 240 partNo : 0 messageNo: 479 size 26375 offset: -1
2025-10-10T14:31:44.345052Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.345059Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.345095Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 Process answer. Aval parts: 0
2025-10-10T14:31:44.345479Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.345513Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.345531Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 235 count 3 size 78264 actorID [3:7559600726884252064:2448]
2025-10-10T14:31:44.345535Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 grpc read done: success# 1, data# { read_request { bytes_size: 75856 } }
2025-10-10T14:31:44.345538Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.345541Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.345542Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 235 partno 0 count 3 parts 0 suffix '63' size 78264
2025-10-10T14:31:44.345547Z node 3 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:31:44.345555Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 78156 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:31:44.345559Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.345564Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 236, partNo: 0, Offset: 235 is stored on disk
2025-10-10T14:31:44.345567Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.345568Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 got read request: guid# e26a4691-a9dbb23d-fe7d800b-1f2ac9c5
2025-10-10T14:31:44.345569Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 237, partNo: 0, Offset: 236 is stored on disk
2025-10-10T14:31:44.345571Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.345573Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 238, partNo: 0, Offset: 237 is stored on disk
2025-10-10T14:31:44.345573Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.345594Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:44.345598Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:44.345600Z node 3 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (2)
2025-10-10T14:31:44.345610Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 239 partNo 0
2025-10-10T14:31:44.345616Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.345633Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 239 partNo 0 FormedBlobsCount 0 NewHead: Offset 238 PartNo 0 PackedSize 26339 count 1 nextOffset 239 batches 1
2025-10-10T14:31:44.345636Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 235 EndOffset 235 newEndOffset 238 commitOffset 0 clientCommitOffset 0 cookie 53 readingFinished 0 firstRead 0
2025-10-10T14:31:44.345638Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 240 partNo 0
2025-10-10T14:31:44.345638Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 235 endOffset 238
2025-10-10T14:31:44.345641Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 240 partNo 0 FormedBlobsCount 0 NewHead: Offset 238 PartNo 0 PackedSize 52756 count 2 nextOffset 240 batches 1
2025-10-10T14:31:44.345643Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 235, endOffset# 238, WTime# 1760106704342, sizeLag# 78264
2025-10-10T14:31:44.345644Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:44.345644Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1TEvPartitionReady. Aval parts: 1
2025-10-10T14:31:44.345649Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 performing read request: guid# 3bf47d01-427278a-aed8f9b6-960bda3b, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 3, size# 93916, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-10T14:31:44.345655Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 3 maxSize 93916 maxTimeLagMs 0 readTimestampMs 0 readOffset 235 EndOffset 238 ClientCommitOffset 0 committedOffset 0 Guid 3bf47d01-427278a-aed8f9b6-960bda3b
2025-10-10T14:31:44.345714Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 238,2 HeadOffset 238 endOffset 238 curOffset 240 d0000000000_00000000000000000238_00000_0000000002_00000? size 52747 WTime 1760106704345
2025-10-10T14:31:44.345779Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:182: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:31:44.345788Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 471  requestId: <none> cookie: 236
2025-10-10T14:31:44.345802Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 474  requestId: <none> cookie: 237
2025-10-10T14:31:44.345806Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 475  requestId: <none> cookie: 238
2025-10-10T14:31:44.345808Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.345809Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.345812Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.345816Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.345818Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.345823Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.345824Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.345830Z node 3 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:31:44.345839Z node 3 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 238 partNo 0 count 2 size 52747
2025-10-10T14:31:44.345844Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 480  requestId: <none> cookie: 241
2025-10-10T14:31:44.345866Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 481  requestId: <none> cookie: 242
2025-10-10T14:31:44.345874Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.345877Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.345887Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 56 Topic 'rt3.dc1--test-topic' partition 0 user user offset 235 count 3 size 93916 endOffset 238 max time lag 0ms effective offset 235
2025-10-10T14:31:44.345904Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 56 added 1 blobs, size 78264 count 3 last offset 235, current partition end offset: 238
2025-10-10T14:31:44.345906Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 56. Send blob request.
2025-10-10T14:31:44.345913Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 235 partno 0 count 3 parts_count 0 source 1 size 78264 accessed 0 times before, last time 2025-10-10T14:31:44.000000Z
2025-10-10T14:31:44.345916Z node 3 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 56. All 1 blobs are from cache.
2025-10-10T14:31:44.345920Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 235 partno 0 count 3 parts 0 suffix '63'
2025-10-10T14:31:44.345921Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.345924Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.345930Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 241 partNo : 0 messageNo: 482 size 26485 offset: -1
2025-10-10T14:31:44.345935Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.345937Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.345940Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 242 partNo : 0 messageNo: 483 size 26595 offset: -1
2025-10-10T14:31:44.345945Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:31:44.345979Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 235 totakecount 3 count 3 size 78241 from pos 0 cbcount 3
2025-10-10T14:31:44.345990Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.345995Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.345996Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.345999Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.346004Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 235
2025-10-10T14:31:44.346062Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 238 Result { Offset: 235 Data: "... 25935 bytes ..." SourceId: "\000src_id" SeqNo: 236 WriteTimestampMS: 1760106704344 CreateTimestampMS: 1760106704342 UncompressedSize: 25861 PartitionKey: "" ExplicitHash: "" } Result { Offset: 236 Data: "... 26045 bytes ..." SourceId: "\000src_id" SeqNo: 237 WriteTimestampMS: 1760106704344 CreateTimestampMS: 1760106704343 UncompressedSize: 25971 PartitionKey: "" ExplicitHash: "" } Result { Offset: 237 Data: "... 26155 bytes ..." SourceId: "\000src_id" SeqNo: 238 WriteTimestampMS: 1760106704344 CreateTimestampMS: 1760106704343 UncompressedSize: 26081 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 3 RealReadOffset: 237 WaitQuotaTimeMs: 0 EndOffset: 238 StartOffset: 0 } Cookie: 235 }
2025-10-10T14:31:44.346078Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.346087Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 54 from offset 238
2025-10-10T14:31:44.346091Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 238 ReadOffset 238 ReadGuid 3bf47d01-427278a-aed8f9b6-960bda3b has messages 1
2025-10-10T14:31:44.346109Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 read done: guid# 3bf47d01-427278a-aed8f9b6-960bda3b, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 78166
2025-10-10T14:31:44.346113Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 response to read: guid# 3bf47d01-427278a-aed8f9b6-960bda3b
2025-10-10T14:31:44.346185Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.346202Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.346207Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.346225Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 Process answer. Aval parts: 0
2025-10-10T14:31:44.346234Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 484  requestId: <none> cookie: 243
2025-10-10T14:31:44.346244Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.346305Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.346307Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.346315Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 243 partNo : 0 messageNo: 485 size 26705 offset: -1
2025-10-10T14:31:44.346319Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.346326Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.346575Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.346589Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 grpc read done: success# 1, data# { read_request { bytes_size: 102637 } }
2025-10-10T14:31:44.346608Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.346613Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 got read request: guid# 5cb2574a-898f81a-7458c59f-d7324311
2025-10-10T14:31:44.346659Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.346664Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.346682Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 238 count 2 size 52747 actorID [3:7559600726884252064:2448]
2025-10-10T14:31:44.346701Z node 3 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:31:44.346703Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 238 partno 0 count 2 parts 0 suffix '63' size 52747
2025-10-10T14:31:44.346712Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 52654 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:31:44.346718Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.346724Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 239, partNo: 0, Offset: 238 is stored on disk
2025-10-10T14:31:44.346729Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.346734Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 240, partNo: 0, Offset: 239 is stored on disk
2025-10-10T14:31:44.346768Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:44.346776Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:44.346778Z node 3 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2025-10-10T14:31:44.346784Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 238 EndOffset 238 newEndOffset 240 commitOffset 0 clientCommitOffset 0 cookie 54 readingFinished 0 firstRead 0
2025-10-10T14:31:44.346787Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 238 endOffset 240
2025-10-10T14:31:44.346792Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 241 partNo 0
2025-10-10T14:31:44.346794Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 238, endOffset# 240, WTime# 1760106704344, sizeLag# 52747
2025-10-10T14:31:44.346796Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1TEvPartitionReady. Aval parts: 1
2025-10-10T14:31:44.346803Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 performing read request: guid# 31792e3f-8f312dfc-17612413-1471e368, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 2, size# 63296, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-10T14:31:44.346811Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 2 maxSize 63296 maxTimeLagMs 0 readTimestampMs 0 readOffset 238 EndOffset 240 ClientCommitOffset 0 committedOffset 0 Guid 31792e3f-8f312dfc-17612413-1471e368
2025-10-10T14:31:44.346817Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 241 partNo 0 FormedBlobsCount 0 NewHead: Offset 240 PartNo 0 PackedSize 26559 count 1 nextOffset 241 batches 1
2025-10-10T14:31:44.346824Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 242 partNo 0
2025-10-10T14:31:44.346831Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 242 partNo 0 FormedBlobsCount 0 NewHead: Offset 240 PartNo 0 PackedSize 53196 count 2 nextOffset 242 batches 1
2025-10-10T14:31:44.346836Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 243 partNo 0
2025-10-10T14:31:44.346840Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 243 partNo 0 FormedBlobsCount 0 NewHead: Offset 240 PartNo 0 PackedSize 79943 count 3 nextOffset 243 batches 1
2025-10-10T14:31:44.346842Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:44.346937Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 240,3 HeadOffset 240 endOffset 240 curOffset 243 d0000000000_00000000000000000240_00000_0000000003_00000? size 79914 WTime 1760106704346
2025-10-10T14:31:44.347058Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:182: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:31:44.347072Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 486  requestId: <none> cookie: 244
2025-10-10T14:31:44.347095Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 477  requestId: <none> cookie: 239
2025-10-10T14:31:44.347101Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 479  requestId: <none> cookie: 240
2025-10-10T14:31:44.347103Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.347110Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.347111Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.347114Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.347115Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.347126Z node 3 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:31:44.347139Z node 3 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 240 partNo 0 count 3 size 79914
2025-10-10T14:31:44.347153Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.347154Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.347162Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 244 partNo : 0 messageNo: 487 size 26815 offset: -1
2025-10-10T14:31:44.347209Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.347218Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.347244Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 57 Topic 'rt3.dc1--test-topic' partition 0 user user offset 238 count 2 size 63296 endOffset 240 max time lag 0ms effective offset 238
2025-10-10T14:31:44.347260Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 57 added 1 blobs, size 52747 count 2 last offset 238, current partition end offset: 240
2025-10-10T14:31:44.347262Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.347263Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 57. Send blob request.
2025-10-10T14:31:44.347275Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 238 partno 0 count 2 parts_count 0 source 1 size 52747 accessed 0 times before, last time 2025-10-10T14:31:44.000000Z
2025-10-10T14:31:44.347279Z node 3 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 57. All 1 blobs are from cache.
2025-10-10T14:31:44.347289Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.347290Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:31:44.347290Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 238 partno 0 count 2 parts 0 suffix '63'
2025-10-10T14:31:44.347331Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 238 totakecount 2 count 2 size 52724 from pos 0 cbcount 2
2025-10-10T14:31:44.347347Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.347350Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.347366Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 238
2025-10-10T14:31:44.347409Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 488  requestId: <none> cookie: 245
2025-10-10T14:31:44.347419Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.347446Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 240 Result { Offset: 238 Data: "... 26265 bytes ..." SourceId: "\000src_id" SeqNo: 239 WriteTimestampMS: 1760106704345 CreateTimestampMS: 1760106704343 UncompressedSize: 26191 PartitionKey: "" ExplicitHash: "" } Result { Offset: 239 Data: "... 26375 bytes ..." SourceId: "\000src_id" SeqNo: 240 WriteTimestampMS: 1760106704345 CreateTimestampMS: 1760106704344 UncompressedSize: 26301 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 23 RealReadOffset: 239 WaitQuotaTimeMs: 0 EndOffset: 240 StartOffset: 0 } Cookie: 238 }
2025-10-10T14:31:44.347449Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.347452Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.347464Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 245 partNo : 0 messageNo: 489 size 26925 offset: -1
2025-10-10T14:31:44.347469Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 55 from offset 240
2025-10-10T14:31:44.347471Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.347473Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 240 ReadOffset 240 ReadGuid 31792e3f-8f312dfc-17612413-1471e368 has messages 1
2025-10-10T14:31:44.347479Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.347491Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 read done: guid# 31792e3f-8f312dfc-17612413-1471e368, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 52705
2025-10-10T14:31:44.347498Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 response to read: guid# 31792e3f-8f312dfc-17612413-1471e368
2025-10-10T14:31:44.347612Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 Process answer. Aval parts: 0
2025-10-10T14:31:44.347811Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.347874Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.347905Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.347907Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.347915Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 240 count 3 size 79914 actorID [3:7559600726884252064:2448]
2025-10-10T14:31:44.347929Z node 3 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:31:44.347934Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 79806 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:31:44.347937Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.347937Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 240 partno 0 count 3 parts 0 suffix '63' size 79914
2025-10-10T14:31:44.347940Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 241, partNo: 0, Offset: 240 is stored on disk
2025-10-10T14:31:44.347942Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.347944Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 242, partNo: 0, Offset: 241 is stored on disk
2025-10-10T14:31:44.347945Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.347948Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 243, partNo: 0, Offset: 242 is stored on disk
2025-10-10T14:31:44.347964Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:44.347967Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:44.347968Z node 3 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (2)
2025-10-10T14:31:44.347976Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 244 partNo 0
2025-10-10T14:31:44.347985Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 240 EndOffset 240 newEndOffset 243 commitOffset 0 clientCommitOffset 0 cookie 55 readingFinished 0 firstRead 0
2025-10-10T14:31:44.347988Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 240 endOffset 243
2025-10-10T14:31:44.347990Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 244 partNo 0 FormedBlobsCount 0 NewHead: Offset 243 PartNo 0 PackedSize 26889 count 1 nextOffset 244 batches 1
2025-10-10T14:31:44.347993Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 245 partNo 0
2025-10-10T14:31:44.347995Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 240, endOffset# 243, WTime# 1760106704345, sizeLag# 79914
2025-10-10T14:31:44.347995Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 245 partNo 0 FormedBlobsCount 0 NewHead: Offset 243 PartNo 0 PackedSize 53856 count 2 nextOffset 245 batches 1
2025-10-10T14:31:44.347996Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1TEvPartitionReady. Aval parts: 1
2025-10-10T14:31:44.347996Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:44.348002Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 performing read request: guid# 4b96cdfb-1cd30f79-fadd7d33-7ff7e334, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 3, size# 95896, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-10T14:31:44.348014Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 3 maxSize 95896 maxTimeLagMs 0 readTimestampMs 0 readOffset 240 EndOffset 243 ClientCommitOffset 0 committedOffset 0 Guid 4b96cdfb-1cd30f79-fadd7d33-7ff7e334
2025-10-10T14:31:44.348026Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 243,2 HeadOffset 243 endOffset 243 curOffset 245 d0000000000_00000000000000000243_00000_0000000002_00000? size 53847 WTime 1760106704348
2025-10-10T14:31:44.348037Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:182: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:31:44.348041Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 490  requestId: <none> cookie: 246
2025-10-10T14:31:44.348045Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 482  requestId: <none> cookie: 241
2025-10-10T14:31:44.348048Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.348053Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.348054Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 483  requestId: <none> cookie: 242
2025-10-10T14:31:44.348056Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 485  requestId: <none> cookie: 243
2025-10-10T14:31:44.348062Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.348063Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.348065Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.348068Z node 3 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:31:44.348071Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.348073Z node 3 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 243 partNo 0 count 2 size 53847
2025-10-10T14:31:44.348085Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.348086Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.348090Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 246 partNo : 0 messageNo: 491 size 27035 offset: -1
2025-10-10T14:31:44.348107Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.348110Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.348122Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 58 Topic 'rt3.dc1--test-topic' partition 0 user user offset 240 count 3 size 95896 endOffset 243 max time lag 0ms effective offset 240
2025-10-10T14:31:44.348129Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 58 added 1 blobs, size 79914 count 3 last offset 240, current partition end offset: 243
2025-10-10T14:31:44.348130Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 58. Send blob request.
2025-10-10T14:31:44.348134Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 240 partno 0 count 3 parts_count 0 source 1 size 79914 accessed 0 times before, last time 2025-10-10T14:31:44.000000Z
2025-10-10T14:31:44.348140Z node 3 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 58. All 1 blobs are from cache.
2025-10-10T14:31:44.348144Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:31:44.348157Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 240 partno 0 count 3 parts 0 suffix '63'
2025-10-10T14:31:44.348170Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 240 totakecount 3 count 3 size 79891 from pos 0 cbcount 3
2025-10-10T14:31:44.348182Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 240
2025-10-10T14:31:44.348240Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 243 Result { Offset: 240 Data: "... 26485 bytes ..." SourceId: "\000src_id" SeqNo: 241 WriteTimestampMS: 1760106704346 CreateTimestampMS: 1760106704344 UncompressedSize: 26411 PartitionKey: "" ExplicitHash: "" } Result { Offset: 241 Data: "... 26595 bytes ..." SourceId: "\000src_id" SeqNo: 242 WriteTimestampMS: 1760106704346 CreateTimestampMS: 1760106704345 UncompressedSize: 26521 PartitionKey: "" ExplicitHash: "" } Result { Offset: 242 Data: "... 26705 bytes ..." SourceId: "\000src_id" SeqNo: 243 WriteTimestampMS: 1760106704346 CreateTimestampMS: 1760106704345 UncompressedSize: 26631 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 3 RealReadOffset: 242 WaitQuotaTimeMs: 0 EndOffset: 243 StartOffset: 0 } Cookie: 240 }
2025-10-10T14:31:44.348325Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 56 from offset 243
2025-10-10T14:31:44.348330Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 243 ReadOffset 243 ReadGuid 4b96cdfb-1cd30f79-fadd7d33-7ff7e334 has messages 1
2025-10-10T14:31:44.348349Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 read done: guid# 4b96cdfb-1cd30f79-fadd7d33-7ff7e334, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 79816
2025-10-10T14:31:44.348354Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 response to read: guid# 4b96cdfb-1cd30f79-fadd7d33-7ff7e334
2025-10-10T14:31:44.348398Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.348431Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.348442Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 Process answer. Aval parts: 0
2025-10-10T14:31:44.348449Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.348451Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.348458Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 492  requestId: <none> cookie: 247
2025-10-10T14:31:44.348462Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 grpc read done: success# 1, data# { read_request { bytes_size: 78166 } }
2025-10-10T14:31:44.348463Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.348471Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.348473Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.348473Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 got read request: guid# c89c7de6-40126f4-94d34b4f-ffe74d3
2025-10-10T14:31:44.348480Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 247 partNo : 0 messageNo: 493 size 27145 offset: -1
2025-10-10T14:31:44.348483Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.348488Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.348492Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.348510Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.348519Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.348521Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.348525Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 494  requestId: <none> cookie: 248
2025-10-10T14:31:44.348536Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.348542Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.348544Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.348548Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 248 partNo : 0 messageNo: 495 size 27255 offset: -1
2025-10-10T14:31:44.348551Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.348554Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.348780Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.348794Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 grpc read done: success# 1, data# { read_request { bytes_size: 52705 } }
2025-10-10T14:31:44.348806Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 got read request: guid# 7c93785-2321d361-472e28d4-a6dd5619
2025-10-10T14:31:44.348822Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.348835Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.348837Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.348845Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 496  requestId: <none> cookie: 249
2025-10-10T14:31:44.348854Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.348862Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.348863Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.348869Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 249 partNo : 0 messageNo: 497 size 27365 offset: -1
2025-10-10T14:31:44.348872Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.348877Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.348902Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 243 count 2 size 53847 actorID [3:7559600726884252064:2448]
2025-10-10T14:31:44.348911Z node 3 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:31:44.348917Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 53754 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:31:44.348921Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.348923Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 243 partno 0 count 2 parts 0 suffix '63' size 53847
2025-10-10T14:31:44.348924Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 244, partNo: 0, Offset: 243 is stored on disk
2025-10-10T14:31:44.348927Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.348929Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 245, partNo: 0, Offset: 244 is stored on disk
2025-10-10T14:31:44.348947Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:44.348952Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:44.348953Z node 3 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (4)
2025-10-10T14:31:44.348958Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 243 EndOffset 243 newEndOffset 245 commitOffset 0 clientCommitOffset 0 cookie 56 readingFinished 0 firstRead 0
2025-10-10T14:31:44.348960Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 243 endOffset 245
2025-10-10T14:31:44.348961Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 246 partNo 0
2025-10-10T14:31:44.348965Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.348973Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 246 partNo 0 FormedBlobsCount 0 NewHead: Offset 245 PartNo 0 PackedSize 27109 count 1 nextOffset 246 batches 1
2025-10-10T14:31:44.348976Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 247 partNo 0
2025-10-10T14:31:44.348980Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 247 partNo 0 FormedBlobsCount 0 NewHead: Offset 245 PartNo 0 PackedSize 54296 count 2 nextOffset 247 batches 1
2025-10-10T14:31:44.348981Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 248 partNo 0
2025-10-10T14:31:44.348984Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 248 partNo 0 FormedBlobsCount 0 NewHead: Offset 245 PartNo 0 PackedSize 81593 count 3 nextOffset 248 batches 1
2025-10-10T14:31:44.348986Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 249 partNo 0
2025-10-10T14:31:44.348988Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 249 partNo 0 FormedBlobsCount 0 NewHead: Offset 245 PartNo 0 PackedSize 109000 count 4 nextOffset 249 batches 1
2025-10-10T14:31:44.348989Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:44.349020Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.349032Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 245,4 HeadOffset 245 endOffset 245 curOffset 249 d0000000000_00000000000000000245_00000_0000000004_00000? size 108940 WTime 1760106704349
2025-10-10T14:31:44.349045Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 243, endOffset# 245, WTime# 1760106704346, sizeLag# 53847
2025-10-10T14:31:44.349047Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1TEvPartitionReady. Aval parts: 1
2025-10-10T14:31:44.349053Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 performing read request: guid# 95a74f61-15ed5033-94c8f198-355c03aa, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 2, size# 64616, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-10T14:31:44.349058Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:182: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:31:44.349064Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 487  requestId: <none> cookie: 244
2025-10-10T14:31:44.349067Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 2 maxSize 64616 maxTimeLagMs 0 readTimestampMs 0 readOffset 243 EndOffset 245 ClientCommitOffset 0 committedOffset 0 Guid 95a74f61-15ed5033-94c8f198-355c03aa
2025-10-10T14:31:44.349069Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 489  requestId: <none> cookie: 245
2025-10-10T14:31:44.349073Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.349075Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.349078Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.349083Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.349086Z node 3 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:31:44.349095Z node 3 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 245 partNo 0 count 4 size 108940
2025-10-10T14:31:44.349104Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.349112Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.349133Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 498  requestId: <none> cookie: 250
2025-10-10T14:31:44.349142Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.349150Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 59 Topic 'rt3.dc1--test-topic' partition 0 user user offset 243 count 2 size 64616 endOffset 245 max time lag 0ms effective offset 243
2025-10-10T14:31:44.349157Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 59 added 1 blobs, size 53847 count 2 last offset 243, current partition end offset: 245
2025-10-10T14:31:44.349159Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 59. Send blob request.
2025-10-10T14:31:44.349164Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 243 partno 0 count 2 parts_count 0 source 1 size 53847 accessed 0 times before, last time 2025-10-10T14:31:44.000000Z
2025-10-10T14:31:44.349166Z node 3 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 59. All 1 blobs are from cache.
2025-10-10T14:31:44.349170Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.349171Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.349179Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 243 partno 0 count 2 parts 0 suffix '63'
2025-10-10T14:31:44.349182Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 250 partNo : 0 messageNo: 499 size 27475 offset: -1
2025-10-10T14:31:44.349185Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:31:44.349200Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 243 totakecount 2 count 2 size 53824 from pos 0 cbcount 2
2025-10-10T14:31:44.349209Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.349214Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.349218Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 243
2025-10-10T14:31:44.349267Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 245 Result { Offset: 243 Data: "... 26815 bytes ..." SourceId: "\000src_id" SeqNo: 244 WriteTimestampMS: 1760106704347 CreateTimestampMS: 1760106704345 UncompressedSize: 26741 PartitionKey: "" ExplicitHash: "" } Result { Offset: 244 Data: "... 26925 bytes ..." SourceId: "\000src_id" SeqNo: 245 WriteTimestampMS: 1760106704347 CreateTimestampMS: 1760106704346 UncompressedSize: 26851 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 23 RealReadOffset: 244 WaitQuotaTimeMs: 0 EndOffset: 245 StartOffset: 0 } Cookie: 243 }
2025-10-10T14:31:44.349290Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 57 from offset 245
2025-10-10T14:31:44.349294Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 245 ReadOffset 245 ReadGuid 95a74f61-15ed5033-94c8f198-355c03aa has messages 1
2025-10-10T14:31:44.349312Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 read done: guid# 95a74f61-15ed5033-94c8f198-355c03aa, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 53805
2025-10-10T14:31:44.349316Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 response to read: guid# 95a74f61-15ed5033-94c8f198-355c03aa
2025-10-10T14:31:44.349427Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 Process answer. Aval parts: 0
2025-10-10T14:31:44.349536Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.349601Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.349656Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.349659Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.349671Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 500  requestId: <none> cookie: 251
2025-10-10T14:31:44.349685Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.349710Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.349715Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.349723Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 251 partNo : 0 messageNo: 501 size 27585 offset: -1
2025-10-10T14:31:44.349727Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.349732Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.350026Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.350028Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 grpc read done: success# 1, data# { read_request { bytes_size: 79816 } }
2025-10-10T14:31:44.350040Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 got read request: guid# bcc6d19b-c2d4d669-f79203c0-c6d4b915
2025-10-10T14:31:44.350072Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 245 count 4 size 108940 actorID [3:7559600726884252064:2448]
2025-10-10T14:31:44.350082Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.350083Z node 3 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:31:44.350090Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 108828 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:31:44.350094Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.350095Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 245 partno 0 count 4 parts 0 suffix '63' size 108940
2025-10-10T14:31:44.350098Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 246, partNo: 0, Offset: 245 is stored on disk
2025-10-10T14:31:44.350101Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.350103Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 247, partNo: 0, Offset: 246 is stored on disk
2025-10-10T14:31:44.350105Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.350108Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 248, partNo: 0, Offset: 247 is stored on disk
2025-10-10T14:31:44.350111Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.350114Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 249, partNo: 0, Offset: 248 is stored on disk
2025-10-10T14:31:44.350138Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:44.350143Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:44.350144Z node 3 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (2)
2025-10-10T14:31:44.350154Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 245 EndOffset 245 newEndOffset 249 commitOffset 0 clientCommitOffset 0 cookie 57 readingFinished 0 firstRead 0
2025-10-10T14:31:44.350156Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 250 partNo 0
2025-10-10T14:31:44.350157Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 245 endOffset 249
2025-10-10T14:31:44.350163Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 245, endOffset# 249, WTime# 1760106704347, sizeLag# 108940
2025-10-10T14:31:44.350165Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1TEvPartitionReady. Aval parts: 1
2025-10-10T14:31:44.350169Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 250 partNo 0 FormedBlobsCount 0 NewHead: Offset 249 PartNo 0 PackedSize 27549 count 1 nextOffset 250 batches 1
2025-10-10T14:31:44.350171Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 performing read request: guid# 9d74fad8-714d01fd-b68bd008-74e58b03, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 4, size# 130728, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-10T14:31:44.350173Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 251 partNo 0
2025-10-10T14:31:44.350177Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 251 partNo 0 FormedBlobsCount 0 NewHead: Offset 249 PartNo 0 PackedSize 55176 count 2 nextOffset 251 batches 1
2025-10-10T14:31:44.350179Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:44.350182Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 4 maxSize 130728 maxTimeLagMs 0 readTimestampMs 0 readOffset 245 EndOffset 249 ClientCommitOffset 0 committedOffset 0 Guid 9d74fad8-714d01fd-b68bd008-74e58b03
2025-10-10T14:31:44.350226Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 249,2 HeadOffset 249 endOffset 249 curOffset 251 d0000000000_00000000000000000249_00000_0000000002_00000? size 55167 WTime 1760106704350
2025-10-10T14:31:44.350244Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:182: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:31:44.350251Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 491  requestId: <none> cookie: 246
2025-10-10T14:31:44.350261Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.350263Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.350270Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.350270Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 493  requestId: <none> cookie: 247
2025-10-10T14:31:44.350274Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 495  requestId: <none> cookie: 248
2025-10-10T14:31:44.350275Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.350278Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 497  requestId: <none> cookie: 249
2025-10-10T14:31:44.350280Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.350285Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.350286Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.350291Z node 3 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:31:44.350299Z node 3 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 249 partNo 0 count 2 size 55167
2025-10-10T14:31:44.350324Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 502  requestId: <none> cookie: 252
2025-10-10T14:31:44.350341Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.350343Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 60 Topic 'rt3.dc1--test-topic' partition 0 user user offset 245 count 4 size 130728 endOffset 249 max time lag 0ms effective offset 245
2025-10-10T14:31:44.350363Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 60 added 1 blobs, size 108940 count 4 last offset 245, current partition end offset: 249
2025-10-10T14:31:44.350365Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 60. Send blob request.
2025-10-10T14:31:44.350373Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 245 partno 0 count 4 parts_count 0 source 1 size 108940 accessed 0 times before, last time 2025-10-10T14:31:44.000000Z
2025-10-10T14:31:44.350376Z node 3 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 60. All 1 blobs are from cache.
2025-10-10T14:31:44.350381Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:31:44.350383Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 245 partno 0 count 4 parts 0 suffix '63'
2025-10-10T14:31:44.350399Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.350423Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 245 totakecount 4 count 4 size 108917 from pos 0 cbcount 4
2025-10-10T14:31:44.350439Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 245
2025-10-10T14:31:44.350458Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.350460Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.350467Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 252 partNo : 0 messageNo: 503 size 27695 offset: -1
2025-10-10T14:31:44.350472Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.350476Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.350512Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 249 Result { Offset: 245 Data: "... 27035 bytes ..." SourceId: "\000src_id" SeqNo: 246 WriteTimestampMS: 1760106704348 CreateTimestampMS: 1760106704347 UncompressedSize: 26961 PartitionKey: "" ExplicitHash: "" } Result { Offset: 246 Data: "... 27145 bytes ..." SourceId: "\000src_id" SeqNo: 247 WriteTimestampMS: 1760106704348 CreateTimestampMS: 1760106704347 UncompressedSize: 27071 PartitionKey: "" ExplicitHash: "" } Result { Offset: 247 Data: "... 27255 bytes ..." SourceId: "\000src_id" SeqNo: 248 WriteTimestampMS: 1760106704348 CreateTimestampMS: 1760106704348 UncompressedSize: 27181 PartitionKey: "" ExplicitHash: "" } Result { Offset: 248 Data: "... 27365 bytes ..." SourceId: "\000src_id" SeqNo: 249 WriteTimestampMS: 1760106704348 CreateTimestampMS: 1760106704348 UncompressedSize: 27291 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 18446744073709551588 RealReadOffset: 248 WaitQuotaTimeMs: 0 EndOffset: 249 StartOffset: 0 } Cookie: 245 }
2025-10-10T14:31:44.350568Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 58 from offset 249
2025-10-10T14:31:44.350573Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 249 ReadOffset 249 ReadGuid 9d74fad8-714d01fd-b68bd008-74e58b03 has messages 1
2025-10-10T14:31:44.350593Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 read done: guid# 9d74fad8-714d01fd-b68bd008-74e58b03, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 108797
2025-10-10T14:31:44.350593Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.350596Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 response to read: guid# 9d74fad8-714d01fd-b68bd008-74e58b03
2025-10-10T14:31:44.350626Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 Process answer. Aval parts: 0
2025-10-10T14:31:44.350627Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.350646Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.350648Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.350652Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.350654Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 504  requestId: <none> cookie: 253
2025-10-10T14:31:44.350674Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.350682Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.350687Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.350688Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.350692Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 253 partNo : 0 messageNo: 505 size 27805 offset: -1
2025-10-10T14:31:44.350694Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.350695Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.350698Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.350700Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.350760Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.350771Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 506  requestId: <none> cookie: 254
2025-10-10T14:31:44.350793Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.350800Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.350808Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.350811Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.350820Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 254 partNo : 0 messageNo: 507 size 27915 offset: -1
2025-10-10T14:31:44.350824Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.350826Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.350830Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.350838Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.350845Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 508  requestId: <none> cookie: 255
2025-10-10T14:31:44.350855Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.350862Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.350864Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.350867Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 255 partNo : 0 messageNo: 509 size 28025 offset: -1
2025-10-10T14:31:44.350870Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.350872Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.350956Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.351015Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.351024Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.351026Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.351034Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 510  requestId: <none> cookie: 256
2025-10-10T14:31:44.351045Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.351049Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.351057Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.351059Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.351063Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 256 partNo : 0 messageNo: 511 size 28135 offset: -1
2025-10-10T14:31:44.351067Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.351070Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.351082Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 grpc read done: success# 1, data# { read_request { bytes_size: 53805 } }
2025-10-10T14:31:44.351089Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.351115Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.351117Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.351121Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 got read request: guid# 85031f99-6e605554-fdc6c0df-e3b9bc1c
2025-10-10T14:31:44.351123Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 249 count 2 size 55167 actorID [3:7559600726884252064:2448]
2025-10-10T14:31:44.351126Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.351128Z node 3 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:31:44.351133Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 55074 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:31:44.351134Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 249 partno 0 count 2 parts 0 suffix '63' size 55167
2025-10-10T14:31:44.351136Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.351139Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 250, partNo: 0, Offset: 249 is stored on disk
2025-10-10T14:31:44.351141Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.351143Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 251, partNo: 0, Offset: 250 is stored on disk
2025-10-10T14:31:44.351149Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.351155Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:44.351160Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:44.351160Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 249 EndOffset 249 newEndOffset 251 commitOffset 0 clientCommitOffset 0 cookie 58 readingFinished 0 firstRead 0
2025-10-10T14:31:44.351161Z node 3 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (5)
2025-10-10T14:31:44.351163Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 249 endOffset 251
2025-10-10T14:31:44.351168Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 252 partNo 0
2025-10-10T14:31:44.351168Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 249, endOffset# 251, WTime# 1760106704348, sizeLag# 55167
2025-10-10T14:31:44.351170Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1TEvPartitionReady. Aval parts: 1
2025-10-10T14:31:44.351177Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 performing read request: guid# 2aacfe7d-78f3aed3-9de1b2e4-2dacbd91, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 2, size# 66200, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-10T14:31:44.351180Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 252 partNo 0 FormedBlobsCount 0 NewHead: Offset 251 PartNo 0 PackedSize 27769 count 1 nextOffset 252 batches 1
2025-10-10T14:31:44.351183Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 253 partNo 0
2025-10-10T14:31:44.351186Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 2 maxSize 66200 maxTimeLagMs 0 readTimestampMs 0 readOffset 249 EndOffset 251 ClientCommitOffset 0 committedOffset 0 Guid 2aacfe7d-78f3aed3-9de1b2e4-2dacbd91
2025-10-10T14:31:44.351187Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 253 partNo 0 FormedBlobsCount 0 NewHead: Offset 251 PartNo 0 PackedSize 55616 count 2 nextOffset 253 batches 1
2025-10-10T14:31:44.351189Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 254 partNo 0
2025-10-10T14:31:44.351191Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 254 partNo 0 FormedBlobsCount 0 NewHead: Offset 251 PartNo 0 PackedSize 83573 count 3 nextOffset 254 batches 1
2025-10-10T14:31:44.351193Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 255 partNo 0
2025-10-10T14:31:44.351195Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 255 partNo 0 FormedBlobsCount 0 NewHead: Offset 251 PartNo 0 PackedSize 111640 count 4 nextOffset 255 batches 1
2025-10-10T14:31:44.351197Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 256 partNo 0
2025-10-10T14:31:44.351200Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 256 partNo 0 FormedBlobsCount 0 NewHead: Offset 251 PartNo 0 PackedSize 139817 count 5 nextOffset 256 batches 1
2025-10-10T14:31:44.351201Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:44.351203Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.351234Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.351241Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.351270Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.351275Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.351281Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 251,5 HeadOffset 251 endOffset 251 curOffset 256 d0000000000_00000000000000000251_00000_0000000005_00000? size 139726 WTime 1760106704351
2025-10-10T14:31:44.351305Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:182: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:31:44.351311Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 512  requestId: <none> cookie: 257
2025-10-10T14:31:44.351322Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 499  requestId: <none> cookie: 250
2025-10-10T14:31:44.351326Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 501  requestId: <none> cookie: 251
2025-10-10T14:31:44.351328Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.351330Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.351332Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.351337Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.351337Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.351338Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.351339Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.351342Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.351343Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.351343Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.351345Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.351346Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.351348Z node 3 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:31:44.351353Z node 3 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 251 partNo 0 count 5 size 139726
2025-10-10T14:31:44.351373Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 513  requestId: <none> cookie: 258
2025-10-10T14:31:44.351376Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.351380Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.351385Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 257 partNo : 0 messageNo: 516 size 28245 offset: -1
2025-10-10T14:31:44.351390Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 514  requestId: <none> cookie: 259
2025-10-10T14:31:44.351392Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 515  requestId: <none> cookie: 260
2025-10-10T14:31:44.351405Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.351405Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.351409Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.351411Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.351412Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 61 Topic 'rt3.dc1--test-topic' partition 0 user user offset 249 count 2 size 66200 endOffset 251 max time lag 0ms effective offset 249
2025-10-10T14:31:44.351415Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.351419Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.351420Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 61 added 1 blobs, size 55167 count 2 last offset 249, current partition end offset: 251
2025-10-10T14:31:44.351421Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 61. Send blob request.
2025-10-10T14:31:44.351431Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 249 partno 0 count 2 parts_count 0 source 1 size 55167 accessed 0 times before, last time 2025-10-10T14:31:44.000000Z
2025-10-10T14:31:44.351434Z node 3 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 61. All 1 blobs are from cache.
2025-10-10T14:31:44.351440Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:31:44.351444Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 249 partno 0 count 2 parts 0 suffix '63'
2025-10-10T14:31:44.351460Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 249 totakecount 2 count 2 size 55144 from pos 0 cbcount 2
2025-10-10T14:31:44.351474Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 249
2025-10-10T14:31:44.351475Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.351481Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.351482Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.351485Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.351489Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.351494Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 258 partNo : 0 messageNo: 518 size 28355 offset: -1
2025-10-10T14:31:44.351497Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.351499Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.351502Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 259 partNo : 0 messageNo: 519 size 28465 offset: -1
2025-10-10T14:31:44.351504Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.351505Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.351506Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 260 partNo : 0 messageNo: 520 size 28575 offset: -1
2025-10-10T14:31:44.351518Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.351518Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.351521Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.351524Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.351525Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.351526Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.351527Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.351528Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.351530Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 517  requestId: <none> cookie: 261
2025-10-10T14:31:44.351531Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 521  requestId: <none> cookie: 262
2025-10-10T14:31:44.351539Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.351543Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.351552Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 251 Result { Offset: 249 Data: "... 27475 bytes ..." SourceId: "\000src_id" SeqNo: 250 WriteTimestampMS: 1760106704350 CreateTimestampMS: 1760106704348 UncompressedSize: 27401 PartitionKey: "" ExplicitHash: "" } Result { Offset: 250 Data: "... 27585 bytes ..." SourceId: "\000src_id" SeqNo: 251 WriteTimestampMS: 1760106704350 CreateTimestampMS: 1760106704348 UncompressedSize: 27511 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 23 RealReadOffset: 250 WaitQuotaTimeMs: 0 EndOffset: 251 StartOffset: 0 } Cookie: 249 }
2025-10-10T14:31:44.351555Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.351556Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.351559Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 261 partNo : 0 messageNo: 522 size 28685 offset: -1
2025-10-10T14:31:44.351561Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.351562Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.351564Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 262 partNo : 0 messageNo: 523 size 28795 offset: -1
2025-10-10T14:31:44.351566Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.351567Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.351568Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.351569Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.351576Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 59 from offset 251
2025-10-10T14:31:44.351580Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 251 ReadOffset 251 ReadGuid 2aacfe7d-78f3aed3-9de1b2e4-2dacbd91 has messages 1
2025-10-10T14:31:44.351590Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 read done: guid# 2aacfe7d-78f3aed3-9de1b2e4-2dacbd91, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 55125
2025-10-10T14:31:44.351594Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 response to read: guid# 2aacfe7d-78f3aed3-9de1b2e4-2dacbd91
2025-10-10T14:31:44.351663Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 Process answer. Aval parts: 0
2025-10-10T14:31:44.352169Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 251 count 5 size 139726 actorID [3:7559600726884252064:2448]
2025-10-10T14:31:44.352177Z node 3 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:31:44.352182Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 139610 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:31:44.352185Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.352188Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 252, partNo: 0, Offset: 251 is stored on disk
2025-10-10T14:31:44.352189Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 251 partno 0 count 5 parts 0 suffix '63' size 139726
2025-10-10T14:31:44.352191Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.352193Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 253, partNo: 0, Offset: 252 is stored on disk
2025-10-10T14:31:44.352195Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.352196Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 254, partNo: 0, Offset: 253 is stored on disk
2025-10-10T14:31:44.352198Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.352199Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 255, partNo: 0, Offset: 254 is stored on disk
2025-10-10T14:31:44.352200Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.352202Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 256, partNo: 0, Offset: 255 is stored on disk
2025-10-10T14:31:44.352217Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:44.352222Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:44.386556Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session got write response: sequence_numbers: 4 offsets: 3 already_written: false write_statistics { persist_duration_ms: 1 queued_in_partition_duration_ms: 1 }
2025-10-10T14:31:44.352223Z node 3 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (6)
2025-10-10T14:31:44.352230Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 257 partNo 0
2025-10-10T14:31:44.386575Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: acknoledged message 4
2025-10-10T14:31:44.352233Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 251 EndOffset 251 newEndOffset 256 commitOffset 0 clientCommitOffset 0 cookie 59 readingFinished 0 firstRead 0
2025-10-10T14:31:44.352236Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 251 endOffset 256
2025-10-10T14:31:44.352243Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 257 partNo 0 FormedBlobsCount 0 NewHead: Offset 256 PartNo 0 PackedSize 28319 count 1 nextOffset 257 batches 1
2025-10-10T14:31:44.352246Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 258 partNo 0
2025-10-10T14:31:44.352246Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 grpc read done: success# 1, data# { read_request { bytes_size: 108797 } }
2025-10-10T14:31:44.352248Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 258 partNo 0 FormedBlobsCount 0 NewHead: Offset 256 PartNo 0 PackedSize 56716 count 2 nextOffset 258 batches 1
2025-10-10T14:31:44.352250Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 259 partNo 0
2025-10-10T14:31:44.352252Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 259 partNo 0 FormedBlobsCount 0 NewHead: Offset 256 PartNo 0 PackedSize 85223 count 3 nextOffset 259 batches 1
2025-10-10T14:31:44.352252Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 251, endOffset# 256, WTime# 1760106704350, sizeLag# 139726
2025-10-10T14:31:44.352254Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 260 partNo 0
2025-10-10T14:31:44.352254Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1TEvPartitionReady. Aval parts: 1
2025-10-10T14:31:44.352256Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 260 partNo 0 FormedBlobsCount 0 NewHead: Offset 256 PartNo 0 PackedSize 113840 count 4 nextOffset 260 batches 1
2025-10-10T14:31:44.352257Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 261 partNo 0
2025-10-10T14:31:44.352260Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 performing read request: guid# cba4d9b1-8d0170a2-5f98e377-7c0c8dc5, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 6, size# 167671, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-10T14:31:44.352262Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 261 partNo 0 FormedBlobsCount 0 NewHead: Offset 256 PartNo 0 PackedSize 142567 count 5 nextOffset 261 batches 1
2025-10-10T14:31:44.352263Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 262 partNo 0
2025-10-10T14:31:44.352266Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 262 partNo 0 FormedBlobsCount 0 NewHead: Offset 256 PartNo 0 PackedSize 171404 count 6 nextOffset 262 batches 1
2025-10-10T14:31:44.352267Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:44.352273Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 got read request: guid# 3aed0b3-79d230b7-8f851000-54a40c1d
2025-10-10T14:31:44.352278Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.352302Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.352316Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 6 maxSize 167671 maxTimeLagMs 0 readTimestampMs 0 readOffset 251 EndOffset 256 ClientCommitOffset 0 committedOffset 0 Guid cba4d9b1-8d0170a2-5f98e377-7c0c8dc5
2025-10-10T14:31:44.352351Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 256,6 HeadOffset 256 endOffset 256 curOffset 262 d0000000000_00000000000000000256_00000_0000000006_00000? size 171282 WTime 1760106704352
2025-10-10T14:31:44.352480Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:182: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:31:44.352489Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 503  requestId: <none> cookie: 252
2025-10-10T14:31:44.386639Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf451f1-c205e716-2df7cd75-d9af365e_0] Write session: destroy
2025-10-10T14:31:44.352500Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 505  requestId: <none> cookie: 253
2025-10-10T14:31:44.352502Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 507  requestId: <none> cookie: 254
2025-10-10T14:31:44.352505Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 509  requestId: <none> cookie: 255
2025-10-10T14:31:44.352507Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 511  requestId: <none> cookie: 256
2025-10-10T14:31:44.352510Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.352510Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.352512Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.352515Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.352520Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.352523Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.352523Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.352524Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.352527Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.352528Z node 3 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:31:44.352534Z node 3 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 256 partNo 0 count 6 size 171282
2025-10-10T14:31:44.352553Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 524  requestId: <none> cookie: 263
2025-10-10T14:31:44.352569Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 62 Topic 'rt3.dc1--test-topic' partition 0 user user offset 251 count 6 size 167671 endOffset 256 max time lag 0ms effective offset 251
2025-10-10T14:31:44.352578Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 62 added 1 blobs, size 139726 count 5 last offset 251, current partition end offset: 256
2025-10-10T14:31:44.352580Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 62. Send blob request.
2025-10-10T14:31:44.352586Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 251 partno 0 count 5 parts_count 0 source 1 size 139726 accessed 0 times before, last time 2025-10-10T14:31:44.000000Z
2025-10-10T14:31:44.352593Z node 3 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 62. All 1 blobs are from cache.
2025-10-10T14:31:44.352598Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 251 partno 0 count 5 parts 0 suffix '63'
2025-10-10T14:31:44.352599Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:31:44.352603Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.352756Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 251 totakecount 5 count 5 size 139703 from pos 0 cbcount 5
2025-10-10T14:31:44.352773Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.352775Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.352784Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 263 partNo : 0 messageNo: 525 size 28905 offset: -1
2025-10-10T14:31:44.352802Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 251
2025-10-10T14:31:44.352810Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.352809Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.352816Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.352840Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.352854Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.352857Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.352869Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 526  requestId: <none> cookie: 264
2025-10-10T14:31:44.352874Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.352887Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 256 Result { Offset: 251 Data: "... 27695 bytes ..." SourceId: "\000src_id" SeqNo: 252 WriteTimestampMS: 1760106704351 CreateTimestampMS: 1760106704349 UncompressedSize: 27621 PartitionKey: "" ExplicitHash: "" } Result { Offset: 252 Data: "... 27805 bytes ..." SourceId: "\000src_id" SeqNo: 253 WriteTimestampMS: 1760106704351 CreateTimestampMS: 1760106704349 UncompressedSize: 27731 PartitionKey: "" ExplicitHash: "" } Result { Offset: 253 Data: "... 27915 bytes ..." SourceId: "\000src_id" SeqNo: 254 WriteTimestampMS: 1760106704351 CreateTimestampMS: 1760106704350 UncompressedSize: 27841 PartitionKey: "" ExplicitHash: "" } Result { Offset: 254 Data: "... 28025 bytes ..." SourceId: "\000src_id" SeqNo: 255 WriteTimestampMS: 1760106704351 CreateTimestampMS: 1760106704350 UncompressedSize: 27951 PartitionKey: "" ExplicitHash: "" } Result { Offset: 255 Data: "... 28135 bytes ..." SourceId: "\000src_id" SeqNo: 256 WriteTimestampMS: 1760106704351 CreateTimestampMS: 1760106704350 UncompressedSize: 28061 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 18446744073709551557 RealReadOffset: 255 WaitQuotaTimeMs: 0 EndOffset: 256 StartOffset: 0 } Cookie: 251 }
2025-10-10T14:31:44.352893Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.352894Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.352903Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 264 partNo : 0 messageNo: 527 size 29015 offset: -1
2025-10-10T14:31:44.352907Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.352912Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.352913Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 60 from offset 256
2025-10-10T14:31:44.352917Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 256 ReadOffset 256 ReadGuid cba4d9b1-8d0170a2-5f98e377-7c0c8dc5 has messages 1
2025-10-10T14:31:44.352929Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 read done: guid# cba4d9b1-8d0170a2-5f98e377-7c0c8dc5, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 139538
2025-10-10T14:31:44.352934Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 response to read: guid# cba4d9b1-8d0170a2-5f98e377-7c0c8dc5
2025-10-10T14:31:44.353059Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 Process answer. Aval parts: 0
2025-10-10T14:31:44.353314Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.353430Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.353446Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.353449Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.353460Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 528  requestId: <none> cookie: 265
2025-10-10T14:31:44.353470Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.353479Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.353480Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.353487Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 265 partNo : 0 messageNo: 529 size 29125 offset: -1
2025-10-10T14:31:44.353513Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.353518Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.353524Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 256 count 6 size 171282 actorID [3:7559600726884252064:2448]
2025-10-10T14:31:44.353532Z node 3 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:31:44.353537Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 171162 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:31:44.353540Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.353543Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 257, partNo: 0, Offset: 256 is stored on disk
2025-10-10T14:31:44.353544Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.353545Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 256 partno 0 count 6 parts 0 suffix '63' size 171282
2025-10-10T14:31:44.353546Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 258, partNo: 0, Offset: 257 is stored on disk
2025-10-10T14:31:44.353551Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.353553Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 259, partNo: 0, Offset: 258 is stored on disk
2025-10-10T14:31:44.353554Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.353555Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 260, partNo: 0, Offset: 259 is stored on disk
2025-10-10T14:31:44.353557Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.353558Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 261, partNo: 0, Offset: 260 is stored on disk
2025-10-10T14:31:44.353560Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.353565Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 262, partNo: 0, Offset: 261 is stored on disk
2025-10-10T14:31:44.353581Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:44.353585Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:44.353586Z node 3 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2025-10-10T14:31:44.353592Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 263 partNo 0
2025-10-10T14:31:44.353599Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 256 EndOffset 256 newEndOffset 262 commitOffset 0 clientCommitOffset 0 cookie 60 readingFinished 0 firstRead 0
2025-10-10T14:31:44.353602Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 256 endOffset 262
2025-10-10T14:31:44.353604Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 263 partNo 0 FormedBlobsCount 0 NewHead: Offset 262 PartNo 0 PackedSize 28979 count 1 nextOffset 263 batches 1
2025-10-10T14:31:44.353607Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 264 partNo 0
2025-10-10T14:31:44.353609Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 264 partNo 0 FormedBlobsCount 0 NewHead: Offset 262 PartNo 0 PackedSize 58036 count 2 nextOffset 264 batches 1
2025-10-10T14:31:44.353609Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 256, endOffset# 262, WTime# 1760106704351, sizeLag# 171282
2025-10-10T14:31:44.353611Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 265 partNo 0
2025-10-10T14:31:44.353611Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1TEvPartitionReady. Aval parts: 1
2025-10-10T14:31:44.353614Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 265 partNo 0 FormedBlobsCount 0 NewHead: Offset 262 PartNo 0 PackedSize 87203 count 3 nextOffset 265 batches 1
2025-10-10T14:31:44.353615Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:44.353617Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 performing read request: guid# 8e1b14d0-dedc41d-e8bf17d3-90ca0b40, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 7, size# 205538, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-10T14:31:44.353626Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 7 maxSize 205538 maxTimeLagMs 0 readTimestampMs 0 readOffset 256 EndOffset 262 ClientCommitOffset 0 committedOffset 0 Guid 8e1b14d0-dedc41d-e8bf17d3-90ca0b40
2025-10-10T14:31:44.353688Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 262,3 HeadOffset 262 endOffset 262 curOffset 265 d0000000000_00000000000000000262_00000_0000000003_00000? size 87174 WTime 1760106704353
2025-10-10T14:31:44.353743Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:182: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:31:44.353749Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 516  requestId: <none> cookie: 257
2025-10-10T14:31:44.353756Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 518  requestId: <none> cookie: 258
2025-10-10T14:31:44.353759Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 519  requestId: <none> cookie: 259
2025-10-10T14:31:44.353762Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 520  requestId: <none> cookie: 260
2025-10-10T14:31:44.353765Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 522  requestId: <none> cookie: 261
2025-10-10T14:31:44.353768Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 523  requestId: <none> cookie: 262
2025-10-10T14:31:44.353769Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.353772Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.353774Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.353776Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.353778Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.353778Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.353781Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.353782Z node 3 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:31:44.353786Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.353787Z node 3 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 262 partNo 0 count 3 size 87174
2025-10-10T14:31:44.353789Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.353816Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 63 Topic 'rt3.dc1--test-topic' partition 0 user user offset 256 count 7 size 205538 endOffset 262 max time lag 0ms effective offset 256
2025-10-10T14:31:44.353826Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 63 added 1 blobs, size 171282 count 6 last offset 256, current partition end offset: 262
2025-10-10T14:31:44.353828Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 63. Send blob request.
2025-10-10T14:31:44.353834Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 256 partno 0 count 6 parts_count 0 source 1 size 171282 accessed 0 times before, last time 2025-10-10T14:31:44.000000Z
2025-10-10T14:31:44.353843Z node 3 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 63. All 1 blobs are from cache.
2025-10-10T14:31:44.353848Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 256 partno 0 count 6 parts 0 suffix '63'
2025-10-10T14:31:44.353849Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:31:44.387813Z :INFO: [/Root] [/Root] [5f0e011-85f0ac12-a238a939-c9adead4] Closing read session. Close timeout: 0.000000s
2025-10-10T14:31:44.353901Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 256 totakecount 6 count 6 size 171259 from pos 0 cbcount 6
2025-10-10T14:31:44.353914Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 256
2025-10-10T14:31:44.353939Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 grpc read done: success# 1, data# { read_request { bytes_size: 55125 } }
2025-10-10T14:31:44.353954Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 got read request: guid# cc2fcd2-5af359e9-4aa3e872-565bccc9
2025-10-10T14:31:44.353966Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.388013Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset):
2025-10-10T14:31:44.353989Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.353991Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 262 Result { Offset: 256 Data: "... 28245 bytes ..." SourceId: "\000src_id" SeqNo: 257 WriteTimestampMS: 1760106704352 CreateTimestampMS: 1760106704350 UncompressedSize: 28171 PartitionKey: "" ExplicitHash: "" } Result { Offset: 257 Data: "... 28355 bytes ..." SourceId: "\000src_id" SeqNo: 258 WriteTimestampMS: 1760106704352 CreateTimestampMS: 1760106704350 UncompressedSize: 28281 PartitionKey: "" ExplicitHash: "" } Result { Offset: 258 Data: "... 28465 bytes ..." SourceId: "\000src_id" SeqNo: 259 WriteTimestampMS: 1760106704352 CreateTimestampMS: 1760106704350 UncompressedSize: 28391 PartitionKey: "" ExplicitHash: "" } Result { Offset: 259 Data: "... 28575 bytes ..." SourceId: "\000src_id" SeqNo: 260 WriteTimestampMS: 1760106704352 CreateTimestampMS: 1760106704350 UncompressedSize: 28501 PartitionKey: "" ExplicitHash: "" } Result { Offset: 260 Data: "... 28685 bytes ..." SourceId: "\000src_id" SeqNo: 261 WriteTimestampMS: 1760106704352 CreateTimestampMS: 1760106704350 UncompressedSize: 28611 PartitionKey: "" ExplicitHash: "" } Result { Offset: 261 Data: "... 28795 bytes ..." SourceId: "\000src_id" SeqNo: 262 WriteTimestampMS: 1760106704352 CreateTimestampMS: 1760106704351 UncompressedSize: 28721 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 18446744073709551526 RealReadOffset: 261 WaitQuotaTimeMs: 0 EndOffset: 262 StartOffset: 0 } Cookie: 256 }
2025-10-10T14:31:44.354011Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.388023Z :INFO: [/Root] [/Root] [5f0e011-85f0ac12-a238a939-c9adead4] Counters: { Errors: 0 CurrentSessionLifetimeMs: 205 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-10T14:31:44.354014Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.354030Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 530  requestId: <none> cookie: 266
2025-10-10T14:31:44.388032Z :INFO: [/Root] [/Root] [58801aae-576286d5-532f2de5-974b64be] Closing read session. Close timeout: 0.000000s
2025-10-10T14:31:44.354035Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 61 from offset 262
2025-10-10T14:31:44.354035Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.388038Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset):
2025-10-10T14:31:44.354039Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 262 ReadOffset 262 ReadGuid 8e1b14d0-dedc41d-e8bf17d3-90ca0b40 has messages 1
2025-10-10T14:31:44.354049Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 read done: guid# 8e1b14d0-dedc41d-e8bf17d3-90ca0b40, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 171049
2025-10-10T14:31:44.354053Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 response to read: guid# 8e1b14d0-dedc41d-e8bf17d3-90ca0b40
2025-10-10T14:31:44.354056Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.354059Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.388042Z :INFO: [/Root] [/Root] [58801aae-576286d5-532f2de5-974b64be] Counters: { Errors: 0 CurrentSessionLifetimeMs: 158 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-10T14:31:44.354068Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 266 partNo : 0 messageNo: 531 size 29235 offset: -1
2025-10-10T14:31:44.388067Z :INFO: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] Closing read session. Close timeout: 0.000000s
2025-10-10T14:31:44.354074Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.354080Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.354252Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 Process answer. Aval parts: 0
2025-10-10T14:31:44.388074Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): -:test-topic:0:1:299:0
2025-10-10T14:31:44.354364Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.354418Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.388079Z :INFO: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] Counters: { Errors: 0 CurrentSessionLifetimeMs: 157 BytesRead: 4936800 MessagesRead: 300 BytesReadCompressed: 4936800 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-10T14:31:44.354438Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.388343Z :INFO: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] Closing read session. Close timeout: 0.000000s
2025-10-10T14:31:44.354441Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.388352Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): -:test-topic:0:1:299:0
2025-10-10T14:31:44.354449Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 532  requestId: <none> cookie: 267
2025-10-10T14:31:44.388355Z :INFO: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] Counters: { Errors: 0 CurrentSessionLifetimeMs: 158 BytesRead: 4936800 MessagesRead: 300 BytesReadCompressed: 4936800 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-10T14:31:44.354457Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.354464Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.388371Z :NOTICE: [/Root] [/Root] [70b59c0-3fec57d7-92bc43c0-4594ce6b] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
2025-10-10T14:31:44.354465Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.354469Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 267 partNo : 0 messageNo: 533 size 29345 offset: -1
2025-10-10T14:31:44.354472Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.354476Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.354513Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 262 count 3 size 87174 actorID [3:7559600726884252064:2448]
2025-10-10T14:31:44.354523Z node 3 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:31:44.354530Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 87066 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:31:44.354532Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.354533Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.354535Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 262 partno 0 count 3 parts 0 suffix '63' size 87174
2025-10-10T14:31:44.354538Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 263, partNo: 0, Offset: 262 is stored on disk
2025-10-10T14:31:44.354540Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.354543Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 264, partNo: 0, Offset: 263 is stored on disk
2025-10-10T14:31:44.354545Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.354548Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 265, partNo: 0, Offset: 264 is stored on disk
2025-10-10T14:31:44.354560Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:44.354563Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:44.354575Z node 3 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (2)
2025-10-10T14:31:44.354587Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 266 partNo 0
2025-10-10T14:31:44.354591Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.354599Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 266 partNo 0 FormedBlobsCount 0 NewHead: Offset 265 PartNo 0 PackedSize 29309 count 1 nextOffset 266 batches 1
2025-10-10T14:31:44.354602Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 267 partNo 0
2025-10-10T14:31:44.354605Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 267 partNo 0 FormedBlobsCount 0 NewHead: Offset 265 PartNo 0 PackedSize 58696 count 2 nextOffset 267 batches 1
2025-10-10T14:31:44.354605Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 262 EndOffset 262 newEndOffset 265 commitOffset 0 clientCommitOffset 0 cookie 61 readingFinished 0 firstRead 0
2025-10-10T14:31:44.354606Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:44.354607Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 262 endOffset 265
2025-10-10T14:31:44.354613Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 262, endOffset# 265, WTime# 1760106704352, sizeLag# 87174
2025-10-10T14:31:44.354615Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1TEvPartitionReady. Aval parts: 1
2025-10-10T14:31:44.354621Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 performing read request: guid# bc1a0f46-8a6f3075-4d1e5500-73c15186, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 3, size# 104608, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-10T14:31:44.354631Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 3 maxSize 104608 maxTimeLagMs 0 readTimestampMs 0 readOffset 262 EndOffset 265 ClientCommitOffset 0 committedOffset 0 Guid bc1a0f46-8a6f3075-4d1e5500-73c15186
2025-10-10T14:31:44.388486Z :INFO: [/Root] [/Root] [58801aae-576286d5-532f2de5-974b64be] Closing read session. Close timeout: 0.000000s
2025-10-10T14:31:44.354652Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 265,2 HeadOffset 265 endOffset 265 curOffset 267 d0000000000_00000000000000000265_00000_0000000002_00000? size 58687 WTime 1760106704354
2025-10-10T14:31:44.354669Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:182: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:31:44.354675Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 525  requestId: <none> cookie: 263
2025-10-10T14:31:44.354685Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 527  requestId: <none> cookie: 264
2025-10-10T14:31:44.354687Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 529  requestId: <none> cookie: 265
2025-10-10T14:31:44.354690Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.388674Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset):
2025-10-10T14:31:44.354691Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.354692Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.388689Z :INFO: [/Root] [/Root] [58801aae-576286d5-532f2de5-974b64be] Counters: { Errors: 0 CurrentSessionLifetimeMs: 158 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-10T14:31:44.354696Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.354698Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.354698Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.354699Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.388702Z :NOTICE: [/Root] [/Root] [58801aae-576286d5-532f2de5-974b64be] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
2025-10-10T14:31:44.354702Z node 3 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:31:44.354708Z node 3 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 265 partNo 0 count 2 size 58687
2025-10-10T14:31:44.354726Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 534  requestId: <none> cookie: 268
2025-10-10T14:31:44.354740Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 64 Topic 'rt3.dc1--test-topic' partition 0 user user offset 262 count 3 size 104608 endOffset 265 max time lag 0ms effective offset 262
2025-10-10T14:31:44.354747Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 64 added 1 blobs, size 87174 count 3 last offset 262, current partition end offset: 265
2025-10-10T14:31:44.354748Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 64. Send blob request.
2025-10-10T14:31:44.354753Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 262 partno 0 count 3 parts_count 0 source 1 size 87174 accessed 0 times before, last time 2025-10-10T14:31:44.000000Z
2025-10-10T14:31:44.354759Z node 3 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 64. All 1 blobs are from cache.
2025-10-10T14:31:44.354759Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.354765Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:31:44.354767Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 262 partno 0 count 3 parts 0 suffix '63'
2025-10-10T14:31:44.354793Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 262 totakecount 3 count 3 size 87151 from pos 0 cbcount 3
2025-10-10T14:31:44.354801Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.354802Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.354807Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 268 partNo : 0 messageNo: 535 size 29455 offset: -1
2025-10-10T14:31:44.354813Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 262
2025-10-10T14:31:44.354817Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.354820Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.354863Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 265 Result { Offset: 262 Data: "... 28905 bytes ..." SourceId: "\000src_id" SeqNo: 263 WriteTimestampMS: 1760106704353 CreateTimestampMS: 1760106704351 UncompressedSize: 28831 PartitionKey: "" ExplicitHash: "" } Result { Offset: 263 Data: "... 29015 bytes ..." SourceId: "\000src_id" SeqNo: 264 WriteTimestampMS: 1760106704353 CreateTimestampMS: 1760106704352 UncompressedSize: 28941 PartitionKey: "" ExplicitHash: "" } Result { Offset: 264 Data: "... 29125 bytes ..." SourceId: "\000src_id" SeqNo: 265 WriteTimestampMS: 1760106704353 CreateTimestampMS: 1760106704352 UncompressedSize: 29051 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 3 RealReadOffset: 264 WaitQuotaTimeMs: 0 EndOffset: 265 StartOffset: 0 } Cookie: 262 }
2025-10-10T14:31:44.354886Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 62 from offset 265
2025-10-10T14:31:44.388805Z :INFO: [/Root] [/Root] [5f0e011-85f0ac12-a238a939-c9adead4] Closing read session. Close timeout: 0.000000s
2025-10-10T14:31:44.354888Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 265 ReadOffset 265 ReadGuid bc1a0f46-8a6f3075-4d1e5500-73c15186 has messages 1
2025-10-10T14:31:44.389008Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset):
2025-10-10T14:31:44.354904Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 read done: guid# bc1a0f46-8a6f3075-4d1e5500-73c15186, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 87076
2025-10-10T14:31:44.354908Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 response to read: guid# bc1a0f46-8a6f3075-4d1e5500-73c15186
2025-10-10T14:31:44.389020Z :INFO: [/Root] [/Root] [5f0e011-85f0ac12-a238a939-c9adead4] Counters: { Errors: 0 CurrentSessionLifetimeMs: 206 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-10T14:31:44.355011Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 Process answer. Aval parts: 0
2025-10-10T14:31:44.389028Z :NOTICE: [/Root] [/Root] [5f0e011-85f0ac12-a238a939-c9adead4] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
2025-10-10T14:31:44.355029Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 grpc read done: success# 1, data# { read_request { bytes_size: 139538 } }
2025-10-10T14:31:44.355040Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 got read request: guid# e0a5f1de-36655e6c-b0902fb2-d2429bc5
2025-10-10T14:31:44.355092Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.355158Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.355167Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.355168Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.355174Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 536  requestId: <none> cookie: 269
2025-10-10T14:31:44.355182Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.355189Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.355190Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.355196Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 269 partNo : 0 messageNo: 537 size 29565 offset: -1
2025-10-10T14:31:44.355198Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.355202Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.355316Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.355395Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 265 count 2 size 58687 actorID [3:7559600726884252064:2448]
2025-10-10T14:31:44.355406Z node 3 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:31:44.355414Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 58594 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:31:44.355414Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 265 partno 0 count 2 parts 0 suffix '63' size 58687
2025-10-10T14:31:44.355418Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.355423Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 266, partNo: 0, Offset: 265 is stored on disk
2025-10-10T14:31:44.355426Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.355443Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 267, partNo: 0, Offset: 266 is stored on disk
2025-10-10T14:31:44.355462Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:44.355466Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:44.355468Z node 3 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (2)
2025-10-10T14:31:44.355478Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 268 partNo 0
2025-10-10T14:31:44.355481Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.355517Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 268 partNo 0 FormedBlobsCount 0 NewHead: Offset 267 PartNo 0 PackedSize 29529 count 1 nextOffset 268 batches 1
2025-10-10T14:31:44.355522Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 265 EndOffset 265 newEndOffset 267 commitOffset 0 clientCommitOffset 0 cookie 62 readingFinished 0 firstRead 0
2025-10-10T14:31:44.355522Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 269 partNo 0
2025-10-10T14:31:44.355526Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 265 endOffset 267
2025-10-10T14:31:44.355526Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 269 partNo 0 FormedBlobsCount 0 NewHead: Offset 267 PartNo 0 PackedSize 59136 count 2 nextOffset 269 batches 1
2025-10-10T14:31:44.355528Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:44.355542Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 265, endOffset# 267, WTime# 1760106704353, sizeLag# 58687
2025-10-10T14:31:44.355546Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1TEvPartitionReady. Aval parts: 1
2025-10-10T14:31:44.355565Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 performing read request: guid# 2df3ec8f-df0fbe78-94e0ab99-d0c8718d, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 2, size# 70424, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-10T14:31:44.355578Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 2 maxSize 70424 maxTimeLagMs 0 readTimestampMs 0 readOffset 265 EndOffset 267 ClientCommitOffset 0 committedOffset 0 Guid 2df3ec8f-df0fbe78-94e0ab99-d0c8718d
2025-10-10T14:31:44.355581Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 267,2 HeadOffset 267 endOffset 267 curOffset 269 d0000000000_00000000000000000267_00000_0000000002_00000? size 59127 WTime 1760106704355
2025-10-10T14:31:44.355618Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:182: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:31:44.355626Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 531  requestId: <none> cookie: 266
2025-10-10T14:31:44.355632Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 533  requestId: <none> cookie: 267
2025-10-10T14:31:44.355637Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.355640Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.355650Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.355651Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.355657Z node 3 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:31:44.355665Z node 3 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 267 partNo 0 count 2 size 59127
2025-10-10T14:31:44.355666Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 grpc read done: success# 1, data# { read_request { bytes_size: 171049 } }
2025-10-10T14:31:44.355684Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 got read request: guid# 1d1f4a5b-937e6cba-9b7d05c7-24d7e2d9
2025-10-10T14:31:44.355691Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 538  requestId: <none> cookie: 270
2025-10-10T14:31:44.355692Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.355703Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.355707Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.355711Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.355712Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 65 Topic 'rt3.dc1--test-topic' partition 0 user user offset 265 count 2 size 70424 endOffset 267 max time lag 0ms effective offset 265
2025-10-10T14:31:44.355725Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 65 added 1 blobs, size 58687 count 2 last offset 265, current partition end offset: 267
2025-10-10T14:31:44.355727Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 65. Send blob request.
2025-10-10T14:31:44.355735Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 265 partno 0 count 2 parts_count 0 source 1 size 58687 accessed 0 times before, last time 2025-10-10T14:31:44.000000Z
2025-10-10T14:31:44.355737Z node 3 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 65. All 1 blobs are from cache.
2025-10-10T14:31:44.355743Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:31:44.355749Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 265 partno 0 count 2 parts 0 suffix '63'
2025-10-10T14:31:44.355797Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 265 totakecount 2 count 2 size 58664 from pos 0 cbcount 2
2025-10-10T14:31:44.355811Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 265
2025-10-10T14:31:44.355858Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 267 Result { Offset: 265 Data: "... 29235 bytes ..." SourceId: "\000src_id" SeqNo: 266 WriteTimestampMS: 1760106704354 CreateTimestampMS: 1760106704353 UncompressedSize: 29161 PartitionKey: "" ExplicitHash: "" } Result { Offset: 266 Data: "... 29345 bytes ..." SourceId: "\000src_id" SeqNo: 267 WriteTimestampMS: 1760106704354 CreateTimestampMS: 1760106704353 UncompressedSize: 29271 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 23 RealReadOffset: 266 WaitQuotaTimeMs: 0 EndOffset: 267 StartOffset: 0 } Cookie: 265 }
2025-10-10T14:31:44.355908Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 63 from offset 267
2025-10-10T14:31:44.355912Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 267 ReadOffset 267 ReadGuid 2df3ec8f-df0fbe78-94e0ab99-d0c8718d has messages 1
2025-10-10T14:31:44.355926Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.355928Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.355936Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 270 partNo : 0 messageNo: 539 size 29675 offset: -1
2025-10-10T14:31:44.355942Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.355948Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.355954Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.355958Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 read done: guid# 2df3ec8f-df0fbe78-94e0ab99-d0c8718d, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 58645
2025-10-10T14:31:44.355962Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 response to read: guid# 2df3ec8f-df0fbe78-94e0ab99-d0c8718d
2025-10-10T14:31:44.355991Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.356007Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.356026Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.356034Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.356047Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.356048Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 Process answer. Aval parts: 0
2025-10-10T14:31:44.356049Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.356074Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 540  requestId: <none> cookie: 271
2025-10-10T14:31:44.356081Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 541  requestId: <none> cookie: 272
2025-10-10T14:31:44.356086Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.356092Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.356107Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.356109Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.356127Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 271 partNo : 0 messageNo: 542 size 29785 offset: -1
2025-10-10T14:31:44.356134Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.356140Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.356146Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 272 partNo : 0 messageNo: 543 size 29895 offset: -1
2025-10-10T14:31:44.356166Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.356180Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.356185Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.356188Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.356314Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.356364Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.356404Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.356412Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.356419Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.356423Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.356428Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.356429Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.356440Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 544  requestId: <none> cookie: 273
2025-10-10T14:31:44.356446Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 545  requestId: <none> cookie: 274
2025-10-10T14:31:44.356455Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.356465Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.356485Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.356489Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.356499Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 273 partNo : 0 messageNo: 546 size 30005 offset: -1
2025-10-10T14:31:44.356504Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.356505Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.356510Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 274 partNo : 0 messageNo: 547 size 30115 offset: -1
2025-10-10T14:31:44.356515Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.356522Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.356524Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.356528Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.356687Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 267 count 2 size 59127 actorID [3:7559600726884252064:2448]
2025-10-10T14:31:44.356702Z node 3 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:31:44.356715Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 267 partno 0 count 2 parts 0 suffix '63' size 59127
2025-10-10T14:31:44.356718Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 59034 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:31:44.356728Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.356737Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 268, partNo: 0, Offset: 267 is stored on disk
2025-10-10T14:31:44.356742Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.356745Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 269, partNo: 0, Offset: 268 is stored on disk
2025-10-10T14:31:44.356786Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:44.356793Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:44.356794Z node 3 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (5)
2025-10-10T14:31:44.356802Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 267 EndOffset 267 newEndOffset 269 commitOffset 0 clientCommitOffset 0 cookie 63 readingFinished 0 firstRead 0
2025-10-10T14:31:44.356804Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 267 endOffset 269
2025-10-10T14:31:44.356810Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 270 partNo 0
2025-10-10T14:31:44.356815Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 267, endOffset# 269, WTime# 1760106704354, sizeLag# 59127
2025-10-10T14:31:44.356816Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1TEvPartitionReady. Aval parts: 1
2025-10-10T14:31:44.356823Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 performing read request: guid# e3a737c3-bfc5feb3-7e6d969a-91d323e8, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 2, size# 70952, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-10T14:31:44.356834Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 2 maxSize 70952 maxTimeLagMs 0 readTimestampMs 0 readOffset 267 EndOffset 269 ClientCommitOffset 0 committedOffset 0 Guid e3a737c3-bfc5feb3-7e6d969a-91d323e8
2025-10-10T14:31:44.356841Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 270 partNo 0 FormedBlobsCount 0 NewHead: Offset 269 PartNo 0 PackedSize 29749 count 1 nextOffset 270 batches 1
2025-10-10T14:31:44.356850Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 271 partNo 0
2025-10-10T14:31:44.356856Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 271 partNo 0 FormedBlobsCount 0 NewHead: Offset 269 PartNo 0 PackedSize 59576 count 2 nextOffset 271 batches 1
2025-10-10T14:31:44.356859Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 272 partNo 0
2025-10-10T14:31:44.356862Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 272 partNo 0 FormedBlobsCount 0 NewHead: Offset 269 PartNo 0 PackedSize 89513 count 3 nextOffset 272 batches 1
2025-10-10T14:31:44.356865Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 273 partNo 0
2025-10-10T14:31:44.356870Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 273 partNo 0 FormedBlobsCount 0 NewHead: Offset 269 PartNo 0 PackedSize 119560 count 4 nextOffset 273 batches 1
2025-10-10T14:31:44.356872Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 274 partNo 0
2025-10-10T14:31:44.356875Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 274 partNo 0 FormedBlobsCount 0 NewHead: Offset 269 PartNo 0 PackedSize 149717 count 5 nextOffset 274 batches 1
2025-10-10T14:31:44.356877Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:44.357013Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 grpc read done: success# 1, data# { read_request { bytes_size: 87076 } }
2025-10-10T14:31:44.357058Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 269,5 HeadOffset 269 endOffset 269 curOffset 274 d0000000000_00000000000000000269_00000_0000000005_00000? size 149626 WTime 1760106704356
2025-10-10T14:31:44.357060Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 got read request: guid# c59ae7e-5b42308d-c09dd8f3-d1125fe6
2025-10-10T14:31:44.357101Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:182: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:31:44.357113Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 535  requestId: <none> cookie: 268
2025-10-10T14:31:44.357129Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 537  requestId: <none> cookie: 269
2025-10-10T14:31:44.357139Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.357140Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.357143Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.357147Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.357152Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.357152Z node 3 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:31:44.357162Z node 3 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 269 partNo 0 count 5 size 149626
2025-10-10T14:31:44.357220Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 66 Topic 'rt3.dc1--test-topic' partition 0 user user offset 267 count 2 size 70952 endOffset 269 max time lag 0ms effective offset 267
2025-10-10T14:31:44.357232Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.357237Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 66 added 1 blobs, size 59127 count 2 last offset 267, current partition end offset: 269
2025-10-10T14:31:44.357241Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 66. Send blob request.
2025-10-10T14:31:44.357252Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 267 partno 0 count 2 parts_count 0 source 1 size 59127 accessed 0 times before, last time 2025-10-10T14:31:44.000000Z
2025-10-10T14:31:44.357257Z node 3 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 66. All 1 blobs are from cache.
2025-10-10T14:31:44.357263Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 267 partno 0 count 2 parts 0 suffix '63'
2025-10-10T14:31:44.357264Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.357266Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.357274Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:31:44.357308Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 267 totakecount 2 count 2 size 59104 from pos 0 cbcount 2
2025-10-10T14:31:44.357347Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 267
2025-10-10T14:31:44.357356Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 548  requestId: <none> cookie: 275
2025-10-10T14:31:44.357380Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.357409Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.357413Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.357421Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 275 partNo : 0 messageNo: 549 size 30225 offset: -1
2025-10-10T14:31:44.357427Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.357433Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 269 Result { Offset: 267 Data: "... 29455 bytes ..." SourceId: "\000src_id" SeqNo: 268 WriteTimestampMS: 1760106704355 CreateTimestampMS: 1760106704354 UncompressedSize: 29381 PartitionKey: "" ExplicitHash: "" } Result { Offset: 268 Data: "... 29565 bytes ..." SourceId: "\000src_id" SeqNo: 269 WriteTimestampMS: 1760106704355 CreateTimestampMS: 1760106704354 UncompressedSize: 29491 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 23 RealReadOffset: 268 WaitQuotaTimeMs: 0 EndOffset: 269 StartOffset: 0 } Cookie: 267 }
2025-10-10T14:31:44.357435Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.357474Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 64 from offset 269
2025-10-10T14:31:44.357482Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 269 ReadOffset 269 ReadGuid e3a737c3-bfc5feb3-7e6d969a-91d323e8 has messages 1
2025-10-10T14:31:44.357506Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 read done: guid# e3a737c3-bfc5feb3-7e6d969a-91d323e8, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 59085
2025-10-10T14:31:44.357510Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 response to read: guid# e3a737c3-bfc5feb3-7e6d969a-91d323e8
2025-10-10T14:31:44.357593Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 Process answer. Aval parts: 0
2025-10-10T14:31:44.357721Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.357784Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.357844Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.357846Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.357857Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 550  requestId: <none> cookie: 276
2025-10-10T14:31:44.357877Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.357891Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.357892Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.357899Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 276 partNo : 0 messageNo: 551 size 30335 offset: -1
2025-10-10T14:31:44.357903Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.357908Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.357991Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 grpc read done: success# 1, data# { read_request { bytes_size: 58645 } }
2025-10-10T14:31:44.357996Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.358011Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 got read request: guid# 1fe88cf7-54569c57-d095d707-e8be645e
2025-10-10T14:31:44.358051Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.358078Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.358083Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.358098Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 552  requestId: <none> cookie: 277
2025-10-10T14:31:44.358108Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.358112Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.358137Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.358144Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 269 count 5 size 149626 actorID [3:7559600726884252064:2448]
2025-10-10T14:31:44.358154Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 269 partno 0 count 5 parts 0 suffix '63' size 149626
2025-10-10T14:31:44.358163Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.358165Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.358175Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 277 partNo : 0 messageNo: 553 size 30445 offset: -1
2025-10-10T14:31:44.358180Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.358181Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.358185Z node 3 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:31:44.358197Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 149510 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:31:44.358203Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.358208Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 270, partNo: 0, Offset: 269 is stored on disk
2025-10-10T14:31:44.358211Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.358214Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 271, partNo: 0, Offset: 270 is stored on disk
2025-10-10T14:31:44.358216Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.358219Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 272, partNo: 0, Offset: 271 is stored on disk
2025-10-10T14:31:44.358221Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.358225Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 273, partNo: 0, Offset: 272 is stored on disk
2025-10-10T14:31:44.358228Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.358243Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 274, partNo: 0, Offset: 273 is stored on disk
2025-10-10T14:31:44.358272Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:44.358277Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:44.358279Z node 3 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (2)
2025-10-10T14:31:44.358281Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 269 EndOffset 269 newEndOffset 274 commitOffset 0 clientCommitOffset 0 cookie 64 readingFinished 0 firstRead 0
2025-10-10T14:31:44.358284Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 269 endOffset 274
2025-10-10T14:31:44.358291Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 269, endOffset# 274, WTime# 1760106704355, sizeLag# 149626
2025-10-10T14:31:44.358292Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 275 partNo 0
2025-10-10T14:31:44.358293Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1TEvPartitionReady. Aval parts: 1
2025-10-10T14:31:44.358301Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 performing read request: guid# a308b736-986553fb-299a4cd2-5091a79d, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 6, size# 179551, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-10T14:31:44.358309Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 6 maxSize 179551 maxTimeLagMs 0 readTimestampMs 0 readOffset 269 EndOffset 274 ClientCommitOffset 0 committedOffset 0 Guid a308b736-986553fb-299a4cd2-5091a79d
2025-10-10T14:31:44.358309Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 275 partNo 0 FormedBlobsCount 0 NewHead: Offset 274 PartNo 0 PackedSize 30299 count 1 nextOffset 275 batches 1
2025-10-10T14:31:44.358314Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 276 partNo 0
2025-10-10T14:31:44.358317Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 276 partNo 0 FormedBlobsCount 0 NewHead: Offset 274 PartNo 0 PackedSize 60676 count 2 nextOffset 276 batches 1
2025-10-10T14:31:44.358320Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:44.358388Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 274,2 HeadOffset 274 endOffset 274 curOffset 276 d0000000000_00000000000000000274_00000_0000000002_00000? size 60667 WTime 1760106704358
2025-10-10T14:31:44.358406Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:182: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:31:44.358411Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.358417Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.358424Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 539  requestId: <none> cookie: 270
2025-10-10T14:31:44.358435Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 542  requestId: <none> cookie: 271
2025-10-10T14:31:44.358437Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.358440Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 543  requestId: <none> cookie: 272
2025-10-10T14:31:44.358442Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.358445Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 546  requestId: <none> cookie: 273
2025-10-10T14:31:44.358447Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.358461Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 547  requestId: <none> cookie: 274
2025-10-10T14:31:44.358470Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.358472Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.358484Z node 3 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:31:44.358494Z node 3 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 274 partNo 0 count 2 size 60667
2025-10-10T14:31:44.358498Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.358498Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 554  requestId: <none> cookie: 278
2025-10-10T14:31:44.358527Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.358531Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.358541Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 67 Topic 'rt3.dc1--test-topic' partition 0 user user offset 269 count 6 size 179551 endOffset 274 max time lag 0ms effective offset 269
2025-10-10T14:31:44.358553Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 67 added 1 blobs, size 149626 count 5 last offset 269, current partition end offset: 274
2025-10-10T14:31:44.358555Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 67. Send blob request.
2025-10-10T14:31:44.358562Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 269 partno 0 count 5 parts_count 0 source 1 size 149626 accessed 0 times before, last time 2025-10-10T14:31:44.000000Z
2025-10-10T14:31:44.358565Z node 3 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 67. All 1 blobs are from cache.
2025-10-10T14:31:44.358569Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 269 partno 0 count 5 parts 0 suffix '63'
2025-10-10T14:31:44.358572Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.358572Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.358574Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.358580Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 278 partNo : 0 messageNo: 555 size 30555 offset: -1
2025-10-10T14:31:44.358585Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:31:44.358593Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.358675Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 269 totakecount 5 count 5 size 149603 from pos 0 cbcount 5
2025-10-10T14:31:44.358691Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.358696Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.358699Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.358700Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.358710Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 269
2025-10-10T14:31:44.358738Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 556  requestId: <none> cookie: 279
2025-10-10T14:31:44.358748Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.358761Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.358762Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.358768Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 279 partNo : 0 messageNo: 557 size 30665 offset: -1
2025-10-10T14:31:44.358772Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.358775Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.358783Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 274 Result { Offset: 269 Data: "... 29675 bytes ..." SourceId: "\000src_id" SeqNo: 270 WriteTimestampMS: 1760106704356 CreateTimestampMS: 1760106704354 UncompressedSize: 29601 PartitionKey: "" ExplicitHash: "" } Result { Offset: 270 Data: "... 29785 bytes ..." SourceId: "\000src_id" SeqNo: 271 WriteTimestampMS: 1760106704356 CreateTimestampMS: 1760106704354 UncompressedSize: 29711 PartitionKey: "" ExplicitHash: "" } Result { Offset: 271 Data: "... 29895 bytes ..." SourceId: "\000src_id" SeqNo: 272 WriteTimestampMS: 1760106704356 CreateTimestampMS: 1760106704355 UncompressedSize: 29821 PartitionKey: "" ExplicitHash: "" } Result { Offset: 272 Data: "... 30005 bytes ..." SourceId: "\000src_id" SeqNo: 273 WriteTimestampMS: 1760106704356 CreateTimestampMS: 1760106704355 UncompressedSize: 29931 PartitionKey: "" ExplicitHash: "" } Result { Offset: 273 Data: "... 30115 bytes ..." SourceId: "\000src_id" SeqNo: 274 WriteTimestampMS: 1760106704356 CreateTimestampMS: 1760106704356 UncompressedSize: 30041 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 18446744073709551557 RealReadOffset: 273 WaitQuotaTimeMs: 0 EndOffset: 274 StartOffset: 0 } Cookie: 269 }
2025-10-10T14:31:44.358832Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 65 from offset 274
2025-10-10T14:31:44.358837Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 274 ReadOffset 274 ReadGuid a308b736-986553fb-299a4cd2-5091a79d has messages 1
2025-10-10T14:31:44.358862Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 read done: guid# a308b736-986553fb-299a4cd2-5091a79d, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 149438
2025-10-10T14:31:44.358866Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 response to read: guid# a308b736-986553fb-299a4cd2-5091a79d
2025-10-10T14:31:44.359003Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 Process answer. Aval parts: 0
2025-10-10T14:31:44.359077Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.359122Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.359153Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 274 count 2 size 60667 actorID [3:7559600726884252064:2448]
2025-10-10T14:31:44.359160Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.359163Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.359163Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 274 partno 0 count 2 parts 0 suffix '63' size 60667
2025-10-10T14:31:44.359169Z node 3 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:31:44.359178Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 60574 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:31:44.359182Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.359187Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 275, partNo: 0, Offset: 274 is stored on disk
2025-10-10T14:31:44.359189Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.359192Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 276, partNo: 0, Offset: 275 is stored on disk
2025-10-10T14:31:44.359215Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:44.359220Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:44.359221Z node 3 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2025-10-10T14:31:44.359231Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 277 partNo 0
2025-10-10T14:31:44.359231Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 274 EndOffset 274 newEndOffset 276 commitOffset 0 clientCommitOffset 0 cookie 65 readingFinished 0 firstRead 0
2025-10-10T14:31:44.359234Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 274 endOffset 276
2025-10-10T14:31:44.359240Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 274, endOffset# 276, WTime# 1760106704356, sizeLag# 60667
2025-10-10T14:31:44.359241Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1TEvPartitionReady. Aval parts: 1
2025-10-10T14:31:44.359247Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 277 partNo 0 FormedBlobsCount 0 NewHead: Offset 276 PartNo 0 PackedSize 30519 count 1 nextOffset 277 batches 1
2025-10-10T14:31:44.359248Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 performing read request: guid# c8d70cb4-bafaee34-dbb850ab-366aba3e, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 2, size# 72800, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-10T14:31:44.359251Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 278 partNo 0
2025-10-10T14:31:44.359255Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 278 partNo 0 FormedBlobsCount 0 NewHead: Offset 276 PartNo 0 PackedSize 61116 count 2 nextOffset 278 batches 1
2025-10-10T14:31:44.359257Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 2 maxSize 72800 maxTimeLagMs 0 readTimestampMs 0 readOffset 274 EndOffset 276 ClientCommitOffset 0 committedOffset 0 Guid c8d70cb4-bafaee34-dbb850ab-366aba3e
2025-10-10T14:31:44.359258Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 279 partNo 0
2025-10-10T14:31:44.359261Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 279 partNo 0 FormedBlobsCount 0 NewHead: Offset 276 PartNo 0 PackedSize 91823 count 3 nextOffset 279 batches 1
2025-10-10T14:31:44.359262Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:44.359324Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 276,3 HeadOffset 276 endOffset 276 curOffset 279 d0000000000_00000000000000000276_00000_0000000003_00000? size 91794 WTime 1760106704359
2025-10-10T14:31:44.359351Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:182: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:31:44.359361Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 549  requestId: <none> cookie: 275
2025-10-10T14:31:44.359372Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 551  requestId: <none> cookie: 276
2025-10-10T14:31:44.359378Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.359380Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.359383Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.359383Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.359389Z node 3 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:31:44.359397Z node 3 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 276 partNo 0 count 3 size 91794
2025-10-10T14:31:44.359401Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 558  requestId: <none> cookie: 280
2025-10-10T14:31:44.359437Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 68 Topic 'rt3.dc1--test-topic' partition 0 user user offset 274 count 2 size 72800 endOffset 276 max time lag 0ms effective offset 274
2025-10-10T14:31:44.359448Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 68 added 1 blobs, size 60667 count 2 last offset 274, current partition end offset: 276
2025-10-10T14:31:44.359450Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 68. Send blob request.
2025-10-10T14:31:44.359457Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 274 partno 0 count 2 parts_count 0 source 1 size 60667 accessed 0 times before, last time 2025-10-10T14:31:44.000000Z
2025-10-10T14:31:44.359460Z node 3 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 68. All 1 blobs are from cache.
2025-10-10T14:31:44.359465Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:31:44.359469Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 274 partno 0 count 2 parts 0 suffix '63'
2025-10-10T14:31:44.359481Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 274 totakecount 2 count 2 size 60644 from pos 0 cbcount 2
2025-10-10T14:31:44.359485Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.359493Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 274
2025-10-10T14:31:44.359498Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.359500Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.359506Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 280 partNo : 0 messageNo: 559 size 30775 offset: -1
2025-10-10T14:31:44.359517Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.359521Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.359549Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 276 Result { Offset: 274 Data: "... 30225 bytes ..." SourceId: "\000src_id" SeqNo: 275 WriteTimestampMS: 1760106704358 CreateTimestampMS: 1760106704356 UncompressedSize: 30151 PartitionKey: "" ExplicitHash: "" } Result { Offset: 275 Data: "... 30335 bytes ..." SourceId: "\000src_id" SeqNo: 276 WriteTimestampMS: 1760106704358 CreateTimestampMS: 1760106704356 UncompressedSize: 30261 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 23 RealReadOffset: 275 WaitQuotaTimeMs: 0 EndOffset: 276 StartOffset: 0 } Cookie: 274 }
2025-10-10T14:31:44.359575Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 66 from offset 276
2025-10-10T14:31:44.359579Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 276 ReadOffset 276 ReadGuid c8d70cb4-bafaee34-dbb850ab-366aba3e has messages 1
2025-10-10T14:31:44.359590Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 grpc read done: success# 1, data# { read_request { bytes_size: 59085 } }
2025-10-10T14:31:44.359600Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 read done: guid# c8d70cb4-bafaee34-dbb850ab-366aba3e, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 60625
2025-10-10T14:31:44.359604Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.359605Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 response to read: guid# c8d70cb4-bafaee34-dbb850ab-366aba3e
2025-10-10T14:31:44.359645Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.359659Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.359672Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.359687Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 Process answer. Aval parts: 0
2025-10-10T14:31:44.359688Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.359692Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.359697Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 got read request: guid# f44076ab-ff312245-5730baea-8bc63a8f
2025-10-10T14:31:44.359697Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.359699Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.359709Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 560  requestId: <none> cookie: 281
2025-10-10T14:31:44.359713Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 561  requestId: <none> cookie: 282
2025-10-10T14:31:44.359727Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.359741Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.359755Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.359758Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.359765Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 281 partNo : 0 messageNo: 562 size 30885 offset: -1
2025-10-10T14:31:44.359769Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.359771Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.359774Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 282 partNo : 0 messageNo: 563 size 30995 offset: -1
2025-10-10T14:31:44.359782Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.359787Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.359789Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.359791Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.360035Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.360090Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.360106Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.360110Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.360121Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 564  requestId: <none> cookie: 283
2025-10-10T14:31:44.360123Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.360129Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.360159Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 276 count 3 size 91794 actorID [3:7559600726884252064:2448]
2025-10-10T14:31:44.360171Z node 3 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:31:44.360179Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 91686 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:31:44.360180Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 276 partno 0 count 3 parts 0 suffix '63' size 91794
2025-10-10T14:31:44.360183Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.360187Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 277, partNo: 0, Offset: 276 is stored on disk
2025-10-10T14:31:44.360189Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.360189Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.360192Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 278, partNo: 0, Offset: 277 is stored on disk
2025-10-10T14:31:44.360194Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.360196Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 279, partNo: 0, Offset: 278 is stored on disk
2025-10-10T14:31:44.360216Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:44.360221Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 276 EndOffset 276 newEndOffset 279 commitOffset 0 clientCommitOffset 0 cookie 66 readingFinished 0 firstRead 0
2025-10-10T14:31:44.360221Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:44.360223Z node 3 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2025-10-10T14:31:44.360224Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 276 endOffset 279
2025-10-10T14:31:44.360230Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 276, endOffset# 279, WTime# 1760106704358, sizeLag# 91794
2025-10-10T14:31:44.360232Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1TEvPartitionReady. Aval parts: 1
2025-10-10T14:31:44.360235Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 280 partNo 0
2025-10-10T14:31:44.360239Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 performing read request: guid# d32acc46-8d98bb8-ebc14700-8dfb34dd, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 3, size# 110152, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-10T14:31:44.360247Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 3 maxSize 110152 maxTimeLagMs 0 readTimestampMs 0 readOffset 276 EndOffset 279 ClientCommitOffset 0 committedOffset 0 Guid d32acc46-8d98bb8-ebc14700-8dfb34dd
2025-10-10T14:31:44.360252Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 280 partNo 0 FormedBlobsCount 0 NewHead: Offset 279 PartNo 0 PackedSize 30849 count 1 nextOffset 280 batches 1
2025-10-10T14:31:44.360257Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 281 partNo 0
2025-10-10T14:31:44.360261Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 281 partNo 0 FormedBlobsCount 0 NewHead: Offset 279 PartNo 0 PackedSize 61776 count 2 nextOffset 281 batches 1
2025-10-10T14:31:44.360263Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 282 partNo 0
2025-10-10T14:31:44.360266Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 282 partNo 0 FormedBlobsCount 0 NewHead: Offset 279 PartNo 0 PackedSize 92813 count 3 nextOffset 282 batches 1
2025-10-10T14:31:44.360268Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:44.360358Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 279,3 HeadOffset 279 endOffset 279 curOffset 282 d0000000000_00000000000000000279_00000_0000000003_00000? size 92784 WTime 1760106704360
2025-10-10T14:31:44.360441Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:182: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:31:44.360452Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 553  requestId: <none> cookie: 277
2025-10-10T14:31:44.360467Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.360469Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.360479Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 283 partNo : 0 messageNo: 565 size 31105 offset: -1
2025-10-10T14:31:44.360485Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 555  requestId: <none> cookie: 278
2025-10-10T14:31:44.360486Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.360489Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.360490Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.360493Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.360495Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 557  requestId: <none> cookie: 279
2025-10-10T14:31:44.360501Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.360504Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.360505Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.360510Z node 3 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:31:44.360519Z node 3 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 279 partNo 0 count 3 size 92784
2025-10-10T14:31:44.360523Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.360532Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.360556Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 566  requestId: <none> cookie: 284
2025-10-10T14:31:44.360570Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.360574Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.360579Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 69 Topic 'rt3.dc1--test-topic' partition 0 user user offset 276 count 3 size 110152 endOffset 279 max time lag 0ms effective offset 276
2025-10-10T14:31:44.360591Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 69 added 1 blobs, size 91794 count 3 last offset 276, current partition end offset: 279
2025-10-10T14:31:44.360593Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 69. Send blob request.
2025-10-10T14:31:44.360600Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 276 partno 0 count 3 parts_count 0 source 1 size 91794 accessed 0 times before, last time 2025-10-10T14:31:44.000000Z
2025-10-10T14:31:44.360606Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.360608Z node 3 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 69. All 1 blobs are from cache.
2025-10-10T14:31:44.360615Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:31:44.360621Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 grpc read done: success# 1, data# { read_request { bytes_size: 149438 } }
2025-10-10T14:31:44.360623Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 276 partno 0 count 3 parts 0 suffix '63'
2025-10-10T14:31:44.360630Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 got read request: guid# d076abd5-b31c850d-253a2dc2-1417f3fd
2025-10-10T14:31:44.360661Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 276 totakecount 3 count 3 size 91771 from pos 0 cbcount 3
2025-10-10T14:31:44.360676Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.360679Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.360686Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 284 partNo : 0 messageNo: 567 size 31215 offset: -1
2025-10-10T14:31:44.360690Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.360691Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.360697Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 276
2025-10-10T14:31:44.360703Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.360709Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.360723Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 568  requestId: <none> cookie: 285
2025-10-10T14:31:44.360744Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.360750Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.360763Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 279 Result { Offset: 276 Data: "... 30445 bytes ..." SourceId: "\000src_id" SeqNo: 277 WriteTimestampMS: 1760106704358 CreateTimestampMS: 1760106704357 UncompressedSize: 30371 PartitionKey: "" ExplicitHash: "" } Result { Offset: 277 Data: "... 30555 bytes ..." SourceId: "\000src_id" SeqNo: 278 WriteTimestampMS: 1760106704359 CreateTimestampMS: 1760106704357 UncompressedSize: 30481 PartitionKey: "" ExplicitHash: "" } Result { Offset: 278 Data: "... 30665 bytes ..." SourceId: "\000src_id" SeqNo: 279 WriteTimestampMS: 1760106704359 CreateTimestampMS: 1760106704357 UncompressedSize: 30591 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 3 RealReadOffset: 278 WaitQuotaTimeMs: 0 EndOffset: 279 StartOffset: 0 } Cookie: 276 }
2025-10-10T14:31:44.360787Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.360794Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.360796Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.360798Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 67 from offset 279
2025-10-10T14:31:44.360802Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 285 partNo : 0 messageNo: 569 size 31325 offset: -1
2025-10-10T14:31:44.360803Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 279 ReadOffset 279 ReadGuid d32acc46-8d98bb8-ebc14700-8dfb34dd has messages 1
2025-10-10T14:31:44.360805Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.360807Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.360814Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.360817Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.360819Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 read done: guid# d32acc46-8d98bb8-ebc14700-8dfb34dd, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 91815
2025-10-10T14:31:44.360823Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 response to read: guid# d32acc46-8d98bb8-ebc14700-8dfb34dd
2025-10-10T14:31:44.360823Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 570  requestId: <none> cookie: 286
2025-10-10T14:31:44.360831Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.360851Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.360853Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.360859Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 286 partNo : 0 messageNo: 571 size 31435 offset: -1
2025-10-10T14:31:44.360862Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.360864Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.360914Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 Process answer. Aval parts: 0
2025-10-10T14:31:44.361162Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.361227Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.361251Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.361262Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.361270Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.361275Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.361283Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.361284Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.361287Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.361303Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 572  requestId: <none> cookie: 287
2025-10-10T14:31:44.361310Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 573  requestId: <none> cookie: 288
2025-10-10T14:31:44.361314Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.361322Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.361347Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.361376Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.361379Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.361393Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 287 partNo : 0 messageNo: 574 size 31545 offset: -1
2025-10-10T14:31:44.361417Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.361423Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.361429Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 288 partNo : 0 messageNo: 575 size 31655 offset: -1
2025-10-10T14:31:44.361434Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.361436Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.361443Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.361455Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.361497Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.361501Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.361515Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 279 count 3 size 92784 actorID [3:7559600726884252064:2448]
2025-10-10T14:31:44.361538Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 576  requestId: <none> cookie: 289
2025-10-10T14:31:44.361548Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 279 partno 0 count 3 parts 0 suffix '63' size 92784
2025-10-10T14:31:44.361551Z node 3 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:31:44.361560Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.361561Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 92676 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:31:44.361568Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.361573Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 280, partNo: 0, Offset: 279 is stored on disk
2025-10-10T14:31:44.361578Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.361581Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 281, partNo: 0, Offset: 280 is stored on disk
2025-10-10T14:31:44.361583Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.361586Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 282, partNo: 0, Offset: 281 is stored on disk
2025-10-10T14:31:44.361616Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:44.361623Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 279 EndOffset 279 newEndOffset 282 commitOffset 0 clientCommitOffset 0 cookie 67 readingFinished 0 firstRead 0
2025-10-10T14:31:44.361625Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:44.361626Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 279 endOffset 282
2025-10-10T14:31:44.361627Z node 3 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (6)
2025-10-10T14:31:44.361632Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 279, endOffset# 282, WTime# 1760106704359, sizeLag# 92784
2025-10-10T14:31:44.361634Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1TEvPartitionReady. Aval parts: 1
2025-10-10T14:31:44.361641Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 performing read request: guid# f7ca643f-930d6f63-a9f1351f-bc9c3670, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 3, size# 111340, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-10T14:31:44.361649Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 283 partNo 0
2025-10-10T14:31:44.361649Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 3 maxSize 111340 maxTimeLagMs 0 readTimestampMs 0 readOffset 279 EndOffset 282 ClientCommitOffset 0 committedOffset 0 Guid f7ca643f-930d6f63-a9f1351f-bc9c3670
2025-10-10T14:31:44.361675Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 283 partNo 0 FormedBlobsCount 0 NewHead: Offset 282 PartNo 0 PackedSize 31179 count 1 nextOffset 283 batches 1
2025-10-10T14:31:44.361682Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 284 partNo 0
2025-10-10T14:31:44.361693Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 284 partNo 0 FormedBlobsCount 0 NewHead: Offset 282 PartNo 0 PackedSize 62436 count 2 nextOffset 284 batches 1
2025-10-10T14:31:44.361698Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 285 partNo 0
2025-10-10T14:31:44.361703Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 285 partNo 0 FormedBlobsCount 0 NewHead: Offset 282 PartNo 0 PackedSize 93803 count 3 nextOffset 285 batches 1
2025-10-10T14:31:44.361707Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 286 partNo 0
2025-10-10T14:31:44.361711Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 286 partNo 0 FormedBlobsCount 0 NewHead: Offset 282 PartNo 0 PackedSize 125280 count 4 nextOffset 286 batches 1
2025-10-10T14:31:44.361714Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 287 partNo 0
2025-10-10T14:31:44.361719Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 287 partNo 0 FormedBlobsCount 0 NewHead: Offset 282 PartNo 0 PackedSize 156867 count 5 nextOffset 287 batches 1
2025-10-10T14:31:44.361723Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 288 partNo 0
2025-10-10T14:31:44.361727Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 288 partNo 0 FormedBlobsCount 0 NewHead: Offset 282 PartNo 0 PackedSize 188564 count 6 nextOffset 288 batches 1
2025-10-10T14:31:44.361729Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:44.361767Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 grpc read done: success# 1, data# { read_request { bytes_size: 60625 } }
2025-10-10T14:31:44.361776Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 got read request: guid# b715839e-f6000380-10c978df-be219641
2025-10-10T14:31:44.361834Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.361858Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.361882Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 282,6 HeadOffset 282 endOffset 282 curOffset 288 d0000000000_00000000000000000282_00000_0000000006_00000? size 188442 WTime 1760106704361
2025-10-10T14:31:44.361941Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.361952Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:182: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:31:44.361960Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.361963Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.361972Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 289 partNo : 0 messageNo: 577 size 31765 offset: -1
2025-10-10T14:31:44.361980Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 559  requestId: <none> cookie: 280
2025-10-10T14:31:44.361985Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.361986Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 562  requestId: <none> cookie: 281
2025-10-10T14:31:44.361990Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.361990Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 563  requestId: <none> cookie: 282
2025-10-10T14:31:44.361994Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.361999Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.362001Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.362003Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.362008Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.362010Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.362015Z node 3 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:31:44.362024Z node 3 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 282 partNo 0 count 6 size 188442
2025-10-10T14:31:44.362029Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.362034Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.362039Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.362041Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.362072Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 578  requestId: <none> cookie: 290
2025-10-10T14:31:44.362100Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 70 Topic 'rt3.dc1--test-topic' partition 0 user user offset 279 count 3 size 111340 endOffset 282 max time lag 0ms effective offset 279
2025-10-10T14:31:44.362104Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.362114Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 70 added 1 blobs, size 92784 count 3 last offset 279, current partition end offset: 282
2025-10-10T14:31:44.362117Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 70. Send blob request.
2025-10-10T14:31:44.362123Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 579  requestId: <none> cookie: 291
2025-10-10T14:31:44.362128Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.362128Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.362133Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.362142Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 290 partNo : 0 messageNo: 580 size 31875 offset: -1
2025-10-10T14:31:44.362153Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 279 partno 0 count 3 parts_count 0 source 1 size 92784 accessed 0 times before, last time 2025-10-10T14:31:44.000000Z
2025-10-10T14:31:44.362158Z node 3 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 70. All 1 blobs are from cache.
2025-10-10T14:31:44.362166Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 279 partno 0 count 3 parts 0 suffix '63'
2025-10-10T14:31:44.362166Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.362169Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.362175Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 291 partNo : 0 messageNo: 581 size 31985 offset: -1
2025-10-10T14:31:44.362180Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.362187Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.362194Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:31:44.362250Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.362250Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 279 totakecount 3 count 3 size 92761 from pos 0 cbcount 3
2025-10-10T14:31:44.362266Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.362270Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.362270Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.362276Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 279
2025-10-10T14:31:44.362309Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.362311Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.362317Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 582  requestId: <none> cookie: 292
2025-10-10T14:31:44.362326Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.362329Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 282 Result { Offset: 279 Data: "... 30775 bytes ..." SourceId: "\000src_id" SeqNo: 280 WriteTimestampMS: 1760106704359 CreateTimestampMS: 1760106704358 UncompressedSize: 30701 PartitionKey: "" ExplicitHash: "" } Result { Offset: 280 Data: "... 30885 bytes ..." SourceId: "\000src_id" SeqNo: 281 WriteTimestampMS: 1760106704359 CreateTimestampMS: 1760106704358 UncompressedSize: 30811 PartitionKey: "" ExplicitHash: "" } Result { Offset: 281 Data: "... 30995 bytes ..." SourceId: "\000src_id" SeqNo: 282 WriteTimestampMS: 1760106704359 CreateTimestampMS: 1760106704359 UncompressedSize: 30921 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 3 RealReadOffset: 281 WaitQuotaTimeMs: 0 EndOffset: 282 StartOffset: 0 } Cookie: 279 }
2025-10-10T14:31:44.362351Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.362365Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.362371Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 292 partNo : 0 messageNo: 583 size 32095 offset: -1
2025-10-10T14:31:44.362372Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 68 from offset 282
2025-10-10T14:31:44.362375Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.362376Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 282 ReadOffset 282 ReadGuid f7ca643f-930d6f63-a9f1351f-bc9c3670 has messages 1
2025-10-10T14:31:44.362379Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.362390Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 read done: guid# f7ca643f-930d6f63-a9f1351f-bc9c3670, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 92686
2025-10-10T14:31:44.362395Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 response to read: guid# f7ca643f-930d6f63-a9f1351f-bc9c3670
2025-10-10T14:31:44.362577Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 Process answer. Aval parts: 0
2025-10-10T14:31:44.362866Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 grpc read done: success# 1, data# { read_request { bytes_size: 91815 } }
2025-10-10T14:31:44.362878Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 got read request: guid# 8c0c1eee-57bf0d6c-e2cae1a6-dab5e3fa
2025-10-10T14:31:44.362886Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.362912Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.362939Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.362942Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.362956Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 584  requestId: <none> cookie: 293
2025-10-10T14:31:44.362971Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.362987Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.362990Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.362999Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 293 partNo : 0 messageNo: 585 size 32205 offset: -1
2025-10-10T14:31:44.363004Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.363010Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.363095Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.363154Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.363186Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.363194Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.363198Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.363245Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.363248Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.363259Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 282 count 6 size 188442 actorID [3:7559600726884252064:2448]
2025-10-10T14:31:44.363274Z node 3 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:31:44.363284Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.363284Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 188322 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:31:44.363288Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 282 partno 0 count 6 parts 0 suffix '63' size 188442
2025-10-10T14:31:44.363289Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.363294Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 283, partNo: 0, Offset: 282 is stored on disk
2025-10-10T14:31:44.363296Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.363300Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 284, partNo: 0, Offset: 283 is stored on disk
2025-10-10T14:31:44.363310Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.363315Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 285, partNo: 0, Offset: 284 is stored on disk
2025-10-10T14:31:44.363317Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.363321Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 286, partNo: 0, Offset: 285 is stored on disk
2025-10-10T14:31:44.363324Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.363327Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 287, partNo: 0, Offset: 286 is stored on disk
2025-10-10T14:31:44.363329Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.363332Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 288, partNo: 0, Offset: 287 is stored on disk
2025-10-10T14:31:44.363395Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.363405Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:44.363412Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:44.363414Z node 3 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (5)
2025-10-10T14:31:44.363426Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 289 partNo 0
2025-10-10T14:31:44.363436Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.363447Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 289 partNo 0 FormedBlobsCount 0 NewHead: Offset 288 PartNo 0 PackedSize 31839 count 1 nextOffset 289 batches 1
2025-10-10T14:31:44.363451Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 290 partNo 0
2025-10-10T14:31:44.363455Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 290 partNo 0 FormedBlobsCount 0 NewHead: Offset 288 PartNo 0 PackedSize 63756 count 2 nextOffset 290 batches 1
2025-10-10T14:31:44.363456Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 282 EndOffset 282 newEndOffset 288 commitOffset 0 clientCommitOffset 0 cookie 68 readingFinished 0 firstRead 0
2025-10-10T14:31:44.363458Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 291 partNo 0
2025-10-10T14:31:44.363460Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 282 endOffset 288
2025-10-10T14:31:44.363462Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 291 partNo 0 FormedBlobsCount 0 NewHead: Offset 288 PartNo 0 PackedSize 95783 count 3 nextOffset 291 batches 1
2025-10-10T14:31:44.363464Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.363465Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 292 partNo 0
2025-10-10T14:31:44.363469Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 292 partNo 0 FormedBlobsCount 0 NewHead: Offset 288 PartNo 0 PackedSize 127920 count 4 nextOffset 292 batches 1
2025-10-10T14:31:44.363471Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 293 partNo 0
2025-10-10T14:31:44.363476Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 293 partNo 0 FormedBlobsCount 0 NewHead: Offset 288 PartNo 0 PackedSize 160167 count 5 nextOffset 293 batches 1
2025-10-10T14:31:44.363478Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:44.363489Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.363505Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 282, endOffset# 288, WTime# 1760106704359, sizeLag# 188442
2025-10-10T14:31:44.363507Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1TEvPartitionReady. Aval parts: 1
2025-10-10T14:31:44.363517Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 performing read request: guid# 111f519a-f0785543-54e4c6e8-29f30ed2, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 7, size# 226130, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-10T14:31:44.363529Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 7 maxSize 226130 maxTimeLagMs 0 readTimestampMs 0 readOffset 282 EndOffset 288 ClientCommitOffset 0 committedOffset 0 Guid 111f519a-f0785543-54e4c6e8-29f30ed2
2025-10-10T14:31:44.363637Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 288,5 HeadOffset 288 endOffset 288 curOffset 293 d0000000000_00000000000000000288_00000_0000000005_00000? size 160076 WTime 1760106704363
2025-10-10T14:31:44.363766Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:182: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:31:44.363775Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 586  requestId: <none> cookie: 294
2025-10-10T14:31:44.363792Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.363796Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.363802Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.363804Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.363808Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 565  requestId: <none> cookie: 283
2025-10-10T14:31:44.363812Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.363814Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 567  requestId: <none> cookie: 284
2025-10-10T14:31:44.363819Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 569  requestId: <none> cookie: 285
2025-10-10T14:31:44.363820Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.363823Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 571  requestId: <none> cookie: 286
2025-10-10T14:31:44.363828Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 574  requestId: <none> cookie: 287
2025-10-10T14:31:44.363832Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 575  requestId: <none> cookie: 288
2025-10-10T14:31:44.363836Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.363837Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.363841Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.363842Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.363843Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.363847Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.363850Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.363852Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.363853Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.363857Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.363858Z node 3 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:31:44.363868Z node 3 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 288 partNo 0 count 5 size 160076
2025-10-10T14:31:44.363868Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.363879Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.363880Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.363891Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 294 partNo : 0 messageNo: 591 size 32315 offset: -1
2025-10-10T14:31:44.363919Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 587  requestId: <none> cookie: 295
2025-10-10T14:31:44.363922Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 588  requestId: <none> cookie: 296
2025-10-10T14:31:44.363925Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 589  requestId: <none> cookie: 297
2025-10-10T14:31:44.363927Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 590  requestId: <none> cookie: 298
2025-10-10T14:31:44.363930Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.363935Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.363956Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 71 Topic 'rt3.dc1--test-topic' partition 0 user user offset 282 count 7 size 226130 endOffset 288 max time lag 0ms effective offset 282
2025-10-10T14:31:44.363970Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 71 added 1 blobs, size 188442 count 6 last offset 282, current partition end offset: 288
2025-10-10T14:31:44.363972Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 71. Send blob request.
2025-10-10T14:31:44.363980Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 282 partno 0 count 6 parts_count 0 source 1 size 188442 accessed 0 times before, last time 2025-10-10T14:31:44.000000Z
2025-10-10T14:31:44.363982Z node 3 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 71. All 1 blobs are from cache.
2025-10-10T14:31:44.363994Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:31:44.364001Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 282 partno 0 count 6 parts 0 suffix '63'
2025-10-10T14:31:44.364042Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.364047Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.364051Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.364054Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.364059Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.364174Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.364208Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 282 totakecount 6 count 6 size 188419 from pos 0 cbcount 6
2025-10-10T14:31:44.364226Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.364229Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.364236Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 295 partNo : 0 messageNo: 592 size 32425 offset: -1
2025-10-10T14:31:44.364241Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.364242Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.364245Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 296 partNo : 0 messageNo: 593 size 32535 offset: -1
2025-10-10T14:31:44.364249Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.364250Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.364254Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 297 partNo : 0 messageNo: 594 size 32645 offset: -1
2025-10-10T14:31:44.364259Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.364260Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.364264Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 298 partNo : 0 messageNo: 595 size 32755 offset: -1
2025-10-10T14:31:44.364266Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.364268Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.364276Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 282
2025-10-10T14:31:44.364283Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.364287Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.364289Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.364291Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.364293Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.364294Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.364296Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.364298Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.364325Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 596  requestId: <none> cookie: 299
2025-10-10T14:31:44.364338Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.364368Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.364371Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.364382Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 299 partNo : 0 messageNo: 597 size 32865 offset: -1
2025-10-10T14:31:44.364387Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.364391Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 288 Result { Offset: 282 Data: "... 31105 bytes ..." SourceId: "\000src_id" SeqNo: 283 WriteTimestampMS: 1760106704361 CreateTimestampMS: 1760106704359 UncompressedSize: 31031 PartitionKey: "" ExplicitHash: "" } Result { Offset: 283 Data: "... 31215 bytes ..." SourceId: "\000src_id" SeqNo: 284 WriteTimestampMS: 1760106704361 CreateTimestampMS: 1760106704359 UncompressedSize: 31141 PartitionKey: "" ExplicitHash: "" } Result { Offset: 284 Data: "... 31325 bytes ..." SourceId: "\000src_id" SeqNo: 285 WriteTimestampMS: 1760106704361 CreateTimestampMS: 1760106704359 UncompressedSize: 31251 PartitionKey: "" ExplicitHash: "" } Result { Offset: 285 Data: "... 31435 bytes ..." SourceId: "\000src_id" SeqNo: 286 WriteTimestampMS: 1760106704361 CreateTimestampMS: 1760106704360 UncompressedSize: 31361 PartitionKey: "" ExplicitHash: "" } Result { Offset: 286 Data: "... 31545 bytes ..." SourceId: "\000src_id" SeqNo: 287 WriteTimestampMS: 1760106704361 CreateTimestampMS: 1760106704360 UncompressedSize: 31471 PartitionKey: "" ExplicitHash: "" } Result { Offset: 287 Data: "... 31655 bytes ..." SourceId: "\000src_id" SeqNo: 288 WriteTimestampMS: 1760106704361 CreateTimestampMS: 1760106704360 UncompressedSize: 31581 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 18446744073709551526 RealReadOffset: 287 WaitQuotaTimeMs: 0 EndOffset: 288 StartOffset: 0 } Cookie: 282 }
2025-10-10T14:31:44.364394Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.364398Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.364436Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 69 from offset 288
2025-10-10T14:31:44.364441Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 288 ReadOffset 288 ReadGuid 111f519a-f0785543-54e4c6e8-29f30ed2 has messages 1
2025-10-10T14:31:44.364444Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.364460Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 read done: guid# 111f519a-f0785543-54e4c6e8-29f30ed2, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 188209
2025-10-10T14:31:44.364465Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 response to read: guid# 111f519a-f0785543-54e4c6e8-29f30ed2
2025-10-10T14:31:44.364468Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.364470Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.364484Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 598  requestId: <none> cookie: 300
2025-10-10T14:31:44.364490Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.364498Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.364503Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.364509Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 300 partNo : 0 messageNo: 599 size 32975 offset: -1
2025-10-10T14:31:44.364512Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:44.364516Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:44.364691Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 Process answer. Aval parts: 0
2025-10-10T14:31:44.364998Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 288 count 5 size 160076 actorID [3:7559600726884252064:2448]
2025-10-10T14:31:44.365010Z node 3 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:31:44.365020Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 159960 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:31:44.365020Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 288 partno 0 count 5 parts 0 suffix '63' size 160076
2025-10-10T14:31:44.365026Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.365029Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 grpc read done: success# 1, data# { read_request { bytes_size: 92686 } }
2025-10-10T14:31:44.365033Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 289, partNo: 0, Offset: 288 is stored on disk
2025-10-10T14:31:44.365037Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.365043Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 290, partNo: 0, Offset: 289 is stored on disk
2025-10-10T14:31:44.365046Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.365049Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 291, partNo: 0, Offset: 290 is stored on disk
2025-10-10T14:31:44.365051Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.365055Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 292, partNo: 0, Offset: 291 is stored on disk
2025-10-10T14:31:44.365057Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.365060Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 293, partNo: 0, Offset: 292 is stored on disk
2025-10-10T14:31:44.365067Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 got read request: guid# f40be367-e2c7a0c5-cb9a04f0-6d694e16
2025-10-10T14:31:44.365082Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:44.365086Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 288 EndOffset 288 newEndOffset 293 commitOffset 0 clientCommitOffset 0 cookie 69 readingFinished 0 firstRead 0
2025-10-10T14:31:44.365089Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 288 endOffset 293
2025-10-10T14:31:44.365091Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:44.365093Z node 3 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (7)
2025-10-10T14:31:44.365096Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 288, endOffset# 293, WTime# 1760106704361, sizeLag# 160076
2025-10-10T14:31:44.365098Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1TEvPartitionReady. Aval parts: 1
2025-10-10T14:31:44.365105Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 performing read request: guid# 55709c55-2ae2db98-c96ba759-c33811a3, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 6, size# 192091, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-10T14:31:44.365106Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 294 partNo 0
2025-10-10T14:31:44.365115Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 6 maxSize 192091 maxTimeLagMs 0 readTimestampMs 0 readOffset 288 EndOffset 293 ClientCommitOffset 0 committedOffset 0 Guid 55709c55-2ae2db98-c96ba759-c33811a3
2025-10-10T14:31:44.365126Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 294 partNo 0 FormedBlobsCount 0 NewHead: Offset 293 PartNo 0 PackedSize 32389 count 1 nextOffset 294 batches 1
2025-10-10T14:31:44.365131Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 295 partNo 0
2025-10-10T14:31:44.365136Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 295 partNo 0 FormedBlobsCount 0 NewHead: Offset 293 PartNo 0 PackedSize 64856 count 2 nextOffset 295 batches 1
2025-10-10T14:31:44.365139Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 296 partNo 0
2025-10-10T14:31:44.365143Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 296 partNo 0 FormedBlobsCount 0 NewHead: Offset 293 PartNo 0 PackedSize 97433 count 3 nextOffset 296 batches 1
2025-10-10T14:31:44.365146Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 297 partNo 0
2025-10-10T14:31:44.365150Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 297 partNo 0 FormedBlobsCount 0 NewHead: Offset 293 PartNo 0 PackedSize 130120 count 4 nextOffset 297 batches 1
2025-10-10T14:31:44.365153Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 298 partNo 0
2025-10-10T14:31:44.365157Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 298 partNo 0 FormedBlobsCount 0 NewHead: Offset 293 PartNo 0 PackedSize 162917 count 5 nextOffset 298 batches 1
2025-10-10T14:31:44.365161Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 299 partNo 0
2025-10-10T14:31:44.365164Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 299 partNo 0 FormedBlobsCount 0 NewHead: Offset 293 PartNo 0 PackedSize 195824 count 6 nextOffset 299 batches 1
2025-10-10T14:31:44.365168Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 300 partNo 0
2025-10-10T14:31:44.365172Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 300 partNo 0 FormedBlobsCount 0 NewHead: Offset 293 PartNo 0 PackedSize 228841 count 7 nextOffset 300 batches 1
2025-10-10T14:31:44.365176Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:44.365353Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 293,7 HeadOffset 293 endOffset 293 curOffset 300 d0000000000_00000000000000000293_00000_0000000007_00000? size 228688 WTime 1760106704364
2025-10-10T14:31:44.365546Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:182: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:31:44.365560Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 577  requestId: <none> cookie: 289
2025-10-10T14:31:44.365578Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 580  requestId: <none> cookie: 290
2025-10-10T14:31:44.365584Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 581  requestId: <none> cookie: 291
2025-10-10T14:31:44.365589Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 583  requestId: <none> cookie: 292
2025-10-10T14:31:44.365595Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 585  requestId: <none> cookie: 293
2025-10-10T14:31:44.365595Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.365603Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.365606Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.365607Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.365610Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.365611Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.365614Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.365619Z node 3 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:31:44.365629Z node 3 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 293 partNo 0 count 7 size 228688
2025-10-10T14:31:44.365680Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 72 Topic 'rt3.dc1--test-topic' partition 0 user user offset 288 count 6 size 192091 endOffset 293 max time lag 0ms effective offset 288
2025-10-10T14:31:44.365691Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 72 added 1 blobs, size 160076 count 5 last offset 288, current partition end offset: 293
2025-10-10T14:31:44.365694Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 72. Send blob request.
2025-10-10T14:31:44.365701Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 288 partno 0 count 5 parts_count 0 source 1 size 160076 accessed 0 times before, last time 2025-10-10T14:31:44.000000Z
2025-10-10T14:31:44.365706Z node 3 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 72. All 1 blobs are from cache.
2025-10-10T14:31:44.365714Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:31:44.365716Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 288 partno 0 count 5 parts 0 suffix '63'
2025-10-10T14:31:44.365916Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 288 totakecount 5 count 5 size 160053 from pos 0 cbcount 5
2025-10-10T14:31:44.365947Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 288
2025-10-10T14:31:44.366034Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 293 Result { Offset: 288 Data: "... 31765 bytes ..." SourceId: "\000src_id" SeqNo: 289 WriteTimestampMS: 1760106704363 CreateTimestampMS: 1760106704361 UncompressedSize: 31691 PartitionKey: "" ExplicitHash: "" } Result { Offset: 289 Data: "... 31875 bytes ..." SourceId: "\000src_id" SeqNo: 290 WriteTimestampMS: 1760106704363 CreateTimestampMS: 1760106704361 UncompressedSize: 31801 PartitionKey: "" ExplicitHash: "" } Result { Offset: 290 Data: "... 31985 bytes ..." SourceId: "\000src_id" SeqNo: 291 WriteTimestampMS: 1760106704363 CreateTimestampMS: 1760106704361 UncompressedSize: 31911 PartitionKey: "" ExplicitHash: "" } Result { Offset: 291 Data: "... 32095 bytes ..." SourceId: "\000src_id" SeqNo: 292 WriteTimestampMS: 1760106704363 CreateTimestampMS: 1760106704361 UncompressedSize: 32021 PartitionKey: "" ExplicitHash: "" } Result { Offset: 292 Data: "... 32205 bytes ..." SourceId: "\000src_id" SeqNo: 293 WriteTimestampMS: 1760106704363 CreateTimestampMS: 1760106704362 UncompressedSize: 32131 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 18446744073709551557 RealReadOffset: 292 WaitQuotaTimeMs: 0 EndOffset: 293 StartOffset: 0 } Cookie: 288 }
2025-10-10T14:31:44.366075Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 70 from offset 293
2025-10-10T14:31:44.366080Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 293 ReadOffset 293 ReadGuid 55709c55-2ae2db98-c96ba759-c33811a3 has messages 1
2025-10-10T14:31:44.366101Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 read done: guid# 55709c55-2ae2db98-c96ba759-c33811a3, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 159888
2025-10-10T14:31:44.366106Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 response to read: guid# 55709c55-2ae2db98-c96ba759-c33811a3
2025-10-10T14:31:44.366226Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 Process answer. Aval parts: 0
2025-10-10T14:31:44.366924Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 293 count 7 size 228688 actorID [3:7559600726884252064:2448]
2025-10-10T14:31:44.366936Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 grpc read done: success# 1, data# { read_request { bytes_size: 188209 } }
2025-10-10T14:31:44.366938Z node 3 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:31:44.366948Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 228564 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:31:44.366953Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.366954Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 293 partno 0 count 7 parts 0 suffix '63' size 228688
2025-10-10T14:31:44.366959Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 294, partNo: 0, Offset: 293 is stored on disk
2025-10-10T14:31:44.366962Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.366967Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 295, partNo: 0, Offset: 294 is stored on disk
2025-10-10T14:31:44.366969Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 got read request: guid# e7aba6d1-19fff724-3de5cbec-6f346f9e
2025-10-10T14:31:44.366969Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.366973Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 296, partNo: 0, Offset: 295 is stored on disk
2025-10-10T14:31:44.366976Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.366978Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 297, partNo: 0, Offset: 296 is stored on disk
2025-10-10T14:31:44.366980Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.366983Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 298, partNo: 0, Offset: 297 is stored on disk
2025-10-10T14:31:44.366985Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.366988Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 299, partNo: 0, Offset: 298 is stored on disk
2025-10-10T14:31:44.366991Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:44.366994Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 300, partNo: 0, Offset: 299 is stored on disk
2025-10-10T14:31:44.367021Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:44.367023Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:44.367025Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:44.367029Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:182: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:31:44.367034Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 293 EndOffset 293 newEndOffset 300 commitOffset 0 clientCommitOffset 0 cookie 70 readingFinished 0 firstRead 0
2025-10-10T14:31:44.367037Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 591  requestId: <none> cookie: 294
2025-10-10T14:31:44.367037Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 293 endOffset 300
2025-10-10T14:31:44.367044Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 293, endOffset# 300, WTime# 1760106704363, sizeLag# 228688
2025-10-10T14:31:44.367044Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 592  requestId: <none> cookie: 295
2025-10-10T14:31:44.367046Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1TEvPartitionReady. Aval parts: 1
2025-10-10T14:31:44.367049Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 593  requestId: <none> cookie: 296
2025-10-10T14:31:44.367052Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 performing read request: guid# bd585601-849fc65e-acfb573a-76f28c2, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 8, size# 274425, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-10T14:31:44.367054Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 594  requestId: <none> cookie: 297
2025-10-10T14:31:44.367059Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 595  requestId: <none> cookie: 298
2025-10-10T14:31:44.367063Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 597  requestId: <none> cookie: 299
2025-10-10T14:31:44.367064Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.367067Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 599  requestId: <none> cookie: 300
2025-10-10T14:31:44.367069Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.367073Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.367077Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.367078Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 8 maxSize 274425 maxTimeLagMs 0 readTimestampMs 0 readOffset 293 EndOffset 300 ClientCommitOffset 0 committedOffset 0 Guid bd585601-849fc65e-acfb573a-76f28c2
2025-10-10T14:31:44.367081Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.367085Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.367091Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:44.367108Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.367112Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.367128Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 73 Topic 'rt3.dc1--test-topic' partition 0 user user offset 293 count 8 size 274425 endOffset 300 max time lag 0ms effective offset 293
2025-10-10T14:31:44.367143Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 73 added 1 blobs, size 228688 count 7 last offset 293, current partition end offset: 300
2025-10-10T14:31:44.367146Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 73. Send blob request.
2025-10-10T14:31:44.367152Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 293 partno 0 count 7 parts_count 0 source 1 size 228688 accessed 0 times before, last time 2025-10-10T14:31:44.000000Z
2025-10-10T14:31:44.367159Z node 3 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 73. All 1 blobs are from cache.
2025-10-10T14:31:44.367167Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:31:44.367169Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 293 partno 0 count 7 parts 0 suffix '63'
2025-10-10T14:31:44.367242Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 293 totakecount 7 count 7 size 228665 from pos 0 cbcount 7
2025-10-10T14:31:44.367265Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 293
2025-10-10T14:31:44.367352Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 300 Result { Offset: 293 Data: "... 32315 bytes ..." SourceId: "\000src_id" SeqNo: 294 WriteTimestampMS: 1760106704364 CreateTimestampMS: 1760106704362 UncompressedSize: 32241 PartitionKey: "" ExplicitHash: "" } Result { Offset: 294 Data: "... 32425 bytes ..." SourceId: "\000src_id" SeqNo: 295 WriteTimestampMS: 1760106704364 CreateTimestampMS: 1760106704362 UncompressedSize: 32351 PartitionKey: "" ExplicitHash: "" } Result { Offset: 295 Data: "... 32535 bytes ..." SourceId: "\000src_id" SeqNo: 296 WriteTimestampMS: 1760106704364 CreateTimestampMS: 1760106704362 UncompressedSize: 32461 PartitionKey: "" ExplicitHash: "" } Result { Offset: 296 Data: "... 32645 bytes ..." SourceId: "\000src_id" SeqNo: 297 WriteTimestampMS: 1760106704364 CreateTimestampMS: 1760106704362 UncompressedSize: 32571 PartitionKey: "" ExplicitHash: "" } Result { Offset: 297 Data: "... 32755 bytes ..." SourceId: "\000src_id" SeqNo: 298 WriteTimestampMS: 1760106704364 CreateTimestampMS: 1760106704363 UncompressedSize: 32681 PartitionKey: "" ExplicitHash: "" } Result { Offset: 298 Data: "... 32865 bytes ..." SourceId: "\000src_id" SeqNo: 299 WriteTimestampMS: 1760106704364 CreateTimestampMS: 1760106704363 UncompressedSize: 32791 PartitionKey: "" ExplicitHash: "" } Result { Offset: 299 Data: "... 32975 bytes ..." SourceId: "\000src_id" SeqNo: 300 WriteTimestampMS: 1760106704364 CreateTimestampMS: 1760106704363 UncompressedSize: 32901 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 18446744073709551495 RealReadOffset: 299 WaitQuotaTimeMs: 0 EndOffset: 300 StartOffset: 0 } Cookie: 293 }
2025-10-10T14:31:44.367402Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 71 from offset 300
2025-10-10T14:31:44.367406Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 300 ReadOffset 300 ReadGuid bd585601-849fc65e-acfb573a-76f28c2 has messages 1
2025-10-10T14:31:44.367437Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 read done: guid# bd585601-849fc65e-acfb573a-76f28c2, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 228410
2025-10-10T14:31:44.367443Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 response to read: guid# bd585601-849fc65e-acfb573a-76f28c2
2025-10-10T14:31:44.367654Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 Process answer. Aval parts: 0
2025-10-10T14:31:44.368206Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 grpc read done: success# 1, data# { read_request { bytes_size: 159888 } }
2025-10-10T14:31:44.368255Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 got read request: guid# 5cfa33ea-e0c520b8-be275a86-28711214
2025-10-10T14:31:44.370193Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_3_1_16103991684086808299_v1 grpc read done: success# 0, data# {  }
2025-10-10T14:31:44.370196Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:125: session cookie 1 consumer shared/user session shared/user_3_1_16103991684086808299_v1 grpc read failed
2025-10-10T14:31:44.370201Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:92: session cookie 1 consumer shared/user session shared/user_3_1_16103991684086808299_v1 grpc closed
2025-10-10T14:31:44.370208Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 1 consumer shared/user session shared/user_3_1_16103991684086808299_v1 is DEAD
2025-10-10T14:31:44.370392Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 2 consumer shared/user session shared/user_3_2_4696609365094200052_v1 grpc read done: success# 0, data# {  }
2025-10-10T14:31:44.370395Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:125: session cookie 2 consumer shared/user session shared/user_3_2_4696609365094200052_v1 grpc read failed
2025-10-10T14:31:44.370399Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:92: session cookie 2 consumer shared/user session shared/user_3_2_4696609365094200052_v1 grpc closed
2025-10-10T14:31:44.370406Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 2 consumer shared/user session shared/user_3_2_4696609365094200052_v1 is DEAD
2025-10-10T14:31:44.370528Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 grpc read done: success# 0, data# {  }
2025-10-10T14:31:44.370530Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:125: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 grpc read failed
2025-10-10T14:31:44.370533Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:92: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 grpc closed
2025-10-10T14:31:44.370540Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 3 consumer shared/user session shared/user_3_3_5041631794065863042_v1 is DEAD
2025-10-10T14:31:44.370688Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_3_3_5041631794065863042_v1
2025-10-10T14:31:44.370695Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [3:7559600731179219704:2516] destroyed
2025-10-10T14:31:44.370710Z node 3 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_3_3_5041631794065863042_v1
2025-10-10T14:31:44.370812Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read done: success: 0 data: 
2025-10-10T14:31:44.370814Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc read failed
2025-10-10T14:31:44.370820Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 grpc closed
2025-10-10T14:31:44.370824Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2 sessionId: src_id|cf451f1-c205e716-2df7cd75-d9af365e_0 is DEAD
2025-10-10T14:31:44.371041Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-10-10T14:31:44.371082Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [3:7559600731179219726:2502] destroyed
2025-10-10T14:31:44.371092Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-10-10T14:31:44.371098Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:44.371101Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:44.371103Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:44.454051Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:44.454074Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:44.454077Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:44.554396Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:44.554416Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:44.554418Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:44.654703Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:44.654724Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:44.654727Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:30:55.311313Z :WriteSessionCloseWaitsForWrites INFO: Random seed for debugging is 1760106655311310
2025-10-10T14:30:55.396934Z node 1 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[1:7559600523792315928:2080];send_to=[0:7307199536658146131:7762515];
2025-10-10T14:30:55.397254Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-10-10T14:30:55.400156Z node 1 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-10-10T14:30:55.400792Z node 2 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[2:7559600522902580125:2159];send_to=[0:7307199536658146131:7762515];
2025-10-10T14:30:55.400863Z node 2 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
test_client.cpp: SetPath # /home/runner/.ya/build/build_root/z96o/002b39/r3tmp/tmp3YsHpu/pdisk_1.dat
2025-10-10T14:30:55.402768Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-10-10T14:30:55.425300Z node 1 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-10T14:30:55.427699Z node 2 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-10T14:30:55.428794Z node 1 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
TServer::EnableGrpc on GrpcPort 12003, node 1
2025-10-10T14:30:55.444471Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:190: distributable config is empty, broken or outdated, will use file: /home/runner/.ya/build/build_root/z96o/002b39/r3tmp/yandexfff2rs.tmp
2025-10-10T14:30:55.444482Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:196: will try to initialize from file: /home/runner/.ya/build/build_root/z96o/002b39/r3tmp/yandexfff2rs.tmp
2025-10-10T14:30:55.444535Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:202: successfully initialized from file: /home/runner/.ya/build/build_root/z96o/002b39/r3tmp/yandexfff2rs.tmp
2025-10-10T14:30:55.444567Z node 1 :NET_CLASSIFIER ERROR: net_classifier.cpp:228: got bad distributable configuration
2025-10-10T14:30:55.448176Z INFO: TTestServer started on Port 18125 GrpcPort 12003
TClient is connected to server localhost:18125
PQClient connected to localhost:12003
WaitRootIsUp 'Root'...
TClient::Ls request: Root
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "Root"
    PathId: 1
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 1
    CreateStep: 0
    ParentPathId: 1
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 1
      SubDomainVersion: 0
      SecurityStateVersion: 0
    }
    ChildrenExist: false
  }
  Children {
    Name: ".sys"
    PathId: 18446744073709551615
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 0
    CreateStep: 0
    ParentPathId: 18446744073709551615
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 0
      Pl...
(TRUNCATED)
WaitRootIsUp 'Root' success.
2025-10-10T14:30:55.499103Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-10T14:30:55.499133Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-10T14:30:55.500567Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Connecting -> Connected
2025-10-10T14:30:55.502154Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-10T14:30:55.502171Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-10T14:30:55.503119Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpAlterSubDomain, opId: 281474976720657:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_alter_subdomain.cpp:311)
2025-10-10T14:30:55.503281Z node 1 :HIVE WARN: hive_impl.cpp:811: HIVE#72057594037968897 Handle TEvInterconnect::TEvNodeConnected, NodeId 2 Cookie 2
2025-10-10T14:30:55.503526Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Connecting -> Connected
waiting...
waiting...
waiting...
waiting...
2025-10-10T14:30:55.581694Z node 1 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-10-10T14:30:55.621220Z node 2 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-10-10T14:30:55.758803Z node 1 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:566: Compilation failed, self: [1:7559600523792316821:2318], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-10T14:30:55.758811Z node 2 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:566: Compilation failed, self: [2:7559600522902580306:2289], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-10T14:30:55.758949Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2408: SessionId: ydb://session/3?node_id=1&id=ZThiNWMwMDEtZjI3YzU2NzYtNmI2MmJjMGEtNzMwZTlmMjg=, ActorId: [1:7559600523792316818:2316], ActorState: ExecuteState, TraceId: 01k778gbz17x0fcer0qj3a07eb, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-10T14:30:55.758937Z node 2 :KQP_SESSION WARN: kqp_session_actor.cpp:2408: SessionId: ydb://session/3?node_id=2&id=NWJhZjJjNmMtOTE5ZWYyZWMtM2MwMWMyMTQtYjhkYzRlM2Y=, ActorId: [2:7559600522902580304:2288], ActorState: ExecuteState, TraceId: 01k778gbzc0v2me0ecdd3f8scs, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-10T14:30:55.759367Z node 1 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-10-10T14:30:55.759373Z node 2 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-10-10T14:30:55.759654Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720661:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-10T14:30:55.778504Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720662:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-10T14:30:55.795058Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720663:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
=== Init DC: UPSERT INTO `/Root/PQ/Config/V2/Cluster` (name, balancer, local, enabled, weight) VALUES ("dc1", "localhost:12003", true, true, 1000), ("dc2", "dc2.logbroker.yandex.net", false, false, 1000);
2025-10-10T14:30:55.833949Z node 1 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976720664. Ctx: { TraceId: 01k778gc205nfyvxywkks5j1bj, Database: , SessionId: ydb://session/3?node_id=1&id=ODhlM2RhNDgtYzYxOWFhOTMtYmUzMzkyMDQtM2Q2ZTVmYzk=, PoolId: , DatabaseId: /Root}. Database not set, use /Root
=== CheckClustersList. Subcribe to ClusterTracker from [1:7559600523792317198:2885] 
2025-10-10T14:30:56.398484Z node 1 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-10-10T14:30:56.402579Z node 2 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-10-10T14:31:00.397198Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[1:7559600523792315928:2080];send_to=[0:7307199536658146131:7762515];
2025-10-10T14:31:00.397231Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
2025-10-10T14:31:00.400733Z node 2 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[2:7559600522902580125:2159];send_to=[0:7307199536658146131:7762515];
2025-10-10T14:31:00.400770Z node 2 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
=== CheckClustersList. Ok
2025-10-10T14:31:00.923666Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720676:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
waiting...
PQ Client: create topic: rt3.dc1--test-topic with 1 partitions
CallPersQueueGRPC request to localhost:12003
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-10T14:31:00.942214Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
CallPersQueueGRPC request to localhost:12003
MetaRequest {
  CmdCreateTopic {
    Topic: "rt3.dc1--test-topic"
    NumPartitions: 1
    Config {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
  }
}
CallPersQueueGRPC response:
Status: 129
ProxyErrorCode: 53
SchemeStatus: 1
FlatTxId {
  TxId: 281474976720677
  SchemeShardTabletId: 72057594046644480
  PathId: 9
}
ErrorCode: OK
AddTopic: rt3.dc1--test-topic
===Run query:``DECLARE $version as Int64; DECLARE $path AS Utf8; DECLARE $cluster as Utf8; UPSERT INTO `/Root/PQ/Config/V2/Topics` (path, dc) VALUES ($path, $cluster); UPSERT INTO `/Root/PQ/Config/V2/Versions` (name, version) VALUES ("Topics", $version);`` with topic = test-topic, dc = dc1
2025-10-10T14:31:00.948108Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][] pipe [1:7559600545267154190:3182] connected; active server actors: 1
2025-10-10T14:31:00.948188Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1517: [72075186224037893][rt3.dc1--test-topic] updating configuration. Deleted partitions []. Added partitions [0]
2025-10-10T14:31:00.948278Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:940: [72075186224037893][rt3.dc1--test-topic] Discovered subdomain [OwnerId: 72057594046644480, LocalPathId: 1] state, outOfSpace = 0 at RB 72075186224037893
2025-10-10T14:31:00.948602Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:138: [72075186224037893][rt3.dc1--test-topic] BALANCER INIT DONE for rt3.dc1--test-topic: (0, 72075186224037892) 
2025-10-10T14:31:00.951683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:00.952211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:00.952261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:784: [PQ: 72075186224037892] no config, start with empty partitions and default config
2025-10-10T14:31:00.952277Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:00.952290Z node 2 :PERSQUEUE INFO: pq_impl.cpp:609: [PQ: 72075186224037892] doesn't have tx writes info
2025-10-10T14:31:00.952364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600545267154210:2438], now have 1 active actors on pipe
2025-10-10T14:31:00.952372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600545267154189:3181], now have 1 active actors on pipe
2025-10-10T14:31:00.952424Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1
2025-10-10T14:31:00.952542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-10T14:31:00.953406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-10T14:31:00.955700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600545267154247:3228], now have 1 active actors on pipe
2025-10-10T14:31:00.955769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-10T14:31:00.956590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-10T14:31:00.956833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:00.956871Z node 2 :PERSQUEUE DEBUG: partition.cpp:1277: [72075186224037892][Partition][0][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-10-10T14:31:00.956923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:00.956996Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600544377417338:2381]
2025-10-10T14:31:00.957788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:00.957799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:00.957805Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1 [2:7559600544377417338:2381]
2025-10-10T14:31:00.957812Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-10-10T14:31:00.958056Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 1
2025-10-10T14:31:00.958067Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:00.958090Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:00.958096Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:00.958099Z node 2 :PERSQUEUE DEBUG: partition.cpp:2345: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-10T14:31:00.958100Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:00.958101Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:00.958102Z node 2 :PERSQUEUE DEBUG: partition.cpp:2345: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-10T14:31:00.958111Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:00.958207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-10T14:31:00.958242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:31:00.966169Z node 1 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976720678. Ctx: { TraceId: 01k778gh2jffmjrxzbtwm5v7d0, Database: , SessionId: ydb://session/3?node_id=1&id=YmNkNDJkMGItYjg2YjYzOC01NmIwNjZkZS1kNWZjMDIzNg==, PoolId: , DatabaseId: /Root}. Database not set, use /Root
===Query complete
2025-10-10T14:31:00.959235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
TClient::Ls request: /Root/PQ/rt3.dc1--test-topic
2025-10-10T14:31:00.959266Z node 2 :PERSQUEUE DEBUG: partition.cpp:1381: [72075186224037892][Partition][0][StateIdle] Handle TEvPQ::TEvTxCommit Step 1760106661005, TxId 281474976720677
2025-10-10T14:31:00.959271Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:00.959273Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:00.959298Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:00.959354Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:31:00.959874Z node 2 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:31:00.959931Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:31:00.959938Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:00.959940Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:00.959941Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:00.959946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:31:00.960045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:395: [PQ: 72075186224037892] Apply new config PartitionConfig { LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 } PartitionIds: 0 TopicName: "rt3.dc1--test-topic" Version: 0 LocalDC: true Codecs { Ids: 0 Ids: 1 Ids: 2 Codecs: "raw" Codecs: "gzip" Codecs: "lzop" } TopicPath: "/Root/PQ/rt3.dc1--test-topic" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } Consumers { Name: "user" ReadFromTimestampsMs: 0 FormatVersion: 0 Version: 0 Generation: 0 } MonitoringProjectId: ""
2025-10-10T14:31:00.960062Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:00.960096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-10T14:31:00.961046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-10T14:31:00.961061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-10T14:31:00.961443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976720677
    CreateStep: 1760106661005
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: ...
(TRUNCATED)
GetTopicVersionFromPath:  record Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976720677
    CreateStep: 1760106661005
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      YdbDatabasePath: "/Root"
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
    Partitions {
      PartitionId: 0
      TabletId: 72075186224037892
      Status: Active
    }
    AlterVersion: 1
    BalancerTabletID: 72075186224037893
    NextPartitionId: 1
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 1
      PlanResolution: 7
      Coordinators: 72057594046316545
      TimeCastBucketsPerMediator: 2
      Mediators: 72057594046382081
    }
    DomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    PathsInside: 8
    PathsLimit: 10000
    ShardsInside: 6
    ShardsLimit: 200000
    ResourcesDomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    DiskSpaceUsage {
      Tables {
        TotalSize: 0
        DataSize: 0
        IndexSize: 0
      }
      Topics {
        ReserveSize: 0
        AccountSize: 0
        DataSize: 0
        UsedReserveSize: 0
      }
    }
    PQPartitionsInside: 1
    PQPartitionsLimit: 1000000
    SchemeLimits {
      MaxDepth: 32
      MaxPaths: 10000
      MaxChildrenInDir: 100000
      MaxAclBytesSize: 10240
      MaxTableColumns: 200
      MaxTableColumnNameLength: 255
      MaxTableKeyColumns: 30
      MaxTableIndices: 20
      MaxShards: 200000
      MaxShardsInPath: 35000
      MaxConsistentCopyTargets: 10000
      MaxPathElementLength: 255
      ExtraPathSymbolsAllowed: "!\"#$%&\'()*+,-.:;<=>?@[\\]^_`{|}~"
      MaxPQPartitions: 1000000
      MaxTableCdcStreams: 5
      MaxExports: 10
      MaxImports: 10
      MaxColumnTableColumns: 10000
    }
  }
}
Path: "/Root/PQ/rt3.dc1--test-topic"
 name rt3.dc1--test-topic version1
CallPersQueueGRPC request to localhost:12003
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-10T14:31:00.972643Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-10-10T14:31:01.058212Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:01.058229Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:01.058232Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:01.158566Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:01.158585Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:01.158598Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:01.258916Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:01.258931Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:01.258934Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:01.359271Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:01.359288Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:01.359291Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:01.459611Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:01.459632Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:01.459635Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:12003
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-10T14:31:01.473777Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-10-10T14:31:01.559979Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:01.560000Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:01.560003Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:01.660313Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:01.660336Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:01.660338Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:01.760646Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:01.760661Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:01.760664Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:01.861016Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:01.861030Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:01.861033Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:01.961365Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:01.961378Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:01.961381Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:12003
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-10T14:31:01.975534Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--test-topic"
      NumPartitions: 1
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        TopicPath: "/Root/PQ/rt3.dc1--test-topic"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Version: 0
        }
      }
      ErrorCode: OK
    }
  }
}
=== Topic created, have version: 1
2025-10-10T14:31:01.976606Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: try to update token
2025-10-10T14:31:01.976810Z :INFO: [] MessageGroupId [src] SessionId [] Write session: Do CDS request
2025-10-10T14:31:01.976814Z :INFO: [] MessageGroupId [src] SessionId [] Start write session. Will connect to endpoint: localhost:12003
2025-10-10T14:31:01.977235Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:01.977245Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1
2025-10-10T14:31:01.978694Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src" }
2025-10-10T14:31:01.978935Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src" }
2025-10-10T14:31:01.978973Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1 topic: "test-topic" message_group_id: "src" from ipv6:[::1]:48634
2025-10-10T14:31:01.978980Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:48634 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:01.978983Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:01.979317Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1 sessionId:  describe result for acl check
2025-10-10T14:31:01.979349Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:01.979353Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:01.979354Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:01.979358Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600549562121710:2471] (SourceId=src, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:01.979799Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600549562121710:2471] (SourceId=src, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:02.002815Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [1:7559600549562121710:2471] (SourceId=src, PreferedPartition=(NULL)) RequestPQRB
2025-10-10T14:31:02.002918Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559600553857089038:2471] connected; active server actors: 1
2025-10-10T14:31:02.002944Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [1:7559600549562121710:2471] (SourceId=src, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=src
2025-10-10T14:31:02.002947Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600549562121710:2471] (SourceId=src, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:02.003009Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559600553857089038:2471] disconnected; active server actors: 1
2025-10-10T14:31:02.003014Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559600553857089038:2471] disconnected no session
2025-10-10T14:31:02.023207Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600549562121710:2471] (SourceId=src, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:02.023226Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600549562121710:2471] (SourceId=src, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-10-10T14:31:02.023230Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600549562121710:2471] (SourceId=src, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:02.023238Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:02.023515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600553857089056:2471], now have 1 active actors on pipe
2025-10-10T14:31:02.023559Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1
2025-10-10T14:31:02.023615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:02.023629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:02.023667Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src|b4003bb9-301d23db-2e94406b-6f57d782_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src
2025-10-10T14:31:02.023682Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:02.023690Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:02.023692Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:02.023703Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:02.023722Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:02.023742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:02.023924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:02.023933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:02.023947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:02.024057Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1 partition: 0 MaxSeqNo: 0 sessionId: src|b4003bb9-301d23db-2e94406b-6f57d782_0
2025-10-10T14:31:02.024323Z :INFO: [] MessageGroupId [src] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1760106662024 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-10T14:31:02.024352Z :INFO: [] MessageGroupId [src] SessionId [] Write session established. Init response: session_id: "src|b4003bb9-301d23db-2e94406b-6f57d782_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:02.024455Z :INFO: [] MessageGroupId [src] SessionId [src|b4003bb9-301d23db-2e94406b-6f57d782_0] Write session: close. Timeout = 0 ms
2025-10-10T14:31:02.024462Z :INFO: [] MessageGroupId [src] SessionId [src|b4003bb9-301d23db-2e94406b-6f57d782_0] Write session will now close
2025-10-10T14:31:02.024468Z :DEBUG: [] MessageGroupId [src] SessionId [src|b4003bb9-301d23db-2e94406b-6f57d782_0] Write session: aborting
2025-10-10T14:31:02.024613Z :INFO: [] MessageGroupId [src] SessionId [src|b4003bb9-301d23db-2e94406b-6f57d782_0] Write session: gracefully shut down, all writes complete
2025-10-10T14:31:02.024618Z :DEBUG: [] MessageGroupId [src] SessionId [src|b4003bb9-301d23db-2e94406b-6f57d782_0] Write session: destroy
2025-10-10T14:31:02.024729Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId: src|b4003bb9-301d23db-2e94406b-6f57d782_0 grpc read done: success: 0 data: 
2025-10-10T14:31:02.024736Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 1 sessionId: src|b4003bb9-301d23db-2e94406b-6f57d782_0 grpc read failed
2025-10-10T14:31:02.024742Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 1 sessionId: src|b4003bb9-301d23db-2e94406b-6f57d782_0 grpc closed
2025-10-10T14:31:02.024746Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1 sessionId: src|b4003bb9-301d23db-2e94406b-6f57d782_0 is DEAD
2025-10-10T14:31:02.024954Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-10-10T14:31:02.025071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [1:7559600553857089056:2471] destroyed
2025-10-10T14:31:02.025088Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-10-10T14:31:02.025094Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:02.025097Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:02.025098Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
Session was created
2025-10-10T14:31:02.061740Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:02.061759Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
>>> Ready to answer: ok
2025-10-10T14:31:02.061762Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:02.080420Z :INFO: [/Root] [] [] Start federated write session to database 'dc1' (previous was <empty>) FederationState: { Status: SUCCESS SelfLocation: "fancy_datacenter" DbInfos: [ { name: "dc1" path: "/Root" id: "account-dc1" endpoint: "localhost:12003" location: "dc1" status: AVAILABLE weight: 1000 } { name: "dc2" path: "/Root" id: "account-dc2" endpoint: "localhost:12003" location: "dc2" status: AVAILABLE weight: 500 } { name: "dc3" path: "/Root" id: "account-dc3" endpoint: "localhost:12003" location: "dc3" status: AVAILABLE weight: 500 } ] ControlPlaneEndpoint: cp.logbroker-federation:2135 }
2025-10-10T14:31:02.082513Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: try to update token
2025-10-10T14:31:02.082709Z :INFO: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Start write session. Will connect to nodeId: 0
2025-10-10T14:31:02.126163Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: write to message_group: src_id
2025-10-10T14:31:02.126297Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:02.126312Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2
2025-10-10T14:31:02.127903Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: send init request: init_request { path: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:02.128044Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: OnWriteDone gRpcStatusCode: 0
2025-10-10T14:31:02.128154Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId:  grpc read done: success: 1 data: init_request { path: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:02.128198Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2 path: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40546
2025-10-10T14:31:02.128205Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2 sessionId= userAgent="topic server" ip=ipv6:[::1]:40546 proto=topic  topic=test-topic durationSec=0
2025-10-10T14:31:02.128208Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:02.128618Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2 sessionId:  describe result for acl check
2025-10-10T14:31:02.128643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:02.128654Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:02.128659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:02.128663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600553857089064:2484] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:02.129124Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600553857089064:2484] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:02.131407Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [1:7559600553857089064:2484] (SourceId=src_id, PreferedPartition=(NULL)) RequestPQRB
2025-10-10T14:31:02.131485Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559600553857089084:2484] connected; active server actors: 1
2025-10-10T14:31:02.131505Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [1:7559600553857089064:2484] (SourceId=src_id, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=src_id
2025-10-10T14:31:02.131516Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600553857089064:2484] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:02.131572Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559600553857089084:2484] disconnected; active server actors: 1
2025-10-10T14:31:02.131580Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559600553857089084:2484] disconnected no session
2025-10-10T14:31:02.133966Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600553857089064:2484] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:02.133978Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600553857089064:2484] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-10-10T14:31:02.133982Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600553857089064:2484] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:02.133990Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:02.134289Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1
2025-10-10T14:31:02.134266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600553857089096:2484], now have 1 active actors on pipe
2025-10-10T14:31:02.134407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:02.134419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:02.134463Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:02.134490Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:02.134502Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:02.134505Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:02.134521Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:02.134557Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:02.134585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:02.134775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:02.134785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:02.134800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:02.134886Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2 partition: 0 MaxSeqNo: 0 sessionId: src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0
2025-10-10T14:31:02.135216Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: OnReadDone gRpcStatusCode: 0
2025-10-10T14:31:02.162096Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:02.181150Z :INFO: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1760106662181 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-10T14:31:02.162115Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:02.162117Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:02.181193Z :INFO: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session established. Init response: session_id: "src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0" supported_codecs { codecs: 1 codecs: 2 codecs: 3 }
2025-10-10T14:31:02.181271Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write 1 messages with Id from 1 to 1
2025-10-10T14:31:02.181302Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write 1 messages with Id from 2 to 2
2025-10-10T14:31:02.181310Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write 1 messages with Id from 3 to 3
2025-10-10T14:31:02.181314Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write 1 messages with Id from 4 to 4
2025-10-10T14:31:02.181347Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write 1 messages with Id from 5 to 5
2025-10-10T14:31:02.181354Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write 1 messages with Id from 6 to 6
2025-10-10T14:31:02.181361Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write 1 messages with Id from 7 to 7
2025-10-10T14:31:02.181367Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write 1 messages with Id from 8 to 8
2025-10-10T14:31:02.181373Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write 1 messages with Id from 9 to 9
2025-10-10T14:31:02.181379Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write 1 messages with Id from 10 to 10
2025-10-10T14:31:02.181387Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write 1 messages with Id from 11 to 11
2025-10-10T14:31:02.181393Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write 1 messages with Id from 12 to 12
2025-10-10T14:31:02.181398Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write 1 messages with Id from 13 to 13
2025-10-10T14:31:02.181404Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write 1 messages with Id from 14 to 14
2025-10-10T14:31:02.181409Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write 1 messages with Id from 15 to 15
2025-10-10T14:31:02.181417Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write 1 messages with Id from 16 to 16
2025-10-10T14:31:02.181430Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write 1 messages with Id from 17 to 17
2025-10-10T14:31:02.181435Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write 1 messages with Id from 18 to 18
2025-10-10T14:31:02.181440Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write 1 messages with Id from 19 to 19
2025-10-10T14:31:02.181445Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write 1 messages with Id from 20 to 20
2025-10-10T14:31:02.181450Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write 1 messages with Id from 21 to 21
2025-10-10T14:31:02.181454Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write 1 messages with Id from 22 to 22
2025-10-10T14:31:02.181457Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write 1 messages with Id from 23 to 23
2025-10-10T14:31:02.181460Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write 1 messages with Id from 24 to 24
2025-10-10T14:31:02.181463Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write 1 messages with Id from 25 to 25
2025-10-10T14:31:02.181467Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write 1 messages with Id from 26 to 26
2025-10-10T14:31:02.181475Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write 1 messages with Id from 27 to 27
2025-10-10T14:31:02.181480Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write 1 messages with Id from 28 to 28
2025-10-10T14:31:02.181484Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write 1 messages with Id from 29 to 29
2025-10-10T14:31:02.181487Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write 1 messages with Id from 30 to 30
2025-10-10T14:31:02.181490Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write 1 messages with Id from 31 to 31
2025-10-10T14:31:02.181493Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write 1 messages with Id from 32 to 32
2025-10-10T14:31:02.181508Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write 1 messages with Id from 33 to 33
2025-10-10T14:31:02.181512Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write 1 messages with Id from 34 to 34
2025-10-10T14:31:02.181516Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write 1 messages with Id from 35 to 35
2025-10-10T14:31:02.181519Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write 1 messages with Id from 36 to 36
2025-10-10T14:31:02.181522Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write 1 messages with Id from 37 to 37
2025-10-10T14:31:02.181525Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write 1 messages with Id from 38 to 38
2025-10-10T14:31:02.181528Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write 1 messages with Id from 39 to 39
2025-10-10T14:31:02.181531Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write 1 messages with Id from 40 to 40
2025-10-10T14:31:02.181534Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write 1 messages with Id from 41 to 41
2025-10-10T14:31:02.182216Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write 1 messages with Id from 42 to 42
2025-10-10T14:31:02.182221Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write 1 messages with Id from 43 to 43
2025-10-10T14:31:02.182224Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write 1 messages with Id from 44 to 44
2025-10-10T14:31:02.182229Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write 1 messages with Id from 45 to 45
2025-10-10T14:31:02.182232Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write 1 messages with Id from 46 to 46
2025-10-10T14:31:02.182236Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write 1 messages with Id from 47 to 47
2025-10-10T14:31:02.182243Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write 1 messages with Id from 48 to 48
2025-10-10T14:31:02.182248Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write 1 messages with Id from 49 to 49
2025-10-10T14:31:02.182251Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write 1 messages with Id from 50 to 50
2025-10-10T14:31:02.182254Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write 1 messages with Id from 51 to 51
2025-10-10T14:31:02.182261Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write 1 messages with Id from 52 to 52
2025-10-10T14:31:02.182265Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write 1 messages with Id from 53 to 53
2025-10-10T14:31:02.182268Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write 1 messages with Id from 54 to 54
2025-10-10T14:31:02.182272Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write 1 messages with Id from 55 to 55
2025-10-10T14:31:02.182276Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write 1 messages with Id from 56 to 56
2025-10-10T14:31:02.182280Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write 1 messages with Id from 57 to 57
2025-10-10T14:31:02.182285Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write 1 messages with Id from 58 to 58
2025-10-10T14:31:02.182291Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write 1 messages with Id from 59 to 59
2025-10-10T14:31:02.182296Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write 1 messages with Id from 60 to 60
2025-10-10T14:31:02.182302Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write 1 messages with Id from 61 to 61
2025-10-10T14:31:02.182307Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write 1 messages with Id from 62 to 62
2025-10-10T14:31:02.182312Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write 1 messages with Id from 63 to 63
2025-10-10T14:31:02.182316Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write 1 messages with Id from 64 to 64
2025-10-10T14:31:02.182320Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write 1 messages with Id from 65 to 65
2025-10-10T14:31:02.182323Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write 1 messages with Id from 66 to 66
2025-10-10T14:31:02.182325Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write 1 messages with Id from 67 to 67
2025-10-10T14:31:02.182328Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write 1 messages with Id from 68 to 68
2025-10-10T14:31:02.182331Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write 1 messages with Id from 69 to 69
2025-10-10T14:31:02.182334Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write 1 messages with Id from 70 to 70
2025-10-10T14:31:02.182338Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write 1 messages with Id from 71 to 71
2025-10-10T14:31:02.182342Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write 1 messages with Id from 72 to 72
2025-10-10T14:31:02.182346Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write 1 messages with Id from 73 to 73
2025-10-10T14:31:02.182348Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write 1 messages with Id from 74 to 74
2025-10-10T14:31:02.182351Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write 1 messages with Id from 75 to 75
2025-10-10T14:31:02.182362Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write 1 messages with Id from 76 to 76
2025-10-10T14:31:02.182366Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write 1 messages with Id from 77 to 77
2025-10-10T14:31:02.182369Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write 1 messages with Id from 78 to 78
2025-10-10T14:31:02.182372Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write 1 messages with Id from 79 to 79
2025-10-10T14:31:02.182374Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write 1 messages with Id from 80 to 80
2025-10-10T14:31:02.182378Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write 1 messages with Id from 81 to 81
2025-10-10T14:31:02.182382Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write 1 messages with Id from 82 to 82
2025-10-10T14:31:02.182387Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write 1 messages with Id from 83 to 83
2025-10-10T14:31:02.182390Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write 1 messages with Id from 84 to 84
2025-10-10T14:31:02.182394Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write 1 messages with Id from 85 to 85
2025-10-10T14:31:02.182397Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write 1 messages with Id from 86 to 86
2025-10-10T14:31:02.182400Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write 1 messages with Id from 87 to 87
2025-10-10T14:31:02.182404Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write 1 messages with Id from 88 to 88
2025-10-10T14:31:02.182407Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write 1 messages with Id from 89 to 89
2025-10-10T14:31:02.182411Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write 1 messages with Id from 90 to 90
2025-10-10T14:31:02.182415Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write 1 messages with Id from 91 to 91
2025-10-10T14:31:02.182418Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write 1 messages with Id from 92 to 92
2025-10-10T14:31:02.182423Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write 1 messages with Id from 93 to 93
2025-10-10T14:31:02.182444Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write session: try to update token
2025-10-10T14:31:02.182455Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Send 4 message(s) (89 left), first sequence number is 1
2025-10-10T14:31:02.182716Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:02.182968Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:02.183069Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write 1 messages with Id from 94 to 94
2025-10-10T14:31:02.183209Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write session: try to update token
2025-10-10T14:31:02.183215Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Send 88 message(s) (2 left), first sequence number is 5
2025-10-10T14:31:02.183199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:02.183224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:02.183279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:31:02.183354Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:02.183397Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:02.183559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:02.183567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:02.183660Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:02.183679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 1 partNo : 0 messageNo: 1 size 98 offset: -1
2025-10-10T14:31:02.183689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 2 partNo : 0 messageNo: 1 size 98 offset: -1
2025-10-10T14:31:02.183693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 3 partNo : 0 messageNo: 1 size 98 offset: -1
2025-10-10T14:31:02.183697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 4 partNo : 0 messageNo: 1 size 98 offset: -1
2025-10-10T14:31:02.183707Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:02.183732Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:02.183741Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write session: try to update token
2025-10-10T14:31:02.183750Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Send 2 message(s) (0 left), first sequence number is 93
2025-10-10T14:31:02.183747Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:02.183754Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (4)
2025-10-10T14:31:02.183787Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 1 partNo 0
2025-10-10T14:31:02.183858Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 1 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 172 count 1 nextOffset 1 batches 1
2025-10-10T14:31:02.183870Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 2 partNo 0
2025-10-10T14:31:02.183874Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 2 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 312 count 2 nextOffset 2 batches 1
2025-10-10T14:31:02.183878Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 3 partNo 0
2025-10-10T14:31:02.183883Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 3 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 452 count 3 nextOffset 3 batches 1
2025-10-10T14:31:02.183887Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 4 partNo 0
2025-10-10T14:31:02.183891Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 4 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 592 count 4 nextOffset 4 batches 1
2025-10-10T14:31:02.183894Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:02.183893Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:02.183933Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:02.183953Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 0,4 HeadOffset 0 endOffset 0 curOffset 4 d0000000000_00000000000000000000_00000_0000000004_00000? size 520 WTime 1760106662183
2025-10-10T14:31:02.183987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:02.183993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:02.184002Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:31:02.184019Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 0 partNo 0 count 4 size 520
2025-10-10T14:31:02.184037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:02.184042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:02.184090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 2  requestId: <none> cookie: 2
2025-10-10T14:31:02.184121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 3  requestId: <none> cookie: 3
2025-10-10T14:31:02.184159Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:02.184188Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:02.184394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:02.184401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:02.184408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 5 partNo : 0 messageNo: 4 size 98 offset: -1
2025-10-10T14:31:02.184411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 6 partNo : 0 messageNo: 4 size 98 offset: -1
2025-10-10T14:31:02.184415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 7 partNo : 0 messageNo: 4 size 98 offset: -1
2025-10-10T14:31:02.184418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 8 partNo : 0 messageNo: 4 size 98 offset: -1
2025-10-10T14:31:02.184421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 9 partNo : 0 messageNo: 4 size 98 offset: -1
2025-10-10T14:31:02.184423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 10 partNo : 0 messageNo: 4 size 98 offset: -1
2025-10-10T14:31:02.184425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 11 partNo : 0 messageNo: 4 size 99 offset: -1
2025-10-10T14:31:02.184427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 12 partNo : 0 messageNo: 4 size 99 offset: -1
2025-10-10T14:31:02.184431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 13 partNo : 0 messageNo: 4 size 99 offset: -1
2025-10-10T14:31:02.184434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 14 partNo : 0 messageNo: 4 size 99 offset: -1
2025-10-10T14:31:02.184437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 15 partNo : 0 messageNo: 4 size 99 offset: -1
2025-10-10T14:31:02.184440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 16 partNo : 0 messageNo: 4 size 99 offset: -1
2025-10-10T14:31:02.184443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 17 partNo : 0 messageNo: 4 size 99 offset: -1
2025-10-10T14:31:02.184446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 4 size 99 offset: -1
2025-10-10T14:31:02.184450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 4 size 99 offset: -1
2025-10-10T14:31:02.184453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 4 size 99 offset: -1
2025-10-10T14:31:02.184458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 4 size 99 offset: -1
2025-10-10T14:31:02.184461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 4 size 99 offset: -1
2025-10-10T14:31:02.184464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 4 size 99 offset: -1
2025-10-10T14:31:02.184466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 4 size 99 offset: -1
2025-10-10T14:31:02.184468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 4 size 99 offset: -1
2025-10-10T14:31:02.184470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 4 size 99 offset: -1
2025-10-10T14:31:02.184472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 4 size 99 offset: -1
2025-10-10T14:31:02.184474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 28 partNo : 0 messageNo: 4 size 99 offset: -1
2025-10-10T14:31:02.184475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 29 partNo : 0 messageNo: 4 size 99 offset: -1
2025-10-10T14:31:02.184478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 30 partNo : 0 messageNo: 4 size 99 offset: -1
2025-10-10T14:31:02.184479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 31 partNo : 0 messageNo: 4 size 99 offset: -1
2025-10-10T14:31:02.184481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 32 partNo : 0 messageNo: 4 size 99 offset: -1
2025-10-10T14:31:02.184483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 33 partNo : 0 messageNo: 4 size 99 offset: -1
2025-10-10T14:31:02.184485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 34 partNo : 0 messageNo: 4 size 99 offset: -1
2025-10-10T14:31:02.184487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 35 partNo : 0 messageNo: 4 size 99 offset: -1
2025-10-10T14:31:02.184489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 36 partNo : 0 messageNo: 4 size 99 offset: -1
2025-10-10T14:31:02.184500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 4 size 99 offset: -1
2025-10-10T14:31:02.184502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 4 size 99 offset: -1
2025-10-10T14:31:02.184503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 4 size 99 offset: -1
2025-10-10T14:31:02.184505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 4 size 99 offset: -1
2025-10-10T14:31:02.184507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 4 size 99 offset: -1
2025-10-10T14:31:02.184508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 4 size 99 offset: -1
2025-10-10T14:31:02.184510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 4 size 99 offset: -1
2025-10-10T14:31:02.184512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 4 size 99 offset: -1
2025-10-10T14:31:02.184514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 4 size 99 offset: -1
2025-10-10T14:31:02.184515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 4 size 99 offset: -1
2025-10-10T14:31:02.184517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 4 size 99 offset: -1
2025-10-10T14:31:02.184519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 4 size 99 offset: -1
2025-10-10T14:31:02.184521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 4 size 99 offset: -1
2025-10-10T14:31:02.184522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 4 size 99 offset: -1
2025-10-10T14:31:02.184525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 4 size 99 offset: -1
2025-10-10T14:31:02.184526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 4 size 99 offset: -1
2025-10-10T14:31:02.184528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 53 partNo : 0 messageNo: 4 size 99 offset: -1
2025-10-10T14:31:02.184529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 54 partNo : 0 messageNo: 4 size 99 offset: -1
2025-10-10T14:31:02.184532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 55 partNo : 0 messageNo: 4 size 99 offset: -1
2025-10-10T14:31:02.184534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 56 partNo : 0 messageNo: 4 size 99 offset: -1
2025-10-10T14:31:02.184536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 57 partNo : 0 messageNo: 4 size 99 offset: -1
2025-10-10T14:31:02.184537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 58 partNo : 0 messageNo: 4 size 99 offset: -1
2025-10-10T14:31:02.184539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 59 partNo : 0 messageNo: 4 size 99 offset: -1
2025-10-10T14:31:02.184542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 60 partNo : 0 messageNo: 4 size 99 offset: -1
2025-10-10T14:31:02.184544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 61 partNo : 0 messageNo: 4 size 99 offset: -1
2025-10-10T14:31:02.184545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 62 partNo : 0 messageNo: 4 size 99 offset: -1
2025-10-10T14:31:02.184547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 63 partNo : 0 messageNo: 4 size 99 offset: -1
2025-10-10T14:31:02.184550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 64 partNo : 0 messageNo: 4 size 99 offset: -1
2025-10-10T14:31:02.184552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 65 partNo : 0 messageNo: 4 size 99 offset: -1
2025-10-10T14:31:02.184554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 66 partNo : 0 messageNo: 4 size 99 offset: -1
2025-10-10T14:31:02.184555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 67 partNo : 0 messageNo: 4 size 99 offset: -1
2025-10-10T14:31:02.184558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 68 partNo : 0 messageNo: 4 size 99 offset: -1
2025-10-10T14:31:02.184564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 69 partNo : 0 messageNo: 4 size 99 offset: -1
2025-10-10T14:31:02.184566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 70 partNo : 0 messageNo: 4 size 99 offset: -1
2025-10-10T14:31:02.184568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 71 partNo : 0 messageNo: 4 size 99 offset: -1
2025-10-10T14:31:02.184570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 72 partNo : 0 messageNo: 4 size 99 offset: -1
2025-10-10T14:31:02.184572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 73 partNo : 0 messageNo: 4 size 99 offset: -1
2025-10-10T14:31:02.184574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 74 partNo : 0 messageNo: 4 size 99 offset: -1
2025-10-10T14:31:02.184576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 75 partNo : 0 messageNo: 4 size 99 offset: -1
2025-10-10T14:31:02.184577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 76 partNo : 0 messageNo: 4 size 99 offset: -1
2025-10-10T14:31:02.184579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 77 partNo : 0 messageNo: 4 size 99 offset: -1
2025-10-10T14:31:02.184581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 78 partNo : 0 messageNo: 4 size 99 offset: -1
2025-10-10T14:31:02.184583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 79 partNo : 0 messageNo: 4 size 99 offset: -1
2025-10-10T14:31:02.184585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 80 partNo : 0 messageNo: 4 size 99 offset: -1
2025-10-10T14:31:02.184586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 81 partNo : 0 messageNo: 4 size 99 offset: -1
2025-10-10T14:31:02.184588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 82 partNo : 0 messageNo: 4 size 99 offset: -1
2025-10-10T14:31:02.184590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 83 partNo : 0 messageNo: 4 size 99 offset: -1
2025-10-10T14:31:02.184592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 84 partNo : 0 messageNo: 4 size 99 offset: -1
2025-10-10T14:31:02.184593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 85 partNo : 0 messageNo: 4 size 99 offset: -1
2025-10-10T14:31:02.184595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 86 partNo : 0 messageNo: 4 size 99 offset: -1
2025-10-10T14:31:02.184598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 87 partNo : 0 messageNo: 4 size 99 offset: -1
2025-10-10T14:31:02.184745Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write 1 messages with Id from 95 to 95
2025-10-10T14:31:02.184599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 88 partNo : 0 messageNo: 4 size 99 offset: -1
2025-10-10T14:31:02.184601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 89 partNo : 0 messageNo: 4 size 99 offset: -1
2025-10-10T14:31:02.184603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 90 partNo : 0 messageNo: 4 size 99 offset: -1
2025-10-10T14:31:02.184605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 91 partNo : 0 messageNo: 4 size 99 offset: -1
2025-10-10T14:31:02.184606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 92 partNo : 0 messageNo: 4 size 99 offset: -1
2025-10-10T14:31:02.184625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:02.185125Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write 1 messages with Id from 96 to 96
2025-10-10T14:31:02.184626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:02.184629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 93 partNo : 0 messageNo: 5 size 99 offset: -1
2025-10-10T14:31:02.184631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 94 partNo : 0 messageNo: 5 size 99 offset: -1
2025-10-10T14:31:02.185136Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write 1 messages with Id from 97 to 97
2025-10-10T14:31:02.184634Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:02.184685Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:02.185143Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write 1 messages with Id from 98 to 98
2025-10-10T14:31:02.184687Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:02.184689Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:02.185152Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write 1 messages with Id from 99 to 99
2025-10-10T14:31:02.185121Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 0 count 4 size 520 actorID [2:7559600544377417321:2381]
2025-10-10T14:31:02.185136Z node 2 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:31:02.185155Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 420 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:31:02.185158Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write 1 messages with Id from 100 to 100
2025-10-10T14:31:02.185162Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:02.185169Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 1, partNo: 0, Offset: 0 is stored on disk
2025-10-10T14:31:02.185174Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:02.185178Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 2, partNo: 0, Offset: 1 is stored on disk
2025-10-10T14:31:02.185179Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 4 parts 0 suffix '63' size 520
2025-10-10T14:31:02.185181Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:02.185185Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 3, partNo: 0, Offset: 2 is stored on disk
2025-10-10T14:31:02.185187Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:02.185201Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write session: try to update token
2025-10-10T14:31:02.185191Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 4, partNo: 0, Offset: 3 is stored on disk
2025-10-10T14:31:02.185211Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Send 3 message(s) (3 left), first sequence number is 95
2025-10-10T14:31:02.185219Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:02.185233Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:02.185238Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:02.185270Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:02.185277Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (90)
2025-10-10T14:31:02.185289Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 5 partNo 0
2025-10-10T14:31:02.185313Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 5 partNo 0 FormedBlobsCount 0 NewHead: Offset 4 PartNo 0 PackedSize 172 count 1 nextOffset 5 batches 1
2025-10-10T14:31:02.185324Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 6 partNo 0
2025-10-10T14:31:02.185354Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:02.185359Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 6 partNo 0 FormedBlobsCount 0 NewHead: Offset 4 PartNo 0 PackedSize 312 count 2 nextOffset 6 batches 1
2025-10-10T14:31:02.185363Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 7 partNo 0
2025-10-10T14:31:02.185465Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:02.185367Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 7 partNo 0 FormedBlobsCount 0 NewHead: Offset 4 PartNo 0 PackedSize 452 count 3 nextOffset 7 batches 1
2025-10-10T14:31:02.185369Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 8 partNo 0
2025-10-10T14:31:02.185373Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 8 partNo 0 FormedBlobsCount 0 NewHead: Offset 4 PartNo 0 PackedSize 592 count 4 nextOffset 8 batches 1
2025-10-10T14:31:02.185376Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 9 partNo 0
2025-10-10T14:31:02.185379Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 9 partNo 0 FormedBlobsCount 0 NewHead: Offset 4 PartNo 0 PackedSize 732 count 5 nextOffset 9 batches 1
2025-10-10T14:31:02.185382Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 10 partNo 0
2025-10-10T14:31:02.185385Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 10 partNo 0 FormedBlobsCount 0 NewHead: Offset 4 PartNo 0 PackedSize 872 count 6 nextOffset 10 batches 1
2025-10-10T14:31:02.185388Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 11 partNo 0
2025-10-10T14:31:02.185391Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 11 partNo 0 FormedBlobsCount 0 NewHead: Offset 4 PartNo 0 PackedSize 1013 count 7 nextOffset 11 batches 1
2025-10-10T14:31:02.185394Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 12 partNo 0
2025-10-10T14:31:02.185398Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 12 partNo 0 FormedBlobsCount 0 NewHead: Offset 4 PartNo 0 PackedSize 1154 count 8 nextOffset 12 batches 1
2025-10-10T14:31:02.185401Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 13 partNo 0
2025-10-10T14:31:02.185406Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 13 partNo 0 FormedBlobsCount 0 NewHead: Offset 4 PartNo 0 PackedSize 1295 count 9 nextOffset 13 batches 1
2025-10-10T14:31:02.185409Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 14 partNo 0
2025-10-10T14:31:02.185413Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 14 partNo 0 FormedBlobsCount 0 NewHead: Offset 4 PartNo 0 PackedSize 1436 count 10 nextOffset 14 batches 1
2025-10-10T14:31:02.185416Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 15 partNo 0
2025-10-10T14:31:02.185419Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 15 partNo 0 FormedBlobsCount 0 NewHead: Offset 4 PartNo 0 PackedSize 1577 count 11 nextOffset 15 batches 1
2025-10-10T14:31:02.185422Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 16 partNo 0
2025-10-10T14:31:02.185426Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 16 partNo 0 FormedBlobsCount 0 NewHead: Offset 4 PartNo 0 PackedSize 1718 count 12 nextOffset 16 batches 1
2025-10-10T14:31:02.185429Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 17 partNo 0
2025-10-10T14:31:02.185433Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 17 partNo 0 FormedBlobsCount 0 NewHead: Offset 4 PartNo 0 PackedSize 1859 count 13 nextOffset 17 batches 1
2025-10-10T14:31:02.185435Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-10T14:31:02.185439Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 0 FormedBlobsCount 0 NewHead: Offset 4 PartNo 0 PackedSize 2000 count 14 nextOffset 18 batches 1
2025-10-10T14:31:02.185442Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-10T14:31:02.185446Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 0 FormedBlobsCount 0 NewHead: Offset 4 PartNo 0 PackedSize 2141 count 15 nextOffset 19 batches 1
2025-10-10T14:31:02.185448Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-10T14:31:02.185452Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 0 FormedBlobsCount 0 NewHead: Offset 4 PartNo 0 PackedSize 2282 count 16 nextOffset 20 batches 1
2025-10-10T14:31:02.185456Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-10T14:31:02.185874Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write session: try to update token
2025-10-10T14:31:02.185460Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 0 FormedBlobsCount 0 NewHead: Offset 4 PartNo 0 PackedSize 2423 count 17 nextOffset 21 batches 1
2025-10-10T14:31:02.185989Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Send 3 message(s) (0 left), first sequence number is 98
2025-10-10T14:31:02.185462Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-10T14:31:02.185466Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 0 FormedBlobsCount 0 NewHead: Offset 4 PartNo 0 PackedSize 2564 count 18 nextOffset 22 batches 1
2025-10-10T14:31:02.185469Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-10T14:31:02.185473Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 0 FormedBlobsCount 0 NewHead: Offset 4 PartNo 0 PackedSize 2705 count 19 nextOffset 23 batches 1
2025-10-10T14:31:02.185476Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-10T14:31:02.185479Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 0 FormedBlobsCount 0 NewHead: Offset 4 PartNo 0 PackedSize 2846 count 20 nextOffset 24 batches 1
2025-10-10T14:31:02.185482Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-10T14:31:02.185485Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 0 FormedBlobsCount 0 NewHead: Offset 4 PartNo 0 PackedSize 2987 count 21 nextOffset 25 batches 1
2025-10-10T14:31:02.185488Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-10T14:31:02.185491Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 0 FormedBlobsCount 0 NewHead: Offset 4 PartNo 0 PackedSize 3128 count 22 nextOffset 26 batches 1
2025-10-10T14:31:02.185494Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-10T14:31:02.185497Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 0 FormedBlobsCount 0 NewHead: Offset 4 PartNo 0 PackedSize 3269 count 23 nextOffset 27 batches 1
2025-10-10T14:31:02.185499Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 28 partNo 0
2025-10-10T14:31:02.185504Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 28 partNo 0 FormedBlobsCount 0 NewHead: Offset 4 PartNo 0 PackedSize 3410 count 24 nextOffset 28 batches 1
2025-10-10T14:31:02.185508Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 29 partNo 0
2025-10-10T14:31:02.185511Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 29 partNo 0 FormedBlobsCount 0 NewHead: Offset 4 PartNo 0 PackedSize 3551 count 25 nextOffset 29 batches 1
2025-10-10T14:31:02.185514Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 30 partNo 0
2025-10-10T14:31:02.185518Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 30 partNo 0 FormedBlobsCount 0 NewHead: Offset 4 PartNo 0 PackedSize 3692 count 26 nextOffset 30 batches 1
2025-10-10T14:31:02.185520Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 31 partNo 0
2025-10-10T14:31:02.185524Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 31 partNo 0 FormedBlobsCount 0 NewHead: Offset 4 PartNo 0 PackedSize 3833 count 27 nextOffset 31 batches 1
2025-10-10T14:31:02.185526Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 32 partNo 0
2025-10-10T14:31:02.185529Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 32 partNo 0 FormedBlobsCount 0 NewHead: Offset 4 PartNo 0 PackedSize 3974 count 28 nextOffset 32 batches 1
2025-10-10T14:31:02.185532Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 33 partNo 0
2025-10-10T14:31:02.185535Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 33 partNo 0 FormedBlobsCount 0 NewHead: Offset 4 PartNo 0 PackedSize 4115 count 29 nextOffset 33 batches 1
2025-10-10T14:31:02.185538Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 34 partNo 0
2025-10-10T14:31:02.185542Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 34 partNo 0 FormedBlobsCount 0 NewHead: Offset 4 PartNo 0 PackedSize 4256 count 30 nextOffset 34 batches 1
2025-10-10T14:31:02.185545Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 35 partNo 0
2025-10-10T14:31:02.185548Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 35 partNo 0 FormedBlobsCount 0 NewHead: Offset 4 PartNo 0 PackedSize 4397 count 31 nextOffset 35 batches 1
2025-10-10T14:31:02.185551Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 36 partNo 0
2025-10-10T14:31:02.186111Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:02.185555Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 36 partNo 0 FormedBlobsCount 0 NewHead: Offset 4 PartNo 0 PackedSize 4538 count 32 nextOffset 36 batches 1
2025-10-10T14:31:02.186123Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:02.186364Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write session: OnReadDone gRpcStatusCode: 0
2025-10-10T14:31:02.186297Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:02.186302Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:02.185558Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 37 partNo 0
2025-10-10T14:31:02.185563Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 37 partNo 0 FormedBlobsCount 0 NewHead: Offset 4 PartNo 0 PackedSize 4679 count 33 nextOffset 37 batches 1
2025-10-10T14:31:02.185566Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 38 partNo 0
2025-10-10T14:31:02.185569Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 38 partNo 0 FormedBlobsCount 0 NewHead: Offset 4 PartNo 0 PackedSize 4820 count 34 nextOffset 38 batches 1
2025-10-10T14:31:02.185572Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 39 partNo 0
2025-10-10T14:31:02.185576Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 39 partNo 0 FormedBlobsCount 0 NewHead: Offset 4 PartNo 0 PackedSize 4961 count 35 nextOffset 39 batches 1
2025-10-10T14:31:02.185579Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 40 partNo 0
2025-10-10T14:31:02.185582Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 40 partNo 0 FormedBlobsCount 0 NewHead: Offset 4 PartNo 0 PackedSize 5102 count 36 nextOffset 40 batches 1
2025-10-10T14:31:02.185585Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 41 partNo 0
2025-10-10T14:31:02.185589Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 41 partNo 0 FormedBlobsCount 0 NewHead: Offset 4 PartNo 0 PackedSize 5243 count 37 nextOffset 41 batches 1
2025-10-10T14:31:02.185592Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 42 partNo 0
2025-10-10T14:31:02.185595Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 42 partNo 0 FormedBlobsCount 0 NewHead: Offset 4 PartNo 0 PackedSize 5384 count 38 nextOffset 42 batches 1
2025-10-10T14:31:02.185598Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 43 partNo 0
2025-10-10T14:31:02.185601Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 43 partNo 0 FormedBlobsCount 0 NewHead: Offset 4 PartNo 0 PackedSize 5525 count 39 nextOffset 43 batches 1
2025-10-10T14:31:02.185604Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 44 partNo 0
2025-10-10T14:31:02.185607Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 44 partNo 0 FormedBlobsCount 0 NewHead: Offset 4 PartNo 0 PackedSize 5666 count 40 nextOffset 44 batches 1
2025-10-10T14:31:02.185611Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 45 partNo 0
2025-10-10T14:31:02.185614Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 45 partNo 0 FormedBlobsCount 0 NewHead: Offset 4 PartNo 0 PackedSize 5807 count 41 nextOffset 45 batches 1
2025-10-10T14:31:02.185617Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 0
2025-10-10T14:31:02.185621Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 46 partNo 0 FormedBlobsCount 0 NewHead: Offset 4 PartNo 0 PackedSize 5948 count 42 nextOffset 46 batches 1
2025-10-10T14:31:02.185625Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 0
2025-10-10T14:31:02.185628Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 47 partNo 0 FormedBlobsCount 0 NewHead: Offset 4 PartNo 0 PackedSize 6089 count 43 nextOffset 47 batches 1
2025-10-10T14:31:02.185631Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 0
2025-10-10T14:31:02.185634Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 48 partNo 0 FormedBlobsCount 0 NewHead: Offset 4 PartNo 0 PackedSize 6230 count 44 nextOffset 48 batches 1
2025-10-10T14:31:02.185637Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 49 partNo 0
2025-10-10T14:31:02.186510Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write session got write response: acks { seq_no: 1 written { } } acks { seq_no: 2 written { offset: 1 } } acks { seq_no: 3 written { offset: 2 } } acks { seq_no: 4 written { offset: 3 } } write_statistics { persisting_time { nanos: 1000000 } min_queue_wait_time { } max_queue_wait_time { } partition_quota_wait_time { } topic_quota_wait_time { } }
2025-10-10T14:31:02.186543Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:02.186882Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] OnAck: seqNo=1, txId=?
2025-10-10T14:31:02.186888Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write session: acknoledged message 1
2025-10-10T14:31:02.185640Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 49 partNo 0 FormedBlobsCount 0 NewHead: Offset 4 PartNo 0 PackedSize 6371 count 45 nextOffset 49 batches 1
2025-10-10T14:31:02.186892Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] OnAck: seqNo=2, txId=?
2025-10-10T14:31:02.185642Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 50 partNo 0
2025-10-10T14:31:02.185646Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 50 partNo 0 FormedBlobsCount 0 NewHead: Offset 4 PartNo 0 PackedSize 6512 count 46 nextOffset 50 batches 1
2025-10-10T14:31:02.186895Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write session: acknoledged message 2
2025-10-10T14:31:02.185649Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 51 partNo 0
2025-10-10T14:31:02.185652Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 51 partNo 0 FormedBlobsCount 0 NewHead: Offset 4 PartNo 0 PackedSize 6653 count 47 nextOffset 51 batches 1
2025-10-10T14:31:02.186908Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] OnAck: seqNo=3, txId=?
2025-10-10T14:31:02.186919Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write session: acknoledged message 3
2025-10-10T14:31:02.185655Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 52 partNo 0
2025-10-10T14:31:02.186922Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] OnAck: seqNo=4, txId=?
2025-10-10T14:31:02.186923Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write session: acknoledged message 4
2025-10-10T14:31:02.185660Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 52 partNo 0 FormedBlobsCount 0 NewHead: Offset 4 PartNo 0 PackedSize 6794 count 48 nextOffset 52 batches 1
2025-10-10T14:31:02.185663Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 53 partNo 0
2025-10-10T14:31:02.185667Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 53 partNo 0 FormedBlobsCount 0 NewHead: Offset 4 PartNo 0 PackedSize 6935 count 49 nextOffset 53 batches 1
2025-10-10T14:31:02.185670Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 54 partNo 0
2025-10-10T14:31:02.185674Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 54 partNo 0 FormedBlobsCount 0 NewHead: Offset 4 PartNo 0 PackedSize 7076 count 50 nextOffset 54 batches 1
2025-10-10T14:31:02.185677Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 55 partNo 0
2025-10-10T14:31:02.185680Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 55 partNo 0 FormedBlobsCount 0 NewHead: Offset 4 PartNo 0 PackedSize 7217 count 51 nextOffset 55 batches 1
2025-10-10T14:31:02.185683Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 56 partNo 0
2025-10-10T14:31:02.185686Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 56 partNo 0 FormedBlobsCount 0 NewHead: Offset 4 PartNo 0 PackedSize 7358 count 52 nextOffset 56 batches 1
2025-10-10T14:31:02.185689Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 57 partNo 0
2025-10-10T14:31:02.185692Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 57 partNo 0 FormedBlobsCount 0 NewHead: Offset 4 PartNo 0 PackedSize 7499 count 53 nextOffset 57 batches 1
2025-10-10T14:31:02.185695Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 58 partNo 0
2025-10-10T14:31:02.185698Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 58 partNo 0 FormedBlobsCount 0 NewHead: Offset 4 PartNo 0 PackedSize 7640 count 54 nextOffset 58 batches 1
2025-10-10T14:31:02.185701Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 59 partNo 0
2025-10-10T14:31:02.185704Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 59 partNo 0 FormedBlobsCount 0 NewHead: Offset 4 PartNo 0 PackedSize 7781 count 55 nextOffset 59 batches 1
2025-10-10T14:31:02.185706Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 60 partNo 0
2025-10-10T14:31:02.185712Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 60 partNo 0 FormedBlobsCount 0 NewHead: Offset 4 PartNo 0 PackedSize 7922 count 56 nextOffset 60 batches 1
2025-10-10T14:31:02.185715Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 61 partNo 0
2025-10-10T14:31:02.185719Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 61 partNo 0 FormedBlobsCount 0 NewHead: Offset 4 PartNo 0 PackedSize 8063 count 57 nextOffset 61 batches 1
2025-10-10T14:31:02.185722Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 62 partNo 0
2025-10-10T14:31:02.185726Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 62 partNo 0 FormedBlobsCount 0 NewHead: Offset 4 PartNo 0 PackedSize 8204 count 58 nextOffset 62 batches 1
2025-10-10T14:31:02.185729Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 63 partNo 0
2025-10-10T14:31:02.185732Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 63 partNo 0 FormedBlobsCount 0 NewHead: Offset 4 PartNo 0 PackedSize 8345 count 59 nextOffset 63 batches 1
2025-10-10T14:31:02.185735Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 64 partNo 0
2025-10-10T14:31:02.185738Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 64 partNo 0 FormedBlobsCount 0 NewHead: Offset 4 PartNo 0 PackedSize 8486 count 60 nextOffset 64 batches 1
2025-10-10T14:31:02.185741Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 65 partNo 0
2025-10-10T14:31:02.185745Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 65 partNo 0 FormedBlobsCount 0 NewHead: Offset 4 PartNo 0 PackedSize 8627 count 61 nextOffset 65 batches 1
2025-10-10T14:31:02.185747Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 66 partNo 0
2025-10-10T14:31:02.185750Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 66 partNo 0 FormedBlobsCount 0 NewHead: Offset 4 PartNo 0 PackedSize 8768 count 62 nextOffset 66 batches 1
2025-10-10T14:31:02.185753Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 67 partNo 0
2025-10-10T14:31:02.185757Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 67 partNo 0 FormedBlobsCount 0 NewHead: Offset 4 PartNo 0 PackedSize 8909 count 63 nextOffset 67 batches 1
2025-10-10T14:31:02.185759Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 68 partNo 0
2025-10-10T14:31:02.185763Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 68 partNo 0 FormedBlobsCount 0 NewHead: Offset 4 PartNo 0 PackedSize 9050 count 64 nextOffset 68 batches 1
2025-10-10T14:31:02.185766Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 69 partNo 0
2025-10-10T14:31:02.185773Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 69 partNo 0 FormedBlobsCount 0 NewHead: Offset 4 PartNo 0 PackedSize 9191 count 65 nextOffset 69 batches 1
2025-10-10T14:31:02.185776Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 70 partNo 0
2025-10-10T14:31:02.185780Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 70 partNo 0 FormedBlobsCount 0 NewHead: Offset 4 PartNo 0 PackedSize 9332 count 66 nextOffset 70 batches 1
2025-10-10T14:31:02.185782Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 71 partNo 0
2025-10-10T14:31:02.185786Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 71 partNo 0 FormedBlobsCount 0 NewHead: Offset 4 PartNo 0 PackedSize 9473 count 67 nextOffset 71 batches 1
2025-10-10T14:31:02.185788Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 72 partNo 0
2025-10-10T14:31:02.185792Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 72 partNo 0 FormedBlobsCount 0 NewHead: Offset 4 PartNo 0 PackedSize 9614 count 68 nextOffset 72 batches 1
2025-10-10T14:31:02.185794Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 73 partNo 0
2025-10-10T14:31:02.185798Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 73 partNo 0 FormedBlobsCount 0 NewHead: Offset 4 PartNo 0 PackedSize 9755 count 69 nextOffset 73 batches 1
2025-10-10T14:31:02.185801Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 74 partNo 0
2025-10-10T14:31:02.185804Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 74 partNo 0 FormedBlobsCount 0 NewHead: Offset 4 PartNo 0 PackedSize 9896 count 70 nextOffset 74 batches 1
2025-10-10T14:31:02.185807Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 75 partNo 0
2025-10-10T14:31:02.185810Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 75 partNo 0 FormedBlobsCount 0 NewHead: Offset 4 PartNo 0 PackedSize 10037 count 71 nextOffset 75 batches 1
2025-10-10T14:31:02.185813Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 76 partNo 0
2025-10-10T14:31:02.185816Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 76 partNo 0 FormedBlobsCount 0 NewHead: Offset 4 PartNo 0 PackedSize 10178 count 72 nextOffset 76 batches 1
2025-10-10T14:31:02.185819Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 77 partNo 0
2025-10-10T14:31:02.185823Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 77 partNo 0 FormedBlobsCount 0 NewHead: Offset 4 PartNo 0 PackedSize 10319 count 73 nextOffset 77 batches 1
2025-10-10T14:31:02.185825Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 78 partNo 0
2025-10-10T14:31:02.185829Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 78 partNo 0 FormedBlobsCount 0 NewHead: Offset 4 PartNo 0 PackedSize 10460 count 74 nextOffset 78 batches 1
2025-10-10T14:31:02.185832Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 79 partNo 0
2025-10-10T14:31:02.185835Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 79 partNo 0 FormedBlobsCount 0 NewHead: Offset 4 PartNo 0 PackedSize 10601 count 75 nextOffset 79 batches 1
2025-10-10T14:31:02.185838Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 80 partNo 0
2025-10-10T14:31:02.185841Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 80 partNo 0 FormedBlobsCount 0 NewHead: Offset 4 PartNo 0 PackedSize 10742 count 76 nextOffset 80 batches 1
2025-10-10T14:31:02.185845Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 81 partNo 0
2025-10-10T14:31:02.185848Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 81 partNo 0 FormedBlobsCount 0 NewHead: Offset 4 PartNo 0 PackedSize 10883 count 77 nextOffset 81 batches 1
2025-10-10T14:31:02.185851Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 82 partNo 0
2025-10-10T14:31:02.185854Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 82 partNo 0 FormedBlobsCount 0 NewHead: Offset 4 PartNo 0 PackedSize 11024 count 78 nextOffset 82 batches 1
2025-10-10T14:31:02.185857Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 83 partNo 0
2025-10-10T14:31:02.185861Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 83 partNo 0 FormedBlobsCount 0 NewHead: Offset 4 PartNo 0 PackedSize 11165 count 79 nextOffset 83 batches 1
2025-10-10T14:31:02.185864Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 84 partNo 0
2025-10-10T14:31:02.185870Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 84 partNo 0 FormedBlobsCount 0 NewHead: Offset 4 PartNo 0 PackedSize 11306 count 80 nextOffset 84 batches 1
2025-10-10T14:31:02.185873Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 85 partNo 0
2025-10-10T14:31:02.185876Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 85 partNo 0 FormedBlobsCount 0 NewHead: Offset 4 PartNo 0 PackedSize 11447 count 81 nextOffset 85 batches 1
2025-10-10T14:31:02.185879Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 86 partNo 0
2025-10-10T14:31:02.185882Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 86 partNo 0 FormedBlobsCount 0 NewHead: Offset 4 PartNo 0 PackedSize 11588 count 82 nextOffset 86 batches 1
2025-10-10T14:31:02.185885Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 87 partNo 0
2025-10-10T14:31:02.185889Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 87 partNo 0 FormedBlobsCount 0 NewHead: Offset 4 PartNo 0 PackedSize 11729 count 83 nextOffset 87 batches 1
2025-10-10T14:31:02.185892Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 88 partNo 0
2025-10-10T14:31:02.185895Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 88 partNo 0 FormedBlobsCount 0 NewHead: Offset 4 PartNo 0 PackedSize 11870 count 84 nextOffset 88 batches 1
2025-10-10T14:31:02.185898Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 89 partNo 0
2025-10-10T14:31:02.185902Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 89 partNo 0 FormedBlobsCount 0 NewHead: Offset 4 PartNo 0 PackedSize 12011 count 85 nextOffset 89 batches 1
2025-10-10T14:31:02.185905Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 90 partNo 0
2025-10-10T14:31:02.185909Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 90 partNo 0 FormedBlobsCount 0 NewHead: Offset 4 PartNo 0 PackedSize 12152 count 86 nextOffset 90 batches 1
2025-10-10T14:31:02.185912Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 91 partNo 0
2025-10-10T14:31:02.185916Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 91 partNo 0 FormedBlobsCount 0 NewHead: Offset 4 PartNo 0 PackedSize 12293 count 87 nextOffset 91 batches 1
2025-10-10T14:31:02.185918Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 92 partNo 0
2025-10-10T14:31:02.185923Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 92 partNo 0 FormedBlobsCount 0 NewHead: Offset 4 PartNo 0 PackedSize 12434 count 88 nextOffset 92 batches 1
2025-10-10T14:31:02.185927Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 93 partNo 0
2025-10-10T14:31:02.185930Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 93 partNo 0 FormedBlobsCount 0 NewHead: Offset 4 PartNo 0 PackedSize 12575 count 89 nextOffset 93 batches 1
2025-10-10T14:31:02.185944Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 94 partNo 0
2025-10-10T14:31:02.185948Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 94 partNo 0 FormedBlobsCount 0 NewHead: Offset 4 PartNo 0 PackedSize 12716 count 90 nextOffset 94 batches 1
2025-10-10T14:31:02.185951Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:02.186031Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 4,90 HeadOffset 4 endOffset 4 curOffset 94 d0000000000_00000000000000000004_00000_0000000090_00000? size 9806 WTime 1760106662185
2025-10-10T14:31:02.186047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:182: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:31:02.186063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-10-10T14:31:02.186085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:02.186088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:02.186094Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:31:02.186104Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 4 partNo 0 count 90 size 9806
2025-10-10T14:31:02.186153Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 4 max time lag 0ms effective offset 0
2025-10-10T14:31:02.186170Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 520 count 4 last offset 0, current partition end offset: 4
2025-10-10T14:31:02.186173Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:02.186177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 6  requestId: <none> cookie: 4
2025-10-10T14:31:02.186207Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 0 partno 0 count 4 parts_count 0 source 1 size 520 accessed 0 times before, last time 2025-10-10T14:31:02.000000Z
2025-10-10T14:31:02.186211Z node 2 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 3. All 1 blobs are from cache.
2025-10-10T14:31:02.186222Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:31:02.186244Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 4 parts 0 suffix '63'
2025-10-10T14:31:02.186320Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 4 count 4 size 500 from pos 0 cbcount 4
2025-10-10T14:31:02.186336Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106662183 queuesize 0 startOffset 0
2025-10-10T14:31:02.186362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:02.186365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:02.186374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:02.186376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:02.186384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 95 partNo : 0 messageNo: 8 size 99 offset: -1
2025-10-10T14:31:02.186388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 96 partNo : 0 messageNo: 8 size 99 offset: -1
2025-10-10T14:31:02.186391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 97 partNo : 0 messageNo: 8 size 99 offset: -1
2025-10-10T14:31:02.186398Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:02.186404Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:02.186407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 7  requestId: <none> cookie: 5
2025-10-10T14:31:02.186645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:02.186648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:02.186655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 98 partNo : 0 messageNo: 9 size 99 offset: -1
2025-10-10T14:31:02.186659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 99 partNo : 0 messageNo: 9 size 99 offset: -1
2025-10-10T14:31:02.186662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 100 partNo : 0 messageNo: 9 size 99 offset: -1
2025-10-10T14:31:02.186667Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:02.186672Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:02.187326Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 4 count 90 size 9806 actorID [2:7559600544377417321:2381]
2025-10-10T14:31:02.187338Z node 2 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:31:02.187349Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 9534 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:31:02.187350Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 4 partno 0 count 90 parts 0 suffix '63' size 9806
2025-10-10T14:31:02.187355Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:02.187362Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 5, partNo: 0, Offset: 4 is stored on disk
2025-10-10T14:31:02.187366Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:02.187370Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 6, partNo: 0, Offset: 5 is stored on disk
2025-10-10T14:31:02.187372Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:02.187376Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 7, partNo: 0, Offset: 6 is stored on disk
2025-10-10T14:31:02.188301Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:02.187378Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:02.187381Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 8, partNo: 0, Offset: 7 is stored on disk
2025-10-10T14:31:02.187384Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:02.187387Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 9, partNo: 0, Offset: 8 is stored on disk
2025-10-10T14:31:02.188356Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:02.188591Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write session: OnReadDone gRpcStatusCode: 0
2025-10-10T14:31:02.187389Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:02.188891Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:02.187393Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 10, partNo: 0, Offset: 9 is stored on disk
2025-10-10T14:31:02.188899Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:02.187395Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:02.187400Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 11, partNo: 0, Offset: 10 is stored on disk
2025-10-10T14:31:02.187402Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:02.187407Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 12, partNo: 0, Offset: 11 is stored on disk
2025-10-10T14:31:02.187409Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:02.187414Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 13, partNo: 0, Offset: 12 is stored on disk
2025-10-10T14:31:02.187417Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:02.187422Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 14, partNo: 0, Offset: 13 is stored on disk
2025-10-10T14:31:02.187424Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:02.187428Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 15, partNo: 0, Offset: 14 is stored on disk
2025-10-10T14:31:02.187430Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:02.187434Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 16, partNo: 0, Offset: 15 is stored on disk
2025-10-10T14:31:02.187436Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:02.187442Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 17, partNo: 0, Offset: 16 is stored on disk
2025-10-10T14:31:02.187444Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:02.187448Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 18, partNo: 0, Offset: 17 is stored on disk
2025-10-10T14:31:02.187450Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:02.187454Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 19, partNo: 0, Offset: 18 is stored on disk
2025-10-10T14:31:02.187456Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:02.187459Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 20, partNo: 0, Offset: 19 is stored on disk
2025-10-10T14:31:02.187462Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:02.187466Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 21, partNo: 0, Offset: 20 is stored on disk
2025-10-10T14:31:02.187469Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:02.187472Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 22, partNo: 0, Offset: 21 is stored on disk
2025-10-10T14:31:02.187474Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:02.187478Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 23, partNo: 0, Offset: 22 is stored on disk
2025-10-10T14:31:02.187480Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:02.187484Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 24, partNo: 0, Offset: 23 is stored on disk
2025-10-10T14:31:02.187487Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:02.187491Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 25, partNo: 0, Offset: 24 is stored on disk
2025-10-10T14:31:02.187493Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:02.187496Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 26, partNo: 0, Offset: 25 is stored on disk
2025-10-10T14:31:02.187499Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:02.187502Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 27, partNo: 0, Offset: 26 is stored on disk
2025-10-10T14:31:02.187504Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:02.187509Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 28, partNo: 0, Offset: 27 is stored on disk
2025-10-10T14:31:02.187510Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:02.187515Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 29, partNo: 0, Offset: 28 is stored on disk
2025-10-10T14:31:02.187516Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:02.187519Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 30, partNo: 0, Offset: 29 is stored on disk
2025-10-10T14:31:02.187521Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:02.187525Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 31, partNo: 0, Offset: 30 is stored on disk
2025-10-10T14:31:02.187527Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:02.187530Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 32, partNo: 0, Offset: 31 is stored on disk
2025-10-10T14:31:02.187532Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:02.187536Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 33, partNo: 0, Offset: 32 is stored on disk
2025-10-10T14:31:02.189514Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write session got write response: acks { seq_no: 5 written { offset: 4 } } acks { seq_no: 6 written { offset: 5 } } acks { seq_no: 7 written { offset: 6 } } acks { seq_no: 8 written { offset: 7 } } acks { seq_no: 9 written { offset: 8 } } acks { seq_no: 10 written { offset: 9 } } acks { seq_no: 11 written { offset: 10 } } acks { seq_no: 12 written { offset: 11 } } acks { seq_no: 13 written { offset: 12 } } acks { seq_no: 14 written { offset: 13 } } acks { seq_no: 15 written { offset: 14 } } acks { seq_no: 16 written { offset: 15 } } acks { seq_no: 17 written { offset: 16 } } acks { seq_no: 18 written { offset: 17 } } acks { seq_no: 19 written { offset: 18 } } acks { seq_no: 20 written { offset: 19 } } acks { seq_no: 21 written { offset: 20 } } acks { seq_no: 22 written { offset: 21 } } acks { seq_no: 23 written { offset: 22 } } acks { seq_no: 24 written { offset: 23 } } acks { seq_no: 25 written { offset: 24 } } acks { seq_no: 26 written { offset: 25 } } acks { seq_no: 27 written { offset: 26 } } acks { seq_no: 28 written { offset: 27 } } acks { seq_no: 29 written { offset: 28 } } acks { seq_no: 30 written { offset: 29 } } acks { seq_no: 31 written { offset: 30 } } acks { seq_no: 32 written { offset: 31 } } acks { seq_no: 33 written { offset: 32 } } acks { seq_no: 34 written { offset: 33 } } acks { seq_no: 35 written { offset: 34 } } acks { seq_no: 36 written { offset: 35 } } acks { seq_no: 37 written { offset: 36 } } acks { seq_no: 38 written { offset: 37 } } acks { seq_no: 39 written { offset: 38 } } acks { seq_no: 40 written { offset: 39 } } acks { seq_no: 41 written { offset: 40 } } acks { seq_no: 42 written { offset: 41 } } acks { seq_no: 43 written { offset: 42 } } acks { seq_no: 44 written { offset: 43 } } acks { seq_no: 45 written { offset: 44 } } acks { seq_no: 46 written { offset: 45 } } acks { seq_no: 47 written { offset: 46 } } acks { seq_no: 48 written { offset: 47 } } acks { seq_no: 49 written { offset: 48 } } acks { seq_no: 50 written { offset: 49 } } acks { seq_no: 51 written { offset: 50 } } acks { seq_no: 52 written { offset: 51 } } acks { seq_no: 53 written { offset: 52 } } acks { seq_no: 54 written { offset: 53 } } acks { seq_no: 55 written { offset: 54 } } acks { seq_no: 56 written { offset: 55 } } acks { seq_no: 57 written { offset: 56 } } acks { seq_no: 58 written { offset: 57 } } acks { seq_no: 59 written { offset: 58 } } acks { seq_no: 60 written { offset: 59 } } acks { seq_no: 61 written { offset: 60 } } acks { seq_no: 62 written { offset: 61 } } acks { seq_no: 63 written { offset: 62 } } acks { seq_no: 64 written { offset: 63 } } acks { seq_no: 65 written { offset: 64 } } acks { seq_no: 66 written { offset: 65 } } acks { seq_no: 67 written { offset: 66 } } acks { seq_no: 68 written { offset: 67 } } acks { seq_no: 69 written { offset: 68 } } acks { seq_no: 70 written { offset: 69 } } acks { seq_no: 71 written { offset: 70 } } acks { seq_no: 72 written { offset: 71 } } acks { seq_no: 73 written { offset: 72 } } acks { seq_no: 74 written { offset: 73 } } acks { seq_no: 75 written { offset: 74 } } acks { seq_no: 76 written { offset: 75 } } acks { seq_no: 77 written { offset: 76 } } acks { seq_no: 78 written { offset: 77 } } acks { seq_no: 79 written { offset: 78 } } acks { seq_no: 80 written { offset: 79 } } acks { seq_no: 81 written { offset: 80 } } acks { seq_no: 82 written { offset: 81 } } acks { seq_no: 83 written { offset: 82 } } acks { seq_no: 84 written { offset: 83 } } acks { seq_no: 85 written { offset: 84 } } acks { seq_no: 86 written { offset: 85 } } acks { seq_no: 87 written { offset: 86 } } acks { seq_no: 88 written { offset: 87 } } acks { seq_no: 89 written { offset: 88 } } acks { seq_no: 90 written { offset: 89 } } acks { seq_no: 91 written { offset: 90 } } acks { seq_no: 92 written { offset: 91 } } write_statistics { persisting_time { nanos: 2000000 } min_queue_wait_time { nanos: 1000000 } max_queue_wait_time { nanos: 1000000 } partition_quota_wait_time { } topic_quota_wait_time { } }
2025-10-10T14:31:02.187538Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:02.187542Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 34, partNo: 0, Offset: 33 is stored on disk
2025-10-10T14:31:02.187544Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:02.187548Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 35, partNo: 0, Offset: 34 is stored on disk
2025-10-10T14:31:02.187550Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:02.187553Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 36, partNo: 0, Offset: 35 is stored on disk
2025-10-10T14:31:02.189978Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] OnAck: seqNo=5, txId=?
2025-10-10T14:31:02.187555Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:02.187560Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 37, partNo: 0, Offset: 36 is stored on disk
2025-10-10T14:31:02.187562Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:02.187566Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 38, partNo: 0, Offset: 37 is stored on disk
2025-10-10T14:31:02.187568Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:02.190422Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write session: acknoledged message 5
2025-10-10T14:31:02.190443Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] OnAck: seqNo=6, txId=?
2025-10-10T14:31:02.190445Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write session: acknoledged message 6
2025-10-10T14:31:02.190448Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] OnAck: seqNo=7, txId=?
2025-10-10T14:31:02.190450Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write session: acknoledged message 7
2025-10-10T14:31:02.187571Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 39, partNo: 0, Offset: 38 is stored on disk
2025-10-10T14:31:02.190455Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] OnAck: seqNo=8, txId=?
2025-10-10T14:31:02.187573Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:02.190458Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write session: acknoledged message 8
2025-10-10T14:31:02.187576Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 40, partNo: 0, Offset: 39 is stored on disk
2025-10-10T14:31:02.187578Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:02.187581Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 41, partNo: 0, Offset: 40 is stored on disk
2025-10-10T14:31:02.190465Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] OnAck: seqNo=9, txId=?
2025-10-10T14:31:02.187583Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:02.187586Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 42, partNo: 0, Offset: 41 is stored on disk
2025-10-10T14:31:02.187597Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:02.190469Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write session: acknoledged message 9
2025-10-10T14:31:02.187600Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 43, partNo: 0, Offset: 42 is stored on disk
2025-10-10T14:31:02.190481Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] OnAck: seqNo=10, txId=?
2025-10-10T14:31:02.190488Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write session: acknoledged message 10
2025-10-10T14:31:02.187602Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:02.190492Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] OnAck: seqNo=11, txId=?
2025-10-10T14:31:02.187606Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 44, partNo: 0, Offset: 43 is stored on disk
2025-10-10T14:31:02.187608Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:02.187612Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 45, partNo: 0, Offset: 44 is stored on disk
2025-10-10T14:31:02.187614Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:02.190495Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write session: acknoledged message 11
2025-10-10T14:31:02.187619Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 46, partNo: 0, Offset: 45 is stored on disk
2025-10-10T14:31:02.190510Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] OnAck: seqNo=12, txId=?
2025-10-10T14:31:02.190515Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write session: acknoledged message 12
2025-10-10T14:31:02.187621Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:02.187624Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 47, partNo: 0, Offset: 46 is stored on disk
2025-10-10T14:31:02.190519Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] OnAck: seqNo=13, txId=?
2025-10-10T14:31:02.187626Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:02.187629Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 48, partNo: 0, Offset: 47 is stored on disk
2025-10-10T14:31:02.190522Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write session: acknoledged message 13
2025-10-10T14:31:02.187631Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:02.187634Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 49, partNo: 0, Offset: 48 is stored on disk
2025-10-10T14:31:02.190526Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] OnAck: seqNo=14, txId=?
2025-10-10T14:31:02.187636Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:02.187639Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 50, partNo: 0, Offset: 49 is stored on disk
2025-10-10T14:31:02.187641Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:02.187644Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 51, partNo: 0, Offset: 50 is stored on disk
2025-10-10T14:31:02.187646Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:02.187649Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 52, partNo: 0, Offset: 51 is stored on disk
2025-10-10T14:31:02.187651Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:02.187655Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 53, partNo: 0, Offset: 52 is stored on disk
2025-10-10T14:31:02.187657Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:02.187660Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 54, partNo: 0, Offset: 53 is stored on disk
2025-10-10T14:31:02.190529Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write session: acknoledged message 14
2025-10-10T14:31:02.187663Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:02.187667Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 55, partNo: 0, Offset: 54 is stored on disk
2025-10-10T14:31:02.187668Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:02.187672Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 56, partNo: 0, Offset: 55 is stored on disk
2025-10-10T14:31:02.190659Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] OnAck: seqNo=15, txId=?
2025-10-10T14:31:02.187674Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:02.190662Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write session: acknoledged message 15
2025-10-10T14:31:02.190669Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] OnAck: seqNo=16, txId=?
2025-10-10T14:31:02.190673Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write session: acknoledged message 16
2025-10-10T14:31:02.187676Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 57, partNo: 0, Offset: 56 is stored on disk
2025-10-10T14:31:02.190676Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] OnAck: seqNo=17, txId=?
2025-10-10T14:31:02.190681Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write session: acknoledged message 17
2025-10-10T14:31:02.187678Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:02.190684Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] OnAck: seqNo=18, txId=?
2025-10-10T14:31:02.187682Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 58, partNo: 0, Offset: 57 is stored on disk
2025-10-10T14:31:02.190686Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write session: acknoledged message 18
2025-10-10T14:31:02.190689Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] OnAck: seqNo=19, txId=?
2025-10-10T14:31:02.190691Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write session: acknoledged message 19
2025-10-10T14:31:02.190693Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] OnAck: seqNo=20, txId=?
2025-10-10T14:31:02.190696Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write session: acknoledged message 20
2025-10-10T14:31:02.187684Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:02.190699Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] OnAck: seqNo=21, txId=?
2025-10-10T14:31:02.187687Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 59, partNo: 0, Offset: 58 is stored on disk
2025-10-10T14:31:02.190701Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write session: acknoledged message 21
2025-10-10T14:31:02.190707Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] OnAck: seqNo=22, txId=?
2025-10-10T14:31:02.187689Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:02.190709Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write session: acknoledged message 22
2025-10-10T14:31:02.187692Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 60, partNo: 0, Offset: 59 is stored on disk
2025-10-10T14:31:02.190712Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] OnAck: seqNo=23, txId=?
2025-10-10T14:31:02.187694Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:02.190714Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write session: acknoledged message 23
2025-10-10T14:31:02.187698Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 61, partNo: 0, Offset: 60 is stored on disk
2025-10-10T14:31:02.190717Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] OnAck: seqNo=24, txId=?
2025-10-10T14:31:02.187700Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:02.190719Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write session: acknoledged message 24
2025-10-10T14:31:02.187704Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 62, partNo: 0, Offset: 61 is stored on disk
2025-10-10T14:31:02.187706Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:02.190723Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] OnAck: seqNo=25, txId=?
2025-10-10T14:31:02.187708Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 63, partNo: 0, Offset: 62 is stored on disk
2025-10-10T14:31:02.190726Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write session: acknoledged message 25
2025-10-10T14:31:02.191146Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] OnAck: seqNo=26, txId=?
2025-10-10T14:31:02.187710Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:02.191149Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write session: acknoledged message 26
2025-10-10T14:31:02.191152Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] OnAck: seqNo=27, txId=?
2025-10-10T14:31:02.187713Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 64, partNo: 0, Offset: 63 is stored on disk
2025-10-10T14:31:02.191154Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write session: acknoledged message 27
2025-10-10T14:31:02.187716Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:02.187719Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 65, partNo: 0, Offset: 64 is stored on disk
2025-10-10T14:31:02.187721Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:02.187724Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 66, partNo: 0, Offset: 65 is stored on disk
2025-10-10T14:31:02.187726Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:02.191157Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] OnAck: seqNo=28, txId=?
2025-10-10T14:31:02.187729Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 67, partNo: 0, Offset: 66 is stored on disk
2025-10-10T14:31:02.187731Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:02.187734Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 68, partNo: 0, Offset: 67 is stored on disk
2025-10-10T14:31:02.187736Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:02.187741Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 69, partNo: 0, Offset: 68 is stored on disk
2025-10-10T14:31:02.191169Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write session: acknoledged message 28
2025-10-10T14:31:02.187742Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:02.187746Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 70, partNo: 0, Offset: 69 is stored on disk
2025-10-10T14:31:02.187748Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:02.187751Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 71, partNo: 0, Offset: 70 is stored on disk
2025-10-10T14:31:02.191184Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] OnAck: seqNo=29, txId=?
2025-10-10T14:31:02.191197Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write session: acknoledged message 29
2025-10-10T14:31:02.187753Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:02.191199Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] OnAck: seqNo=30, txId=?
2025-10-10T14:31:02.187756Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 72, partNo: 0, Offset: 71 is stored on disk
2025-10-10T14:31:02.191202Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write session: acknoledged message 30
2025-10-10T14:31:02.187758Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:02.187762Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 73, partNo: 0, Offset: 72 is stored on disk
2025-10-10T14:31:02.191204Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] OnAck: seqNo=31, txId=?
2025-10-10T14:31:02.187764Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:02.191207Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write session: acknoledged message 31
2025-10-10T14:31:02.187767Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 74, partNo: 0, Offset: 73 is stored on disk
2025-10-10T14:31:02.191209Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] OnAck: seqNo=32, txId=?
2025-10-10T14:31:02.191214Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write session: acknoledged message 32
2025-10-10T14:31:02.191219Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] OnAck: seqNo=33, txId=?
2025-10-10T14:31:02.187769Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:02.191221Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write session: acknoledged message 33
2025-10-10T14:31:02.187771Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 75, partNo: 0, Offset: 74 is stored on disk
2025-10-10T14:31:02.187773Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:02.187776Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 76, partNo: 0, Offset: 75 is stored on disk
2025-10-10T14:31:02.187779Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:02.187784Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 77, partNo: 0, Offset: 76 is stored on disk
2025-10-10T14:31:02.191224Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] OnAck: seqNo=34, txId=?
2025-10-10T14:31:02.187787Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:02.191591Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write session: acknoledged message 34
2025-10-10T14:31:02.191595Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] OnAck: seqNo=35, txId=?
2025-10-10T14:31:02.187792Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 78, partNo: 0, Offset: 77 is stored on disk
2025-10-10T14:31:02.191597Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write session: acknoledged message 35
2025-10-10T14:31:02.187794Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:02.191600Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] OnAck: seqNo=36, txId=?
2025-10-10T14:31:02.187798Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 79, partNo: 0, Offset: 78 is stored on disk
2025-10-10T14:31:02.191602Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write session: acknoledged message 36
2025-10-10T14:31:02.187801Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:02.191605Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] OnAck: seqNo=37, txId=?
2025-10-10T14:31:02.187805Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 80, partNo: 0, Offset: 79 is stored on disk
2025-10-10T14:31:02.187807Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:02.187810Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 81, partNo: 0, Offset: 80 is stored on disk
2025-10-10T14:31:02.187812Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:02.191608Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write session: acknoledged message 37
2025-10-10T14:31:02.191622Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] OnAck: seqNo=38, txId=?
2025-10-10T14:31:02.191628Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write session: acknoledged message 38
2025-10-10T14:31:02.191634Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] OnAck: seqNo=39, txId=?
2025-10-10T14:31:02.191639Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write session: acknoledged message 39
2025-10-10T14:31:02.187814Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 82, partNo: 0, Offset: 81 is stored on disk
2025-10-10T14:31:02.191643Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] OnAck: seqNo=40, txId=?
2025-10-10T14:31:02.191645Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write session: acknoledged message 40
2025-10-10T14:31:02.191648Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] OnAck: seqNo=41, txId=?
2025-10-10T14:31:02.191650Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write session: acknoledged message 41
2025-10-10T14:31:02.187816Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:02.187820Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 83, partNo: 0, Offset: 82 is stored on disk
2025-10-10T14:31:02.187823Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:02.187825Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 84, partNo: 0, Offset: 83 is stored on disk
2025-10-10T14:31:02.187827Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:02.191653Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] OnAck: seqNo=42, txId=?
2025-10-10T14:31:02.191666Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write session: acknoledged message 42
2025-10-10T14:31:02.187830Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 85, partNo: 0, Offset: 84 is stored on disk
2025-10-10T14:31:02.191669Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] OnAck: seqNo=43, txId=?
2025-10-10T14:31:02.191674Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write session: acknoledged message 43
2025-10-10T14:31:02.187832Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:02.191678Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] OnAck: seqNo=44, txId=?
2025-10-10T14:31:02.187834Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 86, partNo: 0, Offset: 85 is stored on disk
2025-10-10T14:31:02.187836Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:02.187838Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 87, partNo: 0, Offset: 86 is stored on disk
2025-10-10T14:31:02.191680Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write session: acknoledged message 44
2025-10-10T14:31:02.187853Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:02.187857Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 88, partNo: 0, Offset: 87 is stored on disk
2025-10-10T14:31:02.191954Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] OnAck: seqNo=45, txId=?
2025-10-10T14:31:02.191959Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write session: acknoledged message 45
2025-10-10T14:31:02.187859Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:02.191962Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] OnAck: seqNo=46, txId=?
2025-10-10T14:31:02.187862Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 89, partNo: 0, Offset: 88 is stored on disk
2025-10-10T14:31:02.191968Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write session: acknoledged message 46
2025-10-10T14:31:02.187863Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:02.187867Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 90, partNo: 0, Offset: 89 is stored on disk
2025-10-10T14:31:02.187869Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:02.187880Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 91, partNo: 0, Offset: 90 is stored on disk
2025-10-10T14:31:02.191977Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] OnAck: seqNo=47, txId=?
2025-10-10T14:31:02.187882Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:02.191979Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write session: acknoledged message 47
2025-10-10T14:31:02.187885Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 92, partNo: 0, Offset: 91 is stored on disk
2025-10-10T14:31:02.191983Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] OnAck: seqNo=48, txId=?
2025-10-10T14:31:02.187887Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:02.187890Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 93, partNo: 0, Offset: 92 is stored on disk
2025-10-10T14:31:02.187892Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:02.191988Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write session: acknoledged message 48
2025-10-10T14:31:02.187895Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 94, partNo: 0, Offset: 93 is stored on disk
2025-10-10T14:31:02.192000Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] OnAck: seqNo=49, txId=?
2025-10-10T14:31:02.187918Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:02.192003Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write session: acknoledged message 49
2025-10-10T14:31:02.187925Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:02.192006Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] OnAck: seqNo=50, txId=?
2025-10-10T14:31:02.192008Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write session: acknoledged message 50
2025-10-10T14:31:02.187926Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (6)
2025-10-10T14:31:02.192011Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] OnAck: seqNo=51, txId=?
2025-10-10T14:31:02.187938Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 95 partNo 0
2025-10-10T14:31:02.192013Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write session: acknoledged message 51
2025-10-10T14:31:02.187957Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 95 partNo 0 FormedBlobsCount 0 NewHead: Offset 94 PartNo 0 PackedSize 173 count 1 nextOffset 95 batches 1
2025-10-10T14:31:02.192015Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] OnAck: seqNo=52, txId=?
2025-10-10T14:31:02.187962Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 96 partNo 0
2025-10-10T14:31:02.192018Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write session: acknoledged message 52
2025-10-10T14:31:02.187966Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 96 partNo 0 FormedBlobsCount 0 NewHead: Offset 94 PartNo 0 PackedSize 314 count 2 nextOffset 96 batches 1
2025-10-10T14:31:02.187969Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 97 partNo 0
2025-10-10T14:31:02.192021Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] OnAck: seqNo=53, txId=?
2025-10-10T14:31:02.187973Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 97 partNo 0 FormedBlobsCount 0 NewHead: Offset 94 PartNo 0 PackedSize 455 count 3 nextOffset 97 batches 1
2025-10-10T14:31:02.187976Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 98 partNo 0
2025-10-10T14:31:02.187980Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 98 partNo 0 FormedBlobsCount 0 NewHead: Offset 94 PartNo 0 PackedSize 596 count 4 nextOffset 98 batches 1
2025-10-10T14:31:02.192385Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write session: acknoledged message 53
2025-10-10T14:31:02.187983Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 99 partNo 0
2025-10-10T14:31:02.187990Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 99 partNo 0 FormedBlobsCount 0 NewHead: Offset 94 PartNo 0 PackedSize 737 count 5 nextOffset 99 batches 1
2025-10-10T14:31:02.192398Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] OnAck: seqNo=54, txId=?
2025-10-10T14:31:02.192403Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write session: acknoledged message 54
2025-10-10T14:31:02.187993Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 100 partNo 0
2025-10-10T14:31:02.192405Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] OnAck: seqNo=55, txId=?
2025-10-10T14:31:02.192407Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write session: acknoledged message 55
2025-10-10T14:31:02.187996Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 100 partNo 0 FormedBlobsCount 0 NewHead: Offset 94 PartNo 0 PackedSize 878 count 6 nextOffset 100 batches 1
2025-10-10T14:31:02.192409Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] OnAck: seqNo=56, txId=?
2025-10-10T14:31:02.187998Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:02.192411Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write session: acknoledged message 56
2025-10-10T14:31:02.188039Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 94,6 HeadOffset 94 endOffset 94 curOffset 100 d0000000000_00000000000000000094_00000_0000000006_00000? size 740 WTime 1760106662187
2025-10-10T14:31:02.188053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:182: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:31:02.192413Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] OnAck: seqNo=57, txId=?
2025-10-10T14:31:02.192427Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write session: acknoledged message 57
2025-10-10T14:31:02.188182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 4  requestId: <none> cookie: 2
2025-10-10T14:31:02.192429Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] OnAck: seqNo=58, txId=?
2025-10-10T14:31:02.188198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 5  requestId: <none> cookie: 3
2025-10-10T14:31:02.188202Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:31:02.192431Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write session: acknoledged message 58
2025-10-10T14:31:02.192442Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] OnAck: seqNo=59, txId=?
2025-10-10T14:31:02.188213Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 94 partNo 0 count 6 size 740
2025-10-10T14:31:02.192443Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write session: acknoledged message 59
2025-10-10T14:31:02.192449Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] OnAck: seqNo=60, txId=?
2025-10-10T14:31:02.192450Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write session: acknoledged message 60
2025-10-10T14:31:02.192452Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] OnAck: seqNo=61, txId=?
2025-10-10T14:31:02.192453Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write session: acknoledged message 61
2025-10-10T14:31:02.192454Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] OnAck: seqNo=62, txId=?
2025-10-10T14:31:02.188748Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 94 count 6 size 740 actorID [2:7559600544377417321:2381]
2025-10-10T14:31:02.192456Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write session: acknoledged message 62
2025-10-10T14:31:02.188761Z node 2 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:31:02.192457Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] OnAck: seqNo=63, txId=?
2025-10-10T14:31:02.188771Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 636 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:31:02.188775Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:02.192459Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write session: acknoledged message 63
2025-10-10T14:31:02.192470Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] OnAck: seqNo=64, txId=?
2025-10-10T14:31:02.188781Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 95, partNo: 0, Offset: 94 is stored on disk
2025-10-10T14:31:02.188781Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 94 partno 0 count 6 parts 0 suffix '63' size 740
2025-10-10T14:31:02.188784Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:02.192472Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write session: acknoledged message 64
2025-10-10T14:31:02.188786Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 96, partNo: 0, Offset: 95 is stored on disk
2025-10-10T14:31:02.188788Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:02.192940Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] OnAck: seqNo=65, txId=?
2025-10-10T14:31:02.192942Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write session: acknoledged message 65
2025-10-10T14:31:02.188791Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 97, partNo: 0, Offset: 96 is stored on disk
2025-10-10T14:31:02.192945Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] OnAck: seqNo=66, txId=?
2025-10-10T14:31:02.188793Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:02.192946Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write session: acknoledged message 66
2025-10-10T14:31:02.188796Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 98, partNo: 0, Offset: 97 is stored on disk
2025-10-10T14:31:02.192949Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] OnAck: seqNo=67, txId=?
2025-10-10T14:31:02.192954Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write session: acknoledged message 67
2025-10-10T14:31:02.188798Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:02.192957Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] OnAck: seqNo=68, txId=?
2025-10-10T14:31:02.188808Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 99, partNo: 0, Offset: 98 is stored on disk
2025-10-10T14:31:02.192959Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write session: acknoledged message 68
2025-10-10T14:31:02.188810Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:02.192961Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] OnAck: seqNo=69, txId=?
2025-10-10T14:31:02.188813Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 100, partNo: 0, Offset: 99 is stored on disk
2025-10-10T14:31:02.188829Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:02.188831Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:02.188832Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:02.188836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:182: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:31:02.192965Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write session: acknoledged message 69
2025-10-10T14:31:02.188844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 8  requestId: <none> cookie: 4
2025-10-10T14:31:02.188854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 9  requestId: <none> cookie: 5
2025-10-10T14:31:02.192978Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] OnAck: seqNo=70, txId=?
2025-10-10T14:31:02.192980Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write session: acknoledged message 70
2025-10-10T14:31:02.192983Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] OnAck: seqNo=71, txId=?
2025-10-10T14:31:02.192985Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write session: acknoledged message 71
2025-10-10T14:31:02.192987Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] OnAck: seqNo=72, txId=?
2025-10-10T14:31:02.192989Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write session: acknoledged message 72
2025-10-10T14:31:02.192991Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] OnAck: seqNo=73, txId=?
2025-10-10T14:31:02.192993Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write session: acknoledged message 73
2025-10-10T14:31:02.192995Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] OnAck: seqNo=74, txId=?
2025-10-10T14:31:02.192998Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write session: acknoledged message 74
2025-10-10T14:31:02.193000Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] OnAck: seqNo=75, txId=?
2025-10-10T14:31:02.193003Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write session: acknoledged message 75
2025-10-10T14:31:02.193005Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] OnAck: seqNo=76, txId=?
2025-10-10T14:31:02.193007Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write session: acknoledged message 76
2025-10-10T14:31:02.193009Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] OnAck: seqNo=77, txId=?
2025-10-10T14:31:02.193011Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write session: acknoledged message 77
2025-10-10T14:31:02.193014Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] OnAck: seqNo=78, txId=?
2025-10-10T14:31:02.193016Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write session: acknoledged message 78
2025-10-10T14:31:02.193508Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] OnAck: seqNo=79, txId=?
2025-10-10T14:31:02.193511Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write session: acknoledged message 79
2025-10-10T14:31:02.193514Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] OnAck: seqNo=80, txId=?
2025-10-10T14:31:02.193516Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write session: acknoledged message 80
2025-10-10T14:31:02.193519Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] OnAck: seqNo=81, txId=?
2025-10-10T14:31:02.193521Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write session: acknoledged message 81
2025-10-10T14:31:02.193524Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] OnAck: seqNo=82, txId=?
2025-10-10T14:31:02.193526Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write session: acknoledged message 82
2025-10-10T14:31:02.193528Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] OnAck: seqNo=83, txId=?
2025-10-10T14:31:02.193531Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write session: acknoledged message 83
2025-10-10T14:31:02.193533Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] OnAck: seqNo=84, txId=?
2025-10-10T14:31:02.193535Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write session: acknoledged message 84
2025-10-10T14:31:02.193537Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] OnAck: seqNo=85, txId=?
2025-10-10T14:31:02.193540Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write session: acknoledged message 85
2025-10-10T14:31:02.193542Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] OnAck: seqNo=86, txId=?
2025-10-10T14:31:02.193544Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write session: acknoledged message 86
2025-10-10T14:31:02.193546Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] OnAck: seqNo=87, txId=?
2025-10-10T14:31:02.193549Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write session: acknoledged message 87
2025-10-10T14:31:02.193551Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] OnAck: seqNo=88, txId=?
2025-10-10T14:31:02.193553Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write session: acknoledged message 88
2025-10-10T14:31:02.193556Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] OnAck: seqNo=89, txId=?
2025-10-10T14:31:02.193558Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write session: acknoledged message 89
2025-10-10T14:31:02.193560Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] OnAck: seqNo=90, txId=?
2025-10-10T14:31:02.193562Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write session: acknoledged message 90
2025-10-10T14:31:02.193565Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] OnAck: seqNo=91, txId=?
2025-10-10T14:31:02.193566Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write session: acknoledged message 91
2025-10-10T14:31:02.193569Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] OnAck: seqNo=92, txId=?
2025-10-10T14:31:02.193572Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write session: acknoledged message 92
2025-10-10T14:31:02.193689Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write session: OnReadDone gRpcStatusCode: 0
2025-10-10T14:31:02.193720Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write session got write response: acks { seq_no: 93 written { offset: 92 } } acks { seq_no: 94 written { offset: 93 } } write_statistics { persisting_time { nanos: 1000000 } min_queue_wait_time { nanos: 1000000 } max_queue_wait_time { nanos: 1000000 } partition_quota_wait_time { } topic_quota_wait_time { } }
2025-10-10T14:31:02.193723Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] OnAck: seqNo=93, txId=?
2025-10-10T14:31:02.193725Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write session: acknoledged message 93
2025-10-10T14:31:02.193728Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] OnAck: seqNo=94, txId=?
2025-10-10T14:31:02.193730Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write session: acknoledged message 94
2025-10-10T14:31:02.193756Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write session: OnReadDone gRpcStatusCode: 0
2025-10-10T14:31:02.193769Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write session got write response: acks { seq_no: 95 written { offset: 94 } } acks { seq_no: 96 written { offset: 95 } } acks { seq_no: 97 written { offset: 96 } } write_statistics { persisting_time { nanos: 1000000 } min_queue_wait_time { nanos: 1000000 } max_queue_wait_time { nanos: 1000000 } partition_quota_wait_time { } topic_quota_wait_time { } }
2025-10-10T14:31:02.193771Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] OnAck: seqNo=95, txId=?
2025-10-10T14:31:02.193773Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write session: acknoledged message 95
2025-10-10T14:31:02.193776Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] OnAck: seqNo=96, txId=?
2025-10-10T14:31:02.193778Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write session: acknoledged message 96
2025-10-10T14:31:02.193781Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] OnAck: seqNo=97, txId=?
2025-10-10T14:31:02.193783Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write session: acknoledged message 97
2025-10-10T14:31:02.193805Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write session: OnReadDone gRpcStatusCode: 0
2025-10-10T14:31:02.193818Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write session got write response: acks { seq_no: 98 written { offset: 97 } } acks { seq_no: 99 written { offset: 98 } } acks { seq_no: 100 written { offset: 99 } } write_statistics { persisting_time { nanos: 1000000 } min_queue_wait_time { nanos: 1000000 } max_queue_wait_time { nanos: 1000000 } partition_quota_wait_time { } topic_quota_wait_time { } }
2025-10-10T14:31:02.193821Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] OnAck: seqNo=98, txId=?
2025-10-10T14:31:02.193977Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write session: acknoledged message 98
2025-10-10T14:31:02.193981Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] OnAck: seqNo=99, txId=?
2025-10-10T14:31:02.193983Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write session: acknoledged message 99
2025-10-10T14:31:02.193986Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] OnAck: seqNo=100, txId=?
2025-10-10T14:31:02.193988Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write session: acknoledged message 100
2025-10-10T14:31:02.194078Z :INFO: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write session: close. Timeout 0.000000s
2025-10-10T14:31:02.194087Z :INFO: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write session will now close
2025-10-10T14:31:02.194097Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write session: aborting
2025-10-10T14:31:02.194228Z :INFO: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write session: gracefully shut down, all writes complete
2025-10-10T14:31:02.194232Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0]  MessageGroupId [src_id] Write session: destroy
2025-10-10T14:31:02.194399Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0 grpc read done: success: 0 data: 
2025-10-10T14:31:02.194410Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 2 sessionId: src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0 grpc read failed
2025-10-10T14:31:02.194417Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 2 sessionId: src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0 grpc closed
2025-10-10T14:31:02.194422Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2 sessionId: src_id|2d2c5201-5fe88f66-49955dc8-1ee3e849_0 is DEAD
2025-10-10T14:31:02.194736Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-10-10T14:31:02.194863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [1:7559600553857089096:2484] destroyed
2025-10-10T14:31:02.194882Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-10-10T14:31:02.194888Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:02.194889Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:02.194891Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:02.262444Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:02.262463Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:02.262466Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:02.362799Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:02.362818Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:02.362821Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:02.683086Z :WriteSessionCloseIgnoresWrites INFO: Random seed for debugging is 1760106662683082
2025-10-10T14:31:02.743043Z node 3 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[3:7559600552098522339:2152];send_to=[0:7307199536658146131:7762515];
2025-10-10T14:31:02.743079Z node 3 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-10-10T14:31:02.744437Z node 4 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[4:7559600552885133042:2148];send_to=[0:7307199536658146131:7762515];
2025-10-10T14:31:02.744472Z node 4 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
test_client.cpp: SetPath # /home/runner/.ya/build/build_root/z96o/002b39/r3tmp/tmpkNURGt/pdisk_1.dat
2025-10-10T14:31:02.745258Z node 3 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-10-10T14:31:02.745716Z node 3 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-10T14:31:02.746310Z node 4 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-10-10T14:31:02.746681Z node 4 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-10T14:31:02.758301Z node 3 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-10-10T14:31:02.762032Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(4, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-10T14:31:02.762050Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(4, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-10T14:31:02.763098Z node 3 :HIVE WARN: hive_impl.cpp:811: HIVE#72057594037968897 Handle TEvInterconnect::TEvNodeConnected, NodeId 4 Cookie 4
2025-10-10T14:31:02.763335Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(4, (0,0,0,0)) VolatileState: Connecting -> Connected
TServer::EnableGrpc on GrpcPort 11804, node 3
2025-10-10T14:31:02.769126Z node 3 :NET_CLASSIFIER WARN: net_classifier.cpp:190: distributable config is empty, broken or outdated, will use file: /home/runner/.ya/build/build_root/z96o/002b39/r3tmp/yandexPBCr6s.tmp
2025-10-10T14:31:02.769137Z node 3 :NET_CLASSIFIER WARN: net_classifier.cpp:196: will try to initialize from file: /home/runner/.ya/build/build_root/z96o/002b39/r3tmp/yandexPBCr6s.tmp
2025-10-10T14:31:02.769186Z node 3 :NET_CLASSIFIER WARN: net_classifier.cpp:202: successfully initialized from file: /home/runner/.ya/build/build_root/z96o/002b39/r3tmp/yandexPBCr6s.tmp
2025-10-10T14:31:02.769232Z node 3 :NET_CLASSIFIER ERROR: net_classifier.cpp:228: got bad distributable configuration
2025-10-10T14:31:02.771518Z INFO: TTestServer started on Port 14626 GrpcPort 11804
TClient is connected to server localhost:14626
PQClient connected to localhost:11804
WaitRootIsUp 'Root'...
TClient::Ls request: Root
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "Root"
    PathId: 1
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 1
    CreateStep: 0
    ParentPathId: 1
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 1
      SubDomainVersion: 0
      SecurityStateVersion: 0
    }
    ChildrenExist: false
  }
  Children {
    Name: ".sys"
    PathId: 18446744073709551615
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 0
    CreateStep: 0
    ParentPathId: 18446744073709551615
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 0
      Pl...
(TRUNCATED)
WaitRootIsUp 'Root' success.
2025-10-10T14:31:02.844255Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(3, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-10T14:31:02.844297Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(3, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-10T14:31:02.845774Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(3, (0,0,0,0)) VolatileState: Connecting -> Connected
2025-10-10T14:31:02.845937Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpAlterSubDomain, opId: 281474976720657:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_alter_subdomain.cpp:311)
waiting...
waiting...
waiting...
waiting...
2025-10-10T14:31:02.898689Z node 3 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-10-10T14:31:02.976182Z node 4 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-10-10T14:31:03.039709Z node 3 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:566: Compilation failed, self: [3:7559600556393490446:2318], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-10T14:31:03.040464Z node 3 :KQP_SESSION WARN: kqp_session_actor.cpp:2408: SessionId: ydb://session/3?node_id=3&id=ZjNlODkxZDItYTUwMmIwYmYtNzE5ZTVmZTEtM2ZhNGZjODQ=, ActorId: [3:7559600556393490443:2316], ActorState: ExecuteState, TraceId: 01k778gk3v0gfg2yxfmxwtrzcf, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-10T14:31:03.040606Z node 3 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-10-10T14:31:03.043764Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720661:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-10T14:31:03.048446Z node 4 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:566: Compilation failed, self: [4:7559600557180100551:2289], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-10T14:31:03.048533Z node 4 :KQP_SESSION WARN: kqp_session_actor.cpp:2408: SessionId: ydb://session/3?node_id=4&id=Njk2MGIxMzUtMTU1NTc2NjItMmY1YTM1YmQtMTMwYTdhYjk=, ActorId: [4:7559600557180100549:2288], ActorState: ExecuteState, TraceId: 01k778gk44ccd8pv8cws70e8zy, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-10T14:31:03.048641Z node 4 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-10-10T14:31:03.058100Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720662:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-10T14:31:03.076378Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720663:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
=== Init DC: UPSERT INTO `/Root/PQ/Config/V2/Cluster` (name, balancer, local, enabled, weight) VALUES ("dc1", "localhost:11804", true, true, 1000), ("dc2", "dc2.logbroker.yandex.net", false, false, 1000);
2025-10-10T14:31:03.109558Z node 3 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976720664. Ctx: { TraceId: 01k778gk5hbacwxdb5gpfezq0z, Database: , SessionId: ydb://session/3?node_id=3&id=MjY1Njk5ZDYtZTZjYjVhNmUtMWY1NWU0YS1hZjU3YTc0MQ==, PoolId: , DatabaseId: /Root}. Database not set, use /Root
=== CheckClustersList. Subcribe to ClusterTracker from [3:7559600556393490875:2924] 
2025-10-10T14:31:03.745176Z node 3 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-10-10T14:31:03.746179Z node 4 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-10-10T14:31:07.743383Z node 3 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[3:7559600552098522339:2152];send_to=[0:7307199536658146131:7762515];
2025-10-10T14:31:07.743422Z node 3 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
2025-10-10T14:31:07.744434Z node 4 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[4:7559600552885133042:2148];send_to=[0:7307199536658146131:7762515];
2025-10-10T14:31:07.744470Z node 4 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
=== CheckClustersList. Ok
2025-10-10T14:31:08.219452Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720676:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
waiting...
PQ Client: create topic: rt3.dc1--test-topic with 1 partitions
CallPersQueueGRPC request to localhost:11804
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-10T14:31:08.233185Z node 3 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
CallPersQueueGRPC request to localhost:11804
MetaRequest {
  CmdCreateTopic {
    Topic: "rt3.dc1--test-topic"
    NumPartitions: 1
    Config {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
  }
}
CallPersQueueGRPC response:
Status: 129
ProxyErrorCode: 53
SchemeStatus: 1
FlatTxId {
  TxId: 281474976720677
  SchemeShardTabletId: 72057594046644480
  PathId: 9
}
ErrorCode: OK
AddTopic: rt3.dc1--test-topic
===Run query:``DECLARE $version as Int64; DECLARE $path AS Utf8; DECLARE $cluster as Utf8; UPSERT INTO `/Root/PQ/Config/V2/Topics` (path, dc) VALUES ($path, $cluster); UPSERT INTO `/Root/PQ/Config/V2/Versions` (name, version) VALUES ("Topics", $version);`` with topic = test-topic, dc = dc1
2025-10-10T14:31:08.238461Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:08.238698Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][] pipe [3:7559600577868327924:3247] connected; active server actors: 1
2025-10-10T14:31:08.238892Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1517: [72075186224037893][rt3.dc1--test-topic] updating configuration. Deleted partitions []. Added partitions [0]
2025-10-10T14:31:08.238979Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:940: [72075186224037893][rt3.dc1--test-topic] Discovered subdomain [OwnerId: 72057594046644480, LocalPathId: 1] state, outOfSpace = 0 at RB 72075186224037893
2025-10-10T14:31:08.238968Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:08.239022Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:784: [PQ: 72075186224037892] no config, start with empty partitions and default config
2025-10-10T14:31:08.239035Z node 3 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:08.239048Z node 3 :PERSQUEUE INFO: pq_impl.cpp:609: [PQ: 72075186224037892] doesn't have tx writes info
2025-10-10T14:31:08.239098Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [3:7559600577868327923:3246], now have 1 active actors on pipe
2025-10-10T14:31:08.239218Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 3, Generation 1
2025-10-10T14:31:08.239250Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-10T14:31:08.239262Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [4:7559600578654937459:2370], now have 1 active actors on pipe
2025-10-10T14:31:08.239332Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:138: [72075186224037893][rt3.dc1--test-topic] BALANCER INIT DONE for rt3.dc1--test-topic: (0, 72075186224037892) 
2025-10-10T14:31:08.239891Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-10T14:31:08.243075Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [3:7559600577868327990:3298], now have 1 active actors on pipe
2025-10-10T14:31:08.243142Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-10T14:31:08.243755Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-10T14:31:08.243887Z node 3 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:08.243899Z node 3 :PERSQUEUE DEBUG: partition.cpp:1277: [72075186224037892][Partition][0][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-10-10T14:31:08.243942Z node 3 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:08.243975Z node 3 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [3:7559600577868328001:2448]
2025-10-10T14:31:08.244605Z node 3 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:08.244612Z node 3 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:08.244617Z node 3 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1 [3:7559600577868328001:2448]
2025-10-10T14:31:08.244623Z node 3 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-10-10T14:31:08.244884Z node 3 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 1
2025-10-10T14:31:08.244894Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:08.244910Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:08.244916Z node 3 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:08.244919Z node 3 :PERSQUEUE DEBUG: partition.cpp:2345: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-10T14:31:08.244921Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:08.244923Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:08.244925Z node 3 :PERSQUEUE DEBUG: partition.cpp:2345: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-10T14:31:08.244933Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:08.244986Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-10T14:31:08.245009Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
===Query complete
TClient::Ls request: /Root/PQ/rt3.dc1--test-topic
2025-10-10T14:31:08.245719Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-10T14:31:08.245739Z node 3 :PERSQUEUE DEBUG: partition.cpp:1381: [72075186224037892][Partition][0][StateIdle] Handle TEvPQ::TEvTxCommit Step 1760106668292, TxId 281474976720677
2025-10-10T14:31:08.245742Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:08.245743Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:08.245759Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:08.245787Z node 3 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:31:08.246057Z node 3 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:31:08.246150Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:490: [72075186224037892][Partition][0][StateIdle] Received TPartition::Handle TEvHandleWriteResponse.
2025-10-10T14:31:08.246181Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:31:08.246186Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:08.246188Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:08.246190Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:08.246193Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:31:08.246262Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:395: [PQ: 72075186224037892] Apply new config PartitionConfig { LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 } PartitionIds: 0 TopicName: "rt3.dc1--test-topic" Version: 0 LocalDC: true Codecs { Ids: 0 Ids: 1 Ids: 2 Codecs: "raw" Codecs: "gzip" Codecs: "lzop" } TopicPath: "/Root/PQ/rt3.dc1--test-topic" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } Consumers { Name: "user" ReadFromTimestampsMs: 0 FormatVersion: 0 Version: 0 Generation: 0 } MonitoringProjectId: ""
2025-10-10T14:31:08.246274Z node 3 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:08.246307Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-10T14:31:08.246889Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-10T14:31:08.246901Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-10T14:31:08.247248Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-10T14:31:08.254893Z node 3 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976720678. Ctx: { TraceId: 01k778gr6dawwygy51wczfqgkv, Database: , SessionId: ydb://session/3?node_id=3&id=MWVlOGRkNWMtNTMzODA5MGMtM2I3ZDllMzAtZmIzMzkwMDQ=, PoolId: , DatabaseId: /Root}. Database not set, use /Root
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976720677
    CreateStep: 1760106668292
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: ...
(TRUNCATED)
GetTopicVersionFromPath:  record Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976720677
    CreateStep: 1760106668292
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      YdbDatabasePath: "/Root"
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
    Partitions {
      PartitionId: 0
      TabletId: 72075186224037892
      Status: Active
    }
    AlterVersion: 1
    BalancerTabletID: 72075186224037893
    NextPartitionId: 1
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 1
      PlanResolution: 7
      Coordinators: 72057594046316545
      TimeCastBucketsPerMediator: 2
      Mediators: 72057594046382081
    }
    DomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    PathsInside: 8
    PathsLimit: 10000
    ShardsInside: 6
    ShardsLimit: 200000
    ResourcesDomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    DiskSpaceUsage {
      Tables {
        TotalSize: 0
        DataSize: 0
        IndexSize: 0
      }
      Topics {
        ReserveSize: 0
        AccountSize: 0
        DataSize: 0
        UsedReserveSize: 0
      }
    }
    PQPartitionsInside: 1
    PQPartitionsLimit: 1000000
    SchemeLimits {
      MaxDepth: 32
      MaxPaths: 10000
      MaxChildrenInDir: 100000
      MaxAclBytesSize: 10240
      MaxTableColumns: 200
      MaxTableColumnNameLength: 255
      MaxTableKeyColumns: 30
      MaxTableIndices: 20
      MaxShards: 200000
      MaxShardsInPath: 35000
      MaxConsistentCopyTargets: 10000
      MaxPathElementLength: 255
      ExtraPathSymbolsAllowed: "!\"#$%&\'()*+,-.:;<=>?@[\\]^_`{|}~"
      MaxPQPartitions: 1000000
      MaxTableCdcStreams: 5
      MaxExports: 10
      MaxImports: 10
      MaxColumnTableColumns: 10000
    }
  }
}
Path: "/Root/PQ/rt3.dc1--test-topic"
 name rt3.dc1--test-topic version1
CallPersQueueGRPC request to localhost:11804
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-10T14:31:08.312189Z node 3 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-10-10T14:31:08.345001Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:08.345018Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:08.345021Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:08.445379Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:08.445397Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:08.445400Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:08.545686Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:08.545704Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:08.545708Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:08.646063Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:08.646081Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:08.646083Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:08.746395Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:08.746414Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:08.746416Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:11804
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-10T14:31:08.813434Z node 3 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-10-10T14:31:08.846759Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:08.846774Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:08.846776Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:08.947064Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:08.947077Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:08.947079Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:09.047463Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:09.047478Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:09.047480Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:09.147820Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:09.147837Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:09.147848Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:09.248136Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:09.248148Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:09.248149Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:11804
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-10T14:31:09.315087Z node 3 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--test-topic"
      NumPartitions: 1
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        TopicPath: "/Root/PQ/rt3.dc1--test-topic"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Version: 0
        }
      }
      ErrorCode: OK
    }
  }
}
=== Topic created, have version: 1
2025-10-10T14:31:09.316125Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: try to update token
2025-10-10T14:31:09.316360Z :INFO: [] MessageGroupId [src] SessionId [] Write session: Do CDS request
2025-10-10T14:31:09.316365Z :INFO: [] MessageGroupId [src] SessionId [] Start write session. Will connect to endpoint: localhost:11804
2025-10-10T14:31:09.316691Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src" }
2025-10-10T14:31:09.316776Z node 3 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:09.316788Z node 3 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1
2025-10-10T14:31:09.316895Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src" }
2025-10-10T14:31:09.316923Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1 topic: "test-topic" message_group_id: "src" from ipv6:[::1]:34566
2025-10-10T14:31:09.316931Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:34566 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:09.316934Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:09.317286Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1 sessionId:  describe result for acl check
2025-10-10T14:31:09.317314Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:09.317316Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:09.317317Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:09.317322Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [3:7559600582163295495:2485] (SourceId=src, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:09.317892Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [3:7559600582163295495:2485] (SourceId=src, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:09.335691Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [3:7559600582163295495:2485] (SourceId=src, PreferedPartition=(NULL)) RequestPQRB
2025-10-10T14:31:09.335802Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [3:7559600582163295526:2485] connected; active server actors: 1
2025-10-10T14:31:09.335869Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [3:7559600582163295495:2485] (SourceId=src, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=src
2025-10-10T14:31:09.335877Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [3:7559600582163295495:2485] (SourceId=src, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:09.335955Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [3:7559600582163295526:2485] disconnected; active server actors: 1
2025-10-10T14:31:09.335964Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--test-topic] pipe [3:7559600582163295526:2485] disconnected no session
2025-10-10T14:31:09.348700Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:09.348712Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:09.348714Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:09.351614Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [3:7559600582163295495:2485] (SourceId=src, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:09.351630Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [3:7559600582163295495:2485] (SourceId=src, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-10-10T14:31:09.351633Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [3:7559600582163295495:2485] (SourceId=src, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:09.351641Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:09.351771Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 3, Generation: 1
2025-10-10T14:31:09.351786Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [3:7559600582163295541:2485], now have 1 active actors on pipe
2025-10-10T14:31:09.351798Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:09.351809Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:09.351838Z node 3 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src|90ac2249-e9f5dca0-a6ca6863-9c91c5ad_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src
2025-10-10T14:31:09.351851Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:09.351860Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:09.351862Z node 3 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:09.351873Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:09.351890Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:09.351906Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:09.351943Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:09.351953Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:09.351982Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:09.352019Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1 partition: 0 MaxSeqNo: 0 sessionId: src|90ac2249-e9f5dca0-a6ca6863-9c91c5ad_0
2025-10-10T14:31:09.352354Z :INFO: [] MessageGroupId [src] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1760106669352 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-10T14:31:09.416871Z :INFO: [] MessageGroupId [src] SessionId [] Write session established. Init response: session_id: "src|90ac2249-e9f5dca0-a6ca6863-9c91c5ad_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:09.417009Z :INFO: [] MessageGroupId [src] SessionId [src|90ac2249-e9f5dca0-a6ca6863-9c91c5ad_0] Write session: close. Timeout = 0 ms
2025-10-10T14:31:09.417016Z :INFO: [] MessageGroupId [src] SessionId [src|90ac2249-e9f5dca0-a6ca6863-9c91c5ad_0] Write session will now close
2025-10-10T14:31:09.417021Z :DEBUG: [] MessageGroupId [src] SessionId [src|90ac2249-e9f5dca0-a6ca6863-9c91c5ad_0] Write session: aborting
2025-10-10T14:31:09.417150Z :INFO: [] MessageGroupId [src] SessionId [src|90ac2249-e9f5dca0-a6ca6863-9c91c5ad_0] Write session: gracefully shut down, all writes complete
2025-10-10T14:31:09.417300Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId: src|90ac2249-e9f5dca0-a6ca6863-9c91c5ad_0 grpc read done: success: 0 data: 
2025-10-10T14:31:09.417309Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 1 sessionId: src|90ac2249-e9f5dca0-a6ca6863-9c91c5ad_0 grpc read failed
2025-10-10T14:31:09.417316Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 1 sessionId: src|90ac2249-e9f5dca0-a6ca6863-9c91c5ad_0 grpc closed
2025-10-10T14:31:09.417322Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1 sessionId: src|90ac2249-e9f5dca0-a6ca6863-9c91c5ad_0 is DEAD
2025-10-10T14:31:09.417563Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-10-10T14:31:09.417603Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [3:7559600582163295541:2485] destroyed
2025-10-10T14:31:09.417616Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-10-10T14:31:09.417624Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:09.417626Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:09.417627Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:09.417797Z :DEBUG: [] MessageGroupId [src] SessionId [src|90ac2249-e9f5dca0-a6ca6863-9c91c5ad_0] Write session: destroy
Session was created
2025-10-10T14:31:09.448848Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:09.448859Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:09.448861Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
>>> Ready to answer: ok
2025-10-10T14:31:09.470781Z :ERROR: [/Root] OnFederationDiscovery: Got error. Status: UNAVAILABLE. Description: 
2025-10-10T14:31:09.549196Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:09.549208Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:09.549210Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:09.649556Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:09.649569Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:09.649571Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:09.749896Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:09.749908Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:09.749909Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:09.850268Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:09.850283Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:09.850285Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:09.950628Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:09.950644Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:09.950648Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:10.050987Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:10.051001Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:10.051003Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:10.151329Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:10.151343Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:10.151346Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:10.251663Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:10.251679Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:10.251681Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:10.352028Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:10.352060Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:10.352062Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:10.452361Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:10.452377Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:10.452379Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:10.552737Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:10.552752Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:10.552754Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:10.653084Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:10.653097Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:10.653100Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:10.753411Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:10.753428Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:10.753430Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:10.853793Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:10.853807Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:10.853809Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:10.954136Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:10.954150Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:10.954152Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:11.054443Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:11.054464Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:11.054466Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:11.154833Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:11.154850Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:11.154853Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:11.255216Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:11.255230Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:11.255233Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:11.355548Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:11.355563Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:11.355565Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:11.455889Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:11.455901Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:11.455904Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:11.556241Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:11.556258Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:11.556260Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:11.656607Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:11.656621Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:11.656623Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:11.756938Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:11.756950Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:11.756951Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:11.857273Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:11.857291Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:11.857294Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:11.957625Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:11.957641Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:11.957644Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:12.058009Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:12.058023Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:12.058026Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:12.158376Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:12.158394Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:12.158397Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:12.258731Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:12.258747Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:12.258750Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:12.359060Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:12.359074Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:12.359076Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:12.459427Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:12.459442Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:12.459445Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:12.559785Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:12.559802Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:12.559805Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:12.660126Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:12.660141Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:12.660143Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:30:54.380446Z :WriteSessionNoAvailableDatabase INFO: Random seed for debugging is 1760106654380442
2025-10-10T14:30:54.467376Z node 1 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[1:7559600518490427756:2078];send_to=[0:7307199536658146131:7762515];
2025-10-10T14:30:54.467775Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-10-10T14:30:54.472061Z node 1 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-10-10T14:30:54.472629Z node 2 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[2:7559600520480699995:2150];send_to=[0:7307199536658146131:7762515];
2025-10-10T14:30:54.472735Z node 2 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
test_client.cpp: SetPath # /home/runner/.ya/build/build_root/z96o/002b4d/r3tmp/tmp6yXM86/pdisk_1.dat
2025-10-10T14:30:54.474963Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-10-10T14:30:54.510173Z node 1 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-10T14:30:54.512946Z node 1 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-10-10T14:30:54.513030Z node 2 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
TServer::EnableGrpc on GrpcPort 14596, node 1
2025-10-10T14:30:54.529948Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:190: distributable config is empty, broken or outdated, will use file: /home/runner/.ya/build/build_root/z96o/002b4d/r3tmp/yandexVrny6M.tmp
2025-10-10T14:30:54.529961Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:196: will try to initialize from file: /home/runner/.ya/build/build_root/z96o/002b4d/r3tmp/yandexVrny6M.tmp
2025-10-10T14:30:54.530035Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:202: successfully initialized from file: /home/runner/.ya/build/build_root/z96o/002b4d/r3tmp/yandexVrny6M.tmp
2025-10-10T14:30:54.530085Z node 1 :NET_CLASSIFIER ERROR: net_classifier.cpp:228: got bad distributable configuration
2025-10-10T14:30:54.534540Z INFO: TTestServer started on Port 30918 GrpcPort 14596
TClient is connected to server localhost:30918
PQClient connected to localhost:14596
WaitRootIsUp 'Root'...
TClient::Ls request: Root
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "Root"
    PathId: 1
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 1
    CreateStep: 0
    ParentPathId: 1
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 1
      SubDomainVersion: 0
      SecurityStateVersion: 0
    }
    ChildrenExist: false
  }
  Children {
    Name: ".sys"
    PathId: 18446744073709551615
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 0
    CreateStep: 0
    ParentPathId: 18446744073709551615
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 0
      Pl...
(TRUNCATED)
WaitRootIsUp 'Root' success.
2025-10-10T14:30:54.569197Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-10T14:30:54.569225Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-10T14:30:54.570692Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Connecting -> Connected
2025-10-10T14:30:54.574522Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpAlterSubDomain, opId: 281474976720657:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_alter_subdomain.cpp:311)
2025-10-10T14:30:54.575033Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-10T14:30:54.575073Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-10T14:30:54.576039Z node 1 :HIVE WARN: hive_impl.cpp:811: HIVE#72057594037968897 Handle TEvInterconnect::TEvNodeConnected, NodeId 2 Cookie 2
2025-10-10T14:30:54.576337Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Connecting -> Connected
waiting...
waiting...
waiting...
waiting...
2025-10-10T14:30:54.672433Z node 2 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-10-10T14:30:54.681964Z node 1 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-10-10T14:30:54.840706Z node 1 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:566: Compilation failed, self: [1:7559600518490428650:2318], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-10T14:30:54.840775Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2408: SessionId: ydb://session/3?node_id=1&id=MzIwM2UxYi1mNzM2N2NlLWRkZjI5ZTEyLTgzZGMzYTk3, ActorId: [1:7559600518490428647:2316], ActorState: ExecuteState, TraceId: 01k778gb2r0w7fxw91k8w0dbgg, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-10T14:30:54.840867Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720661:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-10T14:30:54.841144Z node 1 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-10-10T14:30:54.862222Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720662:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-10T14:30:54.877380Z node 2 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:566: Compilation failed, self: [2:7559600520480700251:2293], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:5:17: Error: At function: KiReadTable!
        <main>:5:17: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Versions]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-10T14:30:54.877464Z node 2 :KQP_SESSION WARN: kqp_session_actor.cpp:2408: SessionId: ydb://session/3?node_id=2&id=YTFkMWEyNjMtZjI5OWRkOWEtMzFiMTdiOWItYmM3NDM5N2I=, ActorId: [2:7559600520480700249:2292], ActorState: ExecuteState, TraceId: 01k778gb4r1htg68g79txdv533, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-10T14:30:54.877596Z node 2 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 5 column: 17 } message: "At function: KiReadTable!" end_position { row: 5 column: 17 } severity: 1 issues { position { row: 5 column: 17 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Versions]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 5 column: 17 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-10-10T14:30:54.882442Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720663:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
=== Init DC: UPSERT INTO `/Root/PQ/Config/V2/Cluster` (name, balancer, local, enabled, weight) VALUES ("dc1", "localhost:14596", true, true, 1000), ("dc2", "dc2.logbroker.yandex.net", false, false, 1000);
2025-10-10T14:30:54.918148Z node 1 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976720664. Ctx: { TraceId: 01k778gb5hamn5pmj1wrf8jttf, Database: , SessionId: ydb://session/3?node_id=1&id=MmRmNWNjY2MtNzUxZmNlNGItYWU3MmFkYTAtOGM3Y2JmZmU=, PoolId: , DatabaseId: /Root}. Database not set, use /Root
=== CheckClustersList. Subcribe to ClusterTracker from [1:7559600518490429022:2880] 
2025-10-10T14:30:55.469616Z node 1 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-10-10T14:30:55.474755Z node 2 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-10-10T14:30:59.467811Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[1:7559600518490427756:2078];send_to=[0:7307199536658146131:7762515];
2025-10-10T14:30:59.467840Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
2025-10-10T14:30:59.472967Z node 2 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[2:7559600520480699995:2150];send_to=[0:7307199536658146131:7762515];
2025-10-10T14:30:59.473000Z node 2 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
=== CheckClustersList. Ok
2025-10-10T14:31:00.016056Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720676:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
waiting...
PQ Client: create topic: rt3.dc1--test-topic with 1 partitions
CallPersQueueGRPC request to localhost:14596
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-10T14:31:00.032997Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
CallPersQueueGRPC request to localhost:14596
MetaRequest {
  CmdCreateTopic {
    Topic: "rt3.dc1--test-topic"
    NumPartitions: 1
    Config {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
  }
}
CallPersQueueGRPC response:
Status: 129
ProxyErrorCode: 53
SchemeStatus: 1
FlatTxId {
  TxId: 281474976720677
  SchemeShardTabletId: 72057594046644480
  PathId: 9
}
ErrorCode: OK
AddTopic: rt3.dc1--test-topic
===Run query:``DECLARE $version as Int64; DECLARE $path AS Utf8; DECLARE $cluster as Utf8; UPSERT INTO `/Root/PQ/Config/V2/Topics` (path, dc) VALUES ($path, $cluster); UPSERT INTO `/Root/PQ/Config/V2/Versions` (name, version) VALUES ("Topics", $version);`` with topic = test-topic, dc = dc1
2025-10-10T14:31:00.039397Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][] pipe [1:7559600544260233302:3169] connected; active server actors: 1
2025-10-10T14:31:00.039502Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1517: [72075186224037893][rt3.dc1--test-topic] updating configuration. Deleted partitions []. Added partitions [0]
2025-10-10T14:31:00.039592Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:940: [72075186224037893][rt3.dc1--test-topic] Discovered subdomain [OwnerId: 72057594046644480, LocalPathId: 1] state, outOfSpace = 0 at RB 72075186224037893
2025-10-10T14:31:00.039857Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:138: [72075186224037893][rt3.dc1--test-topic] BALANCER INIT DONE for rt3.dc1--test-topic: (0, 72075186224037892) 
2025-10-10T14:31:00.042252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:00.042659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:00.042697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:784: [PQ: 72075186224037892] no config, start with empty partitions and default config
2025-10-10T14:31:00.042707Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:00.042718Z node 2 :PERSQUEUE INFO: pq_impl.cpp:609: [PQ: 72075186224037892] doesn't have tx writes info
2025-10-10T14:31:00.042784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600544260233324:2438], now have 1 active actors on pipe
2025-10-10T14:31:00.042794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600544260233301:3168], now have 1 active actors on pipe
2025-10-10T14:31:00.042836Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1
2025-10-10T14:31:00.042908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-10T14:31:00.043640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-10T14:31:00.044803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600544260233360:3216], now have 1 active actors on pipe
2025-10-10T14:31:00.044917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-10T14:31:00.045609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-10T14:31:00.045829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:00.045854Z node 2 :PERSQUEUE DEBUG: partition.cpp:1277: [72075186224037892][Partition][0][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-10-10T14:31:00.045890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:00.045964Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600546250504501:2377]
2025-10-10T14:31:00.046470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:00.046479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:00.046482Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1 [2:7559600546250504501:2377]
2025-10-10T14:31:00.046486Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-10-10T14:31:00.046714Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 1
2025-10-10T14:31:00.046723Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:00.046742Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:00.046748Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:00.046750Z node 2 :PERSQUEUE DEBUG: partition.cpp:2345: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-10T14:31:00.046752Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:00.046752Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:00.046753Z node 2 :PERSQUEUE DEBUG: partition.cpp:2345: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-10T14:31:00.046760Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:00.046803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-10T14:31:00.046828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:31:00.047797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-10T14:31:00.047837Z node 2 :PERSQUEUE DEBUG: partition.cpp:1381: [72075186224037892][Partition][0][StateIdle] Handle TEvPQ::TEvTxCommit Step 1760106660088, TxId 281474976720677
2025-10-10T14:31:00.047847Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:00.047849Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:00.047873Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:00.047922Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:31:00.048392Z node 2 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:31:00.048454Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:31:00.048466Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:00.048468Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:00.048470Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:00.048474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:31:00.048566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:395: [PQ: 72075186224037892] Apply new config PartitionConfig { LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 } PartitionIds: 0 TopicName: "rt3.dc1--test-topic" Version: 0 LocalDC: true Codecs { Ids: 0 Ids: 1 Ids: 2 Codecs: "raw" Codecs: "gzip" Codecs: "lzop" } TopicPath: "/Root/PQ/rt3.dc1--test-topic" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } Consumers { Name: "user" ReadFromTimestampsMs: 0 FormatVersion: 0 Version: 0 Generation: 0 } MonitoringProjectId: ""
2025-10-10T14:31:00.048589Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:00.048624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-10T14:31:00.049378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-10T14:31:00.049397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-10T14:31:00.049780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-10T14:31:00.054358Z node 1 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976720678. Ctx: { TraceId: 01k778gg65545j2j63fg7rybjf, Database: , SessionId: ydb://session/3?node_id=1&id=NzQ2NTIyNTEtOTVkZTNkOTgtYmU4NTY4N2YtYmJiNzczOTE=, PoolId: , DatabaseId: /Root}. Database not set, use /Root
===Query complete
TClient::Ls request: /Root/PQ/rt3.dc1--test-topic
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976720677
    CreateStep: 1760106660088
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: ...
(TRUNCATED)
GetTopicVersionFromPath:  record Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976720677
    CreateStep: 1760106660088
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      YdbDatabasePath: "/Root"
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
    Partitions {
      PartitionId: 0
      TabletId: 72075186224037892
      Status: Active
    }
    AlterVersion: 1
    BalancerTabletID: 72075186224037893
    NextPartitionId: 1
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 1
      PlanResolution: 7
      Coordinators: 72057594046316545
      TimeCastBucketsPerMediator: 2
      Mediators: 72057594046382081
    }
    DomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    PathsInside: 8
    PathsLimit: 10000
    ShardsInside: 6
    ShardsLimit: 200000
    ResourcesDomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    DiskSpaceUsage {
      Tables {
        TotalSize: 0
        DataSize: 0
        IndexSize: 0
      }
      Topics {
        ReserveSize: 0
        AccountSize: 0
        DataSize: 0
        UsedReserveSize: 0
      }
    }
    PQPartitionsInside: 1
    PQPartitionsLimit: 1000000
    SchemeLimits {
      MaxDepth: 32
      MaxPaths: 10000
      MaxChildrenInDir: 100000
      MaxAclBytesSize: 10240
      MaxTableColumns: 200
      MaxTableColumnNameLength: 255
      MaxTableKeyColumns: 30
      MaxTableIndices: 20
      MaxShards: 200000
      MaxShardsInPath: 35000
      MaxConsistentCopyTargets: 10000
      MaxPathElementLength: 255
      ExtraPathSymbolsAllowed: "!\"#$%&\'()*+,-.:;<=>?@[\\]^_`{|}~"
      MaxPQPartitions: 1000000
      MaxTableCdcStreams: 5
      MaxExports: 10
      MaxImports: 10
      MaxColumnTableColumns: 10000
    }
  }
}
Path: "/Root/PQ/rt3.dc1--test-topic"
 name rt3.dc1--test-topic version1
CallPersQueueGRPC request to localhost:14596
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-10T14:31:00.060021Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-10-10T14:31:00.146732Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:00.146744Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:00.146746Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:00.247079Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:00.247093Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:00.247095Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:00.347468Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:00.347482Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:00.347485Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:00.447812Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:00.447826Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:00.447828Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:00.548168Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:00.548180Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:00.548183Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:14596
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-10T14:31:00.561140Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-10-10T14:31:00.648513Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:00.648528Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:00.648530Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:00.748860Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:00.748874Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:00.748876Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:00.849220Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:00.849235Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:00.849238Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:00.949580Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:00.949604Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:00.949606Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:01.049907Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:01.049932Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:01.049936Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:14596
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-10T14:31:01.062662Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--test-topic"
      NumPartitions: 1
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        TopicPath: "/Root/PQ/rt3.dc1--test-topic"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Version: 0
        }
      }
      ErrorCode: OK
    }
  }
}
=== Topic created, have version: 1
2025-10-10T14:31:01.063727Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: try to update token
2025-10-10T14:31:01.063983Z :INFO: [] MessageGroupId [src] SessionId [] Write session: Do CDS request
2025-10-10T14:31:01.063990Z :INFO: [] MessageGroupId [src] SessionId [] Start write session. Will connect to endpoint: localhost:14596
2025-10-10T14:31:01.064465Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:01.064475Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1
2025-10-10T14:31:01.066053Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src" }
2025-10-10T14:31:01.066246Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src" }
2025-10-10T14:31:01.066297Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1 topic: "test-topic" message_group_id: "src" from ipv6:[::1]:35648
2025-10-10T14:31:01.066306Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:35648 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:01.066317Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:01.066672Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1 sessionId:  describe result for acl check
2025-10-10T14:31:01.066712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:01.066717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:01.066718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:01.066721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600548555200822:2471] (SourceId=src, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:01.067091Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600548555200822:2471] (SourceId=src, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:01.088145Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [1:7559600548555200822:2471] (SourceId=src, PreferedPartition=(NULL)) RequestPQRB
2025-10-10T14:31:01.088211Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559600548555200857:2471] connected; active server actors: 1
2025-10-10T14:31:01.088234Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [1:7559600548555200822:2471] (SourceId=src, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=src
2025-10-10T14:31:01.088238Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600548555200822:2471] (SourceId=src, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:01.088299Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559600548555200857:2471] disconnected; active server actors: 1
2025-10-10T14:31:01.088305Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559600548555200857:2471] disconnected no session
2025-10-10T14:31:01.101824Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600548555200822:2471] (SourceId=src, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:01.101835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600548555200822:2471] (SourceId=src, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-10-10T14:31:01.101837Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600548555200822:2471] (SourceId=src, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:01.101842Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:01.102029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600548555200875:2471], now have 1 active actors on pipe
2025-10-10T14:31:01.102074Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1
2025-10-10T14:31:01.102109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:01.102119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:01.102140Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src|d1c94b36-5a8699a9-9488bc-ff087f37_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src
2025-10-10T14:31:01.102152Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:01.102156Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:01.102157Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:01.102166Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:01.102189Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:01.102203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:01.102370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:01.102378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:01.102388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:01.102478Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1 partition: 0 MaxSeqNo: 0 sessionId: src|d1c94b36-5a8699a9-9488bc-ff087f37_0
2025-10-10T14:31:01.102714Z :INFO: [] MessageGroupId [src] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1760106661102 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-10T14:31:01.102740Z :INFO: [] MessageGroupId [src] SessionId [] Write session established. Init response: session_id: "src|d1c94b36-5a8699a9-9488bc-ff087f37_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:01.102832Z :INFO: [] MessageGroupId [src] SessionId [src|d1c94b36-5a8699a9-9488bc-ff087f37_0] Write session: close. Timeout = 0 ms
2025-10-10T14:31:01.102841Z :INFO: [] MessageGroupId [src] SessionId [src|d1c94b36-5a8699a9-9488bc-ff087f37_0] Write session will now close
2025-10-10T14:31:01.102846Z :DEBUG: [] MessageGroupId [src] SessionId [src|d1c94b36-5a8699a9-9488bc-ff087f37_0] Write session: aborting
2025-10-10T14:31:01.102974Z :INFO: [] MessageGroupId [src] SessionId [src|d1c94b36-5a8699a9-9488bc-ff087f37_0] Write session: gracefully shut down, all writes complete
2025-10-10T14:31:01.102978Z :DEBUG: [] MessageGroupId [src] SessionId [src|d1c94b36-5a8699a9-9488bc-ff087f37_0] Write session: destroy
2025-10-10T14:31:01.103093Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId: src|d1c94b36-5a8699a9-9488bc-ff087f37_0 grpc read done: success: 0 data: 
2025-10-10T14:31:01.103100Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 1 sessionId: src|d1c94b36-5a8699a9-9488bc-ff087f37_0 grpc read failed
2025-10-10T14:31:01.103106Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 1 sessionId: src|d1c94b36-5a8699a9-9488bc-ff087f37_0 grpc closed
2025-10-10T14:31:01.103110Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1 sessionId: src|d1c94b36-5a8699a9-9488bc-ff087f37_0 is DEAD
2025-10-10T14:31:01.103302Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-10-10T14:31:01.103387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [1:7559600548555200875:2471] destroyed
2025-10-10T14:31:01.103397Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-10-10T14:31:01.103400Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:01.103402Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:01.103404Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
Session was created
2025-10-10T14:31:01.150268Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:01.150280Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:01.150282Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
>>> Got event: ReadyToAcceptEvent>>> Ready to answer: ok
2025-10-10T14:31:01.156461Z :ERROR: [/Root] [] [] Failed to select database: no available database. Status: NOT_FOUND
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to select database: no available database " }
2025-10-10T14:31:01.250624Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:01.250636Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:01.250638Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:01.544265Z :WriteSessionSwitchDatabases INFO: Random seed for debugging is 1760106661544259
2025-10-10T14:31:01.601755Z node 3 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[3:7559600549137296338:2157];send_to=[0:7307199536658146131:7762515];
2025-10-10T14:31:01.601792Z node 3 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-10-10T14:31:01.602618Z node 4 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[4:7559600546507167005:2082];send_to=[0:7307199536658146131:7762515];
2025-10-10T14:31:01.602804Z node 4 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-10-10T14:31:01.603009Z node 3 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
test_client.cpp: SetPath # /home/runner/.ya/build/build_root/z96o/002b4d/r3tmp/tmpgQc8jX/pdisk_1.dat
2025-10-10T14:31:01.603124Z node 3 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-10T14:31:01.604202Z node 4 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-10-10T14:31:01.604270Z node 4 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-10T14:31:01.617096Z node 3 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-10-10T14:31:01.620378Z node 4 :CONFIGS_DISPATCHER ERROR: configs_dispatcher.cpp:1229: Notification cookie mismatch for subscription [4:7559600546507166944:2073] 1760106661602390 != 1760106661602387
2025-10-10T14:31:01.621723Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(4, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-10T14:31:01.621744Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(4, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-10T14:31:01.622688Z node 3 :HIVE WARN: hive_impl.cpp:811: HIVE#72057594037968897 Handle TEvInterconnect::TEvNodeConnected, NodeId 4 Cookie 4
2025-10-10T14:31:01.622950Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(4, (0,0,0,0)) VolatileState: Connecting -> Connected
TServer::EnableGrpc on GrpcPort 14001, node 3
2025-10-10T14:31:01.628977Z node 3 :NET_CLASSIFIER WARN: net_classifier.cpp:190: distributable config is empty, broken or outdated, will use file: /home/runner/.ya/build/build_root/z96o/002b4d/r3tmp/yandexngF30c.tmp
2025-10-10T14:31:01.628987Z node 3 :NET_CLASSIFIER WARN: net_classifier.cpp:196: will try to initialize from file: /home/runner/.ya/build/build_root/z96o/002b4d/r3tmp/yandexngF30c.tmp
2025-10-10T14:31:01.629029Z node 3 :NET_CLASSIFIER WARN: net_classifier.cpp:202: successfully initialized from file: /home/runner/.ya/build/build_root/z96o/002b4d/r3tmp/yandexngF30c.tmp
2025-10-10T14:31:01.629065Z node 3 :NET_CLASSIFIER ERROR: net_classifier.cpp:228: got bad distributable configuration
2025-10-10T14:31:01.631926Z INFO: TTestServer started on Port 28937 GrpcPort 14001
TClient is connected to server localhost:28937
PQClient connected to localhost:14001
WaitRootIsUp 'Root'...
TClient::Ls request: Root
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "Root"
    PathId: 1
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 1
    CreateStep: 0
    ParentPathId: 1
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 1
      SubDomainVersion: 0
      SecurityStateVersion: 0
    }
    ChildrenExist: false
  }
  Children {
    Name: ".sys"
    PathId: 18446744073709551615
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 0
    CreateStep: 0
    ParentPathId: 18446744073709551615
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 0
      Pl...
(TRUNCATED)
WaitRootIsUp 'Root' success.
2025-10-10T14:31:01.646280Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpAlterSubDomain, opId: 281474976710657:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_alter_subdomain.cpp:311)
waiting...
waiting...
waiting...
waiting...
2025-10-10T14:31:01.703415Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(3, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-10T14:31:01.703440Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(3, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-10T14:31:01.704893Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(3, (0,0,0,0)) VolatileState: Connecting -> Connected
2025-10-10T14:31:01.764474Z node 3 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-10-10T14:31:01.793881Z node 4 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-10-10T14:31:01.903185Z node 3 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:566: Compilation failed, self: [3:7559600549137297139:2318], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-10T14:31:01.903607Z node 3 :KQP_SESSION WARN: kqp_session_actor.cpp:2408: SessionId: ydb://session/3?node_id=3&id=OTAxYWMwNmEtYTc4YjNjYWYtZWQ1YmI2NGEtNDdkY2I5Y2I=, ActorId: [3:7559600549137297136:2316], ActorState: ExecuteState, TraceId: 01k778gj0aabsgzpn17d8d2jc4, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-10T14:31:01.903709Z node 3 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-10-10T14:31:01.905505Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710661:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-10T14:31:01.920628Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710662:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-10T14:31:01.939037Z node 4 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:566: Compilation failed, self: [4:7559600546507167342:2293], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:5:17: Error: At function: KiReadTable!
        <main>:5:17: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Versions]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-10T14:31:01.939102Z node 4 :KQP_SESSION WARN: kqp_session_actor.cpp:2408: SessionId: ydb://session/3?node_id=4&id=OWIxMWI0OC02N2JjZDA4My1iYTNlYjVkYi02YWVkYWY3Mw==, ActorId: [4:7559600546507167340:2292], ActorState: ExecuteState, TraceId: 01k778gj1e8n1kfw7y9hvmpfd4, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-10T14:31:01.939191Z node 4 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 5 column: 17 } message: "At function: KiReadTable!" end_position { row: 5 column: 17 } severity: 1 issues { position { row: 5 column: 17 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Versions]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 5 column: 17 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-10-10T14:31:01.940544Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710663:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
=== Init DC: UPSERT INTO `/Root/PQ/Config/V2/Cluster` (name, balancer, local, enabled, weight) VALUES ("dc1", "localhost:14001", true, true, 1000);
2025-10-10T14:31:01.972596Z node 3 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976710664. Ctx: { TraceId: 01k778gj221hrxsydyvvzwntqp, Database: , SessionId: ydb://session/3?node_id=3&id=YjYwMDBjZmMtODE4OGE1MDYtNDg2ZGY3NzUtODM1YWI4N2U=, PoolId: , DatabaseId: /Root}. Database not set, use /Root
=== CheckClustersList. Subcribe to ClusterTracker from [3:7559600549137297569:2921] 
2025-10-10T14:31:02.602828Z node 3 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-10-10T14:31:02.603800Z node 4 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-10-10T14:31:06.602057Z node 3 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[3:7559600549137296338:2157];send_to=[0:7307199536658146131:7762515];
2025-10-10T14:31:06.602091Z node 3 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
2025-10-10T14:31:06.603061Z node 4 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[4:7559600546507167005:2082];send_to=[0:7307199536658146131:7762515];
2025-10-10T14:31:06.603104Z node 4 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
=== CheckClustersList. Ok
2025-10-10T14:31:07.091991Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710676:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
waiting...
PQ Client: create topic: rt3.dc1--test-topic with 1 partitions
CallPersQueueGRPC request to localhost:14001
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-10T14:31:07.105106Z node 3 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
CallPersQueueGRPC request to localhost:14001
MetaRequest {
  CmdCreateTopic {
    Topic: "rt3.dc1--test-topic"
    NumPartitions: 1
    Config {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
  }
}
CallPersQueueGRPC response:
Status: 129
ProxyErrorCode: 53
SchemeStatus: 1
FlatTxId {
  TxId: 281474976710677
  SchemeShardTabletId: 72057594046644480
  PathId: 9
}
ErrorCode: OK
AddTopic: rt3.dc1--test-topic
===Run query:``DECLARE $version as Int64; DECLARE $path AS Utf8; DECLARE $cluster as Utf8; UPSERT INTO `/Root/PQ/Config/V2/Topics` (path, dc) VALUES ($path, $cluster); UPSERT INTO `/Root/PQ/Config/V2/Versions` (name, version) VALUES ("Topics", $version);`` with topic = test-topic, dc = dc1
2025-10-10T14:31:07.110086Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:07.110421Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][] pipe [3:7559600574907101906:3241] connected; active server actors: 1
2025-10-10T14:31:07.110560Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1517: [72075186224037893][rt3.dc1--test-topic] updating configuration. Deleted partitions []. Added partitions [0]
2025-10-10T14:31:07.110702Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:940: [72075186224037893][rt3.dc1--test-topic] Discovered subdomain [OwnerId: 72057594046644480, LocalPathId: 1] state, outOfSpace = 0 at RB 72075186224037893
2025-10-10T14:31:07.110740Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:07.110795Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:784: [PQ: 72075186224037892] no config, start with empty partitions and default config
2025-10-10T14:31:07.110806Z node 3 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:07.110827Z node 3 :PERSQUEUE INFO: pq_impl.cpp:609: [PQ: 72075186224037892] doesn't have tx writes info
2025-10-10T14:31:07.110854Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [3:7559600574907101905:3240], now have 1 active actors on pipe
2025-10-10T14:31:07.111048Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-10T14:31:07.111071Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [4:7559600572276971476:2368], now have 1 active actors on pipe
2025-10-10T14:31:07.111106Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:138: [72075186224037893][rt3.dc1--test-topic] BALANCER INIT DONE for rt3.dc1--test-topic: (0, 72075186224037892) 
2025-10-10T14:31:07.111132Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 3, Generation 1
2025-10-10T14:31:07.112182Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-10T14:31:07.116034Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [3:7559600574907101977:3292], now have 1 active actors on pipe
2025-10-10T14:31:07.116112Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-10T14:31:07.116711Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-10T14:31:07.116842Z node 3 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:07.116856Z node 3 :PERSQUEUE DEBUG: partition.cpp:1277: [72075186224037892][Partition][0][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-10-10T14:31:07.116896Z node 3 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:07.116927Z node 3 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [3:7559600574907101988:2446]
2025-10-10T14:31:07.117426Z node 3 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:07.117433Z node 3 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:07.117437Z node 3 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1 [3:7559600574907101988:2446]
2025-10-10T14:31:07.117441Z node 3 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-10-10T14:31:07.117628Z node 3 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 1
2025-10-10T14:31:07.117638Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:07.117650Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:07.117651Z node 3 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:07.117654Z node 3 :PERSQUEUE DEBUG: partition.cpp:2345: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-10T14:31:07.117655Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:07.117656Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:07.117657Z node 3 :PERSQUEUE DEBUG: partition.cpp:2345: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-10T14:31:07.117663Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:07.117713Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-10T14:31:07.117734Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:31:07.118622Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-10T14:31:07.118650Z node 3 :PERSQUEUE DEBUG: partition.cpp:1381: [72075186224037892][Partition][0][StateIdle] Handle TEvPQ::TEvTxCommit Step 1760106667165, TxId 281474976710677
2025-10-10T14:31:07.118658Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:07.118659Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:07.118678Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:07.118710Z node 3 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:31:07.119070Z node 3 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:31:07.119164Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:490: [72075186224037892][Partition][0][StateIdle] Received TPartition::Handle TEvHandleWriteResponse.
2025-10-10T14:31:07.119204Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:31:07.119213Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:07.119214Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:07.119216Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:07.119220Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:31:07.119311Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:395: [PQ: 72075186224037892] Apply new config PartitionConfig { LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 } PartitionIds: 0 TopicName: "rt3.dc1--test-topic" Version: 0 LocalDC: true Codecs { Ids: 0 Ids: 1 Ids: 2 Codecs: "raw" Codecs: "gzip" Codecs: "lzop" } TopicPath: "/Root/PQ/rt3.dc1--test-topic" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } Consumers { Name: "user" ReadFromTimestampsMs: 0 FormatVersion: 0 Version: 0 Generation: 0 } MonitoringProjectId: ""
2025-10-10T14:31:07.119325Z node 3 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:07.119362Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-10T14:31:07.120249Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-10T14:31:07.120266Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-10T14:31:07.120726Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-10T14:31:07.122846Z node 3 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976710678. Ctx: { TraceId: 01k778gq342a37v2jbhza6s755, Database: , SessionId: ydb://session/3?node_id=3&id=NGRiOTRjYTYtOGNiMWYyMTMtZTRlOGE3ZTMtZjQwY2M3Zjc=, PoolId: , DatabaseId: /Root}. Database not set, use /Root
===Query complete
TClient::Ls request: /Root/PQ/rt3.dc1--test-topic
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976710677
    CreateStep: 1760106667165
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: ...
(TRUNCATED)
GetTopicVersionFromPath:  record Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976710677
    CreateStep: 1760106667165
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      YdbDatabasePath: "/Root"
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
    Partitions {
      PartitionId: 0
      TabletId: 72075186224037892
      Status: Active
    }
    AlterVersion: 1
    BalancerTabletID: 72075186224037893
    NextPartitionId: 1
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 1
      PlanResolution: 7
      Coordinators: 72057594046316545
      TimeCastBucketsPerMediator: 2
      Mediators: 72057594046382081
    }
    DomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    PathsInside: 8
    PathsLimit: 10000
    ShardsInside: 6
    ShardsLimit: 200000
    ResourcesDomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    DiskSpaceUsage {
      Tables {
        TotalSize: 0
        DataSize: 0
        IndexSize: 0
      }
      Topics {
        ReserveSize: 0
        AccountSize: 0
        DataSize: 0
        UsedReserveSize: 0
      }
    }
    PQPartitionsInside: 1
    PQPartitionsLimit: 1000000
    SchemeLimits {
      MaxDepth: 32
      MaxPaths: 10000
      MaxChildrenInDir: 100000
      MaxAclBytesSize: 10240
      MaxTableColumns: 200
      MaxTableColumnNameLength: 255
      MaxTableKeyColumns: 30
      MaxTableIndices: 20
      MaxShards: 200000
      MaxShardsInPath: 35000
      MaxConsistentCopyTargets: 10000
      MaxPathElementLength: 255
      ExtraPathSymbolsAllowed: "!\"#$%&\'()*+,-.:;<=>?@[\\]^_`{|}~"
      MaxPQPartitions: 1000000
      MaxTableCdcStreams: 5
      MaxExports: 10
      MaxImports: 10
      MaxColumnTableColumns: 10000
    }
  }
}
Path: "/Root/PQ/rt3.dc1--test-topic"
 name rt3.dc1--test-topic version1
CallPersQueueGRPC request to localhost:14001
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-10T14:31:07.128160Z node 3 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-10-10T14:31:07.218013Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:07.218027Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:07.218029Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:07.318348Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:07.318361Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:07.318363Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:07.418647Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:07.418658Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:07.418660Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:07.519068Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:07.519084Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:07.519087Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:07.619392Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:07.619411Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:07.619414Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:14001
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-10T14:31:07.629163Z node 3 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-10-10T14:31:07.719747Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:07.719764Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:07.719766Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:07.820061Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:07.820075Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:07.820078Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:07.920465Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:07.920480Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:07.920483Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:08.020817Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:08.020831Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:08.020833Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:08.121153Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:08.121166Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:08.121170Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:14001
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-10T14:31:08.130722Z node 3 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--test-topic"
      NumPartitions: 1
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        TopicPath: "/Root/PQ/rt3.dc1--test-topic"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Version: 0
        }
      }
      ErrorCode: OK
    }
  }
}
=== Topic created, have version: 1
2025-10-10T14:31:08.131855Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: try to update token
2025-10-10T14:31:08.132098Z :INFO: [] MessageGroupId [src] SessionId [] Write session: Do CDS request
2025-10-10T14:31:08.132104Z :INFO: [] MessageGroupId [src] SessionId [] Start write session. Will connect to endpoint: localhost:14001
2025-10-10T14:31:08.132433Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src" }
2025-10-10T14:31:08.132481Z node 3 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:08.132493Z node 3 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1
2025-10-10T14:31:08.132671Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src" }
2025-10-10T14:31:08.132708Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1 topic: "test-topic" message_group_id: "src" from ipv6:[::1]:60084
2025-10-10T14:31:08.132717Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:60084 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:08.132721Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:08.133021Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1 sessionId:  describe result for acl check
2025-10-10T14:31:08.133055Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:08.133062Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:08.133064Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:08.133069Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [3:7559600579202069475:2483] (SourceId=src, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:08.133551Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [3:7559600579202069475:2483] (SourceId=src, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:08.152287Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [3:7559600579202069475:2483] (SourceId=src, PreferedPartition=(NULL)) RequestPQRB
2025-10-10T14:31:08.152404Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [3:7559600579202069513:2483] connected; active server actors: 1
2025-10-10T14:31:08.152504Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [3:7559600579202069475:2483] (SourceId=src, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=src
2025-10-10T14:31:08.152513Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [3:7559600579202069475:2483] (SourceId=src, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:08.152629Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [3:7559600579202069513:2483] disconnected; active server actors: 1
2025-10-10T14:31:08.152642Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--test-topic] pipe [3:7559600579202069513:2483] disconnected no session
2025-10-10T14:31:08.169615Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [3:7559600579202069475:2483] (SourceId=src, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:08.169633Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [3:7559600579202069475:2483] (SourceId=src, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-10-10T14:31:08.169637Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [3:7559600579202069475:2483] (SourceId=src, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:08.169647Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:08.169829Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [3:7559600579202069528:2483], now have 1 active actors on pipe
2025-10-10T14:31:08.169839Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 3, Generation: 1
2025-10-10T14:31:08.169842Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:08.169851Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:08.169895Z node 3 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src|45ee1d63-cfa162e6-8c6a9a5-7eece5b4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src
2025-10-10T14:31:08.169912Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:08.169922Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:08.169925Z node 3 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:08.169941Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:08.169958Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:08.169981Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:08.170050Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:08.170057Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:08.170072Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:08.170109Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1 partition: 0 MaxSeqNo: 0 sessionId: src|45ee1d63-cfa162e6-8c6a9a5-7eece5b4_0
2025-10-10T14:31:08.170459Z :INFO: [] MessageGroupId [src] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1760106668170 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-10T14:31:08.170503Z :INFO: [] MessageGroupId [src] SessionId [] Write session established. Init response: session_id: "src|45ee1d63-cfa162e6-8c6a9a5-7eece5b4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:08.170614Z :INFO: [] MessageGroupId [src] SessionId [src|45ee1d63-cfa162e6-8c6a9a5-7eece5b4_0] Write session: close. Timeout = 0 ms
2025-10-10T14:31:08.170627Z :INFO: [] MessageGroupId [src] SessionId [src|45ee1d63-cfa162e6-8c6a9a5-7eece5b4_0] Write session will now close
2025-10-10T14:31:08.170634Z :DEBUG: [] MessageGroupId [src] SessionId [src|45ee1d63-cfa162e6-8c6a9a5-7eece5b4_0] Write session: aborting
2025-10-10T14:31:08.170824Z :INFO: [] MessageGroupId [src] SessionId [src|45ee1d63-cfa162e6-8c6a9a5-7eece5b4_0] Write session: gracefully shut down, all writes complete
2025-10-10T14:31:08.170828Z :DEBUG: [] MessageGroupId [src] SessionId [src|45ee1d63-cfa162e6-8c6a9a5-7eece5b4_0] Write session: destroy
2025-10-10T14:31:08.170990Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId: src|45ee1d63-cfa162e6-8c6a9a5-7eece5b4_0 grpc read done: success: 0 data: 
2025-10-10T14:31:08.171007Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 1 sessionId: src|45ee1d63-cfa162e6-8c6a9a5-7eece5b4_0 grpc read failed
2025-10-10T14:31:08.171015Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 1 sessionId: src|45ee1d63-cfa162e6-8c6a9a5-7eece5b4_0 grpc closed
2025-10-10T14:31:08.171020Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1 sessionId: src|45ee1d63-cfa162e6-8c6a9a5-7eece5b4_0 is DEAD
2025-10-10T14:31:08.171309Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-10-10T14:31:08.171372Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [3:7559600579202069528:2483] destroyed
2025-10-10T14:31:08.171393Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-10-10T14:31:08.171401Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:08.171404Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:08.171405Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:08.221462Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:08.221477Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:08.221479Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
>>> Got event: ReadyToAcceptEvent
>>> Ready to answer: ok
>>> Got event: ReadyToAcceptEvent
2025-10-10T14:31:08.224289Z :INFO: [/Root] [] [] Start federated write session to database 'dc1' (previous was <empty>) FederationState: { Status: SUCCESS SelfLocation: "fancy_datacenter" DbInfos: [ { name: "dc1" path: "/Root" id: "account-dc1" endpoint: "localhost:14001" location: "dc1" status: AVAILABLE weight: 1000 } { name: "dc2" path: "/Root" id: "account-dc2" endpoint: "localhost:14001" location: "dc2" status: AVAILABLE weight: 500 } { name: "dc3" path: "/Root" id: "account-dc3" endpoint: "localhost:14001" location: "dc3" status: AVAILABLE weight: 500 } ] ControlPlaneEndpoint: cp.logbroker-federation:2135 }
2025-10-10T14:31:08.226221Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: try to update token
2025-10-10T14:31:08.226438Z :INFO: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Start write session. Will connect to nodeId: 0
2025-10-10T14:31:08.286107Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: write to message_group: src_id
2025-10-10T14:31:08.286334Z node 3 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:08.286351Z node 3 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2
2025-10-10T14:31:08.287898Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: send init request: init_request { path: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:08.288057Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: OnWriteDone gRpcStatusCode: 0
2025-10-10T14:31:08.288203Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId:  grpc read done: success: 1 data: init_request { path: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:08.288245Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2 path: "test-topic" message_group_id: "src_id" from ipv6:[::1]:35572
2025-10-10T14:31:08.288250Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2 sessionId= userAgent="topic server" ip=ipv6:[::1]:35572 proto=topic  topic=test-topic durationSec=0
2025-10-10T14:31:08.288253Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:08.288673Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2 sessionId:  describe result for acl check
2025-10-10T14:31:08.288710Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:08.288717Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:08.288719Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:08.288735Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [3:7559600579202069537:2498] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:08.289259Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [3:7559600579202069537:2498] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:08.291705Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [3:7559600579202069537:2498] (SourceId=src_id, PreferedPartition=(NULL)) RequestPQRB
2025-10-10T14:31:08.291862Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [3:7559600579202069557:2498] connected; active server actors: 1
2025-10-10T14:31:08.291980Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [3:7559600579202069537:2498] (SourceId=src_id, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=src_id
2025-10-10T14:31:08.291989Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [3:7559600579202069537:2498] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:08.292064Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [3:7559600579202069557:2498] disconnected; active server actors: 1
2025-10-10T14:31:08.292071Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--test-topic] pipe [3:7559600579202069557:2498] disconnected no session
2025-10-10T14:31:08.294546Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [3:7559600579202069537:2498] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:08.294566Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [3:7559600579202069537:2498] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-10-10T14:31:08.294568Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [3:7559600579202069537:2498] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:08.294575Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:08.294717Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 3, Generation: 1
2025-10-10T14:31:08.294736Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [3:7559600579202069567:2498], now have 1 active actors on pipe
2025-10-10T14:31:08.294745Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:08.294751Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:08.294780Z node 3 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2abe159c-d6edd6cb-721fe2ae-9ed0d186_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:08.294798Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:08.294804Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:08.294810Z node 3 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:08.294825Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:08.294846Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:08.294880Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:08.294918Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:08.294925Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:08.294939Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:08.294972Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2 partition: 0 MaxSeqNo: 0 sessionId: src_id|2abe159c-d6edd6cb-721fe2ae-9ed0d186_0
2025-10-10T14:31:08.295321Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: OnReadDone gRpcStatusCode: 0
2025-10-10T14:31:08.295339Z :INFO: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1760106668295 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-10T14:31:08.295364Z :INFO: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session established. Init response: session_id: "src_id|2abe159c-d6edd6cb-721fe2ae-9ed0d186_0" supported_codecs { codecs: 1 codecs: 2 codecs: 3 }
2025-10-10T14:31:08.295442Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2abe159c-d6edd6cb-721fe2ae-9ed0d186_0]  MessageGroupId [src_id] Write 1 messages with Id from 1 to 1
2025-10-10T14:31:08.295633Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2abe159c-d6edd6cb-721fe2ae-9ed0d186_0]  MessageGroupId [src_id] Write session: try to update token
2025-10-10T14:31:08.295646Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2abe159c-d6edd6cb-721fe2ae-9ed0d186_0]  MessageGroupId [src_id] Send 1 message(s) (0 left), first sequence number is 1
2025-10-10T14:31:08.295895Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|2abe159c-d6edd6cb-721fe2ae-9ed0d186_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:08.296017Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:08.296060Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:08.296069Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:08.296090Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:31:08.296111Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:08.296137Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:08.296143Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:08.296217Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 1 partNo : 0 messageNo: 1 size 98 offset: -1
2025-10-10T14:31:08.296226Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:08.296237Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:08.296243Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:08.296244Z node 3 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:08.296266Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 1 partNo 0
2025-10-10T14:31:08.296303Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 1 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 172 count 1 nextOffset 1 batches 1
2025-10-10T14:31:08.296311Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:08.296347Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 0,1 HeadOffset 0 endOffset 0 curOffset 1 d0000000000_00000000000000000000_00000_0000000001_00000? size 160 WTime 1760106668296
2025-10-10T14:31:08.296369Z node 3 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:31:08.296381Z node 3 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 0 partNo 0 count 1 size 160
2025-10-10T14:31:08.296949Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 0 count 1 size 160 actorID [3:7559600574907101927:2446]
2025-10-10T14:31:08.296965Z node 3 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:31:08.296980Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 105 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:31:08.296989Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:08.296994Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 1, partNo: 0, Offset: 0 is stored on disk
2025-10-10T14:31:08.296997Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63' size 160
2025-10-10T14:31:08.297016Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:08.297024Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:08.297027Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:08.297029Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:08.297030Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:08.297034Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:182: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:31:08.297040Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-10-10T14:31:08.297073Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 1 max time lag 0ms effective offset 0
2025-10-10T14:31:08.297088Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 160 count 1 last offset 0, current partition end offset: 1
2025-10-10T14:31:08.297090Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:08.297091Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:31:08.297097Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 0 partno 0 count 1 parts_count 0 source 1 size 160 accessed 0 times before, last time 2025-10-10T14:31:08.000000Z
2025-10-10T14:31:08.297103Z node 3 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 3. All 1 blobs are from cache.
2025-10-10T14:31:08.297108Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63'
2025-10-10T14:31:08.297113Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:31:08.297124Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 1 count 1 size 140 from pos 0 cbcount 1
2025-10-10T14:31:08.297136Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106668296 queuesize 0 startOffset 0
2025-10-10T14:31:08.297290Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2abe159c-d6edd6cb-721fe2ae-9ed0d186_0]  MessageGroupId [src_id] Write session: OnReadDone gRpcStatusCode: 0
2025-10-10T14:31:08.297397Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2abe159c-d6edd6cb-721fe2ae-9ed0d186_0]  MessageGroupId [src_id] Write session got write response: acks { seq_no: 1 written { } } write_statistics { persisting_time { } min_queue_wait_time { } max_queue_wait_time { } partition_quota_wait_time { } topic_quota_wait_time { } }
2025-10-10T14:31:08.297410Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2abe159c-d6edd6cb-721fe2ae-9ed0d186_0]  MessageGroupId [src_id] OnAck: seqNo=1, txId=?
2025-10-10T14:31:08.297413Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2abe159c-d6edd6cb-721fe2ae-9ed0d186_0]  MessageGroupId [src_id] Write session: acknoledged message 1
2025-10-10T14:31:08.321855Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:08.321869Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:08.321872Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:08.422213Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:08.422226Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:08.422229Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:08.522563Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:08.522577Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:08.522579Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:08.622894Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:08.622907Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:08.622909Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:08.723272Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:08.723287Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:08.723289Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:08.823594Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:08.823617Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:08.823621Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:08.923937Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:08.923951Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:08.923953Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:09.024329Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:09.024342Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:09.024344Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:09.124629Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:09.124645Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:09.124648Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:09.224994Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:09.225009Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:09.225012Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:09.295161Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [3:7559600579202069537:2498] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:09.325367Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:09.325379Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:09.325381Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:09.326233Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [3:7559600579202069537:2498] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=1 Status=SUCCESS
2025-10-10T14:31:09.326249Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [3:7559600579202069537:2498] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:09.425726Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:09.425739Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:09.425741Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:09.526093Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:09.526110Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:09.526114Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:09.626422Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:09.626435Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:09.626437Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:09.726757Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:09.726770Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:09.726772Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:09.827135Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:09.827150Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:09.827153Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:09.927480Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:09.927493Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:09.927496Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:10.027828Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:10.027847Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:10.027849Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:10.128200Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:10.128218Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:10.128222Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:10.228524Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:10.228537Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:10.228538Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:10.328912Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:10.328934Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:10.328936Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:10.429257Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:10.429270Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:10.429272Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:10.529618Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:10.529634Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:10.529636Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:10.629939Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:10.629952Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:10.629954Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:10.730300Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:10.730314Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:10.730316Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:10.830657Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:10.830672Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:10.830674Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:10.931005Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:10.931020Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:10.931023Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:11.031348Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:11.031360Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:11.031363Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:11.131705Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:11.131718Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:11.131720Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:11.232053Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:11.232072Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:11.232074Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:11.332411Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:11.332425Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:11.332428Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:11.432745Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:11.432761Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:11.432764Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:11.533115Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:11.533130Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:11.533132Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:11.633457Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:11.633470Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:11.633472Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:11.733815Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:11.733830Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:11.733833Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:11.834157Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:11.834171Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:11.834173Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:11.934490Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:11.934501Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:11.934503Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
E1010 14:31:11.977763566 2325087 chttp2_transport.cc:1143]             ipv4:127.0.0.1:12586: Received a GOAWAY with error code ENHANCE_YOUR_CALM and debug data equal to "too_many_pings". Current keepalive time (before throttling): 1250ms
2025-10-10T14:31:12.034836Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:12.034850Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:12.034851Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:12.117848Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:182: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:31:12.135222Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:12.135236Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:12.135238Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:12.235590Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:12.235608Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:12.235611Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:12.335970Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:12.335988Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:12.335991Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:12.436311Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:12.436326Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:12.436329Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:12.536664Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:12.536682Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:12.536685Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:12.637000Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:12.637015Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:12.637017Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:12.737325Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:12.737350Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:12.737352Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:12.837714Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:12.837729Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:12.837732Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:12.938057Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:12.938071Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:12.938073Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:13.038391Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:13.038404Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:13.038405Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:13.138736Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:13.138749Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:13.138751Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:13.239096Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:13.239111Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:13.239113Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:13.339456Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:13.339471Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:13.339473Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:13.439806Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:13.439823Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:13.439826Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:13.540170Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:13.540184Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:13.540186Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:13.640482Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:13.640505Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:13.640508Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:13.740875Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:13.740888Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:13.740890Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:13.841236Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:13.841253Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:13.841256Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:13.941587Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:13.941599Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:13.941601Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:14.041942Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:14.041957Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:14.041959Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:14.142265Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:14.142280Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:14.142284Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:14.242647Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:14.242661Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:14.242664Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:14.342978Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:14.342992Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:14.342995Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:14.443328Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:14.443350Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:14.443352Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:14.543692Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:14.543705Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:14.543708Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:14.644031Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:14.644047Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:14.644050Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:14.744398Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:14.744413Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:14.744415Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:14.844739Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:14.844752Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:14.844754Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:14.945100Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:14.945116Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:14.945119Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:15.045457Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:15.045471Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:15.045474Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:15.145785Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:15.145808Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:15.145810Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:15.246157Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:15.246176Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:15.246179Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:15.346487Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:15.346501Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:15.346503Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:15.446847Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:15.446862Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:15.446864Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:15.547180Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:15.547200Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:15.547204Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:15.647542Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:15.647554Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:15.647557Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:15.747895Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:15.747909Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:15.747912Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:15.848246Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:15.848261Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:15.848264Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:15.948605Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:15.948619Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:15.948622Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:16.048963Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:16.048980Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:16.048983Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:16.149307Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:16.149321Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:16.149324Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:16.249676Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:16.249689Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:16.249691Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:16.350045Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:16.350064Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:16.350067Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:16.450387Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:16.450405Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:16.450408Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:16.550747Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:16.550763Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:16.550765Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:16.611633Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard_impl.cpp:7712: Cannot get console configs
2025-10-10T14:31:16.611647Z node 3 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-10-10T14:31:16.651087Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:16.651101Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:16.651103Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:16.751432Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:16.751446Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:16.751449Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:16.851735Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:16.851750Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:16.851752Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:16.952125Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:16.952142Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:16.952145Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:17.052480Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:17.052495Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:17.052497Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:17.118036Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:182: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:31:17.152832Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:17.152849Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:17.152852Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:17.253177Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:17.253195Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:17.253198Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:17.353527Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:17.353543Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:17.353545Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:17.453879Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:17.453893Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:17.453896Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:17.554247Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:17.554265Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:17.554268Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:17.654599Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:17.654613Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:17.654615Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:17.754969Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:17.754987Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:17.754991Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:17.855309Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:17.855326Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:17.855329Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:17.955660Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:17.955674Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:17.955676Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:18.056020Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:18.056038Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:18.056041Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:18.156360Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:18.156376Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:18.156379Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
E1010 14:31:18.178208428 2325080 chttp2_transport.cc:1143]             ipv6:%5B::1%5D:12586: Received a GOAWAY with error code ENHANCE_YOUR_CALM and debug data equal to "too_many_pings". Current keepalive time (before throttling): 1250ms
2025-10-10T14:31:18.256686Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:18.256699Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:18.256702Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:18.357052Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:18.357070Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:18.357073Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:18.457405Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:18.457421Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:18.457423Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:18.557763Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:18.557777Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:18.557780Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:18.658130Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:18.658143Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:18.658146Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:18.758453Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:18.758468Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:18.758471Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:18.858781Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:18.858809Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:18.858812Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:18.959160Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:18.959177Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:18.959180Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:19.059529Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:19.059545Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:19.059547Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:19.159891Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:19.159907Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:19.159910Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:19.260220Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:19.260235Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:19.260237Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:19.360583Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:19.360597Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:19.360599Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:19.460923Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:19.460937Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:19.460939Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:19.561281Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:19.561296Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:19.561298Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:19.661621Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:19.661636Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:19.661638Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:19.761978Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:19.761994Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:19.761996Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:19.862346Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:19.862360Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:19.862363Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:19.962702Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:19.962717Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:19.962719Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:20.063040Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:20.063056Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:20.063058Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:20.163406Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:20.163423Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:20.163425Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:20.263739Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:20.263753Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:20.263755Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:20.364055Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:20.364067Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:20.364070Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:20.464431Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:20.464448Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:20.464451Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:20.564827Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:20.564841Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:20.564851Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:20.665174Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:20.665192Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:20.665196Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:20.765488Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:20.765506Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:20.765510Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:20.865882Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:20.865901Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:20.865905Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:20.966224Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:20.966242Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:20.966245Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:21.066586Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:21.066601Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:21.066603Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:21.166952Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:21.166968Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:21.166970Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:21.267288Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:21.267303Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:21.267306Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:21.367644Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:21.367660Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:21.367662Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:21.467973Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:21.467988Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:21.467990Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:21.568331Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:21.568346Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:21.568348Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:21.668688Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:21.668715Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:21.668718Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:21.769045Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:21.769062Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:21.769065Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:21.869401Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:21.869421Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:21.869424Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:21.969736Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:21.969756Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:21.969759Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:22.070106Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:22.070127Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:22.070140Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:22.118303Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:182: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:31:22.170466Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:22.170485Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:22.170488Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:22.270798Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:22.270817Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:22.270820Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:22.371129Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:22.371144Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:22.371146Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:22.471458Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:22.471472Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:22.471475Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:22.571847Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:22.571864Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:22.571867Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:22.672193Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:22.672209Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:22.672211Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:22.772552Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:22.772571Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:22.772574Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:22.872901Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:22.872917Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:22.872919Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:22.973248Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:22.973261Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:22.973264Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:23.073592Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:23.073607Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:23.073610Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:23.173946Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:23.173959Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:23.173962Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:23.274304Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:23.274318Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:23.274320Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:23.374675Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:23.374692Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:23.374695Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:23.475016Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:23.475033Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:23.475036Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:23.575406Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:23.575422Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:23.575424Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:23.675694Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:23.675714Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:23.675716Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:23.776072Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:23.776091Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:23.776093Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:23.876425Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:23.876443Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:23.876445Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:23.976781Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:23.976805Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:23.976807Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:24.077127Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:24.077143Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:24.077145Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:24.177499Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:24.177521Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:24.177524Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:24.277848Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:24.277870Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:24.277873Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:24.378179Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:24.378194Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:24.378197Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:24.478520Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:24.478535Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:24.478537Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:24.578881Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:24.578898Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:24.578900Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:24.679244Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:24.679258Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:24.679260Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:24.779603Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:24.779619Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:24.779621Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:24.879994Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:24.880009Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:24.880012Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:24.980296Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:24.980315Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:24.980318Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:25.080638Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:25.080652Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:25.080654Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:25.180995Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:25.181013Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:25.181016Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:25.281359Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:25.281375Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:25.281378Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:25.381665Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:25.381680Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:25.381682Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:25.482009Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:25.482022Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:25.482025Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:25.582361Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:25.582379Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:25.582382Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:25.682756Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:25.682773Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:25.682775Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:25.783106Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:25.783120Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:25.783123Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:25.883460Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:25.883477Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:25.883480Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:25.983824Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:25.983838Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:25.983840Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:26.084123Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:26.084138Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:26.084140Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:26.184510Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:26.184526Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:26.184529Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:26.284866Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:26.284880Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:26.284883Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:26.385223Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:26.385239Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:26.385242Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:26.485559Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:26.485574Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:26.485577Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:26.585892Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:26.585908Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:26.585910Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:26.686293Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:26.686308Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:26.686310Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:26.786663Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:26.786697Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:26.786699Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:26.886985Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:26.887016Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:26.887018Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:26.987335Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:26.987352Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:26.987354Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:27.087637Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:27.087659Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:27.087662Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:27.118456Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:182: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:31:27.188028Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:27.188041Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:27.188043Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:27.288381Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:27.288393Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:27.288396Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:27.388736Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:27.388753Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:27.388755Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:27.489095Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:27.489112Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:27.489114Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:27.589427Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:27.589441Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:27.589444Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:27.689788Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:27.689804Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:27.689806Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:27.790155Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:27.790168Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:27.790170Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:27.890514Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:27.890531Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:27.890534Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:27.990823Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:27.990840Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:27.990842Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:28.091150Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:28.091164Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:28.091166Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:28.191515Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:28.191530Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:28.191542Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:28.291908Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:28.291922Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:28.291924Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:28.392218Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:28.392243Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:28.392245Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:28.492616Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:28.492631Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:28.492634Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:28.592965Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:28.592981Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:28.592984Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:28.693312Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:28.693339Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:28.693342Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:28.793676Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:28.793692Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:28.793695Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:28.894031Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:28.894054Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:28.894057Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:28.994386Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:28.994403Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:28.994406Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:29.094725Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:29.094741Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:29.094744Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:29.195090Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:29.195106Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:29.195109Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:29.295407Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:29.295423Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:29.295426Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:29.395797Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:29.395815Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:29.395818Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:29.496140Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:29.496155Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:29.496157Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:29.596488Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:29.596502Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:29.596504Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:29.696846Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:29.696863Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:29.696867Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:29.797193Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:29.797206Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:29.797209Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:29.897542Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:29.897559Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:29.897562Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:29.997917Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:29.997935Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:29.997938Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:30.098268Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:30.098285Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:30.098289Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:30.198623Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:30.198639Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:30.198642Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:30.298975Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:30.298993Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:30.298996Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:30.399269Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:30.399285Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:30.399287Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:30.499652Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:30.499666Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:30.499668Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:30.600017Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:30.600031Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:30.600033Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:30.700354Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:30.700369Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:30.700371Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:30.800715Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:30.800729Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:30.800731Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:30.901055Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:30.901068Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:30.901070Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:31.001425Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:31.001438Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:31.001440Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:31.101773Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:31.101792Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:31.101796Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:31.202117Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:31.202135Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:31.202137Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:31.302491Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:31.302509Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:31.302513Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:31.402842Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:31.402859Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:31.402862Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:31.503137Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:31.503156Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:31.503159Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:31.603522Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:31.603535Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:31.603538Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:31.703885Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:31.703901Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:31.703918Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:31.804223Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:31.804241Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:31.804245Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:31.904589Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:31.904604Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:31.904606Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:32.004969Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:32.004989Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:32.004992Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:32.105259Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:32.105275Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:32.105278Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:32.118644Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:182: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:31:32.205627Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:32.205644Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:32.205647Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:32.305964Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:32.305991Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:32.305994Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:32.406344Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:32.406363Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:32.406365Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:32.506703Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:32.506721Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:32.506725Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:32.607044Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:32.607061Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:32.607064Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:32.707398Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:32.707412Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:32.707415Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:32.807783Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:32.807805Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:32.807809Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:32.908120Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:32.908135Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:32.908138Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:33.008432Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:33.008458Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:33.008460Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:33.108793Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:33.108809Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:33.108812Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:33.209126Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:33.209143Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:33.209145Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:33.309501Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:33.309518Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:33.309520Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:33.409856Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:33.409872Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:33.409875Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:33.510215Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:33.510231Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:33.510233Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:33.610555Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:33.610569Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:33.610571Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:33.710950Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:33.710972Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:33.710976Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:33.811272Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:33.811290Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:33.811293Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:33.911623Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:33.911647Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:33.911649Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:34.011972Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:34.011986Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:34.011988Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:34.112317Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:34.112335Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:34.112337Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:34.212686Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:34.212705Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:34.212707Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:34.313030Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:34.313050Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:34.313052Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:34.413361Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:34.413382Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:34.413385Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:34.513756Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:34.513776Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:34.513789Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:34.614092Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:34.614105Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:34.614108Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:34.714431Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:34.714448Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:34.714450Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:34.814769Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:34.814789Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:34.814793Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:34.915129Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:34.915147Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:34.915150Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:35.015459Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:35.015475Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:35.015477Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:35.115872Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:35.115892Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:35.115894Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:35.216203Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:35.216220Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:35.216223Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:35.316572Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:35.316590Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:35.316592Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:35.416914Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:35.416931Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:35.416933Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:35.517207Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:35.517222Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:35.517224Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:35.617602Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:35.617617Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:35.617619Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:35.717954Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:35.717974Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:35.717977Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:35.818286Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:35.818310Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:35.818312Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:35.918675Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:35.918691Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:35.918694Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:36.019011Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:36.019027Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:36.019032Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:36.119356Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:36.119370Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:36.119373Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:36.219723Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:36.219741Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:36.219744Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:36.320068Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:36.320085Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:36.320087Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:36.420417Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:36.420436Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:36.420440Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:36.520782Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:36.520801Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:36.520805Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:36.621134Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:36.621147Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:36.621150Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:36.721484Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:36.721506Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:36.721509Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:36.821827Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:36.821843Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:36.821846Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:36.922168Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:36.922183Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:36.922185Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:37.022497Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:37.022514Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:37.022517Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:37.111095Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:155: [72075186224037893][rt3.dc1--test-topic] TPersQueueReadBalancer::HandleWakeup
2025-10-10T14:31:37.111123Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 1
2025-10-10T14:31:37.111363Z node 3 :PERSQUEUE DEBUG: partition.cpp:1000: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 0 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-10-10T14:31:37.111580Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 9 Generation: 1 StatsReportRound: 1 DataSize: 0 UsedReserveSize: 0
2025-10-10T14:31:37.111774Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-10-10T14:31:37.112016Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72057594046644480, NodeId 3, Generation 2
2025-10-10T14:31:37.118815Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:182: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:31:37.122871Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:37.122886Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:37.122890Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:37.223237Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:37.223255Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:37.223258Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:37.323588Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:37.323605Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:37.323607Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:37.423927Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:37.423944Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:37.423946Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:37.524310Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:37.524327Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:37.524330Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:37.624620Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:37.624634Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:37.624636Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:37.724988Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:37.725007Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:37.725010Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:37.825358Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:37.825377Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:37.825380Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:37.925690Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:37.925711Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:37.925714Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:38.026072Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:38.026091Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:38.026095Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:38.126389Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:38.126408Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:38.126411Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
E1010 14:31:38.181561432 2325080 chttp2_transport.cc:1143]             ipv6:%5B::1%5D:12586: Received a GOAWAY with error code ENHANCE_YOUR_CALM and debug data equal to "too_many_pings". Current keepalive time (before throttling): 2500ms
2025-10-10T14:31:38.226723Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:38.226742Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:38.226744Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
>>> Ready to answer: ok
2025-10-10T14:31:38.327116Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:38.327135Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:38.327138Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:38.427458Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:38.427475Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:38.427477Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:38.527807Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:38.527825Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:38.527828Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:38.628165Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:38.628183Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:38.628185Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:38.728537Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:38.728551Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:38.728554Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:38.828862Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:38.828877Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:38.828881Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:38.929207Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:38.929225Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:38.929229Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:39.029577Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:39.029594Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:39.029598Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:39.129899Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:39.129916Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:39.129919Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:39.230313Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:39.230331Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:39.230334Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:39.330650Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:39.330665Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:39.330667Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:39.430967Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:39.430991Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:39.430994Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:39.531334Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:39.531353Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:39.531356Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:39.631678Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:39.631694Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:39.631696Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:39.731995Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:39.732013Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:39.732016Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:39.832369Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:39.832397Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:39.832401Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:39.932743Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:39.932763Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:39.932766Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:40.033091Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:40.033115Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:40.033117Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:40.133441Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:40.133459Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:40.133463Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:40.233788Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:40.233806Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:40.233809Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:40.334162Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:40.334185Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:40.334188Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:40.434526Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:40.434542Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:40.434545Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:40.534856Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:40.534871Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:40.534874Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:40.635187Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:40.635203Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:40.635205Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:40.735558Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:40.735574Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:40.735577Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:40.835918Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:40.835934Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:40.835937Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:40.936248Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:40.936265Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:40.936269Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:41.036609Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:41.036623Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:41.036625Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:41.136917Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:41.136930Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:41.136932Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:41.237307Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:41.237319Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:41.237321Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:41.337795Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:41.337808Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:41.337810Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:41.438043Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:41.438067Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:41.438069Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:41.538392Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:41.538408Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:41.538410Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:41.638733Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:41.638749Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:41.638752Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:41.739096Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:41.739113Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:41.739116Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:41.839442Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:41.839458Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:41.839460Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:41.939791Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:41.939807Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:41.939809Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:42.040170Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:42.040186Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:42.040188Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:42.119083Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:182: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:31:42.140496Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:42.140511Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:42.140514Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:42.240843Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:42.240859Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:42.240861Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:42.341205Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:42.341221Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:42.341223Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:42.441548Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:42.441566Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:42.441568Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:42.541875Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:42.541889Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:42.541891Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:42.642278Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:42.642295Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:42.642299Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:42.742613Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:42.742632Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:42.742635Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:42.842935Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:42.842957Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:42.842959Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:42.943303Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:42.943318Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:42.943320Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:43.043653Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:43.043668Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:43.043671Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:43.143995Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:43.144012Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:43.144015Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:43.244363Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:43.244378Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:43.244381Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:43.344711Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:43.344725Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:43.344728Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:43.445064Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:43.445079Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:43.445081Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:43.545386Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:43.545404Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:43.545406Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:43.645750Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:43.645766Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:43.645770Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:43.746116Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:43.746133Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:43.746145Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:43.846467Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:43.846485Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:43.846487Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:43.946830Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:43.946846Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:43.946849Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:44.047180Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:44.047198Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:44.047200Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:44.147542Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:44.147559Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:44.147561Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:44.247879Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:44.247910Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:44.247913Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:44.348237Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:44.348269Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:44.348272Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:44.448588Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:44.448607Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:44.448610Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:44.548951Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:44.548972Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:44.548975Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:44.649281Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:44.649301Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:44.649304Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:44.749656Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:44.749686Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:44.749690Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:44.850002Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:44.850022Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:44.850026Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:44.950398Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:44.950418Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:44.950421Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:45.050708Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:45.050726Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:45.050729Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:45.151074Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:45.151092Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:45.151094Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:45.251410Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:45.251428Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:45.251430Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:45.351719Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:45.351734Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:45.351737Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:45.452105Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:45.452131Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:45.452133Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:45.552470Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:45.552499Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:45.552502Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:45.652795Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:45.652810Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:45.652814Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:45.753162Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:45.753178Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:45.753180Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:45.853480Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:45.853497Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:45.853500Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:45.953856Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:45.953872Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:45.953874Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:46.054231Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:46.054254Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:46.054258Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
E1010 14:31:46.086214338 2322938 chttp2_transport.cc:1143]             ipv4:127.0.0.1:12586: Received a GOAWAY with error code ENHANCE_YOUR_CALM and debug data equal to "too_many_pings". Current keepalive time (before throttling): 2500ms
2025-10-10T14:31:46.154581Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:46.154605Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:46.154608Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:46.254935Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:46.254957Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:46.254961Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:46.355269Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:46.355283Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:46.355285Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:46.455626Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:46.455641Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:46.455643Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:46.555977Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:46.555991Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:46.555994Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:46.656320Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:46.656333Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:46.656336Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:46.756687Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:46.756701Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:46.756704Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:46.857047Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:46.857062Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:46.857065Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:46.957408Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:46.957425Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:46.957428Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:47.057708Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:47.057721Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:47.057723Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:47.119174Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:182: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:31:47.158075Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:47.158089Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:47.158091Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:47.258446Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:47.258461Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:47.258464Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:47.358806Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:47.358825Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:47.358828Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:47.459139Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:47.459161Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:47.459163Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:47.559504Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:47.559519Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:47.559522Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:47.659855Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:47.659871Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:47.659875Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:47.760196Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:47.760211Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:47.760214Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:47.860548Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:47.860563Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:47.860565Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:47.960904Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:47.960920Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:47.960924Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:48.061266Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:48.061282Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:48.061285Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:48.161620Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:48.161636Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:48.161640Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:48.230577Z :INFO: [/Root] [] [] Start federated write session to database 'dc2' (previous was dc1) FederationState: { Status: SUCCESS SelfLocation: "fancy_datacenter" DbInfos: [ { name: "dc1" path: "/Root" id: "account-dc1" endpoint: "localhost:14001" location: "dc1" status: UNAVAILABLE weight: 500 } { name: "dc2" path: "/Root" id: "account-dc2" endpoint: "localhost:14001" location: "dc2" status: AVAILABLE weight: 500 } { name: "dc3" path: "/Root" id: "account-dc3" endpoint: "localhost:14001" location: "dc3" status: AVAILABLE weight: 500 } ] ControlPlaneEndpoint: cp.logbroker-federation:2135 }
2025-10-10T14:31:48.230705Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: try to update token
2025-10-10T14:31:48.230728Z :INFO: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Start write session. Will connect to nodeId: 0
2025-10-10T14:31:48.231020Z :INFO: [/Root]  TraceId []  SessionId [src_id|2abe159c-d6edd6cb-721fe2ae-9ed0d186_0]  MessageGroupId [src_id] Write session: close. Timeout 0.000000s
2025-10-10T14:31:48.231025Z :INFO: [/Root]  TraceId []  SessionId [src_id|2abe159c-d6edd6cb-721fe2ae-9ed0d186_0]  MessageGroupId [src_id] Write session will now close
2025-10-10T14:31:48.231041Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2abe159c-d6edd6cb-721fe2ae-9ed0d186_0]  MessageGroupId [src_id] Write session: aborting
2025-10-10T14:31:48.231042Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: write to message_group: src_id
2025-10-10T14:31:48.231094Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: send init request: init_request { path: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:48.231175Z :INFO: [/Root]  TraceId []  SessionId [src_id|2abe159c-d6edd6cb-721fe2ae-9ed0d186_0]  MessageGroupId [src_id] Write session: gracefully shut down, all writes complete
2025-10-10T14:31:48.231180Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|2abe159c-d6edd6cb-721fe2ae-9ed0d186_0]  MessageGroupId [src_id] Write session: destroy
2025-10-10T14:31:48.231371Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: OnWriteDone gRpcStatusCode: 0
2025-10-10T14:31:48.231335Z node 3 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:48.231353Z node 3 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3
2025-10-10T14:31:48.231432Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|2abe159c-d6edd6cb-721fe2ae-9ed0d186_0 grpc read done: success: 0 data: 
2025-10-10T14:31:48.231443Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 2 sessionId: src_id|2abe159c-d6edd6cb-721fe2ae-9ed0d186_0 grpc read failed
2025-10-10T14:31:48.231453Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 2 sessionId: src_id|2abe159c-d6edd6cb-721fe2ae-9ed0d186_0 grpc closed
2025-10-10T14:31:48.231460Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2 sessionId: src_id|2abe159c-d6edd6cb-721fe2ae-9ed0d186_0 is DEAD
2025-10-10T14:31:48.231544Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3 sessionId:  grpc read done: success: 1 data: init_request { path: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:48.231581Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3 path: "test-topic" message_group_id: "src_id" from ipv6:[::1]:35572
2025-10-10T14:31:48.231592Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3 sessionId= userAgent="topic server" ip=ipv6:[::1]:35572 proto=topic  topic=test-topic durationSec=0
2025-10-10T14:31:48.231596Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:48.231841Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-10-10T14:31:48.231890Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [3:7559600579202069567:2498] destroyed
2025-10-10T14:31:48.231907Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-10-10T14:31:48.231919Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:48.231926Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:48.231929Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:48.232082Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3 sessionId:  describe result for acl check
2025-10-10T14:31:48.232138Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:48.232147Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:48.232150Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:48.232156Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [3:7559600751000764740:3124] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:48.232777Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [3:7559600751000764740:3124] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:48.235495Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [3:7559600751000764740:3124] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:48.238360Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [3:7559600751000764740:3124] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:48.238375Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [3:7559600751000764740:3124] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:48.238379Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [3:7559600751000764740:3124] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:48.238388Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:48.238556Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 3, Generation: 1
2025-10-10T14:31:48.238556Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [3:7559600751000764767:3124], now have 1 active actors on pipe
2025-10-10T14:31:48.238562Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:48.238567Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:48.238594Z node 3 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4cd5eb85-a25ce75d-3f9c8924-e64c0f63_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:48.238611Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:48.238621Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:48.238623Z node 3 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:48.238639Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:48.238660Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:48.238678Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:48.238714Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:48.238721Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:48.238735Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:48.238771Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3 partition: 0 MaxSeqNo: 1 sessionId: src_id|4cd5eb85-a25ce75d-3f9c8924-e64c0f63_0
2025-10-10T14:31:48.239107Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: OnReadDone gRpcStatusCode: 0
2025-10-10T14:31:48.239127Z :INFO: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1760106708239 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-10T14:31:48.239168Z :INFO: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session established. Init response: last_seq_no: 1 session_id: "src_id|4cd5eb85-a25ce75d-3f9c8924-e64c0f63_0" supported_codecs { codecs: 1 codecs: 2 codecs: 3 }
2025-10-10T14:31:48.261954Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:48.261970Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:48.261975Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:48.362324Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:48.362340Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:48.362343Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:48.462662Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:48.462680Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:48.462683Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:48.563018Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:48.563035Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:48.563038Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:48.663371Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:48.663388Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:48.663391Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:48.763731Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:48.763747Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:48.763750Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:48.864079Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:48.864094Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:48.864096Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:48.964423Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:48.964439Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:48.964442Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:49.064774Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:49.064787Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:49.064790Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:49.165134Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:49.165148Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:49.165151Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:49.239367Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [3:7559600751000764740:3124] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:49.245782Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [3:7559600751000764740:3124] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=1 Status=SUCCESS
2025-10-10T14:31:49.245795Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [3:7559600751000764740:3124] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:49.265468Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:49.265490Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:49.265492Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:49.365846Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:49.365865Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:49.365868Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:49.466195Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:49.466210Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:49.466213Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:49.566580Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:49.566598Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:49.566602Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:49.666891Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:49.666908Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:49.666910Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:49.767247Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:49.767264Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:49.767267Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:49.867597Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:49.867612Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:49.867615Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:49.967922Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:49.967937Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:49.967940Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:50.068289Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:50.068304Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:50.068306Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:50.168646Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:50.168662Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:50.168665Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:50.268997Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:50.269019Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:50.269021Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:50.369353Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:50.369368Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:50.369370Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:50.469692Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:50.469706Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:50.469709Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:50.570057Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:50.570071Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:50.570074Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:50.670371Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:50.670385Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:50.670387Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:50.770776Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:50.770794Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:50.770797Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:50.871116Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:50.871131Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:50.871134Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:50.971476Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:50.971491Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:50.971493Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:51.071829Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:51.071846Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:51.071850Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:51.172171Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:51.172186Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:51.172189Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:51.272519Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:51.272533Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:51.272535Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:51.372890Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:51.372906Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:51.372909Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:51.473178Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:51.473195Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:51.473198Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:51.573534Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:51.573551Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:51.573560Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:51.673932Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:51.673948Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:51.673951Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:51.774293Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:51.774308Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:51.774310Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:51.874599Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:51.874616Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:51.874619Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:51.974980Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:51.974999Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:51.975002Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:52.075355Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:52.075370Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:52.075372Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:52.119429Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:182: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:31:52.175668Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:52.175685Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:52.175689Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:52.276038Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:52.276052Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:52.276054Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:52.376400Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:52.376414Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:52.376417Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:52.476751Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:52.476768Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:52.476771Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:52.577090Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:52.577103Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:52.577105Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:52.677460Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:52.677474Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:52.677476Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:52.777807Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:52.777825Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:52.777827Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:52.878162Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:52.878183Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:52.878186Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:52.978506Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:52.978523Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:52.978527Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:53.078870Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:53.078890Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:53.078893Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:53.179232Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:53.179252Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:53.179255Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:53.279556Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:53.279574Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:53.279576Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:53.379912Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:53.379929Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:53.379931Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:53.480277Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:53.480294Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:53.480296Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:53.580611Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:53.580630Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:53.580633Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:53.680962Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:53.680980Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:53.680982Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:53.781315Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:53.781342Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:53.781344Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:53.881671Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:53.881690Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:53.881692Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:53.982031Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:53.982047Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:53.982050Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:54.082390Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:54.082407Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:54.082410Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:54.182720Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:54.182740Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:54.182742Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:54.283113Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:54.283130Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:54.283134Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:54.383401Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:54.383415Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:54.383418Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:54.483762Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:54.483776Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:54.483779Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:54.584152Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:54.584172Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:54.584175Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:54.684491Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:54.684509Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:54.684512Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:54.784843Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:54.784859Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:54.784862Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:54.885190Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:54.885207Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:54.885210Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:54.985553Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:54.985571Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:54.985574Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:55.085901Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:55.085917Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:55.085921Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:55.186300Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:55.186333Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:55.186339Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:55.286613Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:55.286632Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:55.286635Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:55.386965Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:55.386984Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:55.386987Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:55.487309Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:55.487327Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:55.487330Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:55.587622Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:55.587641Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:55.587644Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:55.688009Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:55.688023Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:55.688026Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:55.788331Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:55.788345Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:55.788348Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:55.888723Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:55.888778Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:55.888781Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:55.989076Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:55.989102Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:55.989105Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:56.089387Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:56.089405Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:56.089407Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:56.189767Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:56.189793Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:56.189795Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:56.290122Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:56.290144Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:56.290146Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:56.390472Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:56.390510Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:56.390513Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:56.490785Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:56.490801Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:56.490804Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:56.591193Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:56.591210Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:56.591213Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:56.691551Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:56.691571Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:56.691574Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:56.791888Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:56.791906Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:56.791909Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:56.892234Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:56.892252Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:56.892255Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:56.992585Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:56.992603Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:56.992607Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:57.092915Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:57.092928Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:57.092930Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:57.119676Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:182: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:31:57.193316Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:57.193350Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:57.193354Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:57.293626Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:57.293642Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:57.293644Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:57.394009Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:57.394023Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:57.394026Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:57.494343Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:57.494363Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:57.494367Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:57.594710Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:57.594728Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:57.594731Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:57.695061Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:57.695079Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:57.695081Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:57.795402Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:57.795428Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:57.795432Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:57.895768Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:57.895790Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:57.895793Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:57.996118Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:57.996137Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:57.996140Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:58.096440Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:58.096453Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:58.096455Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:58.196794Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:58.196820Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:58.196822Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:58.297186Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:58.297217Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:58.297219Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:58.397536Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:58.397556Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:58.397566Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:58.497865Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:58.497882Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:58.497884Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:58.598179Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:58.598199Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:58.598202Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:58.698583Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:58.698598Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:58.698601Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:58.798954Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:58.798973Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:58.798976Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:58.899273Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:58.899300Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:58.899303Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:58.999648Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:58.999668Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:58.999671Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:59.099963Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:59.099978Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:59.099979Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:59.200334Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:59.200356Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:59.200358Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:59.300669Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:59.300686Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:59.300689Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:59.401031Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:59.401058Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:59.401061Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:59.501398Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:59.501415Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:59.501417Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:59.601725Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:59.601741Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:59.601743Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:59.702099Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:59.702115Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:59.702117Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:59.802422Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:59.802445Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:59.802448Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:59.902790Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:59.902816Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:59.902819Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:00.003134Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:00.003153Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:00.003156Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:00.103494Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:00.103512Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:00.103515Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:00.203867Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:00.203886Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:00.203889Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:00.304219Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:00.304238Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:00.304241Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:00.404521Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:00.404545Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:00.404548Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:00.504930Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:00.504951Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:00.504954Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:00.605271Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:00.605290Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:00.605292Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:00.705612Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:00.705634Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:00.705638Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:00.805962Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:00.805981Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:00.805984Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:00.906358Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:00.906383Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:00.906387Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:01.006654Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:01.006674Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:01.006678Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:01.107022Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:01.107043Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:01.107045Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:01.207373Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:01.207392Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:01.207395Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:01.307702Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:01.307719Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:01.307722Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:01.408082Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:01.408098Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:01.408100Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:01.508413Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:01.508430Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:01.508432Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:01.608781Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:01.608797Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:01.608800Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:01.709126Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:01.709142Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:01.709145Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:01.809448Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:01.809466Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:01.809468Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:01.909808Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:01.909823Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:01.909825Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:02.010185Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:02.010202Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:02.010204Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:02.110542Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:02.110559Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:02.110561Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:02.119789Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:182: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:32:02.210911Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:02.210939Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:02.210941Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:02.311268Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:02.311289Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:02.311292Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:02.411737Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:02.411760Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:02.411763Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:02.511966Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:02.511989Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:02.511993Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:02.612303Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:02.612326Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:02.612330Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:02.712636Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:02.712657Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:02.712659Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:02.812969Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:02.812993Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:02.812995Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:02.913370Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:02.913397Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:02.913401Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:03.013710Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:03.013725Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:03.013728Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:03.114049Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:03.114068Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:03.114070Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:03.214415Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:03.214436Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:03.214439Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:03.314777Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:03.314796Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:03.314799Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:03.415116Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:03.415136Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:03.415139Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:03.515471Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:03.515489Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:03.515493Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:03.615822Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:03.615856Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:03.615859Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:03.716190Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:03.716211Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:03.716215Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:03.816509Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:03.816526Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:03.816528Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:03.916878Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:03.916894Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:03.916897Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:04.017229Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:04.017244Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:04.017247Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:04.117572Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:04.117594Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:04.117596Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:04.217919Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:04.217940Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:04.217943Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:04.318273Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:04.318290Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:04.318292Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:04.418687Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:04.418706Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:04.418708Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:04.519000Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:04.519017Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:04.519019Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:04.619336Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:04.619350Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:04.619352Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:04.719687Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:04.719701Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:04.719703Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:04.820041Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:04.820057Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:04.820059Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:04.920381Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:04.920400Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:04.920403Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:05.020735Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:05.020748Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:05.020751Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:05.121053Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:05.121067Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:05.121069Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:05.221482Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:05.221505Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:05.221508Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:05.321814Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:05.321833Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:05.321835Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:05.422167Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:05.422188Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:05.422190Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:05.522499Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:05.522596Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:05.522617Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:05.622847Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:05.622869Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:05.622874Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:05.723255Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:05.723276Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:05.723279Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:05.823541Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:05.823568Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:05.823576Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:05.923891Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:05.923908Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:05.923911Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:06.024278Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:06.024318Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:06.024322Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:06.124596Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:06.124615Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:06.124618Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:06.224965Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:06.224981Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:06.224982Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:06.325340Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:06.325358Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:06.325361Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:06.425648Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:06.425664Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:06.425667Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:06.526020Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:06.526036Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:06.526038Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:06.626374Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:06.626391Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:06.626393Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:06.726720Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:06.726735Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:06.726738Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:06.827075Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:06.827093Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:06.827095Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:06.927427Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:06.927440Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:06.927442Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:07.027796Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:07.027812Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:07.027815Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:07.111221Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:155: [72075186224037893][rt3.dc1--test-topic] TPersQueueReadBalancer::HandleWakeup
2025-10-10T14:32:07.111260Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 2
2025-10-10T14:32:07.111545Z node 3 :PERSQUEUE DEBUG: partition.cpp:1000: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 0 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-10-10T14:32:07.111894Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 9 Generation: 1 StatsReportRound: 2 DataSize: 0 UsedReserveSize: 0
2025-10-10T14:32:07.111955Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-10-10T14:32:07.119951Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:182: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:32:07.128122Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:07.128134Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:07.128136Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:07.228443Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:07.228464Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:07.228466Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:07.328845Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:07.328859Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:07.328862Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:07.429182Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:07.429196Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:07.429198Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:07.529549Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:07.529565Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:07.529567Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:07.629874Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:07.629887Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:07.629889Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:07.730247Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:07.730264Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:07.730266Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:07.830631Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:07.830647Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:07.830649Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:07.930894Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:07.930910Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:07.930912Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:08.031280Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:08.031294Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:08.031296Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:08.131639Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:08.131660Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:08.131662Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:08.231982Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:08.231999Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:08.232003Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
>>> Ready to answer: ok
2025-10-10T14:32:08.271061Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|4cd5eb85-a25ce75d-3f9c8924-e64c0f63_0]  MessageGroupId [src_id] Write 1 messages with Id from 1 to 1
>>> Got event: ReadyToAcceptEvent
2025-10-10T14:32:08.271429Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|4cd5eb85-a25ce75d-3f9c8924-e64c0f63_0]  MessageGroupId [src_id] Write session: try to update token
2025-10-10T14:32:08.271443Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|4cd5eb85-a25ce75d-3f9c8924-e64c0f63_0]  MessageGroupId [src_id] Send 1 message(s) (0 left), first sequence number is 2
2025-10-10T14:32:08.271757Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3 sessionId: src_id|4cd5eb85-a25ce75d-3f9c8924-e64c0f63_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:08.271902Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:08.271966Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:08.271979Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:08.272007Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:32:08.272032Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:32:08.272078Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:08.272086Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:08.272101Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 2 partNo : 0 messageNo: 1 size 98 offset: -1
2025-10-10T14:32:08.272124Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:32:08.272141Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:08.272148Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:08.272154Z node 3 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:08.272186Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 2 partNo 0
2025-10-10T14:32:08.272237Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 2 partNo 0 FormedBlobsCount 0 NewHead: Offset 1 PartNo 0 PackedSize 172 count 1 nextOffset 2 batches 1
2025-10-10T14:32:08.272246Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:08.272286Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 1,1 HeadOffset 1 endOffset 1 curOffset 2 d0000000000_00000000000000000001_00000_0000000001_00000? size 160 WTime 1760106728271
2025-10-10T14:32:08.272312Z node 3 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:32:08.272321Z node 3 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 1 partNo 0 count 1 size 160
2025-10-10T14:32:08.273157Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 1 count 1 size 160 actorID [3:7559600574907101927:2446]
2025-10-10T14:32:08.273172Z node 3 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:32:08.273185Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 1 partno 0 count 1 parts 0 suffix '63' size 160
2025-10-10T14:32:08.273201Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 105 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:32:08.273207Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:32:08.273216Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 2, partNo: 0, Offset: 1 is stored on disk
2025-10-10T14:32:08.273238Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:08.273244Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:08.273245Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:08.273249Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:182: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:32:08.273254Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:1181: [PQ: 72075186224037892] Topic 'rt3.dc1--test-topic' counters. CacheSize 320 CachedBlobs 2
2025-10-10T14:32:08.273259Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-10-10T14:32:08.273271Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:32:08.273462Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|4cd5eb85-a25ce75d-3f9c8924-e64c0f63_0]  MessageGroupId [src_id] Write session: OnReadDone gRpcStatusCode: 0
2025-10-10T14:32:08.273518Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|4cd5eb85-a25ce75d-3f9c8924-e64c0f63_0]  MessageGroupId [src_id] Write session got write response: acks { seq_no: 2 written { offset: 1 } } write_statistics { persisting_time { } min_queue_wait_time { } max_queue_wait_time { } partition_quota_wait_time { } topic_quota_wait_time { } }
2025-10-10T14:32:08.273529Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|4cd5eb85-a25ce75d-3f9c8924-e64c0f63_0]  MessageGroupId [src_id] OnAck: seqNo=1, txId=?
2025-10-10T14:32:08.273532Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|4cd5eb85-a25ce75d-3f9c8924-e64c0f63_0]  MessageGroupId [src_id] Write session: acknoledged message 1
2025-10-10T14:32:08.332348Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:08.332365Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:08.332367Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:08.432703Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:08.432721Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:08.432723Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:08.533061Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:08.533088Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:08.533091Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:08.633394Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:08.633411Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:08.633414Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:08.733773Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:08.733790Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:08.733792Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:08.834063Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:08.834079Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:08.834081Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:08.934452Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:08.934466Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:08.934469Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:09.034827Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:09.034843Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:09.034845Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:09.135164Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:09.135186Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:09.135189Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:09.235505Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:09.235521Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:09.235533Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:09.335902Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:09.335916Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:09.335918Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:09.436245Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:09.436268Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:09.436271Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:09.536600Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:09.536624Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:09.536627Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:09.636917Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:09.636942Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:09.636944Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:09.737316Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:09.737352Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:09.737356Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:09.837655Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:09.837676Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:09.837680Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:09.938001Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:09.938024Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:09.938028Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:10.038379Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:10.038398Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:10.038401Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:10.138698Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:10.138716Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:10.138718Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:10.239059Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:10.239075Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:10.239078Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:10.339386Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:10.339403Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:10.339406Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:10.439698Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:10.439712Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:10.439714Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:10.540111Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:10.540128Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:10.540130Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:10.640435Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:10.640447Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:10.640449Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:10.740796Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:10.740816Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:10.740819Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:10.841166Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:10.841186Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:10.841189Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:10.941500Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:10.941513Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:10.941515Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:11.041875Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:11.041895Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:11.041898Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:11.142218Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:11.142233Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:11.142235Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:11.242566Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:11.242581Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:11.242583Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:11.342931Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:11.342945Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:11.342947Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:11.443281Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:11.443295Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:11.443297Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:11.543616Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:11.543631Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:11.543640Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:11.643968Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:11.643983Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:11.643986Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:11.744334Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:11.744350Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:11.744353Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:11.844685Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:11.844703Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:11.844705Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:11.945030Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:11.945045Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:11.945048Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:12.045397Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:12.045411Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:12.045414Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:12.120199Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:182: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:32:12.145749Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:12.145766Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:12.145768Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:12.246064Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:12.246078Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:12.246080Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:12.346443Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:12.346460Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:12.346462Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:12.446789Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:12.446806Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:12.446808Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:12.547110Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:12.547136Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:12.547139Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:12.647481Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:12.647496Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:12.647498Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:12.747818Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:12.747835Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:12.747839Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:12.848198Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:12.848221Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:12.848224Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:12.948539Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:12.948557Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:12.948560Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:13.048885Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:13.048904Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:13.048908Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:13.149195Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:13.149210Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:13.149220Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:13.249602Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:13.249616Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:13.249618Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:13.349966Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:13.349985Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:13.349987Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:13.450310Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:13.450334Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:13.450337Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:13.550668Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:13.550684Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:13.550686Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:13.651015Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:13.651028Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:13.651030Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:13.751361Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:13.751381Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:13.751383Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:13.851722Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:13.851745Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:13.851747Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:13.952056Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:13.952069Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:13.952071Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:14.052424Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:14.052449Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:14.052451Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:14.152754Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:14.152773Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:14.152776Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:14.253103Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:14.253121Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:14.253125Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:14.353441Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:14.353456Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:14.353458Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:14.453834Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:14.453849Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:14.453852Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:14.554179Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:14.554194Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:14.554196Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:14.654535Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:14.654549Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:14.654551Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:14.754904Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:14.754922Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:14.754925Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:14.855192Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:14.855208Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:14.855210Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:14.955588Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:14.955604Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:14.955607Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:15.055937Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:15.055963Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:15.055966Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:15.156286Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:15.156304Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:15.156308Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:15.256646Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:15.256661Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:15.256663Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:15.356999Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:15.357014Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:15.357016Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:15.457359Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:15.457376Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:15.457391Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:15.557694Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:15.557707Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:15.557708Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:15.658052Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:15.658068Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:15.658071Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:15.758406Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:15.758420Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:15.758422Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:15.858764Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:15.858779Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:15.858782Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:15.959132Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:15.959152Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:15.959155Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:16.059487Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:16.059502Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:16.059505Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:16.159810Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:16.159832Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:16.159835Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:16.260167Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:16.260192Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:16.260195Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:16.360529Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:16.360556Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:16.360559Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:16.460902Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:16.460919Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:16.460922Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:16.561202Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:16.561222Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:16.561224Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:16.661627Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:16.661643Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:16.661645Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:16.761931Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:16.761949Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:16.761952Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:16.862281Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:16.862304Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:16.862307Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:16.962625Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:16.962639Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:16.962641Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:17.062978Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:17.062994Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:17.062997Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:17.120372Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:182: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:32:17.163327Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:17.163342Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:17.163344Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:17.263688Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:17.263715Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:17.263718Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:17.364026Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:17.364046Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:17.364049Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:17.464391Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:17.464414Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:17.464417Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:17.564761Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:17.564781Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:17.564784Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:17.665092Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:17.665109Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:17.665112Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:17.765455Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:17.765472Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:17.765475Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:17.865815Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:17.865834Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:17.865837Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:17.966165Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:17.966182Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:17.966185Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:18.066515Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:18.066533Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:18.066536Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:18.166841Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:18.166858Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:18.166861Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:18.267212Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:18.267231Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:18.267234Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:18.367566Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:18.367582Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:18.367585Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:18.467908Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:18.467924Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:18.467927Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:18.568262Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:18.568278Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:18.568280Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:18.668604Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:18.668620Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:18.668623Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:18.768982Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:18.768998Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:18.769000Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:18.869319Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:18.869348Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:18.869350Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:18.969675Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:18.969695Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:18.969698Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:19.070002Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:19.070020Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:19.070023Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:19.170383Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:19.170398Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:19.170400Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:19.270749Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:19.270767Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:19.270769Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:19.371077Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:19.371089Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:19.371091Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:19.471452Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:19.471469Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:19.471472Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:19.571784Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:19.571801Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:19.571803Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:19.672126Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:19.672143Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:19.672146Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:19.772456Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:19.772473Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:19.772476Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:19.872847Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:19.872863Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:19.872867Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:19.973185Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:19.973202Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:19.973205Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:20.073546Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:20.073565Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:20.073569Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:20.173908Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:20.173929Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:20.173932Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:20.274223Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:20.274242Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:20.274244Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:20.374586Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:20.374602Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:20.374604Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:20.474968Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:20.474983Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:20.474987Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:20.575321Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:20.575340Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:20.575343Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:20.675659Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:20.675674Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:20.675677Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:20.775995Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:20.776008Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:20.776010Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:20.876353Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:20.876376Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:20.876378Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:20.976710Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:20.976725Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:20.976727Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:21.077067Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:21.077083Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:21.077086Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:21.177397Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:21.177416Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:21.177419Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:21.277791Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:21.277810Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:21.277813Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:21.378122Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:21.378140Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:21.378143Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:21.478483Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:21.478500Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:21.478503Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:21.578828Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:21.578844Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:21.578847Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:21.679198Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:21.679216Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:21.679219Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:21.779531Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:21.779550Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:21.779552Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:21.879887Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:21.879905Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:21.879909Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:21.980201Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:21.980217Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:21.980220Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:22.080589Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:22.080609Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:22.080612Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:22.120589Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:182: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:32:22.180942Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:22.180962Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:22.180965Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:22.281292Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:22.281310Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:22.281314Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:22.381637Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:22.381654Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:22.381657Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:22.481998Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:22.482017Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:22.482020Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:22.582296Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:22.582324Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:22.582327Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:22.682697Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:22.682712Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:22.682715Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:22.783015Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:22.783030Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:22.783032Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:22.883364Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:22.883389Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:22.883392Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:22.983745Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:22.983759Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:22.983761Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:23.084097Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:23.084111Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:23.084114Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:23.184452Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:23.184468Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:23.184471Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:23.284830Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:23.284850Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:23.284852Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:23.385165Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:23.385182Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:23.385185Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:23.485513Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:23.485530Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:23.485532Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:23.585870Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:23.585887Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:23.585889Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:23.686212Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:23.686243Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:23.686247Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:23.786567Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:23.786584Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:23.786586Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:23.886905Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:23.886926Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:23.886928Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:23.987275Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:23.987294Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:23.987297Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:24.087620Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:24.087635Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:24.087637Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:24.187971Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:24.187985Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:24.187987Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:24.288338Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:24.288358Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:24.288361Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:24.388681Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:24.388696Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:24.388699Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:24.489045Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:24.489061Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:24.489063Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:24.589402Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:24.589418Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:24.589420Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:24.689755Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:24.689770Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:24.689772Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:24.790079Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:24.790095Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:24.790098Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:24.890461Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:24.890475Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:24.890477Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:24.990793Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:24.990809Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:24.990811Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:25.091101Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:25.091116Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:25.091118Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:25.191487Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:25.191502Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:25.191504Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:25.291850Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:25.291866Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:25.291868Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:25.392204Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:25.392222Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:25.392225Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:25.492551Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:25.492582Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:25.492585Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:25.592898Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:25.592919Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:25.592922Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:25.693210Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:25.693228Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:25.693231Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:25.793603Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:25.793621Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:25.793623Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:25.893955Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:25.893979Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:25.893981Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:25.994322Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:25.994336Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:25.994338Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:26.094653Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:26.094674Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:26.094677Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:26.195023Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:26.195039Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:26.195042Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:26.295374Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:26.295394Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:26.295397Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:26.395715Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:26.395732Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:26.395734Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:26.496085Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:26.496105Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:26.496108Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:26.596390Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:26.596407Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:26.596410Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:26.696779Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:26.696797Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:26.696800Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:26.797080Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:26.797103Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:26.797105Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:26.897472Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:26.897495Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:26.897498Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:26.997832Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:26.997847Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:26.997850Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:27.098192Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:27.098209Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:27.098211Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:27.120752Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:182: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:32:27.198538Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:27.198554Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:27.198557Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:27.298898Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:27.298914Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:27.298917Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:27.399254Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:27.399272Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:27.399274Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:27.499605Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:27.499620Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:27.499623Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:27.599944Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:27.599960Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:27.599963Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:27.700307Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:27.700325Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:27.700328Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:27.800636Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:27.800653Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:27.800656Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:27.901009Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:27.901030Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:27.901034Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:28.001358Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:28.001375Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:28.001377Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:28.101687Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:28.101702Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:28.101704Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:28.202079Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:28.202097Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:28.202100Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:28.302408Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:28.302428Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:28.302431Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:28.402740Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:28.402759Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:28.402762Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:28.503137Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:28.503157Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:28.503161Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:28.603454Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:28.603471Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:28.603474Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:28.703840Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:28.703859Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:28.703862Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:28.804149Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:28.804167Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:28.804169Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:28.904527Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:28.904544Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:28.904546Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:29.004861Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:29.004875Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:29.004877Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:29.105235Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:29.105248Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:29.105251Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:29.205573Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:29.205589Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:29.205592Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:29.305883Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:29.305898Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:29.305900Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:29.406273Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:29.406289Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:29.406293Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:29.506630Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:29.506644Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:29.506646Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:29.606977Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:29.606992Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:29.606994Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:29.707298Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:29.707314Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:29.707316Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:29.807676Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:29.807690Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:29.807702Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:29.908053Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:29.908071Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:29.908074Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:30.008393Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:30.008407Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:30.008409Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:30.108726Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:30.108740Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:30.108742Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:30.209104Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:30.209131Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:30.209134Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:30.309439Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:30.309467Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:30.309469Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:30.409797Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:30.409814Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:30.409816Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:30.510157Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:30.510174Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:30.510176Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:30.610507Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:30.610524Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:30.610526Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:30.710868Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:30.710884Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:30.710886Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:30.811184Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:30.811200Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:30.811203Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:30.911558Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:30.911573Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:30.911576Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:31.011936Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:31.011955Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:31.011959Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:31.112257Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:31.112276Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:31.112278Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:31.212615Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:31.212631Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:31.212633Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:31.312973Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:31.312991Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:31.312993Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:31.413317Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:31.413346Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:31.413348Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:31.513681Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:31.513696Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:31.513698Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:31.614046Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:31.614067Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:31.614071Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:31.714356Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:31.714371Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:31.714374Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:31.814726Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:31.814750Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:31.814753Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:31.915095Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:31.915114Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:31.915117Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:32.015444Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:32.015461Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:32.015464Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:32.115764Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:32.115781Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:32.115783Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:32.120961Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:182: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:32:32.216126Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:32.216145Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:32.216161Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:32.316483Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:32.316499Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:32.316501Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:32.416855Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:32.416883Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:32.416886Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:32.517196Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:32.517214Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:32.517217Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:32.617543Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:32.617562Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:32.617565Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:32.717900Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:32.717918Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:32.717920Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:32.818244Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:32.818267Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:32.818270Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:32.918609Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:32.918627Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:32.918630Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:33.018979Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:33.019001Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:33.019004Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:33.119297Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:33.119314Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:33.119317Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:33.219630Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:33.219643Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:33.219644Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:33.320034Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:33.320057Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:33.320060Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:33.420377Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:33.420395Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:33.420398Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:33.520711Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:33.520728Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:33.520731Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:33.621043Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:33.621058Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:33.621061Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:33.721409Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:33.721428Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:33.721431Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:33.821776Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:33.821794Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:33.821797Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:33.922120Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:33.922136Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:33.922139Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:34.022426Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:34.022443Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:34.022445Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:34.122864Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:34.122885Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:34.122888Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:34.223171Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:34.223187Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:34.223189Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:34.323557Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:34.323579Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:34.323583Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:34.423868Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:34.423885Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:34.423888Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:34.524254Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:34.524272Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:34.524275Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:34.624580Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:34.624608Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:34.624610Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:34.724918Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:34.724933Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:34.724936Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:34.825275Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:34.825293Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:34.825296Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:34.925630Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:34.925645Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:34.925648Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:35.026005Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:35.026023Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:35.026026Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:35.126334Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:35.126350Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:35.126352Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:35.226681Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:35.226696Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:35.226698Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:35.327045Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:35.327062Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:35.327065Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:35.427392Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:35.427411Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:35.427414Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:35.527756Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:35.527776Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:35.527779Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:35.628118Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:35.628138Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:35.628141Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:35.728449Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:35.728464Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:35.728466Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:35.828816Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:35.828834Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:35.828837Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:35.929171Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:35.929196Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:35.929200Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:36.029531Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:36.029551Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:36.029554Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:36.129893Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:36.129913Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:36.129915Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:36.230219Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:36.230235Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:36.230237Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:36.330593Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:36.330611Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:36.330614Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:36.430937Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:36.430956Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:36.430959Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:36.531322Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:36.531345Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:36.531349Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:36.631620Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:36.631638Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:36.631641Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:36.731979Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:36.731996Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:36.731998Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:36.832336Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:36.832354Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:36.832357Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:36.932679Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:36.932695Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:36.932697Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:37.033049Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:37.033069Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:37.033073Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:37.111365Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:155: [72075186224037893][rt3.dc1--test-topic] TPersQueueReadBalancer::HandleWakeup
2025-10-10T14:32:37.111394Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 3
2025-10-10T14:32:37.111675Z node 3 :PERSQUEUE DEBUG: partition.cpp:1000: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 0 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-10-10T14:32:37.111915Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 9 Generation: 1 StatsReportRound: 3 DataSize: 0 UsedReserveSize: 0
2025-10-10T14:32:37.111954Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-10-10T14:32:37.121110Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:182: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:32:37.133380Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:37.133395Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:37.133397Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:37.233747Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:37.233767Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:37.233770Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:37.334106Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:37.334120Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:37.334122Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:37.434443Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:37.434459Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:37.434461Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:37.534788Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:37.534804Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:37.534806Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:37.635135Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:37.635156Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:37.635159Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:37.735494Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:37.735511Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:37.735513Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:37.835859Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:37.835886Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:37.835889Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:37.936194Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:37.936210Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:37.936213Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:38.036551Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:38.036569Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:38.036573Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:38.136844Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:38.136859Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:38.136862Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:38.237216Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:38.237234Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:38.237236Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
>>> Ready to answer: ok
2025-10-10T14:32:38.337591Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:38.337605Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:38.337607Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:38.437951Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:38.437967Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:38.437969Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:38.538303Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:38.538319Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:38.538321Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:38.638632Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:38.638646Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:38.638647Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:38.739021Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:38.739036Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:38.739039Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:38.839385Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:38.839401Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:38.839403Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:38.939720Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:38.939736Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:38.939739Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:39.040046Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:39.040068Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:39.040071Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:39.140425Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:39.140444Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:39.140447Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:39.240739Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:39.240759Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:39.240761Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:39.341126Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:39.341149Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:39.341152Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:39.441456Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:39.441478Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:39.441480Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:39.541830Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:39.541854Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:39.541856Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:39.642182Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:39.642198Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:39.642200Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:39.742546Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:39.742565Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:39.742568Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:39.842893Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:39.842931Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:39.842934Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:39.943184Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:39.943203Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:39.943206Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:40.043589Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:40.043621Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:40.043624Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:40.143964Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:40.143988Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:40.143990Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:40.244299Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:40.244318Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:40.244321Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:40.344653Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:40.344670Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:40.344672Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:40.444994Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:40.445010Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:40.445012Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:40.545367Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:40.545385Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:40.545387Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:40.645725Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:40.645739Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:40.645741Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:40.746059Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:40.746081Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:40.746083Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:40.846409Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:40.846424Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:40.846426Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:40.946757Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:40.946772Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:40.946775Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:41.047130Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:41.047151Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:41.047154Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:41.147469Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:41.147486Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:41.147489Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:41.247809Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:41.247825Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:41.247828Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:41.348205Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:41.348229Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:41.348233Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:41.448530Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:41.448559Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:41.448562Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:41.548860Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:41.548898Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:41.548902Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:41.649211Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:41.649230Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:41.649233Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:41.749591Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:41.749612Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:41.749615Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:41.849957Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:41.849993Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:41.849997Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:41.950301Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:41.950321Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:41.950324Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:42.050635Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:42.050657Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:42.050659Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:42.121369Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:182: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:32:42.150980Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:42.150996Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:42.150998Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:42.251297Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:42.251314Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:42.251316Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:42.351692Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:42.351711Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:42.351715Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:42.452044Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:42.452060Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:42.452062Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:42.552390Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:42.552406Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:42.552409Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:42.652743Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:42.652763Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:42.652766Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:42.753109Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:42.753129Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:42.753133Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:42.853466Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:42.853486Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:42.853490Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:42.953800Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:42.953816Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:42.953819Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:43.054164Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:43.054183Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:43.054186Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:43.154509Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:43.154526Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:43.154528Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:43.254856Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:43.254871Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:43.254874Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:43.355229Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:43.355250Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:43.355254Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:43.455528Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:43.455547Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:43.455550Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:43.555886Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:43.555905Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:43.555908Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:43.656258Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:43.656274Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:43.656277Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:43.756631Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:43.756649Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:43.756651Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:43.856984Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:43.857020Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:43.857023Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:43.957322Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:43.957354Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:43.957357Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:44.057676Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:44.057696Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:44.057700Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:44.158042Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:44.158062Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:44.158065Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:44.258407Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:44.258430Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:44.258434Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:44.358725Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:44.358758Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:44.358761Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:44.459087Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:44.459104Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:44.459107Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:44.559442Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:44.559461Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:44.559464Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:44.659760Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:44.659776Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:44.659779Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:44.760139Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:44.760155Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:44.760157Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:44.860457Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:44.860475Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:44.860478Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:44.960833Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:44.960848Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:44.960850Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:45.061182Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:45.061199Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:45.061202Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:45.161556Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:45.161573Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:45.161575Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:45.261898Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:45.261913Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:45.261916Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:45.362262Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:45.362280Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:45.362282Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:45.462585Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:45.462600Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:45.462603Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:45.562976Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:45.562996Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:45.562999Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:45.663334Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:45.663356Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:45.663360Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:45.763663Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:45.763681Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:45.763684Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:45.864029Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:45.864052Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:45.864056Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:45.964367Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:45.964388Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:45.964391Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:46.064721Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:46.064743Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:46.064747Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:46.165085Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:46.165110Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:46.165113Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:46.265408Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:46.265429Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:46.265432Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:46.365779Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:46.365795Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:46.365798Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:46.466125Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:46.466150Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:46.466152Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:46.566473Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:46.566490Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:46.566492Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:46.666852Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:46.666871Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:46.666873Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:46.767176Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:46.767193Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:46.767196Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:46.867539Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:46.867555Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:46.867557Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:46.967886Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:46.967904Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:46.967907Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:47.068239Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:47.068259Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:47.068263Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:47.121528Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:182: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:32:47.168571Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:47.168588Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:47.168591Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:47.268931Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:47.268947Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:47.268949Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:47.369301Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:47.369320Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:47.369327Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:47.469646Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:47.469663Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:47.469666Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:47.569990Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:47.570007Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:47.570010Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:47.670346Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:47.670362Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:47.670365Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:47.770717Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:47.770733Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:47.770736Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:47.871070Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:47.871088Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:47.871091Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:47.971414Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:47.971433Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:47.971436Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:48.071773Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:48.071793Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:48.071796Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:48.172119Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:48.172143Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:48.172146Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:48.236650Z :INFO: [/Root] [] [] Start federated write session to database 'dc1' (previous was dc2) FederationState: { Status: SUCCESS SelfLocation: "fancy_datacenter" DbInfos: [ { name: "dc1" path: "/Root" id: "account-dc1" endpoint: "localhost:14001" location: "dc1" status: AVAILABLE weight: 1000 } { name: "dc2" path: "/Root" id: "account-dc2" endpoint: "localhost:14001" location: "dc2" status: AVAILABLE weight: 500 } { name: "dc3" path: "/Root" id: "account-dc3" endpoint: "localhost:14001" location: "dc3" status: AVAILABLE weight: 500 } ] ControlPlaneEndpoint: cp.logbroker-federation:2135 }
2025-10-10T14:32:48.236764Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: try to update token
2025-10-10T14:32:48.236801Z :INFO: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Start write session. Will connect to nodeId: 0
2025-10-10T14:32:48.237070Z :INFO: [/Root]  TraceId []  SessionId [src_id|4cd5eb85-a25ce75d-3f9c8924-e64c0f63_0]  MessageGroupId [src_id] Write session: close. Timeout 0.000000s
2025-10-10T14:32:48.237075Z :INFO: [/Root]  TraceId []  SessionId [src_id|4cd5eb85-a25ce75d-3f9c8924-e64c0f63_0]  MessageGroupId [src_id] Write session will now close
2025-10-10T14:32:48.237094Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|4cd5eb85-a25ce75d-3f9c8924-e64c0f63_0]  MessageGroupId [src_id] Write session: aborting
2025-10-10T14:32:48.237094Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: write to message_group: src_id
2025-10-10T14:32:48.237148Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: send init request: init_request { path: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:48.237204Z :INFO: [/Root]  TraceId []  SessionId [src_id|4cd5eb85-a25ce75d-3f9c8924-e64c0f63_0]  MessageGroupId [src_id] Write session: gracefully shut down, all writes complete
2025-10-10T14:32:48.237210Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|4cd5eb85-a25ce75d-3f9c8924-e64c0f63_0]  MessageGroupId [src_id] Write session: destroy
2025-10-10T14:32:48.237375Z node 3 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:48.237393Z node 3 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 4
2025-10-10T14:32:48.237435Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3 sessionId: src_id|4cd5eb85-a25ce75d-3f9c8924-e64c0f63_0 grpc read done: success: 0 data: 
2025-10-10T14:32:48.237447Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 3 sessionId: src_id|4cd5eb85-a25ce75d-3f9c8924-e64c0f63_0 grpc read failed
2025-10-10T14:32:48.237463Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: OnWriteDone gRpcStatusCode: 0
2025-10-10T14:32:48.237458Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 3 sessionId: src_id|4cd5eb85-a25ce75d-3f9c8924-e64c0f63_0 grpc closed
2025-10-10T14:32:48.237468Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3 sessionId: src_id|4cd5eb85-a25ce75d-3f9c8924-e64c0f63_0 is DEAD
2025-10-10T14:32:48.237542Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 4 sessionId:  grpc read done: success: 1 data: init_request { path: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:48.237579Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 4 path: "test-topic" message_group_id: "src_id" from ipv6:[::1]:35572
2025-10-10T14:32:48.237590Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=4 sessionId= userAgent="topic server" ip=ipv6:[::1]:35572 proto=topic  topic=test-topic durationSec=0
2025-10-10T14:32:48.237594Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:48.237763Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-10-10T14:32:48.237821Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [3:7559600751000764767:3124] destroyed
2025-10-10T14:32:48.237840Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-10-10T14:32:48.237850Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:48.237854Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:48.237856Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:48.237996Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 4 sessionId:  describe result for acl check
2025-10-10T14:32:48.238035Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:48.238042Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:48.238044Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:48.238050Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [3:7559601008698807564:4069] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:48.238579Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [3:7559601008698807564:4069] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:48.240730Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [3:7559601008698807564:4069] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:48.243676Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [3:7559601008698807564:4069] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:48.243689Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [3:7559601008698807564:4069] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:48.243692Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [3:7559601008698807564:4069] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:48.243701Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 4 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:48.243869Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 3, Generation: 1
2025-10-10T14:32:48.243869Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [3:7559601008698807591:4069], now have 1 active actors on pipe
2025-10-10T14:32:48.243876Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:48.243881Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:48.243908Z node 3 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e321841f-e1488afd-d1184a61-3d904c22_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:48.243918Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:48.243929Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:48.243931Z node 3 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:48.243945Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:48.243964Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:48.243987Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:48.244030Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:48.244040Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:48.244069Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:48.244108Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 4 partition: 0 MaxSeqNo: 2 sessionId: src_id|e321841f-e1488afd-d1184a61-3d904c22_0
2025-10-10T14:32:48.244391Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: OnReadDone gRpcStatusCode: 0
2025-10-10T14:32:48.244410Z :INFO: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1760106768244 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-10T14:32:48.244445Z :INFO: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session established. Init response: last_seq_no: 2 session_id: "src_id|e321841f-e1488afd-d1184a61-3d904c22_0" supported_codecs { codecs: 1 codecs: 2 codecs: 3 }
2025-10-10T14:32:48.272467Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:48.272488Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:48.272492Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:48.372820Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:48.372839Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:48.372842Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:48.473182Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:48.473199Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:48.473201Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:48.573518Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:48.573537Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:48.573540Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:48.673903Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:48.673923Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:48.673926Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:48.774212Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:48.774229Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:48.774230Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:48.874593Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:48.874629Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:48.874632Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:48.974925Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:48.974941Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:48.974944Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:49.075273Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:49.075291Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:49.075295Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:49.175623Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:49.175641Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:49.175643Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:49.244195Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [3:7559601008698807564:4069] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:49.249796Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [3:7559601008698807564:4069] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=1 Status=SUCCESS
2025-10-10T14:32:49.249809Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [3:7559601008698807564:4069] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:49.275975Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:49.275993Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:49.275996Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:49.376336Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:49.376355Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:49.376357Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:49.476667Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:49.476686Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:49.476689Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:49.576985Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:49.577002Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:49.577005Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:49.677424Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:49.677439Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:49.677442Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:49.777749Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:49.777768Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:49.777771Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:49.878090Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:49.878108Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:49.878110Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:49.978442Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:49.978471Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:49.978475Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:50.078766Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:50.078786Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:50.078789Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:50.179149Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:50.179168Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:50.179171Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:50.279506Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:50.279525Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:50.279528Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:50.379870Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:50.379891Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:50.379895Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:50.480217Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:50.480238Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:50.480240Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:50.580568Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:50.580587Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:50.580590Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:50.680915Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:50.680936Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:50.680938Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:50.781270Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:50.781289Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:50.781292Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:50.881602Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:50.881622Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:50.881624Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:50.981966Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:50.981987Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:50.981990Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:51.082321Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:51.082341Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:51.082345Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:51.182685Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:51.182706Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:51.182709Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:51.283015Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:51.283046Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:51.283049Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:51.383400Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:51.383419Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:51.383422Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:51.483736Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:51.483754Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:51.483758Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:51.584086Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:51.584105Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:51.584108Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:51.684441Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:51.684460Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:51.684463Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:51.784752Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:51.784771Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:51.784774Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:51.885142Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:51.885160Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:51.885163Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:51.985511Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:51.985531Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:51.985544Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:52.085866Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:52.085890Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:52.085894Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:52.121751Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:182: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:32:52.186176Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:52.186196Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:52.186200Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:52.286547Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:52.286572Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:52.286575Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:52.386910Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:52.386936Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:52.386939Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:52.487213Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:52.487244Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:52.487246Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:52.587611Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:52.587635Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:52.587638Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:52.687943Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:52.687961Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:52.687964Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:52.788289Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:52.788309Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:52.788312Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:52.888672Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:52.888694Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:52.888696Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:52.989018Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:52.989042Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:52.989045Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:53.089384Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:53.089412Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:53.089416Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:53.189724Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:53.189746Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:53.189749Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:53.290064Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:53.290087Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:53.290091Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:53.390407Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:53.390429Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:53.390433Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:53.490759Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:53.490779Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:53.490782Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:53.591141Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:53.591167Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:53.591170Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:53.691471Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:53.691493Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:53.691495Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:53.791825Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:53.791846Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:53.791849Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:53.892178Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:53.892211Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:53.892214Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:53.992527Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:53.992550Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:53.992553Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:54.092871Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:54.092888Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:54.092891Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:54.193236Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:54.193253Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:54.193256Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:54.293606Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:54.293628Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:54.293630Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:54.393940Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:54.393962Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:54.393966Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:54.494292Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:54.494310Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:54.494313Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:54.594634Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:54.594648Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:54.594651Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:54.694982Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:54.695002Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:54.695005Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:54.795330Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:54.795347Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:54.795350Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:54.895693Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:54.895714Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:54.895717Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:54.996036Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:54.996052Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:54.996054Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:55.096419Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:55.096439Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:55.096441Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:55.196742Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:55.196759Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:55.196761Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:55.297079Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:55.297101Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:55.297104Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:55.397454Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:55.397474Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:55.397477Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:55.497795Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:55.497813Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:55.497815Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:55.598147Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:55.598162Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:55.598164Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:55.698458Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:55.698475Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:55.698477Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:55.798859Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:55.798875Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:55.798877Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:55.899229Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:55.899256Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:55.899260Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:55.999577Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:55.999597Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:55.999600Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:56.099957Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:56.099978Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:56.099982Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:56.200274Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:56.200294Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:56.200296Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:56.300601Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:56.300619Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:56.300623Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:56.400978Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:56.400996Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:56.400999Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:56.501322Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:56.501356Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:56.501360Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:56.601690Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:56.601707Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:56.601710Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:56.702010Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:56.702031Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:56.702034Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:56.802374Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:56.802392Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:56.802396Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:56.902733Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:56.902753Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:56.902756Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:57.003052Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:57.003072Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:57.003076Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:57.103402Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:57.103417Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:57.103419Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:57.121893Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:182: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:32:57.203791Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:57.203819Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:57.203822Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:57.304143Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:57.304161Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:57.304164Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:57.404478Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:57.404492Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:57.404494Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:57.504850Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:57.504871Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:57.504874Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:57.605208Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:57.605229Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:57.605233Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:57.705547Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:57.705574Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:57.705578Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:57.805921Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:57.805940Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:57.805944Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:57.906250Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:57.906272Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:57.906275Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:58.006619Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:58.006639Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:58.006643Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:58.106927Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:58.106947Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:58.106950Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:58.207300Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:58.207319Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:58.207321Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:58.307664Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:58.307685Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:58.307688Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:58.408006Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:58.408023Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:58.408027Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:58.508359Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:58.508376Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:58.508378Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:58.608710Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:58.608727Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:58.608730Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:58.709062Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:58.709081Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:58.709084Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:58.809390Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:58.809407Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:58.809409Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:58.909776Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:58.909799Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:58.909802Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:59.010121Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:59.010138Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:59.010140Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:59.110437Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:59.110463Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:59.110465Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:59.210819Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:59.210834Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:59.210836Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:59.311159Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:59.311178Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:59.311182Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:59.411527Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:59.411545Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:59.411547Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:59.511883Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:59.511905Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:59.511907Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:59.612253Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:59.612282Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:59.612285Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:59.712602Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:59.712621Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:59.712625Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:59.812941Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:59.812963Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:59.812966Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:59.913299Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:59.913320Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:59.913324Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:00.013641Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:00.013657Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:00.013660Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:00.114006Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:00.114024Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:00.114027Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:00.214338Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:00.214354Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:00.214356Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:00.314700Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:00.314718Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:00.314721Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:00.415052Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:00.415071Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:00.415074Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:00.515421Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:00.515441Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:00.515455Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:00.615769Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:00.615792Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:00.615795Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:00.716110Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:00.716130Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:00.716133Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:00.816491Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:00.816512Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:00.816515Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:00.916822Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:00.916839Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:00.916842Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:01.017169Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:01.017188Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:01.017191Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:01.117536Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:01.117557Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:01.117560Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:01.217874Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:01.217897Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:01.217906Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:01.318224Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:01.318244Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:01.318247Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:01.418570Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:01.418591Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:01.418595Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:01.518908Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:01.518929Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:01.518932Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:01.619275Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:01.619290Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:01.619293Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:01.719633Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:01.719651Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:01.719654Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:01.820004Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:01.820027Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:01.820030Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:01.920279Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:01.920294Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:01.920296Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:02.020679Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:02.020696Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:02.020698Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:02.121019Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:02.121036Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:02.121039Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:02.122106Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:182: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:33:02.221381Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:02.221409Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:02.221411Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:02.321706Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:02.321725Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:02.321727Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:02.422072Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:02.422088Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:02.422090Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:02.522450Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:02.522468Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:02.522470Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:02.622770Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:02.622789Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:02.622792Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:02.723129Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:02.723159Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:02.723162Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:02.823504Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:02.823525Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:02.823529Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:02.923838Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:02.923860Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:02.923863Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:03.024204Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:03.024220Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:03.024223Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:03.124552Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:03.124569Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:03.124572Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:03.224904Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:03.224926Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:03.224929Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:03.325249Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:03.325266Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:03.325268Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:03.425601Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:03.425616Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:03.425619Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:03.525959Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:03.525979Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:03.525981Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:03.626323Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:03.626341Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:03.626343Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:03.726664Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:03.726681Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:03.726685Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:03.826995Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:03.827017Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:03.827020Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:03.927386Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:03.927404Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:03.927408Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:04.027721Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:04.027738Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:04.027741Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:04.128060Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:04.128076Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:04.128078Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:04.228398Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:04.228414Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:04.228416Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:04.328815Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:04.328847Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:04.328850Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:04.429124Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:04.429140Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:04.429142Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:04.529492Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:04.529508Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:04.529510Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:04.629844Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:04.629870Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:04.629874Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:04.730176Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:04.730195Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:04.730197Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:04.830550Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:04.830569Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:04.830572Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:04.930888Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:04.930905Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:04.930907Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:05.031242Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:05.031270Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:05.031272Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:05.131593Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:05.131621Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:05.131624Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:05.231959Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:05.231978Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:05.231980Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:05.332298Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:05.332315Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:05.332317Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:05.432682Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:05.432702Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:05.432704Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:05.533008Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:05.533032Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:05.533035Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:05.633366Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:05.633384Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:05.633387Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:05.733702Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:05.733720Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:05.733723Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:05.834021Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:05.834041Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:05.834045Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:05.934422Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:05.934444Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:05.934447Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:06.034767Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:06.034786Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:06.034789Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:06.135120Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:06.135140Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:06.135144Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:06.235469Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:06.235488Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:06.235492Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:06.335822Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:06.335846Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:06.335849Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:06.436151Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:06.436172Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:06.436174Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:06.536516Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:06.536535Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:06.536537Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:06.636851Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:06.636869Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:06.636872Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:06.737222Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:06.737239Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:06.737242Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:06.837599Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:06.837618Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:06.837621Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:06.937913Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:06.937928Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:06.937930Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:07.038305Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:07.038328Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:07.038332Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:07.111480Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:155: [72075186224037893][rt3.dc1--test-topic] TPersQueueReadBalancer::HandleWakeup
2025-10-10T14:33:07.111508Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 4
2025-10-10T14:33:07.111818Z node 3 :PERSQUEUE DEBUG: partition.cpp:1000: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 0 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-10-10T14:33:07.112112Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 9 Generation: 1 StatsReportRound: 4 DataSize: 0 UsedReserveSize: 0
2025-10-10T14:33:07.112149Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-10-10T14:33:07.122284Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:182: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:33:07.138633Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:07.138652Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:07.138655Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:07.239005Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:07.239021Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:07.239023Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:07.339304Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:07.339322Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:07.339325Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:07.439684Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:07.439700Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:07.439702Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:07.540024Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:07.540045Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:07.540048Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:07.640396Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:07.640415Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:07.640418Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:07.740742Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:07.740758Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:07.740761Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:07.841107Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:07.841124Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:07.841126Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:07.941460Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:07.941479Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:07.941483Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:08.041821Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:08.041842Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:08.041845Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:08.142156Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:08.142176Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:08.142179Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:08.242491Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:08.242508Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:08.242510Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:08.342874Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:08.342898Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:08.342901Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
>>> Ready to answer: ok
2025-10-10T14:33:08.346646Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|e321841f-e1488afd-d1184a61-3d904c22_0]  MessageGroupId [src_id] Write 1 messages with Id from 1 to 1
>>> Got event: ReadyToAcceptEvent
2025-10-10T14:33:08.347088Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|e321841f-e1488afd-d1184a61-3d904c22_0]  MessageGroupId [src_id] Write session: try to update token
2025-10-10T14:33:08.347102Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|e321841f-e1488afd-d1184a61-3d904c22_0]  MessageGroupId [src_id] Send 1 message(s) (0 left), first sequence number is 3
2025-10-10T14:33:08.347393Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 4 sessionId: src_id|e321841f-e1488afd-d1184a61-3d904c22_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:08.347516Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:08.347623Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:08.347640Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:08.347692Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:33:08.347733Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:33:08.347763Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:08.347771Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:08.347792Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 3 partNo : 0 messageNo: 1 size 98 offset: -1
2025-10-10T14:33:08.347799Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:33:08.347822Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:08.347838Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:08.347846Z node 3 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:08.347879Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 3 partNo 0
2025-10-10T14:33:08.347936Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 3 partNo 0 FormedBlobsCount 0 NewHead: Offset 2 PartNo 0 PackedSize 172 count 1 nextOffset 3 batches 1
2025-10-10T14:33:08.347948Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:08.348008Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 2,1 HeadOffset 2 endOffset 2 curOffset 3 d0000000000_00000000000000000002_00000_0000000001_00000? size 160 WTime 1760106788347
2025-10-10T14:33:08.348039Z node 3 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:33:08.348056Z node 3 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 2 partNo 0 count 1 size 160
2025-10-10T14:33:08.349225Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 2 count 1 size 160 actorID [3:7559600574907101927:2446]
2025-10-10T14:33:08.349252Z node 3 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:33:08.349290Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 2 partno 0 count 1 parts 0 suffix '63' size 160
2025-10-10T14:33:08.349299Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 105 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:33:08.349309Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:33:08.349319Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 3, partNo: 0, Offset: 2 is stored on disk
2025-10-10T14:33:08.349370Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:08.349378Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:08.349380Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:08.349387Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:182: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:33:08.349397Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:1181: [PQ: 72075186224037892] Topic 'rt3.dc1--test-topic' counters. CacheSize 480 CachedBlobs 3
2025-10-10T14:33:08.349410Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-10-10T14:33:08.349436Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-10T14:33:08.349640Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|e321841f-e1488afd-d1184a61-3d904c22_0]  MessageGroupId [src_id] Write session: OnReadDone gRpcStatusCode: 0
2025-10-10T14:33:08.349712Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|e321841f-e1488afd-d1184a61-3d904c22_0]  MessageGroupId [src_id] Write session got write response: acks { seq_no: 3 written { offset: 2 } } write_statistics { persisting_time { nanos: 1000000 } min_queue_wait_time { } max_queue_wait_time { } partition_quota_wait_time { } topic_quota_wait_time { } }
2025-10-10T14:33:08.349719Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|e321841f-e1488afd-d1184a61-3d904c22_0]  MessageGroupId [src_id] OnAck: seqNo=1, txId=?
2025-10-10T14:33:08.349722Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|e321841f-e1488afd-d1184a61-3d904c22_0]  MessageGroupId [src_id] Write session: acknoledged message 1
2025-10-10T14:33:08.349953Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 4 sessionId: src_id|e321841f-e1488afd-d1184a61-3d904c22_0 grpc read done: success: 0 data: 
2025-10-10T14:33:08.349962Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 4 sessionId: src_id|e321841f-e1488afd-d1184a61-3d904c22_0 grpc read failed
2025-10-10T14:33:08.349970Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 4 sessionId: src_id|e321841f-e1488afd-d1184a61-3d904c22_0 grpc closed
2025-10-10T14:33:08.349974Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 4 sessionId: src_id|e321841f-e1488afd-d1184a61-3d904c22_0 is DEAD
2025-10-10T14:33:08.350118Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-10-10T14:33:08.350198Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [3:7559601008698807591:4069] destroyed
2025-10-10T14:33:08.350214Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-10-10T14:33:08.350224Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:08.350234Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|e321841f-e1488afd-d1184a61-3d904c22_0]  MessageGroupId [src_id] Write session: OnReadDone gRpcStatusCode: 1, Msg: Cancelled on the server side, Details: , InternalError: 0
2025-10-10T14:33:08.350227Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:08.350229Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:08.350252Z :ERROR: [/Root]  TraceId []  SessionId [src_id|e321841f-e1488afd-d1184a61-3d904c22_0]  MessageGroupId [src_id] Got error. Status: CLIENT_CANCELLED, Description: <main>: Error: GRpc error: (1): Cancelled on the server side 
2025-10-10T14:33:08.350255Z :ERROR: [/Root]  TraceId []  SessionId [src_id|e321841f-e1488afd-d1184a61-3d904c22_0]  MessageGroupId [src_id] Write session will not restart after a fatal error
2025-10-10T14:33:08.350259Z :INFO: [/Root]  TraceId []  SessionId [src_id|e321841f-e1488afd-d1184a61-3d904c22_0]  MessageGroupId [src_id] Write session will now close
2025-10-10T14:33:08.350272Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|e321841f-e1488afd-d1184a61-3d904c22_0]  MessageGroupId [src_id] Write session: aborting
2025-10-10T14:33:08.353882Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|e321841f-e1488afd-d1184a61-3d904c22_0]  MessageGroupId [src_id] Write session: destroy
2025-10-10T14:33:08.443215Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:08.443237Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:08.443240Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:08.543549Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:08.543566Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:08.543567Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:30:54.352383Z :WriteSessionWriteInHandlers INFO: Random seed for debugging is 1760106654352378
2025-10-10T14:30:54.433246Z node 1 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[1:7559600516779849517:2151];send_to=[0:7307199536658146131:7762515];
2025-10-10T14:30:54.433260Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-10-10T14:30:54.437048Z node 1 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-10-10T14:30:54.437294Z node 2 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[2:7559600517969502986:2076];send_to=[0:7307199536658146131:7762515];
2025-10-10T14:30:54.437698Z node 2 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
test_client.cpp: SetPath # /home/runner/.ya/build/build_root/z96o/002b66/r3tmp/tmpjMcb9O/pdisk_1.dat
2025-10-10T14:30:54.439924Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-10-10T14:30:54.464779Z node 2 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-10T14:30:54.467253Z node 1 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-10-10T14:30:54.467374Z node 1 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
TServer::EnableGrpc on GrpcPort 17298, node 1
2025-10-10T14:30:54.485278Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:190: distributable config is empty, broken or outdated, will use file: /home/runner/.ya/build/build_root/z96o/002b66/r3tmp/yandexvAlJcj.tmp
2025-10-10T14:30:54.485294Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:196: will try to initialize from file: /home/runner/.ya/build/build_root/z96o/002b66/r3tmp/yandexvAlJcj.tmp
2025-10-10T14:30:54.485371Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:202: successfully initialized from file: /home/runner/.ya/build/build_root/z96o/002b66/r3tmp/yandexvAlJcj.tmp
2025-10-10T14:30:54.485421Z node 1 :NET_CLASSIFIER ERROR: net_classifier.cpp:228: got bad distributable configuration
2025-10-10T14:30:54.489762Z INFO: TTestServer started on Port 14235 GrpcPort 17298
TClient is connected to server localhost:14235
PQClient connected to localhost:17298
WaitRootIsUp 'Root'...
TClient::Ls request: Root
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "Root"
    PathId: 1
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 1
    CreateStep: 0
    ParentPathId: 1
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 1
      SubDomainVersion: 0
      SecurityStateVersion: 0
    }
    ChildrenExist: false
  }
  Children {
    Name: ".sys"
    PathId: 18446744073709551615
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 0
    CreateStep: 0
    ParentPathId: 18446744073709551615
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 0
      Pl...
(TRUNCATED)
WaitRootIsUp 'Root' success.
2025-10-10T14:30:54.534739Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-10T14:30:54.534774Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-10T14:30:54.536315Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Connecting -> Connected
2025-10-10T14:30:54.539507Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpAlterSubDomain, opId: 281474976720657:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_alter_subdomain.cpp:311)
2025-10-10T14:30:54.540065Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-10T14:30:54.540085Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-10T14:30:54.541005Z node 1 :HIVE WARN: hive_impl.cpp:811: HIVE#72057594037968897 Handle TEvInterconnect::TEvNodeConnected, NodeId 2 Cookie 2
2025-10-10T14:30:54.541279Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Connecting -> Connected
waiting...
waiting...
waiting...
waiting...
2025-10-10T14:30:54.659363Z node 1 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-10-10T14:30:54.728618Z node 2 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-10-10T14:30:54.817968Z node 2 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:566: Compilation failed, self: [2:7559600517969503261:2289], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-10T14:30:54.818066Z node 2 :KQP_SESSION WARN: kqp_session_actor.cpp:2408: SessionId: ydb://session/3?node_id=2&id=M2RjM2MyODktNzEyODJlZTEtOWVjM2EzYzMtN2JhOGQ2YzM=, ActorId: [2:7559600517969503259:2288], ActorState: ExecuteState, TraceId: 01k778gb1g4acdvy5rerm22gre, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-10T14:30:54.818304Z node 1 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:566: Compilation failed, self: [1:7559600516779850336:2318], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-10T14:30:54.818541Z node 2 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-10-10T14:30:54.818634Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2408: SessionId: ydb://session/3?node_id=1&id=YWVhNTU2OTgtYzcyYjM0MGEtZDRkZWFiY2UtZmE2MGRmMzE=, ActorId: [1:7559600516779850333:2316], ActorState: ExecuteState, TraceId: 01k778gb1p561sjvnec8354e96, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-10T14:30:54.818739Z node 1 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-10-10T14:30:54.819817Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720661:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-10T14:30:54.844105Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720662:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-10T14:30:54.864265Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720663:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
=== Init DC: UPSERT INTO `/Root/PQ/Config/V2/Cluster` (name, balancer, local, enabled, weight) VALUES ("dc1", "localhost:17298", true, true, 1000), ("dc2", "dc2.logbroker.yandex.net", false, false, 1000);
2025-10-10T14:30:54.903105Z node 1 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976720664. Ctx: { TraceId: 01k778gb4z7s9yba1nbzka24h6, Database: , SessionId: ydb://session/3?node_id=1&id=N2Q1OGJjOC1kNmU4M2NlNy1jODNiMWNiNy02YzYxOGQyNg==, PoolId: , DatabaseId: /Root}. Database not set, use /Root
=== CheckClustersList. Subcribe to ClusterTracker from [1:7559600516779850716:2894] 
2025-10-10T14:30:55.435147Z node 1 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-10-10T14:30:55.439750Z node 2 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-10-10T14:30:59.433365Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[1:7559600516779849517:2151];send_to=[0:7307199536658146131:7762515];
2025-10-10T14:30:59.433392Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
2025-10-10T14:30:59.437454Z node 2 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[2:7559600517969502986:2076];send_to=[0:7307199536658146131:7762515];
2025-10-10T14:30:59.437486Z node 2 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
=== CheckClustersList. Ok
2025-10-10T14:30:59.998194Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720676:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
waiting...
PQ Client: create topic: rt3.dc1--test-topic with 1 partitions
CallPersQueueGRPC request to localhost:17298
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-10T14:31:00.013728Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
CallPersQueueGRPC request to localhost:17298
MetaRequest {
  CmdCreateTopic {
    Topic: "rt3.dc1--test-topic"
    NumPartitions: 1
    Config {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
  }
}
CallPersQueueGRPC response:
Status: 129
ProxyErrorCode: 53
SchemeStatus: 1
FlatTxId {
  TxId: 281474976720677
  SchemeShardTabletId: 72057594046644480
  PathId: 9
}
ErrorCode: OK
AddTopic: rt3.dc1--test-topic
===Run query:``DECLARE $version as Int64; DECLARE $path AS Utf8; DECLARE $cluster as Utf8; UPSERT INTO `/Root/PQ/Config/V2/Topics` (path, dc) VALUES ($path, $cluster); UPSERT INTO `/Root/PQ/Config/V2/Versions` (name, version) VALUES ("Topics", $version);`` with topic = test-topic, dc = dc1
2025-10-10T14:31:00.018912Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][] pipe [1:7559600542549655004:3190] connected; active server actors: 1
2025-10-10T14:31:00.018996Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1517: [72075186224037893][rt3.dc1--test-topic] updating configuration. Deleted partitions []. Added partitions [0]
2025-10-10T14:31:00.019082Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:940: [72075186224037893][rt3.dc1--test-topic] Discovered subdomain [OwnerId: 72057594046644480, LocalPathId: 1] state, outOfSpace = 0 at RB 72075186224037893
2025-10-10T14:31:00.019298Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:138: [72075186224037893][rt3.dc1--test-topic] BALANCER INIT DONE for rt3.dc1--test-topic: (0, 72075186224037892) 
2025-10-10T14:31:00.022439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:00.022914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:00.022970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:784: [PQ: 72075186224037892] no config, start with empty partitions and default config
2025-10-10T14:31:00.022981Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:00.022992Z node 2 :PERSQUEUE INFO: pq_impl.cpp:609: [PQ: 72075186224037892] doesn't have tx writes info
2025-10-10T14:31:00.023029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600542549655003:3189], now have 1 active actors on pipe
2025-10-10T14:31:00.023045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600542549655022:2439], now have 1 active actors on pipe
2025-10-10T14:31:00.023095Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1
2025-10-10T14:31:00.023145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-10T14:31:00.024024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-10T14:31:00.025229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600542549655058:3234], now have 1 active actors on pipe
2025-10-10T14:31:00.025319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-10T14:31:00.026083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-10T14:31:00.026263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:00.026286Z node 2 :PERSQUEUE DEBUG: partition.cpp:1277: [72075186224037892][Partition][0][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-10-10T14:31:00.026340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:00.026391Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600543739307584:2381]
2025-10-10T14:31:00.027123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:00.027129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:00.027133Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1 [2:7559600543739307584:2381]
2025-10-10T14:31:00.027138Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-10-10T14:31:00.027415Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 1
2025-10-10T14:31:00.027425Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:00.027448Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:00.027455Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:00.027458Z node 2 :PERSQUEUE DEBUG: partition.cpp:2345: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-10T14:31:00.027460Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:00.027462Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:00.027463Z node 2 :PERSQUEUE DEBUG: partition.cpp:2345: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-10T14:31:00.027486Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:00.027575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-10T14:31:00.027600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:31:00.028495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-10T14:31:00.028528Z node 2 :PERSQUEUE DEBUG: partition.cpp:1381: [72075186224037892][Partition][0][StateIdle] Handle TEvPQ::TEvTxCommit Step 1760106660074, TxId 281474976720677
2025-10-10T14:31:00.028536Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:00.028538Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:00.028561Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:00.028609Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:31:00.029105Z node 2 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:31:00.029158Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:31:00.029169Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:00.029170Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:00.029172Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:00.029175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:31:00.029256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:395: [PQ: 72075186224037892] Apply new config PartitionConfig { LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 } PartitionIds: 0 TopicName: "rt3.dc1--test-topic" Version: 0 LocalDC: true Codecs { Ids: 0 Ids: 1 Ids: 2 Codecs: "raw" Codecs: "gzip" Codecs: "lzop" } TopicPath: "/Root/PQ/rt3.dc1--test-topic" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } Consumers { Name: "user" ReadFromTimestampsMs: 0 FormatVersion: 0 Version: 0 Generation: 0 } MonitoringProjectId: ""
2025-10-10T14:31:00.029274Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:00.029312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-10T14:31:00.030233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-10T14:31:00.030256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-10T14:31:00.030603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-10T14:31:00.032256Z node 1 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976720678. Ctx: { TraceId: 01k778gg5h7xngjsn96awvwc60, Database: , SessionId: ydb://session/3?node_id=1&id=NGFiMGMzZWEtYmNlMWM4MzAtNzc2OGU0ZjUtY2JjODA1NA==, PoolId: , DatabaseId: /Root}. Database not set, use /Root
===Query complete
TClient::Ls request: /Root/PQ/rt3.dc1--test-topic
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976720677
    CreateStep: 1760106660074
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: ...
(TRUNCATED)
GetTopicVersionFromPath:  record Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976720677
    CreateStep: 1760106660074
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      YdbDatabasePath: "/Root"
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
    Partitions {
      PartitionId: 0
      TabletId: 72075186224037892
      Status: Active
    }
    AlterVersion: 1
    BalancerTabletID: 72075186224037893
    NextPartitionId: 1
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 1
      PlanResolution: 7
      Coordinators: 72057594046316545
      TimeCastBucketsPerMediator: 2
      Mediators: 72057594046382081
    }
    DomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    PathsInside: 8
    PathsLimit: 10000
    ShardsInside: 6
    ShardsLimit: 200000
    ResourcesDomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    DiskSpaceUsage {
      Tables {
        TotalSize: 0
        DataSize: 0
        IndexSize: 0
      }
      Topics {
        ReserveSize: 0
        AccountSize: 0
        DataSize: 0
        UsedReserveSize: 0
      }
    }
    PQPartitionsInside: 1
    PQPartitionsLimit: 1000000
    SchemeLimits {
      MaxDepth: 32
      MaxPaths: 10000
      MaxChildrenInDir: 100000
      MaxAclBytesSize: 10240
      MaxTableColumns: 200
      MaxTableColumnNameLength: 255
      MaxTableKeyColumns: 30
      MaxTableIndices: 20
      MaxShards: 200000
      MaxShardsInPath: 35000
      MaxConsistentCopyTargets: 10000
      MaxPathElementLength: 255
      ExtraPathSymbolsAllowed: "!\"#$%&\'()*+,-.:;<=>?@[\\]^_`{|}~"
      MaxPQPartitions: 1000000
      MaxTableCdcStreams: 5
      MaxExports: 10
      MaxImports: 10
      MaxColumnTableColumns: 10000
    }
  }
}
Path: "/Root/PQ/rt3.dc1--test-topic"
 name rt3.dc1--test-topic version1
CallPersQueueGRPC request to localhost:17298
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-10T14:31:00.037074Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-10-10T14:31:00.127644Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:00.127656Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:00.127658Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:00.227987Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:00.227999Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:00.228001Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:00.328335Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:00.328349Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:00.328351Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:00.428690Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:00.428711Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:00.428714Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:00.529040Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:00.529062Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:00.529064Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:17298
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-10T14:31:00.538078Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-10-10T14:31:00.629413Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:00.629430Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:00.629432Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:00.729758Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:00.729774Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:00.729776Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:00.830101Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:00.830116Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:00.830118Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:00.930458Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:00.930473Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:00.930475Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:01.030800Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:01.030827Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:01.030830Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:17298
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-10T14:31:01.039438Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--test-topic"
      NumPartitions: 1
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        TopicPath: "/Root/PQ/rt3.dc1--test-topic"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Version: 0
        }
      }
      ErrorCode: OK
    }
  }
}
=== Topic created, have version: 1
2025-10-10T14:31:01.040440Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: try to update token
2025-10-10T14:31:01.040634Z :INFO: [] MessageGroupId [src] SessionId [] Write session: Do CDS request
2025-10-10T14:31:01.040638Z :INFO: [] MessageGroupId [src] SessionId [] Start write session. Will connect to endpoint: localhost:17298
2025-10-10T14:31:01.041036Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:01.041048Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1
2025-10-10T14:31:01.042547Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src" }
2025-10-10T14:31:01.042744Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src" }
2025-10-10T14:31:01.042793Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1 topic: "test-topic" message_group_id: "src" from ipv6:[::1]:34568
2025-10-10T14:31:01.042806Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:34568 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:01.042810Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:01.043191Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1 sessionId:  describe result for acl check
2025-10-10T14:31:01.043225Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:01.043231Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:01.043232Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:01.043235Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600546844622520:2471] (SourceId=src, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:01.043693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600546844622520:2471] (SourceId=src, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:01.065776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [1:7559600546844622520:2471] (SourceId=src, PreferedPartition=(NULL)) RequestPQRB
2025-10-10T14:31:01.065863Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559600546844622552:2471] connected; active server actors: 1
2025-10-10T14:31:01.065896Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [1:7559600546844622520:2471] (SourceId=src, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=src
2025-10-10T14:31:01.065900Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600546844622520:2471] (SourceId=src, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:01.065967Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559600546844622552:2471] disconnected; active server actors: 1
2025-10-10T14:31:01.065974Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559600546844622552:2471] disconnected no session
2025-10-10T14:31:01.082302Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600546844622520:2471] (SourceId=src, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:01.082317Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600546844622520:2471] (SourceId=src, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-10-10T14:31:01.082319Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600546844622520:2471] (SourceId=src, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:01.082327Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:01.082579Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1
2025-10-10T14:31:01.082596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600546844622570:2471], now have 1 active actors on pipe
2025-10-10T14:31:01.082679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:01.082699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:01.082751Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src|e2b22e04-57685ccd-136eaa33-c498a0df_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src
2025-10-10T14:31:01.082773Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:01.082786Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:01.082790Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:01.082809Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:01.082827Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:01.082859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:01.083089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:01.083103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:01.083123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:01.083216Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1 partition: 0 MaxSeqNo: 0 sessionId: src|e2b22e04-57685ccd-136eaa33-c498a0df_0
2025-10-10T14:31:01.083509Z :INFO: [] MessageGroupId [src] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1760106661083 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-10T14:31:01.083538Z :INFO: [] MessageGroupId [src] SessionId [] Write session established. Init response: session_id: "src|e2b22e04-57685ccd-136eaa33-c498a0df_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:01.083633Z :INFO: [] MessageGroupId [src] SessionId [src|e2b22e04-57685ccd-136eaa33-c498a0df_0] Write session: close. Timeout = 0 ms
2025-10-10T14:31:01.083643Z :INFO: [] MessageGroupId [src] SessionId [src|e2b22e04-57685ccd-136eaa33-c498a0df_0] Write session will now close
2025-10-10T14:31:01.083649Z :DEBUG: [] MessageGroupId [src] SessionId [src|e2b22e04-57685ccd-136eaa33-c498a0df_0] Write session: aborting
2025-10-10T14:31:01.083789Z :INFO: [] MessageGroupId [src] SessionId [src|e2b22e04-57685ccd-136eaa33-c498a0df_0] Write session: gracefully shut down, all writes complete
2025-10-10T14:31:01.083793Z :DEBUG: [] MessageGroupId [src] SessionId [src|e2b22e04-57685ccd-136eaa33-c498a0df_0] Write session: destroy
2025-10-10T14:31:01.083892Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId: src|e2b22e04-57685ccd-136eaa33-c498a0df_0 grpc read done: success: 0 data: 
2025-10-10T14:31:01.083901Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 1 sessionId: src|e2b22e04-57685ccd-136eaa33-c498a0df_0 grpc read failed
2025-10-10T14:31:01.083908Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 1 sessionId: src|e2b22e04-57685ccd-136eaa33-c498a0df_0 grpc closed
2025-10-10T14:31:01.083912Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1 sessionId: src|e2b22e04-57685ccd-136eaa33-c498a0df_0 is DEAD
2025-10-10T14:31:01.084174Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-10-10T14:31:01.084286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [1:7559600546844622570:2471] destroyed
2025-10-10T14:31:01.084298Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-10-10T14:31:01.084304Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:01.084306Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:01.084308Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
=== Before CreateWriteSession
=== Inside ReadyToAcceptHandler
=== Session created
=== Inside ReadyToAcceptHandler
2025-10-10T14:31:01.086877Z :INFO: [/Root] OnFederationDiscovery fall back to single mode, database=/Root
2025-10-10T14:31:01.087055Z :INFO: [/Root] [] [] Start federated write session to database '' (previous was <empty>) FederationState: { Status: SUCCESS SelfLocation: "" DbInfos: [ { path: "/Root" endpoint: "localhost:17298" status: AVAILABLE weight: 100 } ] ControlPlaneEndpoint: localhost:17298 }
2025-10-10T14:31:01.087104Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: try to update token
2025-10-10T14:31:01.087269Z :INFO: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Start write session. Will connect to nodeId: 0
2025-10-10T14:31:01.088024Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: write to message_group: src_id
2025-10-10T14:31:01.088196Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:01.088213Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2
2025-10-10T14:31:01.089172Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: send init request: init_request { path: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:01.089263Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: OnWriteDone gRpcStatusCode: 0
2025-10-10T14:31:01.089359Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId:  grpc read done: success: 1 data: init_request { path: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:01.089384Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2 path: "test-topic" message_group_id: "src_id" from ipv6:[::1]:50514
2025-10-10T14:31:01.089388Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2 sessionId= userAgent="topic server" ip=ipv6:[::1]:50514 proto=topic  topic=test-topic durationSec=0
2025-10-10T14:31:01.089390Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:01.089722Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2 sessionId:  describe result for acl check
2025-10-10T14:31:01.089757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:01.089761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:01.089762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:01.089764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600546844622577:2484] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:01.090196Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600546844622577:2484] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:01.091381Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [1:7559600546844622577:2484] (SourceId=src_id, PreferedPartition=(NULL)) RequestPQRB
2025-10-10T14:31:01.091433Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559600546844622596:2484] connected; active server actors: 1
2025-10-10T14:31:01.091445Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [1:7559600546844622577:2484] (SourceId=src_id, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=src_id
2025-10-10T14:31:01.091447Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600546844622577:2484] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:01.091487Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559600546844622596:2484] disconnected; active server actors: 1
2025-10-10T14:31:01.091492Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559600546844622596:2484] disconnected no session
2025-10-10T14:31:01.093212Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600546844622577:2484] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:01.093221Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600546844622577:2484] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-10-10T14:31:01.093223Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600546844622577:2484] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:01.093227Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:01.093424Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1
2025-10-10T14:31:01.093411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600546844622608:2484], now have 1 active actors on pipe
2025-10-10T14:31:01.093459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:01.093464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:01.093490Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8d7a7f7c-58fd9fc2-c1a0ffc6-c69cebf9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:01.093505Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:01.093511Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:01.093514Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:01.093531Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:01.093544Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:01.093563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:01.093686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:01.093692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:01.093706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:01.093763Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2 partition: 0 MaxSeqNo: 0 sessionId: src_id|8d7a7f7c-58fd9fc2-c1a0ffc6-c69cebf9_0
2025-10-10T14:31:01.093950Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: OnReadDone gRpcStatusCode: 0
2025-10-10T14:31:01.093959Z :INFO: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1760106661093 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-10T14:31:01.093975Z :INFO: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session established. Init response: session_id: "src_id|8d7a7f7c-58fd9fc2-c1a0ffc6-c69cebf9_0" supported_codecs { codecs: 1 codecs: 2 codecs: 3 }
2025-10-10T14:31:01.094019Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|8d7a7f7c-58fd9fc2-c1a0ffc6-c69cebf9_0]  MessageGroupId [src_id] Write 1 messages with Id from 1 to 1
2025-10-10T14:31:01.094227Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|8d7a7f7c-58fd9fc2-c1a0ffc6-c69cebf9_0]  MessageGroupId [src_id] Write session: try to update token
2025-10-10T14:31:01.094240Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|8d7a7f7c-58fd9fc2-c1a0ffc6-c69cebf9_0]  MessageGroupId [src_id] Send 1 message(s) (0 left), first sequence number is 1
2025-10-10T14:31:01.094475Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|8d7a7f7c-58fd9fc2-c1a0ffc6-c69cebf9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:01.094555Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:01.094693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:01.094704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:01.094723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:31:01.094794Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:01.094895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:01.094901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:01.094996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 1 partNo : 0 messageNo: 1 size 115 offset: -1
2025-10-10T14:31:01.095007Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:01.095021Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:01.095031Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:01.095033Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:01.095054Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 1 partNo 0
2025-10-10T14:31:01.095102Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 1 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 189 count 1 nextOffset 1 batches 1
2025-10-10T14:31:01.095110Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:01.095172Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 0,1 HeadOffset 0 endOffset 0 curOffset 1 d0000000000_00000000000000000000_00000_0000000001_00000? size 177 WTime 1760106661094
2025-10-10T14:31:01.095200Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:31:01.095219Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 0 partNo 0 count 1 size 177
2025-10-10T14:31:01.095891Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 0 count 1 size 177 actorID [2:7559600543739307568:2381]
2025-10-10T14:31:01.095914Z node 2 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:31:01.095932Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63' size 177
2025-10-10T14:31:01.095936Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 122 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:31:01.095944Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.095955Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 1, partNo: 0, Offset: 0 is stored on disk
2025-10-10T14:31:01.095987Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:01.095998Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:01.096002Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:01.096005Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:01.096006Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:01.096012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:182: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:31:01.096020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-10-10T14:31:01.096064Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 1 max time lag 0ms effective offset 0
2025-10-10T14:31:01.096084Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 177 count 1 last offset 0, current partition end offset: 1
2025-10-10T14:31:01.096091Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:01.096095Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:01.096102Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 0 partno 0 count 1 parts_count 0 source 1 size 177 accessed 0 times before, last time 2025-10-10T14:31:01.000000Z
2025-10-10T14:31:01.096115Z node 2 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 3. All 1 blobs are from cache.
2025-10-10T14:31:01.096122Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63'
2025-10-10T14:31:01.096128Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:31:01.096142Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 1 count 1 size 157 from pos 0 cbcount 1
2025-10-10T14:31:01.096178Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661094 queuesize 0 startOffset 0
2025-10-10T14:31:01.096260Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|8d7a7f7c-58fd9fc2-c1a0ffc6-c69cebf9_0]  MessageGroupId [src_id] Write session: OnReadDone gRpcStatusCode: 0
2025-10-10T14:31:01.096331Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|8d7a7f7c-58fd9fc2-c1a0ffc6-c69cebf9_0]  MessageGroupId [src_id] Write session got write response: acks { seq_no: 1 written { } } write_statistics { persisting_time { nanos: 1000000 } min_queue_wait_time { } max_queue_wait_time { } partition_quota_wait_time { } topic_quota_wait_time { } }
2025-10-10T14:31:01.096334Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|8d7a7f7c-58fd9fc2-c1a0ffc6-c69cebf9_0]  MessageGroupId [src_id] OnAck: seqNo=1, txId=?
2025-10-10T14:31:01.096338Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|8d7a7f7c-58fd9fc2-c1a0ffc6-c69cebf9_0]  MessageGroupId [src_id] Write session: acknoledged message 1
=== Inside AcksHandler
2025-10-10T14:31:01.096373Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|8d7a7f7c-58fd9fc2-c1a0ffc6-c69cebf9_0]  MessageGroupId [src_id] Write 1 messages with Id from 2 to 2
=== Inside ReadyToAcceptHandler
=== AcksHandler has written a message, closing the session
2025-10-10T14:31:01.096500Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|8d7a7f7c-58fd9fc2-c1a0ffc6-c69cebf9_0]  MessageGroupId [src_id] Write session: try to update token
2025-10-10T14:31:01.096507Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|8d7a7f7c-58fd9fc2-c1a0ffc6-c69cebf9_0]  MessageGroupId [src_id] Send 1 message(s) (0 left), first sequence number is 2
2025-10-10T14:31:01.096624Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|8d7a7f7c-58fd9fc2-c1a0ffc6-c69cebf9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:01.096682Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:01.096788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:01.096795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:01.096806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 2  requestId: <none> cookie: 2
2025-10-10T14:31:01.096852Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:01.096943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:01.096949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:01.096959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 2 partNo : 0 messageNo: 3 size 107 offset: -1
2025-10-10T14:31:01.096968Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:01.096976Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:01.096984Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:01.096985Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:01.096997Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 2 partNo 0
2025-10-10T14:31:01.097018Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 2 partNo 0 FormedBlobsCount 0 NewHead: Offset 1 PartNo 0 PackedSize 181 count 1 nextOffset 2 batches 1
2025-10-10T14:31:01.097025Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:01.097051Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 1,1 HeadOffset 1 endOffset 1 curOffset 2 d0000000000_00000000000000000001_00000_0000000001_00000? size 169 WTime 1760106661096
2025-10-10T14:31:01.097065Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:31:01.097076Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 1 partNo 0 count 1 size 169
2025-10-10T14:31:01.097646Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 1 count 1 size 169 actorID [2:7559600543739307568:2381]
2025-10-10T14:31:01.097666Z node 2 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:31:01.097677Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 114 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:31:01.097677Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 1 partno 0 count 1 parts 0 suffix '63' size 169
2025-10-10T14:31:01.097687Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.097693Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 2, partNo: 0, Offset: 1 is stored on disk
2025-10-10T14:31:01.097713Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:01.097715Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:01.097717Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:01.097722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:182: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:31:01.097729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 3  requestId: <none> cookie: 2
2025-10-10T14:31:01.097779Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:01.097895Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|8d7a7f7c-58fd9fc2-c1a0ffc6-c69cebf9_0]  MessageGroupId [src_id] Write session: OnReadDone gRpcStatusCode: 0
2025-10-10T14:31:01.097914Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|8d7a7f7c-58fd9fc2-c1a0ffc6-c69cebf9_0]  MessageGroupId [src_id] Write session got write response: acks { seq_no: 2 written { offset: 1 } } write_statistics { persisting_time { } min_queue_wait_time { } max_queue_wait_time { } partition_quota_wait_time { } topic_quota_wait_time { } }
2025-10-10T14:31:01.097918Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|8d7a7f7c-58fd9fc2-c1a0ffc6-c69cebf9_0]  MessageGroupId [src_id] OnAck: seqNo=2, txId=?
2025-10-10T14:31:01.097930Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|8d7a7f7c-58fd9fc2-c1a0ffc6-c69cebf9_0]  MessageGroupId [src_id] Write session: acknoledged message 2
=== Inside AcksHandler
=== Inside SessionClosedHandler
2025-10-10T14:31:01.097989Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|8d7a7f7c-58fd9fc2-c1a0ffc6-c69cebf9_0]  MessageGroupId [src_id] Write 1 messages with Id from 3 to 3
=== SessionClosedHandler has 'written' a message
2025-10-10T14:31:01.098013Z :INFO: [/Root]  TraceId []  SessionId [src_id|8d7a7f7c-58fd9fc2-c1a0ffc6-c69cebf9_0]  MessageGroupId [src_id] Write session: close. Timeout 0.000000s
2025-10-10T14:31:01.098015Z :INFO: [/Root]  TraceId []  SessionId [src_id|8d7a7f7c-58fd9fc2-c1a0ffc6-c69cebf9_0]  MessageGroupId [src_id] Write session will now close
2025-10-10T14:31:01.098026Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|8d7a7f7c-58fd9fc2-c1a0ffc6-c69cebf9_0]  MessageGroupId [src_id] Write session: aborting
2025-10-10T14:31:01.098123Z :WARNING: [/Root]  TraceId []  SessionId [src_id|8d7a7f7c-58fd9fc2-c1a0ffc6-c69cebf9_0]  MessageGroupId [src_id] Write session: could not confirm all writes in time or session aborted, perform hard shutdown
2025-10-10T14:31:01.098159Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|8d7a7f7c-58fd9fc2-c1a0ffc6-c69cebf9_0]  MessageGroupId [src_id] Write session: destroy
2025-10-10T14:31:01.098187Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|8d7a7f7c-58fd9fc2-c1a0ffc6-c69cebf9_0 grpc read done: success: 0 data: 
2025-10-10T14:31:01.098191Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 2 sessionId: src_id|8d7a7f7c-58fd9fc2-c1a0ffc6-c69cebf9_0 grpc read failed
2025-10-10T14:31:01.098255Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:824: session v1 closed cookie: 2 sessionId: src_id|8d7a7f7c-58fd9fc2-c1a0ffc6-c69cebf9_0
2025-10-10T14:31:01.098262Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2 sessionId: src_id|8d7a7f7c-58fd9fc2-c1a0ffc6-c69cebf9_0 is DEAD
2025-10-10T14:31:01.098339Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-10-10T14:31:01.098418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [1:7559600546844622608:2484] destroyed
2025-10-10T14:31:01.098428Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-10-10T14:31:01.098432Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:01.098433Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:01.098434Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:01.131158Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:01.131178Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:01.131180Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:01.231524Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:01.231540Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:01.231542Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
